Second half goals from Ollie Watkins and Tyrone Mings saw Albion to defeat on Gerrard's first match in charge since taking over from Dean Smith.
Brighton played well in the first half and Leo Trossard and Tariq Lamptey both had good efforts well saved by home keeper Martinez.
The defeat drops Brighton to eighth in the Premier League and without a win in their last seven.
Dunk said: "It is a frustrating one to take because if you look at the game we controlled the majority of it. But it is no good just controlling the game, we have t get in front and defend it.
"We didn't do that and we got punished for it. That was their game plan to sit there and counter. It was a good atmosphere, we dealt with it well but unfortunate we lost in the end.
"We just lacked that cutting edge and were not quite there in the final third. Our possession were good but it is frustrating.
"We have to get out of this little rut we are in starting with our next home game ].
"We know what we were coming into. It was a new new manager and Steven Gerrard in charge - it was always going to be super loud.
"I thought we dealt with that but not well enough."
Of the frustrating winless run, the Albion skipper added.
"It is a concern but it is a tough league. The performances we are putting in are good but it is hard to win games. From the outside you can sit there and say you should be beating this team and that team but it is not so easy.
"We make sure we work hard and take our game plan onto the pitch and hopefully it works. Unfortunately today it didn't.
"We are in a much position than we have been. Usually we are floating around the relegation zone. At the moment we are a little bit away.
"You can get sucked in quick and we have to make sure that doesn't happen. We know what we are about and we have a big home game coming up (against Leeds)."

1. Diallo set for loan exit
Manchester United winger Amad Diallo is set for a 18-month loan move to Feyenoord. (Daily Star) (Photo by Toru Hanai/Getty Images) Photo: Toru Hanai

2. Wright issues Tarkowski warning
Ian Wright has warned Newcastle United that they may have to pay a premium to sign Burnley star James Tarkowski ahead of West Ham. (PL Productions) (Photo by Alex Livesey/Getty Images) Photo: Alex Livesey

3. Newcastle eye Zakaria
Newcastle United are keeping close tabs on Borussia Monchengladbach midfielder Denis Zakaria, who is currently in the final few months of his contract. (Siamo La Roma) (Photo by Lukas Schulze/Getty Images) Photo: Lukas Schulze

4. Hammers to bid for Lingard
West Ham will submit a bid for Jesse Lingard in January after contract talks with Manchester United collapsed. (Telegraph) (Photo by Charlie Crowhurst/Getty Images) Photo: Charlie Crowhurst