Now at Villa, Dunne goes into Tuesday's Carling Cup semi-final first leg against Blackburn hopeful he can put that right.
"If I can finish the season having done well in the league and with a trophy, it's been a successful season," he said.
"I've been to a quarter-final before but never a semi, so this is a big deal for me.
"For every footballer the aim when they look back on their career is to have a medal to show for it.
"Every player in the Premier League will more or less finish his career having enough money and be financially happy.
"But whether they are fulfilled career-wise is different. You have to have actual silverware to look back on.
"That's where your memories are. You keep your medals for ever. All of the players in the dressing room go into this game knowing we are close to that."
Dunne is hopeful Villa can deliver in the Carling Cup, for their boss Martin O'Neill.
"I think it would be great for Martin to win a trophy," he continued. "The fans love him and, if he could bring them a trophy, it would only push him higher.
"But the club is progressing and for us to push on to the next level and win a cup is the start of a new and successful era.
"The main thing is to focus on the semi-final and not get carried away with thinking about Wembley. Teams can get sidetracked thinking too far ahead.
"People are already asking about a possible final against Manchester City, but I've not got any preference, I just want to win a trophy."