The Welshman returned to Ewood Park on Saturday with new club Fulham to jeers and taunts following his departure from Rovers in 2008 to join Manchester City.
Hughes did not enjoy the best of times at Eastlands, and was forced out of the club in December 2009 after failing to live up to expectations of their wealthy owners.
Samba, who scored in Rovers' 1-1 draw with Fulham, however believed it was time to move on from the manager who brought him to the club in 2007.
"I'm sure there is a respect from the fans for what he did, but it's two-and-a-half years since he left," said Samba.
"The page has turned on him and now we have to look to the future.
"It has to be about us now. Don't get me wrong, I'm eternally grateful for what Mark Hughes did for me.
"He brought me here and gave me my chance in English football. But you've to move and I'm grateful to Sam (Allardyce) for putting his trust in me by giving me the armband.
"I had a good chat with Mark Hughes before the game - not really about football, but about families and stuff. I can see him doing a really good job at Fulham.
"That's twice he's come here and got a draw. He knows this place very well. He knows a lot of the players.
"That makes him difficult for us to play against. We know he's a good manager and he knows all about us."