Bruce believes his Newcastle ties meant he faced a struggle to win over Sunderland fans and despite relatively successful finishes in his first two seasons in charge, he came in for abuse after a poor start to the 2011/12 campaign and was dismissed in November.
The former Manchester United defender has since guided Hull to the Premier League, while Sunderland have encountered difficulties under Martin O'Neill and Paolo Di Canio.
And while Bruce takes no pleasure in Sunderland's current trials, he believes he made a mistake in accepting the job at the Stadium of Light.
Steve Bruce: "In hindsight maybe going there was a mistake, being a Newcastle fan as a boy...some would never forgive that.
"I wouldn't say it was the utmost reason but for a lot of them, they couldn't hack that.
"Honestly, I take no satisfaction at all (in Sunderland's struggles). You go back to when it went pear-shaped - if it did got pear-shaped - and you have to look back and learn from it, learn from your mistakes.
"You question yourself: did you make the right decision? I left a really good Wigan team to go there. Being a Newcastle fan, as soon as it went a little pear-shaped they couldn't wait to jump on the bandwagon.
"I was bitterly disappointed with the way it ended. I'll never forget the day at Wigan (his last match in charge) when the crowd turn on you...I wouldn't want any manager to go through that.
"I was desperately disappointed because after finishing 10th I thought I might get a bit more time.
"It didn't happen, so you move on and Hull gave me the opportunity to get back to work again.
"When you get sacked what you want to do is come out fighting and show what you're about."
Source: Newcastle United Mad