Harry Redknapp said he was "sick and tired" of bung slurs and claimed he was victimised because of his Cockney accent, a court has been told.
The Tottenham boss also told football corruption investigators: "If there is any mud to be thrown, I seem to get on the end of it for whatever reason."
Redknapp said there was "nothing on me in this world" as he voluntarily revealed details about his Monaco bank account during the Quest Premier League bung inquiry in 2006, jurors at at Southwark Crown Court were told.
He told accountant Nigel Layton "I don't care who looks", as Portsmouth's finances were examined by the investigation led by former Metropolitan Police commissioner Lord Stevens in 2006.
Redknapp, originally from Poplar, east London, said: "A friend said to me, he said 'Harry, I can't believe it's always you, I have dealt with you enough times. Your problem is your name, Harry, and you have got a Cockney accent'.
"People don't know me and I am sick and tired of it. There ain't nobody who is more of a fan. My son has been a top footballer."
The conversation took place between Mr Layton - managing director of Quest - and Redknapp in November 2006.
Redknapp added: "I don't care who looks, your people can look. Nobody will ever find anything on me. I don't care who looks or how hard because there is nothing on me in this world."
The extracts were read out in court after prosecutors said excuses offered by Redknapp and co-defendant Milan Mandaric for the Â£189,000 "bung" were "contradictory, inconsistent and lack credibility".
Both Redknapp, 64, of Poole, Dorset, and Mandaric, 73, from Oadby, Leicestershire, deny two counts of cheating the public revenue when Redknapp was manager of Portsmouth FC.