Spurs have expressed an interest in moving to the stadium in east London, despite being granted planning permission for their own new ground next to White Hart Lane. Now, according to The Daily Mail, it is looking 'increasingly like the preferred option', rather than just a fall-back option to the new stadium.
However, Sullivan believes West Ham are the rightful tenants of the new ground, and has suggested public reaction from those in east London would be severe.
He said: "It would be such a slap in the face to east London. If it happens, there will be real problems that could easily lead to civil unrest.
"I think there could be riots, such is the ill feeling between West Ham and Spurs and I know the police feel the same.
"I feel very let down by Tottenham. The way they do business is not right. They pinched Eidur Gudjohnsen off us after we brought him from Barcelona for talks. He just disappeared from the hotel. And the way they unsettled Scott Parker was appalling.
"Now they want to move into our borough of Newham. How would they like it if we suddenly set up a new home in Haringey? I'm flabbergasted by the cheek of it."