Nosworthy could be set to leave Sunderland before the transfer window closes next week.
His former boss at Ipswich, Roy Keane, is understood to be keen to take him to Suffolk.
But Nosworthy's advisor Uben Gray has confirmed that he will not be dropping down a division.
"No disrespect to Ipswich, or any Championship side, but at this point in his career, that is not a move Nyron will look for," Gray told skysports.com.
Gray refused to confirm any interest in Nosworthy, who has been linked with a number of Premier League clubs in recent weeks - with Portsmouth, Bolton, West Ham and Stoke all said to be keen.
"Nyron is with Sunderland, and is happy, but obviously if somebody comes in for him - then who knows what could happen," he added.