Walters has been tracked by the Potters for some time and now told Keane he wants the chance to join the Premier League outfit.
The Town boss told the East Anglian Daily Times: "I know Jon wants to go because he told me and he can go.
"If it happens I won't lose one minute's sleep. I have absolutely no problem with him going as players get their heads turned and there is a chance of playing in the Premier League.
"Jon has a contract here but I live in the real world and I know players get tapped up, but there is no way in the world I could prove it.
"He has gone about things the wrong way. Instead of waiting for an offer to come in, he has been in and told me that he wants to leave.
"He has put the cart before the horse. He told me he is aware of interest in him and that he wants to go.
"A number of clubs are showing an interest, but Stoke are the favourites."