Varney missed the win against Blackpool along with defeats by Peterborough and Leeds after a red card at Hull last month.
"It was a bit easier to miss the Blackpool game when we won it but I've never been good at watching games, especially with the situation we're in and you want to pull your weight," he told The News.
"We've got a good group here and not to be involved is very disappointing after such an innocuous challenge.
"I found it hard but the lads have kept me involved and I've been to every game.
"It's just a case of keeping fit and being ready for the next chance. I will have to keep myself topped up and, hopefully, I get the shout on Saturday."