Martin O'Neill's side have been in superb form this term and enhanced their chances of a top four finish with a 2-0 win at Blackburn on Saturday.
Villa's Ewood Park success sees them just three points behind Liverpool and Milner believes one of the club's main challenges is trying to keep their feet on the ground.
"We just need to keep going, keep working hard and keep improving. We cannot rest on our laurels," said Milner.
Minds on the job"We are having a great season but it is down to us to keep our minds on the job in hand.
"Confidence is massive in football and obviously it helps with the run we have been on. It is not easy away from home but we are getting the results.
"We are playing well - that is the main thing - we are not nicking wins, we deserve the points and that is important."
Milner secured a call-up to Fabio Capello's England squad on Saturday and the ex-Newcastle man is honoured to have received the call.
Honoured"To represent your country at any level is fantastic but to be called up to the full squad is an absolute honour and a real proud moment in my career," he added on the club's official website.
"I am thrilled and I can't wait to link up with the other lads and work hard and try to do well in training.
"Villa have six players in the national squad, which is a huge achievement too. Credit has to go to the manager Martin O'Neill for that.
"It'll be great to be part of the set-up and to have so many lads from Villa there too will make it even better."