Ainsworth made his first league start in a Millers shirt last weekend at Chesterfield and spoke to the Advertiser, insisting the off field chat doesn't bother him or the rest of the staff.
He said: "We have a so-called big budget and people say we are spending this and that. We don't believe that and we don't look at any of that.
"We're players and we get paid to do a job and go on the pitch and play football. We know we're good players or we wouldn't be here in the first place. The club is attracting quality with a great ground and great fans and that's what you want.
"There is more to come from this team, definitely. We've gelled over pre-season and we can kick on; we've got to as Rotherham United Football Club. The fans want it and we want it. We've had disallowed goals and good saves deny us and on other days they go in and you win 4-0.
"It has been a tough opening and we are disappointed with four points from nine but it's a tough league. We're just trying to kick on and win games", he added.