Saturday's thumping 5-0 defeat at Millwall renewed fans' calls for the former Celtic manager to quit.
Tranmere are currently third from bottom in the table four points adrift of Stockport after nine defeats in just 11 league outings.
However, Barnes insists he will not be forced out and that he can cope with the pressure that comes along with football management.
"I'm not going anywhere, I'm not walking," insisted Barnes.
"Obviously, after losing 5-0 the pressure is greater. Pressure is what you make it and I'm trying to make the team play well.
"When it goes well you're a hero. When it goes badly, you're a villain."
Barnes had an illustrious career as a player after winning 79 caps for England and he believes his high profile is bringing added attention to Prenton Park.
"[My profile] might be hindering people's perception of the position we're in," he continued.
"Possibly if I'm not the manager then we would be getting a bit less attention, but we have lost seven out of eight games and no matter who you are, that's not good."