The 36-year-old, capped 85 times between 1995 and 2007, backed up the view of long-time Manchester United team-mate Paul Scholes, who said players turned up for England duty full of fear.
United they stand: Neville and Scholes believe England are crippled by fear
Neville told Sky Sports News: 'I would agree with him and, if you spoke to any player who has been around England for the last 15 years, I don't think you'd find one who disagreed with him.
'I think every single player who has played for England, even during my time, I would say they feel passionately about their country and want to play for England.
'But I think there is a mixture of people who are that nervous and have the fear about them when they go to play for England that they can't perform.'
Sign on: Neville retired midway through last season
Neville also believes some players are too concerned about media coverage and that team morale does not match the likes of world and European champions Spain.
He added: 'I think you have the factor that you are bringing players together who don't know each other and you are changing the team every month, and that is difficult.
'And then you have this protection-type mentality of people who do worry about what the next headline is going to say and whether it is going to affect their status.
Sealed with a kiss: Neville and Scholes spent their career together
'You look at the likes of the French, the Argentinians, the Brazilians, the Spanish now, and we have seen it for 10-15 years - they are all hugging each other in the tunnels.
'They love each other, like there is a team and a camaraderie. We've never really been able to capture that with England.'
Which of Paul Scholes's former England team-mates is he calling selfish?Scholes: I wanted to be part of a winning England team, not one full of greedy players