The South Americans are two-time world champions having won the crown in 1974 and in 1986 and have arrived in South Africa as one of the favourites.
Diego Maradona's men kicked off their campaign with a 1-0 win over Nigeria on Saturday, a game they dominated without making the most of their numerous chances.
Tevez, though, is not worried about their attack - something he is confident will take care of itself - but is desperate for the team to go all the way.
"A good World Cup for Argentina will be to win it," he told a packed press conference in Pretoria.
"There is nothing else that will do.
"If we get to the quarters, the last 16, last eight or whatever, this will not do."
Argentina should have scored many more against Nigeria, but, having failed to do so, left themselves open on the counter-attack, but Tevez is unconcerned.
"We are a team going forward, we have very good attacking players," he said.
"We do not play defensively, but we attack. This is demonstrated in the type of players the coach has chosen."
The City striker formed part of three-pronged attack against the Nigerians along with Gonzalo Higuain and Lionel Messi, who was guilty of several missed chances in that game.
And Tevez revealed that he been advising the young Barcelona forward to enjoy his football in a bid to take the pressure off on the sport's biggest stage.
He added: "All I say to him is to have fun playing football and he should do it without pressure.
"It's the best place to be playing at the World Cup. Those of us around him, we care and we know what kind of player he is. He has nothing to prove."