Latics boss Martinez revealed the extent of the ill-feeling there is towards N'Zogbia at the DW Stadium after the France midfielder put in a transfer request.
Wigan finally caved in to the 24-year-old's demands this week when they accepted an improved offer from Birmingham.
But the deal broke down after N'Zogbia failed to agree personal terms.
"Obviously, we agreed a fee with another Premier League club and it seemed that transfer was going to go ahead," said Martinez after his side's stunning 1-0 Premier League win at Tottenham on Saturday, which was achieved without N'Zogbia.
"Now, the situation is up in the air.
"Charles is a Wigan Athletic player and he needs to do a lot on the training ground to persuade this group of players to open up and allow him to come in and fight for a place."
Martinez, who contrasted N'Zogbia's attitude with that of the players who ended Wigan's horrendous start to the Premier League season, added: "It's difficult to accept that certain players don't want to be committed and don't want to be at the football club.
"It's very, very difficult to see a way back for Charles."