Hall sent off former City captain Graeme Lee in the 64th minute for a second bookable offence with the two sides level at 1-1 after Bantams striker Michael Boulding had cancelled out Craig Westcarr's opener.
Delroy Facey looked to have put County through when he scored five minutes from time but Chris Brandon levelled in the 89th minute to force penalties, which spelt the end for McParland's side following misses by Facey and goalkeeper Kasper Schmeichel.
"It was a terrible sending-off. They should be big enough to hold their hands up. Some of the bookings were not bookings and Lee's dismissal was not a sending-off," said McParland.
"But good luck to Bradford - they stuck their penalties in. We could have had them dead and buried even with 10 men. We came here to win the game and we deserved to win the game.
"It is a terrible way to go out on penalties, especially when we dominated it so much, but it was a great cup tie. I am happy with the performance but not with the result."