Winger Michael Jones grabbed the 71st-minute winner as Bury recovered from going 2-0 behind to clinch a thrilling 4-3 win at Torquay.
The home side went ahead when towering right-back Chris Robertson - 24 last Monday - celebrated his birthday by heading home left-back Kevin Nicholson's 18th-minute free-kick.
Two minutes later United went further ahead when winger Chris Zebroski fired home from outside the penalty area, but Bury were soon on level terms.
Their top scorer Ryan Lowe took his tally to 10 for the season by converting a 27th-minute penalty when he sent keeper Scott Bevan the wrong way after Guy Branston had fouled Efe Sodje. The Shakers levelled six minutes later when Nicky Ajose exchanged passes with Lowe on the edge of the penalty area and fired home at the second attempt after Bevan was unable to hold on to the striker's initial effort.
United striker Elliot Benyon was then denied by Bury keeper Cameron Belford in first-half stoppage time.
Bury completed the turnaround as skipper Steven Schumacher scored from 20 yards. Zebroski made it 3-3 in the 56th minute with a measured 25-yard drive but Jones settled it when he angled in the winner from the right.