A Paul Heffernan hit and another from Kuffour before half-time ended the tie as a contest, although Skiverton insisted Reading loanee McCarthy had his backing - blaming his side's failure to recover as the reason behind the loss.
"I stand by Alex 100%," said the Glovers chief. "For the first 15 minutes we were scintillating. We got them on the back foot and put plenty of crosses in to the box.
"After the goal we didn't play our way back in to the game. Bristol Rovers were good on the day so I have no bones about the result.
"We let them score, we just didn't make them work hard to get their goals."