The London club were deducted 10 points after going into administration last month, but Neil Warnock's side have won their last three matches including an FA Cup victory against Wolves last week.
Kuqi told the club's official website: "As a group, if we think that Crystal Palace will have administration playing on their minds it will be the wrong idea.
"We have to focus 100% and try and go there and perform as good as we can because it is one of the toughest places to go and play.
"I know the players and I know the manager and they will be up for it. If they didn't get the 10-point deduction they would still be in the play-offs and that tells you everything."