The Swans fired blanks for the third consecutive game in the 0-0 draw with Barnsley on Saturday.
Paulo Sousa's men have now scored just three goals in eight Championship matches and hover just two points above the relegation zone.
But Wales international Williams told the South Wales Evening Post: "We are not looking at the table. That's the thing we learned last season - when you start worrying about getting a win at any cost it affects your performance.
"We are not going to panic. We will get the wins and get right up the table. The fans have been brilliant - both home and away - and they will stick with us to help us get that next win.
"We are very confident in ourselves and the formation that is in place."