Lambeth born Steven Kabba started his career at Crystal Palace in 1998 but after making 11 appearances and scoring 1 goal in 4 seasons he struggled to make it into the first team. In 2001/2002 he was loaned to Luton Town making 3 substitute appearances. The following season he was out on loan again, this time to Grimsby Town and that is where he was able to show what he was capable of, scoring 6 goals in 14 games.