Whitley was a product of the Manchester City youth scheme
He joined as a ten-year-old and began his club career
Jeff had a two-month loan spell at Wrexham in the 1998–99 season
In March 2002, Jeff fall of favour at Manchester City, joined Notts County on loan for the remainder of the 2001–02 season.
He had a three-month loan spell at Notts County in the 2002–03 season, returning to Manchester City in January 2003
After a trial and impressing in pre-season, he signed a contract with Sunderland in August 2003.
He made over 70 league and cup appearances for Sunderland,helping the club to the Football League Championship play-offs at the end of the 2003–04 season and to the Football League Championship title in 2005
In July 2005, he joined Cardiff City on a free transfer and made 38 league and cup appearances for the club in the 2005–06 season, scoring once against Watford in the league.
He joined Northern Premier League Division One North side Woodley Sports in an effort to gain match fitness, before signing for Northwich Victoria on 7 March 2009