A fierce Hampshire derby was settled by two major decisions from referee Steve Bennett.
The first was controversial enough, awarding a penalty when Diomansy Kamara was brought down to provide Pompey with an equaliser.
But this was nothing compared with Mr Bennett's other decision when Matt Taylor blocked a Southampton cross with his arm.
The Kent referee waved play on before his attention was drawn to his assistant, Mike Tingay.
The referee consulted his linesman, changed his mind and awarded the penalty. Furious Portsmouth players surrounded the referee and he showed yellow cards to Dejan Stefanovic and Aliou Cisse but he was not going to change his mind a second time.
With the stadium in uproar Crouch calmly beat debut goalkeeper Konstantinos Chalkias with the penalty.
The first half of the match was a poor advertisement for the competition with few incidents and little to excite a crowd of almost 30,000.
But the match sprang to life in the 54th minute when Matt Oakley, only playing because of injury to the manger's son Jamie, unleashed a 20-yard shot which gave Chalkias no chance.
Southampton hardly had time to celebrate because within seconds Portsmouth were level thanks to Yakubu Ayegbeni's penalty.
Kamara burst into the Saints area and was nudged off the ball by Claus Lundekvam. Southampton claimed Kamara have dived and in the fracas that followed, Kamara and Paul Telfer were booked.
Yakubu stepped up to send the goalkeeper the wrong way with his penalty.
After that there were chances at both ends with Taylor heading off the line from Crouch, Crouch having a goal ruled out for offside and Antti Niemi making an outstanding save to keep out a shot from Yakubu in the 69th minute.
Three minutes later Kamara was sent off for a second bookable offence and with the extra man Southampton appeared to gain control.
Sub Kenwyne Jones headed narrowly over before Portsmouth suddenly had two great opportunities to win the match.
Patrik Berger had a shot deflected over the bar from ten yards but sub Ricardo Fuller was even closer when he wastefully blazed over with the goal at his mercy.
The fourth official indicated four minutes of added time and it was then that Taylor handled and Crouch scored the winner.
There was still time for Portsmouth to launch a desperate last attack in search of a second equaliser but it was not to be.
Man of the Match: Peter Crouch - The giant striker led the Saints line superbly all game and put the seal on his performance with a cool penalty to hand his side victory.