Southampton 2 Aston Villa 3
[gallery] Fabian Delph struck a stunning winner as Villa became the first side to beat Southampton at home this season.
The claret and blues executed the perfect smash and grab raid at St Mary's after scoring with their only three shots on target.
Gabby Agbonlahor and Libor Kozak twice put Villa ahead against the run of play only for Jay Rodriguez and Dani Osvaldo to peg them back. But Delph hammered in from 20-yards to win it with his first ever Premier League goal.
Southampton bossed possession – having 77 per cent of the ball – but lost their unbeaten home record to battling Villa, who climbed to 10th in the Premier League.
It came after Christian Benteke was dropped after a labouring performance against Sunderland extended his goal drought to seven games.
Kozak returned while Andi Weimann was replaced by Nathan Baker after failing to recover fully from a hamstring injury.
The Austrian was on the bench while Southampton started former Villa trainee Steven Davis.
The Saints started well and Adam Lallana was denied by Ron Vlaar's last ditch tackle before the England midfielder's cross dropped onto the bar.
Brad Guzan escaped punishment when he seemed to handle outside the box – although replays suggested referee Jon Moss made the correct call.
The keeper then beat away Rodriguez's drive before Villa caught Southampton cold on 15 minutes.
Delph won the ball outside Villa's area and unleashed Agbonlahor down the left.
The striker turned Maya Yoshida, darted into the area before beating Dejan Lovern and keeper Paulo Gazzaniga.
It stunned the Saints but they failed to threaten Guzan until the 27th minute when he turned Rodriguez's header wide.
For all Southampton's possession they couldn't break Villa's first-half resolve but that changed just three minutes after the break.
Vlaar was replaced by Matt Lowton before Southampton levelled when Rodriguez headed in Nathaniel Clyne's cross.
The England man was then well marshalled by Nathan Baker as Southampton suddenly rediscovered their spark.
But no sooner did they do it Villa regained the lead, again against the run of play on 64 minutes. Karim El Ahmadi robbed Jack Cork on the right and crossed for Kozak to nod in from six yards.
It was the striker's last touch as he was replaced by Benteke – who immediately wanted a penalty after going down under pressure from Lovern and Yoshida.
It went unrewarded and Saints levelled on 69 minutes when Rickie Lambert headed back across goal for Osvaldo to thump in.
The game remained in the balance and Delph grabbed a stunning winner with 10 minutes left as he broke from deep and unleashed a rocket into the top corner from 20 yards.