The good times for West Ham vs Huddersfield this season continued ten minutes later, when Lanzini finished from clinically to make it 3-1.
Mark Noble started the rout with 25 minutes on the clock after the Hammers capitalised on a terrible error by the Terriers, who conceded possession directly from a goal kick.
The forward - who had scored three in his last three appearances for the Hammers - put David Moyes' men back in front within a few seconds of the second-half starting, before he turned provider for Manuel Lanzini.
But Lolley atoned with an equaliser five minutes before half-time.
Huddersfield sit in 14th position in the league table but remain just four points above the relegation zone.
Abumere Ogogo of Shrewsbury Town and Javier Hernandez of West Ham United battle for the ball during The Emirates FA Cup Third Round match
Marko Arnautovic, who was to prove instrumental in the second period picked off a poor pass by goalkeepr Jonas Lossl before feeding Noble, who was left with just the 'keeper to beat.
A neat Huddersfield move on the right ended up at Lolley's feet, he cut inside and was given plenty of time to curl a sumptuous shot out of Adrian's reach.
For within 11 seconds of the restart West Ham found themselves ahead once again.
A long ball from Angelo Ogbonna was flicked onto the Austrian by Cheikhou Kouyate, he lifted it over Tommy Smith and lashed beyond Lossl to restore West Ham's lead. He had a point, it was a risky pass from the goalkeeper when Lolley had his back to play, but perhaps the latter could have reacted more decisively instead of letting first Arnautovic and then Mark Noble hustle him off the ball. New signings Alex Pritchard and Terence Kongolo, coming on as second-half substitutes with their side three goals in arrears, must have wondered what happened to the feisty battlers described in the brochure.