Jurgen Klopp called on Liverpool to improve their "rubbish" defensive set-piece record after snatching a 5-4 victory at Norwich City thanks to an Adam Lallana winner deep into injury time.
Liverpool went into injury time 4-3 up, and Norwich thought they had secured a point with Sebastien Bassong's long-range volley on 92 minutes.
However, Lallana sent a bouncing shot past Rudd in the final seconds of the game to spark wild celebrations on the touchline with Klopp, whose glasses were accidentally broken by Christian Benteke.
Liverpool's defensive vulnerability was exposed throughout the game -- the visitors twice failed to clear a corner which led to Dieumerci Mbokani scoring Norwich's first, while Alberto Moreno made a pair of ill-advised challenges on Steven Naismith in the area to concede a penalty from which the Canaries went 3-1 up.
Klopp was furious following Bassong's late equaliser after the Reds failed to clear a long free kick, and the Anfield boss told BBC Sport: "We have had a few games with a similar story like this, we need to think whether it is because of us.
"It was exciting until the end and longer. We had a win after 90 mins, a draw after 92 and then a win again. It is not usual.
"There was about 70 minutes that were really good. We started well but then conceded the goals. Conceding four goals in general [is] not good. Conceding from set plays is the biggest rubbish ever because it is too easy for the other team.
"Usually we concede from the corner but now it was from the second ball, we were like rabbits in the headlights. We won the game, in the end it was deserved. The players played under big pressure and scoring five goals is not too easy. We did it.
"I was really surprised because the story of the game was not that we could make time pay. It was an open game, 90 minutes thank you and go but five? That's hard.
"It is not too easy to judge and stay cool in a game like this. I asked why five minutes [were added]. I was not satisfied with the answer, the referee was not satisfied with the question.
"We needed luck at the end and we had it."
Naismith -- who scored on his Norwich debut following a January move from Liverpool's rivals Everton -- told BBC Sport: "Defensively it was very poor and that is what cost us.
"If 11 men can't defend their goal for two minutes, then you will get punished."
Norwich boss Alex Neil was crestfallen after watching his side give away a 3-1 lead.
"We were good value for 3-1," he said. "I thought we were the better side. They scored really quickly after we got our third goal, through poor defending from us. I don't really know what to say. Defensively they made extremely poor decisions, cost ourselves three points, because we had it comfortably. We failed to make correct decisions at vital times in the game and it cost us goals.
"People's lasting memory of this game will be what happened in the last 25 minutes of this game. Up until then everything was going well for us, but then we transpired to really be the makers of our own downfall, through poor decision making, not looking after the ball, looking nervous and edgy at the back and basically not defending our box well enough. I didn't really celebrate the fourth goal, because I couldn't believe what I was seeing.
"I'm extremely angry. And so should they be. Angry with themselves, frustrated. We managed to score four goals at home, which should mean we're going home with three points."