Olivier Giroud's late goal helped Arsenal recover from an early setback to beat Preston North End 2-1 at Deepdale and book their place in the fourth round of the FA Cup.
The hosts made a dream start when they went ahead through Callum Robinson in the seventh minute. And they could have extended their lead against a lacklustre Gunners side that failed to get going. Preston's Tom Clarke, Jordan Hugill and Paul Gallagher all drawing saves from David Ospina or missing good chances.
Arsene Wenger did something to shake Arsenal out of their slumber at half time as Aaron Ramsey levelled within a minute of the restart with a curling effort from the edge of the box. But they failed to build on that goal until Giroud, named captain for the day, scored a last-minute winner from close range following Lucas Perez's backheel.
FA Cup holders Manchester United began their defence of the FA Cup with a 4-0 third round win against Reading at Old Trafford.
Wayne Rooney put United ahead in the seventh minute, with a strike that equalled Sir Bobby Charlton's all-time goal scoring record for the club and United doubled their advantage in the 15th minute through Anthony Martial, who played a smart one-two with Rooney before dispatching a low finish into the corner of the goal.
Rashford rounded off the victory with two late strikes to end a run of 18 games without a goal. The first came after 75 minutes, Rashford latching on to a precise long pass from Michael Carrick to get in behind the Reading defence and score. And four minutes later the 19-year-old took advantage of a mistake by Ali Al-Habsi to dispossess the goalkeeper and tap in from close range.
Everton were knocked out 2-1 by Leicester City after Romelu Lukaku had scored his seventh goal in as many FA Cup ties.
Ahmed Musa quickly levelled Lukaku's opener before the Foxes substitute grabbed a 71st-minute winner to avenge their Premier League defeat to Everton on Boxing Day.
Derby County also produced a come-from-behind 2-1 win to end West Bromwich Albion's participation in the competition.
Matt Phillips fired the Baggies ahead on 35 minutes with a low driven shot into the bottom corner But Derby were level six minutes after the break through Darren Bent and then behind three minutes later when Thomas Ince curled a free kick beyond Boaz Myhill.
Bournemouth were made to pay the price for making 11 changes, losing 3-0 to League One side Millwall.
Steve Morison put the League One side ahead in the 26th minute and then turned provider, setting up Shaun Cummings to finish from close range in the 49th minute before Shane Ferguson added a third in the final minute.
Watford avoided an upset as goals from Christian Kabasele and Jerome Sinclair saw them past Burton Albion 2-0.
But Stoke City were dumped out by Wolverhampton Wanderers, losing 2-0 to Helder Costa and Matt Doherty goals.
League One Oxford United won 3-2 at Rotherham United where Ryan Taylor, Phil Edwards and Kane Hemmings scored after Chris Maguire had seen his spot-kick saved. Danny Ward and Tom Adeyemi gave the Millers hope, but it was another sad day for the Championship's bottom club.
But there was to be no giant-killing for non-league trio Barrow, Eastleigh and Stourbridge.
Barrow's hopes of making the fourth round for the first time were ended by Ian Henderson's brace in a 2-0 away win for Rochdale.
Eastleigh, also of the National League, were thrashed 5-1 at Brentford as former Bees boss Martin Allen suffered a miserable return to Griffin Park.
Tom Field (two), Yoann Barbet (penalty), Lasse Vibe and Romaine Sawyers all scored before half-time, with Ayo Obileye replying for Eastleigh.
Stourbridge, the lowest-ranked side left in the competition, lost 2-1 at League Two Wycombe Wanderers.
Dan Scarr cancelled out Sam Wood's opener 20 minutes from time, but the Northern Premier League minnows were left heartbroken by Adebayo Akinfenwa's late winner.
But National League side Sutton United will play local rivals AFC Wimbledon again after a goalless draw.
Hull City's Marco Silva won the battle of the new bosses as fellow Premier League strugglers Swansea City lost 2-0 on Humberside.
Paul Clement's Swansea were on course for a replay until Abel Hernandez and Josh Tymon scored for the Tigers in the final 12 minutes.
Sam Allardyce's Crystal Palace must replay as his former club Bolton Wanderers held last season's finalists to a goalless draw at the Macron Stadium.
Southampton and Norwich City must also play again after a 2-2 draw at Carrow Road.
Virgil van Dijk and Maya Yoshida twice put the Saints ahead, but Steven Whittaker (pen) and Steven Naismith, in the final minute, saved Norwich.
There will be further replays between Sunderland and Burnley, Bristol City and Fleetwood Town and Blackpool and Barnsley after goalless draws.
Gianfranco Zola is still looking for his first win as Birmingham City boss after a 1-1 draw at home to Newcastle United.
Daryl Murphy gave Newcastle a fifth-minute lead but Lukas Jutkiewicz equalised just before the break.
Israel internationals Beram Kayal and Tomer Hemed were on the scoresheet as Brighton beat MK Dons 2-0, while fellow Championship high-fliers Huddersfield Town overcame Port Vale 4-0 with Jack Payne (two), Kasey Palmer and Harry Bunn netting.
A Joel Lynch own goal and a Liam Feeney strike saw Blackburn Rovers through 2-1 at QPR, Jake Bidwell claiming a consolation from the penalty spot.
Wigan Athletic won another all-Championship affair as Will Grigg and Yanic Wildschut scored in a 2-0 victory over Nottingham Forest.
Accrington Stanley saw off fellow League Two side Luton Town 2-1, Omar Beckles grabbing the winner after Jake Gray had cancelled out Sean McConville's efffort.
Ipswich Town scored an 86th-minute equaliser to deny National League leaders Lincoln City a famous victory in a 2-2 draw. Tom Lawrence had twice equalised for the Championship side after Theo Robinson's brace for the Imps.