Eli Manning took Big Blue 80 yards with under two minutes to play, connecting with Jake Ballard for a one yard touchdown pass to give the team a 24-20 win.
"If it was thrown anywhere else, I wouldn't have caught it," Ballard told reporters after the game, according to ESPN. "You dream about making catches like that."
Before the drive it looked like the Patriots were going to win with another Tom Brady-led late touchdown drive.
Brady brought his team 64 yards for a touchdown with just three minutes to go, but left just enough time for the Giants to make another comeback.
Manning threw for 250 yards and two touchdowns.
The Patriots' loss means the Jets are now in a three-way tie for first place after their third straight win against the Bills in Buffalo Sunday put them at 5-3.
Gang Green's offensive finally looked to be firing on all cylinders, with quarterback Mark Sanchez throwing for 230 yards and their running backs rushing for 126 yards.
The team managed just a field goal in the first half after the team started the game with an 80-yard, 10 minute drive that ended in a interception in the endzone.
But in the second half their offensive exploded scoring three times in the third quarter and once in the fourth.
The Jets defense was solid, as usual, forcing three Bills turnovers and stopping the team twice on fourth down.
"It's totally attitude," defensive tackle Sione Pouha told reporters after the game. "Jet-i-tude is the way we look at it. Today we displayed what Jet football is all about."