The Magpies have an unenviable record against Liverpool on Merseyside, with Sunday's 1-1 draw ensuring the Reds extended their unbeaten home run against Alan Pardew's men to 18 league matches.
Their goalscoring record makes equally abysmal reading, and Cabaye's fantastic half-volley from a narrow angle was the first goal a Newcastle player has registered at Anfield since Patrick Kluivert's close-range finish in December 2004.
Yohan Cabaye: "It was a good point from a very hard and difficult away game.
"In the first 10 minutes they put us under a lot of pressure but we stayed solid and they didn't have a really good chance to score.
"It was really important that we didn't concede early on because it meant we stayed in the game.
"After 20-25 minutes we kept the ball better, played in their half and had a few chances before my goal.
"Going in 1-0 up at half-time was great, but the goal we conceded in the second half we could have done much better with. However, a point here is a good point."