Cabaye sealed the win in the final minute after having opened the scoring in the first half, much to the frustration of the Upton Park crowd.
Alan Pardew: "He has a great role for us, for the team. He gets almost a free role in the team in the number 10 shirt and I think he's enjoyed that.
"He's added goals to his game. The first one was a real class, individual goal - the touch, and the way he moved, and the sublime moment he took to finish it.
"And I thought he was a class act all day really and he has been a big player for us, and it's helped us get a rhythm in the midfield, which worked well for us today.
"I think the one regret of the game really were the final minutes of the first half when we'd played so well and got ourselves a great platform to win the game, and to concede at that moment was really, really bad.
"I refocused at half-time to try and get the team in a place for the second half to try and play like we did in the first, but I thought West Ham were much better in the second half and it was difficult for us.
"We had to really dig in to win headers and challenges. But really and truly the first half was the platform for victory."