Basic Nodejs app on VPS

Hi,
I've order a VPS and I just received the login details. Currently I have SSH'd into the VPS, installed NodeJS, and now I am running a simple Hello World app on port 3000. Should I be able to access it via the VPS IP (with port :3000) or the URL vps5xxxxx.ovh.net:3000 ?
I cannot connect to it.
I just make a folder called apps in my home folder with the NodeJS file. I've tried setting it to listen to 127.0.0.1:3000 and localhost:3000, but nothing works. I also tried port 80 and just use the URL without specifying a port - no success.

Any ideas?