Windows Firewall not opening Ports

Hi

I am not Sure, but I think there may be a problem with a firewall on a server.

Its a Server 2012 server. I am trying to open port 5420.
I create the rule on the server, port 5420, all profiles.
Its open on the firewall and mapped to an external IP.

I run netsh firewall show state and it says the port is open.

I use this to test from the outside: http://www.yougetsignal.com/tools/open-ports/ and it says the port is closed

I even disable the firewall on the server and it does not connect.

Should I reset the firewall to defaults and start again. Is there a way to fix this?

Thanks