IPSec policty to limit LDAP access

Hi,

I'm trying to block incoming LDAP requests, with IPSec,

So I create a policy that blocks all incoming connection to TCP port 389, 

And setup a white list of IPs that allow them to connect to that port.

Soon after that I find the Group Policy Management mms wasn't responding at all.

So I doubt it might be using loopback interface for communication. But IPSec wouldn't allow me to use 127.0.0.1 as either destination address or source address.

What should I do ? (P.S tried localhost, won't work either)