I see now that this happens as well when I failed over from the Secondary server to the Primary server as well. The secondary server Pulbic IP has now been hidden, and I saw on the console that it was hiding the non-active server's public IP. I suppose this is intentional, but I'm still curious if there is a way to not make it do this.
Thanks,
Jason