The bilge pump is controlled by a float switch or a manual override...when you flipped it on, you hit the manual override and the pump started pumping.
Check the float and as long as it's working, you can leave the switch in auto mode....when the water gets high enough, the bilge pump will kick...