If it's a pop-off style, tapping it with a rubber mallet (or similar) from the side should start to dislodge it. Obviously, use light to medium pressure - but if it's meant to pop off, you should be able to see/feel that "it will work".
Although, if it's a pop-off style, it also should have...