Should I take out battery of my Whisper Flex (Ultimate) is I am not using my fan?

This is not required, but is recommended. In fact, your battery will then last longer than if you always leave it in while plugged in.