Remove or cover, yes? But when you cover, what about the gap in the window above the unit? You know, between the top section and the bottom section when the bottom section is slid up? Oh yeah, the gap that leaked all summer too. Get some pipe wrap, cut it to length and stuff it in there. Keep it there.