Yes, empty the tank. I doubt you'll have enough clearance to pull the entire pump assembly out unless you drop the tank all the way. And, you DON'T want gas sloshing around. One slip up and you're toast--literally. Not only should you change the filter, but you should also flush out the tank. Not flushing the tank is the single most common cause of repeat fuel pump failures.