I had a microwave sterilizer, but for the pump bits, I found the really cheep sterilizing tablets from tescos good, I use a tupperware box on the window sill in kitchen and fill with water, add the one or two tablets required (can't remember), and you only have to leave things in there for 30 mins, (just rinse and plonk in, no rinse required after).
I would get most off if I fed on one side and pumped on the other at the same time, ok after a few trys , (make sure its all ready), and that way my boobs had no idea I was dong an extra feed, and my boobs stayed under control more
Good luck