I have a glass now - I just have one as soon as I have fed him (or as I am feeding!). He feeds every three hours, so by the time I come to feed him again it is clear of my milk.
Alcohol is not stored in breastmilk, so it is just the time you have to watch - your body will clear one unit per hour.
I am storing up a bit of milk for Christmas Day so I can have a couple of drinks and not be worrying when I am having them.
Like you say, I don't want to go off on a bender (can't think of anything worse than looking after a baby with a hangover!), but it is nice to indulge a little!