Pump with fitted dress/maxi dress

How do you wear your pump with a maxi dress or a fitted dress? Do you attach it to your bra strap? If so, how?! Right now I have the pump attached to my thigh since my dress is loose fitting, but it looks awkward. I need more ideas !