Cut the Cathode (-) side of the LED back far enough so it won't be able to touch the battery when reinserted into the light brick.  You'll need to add more of a curve to the anode (+) side so it will touch the battery positive (+) at all times.  Cut a small length of wire to solder from the switch to the LED cathode.