You probably aren't going to drill into a tap. Typically, the tap is going to be much harder than a drill bit and as you have learned they can be brittle.
Sometimes you can use a punch and hammer and smack them, and they will break into smaller pieces. Or you can try to use a die grinder with a...