I do something similar, except I add an explicit breakpoint. For example, in my current ARM project, I have the following:
#define _BKPT __ASM(“bkpt 0″)
I put _BKPT before the infinite loop. I use this same technique for asserts. Thus, I never need to set a breakpoint in the debugger on the error handlers, the debugger will just stop on them when they are called.