When running via a browser using DirectoryTestSuite.run(), if something goes wrong in beforeTest(), then an exception is thrown, and testing HALTS. Not just for that test CFC, but completely. This is a right PitA.
MXUnit acknowledge this as a bug:
But it's never been fixed. It's be good if you guys fixed it.
Expected results of fix: tests are still attempted, and if anything a test relies on that didn't get created by the failed beforeTests(), then the test simply bubbles back the error.