Flush test results back to the screen periodically (HTML Runner)

Description

I know that most people don't have test suites that take an extreme amount of time to run, but I do. It would be nice if you could throw a <cfflush/> tag in after each test is executed and written to the buffer, so that even if my tests time out, I can start to get some test results back.

Tech Spec

Make sure that when running specs, output can be produced in HTML format back to the user and build the report incrementally

Activity

Show:
Luis Majano
October 28, 2015, 8:12 PM

Do you think maybe we can do a new Report?

Adam Tuttle
October 28, 2015, 8:16 PM

I don't really follow what you're asking. I don't have enough knowledge of how TB internals work, but from what I've seen in the HTMLRunner.cfm, it looks like it's a staged approach:

stage 1: run the tests. stage 2: calculate metadata (totals, etc), stage 3: write output.

If the request times out during stage 1, I get NO data back, even if it was in the last of many tests when it failed. It would be nice if they were constantly flushing content to the screen as it was ready – as each spec is tested.

Whether that's a new report, or a runner, or something else ~ that much doesn't really matter to me. I'm only concerned with the end result.

Luis Majano
October 28, 2015, 8:21 PM

Yea, I guess a new runner is in order that can spit out results as it goes. Have to really investigate this one as it has to be a runner that produces output as it goes and in a specific format. Ok, I will target this for queue.

Luis Majano
February 9, 2016, 7:06 PM

Ok, I am trying to revisit this, but the issue is that the reporters are done after the fact testing has been concluded. I am thinking the new runner listeners might do the job for getting progress updates: http://testbox.ortusbooks.com/content/running_tests/run_listeners.html

If that is satisfactory, I can close this ticket out.

Luis Majano
November 4, 2016, 1:22 AM

Listeners might do the required trick.

Fixed

Assignee

Luis Majano

Reporter

Adam Tuttle

Labels

None

Components

Priority

Minor
Configure