Option to live-display logs during job execution

[rowleya]

The most recent client has an option to "wait" for the execution to complete. A nice companion option would be to have the logs collected and displayed during the execution, as they are generated. This would require the client to keep up to date with the log and only display the new parts, as I don't think it is possible to get the log in parts currently (or else the server could be updated to allow this).

[apdavison]

@rowleya this would of course need changes from your end (and from @muffgaga), to push new updates to the log at regular intervals, or at certain key stages in the process. Would this be fairly straightforward?

[rowleya]

I think our side does this already; if you submit a job through the Collaboratory and then repeatedly expand the log at the bottom of the page, it is updated as the job is run.