rxGetJobOutput: Get Console Output from Distributed Computing Job

Article
07/15/2019

Description

Gets the console output from the various nodes in a non-waiting distributed computing job.

Usage

  rxGetJobOutput(jobInfo)

Arguments

`jobInfo`

a job information object, such as that returned from a non-waiting, distributed computation, for example, the rxgLastPendingJob object, if available.

Details

During a job run, the state of the output is non-deterministic (that is, it may or may not be on disk, and what is on disk at any given point in time may not reflect the actual completion state of a job).

If autoCleanup has been set to TRUE, the console output will not persist after the job completes.

Unlike rxGetJobResults, this function does not remove any job information upon retrieval.

Value

This function is called for its side effect of printing console output; it does not have a useful return value.

Examples


 ## Not run:

# set up a non-waiting HPC Server compute context: 
myCluster <- RxSpark(nameNode = "my-name-service-server", port = 8020, wait = FALSE) 
rxOptions(computeContext=myCluster) 

myJob <- rxExec(function(){ print( "Hello World"); return ( 1 ) })
# The job output will contain the printed text "Hello World" from each node
rxGetJobOutput(myJob)
# The results object will be a list containing the value 1 for each node
rxGetJobResults(myJob)
# Get job results will remove the job object (by default)
# Another call to rxGetJobOutput(myJob) would return no output

## End(Not run)

Share via