If a particular Spark command is taking too long to evaluate, you can monitor the Spark status by visiting the Spark console page. To do that, copy the URL of your current JupyterLab session (typically ending in
".dnanexus.cloud/lab?"
), open a new browser tab, and paste the URL. Replace
Comments
2 comments
yes, using the method describe here https://dnanexus.gitbook.io/uk-biobank-rap/working-on-the-research-analysis-platform/using-spark-to-analyze-tabular-data#tips-for-retrieving-fields
If a particular Spark command is taking too long to evaluate, you can monitor the Spark status by visiting the Spark console page. To do that, copy the URL of your current JupyterLab session (typically ending in
".dnanexus.cloud/lab?"
), open a new browser tab, and paste the URL. Replace
"/lab?"
with
":8081/jobs/"
and press Enter.
Great. Just what I was looking for.
Thanks Chai
Please sign in to leave a comment.