Former User of DNAx Community_47
Activity overview
Latest activity by Former User of DNAx Community_47
-
Former User of DNAx Community_47 commented,
Interestingly, I found that this OOM error is only "masked" when the offending process is given as a process substitution file input.That is, when I do the command like the below, it may incorrectl...
- View comment
- 0 votes
-
Former User of DNAx Community_47 commented,
I realised that passing --get-streams to dx watch restricts the output to the stdout and stderr streams of the app, whereas if I omit this parameter (just dx watch jobid) then I get more detail, an...
- View comment
- 0 votes
-
Former User of DNAx Community_47 created a post,
How to tell that a job has failed due to an out of memory error when it completes with state "done"
I am running an applet on the DNA Nexus RAP that pipes output from bcftools into another program. Sometimes the applet runs into insufficient memory... but it does not die with an error - it comple...
- Former User of DNAx Community_47
- 2 followers
- 3 comments
- 0 votes
-
Former User of DNAx Community_47 commented,
That's a good idea to try, thanks!
- View comment
- 0 votes
-
Former User of DNAx Community_47 created a post,
DNA Nexus takes ages to run a job
The past week or more, it takes many hours before any job that I submit starts running on DNA Nexus. This makes it nearly impossible to develop / debug an app or commands I want to run. Does anyone...
- Former User of DNAx Community_47
- 2 followers
- 2 comments
- 0 votes
-
Former User of DNAx Community_47 commented,
Ah, I didn't realise that dx-spark-submit needed to be called from within the app's script. I'll give that a try.Does this work to submit a pyspark script to be run? E.g. within script.sh, I would...
- View comment
- 0 votes
-
Former User of DNAx Community_47 commented,
Thanks Ondrej.I can't for the life of me figure out how to get the dx-spark-submit utility though. Where is it?I've installed the dx toolkit and other commands work fine.I've tried to run it on Clo...
- View comment
- 0 votes
-
Former User of DNAx Community_47 created a post,
How do you run a spark app?
I have read the documentation on Spark apps (https://documentation.dnanexus.com/developer/apps/developing-spark-apps), but it's not clear to me how to actually run one. For example, I have run th...
- Former User of DNAx Community_47
- 3 followers
- 7 comments
- 0 votes
-
Former User of DNAx Community_47 commented,
Thank you! I would be interested to hear any comments the team has on the subject.
- View comment
- 0 votes
-
Former User of DNAx Community_47 commented,
Thanks Ondrej.I would like to test or debug computational pipelines / code in development that may need access to Gb of data, including genotypes, in which case I cannot download the data to operat...
- View comment
- 0 votes