Cloud computing has many downsides, but one of its upsides is (usually) simultaneous access to large numbers of machines on demand. However, with DNANexus, I have not been able to access more than 100 machines simultaneously. Is that a DNANexus limit, or are there ways to gain access to more machines simultaneously?
Please note that this is not a question about how I might change my workflow, or whether I should be doing more on-device parallelization within larger machines, etc. It's a specific question about a resource limit that I appear to be observing in DNANexus, trying to understand if I've been observing it by chance or if I have incidentally bumped up against a DNANexus resource limit (and if so, whether that can be modified).
The 100 concurrent worker limit is according to the term of service that DNAnexus signed with UKB. You can request additional concurrent worker limit if you submit your request to ukbiobank-support@dnanexus.com.
Comments
2 comments
The 100 concurrent worker limit is according to the term of service that DNAnexus signed with UKB. You can request additional concurrent worker limit if you submit your request to ukbiobank-support@dnanexus.com.
Fantastic, thanks for the clear response and the pointer to how we might solve it.
Please sign in to leave a comment.