I am trying to estimate the cost of our project. While running a custom applet on 50 pilot cram data in normal priority, I noticed that my job shifted to wait state when processed to 49th cram and then restarted from beginning. I also noticed that the priced was almost 2.5 times of complete job when the restarted job process to half way of 50 crams.
My questions are, what caused the job restating, and how to avoid it? Why the restarted job is so costly?
I terminated the half way finished job and started it as new job without problem.
Thanks for help.
when you are choosing normal priority job , it can be either spot instance or on-demand. Spot instance costs lower, but can be terminated unexpectedly, which is what likely happened in your case. The fact that restarted job costed more is that according to the settings for normal priority, it will wait for 15 minutes to get spot instances, if no spot instances are available, platform will request on-demand instances, which costs more.
You can use normal priority to lower the costs, however, keep in mind that there could be restart needed due to spot termination.
Here is the guide to analyze large sample sets that could be helpful.
0
Permanently deleted user
Thank you for the answer. The link to the guide is really helpful!
Do terminated jobs are also charged for the time used? Are there job termination rates for spot instances available somewhere under different scenarios? I just want to get some estimates on the amount of budget we will be expecting.
Comments
3 comments
Hello,
when you are choosing normal priority job , it can be either spot instance or on-demand. Spot instance costs lower, but can be terminated unexpectedly, which is what likely happened in your case. The fact that restarted job costed more is that according to the settings for normal priority, it will wait for 15 minutes to get spot instances, if no spot instances are available, platform will request on-demand instances, which costs more.
You can use normal priority to lower the costs, however, keep in mind that there could be restart needed due to spot termination.
Here is the guide to analyze large sample sets that could be helpful.
Thank you for the answer. The link to the guide is really helpful!
Do terminated jobs are also charged for the time used? Are there job termination rates for spot instances available somewhere under different scenarios? I just want to get some estimates on the amount of budget we will be expecting.
> Do terminated jobs are also charged for the time used?
Yes, user is charged for terminated jobs. With normal priority there is a possibility that there will be spot termination
> Are there job termination rates for spot instances available somewhere under different scenarios?
Rates are usual and based on how long the instance was running.
Please sign in to leave a comment.