How can I estimate the resources that an AWS instance used after a run?

Former User of DNAx Community_48
Hi!   I am developing an analysis (e.g. a GWAS). As I intend to run the final job hundreds of times, I like to determine the optimal configuration of my AWS instance (memory, number of CPUs, ssd versus hdd, ...) in order to minimize cost.   How can I get this information from a terminated job? Any further suggestions or links to resources regarding instance optimization are welcome.   Thanks a lot for your support,   Karsten.  

Comments

1 comment

Date Votes
  • Comment author
    Anastazie Sedlakova DNAnexus Team

    Hello,

    you can use dx watch -l INFO, this will print only INFO level logs.

     

    Here is an example

     

    $dx watch -l INFO job-ID

    Watching job job-ID. Press Ctrl+C to stop.

    * ttyd (terminated) job-ID

    ...

    2021-12-09 03:40:51 ttyd INFO CPU: 7% (4 cores) * Memory: 1116/7665MB * Storage: 11/96GB * Net: 3?/7?MBps

    ...

    2021-12-09 05:30:51 ttyd INFO CPU: 1% (4 cores) * Memory: 1369/7665MB * Storage: 15/96GB * Net: 0?/0?MBps

     

    Hope that helps,

    Anastazie

    0

Please sign in to leave a comment.