AWS Workflow Troubleshooting

AWS Workflow Troubleshooting

Manually triggering postprocessing

Sometimes a postprocessing job on EMR fails. Here's how to manually restart it without having to rerun all your simulations.

Finding buildstockbatch console output on AWS

Sometimes the bucket/prefix/results/simulation_output directory on S3 is empty or doesn't contain all the information you need to debug a failed run. In that situation, the console output from buildstockbatch can be helpful. Here's how to find it:

1. In the AWS console, open the "AWS Batch" service
2. Find your job, based on the aws:job_identifier in your .yml file
3. Click the number 1 next to either the green check or the red X
4. Click the job index of a job
5. Scroll to the bottom and click the Job attempts dropdown
6. Click log stream name link
7. This opens a cloudwatch log where the buildstockbatch console output can be seen
8. Click "Actions -> Copy/Download ASCII" to save the results to look at them in a text editor