Scripts¶

A set of helper scripts for the batching system.

Note that this directory is required to sit in $PATH. By convention, all executables in this directory start with nesta_ so that our developers know where to find them.

nesta_prepare_batch¶

Collect a batchable run.py file, including dependencies and an automaticlly generated requirements file; which is all zipped up and sent to AWS S3 for batching. This script is executed automatically in luigihacks.autobatch.AutoBatchTask.run.

Parameters:

BATCHABLE_DIRECTORY: The path to the directory containing the batchable run.py file.
ARGS: Space-separated-list of files or directories to include in the zip file, for example imports.

nesta_docker_build¶

Build a docker environment and register it with the AWS ECS container repository.

Parameters:

DOCKER_RECIPE: A docker recipe. See docker_recipes/ for a good idea of how to build a new environment.