# Eval

## Prompts

The [prompts](prompts) directory contains the prompts used in evaluation

## Generate images with pretrained model

Default uses all available GPUs. Set world_size arg to use less than all GPUs. 

**Use generations.csv** as the final csv for eval. It contains all the generated image paths and relevant info.

```shell
python3 generate_images.py --csv_path [PROMPT_FILE_PATH] --ckpt_path [CKPT_PATH] --save_dir [SAVE_DIR]
```

## Metrics

The [metrics](metrics) directory contains the scripts to compute metrics