Merge pull request #74 from datalab-to/dev

Dev

Flatten in annotation

Fix file output dir

Set proper batch sizes

Fix vllm token

Fix attn impl

Fix attn impl

Fix up repo

Fix license and README