Recruiting test aiming to synchronize an S3 bucket from a local folder

DricomDragon 361ac3df5a Add running instructions and limits of script há 3 anos atrás
test e79fb7152e Adding more dummy data há 3 anos atrás
.gitignore 5cedd1f42a Initial commit há 3 anos atrás
LICENSE 5cedd1f42a Initial commit há 3 anos atrás
README.md 361ac3df5a Add running instructions and limits of script há 3 anos atrás
boto-updater.py fd7e3595fa Fix listing files in empty bucket há 3 anos atrás
run_minio.sh 21d4f3a77f Create Minio runner for local testing há 3 anos atrás

README.md

BucketUpdater

Recruiting test aiming to synchronize an S3 bucket from a local folder

Run local tests

Mock AWS

Run the Minio instance locally (Docker is required):

sudo ./run_minio.sh

Run updater

python3 boto-updater.py

You can modify files in ./test/data or in bucket with Minio web portal to manually test different use cases.

Limits

  • Locally modified files are not updated if already existing on Bucket
  • Arguments of scripts are hardcoded
  • Subfolder are not supported
  • Can be optimized with multithreading