Recruiting test aiming to synchronize an S3 bucket from a local folder

DricomDragon 361ac3df5a Add running instructions and limits of script 3 lat temu
test e79fb7152e Adding more dummy data 3 lat temu
.gitignore 5cedd1f42a Initial commit 3 lat temu
LICENSE 5cedd1f42a Initial commit 3 lat temu
README.md 361ac3df5a Add running instructions and limits of script 3 lat temu
boto-updater.py fd7e3595fa Fix listing files in empty bucket 3 lat temu
run_minio.sh 21d4f3a77f Create Minio runner for local testing 3 lat temu

README.md

BucketUpdater

Recruiting test aiming to synchronize an S3 bucket from a local folder

Run local tests

Mock AWS

Run the Minio instance locally (Docker is required):

sudo ./run_minio.sh

Run updater

python3 boto-updater.py

You can modify files in ./test/data or in bucket with Minio web portal to manually test different use cases.

Limits

  • Locally modified files are not updated if already existing on Bucket
  • Arguments of scripts are hardcoded
  • Subfolder are not supported
  • Can be optimized with multithreading