Recruiting test aiming to synchronize an S3 bucket from a local folder

DricomDragon 361ac3df5a Add running instructions and limits of script пре 3 година
test e79fb7152e Adding more dummy data пре 3 година
.gitignore 5cedd1f42a Initial commit пре 3 година
LICENSE 5cedd1f42a Initial commit пре 3 година
README.md 361ac3df5a Add running instructions and limits of script пре 3 година
boto-updater.py fd7e3595fa Fix listing files in empty bucket пре 3 година
run_minio.sh 21d4f3a77f Create Minio runner for local testing пре 3 година

README.md

BucketUpdater

Recruiting test aiming to synchronize an S3 bucket from a local folder

Run local tests

Mock AWS

Run the Minio instance locally (Docker is required):

sudo ./run_minio.sh

Run updater

python3 boto-updater.py

You can modify files in ./test/data or in bucket with Minio web portal to manually test different use cases.

Limits

  • Locally modified files are not updated if already existing on Bucket
  • Arguments of scripts are hardcoded
  • Subfolder are not supported
  • Can be optimized with multithreading