Strona główna Odkrywaj Pomoc
Zaloguj się
DricomDragon
/
BucketUpdater
1
0
Forkuj 0
Pliki Problemy 0 Oczekujące zmiany 0

Recruiting test aiming to synchronize an S3 bucket from a local folder

Gałąź: master
Gałęzie Tagi
BucketUpdater
ZIP TAR.GZ
DricomDragon 361ac3df5a Add running instructions and limits of script 4 lat temu
test e79fb7152e Adding more dummy data 4 lat temu
.gitignore 5cedd1f42a Initial commit 4 lat temu
LICENSE 5cedd1f42a Initial commit 4 lat temu
README.md 361ac3df5a Add running instructions and limits of script 4 lat temu
boto-updater.py fd7e3595fa Fix listing files in empty bucket 4 lat temu
run_minio.sh 21d4f3a77f Create Minio runner for local testing 4 lat temu

README.md

BucketUpdater

Recruiting test aiming to synchronize an S3 bucket from a local folder

Run local tests

Mock AWS

Run the Minio instance locally (Docker is required):

sudo ./run_minio.sh

Run updater

python3 boto-updater.py

You can modify files in ./test/data or in bucket with Minio web portal to manually test different use cases.

Limits

  • Locally modified files are not updated if already existing on Bucket
  • Arguments of scripts are hardcoded
  • Subfolder are not supported
  • Can be optimized with multithreading