Inicio Explorar Axuda
Iniciar sesión
DricomDragon
/
BucketUpdater
1
0
Fork 0
Ficheiros Incidencias 0 Pull Requests 0

Recruiting test aiming to synchronize an S3 bucket from a local folder

Rama: master
Ramas Etiquetas
BucketUpdater
ZIP TAR.GZ
DricomDragon 361ac3df5a Add running instructions and limits of script %!s(int64=3) %!d(string=hai) anos
test e79fb7152e Adding more dummy data %!s(int64=3) %!d(string=hai) anos
.gitignore 5cedd1f42a Initial commit %!s(int64=3) %!d(string=hai) anos
LICENSE 5cedd1f42a Initial commit %!s(int64=3) %!d(string=hai) anos
README.md 361ac3df5a Add running instructions and limits of script %!s(int64=3) %!d(string=hai) anos
boto-updater.py fd7e3595fa Fix listing files in empty bucket %!s(int64=3) %!d(string=hai) anos
run_minio.sh 21d4f3a77f Create Minio runner for local testing %!s(int64=3) %!d(string=hai) anos

README.md

BucketUpdater

Recruiting test aiming to synchronize an S3 bucket from a local folder

Run local tests

Mock AWS

Run the Minio instance locally (Docker is required):

sudo ./run_minio.sh

Run updater

python3 boto-updater.py

You can modify files in ./test/data or in bucket with Minio web portal to manually test different use cases.

Limits

  • Locally modified files are not updated if already existing on Bucket
  • Arguments of scripts are hardcoded
  • Subfolder are not supported
  • Can be optimized with multithreading