Commit Graph

2 Commits

Author SHA1 Message Date
Lena Tauchner
6729782c3f fix(cli): Concurrency not fully using queue potential (#11828)
Some checks failed
CodeQL / Analyze (javascript) (push) Failing after 1m51s
CodeQL / Analyze (python) (push) Failing after 25s
Docker / pre-job (push) Successful in 8s
Docs build / pre-job (push) Successful in 5s
Static Code Analysis / pre-job (push) Successful in 6s
Test / pre-job (push) Successful in 6s
Test / ShellCheck (push) Successful in 9s
Test / OpenAPI Clients (push) Failing after 2m24s
Test / TypeORM Checks (push) Failing after 13s
CLI Build / Docker (push) Failing after 1m12s
Docker / Re-Tag ML () (push) Failing after 4s
Docker / Re-Tag ML (-armnn) (push) Failing after 4s
Docker / Re-Tag ML (-cuda) (push) Failing after 4s
Docker / Re-Tag ML (-openvino) (push) Failing after 5s
Docker / Re-Tag Server () (push) Failing after 4s
Docker / Build and Push ML (armnn, linux/arm64, -armnn) (push) Has been skipped
Docker / Build and Push ML (cpu, linux/amd64,linux/arm64) (push) Has been skipped
Docker / Build and Push ML (cuda, linux/amd64, -cuda) (push) Has been skipped
Docker / Build and Push ML (openvino, linux/amd64, -openvino) (push) Has been skipped
Docker / Build and Push Server (cpu, linux/amd64,linux/arm64) (push) Has been skipped
Docs build / Docs Build (push) Failing after 3m45s
Static Code Analysis / Run Dart Code Analysis (push) Has been skipped
Test / Test & Lint Server (push) Has been skipped
Test / Unit Test CLI (push) Successful in 18s
Test / Test & Lint Web (push) Has been skipped
Test / End-to-End Lint (push) Successful in 21s
Test / Unit Test Mobile (push) Has been skipped
Test / Unit Test ML (push) Has been skipped
Docker / Docker Build & Push ML Success (push) Successful in 2s
Docker / Docker Build & Push Server Success (push) Successful in 2s
2024-11-15 13:09:56 -05:00
Simon Thiboutôt
eb89208abb feat(cli): use a queue for duplicate and upload (#10750)
* feat(cli): use a queue for duplicate and upload

Using a queue to process the files makes the file duplicate detection and asset upload more stable and tolerant of network errors. If an error occurs, the whole command will not stop; the task will be retried (3 times) before logging the error and moving to the next step.

The new queue abstraction is using [fastq](https://www.npmjs.com/package/fastq) internally.

* chore(cli): queue.push return promise which resolve with task

* test(cli): add spec for uploadFiles and checkForDuplicates
2024-07-08 22:39:07 -05:00