[PATCH 0/3] erofs-utils: mkfs: s3: switch to libcurl multiplexing api
Yifan Zhao
zhaoyifan28 at huawei.com
Fri Sep 19 01:12:42 AEST 2025
From: zhaoyifan <zhaoyifan28 at huawei.com>
This patchset use curl_multi* API in s3erofs to improve performance while
interacting with a large number of files.
E2E mkfs.erofs image building time comparison:
- Workload A: Building from 3000 empty files
- Workload B: Building from 3000 files with size in 2~5 Bytes
+------------+------------+------------+
| | Baseline | Optimized |
+------------+------------+------------+
| Workload A | 72.24s | 5.08s |
+------------+------------+------------+
| Workload B | 34.31s | 0.61s |
+------------+------------+------------+
zhaoyifan (3):
erofs-utils: add mount/mount.erofs to .gitignore
erofs-utils: lib: avoid using lseek in diskbuf
erofs-utils: mkfs: use libcurl multiplexing api to optimize S3
interaction
.gitignore | 1 +
lib/diskbuf.c | 7 +-
lib/remotes/s3.c | 400 +++++++++++++++++++++++++++++++++--------------
lib/tar.c | 2 +-
4 files changed, 284 insertions(+), 126 deletions(-)
--
2.46.0
More information about the Linux-erofs
mailing list