[PATCH 0/3] erofs-utils: mkfs: s3: switch to libcurl multiplexing api

Yifan Zhao zhaoyifan28 at huawei.com
Fri Sep 19 01:12:42 AEST 2025


From: zhaoyifan <zhaoyifan28 at huawei.com>

This patchset use curl_multi* API in s3erofs to improve performance while
interacting with a large number of files.

E2E mkfs.erofs image building time comparison:
- Workload A: Building from 3000 empty files
- Workload B: Building from 3000 files with size in 2~5 Bytes

+------------+------------+------------+
|            | Baseline   | Optimized  |
+------------+------------+------------+
| Workload A | 72.24s     | 5.08s      |
+------------+------------+------------+
| Workload B | 34.31s     | 0.61s      |
+------------+------------+------------+

zhaoyifan (3):
  erofs-utils: add mount/mount.erofs to .gitignore
  erofs-utils: lib: avoid using lseek in diskbuf
  erofs-utils: mkfs: use libcurl multiplexing api to optimize S3
    interaction

 .gitignore       |   1 +
 lib/diskbuf.c    |   7 +-
 lib/remotes/s3.c | 400 +++++++++++++++++++++++++++++++++--------------
 lib/tar.c        |   2 +-
 4 files changed, 284 insertions(+), 126 deletions(-)

-- 
2.46.0



More information about the Linux-erofs mailing list