[PATCH 0/3] erofs-utils: mkfs: s3: switch to libcurl multiplexing api

[zhaoyifan (H)]

sry the workload A and B here were mistakely swapped...



发件人：Yifan Zhao <zhaoyifan28 at huawei.com<mailto:zhaoyifan28 at huawei.com>>
收件人：linux-erofs at lists.ozlabs.org <linux-erofs at lists.ozlabs.org<mailto:linux-erofs at lists.ozlabs.org>>
抄 送：Lihongbo(hb-lee,OS Lab) <lihongbo22 at huawei.com<mailto:lihongbo22 at huawei.com>>; jingrui <jingrui at huawei.com<mailto:jingrui at huawei.com>>; Mawen (Wayne) <wayne.ma at huawei.com<mailto:wayne.ma at huawei.com>>
主 题：[PATCH 0/3] erofs-utils: mkfs: s3: switch to libcurl multiplexing api
时 间：2025-09-18　23:13:34

From: zhaoyifan <zhaoyifan28 at huawei.com>

This patchset use curl_multi* API in s3erofs to improve performance while
interacting with a large number of files.

E2E mkfs.erofs image building time comparison:
- Workload A: Building from 3000 empty files
- Workload B: Building from 3000 files with size in 2~5 Bytes

+------------+------------+------------+
|            | Baseline   | Optimized  |
+------------+------------+------------+
| Workload A | 72.24s     | 5.08s      |
+------------+------------+------------+
| Workload B | 34.31s     | 0.61s      |
+------------+------------+------------+

zhaoyifan (3):
  erofs-utils: add mount/mount.erofs to .gitignore
  erofs-utils: lib: avoid using lseek in diskbuf
  erofs-utils: mkfs: use libcurl multiplexing api to optimize S3
    interaction

 .gitignore       |   1 +
 lib/diskbuf.c    |   7 +-
 lib/remotes/s3.c | 400 +++++++++++++++++++++++++++++++++--------------
 lib/tar.c        |   2 +-
 4 files changed, 284 insertions(+), 126 deletions(-)

--
2.46.0



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ozlabs.org/pipermail/linux-erofs/attachments/20250918/87f042fa/attachment.htm>