[HN Gopher] Ordering Requests to Accelerate Disk I/O ___________________________________________________________________ Ordering Requests to Accelerate Disk I/O Author : pkolaczk Score : 10 points Date : 2021-04-05 06:14 UTC (1 days ago) (HTM) web link (pkolaczk.github.io) (TXT) w3m dump (pkolaczk.github.io) | the8472 wrote: | A few things that can make walking HDDs by physical layout even | faster: | | * also do it when walking directories! on ext4 you can FIEMAP the | directories while walking them. | | * keep a readahead buffer that spans multiple files, that way you | can keep X megabytes in flight even when the files are small | | * do readaheads on directories (can only be done as root for | ext4) | | * do drop-behind to prevent page cache thrashing | | I wrote some crates for that: https://crates.io/crates/platter- | walk https://crates.io/crates/reapfrog ___________________________________________________________________ (page generated 2021-04-06 23:00 UTC)