filemap: Correct the conditions for marking a folio as accessed

We had an off-by-one error which meant that we never marked the first page
in a read as accessed.  This was visible as a slowdown when re-reading
a file as pages were being evicted from cache too soon.  In reviewing
this code, we noticed a second bug where a multi-page folio would be
marked as accessed multiple times when doing reads that were less than
the size of the folio.

Abstract the comparison of whether two file positions are in the same
folio into a new function, fixing both of these bugs.
Reported-by: default avatarYu Kuai <yukuai3@huawei.com>
Reviewed-by: default avatarKent Overstreet <kent.overstreet@gmail.com>
Signed-off-by: default avatarMatthew Wilcox (Oracle) <willy@infradead.org>
parent 78ca5588
...@@ -2629,6 +2629,13 @@ static int filemap_get_pages(struct kiocb *iocb, struct iov_iter *iter, ...@@ -2629,6 +2629,13 @@ static int filemap_get_pages(struct kiocb *iocb, struct iov_iter *iter,
return err; return err;
} }
static inline bool pos_same_folio(loff_t pos1, loff_t pos2, struct folio *folio)
{
unsigned int shift = folio_shift(folio);
return (pos1 >> shift == pos2 >> shift);
}
/** /**
* filemap_read - Read data from the page cache. * filemap_read - Read data from the page cache.
* @iocb: The iocb to read. * @iocb: The iocb to read.
...@@ -2700,11 +2707,11 @@ ssize_t filemap_read(struct kiocb *iocb, struct iov_iter *iter, ...@@ -2700,11 +2707,11 @@ ssize_t filemap_read(struct kiocb *iocb, struct iov_iter *iter,
writably_mapped = mapping_writably_mapped(mapping); writably_mapped = mapping_writably_mapped(mapping);
/* /*
* When a sequential read accesses a page several times, only * When a read accesses the same folio several times, only
* mark it as accessed the first time. * mark it as accessed the first time.
*/ */
if (iocb->ki_pos >> PAGE_SHIFT != if (!pos_same_folio(iocb->ki_pos, ra->prev_pos - 1,
ra->prev_pos >> PAGE_SHIFT) fbatch.folios[0]))
folio_mark_accessed(fbatch.folios[0]); folio_mark_accessed(fbatch.folios[0]);
for (i = 0; i < folio_batch_count(&fbatch); i++) { for (i = 0; i < folio_batch_count(&fbatch); i++) {
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment