Commit cef23d9d authored by Rik van Riel's avatar Rik van Riel Committed by Mel Gorman

mm,generic: only flush the local TLB in ptep_set_access_flags

The function ptep_set_access_flags is only ever used to upgrade
access permissions to a page. That means the only negative side
effect of not flushing remote TLBs is that other CPUs may incur
spurious page faults, if they happen to access the same address,
and still have a PTE with the old permissions cached in their
TLB.

Having another CPU maybe incur a spurious page fault is faster
than always incurring the cost of a remote TLB flush, so replace
the remote TLB flush with a purely local one.

This should be safe on every architecture that correctly
implements flush_tlb_fix_spurious_fault() to actually invalidate
the local TLB entry that caused a page fault, as well as on
architectures where the hardware invalidates TLB entries that
cause page faults.

In the unlikely event that you are hitting what appears to be
an infinite loop of page faults, and 'git bisect' took you to
this changeset, your architecture needs to implement
flush_tlb_fix_spurious_fault to actually flush the TLB entry.
Signed-off-by: default avatarRik van Riel <riel@redhat.com>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Peter Zijlstra <a.p.zijlstra@chello.nl>
Cc: Michel Lespinasse <walken@google.com>
Cc: Ingo Molnar <mingo@kernel.org>
parent e4a1cc56
...@@ -12,8 +12,8 @@ ...@@ -12,8 +12,8 @@
#ifndef __HAVE_ARCH_PTEP_SET_ACCESS_FLAGS #ifndef __HAVE_ARCH_PTEP_SET_ACCESS_FLAGS
/* /*
* Only sets the access flags (dirty, accessed, and * Only sets the access flags (dirty, accessed), as well as write
* writable). Furthermore, we know it always gets set to a "more * permission. Furthermore, we know it always gets set to a "more
* permissive" setting, which allows most architectures to optimize * permissive" setting, which allows most architectures to optimize
* this. We return whether the PTE actually changed, which in turn * this. We return whether the PTE actually changed, which in turn
* instructs the caller to do things like update__mmu_cache. This * instructs the caller to do things like update__mmu_cache. This
...@@ -27,7 +27,7 @@ int ptep_set_access_flags(struct vm_area_struct *vma, ...@@ -27,7 +27,7 @@ int ptep_set_access_flags(struct vm_area_struct *vma,
int changed = !pte_same(*ptep, entry); int changed = !pte_same(*ptep, entry);
if (changed) { if (changed) {
set_pte_at(vma->vm_mm, address, ptep, entry); set_pte_at(vma->vm_mm, address, ptep, entry);
flush_tlb_page(vma, address); flush_tlb_fix_spurious_fault(vma, address);
} }
return changed; return changed;
} }
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment