Commit 1401bef7 authored by James Morse's avatar James Morse Committed by Will Deacon

arm64: mm: Always update TCR_EL1 from __cpu_set_tcr_t0sz()

Because only the idmap sets a non-standard T0SZ, __cpu_set_tcr_t0sz()
can check for platforms that need to do this using
__cpu_uses_extended_idmap() before doing its work.

The idmap is only built with enough levels, (and T0SZ bits) to map
its single page.

To allow hibernate, and then kexec to idmap their single page copy
routines, __cpu_set_tcr_t0sz() needs to consider additional users,
who may need a different number of levels/T0SZ-bits to the idmap.
(i.e. VA_BITS may be enough for the idmap, but not hibernate/kexec)

Always read TCR_EL1, and check whether any work needs doing for
this request. __cpu_uses_extended_idmap() remains as it is used
by KVM, whose idmap is also part of the kernel image.

This mostly affects the cpuidle path, where we now get an extra
system register read .

CC: Lorenzo Pieralisi <Lorenzo.Pieralisi@arm.com>
CC: Sudeep Holla <sudeep.holla@arm.com>
Signed-off-by: default avatarJames Morse <james.morse@arm.com>
Signed-off-by: default avatarPavel Tatashin <pasha.tatashin@soleen.com>
Link: https://lore.kernel.org/r/20210125191923.1060122-8-pasha.tatashin@soleen.comSigned-off-by: default avatarWill Deacon <will@kernel.org>
parent 5de59884
...@@ -81,16 +81,15 @@ static inline bool __cpu_uses_extended_idmap_level(void) ...@@ -81,16 +81,15 @@ static inline bool __cpu_uses_extended_idmap_level(void)
} }
/* /*
* Set TCR.T0SZ to its default value (based on VA_BITS) * Ensure TCR.T0SZ is set to the provided value.
*/ */
static inline void __cpu_set_tcr_t0sz(unsigned long t0sz) static inline void __cpu_set_tcr_t0sz(unsigned long t0sz)
{ {
unsigned long tcr; unsigned long tcr = read_sysreg(tcr_el1);
if (!__cpu_uses_extended_idmap()) if ((tcr & TCR_T0SZ_MASK) >> TCR_T0SZ_OFFSET == t0sz)
return; return;
tcr = read_sysreg(tcr_el1);
tcr &= ~TCR_T0SZ_MASK; tcr &= ~TCR_T0SZ_MASK;
tcr |= t0sz << TCR_T0SZ_OFFSET; tcr |= t0sz << TCR_T0SZ_OFFSET;
write_sysreg(tcr, tcr_el1); write_sysreg(tcr, tcr_el1);
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment