Commit d6a4f709 authored by Paul Mackerras's avatar Paul Mackerras Committed by Michael Ellerman

powerpc/powernv: Don't call generic code on offline cpus

On PowerNV platforms, when a CPU is offline, we put it into nap mode.
It's possible that the CPU wakes up from nap mode while it is still
offline due to a stray IPI.  A misdirected device interrupt could also
potentially cause it to wake up.  In that circumstance, we need to clear
the interrupt so that the CPU can go back to nap mode.

In the past the clearing of the interrupt was accomplished by briefly
enabling interrupts and allowing the normal interrupt handling code
(do_IRQ() etc.) to handle the interrupt.  This has the problem that
this code calls irq_enter() and irq_exit(), which call functions such
as account_system_vtime() which use RCU internally.  Use of RCU is not
permitted on offline CPUs and will trigger errors if RCU checking is
enabled.

To avoid calling into any generic code which might use RCU, we adopt
a different method of clearing interrupts on offline CPUs.  Since we
are on the PowerNV platform, we know that the system interrupt
controller is a XICS being driven directly (i.e. not via hcalls) by
the kernel.  Hence this adds a new icp_native_flush_interrupt()
function to the native-mode XICS driver and arranges to call that
when an offline CPU is woken from nap.  This new function reads the
interrupt from the XICS.  If it is an IPI, it clears the IPI; if it
is a device interrupt, it prints a warning and disables the source.
Then it does the end-of-interrupt processing for the interrupt.

The other thing that briefly enabling interrupts did was to check and
clear the irq_happened flag in this CPU's PACA.  Therefore, after
flushing the interrupt from the XICS, we also clear all bits except
the PACA_IRQ_HARD_DIS (interrupts are hard disabled) bit from the
irq_happened flag.  The PACA_IRQ_HARD_DIS flag is set by power7_nap()
and is left set to indicate that interrupts are hard disabled.  This
means we then have to ignore that flag in power7_nap(), which is
reasonable since it doesn't indicate that any interrupt event needs
servicing.
Signed-off-by: default avatarPaul Mackerras <paulus@samba.org>
Signed-off-by: default avatarMichael Ellerman <mpe@ellerman.id.au>
parent 423216ed
...@@ -29,6 +29,7 @@ ...@@ -29,6 +29,7 @@
/* Native ICP */ /* Native ICP */
#ifdef CONFIG_PPC_ICP_NATIVE #ifdef CONFIG_PPC_ICP_NATIVE
extern int icp_native_init(void); extern int icp_native_init(void);
extern void icp_native_flush_interrupt(void);
#else #else
static inline int icp_native_init(void) { return -ENODEV; } static inline int icp_native_init(void) { return -ENODEV; }
#endif #endif
......
...@@ -73,7 +73,7 @@ _GLOBAL(power7_powersave_common) ...@@ -73,7 +73,7 @@ _GLOBAL(power7_powersave_common)
/* Check if something happened while soft-disabled */ /* Check if something happened while soft-disabled */
lbz r0,PACAIRQHAPPENED(r13) lbz r0,PACAIRQHAPPENED(r13)
cmpwi cr0,r0,0 andi. r0,r0,~PACA_IRQ_HARD_DIS@l
beq 1f beq 1f
cmpwi cr0,r4,0 cmpwi cr0,r4,0
beq 1f beq 1f
......
...@@ -168,9 +168,9 @@ static void pnv_smp_cpu_kill_self(void) ...@@ -168,9 +168,9 @@ static void pnv_smp_cpu_kill_self(void)
power7_nap(1); power7_nap(1);
ppc64_runlatch_on(); ppc64_runlatch_on();
/* Reenable IRQs briefly to clear the IPI that woke us */ /* Clear the IPI that woke us up */
local_irq_enable(); icp_native_flush_interrupt();
local_irq_disable(); local_paca->irq_happened &= PACA_IRQ_HARD_DIS;
mb(); mb();
if (cpu_core_split_required()) if (cpu_core_split_required())
......
...@@ -155,6 +155,31 @@ static void icp_native_cause_ipi(int cpu, unsigned long data) ...@@ -155,6 +155,31 @@ static void icp_native_cause_ipi(int cpu, unsigned long data)
icp_native_set_qirr(cpu, IPI_PRIORITY); icp_native_set_qirr(cpu, IPI_PRIORITY);
} }
/*
* Called when an interrupt is received on an off-line CPU to
* clear the interrupt, so that the CPU can go back to nap mode.
*/
void icp_native_flush_interrupt(void)
{
unsigned int xirr = icp_native_get_xirr();
unsigned int vec = xirr & 0x00ffffff;
if (vec == XICS_IRQ_SPURIOUS)
return;
if (vec == XICS_IPI) {
/* Clear pending IPI */
int cpu = smp_processor_id();
kvmppc_set_host_ipi(cpu, 0);
icp_native_set_qirr(cpu, 0xff);
} else {
pr_err("XICS: hw interrupt 0x%x to offline cpu, disabling\n",
vec);
xics_mask_unknown_vec(vec);
}
/* EOI the interrupt */
icp_native_set_xirr(xirr);
}
void xics_wake_cpu(int cpu) void xics_wake_cpu(int cpu)
{ {
icp_native_set_qirr(cpu, IPI_PRIORITY); icp_native_set_qirr(cpu, IPI_PRIORITY);
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment