• Thomas Gleixner's avatar
    x86/pkru: Write hardware init value to PKRU when xstate is init · 510b80a6
    Thomas Gleixner authored
    When user space brings PKRU into init state, then the kernel handling is
    broken:
    
      T1 user space
         xsave(state)
         state.header.xfeatures &= ~XFEATURE_MASK_PKRU;
         xrstor(state)
    
      T1 -> kernel
         schedule()
           XSAVE(S) -> T1->xsave.header.xfeatures[PKRU] == 0
           T1->flags |= TIF_NEED_FPU_LOAD;
    
           wrpkru();
    
         schedule()
           ...
           pk = get_xsave_addr(&T1->fpu->state.xsave, XFEATURE_PKRU);
           if (pk)
    	 wrpkru(pk->pkru);
           else
    	 wrpkru(DEFAULT_PKRU);
    
    Because the xfeatures bit is 0 and therefore the value in the xsave
    storage is not valid, get_xsave_addr() returns NULL and switch_to()
    writes the default PKRU. -> FAIL #1!
    
    So that wrecks any copy_to/from_user() on the way back to user space
    which hits memory which is protected by the default PKRU value.
    
    Assumed that this does not fail (pure luck) then T1 goes back to user
    space and because TIF_NEED_FPU_LOAD is set it ends up in
    
      switch_fpu_return()
          __fpregs_load_activate()
            if (!fpregs_state_valid()) {
      	 load_XSTATE_from_task();
            }
    
    But if nothing touched the FPU between T1 scheduling out and back in,
    then the fpregs_state is still valid which means switch_fpu_return()
    does nothing and just clears TIF_NEED_FPU_LOAD. Back to user space with
    DEFAULT_PKRU loaded. -> FAIL #2!
    
    The fix is simple: if get_xsave_addr() returns NULL then set the
    PKRU value to 0 instead of the restrictive default PKRU value in
    init_pkru_value.
    
     [ bp: Massage in minor nitpicks from folks. ]
    
    Fixes: 0cecca9d ("x86/fpu: Eager switch PKRU state")
    Signed-off-by: default avatarThomas Gleixner <tglx@linutronix.de>
    Signed-off-by: default avatarBorislav Petkov <bp@suse.de>
    Acked-by: default avatarDave Hansen <dave.hansen@linux.intel.com>
    Acked-by: default avatarRik van Riel <riel@surriel.com>
    Tested-by: default avatarBabu Moger <babu.moger@amd.com>
    Cc: stable@vger.kernel.org
    Link: https://lkml.kernel.org/r/20210608144346.045616965@linutronix.de
    510b80a6
internal.h 15.8 KB