• Alexei Starovoitov's avatar
    bpf: fix x64 JIT code generation for jmp to 1st insn · 7c2e988f
    Alexei Starovoitov authored
    Introduction of bounded loops exposed old bug in x64 JIT.
    JIT maintains the array of offsets to the end of all instructions to
    compute jmp offsets.
    addrs[0] - offset of the end of the 1st insn (that includes prologue).
    addrs[1] - offset of the end of the 2nd insn.
    JIT didn't keep the offset of the beginning of the 1st insn,
    since classic BPF didn't have backward jumps and valid extended BPF
    couldn't have a branch to 1st insn, because it didn't allow loops.
    With bounded loops it's possible to construct a valid program that
    jumps backwards to the 1st insn.
    Fix JIT by computing:
    addrs[0] - offset of the end of prologue == start of the 1st insn.
    addrs[1] - offset of the end of 1st insn.
    
    v1->v2:
    - Yonghong noticed a bug in jit linfo.
      Fix it by passing 'addrs + 1' to bpf_prog_fill_jited_linfo(),
      since it expects insn_to_jit_off array to be offsets to last byte.
    
    Reported-by: syzbot+35101610ff3e83119b1b@syzkaller.appspotmail.com
    Fixes: 2589726d ("bpf: introduce bounded loops")
    Fixes: 0a14842f ("net: filter: Just In Time compiler for x86-64")
    Signed-off-by: default avatarAlexei Starovoitov <ast@kernel.org>
    Acked-by: default avatarSong Liu <songliubraving@fb.com>
    7c2e988f
bpf_jit_comp.c 30 KB