• Muchun Song's avatar
    mm: memcontrol: fix root_mem_cgroup charging · c5c8b16b
    Muchun Song authored
    The below scenario can cause the page counters of the root_mem_cgroup to
    be out of balance.
    
    CPU0:                                   CPU1:
    
    objcg = get_obj_cgroup_from_current()
    obj_cgroup_charge_pages(objcg)
                                            memcg_reparent_objcgs()
                                                // reparent to root_mem_cgroup
                                                WRITE_ONCE(iter->memcg, parent)
        // memcg == root_mem_cgroup
        memcg = get_mem_cgroup_from_objcg(objcg)
        // do not charge to the root_mem_cgroup
        try_charge(memcg)
    
    obj_cgroup_uncharge_pages(objcg)
        memcg = get_mem_cgroup_from_objcg(objcg)
        // uncharge from the root_mem_cgroup
        refill_stock(memcg)
            drain_stock(memcg)
                page_counter_uncharge(&memcg->memory)
    
    get_obj_cgroup_from_current() never returns a root_mem_cgroup's objcg, so
    we never explicitly charge the root_mem_cgroup.  And it's not going to
    change.  It's all about a race when we got an obj_cgroup pointing at some
    non-root memcg, but before we were able to charge it, the cgroup was gone,
    objcg was reparented to the root and so we're skipping the charging.  Then
    we store the objcg pointer and later use to uncharge the root_mem_cgroup.
    
    This can cause the page counter to be less than the actual value.
    Although we do not display the value (mem_cgroup_usage) so there shouldn't
    be any actual problem, but there is a WARN_ON_ONCE in the
    page_counter_cancel().  Who knows if it will trigger?  So it is better to
    fix it.
    
    Link: https://lkml.kernel.org/r/20210425075410.19255-1-songmuchun@bytedance.comSigned-off-by: default avatarMuchun Song <songmuchun@bytedance.com>
    Acked-by: default avatarRoman Gushchin <guro@fb.com>
    Reviewed-by: default avatarShakeel Butt <shakeelb@google.com>
    Cc: Xiongchun Duan <duanxiongchun@bytedance.com>
    Cc: Johannes Weiner <hannes@cmpxchg.org>
    Cc: Michal Hocko <mhocko@kernel.org>
    Cc: Vladimir Davydov <vdavydov.dev@gmail.com>
    Signed-off-by: default avatarAndrew Morton <akpm@linux-foundation.org>
    Signed-off-by: default avatarLinus Torvalds <torvalds@linux-foundation.org>
    c5c8b16b
memcontrol.c 192 KB