bpf: Use pcpu_alloc_size() in bpf_mem_free{_rcu}()
authorHou Tao <houtao1@huawei.com>
Fri, 20 Oct 2023 13:31:59 +0000 (21:31 +0800)
committerAlexei Starovoitov <ast@kernel.org>
Fri, 20 Oct 2023 21:15:13 +0000 (14:15 -0700)
commit3f2189e4f77b7a3e979d143dc4ff586488c7e8a5
treed2b472bb05a3c5e94c26e69d30c09dc91139bf00
parentbaa8fdecd87bb8751237b45e3bcb5a179e5a12ca
bpf: Use pcpu_alloc_size() in bpf_mem_free{_rcu}()

For bpf_global_percpu_ma, the pointer passed to bpf_mem_free_rcu() is
allocated by kmalloc() and its size is fixed (16-bytes on x86-64). So
no matter which cache allocates the dynamic per-cpu area, on x86-64
cache[2] will always be used to free the per-cpu area.

Fix the unbalance by checking whether the bpf memory allocator is
per-cpu or not and use pcpu_alloc_size() instead of ksize() to
find the correct cache for per-cpu free.

Signed-off-by: Hou Tao <houtao1@huawei.com>
Link: https://lore.kernel.org/r/20231020133202.4043247-5-houtao@huaweicloud.com
Signed-off-by: Alexei Starovoitov <ast@kernel.org>
include/linux/bpf_mem_alloc.h
kernel/bpf/memalloc.c