rcu: Add full-sized polling for start_poll_expedited()
authorPaul E. McKenney <paulmck@kernel.org>
Wed, 3 Aug 2022 19:38:51 +0000 (12:38 -0700)
committerPaul E. McKenney <paulmck@kernel.org>
Wed, 31 Aug 2022 12:08:08 +0000 (05:08 -0700)
commit6c502b14ba66da0670a59e20354469fa56eab26c
tree5a679c428171685fe7328744ae9dab32f5e0ba00
parent76ea364161e72b1878126edf8d507d2a62fb47b0
rcu: Add full-sized polling for start_poll_expedited()

The start_poll_synchronize_rcu_expedited() API compresses the combined
expedited and normal grace-period states into a single unsigned long,
which conserves storage, but can miss grace periods in certain cases
involving overlapping normal and expedited grace periods.  Missing the
occasional grace period is usually not a problem, but there are use
cases that care about each and every grace period.

This commit therefore adds yet another member of the
full-state RCU grace-period polling API, which is the
start_poll_synchronize_rcu_expedited_full() function.  This uses up to
three times the storage (rcu_gp_oldstate structure instead of unsigned
long), but is guaranteed not to miss grace periods.

[ paulmck: Apply feedback from kernel test robot and Julia Lawall. ]

Signed-off-by: Paul E. McKenney <paulmck@kernel.org>
include/linux/rcutiny.h
include/linux/rcutree.h
kernel/rcu/rcutorture.c
kernel/rcu/tree_exp.h