Publications

KL-Regularized RLHF with Multiple Reference Models: Exact Solutions and Sample Complexity