Please add native support for Geometric-Mean Policy Optimization (GMPO) to Liger’s chunked GRPO loss.
GMPO is a policy optimization algorithm published at ICLR 2026 that improves training stability by applying token-level clipping and aggregating importance ratios with a sequence-level geometric mean. Using DeepSeek-R1-Distill-Qwen-7B, GMPO improves the average Pass@1 score across five mathematical reasoning benchmarks from GRPO’s 59.3 to 63.4.
official code:https://github.com/callsys/GMPO
Please add native support for Geometric-Mean Policy Optimization (GMPO) to Liger’s chunked GRPO loss.
GMPO is a policy optimization algorithm published at ICLR 2026 that improves training stability by applying token-level clipping and aggregating importance ratios with a sequence-level geometric mean. Using DeepSeek-R1-Distill-Qwen-7B, GMPO improves the average Pass@1 score across five mathematical reasoning benchmarks from GRPO’s 59.3 to 63.4.
official code:https://github.com/callsys/GMPO