
Christophe Roux
My research interests lie at the intersection of optimization and machine learning. In particular, I am interested in online optimization, federated learning and optimization on riemannian manifolds.
Contact
- office
- Room 3107 at ZIB
- email shown with JavaScript enabled
email shown with JavaScript enabled - homepage
- christopheroux.de
- languages
- German, English, and French
Curriculum vitae
- since 2022
- Member of BMS
- since 2021
- Researcher at ZIB
- 2021
- Research Assistant at ZIB
- Jun 2021
- M.Sc. in Scientific Computing at TUB
- Feb 2018
- B.Sc. in Engineering Science at TUB
Publications and preprints
Preprints and reports
- Roux, C., Wirth, E., Pokutta, S., and Kerdreux, T. (2021). Efficient Online-Bandit Strategies for Minimax Learning Problems.
[arXiv]
[BibTeX]
@misc{2021_RouxWirthPokuttaKerdreux_Onlinebanditminimax, archiveprefix = {arXiv}, eprint = {2105.13939}, arxiv = {arXiv:2105.13939}, primaryclass = {cs.LG}, author = {Roux, Christophe and Wirth, Elias and Pokutta, Sebastian and Kerdreux, Thomas}, title = {Efficient Online-Bandit Strategies for Minimax Learning Problems}, date = {2021-05-28} } - Roux, C., Zimmer, M., d’Aspremont, A., and Pokutta, S. (2025). Don’t Be Greedy, Just Relax! Pruning LLMs via Frank-Wolfe.
[arXiv]
[BibTeX]
@misc{2025_RouxZimmerDaspremontPokutta_Pruningfrankwolfe_2510-13713, archiveprefix = {arXiv}, eprint = {2510.13713}, arxiv = {arXiv:2510.13713}, primaryclass = {cs.LG}, author = {Roux, Christophe and Zimmer, Max and d'Aspremont, Alexandre and Pokutta, Sebastian}, title = {Don't Be Greedy, Just Relax! Pruning LLMs via Frank-Wolfe}, date = {2025-10-15} } - Zimmer, M., Roux, C., Wagner, M., Hendrych, D., and Pokutta, S. (2025). SparseSwaps: Tractable LLM Pruning Mask Refinement at Scale.
[arXiv]
[BibTeX]
@misc{2025_ZimmerEtAl_Sparseswapspruning_2512-10922, archiveprefix = {arXiv}, eprint = {2512.10922}, arxiv = {arXiv:2512.10922}, primaryclass = {cs.LG}, author = {Zimmer, Max and Roux, Christophe and Wagner, Moritz and Hendrych, Deborah and Pokutta, Sebastian}, title = {SparseSwaps: Tractable LLM Pruning Mask Refinement at Scale}, date = {2025-12-11} } - Elhishi, A., Roux, C., and d’Aspremont, A. (2026). Restart and Adaptive Acceleration in Stochastic Gradient Methods.
[arXiv]
[BibTeX]
@misc{2026_ElhishiRouxD'aspremont_Restartacceleration_2606-21354, archiveprefix = {arXiv}, eprint = {2606.21354}, arxiv = {arXiv:2606.21354}, primaryclass = {math.OC}, author = {Elhishi, Ali and Roux, Christophe and d'Aspremont, Alexandre}, title = {Restart and Adaptive Acceleration in Stochastic Gradient Methods}, date = {2026-06-19} } - Schiekiera, L., Zimmer, M., Roux, C., Arnold, M., Pokutta, S., and Günther, F. (2026). LinearPFN: Amortized Variable Selection for Linear Models with Interactions.
[arXiv]
[BibTeX]
@misc{2026_SchiekieraEtAl_LinearPFNVariableSelection_2610-06580, archiveprefix = {arXiv}, eprint = {2610.06580}, arxiv = {arXiv:2610.06580}, primaryclass = {cs.LG}, author = {Schiekiera, Louis and Zimmer, Max and Roux, Christophe and Arnold, Manuel and Pokutta, Sebastian and Günther, Fritz}, title = {LinearPFN: Amortized Variable Selection for Linear Models with Interactions}, date = {2026-10-05} } - Wagner, M., Roux, C., Zimmer, M., and Pokutta, S. (2026). The KV-Surgeon: Compensation-Aware Offline KV-Cache Compaction.
[arXiv]
[BibTeX]
@misc{2026_WagnerRouxZimmerPokutta_KVCacheCompaction_2610-25933, archiveprefix = {arXiv}, eprint = {2610.25933}, arxiv = {arXiv:2610.25933}, primaryclass = {cs.LG}, author = {Wagner, Moritz and Roux, Christophe and Zimmer, Max and Pokutta, Sebastian}, title = {The KV-Surgeon: Compensation-Aware Offline KV-Cache Compaction}, date = {2026-10-19} } - Zimmer, M., Pelleriti, N., Roux, C., and Pokutta, S. (2026). The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning.
[arXiv]
[BibTeX]
@misc{2026_ZimmerPelleritiRouxPokutta_Airesearchframework_2603-15914, archiveprefix = {arXiv}, eprint = {2603.15914}, arxiv = {arXiv:2603.15914}, primaryclass = {cs.LG}, author = {Zimmer, Max and Pelleriti, Nico and Roux, Christophe and Pokutta, Sebastian}, title = {The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning}, date = {2026-03-16} }
Conference contributions
- Wagner, M., Roux, C., Zimmer, M., and Pokutta, S. A Free Lunch in LLM Compression: Revisiting Retraining after Pruning. Advances in Neural Information Processing Systems, 39.
To appear.
Associated with NeurIPS 2026.
[arXiv]
[BibTeX]
@inproceedings{2025_WagnerRouxZimmerPokutta_Llmpruningretraining_2510-14444, booktitle = {Advances in Neural Information Processing Systems}, series = {Advances in Neural Information Processing Systems}, volume = {39}, publisher = {Curran Associates}, note = {To appear}, archiveprefix = {arXiv}, eprint = {2510.14444}, arxiv = {arXiv:2510.14444}, primaryclass = {cs.LG}, author = {Wagner, Moritz and Roux, Christophe and Zimmer, Max and Pokutta, Sebastian}, title = {A Free Lunch in LLM Compression: Revisiting Retraining after Pruning} } - Halbey, J., Roux, C., and Pokutta, S. Curvature-Dependent Lower Bounds for Frank-Wolfe. Advances in Neural Information Processing Systems, 39.
To appear.
Associated with NeurIPS 2026.
[arXiv]
[BibTeX]
@inproceedings{2026_HalbeyRouxPokutta_Curvaturelowerbounds_2605-10595, booktitle = {Advances in Neural Information Processing Systems}, series = {Advances in Neural Information Processing Systems}, volume = {39}, publisher = {Curran Associates}, note = {To appear}, archiveprefix = {arXiv}, eprint = {2605.10595}, arxiv = {arXiv:2605.10595}, primaryclass = {math.OC}, author = {Halbey, Jannis and Roux, Christophe and Pokutta, Sebastian}, title = {Curvature-Dependent Lower Bounds for Frank-Wolfe} } - Halbey, J., Deza, D., Zimmer, M., Roux, C., Stellato, B., and Pokutta, S. (2026). Lower Bounds for Frank-Wolfe on Strongly Convex Sets. Proceedings of the 43rd International Conference on Machine Learning, 306.
Associated with ICML 2026.
[arXiv]
[BibTeX]
@inproceedings{2026_HalbeyEtAl_Lowerboundsfrankwolfe_2602-04378, year = {2026}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, series = {Proceedings of Machine Learning Research}, volume = {306}, month = jul, archiveprefix = {arXiv}, eprint = {2602.04378}, arxiv = {arXiv:2602.04378}, primaryclass = {math.OC}, author = {Halbey, Jannis and Deza, Daniel and Zimmer, Max and Roux, Christophe and Stellato, Bartolomeo and Pokutta, Sebastian}, title = {Lower Bounds for Frank-Wolfe on Strongly Convex Sets} } - Schiekiera, L., Zimmer, M., Roux, C., Pokutta, S., and Günther, F. (2026). From Associations to Activations: Comparing Behavioral and Hidden-State Semantic Geometry in LLMs. Proceedings of the 43rd International Conference on Machine Learning, 306.
Associated with ICML 2026.
[arXiv]
[BibTeX]
@inproceedings{2026_LouisEtAl_Behavioralgeometry_2602-00628, year = {2026}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, series = {Proceedings of Machine Learning Research}, volume = {306}, month = jul, archiveprefix = {arXiv}, eprint = {2602.00628}, arxiv = {arXiv:2602.00628}, primaryclass = {cs.LG}, author = {Schiekiera, Louis and Zimmer, Max and Roux, Christophe and Pokutta, Sebastian and Günther, Fritz}, title = {From Associations to Activations: Comparing Behavioral and Hidden-State Semantic Geometry in LLMs} } - Roux, C., Martínez-Rubio, D., and Pokutta, S. (2025). Implicit Riemannian Optimism with Applications to Min-Max Problems. Proceedings of the 42nd International Conference on Machine Learning, 267, 52139–52172.
Associated with ICML 2025.
[arXiv]
[BibTeX]
@inproceedings{2025_RouxMartinezrubioPokutta_ImplicitRiemannian, year = {2025}, booktitle = {Proceedings of the 42nd International Conference on Machine Learning}, series = {Proceedings of Machine Learning Research}, volume = {267}, month = may, pages = {52139--52172}, archiveprefix = {arXiv}, eprint = {2501.18381}, arxiv = {arXiv:2501.18381}, primaryclass = {math.OC}, author = {Roux, Christophe and Martínez-Rubio, David and Pokutta, Sebastian}, title = {Implicit Riemannian Optimism with Applications to Min-Max Problems} } - Martínez-Rubio, D., Roux, C., Criscitiello, C., and Pokutta, S. (2025). Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties. Proceedings of The 28th International Conference on Artificial Intelligence and Statistics, 258, 280–288.
Associated with AISTATS 2025.
[arXiv]
[BibTeX]
@inproceedings{2023_MartinezrubioRouxCriscitielloPokutta_Riemannianminmax, year = {2025}, booktitle = {Proceedings of The 28th International Conference on Artificial Intelligence and Statistics}, series = {Proceedings of Machine Learning Research}, volume = {258}, month = jan, pages = {280--288}, archiveprefix = {arXiv}, eprint = {2305.16186}, arxiv = {arXiv:2305.16186}, primaryclass = {math.OC}, author = {Martínez-Rubio, David and Roux, Christophe and Criscitiello, Christopher and Pokutta, Sebastian}, title = {Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties} } - Roux, C., Zimmer, M., and Pokutta, S. (2025, January). On the Byzantine-Resilience of Distillation-Based Federated Learning. International Conference on Learning Representations 2025.
Associated with ICLR 2025.
[arXiv]
[BibTeX]
@inproceedings{2024_RouxZimmerPokutta_Byzantineresilience, year = {2025}, booktitle = {International Conference on Learning Representations 2025}, publisher = {ICLR (OpenReview)}, month = jan, archiveprefix = {arXiv}, eprint = {2402.12265}, arxiv = {arXiv:2402.12265}, primaryclass = {cs.LG}, author = {Roux, Christophe and Zimmer, Max and Pokutta, Sebastian}, title = {On the Byzantine-Resilience of Distillation-Based Federated Learning} } - Martínez-Rubio, D., Roux, C., and Pokutta, S. (2024). Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point. Proceedings of the 41st International Conference on Machine Learning, 235.
Associated with ICML 2024.
[URL]
[arXiv]
[BibTeX]
@inproceedings{2024_MartinezrubioRouxPokutta_Riemanniangradientdescent, year = {2024}, booktitle = {Proceedings of the 41st International Conference on Machine Learning}, series = {Proceedings of Machine Learning Research}, volume = {235}, url = {https://proceedings.mlr.press/v235/marti-nez-rubio24a.html}, archiveprefix = {arXiv}, eprint = {2403.10429}, arxiv = {arXiv:2403.10429}, primaryclass = {math.OC}, author = {Martínez-Rubio, David and Roux, Christophe and Pokutta, Sebastian}, title = {Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point} } - Martínez-Rubio, D., Roux, C., Criscitiello, C., and Pokutta, S. (2023). Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties. Accepted at Optimization for Machine Learning.
[arXiv]
[BibTeX]
@misc{2023_MartinezrubioRouxCriscitielloPokutta_Riemannianminmax:1, howpublished = {Accepted at Optimization for Machine Learning}, year = {2023}, month = may, archiveprefix = {arXiv}, eprint = {2305.16186}, arxiv = {arXiv:2305.16186}, primaryclass = {math.OC}, author = {Martínez-Rubio, David and Roux, Christophe and Criscitiello, Christopher and Pokutta, Sebastian}, title = {Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties} }
Articles, chapters and books
- Kerdreux, T., Roux, C., d’Aspremont, A., and Pokutta, S. (2021). Linear Bandits on Uniformly Convex Sets. Journal of Machine Learning Research, 22(284), 1–23.
[URL]
[arXiv]
[summary]
[BibTeX]
@article{2021_KerdreuxRouxDaspremontPokutta_Linearbandits, year = {2021}, journal = {Journal of Machine Learning Research}, month = mar, volume = {22}, number = {284}, pages = {1--23}, url = {https://jmlr.org/papers/v22/21-0277.html}, archiveprefix = {arXiv}, eprint = {2103.05907}, arxiv = {arXiv:2103.05907}, primaryclass = {cs.LG}, author = {Kerdreux, Thomas and Roux, Christophe and d'Aspremont, Alexandre and Pokutta, Sebastian}, title = {Linear Bandits on Uniformly Convex Sets}, summary = {https://www.pokutta.com/blog/research/2021/04/03/linearBandits.html} }
Projects
SynLab MODAL 05M20ZBM
Research Campus MODAL SynLab
This project develops the SCIP Optimization Suite and generalizes application-specific advances from MODAL's vertical labs into exact methods for constraint integer programming. The focus is on structure recognition, nonlinear constraints, and efficient implementation on modern architectures.
SynLab MODAL 05M20ZBM
Apr 2020 to Mar 2030
24
74
Talks and posters
Conference and workshop talks
- Sep 2026
- Recent Progress in Language Models for Mathematics by Christophe Roux
IOL @ Speinshart Scientific Center for AI and SuperTech, Speinshart - Jul 2025
- Online Implicit Riemannian Optimization by Christophe Roux
8th International Conference on Continuous Optimization (ICCOPT), Los Angeles - May 2025
- Implicit Riemannian Optimism with Applications to Min-Max Problems by Christophe Roux
Foundations and Frontiers: Interdisciplinary Perspectives on Mathematical Optimization, Nihonbashi - Mar 2023
- Riemannian Optimization: How and Why? by Christophe Roux
Workshop on Optimization and Machine Learning, Waischenfeld
Research seminar talks
- Mar 2026
- Lower Bounds for Frank-Wolfe on Strongly Convex Sets by Christophe Roux
SIERRA Seminar at INRIA Paris, Paris - Jun 2025
- Bounding Geometric Penalties in Riemannian Optimization by Christophe Roux
IOL Research Seminar (IOL), Berlin - Apr 2024
- Bounding Geometric Penalties in Riemannian Optimization by Christophe Roux
CISPA Research seminar, Saarbrücken - Nov 2023
- Bounding Geometric Penalties in First-Order Riemannian Optimization by Christophe Roux
Modern Methods in Applied Stochastics and Nonparametric Statistics, Berlin
Poster presentations
- Jul 2025
- Implicit Riemannian Optimism with Applications to Min-Max Problems by Christophe Roux
42nd International Conference on Machine Learning (ICML), Vancouver - May 2025
- Accelerated Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties by Christophe Roux
28th AISTATS Conference, Phuket - Apr 2025
- On the Byzantine-Resilience of Distillation-Based Federated Learning by Christophe Roux and Max Zimmer
13th International Conference on Learning Representations (ICLR), Singapore - Jul 2024
- Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point by Christophe Roux
41st International Conference on Machine Learning (ICML), Vienna - Mar 2023
- Accelerated Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties by Christophe Roux
Workshop on Optimization and Machine Learning, Waischenfeld
Events
- Sep 2026
- IOL @ Speinshart Scientific Center for AI and SuperTech, Speinshart
- Jul 2026
- 43rd International Conference on Machine Learning (ICML), Seoul
- Dec 2025
- NeurIPS 2025: EurIPS (NeurIPS), Copenhagen
- Jul 2025
- 8th International Conference on Continuous Optimization (ICCOPT), Los Angeles
- Jul 2025
- 42nd International Conference on Machine Learning (ICML), Vancouver
- May 2025
- 7th DOxML Conference, Kyoto
- May 2025
- 28th AISTATS Conference, Phuket
- Apr 2025
- 13th International Conference on Learning Representations (ICLR), Singapore
- Jul 2024
- 41st International Conference on Machine Learning (ICML), Vienna
- Dec 2023
- NeurIPS 2023: NeurIPS@Paris (NeurIPS), Paris
- Mar 2023
- Workshop on Optimization and Machine Learning, Waischenfeld
- summer 2022
- Discrete Optimization and Machine Learning, Berlin
- winter 2021
- Discrete Optimization and Machine Learning, Berlin
Teaching
- summer 2026
- Lecturer for High-Dimensional Optimization and Learning at TUB
- summer 2022
- Teaching Assistant for Discrete Optimization and Machine Learning at TUB
- winter 2021
- Teaching Assistant for Discrete Optimization and Machine Learning at TUB
