Christophe Roux

Christophe Roux

My research interests lie at the intersection of optimization and machine learning. In particular, I am interested in online optimization, federated learning and optimization on riemannian manifolds.

Contact

office
Room 3107 at ZIB
e-mail
homepage
christopheroux.de
languages
German, English, and French

Curriculum vitae

since 2022
Member of BMS
since 2021
Researcher at ZIB
2021
Research Assistant at ZIB
Jun 2021
M.Sc. in Scientific Computing at TUB
Feb 2018
B.Sc. in Engineering Science at TUB

Publications and preprints

Preprints and reports

  1. Roux, C., Wirth, E., Pokutta, S., and Kerdreux, T. (2021). Efficient Online-Bandit Strategies for Minimax Learning Problems. [arXiv]
    [BibTeX]
    @misc{2021_RouxWirthPokuttaKerdreux_Onlinebanditminimax,
      archiveprefix = {arXiv},
      eprint = {2105.13939},
      arxiv = {arXiv:2105.13939},
      primaryclass = {cs.LG},
      author = {Roux, Christophe and Wirth, Elias and Pokutta, Sebastian and Kerdreux, Thomas},
      title = {Efficient Online-Bandit Strategies for Minimax Learning Problems},
      date = {2021-05-28}
    }
  2. Roux, C., Zimmer, M., d’Aspremont, A., and Pokutta, S. (2025). Don’t Be Greedy, Just Relax! Pruning LLMs via Frank-Wolfe. [arXiv]
    [BibTeX]
    @misc{2025_RouxZimmerDaspremontPokutta_Pruningfrankwolfe_2510-13713,
      archiveprefix = {arXiv},
      eprint = {2510.13713},
      arxiv = {arXiv:2510.13713},
      primaryclass = {cs.LG},
      author = {Roux, Christophe and Zimmer, Max and d'Aspremont, Alexandre and Pokutta, Sebastian},
      title = {Don't Be Greedy, Just Relax! Pruning LLMs via Frank-Wolfe},
      date = {2025-10-15}
    }
  3. Zimmer, M., Roux, C., Wagner, M., Hendrych, D., and Pokutta, S. (2025). SparseSwaps: Tractable LLM Pruning Mask Refinement at Scale. [arXiv]
    [BibTeX]
    @misc{2025_ZimmerEtAl_Sparseswapspruning_2512-10922,
      archiveprefix = {arXiv},
      eprint = {2512.10922},
      arxiv = {arXiv:2512.10922},
      primaryclass = {cs.LG},
      author = {Zimmer, Max and Roux, Christophe and Wagner, Moritz and Hendrych, Deborah and Pokutta, Sebastian},
      title = {SparseSwaps: Tractable LLM Pruning Mask Refinement at Scale},
      date = {2025-12-11}
    }
  4. Elhishi, A., Roux, C., and d’Aspremont, A. (2026). Restart and Adaptive Acceleration in Stochastic Gradient Methods. [arXiv]
    [BibTeX]
    @misc{2026_ElhishiRouxD'aspremont_Restartacceleration_2606-21354,
      archiveprefix = {arXiv},
      eprint = {2606.21354},
      arxiv = {arXiv:2606.21354},
      primaryclass = {math.OC},
      author = {Elhishi, Ali and Roux, Christophe and d'Aspremont, Alexandre},
      title = {Restart and Adaptive Acceleration in Stochastic Gradient Methods},
      date = {2026-06-19}
    }
  5. Schiekiera, L., Zimmer, M., Roux, C., Arnold, M., Pokutta, S., and Günther, F. (2026). LinearPFN: Amortized Variable Selection for Linear Models with Interactions. [arXiv]
    [BibTeX]
    @misc{2026_SchiekieraEtAl_LinearPFNVariableSelection_2610-06580,
      archiveprefix = {arXiv},
      eprint = {2610.06580},
      arxiv = {arXiv:2610.06580},
      primaryclass = {cs.LG},
      author = {Schiekiera, Louis and Zimmer, Max and Roux, Christophe and Arnold, Manuel and Pokutta, Sebastian and Günther, Fritz},
      title = {LinearPFN: Amortized Variable Selection for Linear Models with Interactions},
      date = {2026-10-05}
    }
  6. Wagner, M., Roux, C., Zimmer, M., and Pokutta, S. (2026). The KV-Surgeon: Compensation-Aware Offline KV-Cache Compaction. [arXiv]
    [BibTeX]
    @misc{2026_WagnerRouxZimmerPokutta_KVCacheCompaction_2610-25933,
      archiveprefix = {arXiv},
      eprint = {2610.25933},
      arxiv = {arXiv:2610.25933},
      primaryclass = {cs.LG},
      author = {Wagner, Moritz and Roux, Christophe and Zimmer, Max and Pokutta, Sebastian},
      title = {The KV-Surgeon: Compensation-Aware Offline KV-Cache Compaction},
      date = {2026-10-19}
    }
  7. Zimmer, M., Pelleriti, N., Roux, C., and Pokutta, S. (2026). The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning. [arXiv]
    [BibTeX]
    @misc{2026_ZimmerPelleritiRouxPokutta_Airesearchframework_2603-15914,
      archiveprefix = {arXiv},
      eprint = {2603.15914},
      arxiv = {arXiv:2603.15914},
      primaryclass = {cs.LG},
      author = {Zimmer, Max and Pelleriti, Nico and Roux, Christophe and Pokutta, Sebastian},
      title = {The Agentic Researcher: A Practical Guide to AI-Assisted Research in Mathematics and Machine Learning},
      date = {2026-03-16}
    }

Conference contributions

  1. Wagner, M., Roux, C., Zimmer, M., and Pokutta, S. A Free Lunch in LLM Compression: Revisiting Retraining after Pruning. Advances in Neural Information Processing Systems, 39. To appear. Associated with NeurIPS 2026. [arXiv]
    [BibTeX]
    @inproceedings{2025_WagnerRouxZimmerPokutta_Llmpruningretraining_2510-14444,
      booktitle = {Advances in Neural Information Processing Systems},
      series = {Advances in Neural Information Processing Systems},
      volume = {39},
      publisher = {Curran Associates},
      note = {To appear},
      archiveprefix = {arXiv},
      eprint = {2510.14444},
      arxiv = {arXiv:2510.14444},
      primaryclass = {cs.LG},
      author = {Wagner, Moritz and Roux, Christophe and Zimmer, Max and Pokutta, Sebastian},
      title = {A Free Lunch in LLM Compression: Revisiting Retraining after Pruning}
    }
  2. Halbey, J., Roux, C., and Pokutta, S. Curvature-Dependent Lower Bounds for Frank-Wolfe. Advances in Neural Information Processing Systems, 39. To appear. Associated with NeurIPS 2026. [arXiv]
    [BibTeX]
    @inproceedings{2026_HalbeyRouxPokutta_Curvaturelowerbounds_2605-10595,
      booktitle = {Advances in Neural Information Processing Systems},
      series = {Advances in Neural Information Processing Systems},
      volume = {39},
      publisher = {Curran Associates},
      note = {To appear},
      archiveprefix = {arXiv},
      eprint = {2605.10595},
      arxiv = {arXiv:2605.10595},
      primaryclass = {math.OC},
      author = {Halbey, Jannis and Roux, Christophe and Pokutta, Sebastian},
      title = {Curvature-Dependent Lower Bounds for Frank-Wolfe}
    }
  3. Halbey, J., Deza, D., Zimmer, M., Roux, C., Stellato, B., and Pokutta, S. (2026). Lower Bounds for Frank-Wolfe on Strongly Convex Sets. Proceedings of the 43rd International Conference on Machine Learning, 306. Associated with ICML 2026. [arXiv]
    [BibTeX]
    @inproceedings{2026_HalbeyEtAl_Lowerboundsfrankwolfe_2602-04378,
      year = {2026},
      booktitle = {Proceedings of the 43rd International Conference on Machine Learning},
      series = {Proceedings of Machine Learning Research},
      volume = {306},
      month = jul,
      archiveprefix = {arXiv},
      eprint = {2602.04378},
      arxiv = {arXiv:2602.04378},
      primaryclass = {math.OC},
      author = {Halbey, Jannis and Deza, Daniel and Zimmer, Max and Roux, Christophe and Stellato, Bartolomeo and Pokutta, Sebastian},
      title = {Lower Bounds for Frank-Wolfe on Strongly Convex Sets}
    }
  4. Schiekiera, L., Zimmer, M., Roux, C., Pokutta, S., and Günther, F. (2026). From Associations to Activations: Comparing Behavioral and Hidden-State Semantic Geometry in LLMs. Proceedings of the 43rd International Conference on Machine Learning, 306. Associated with ICML 2026. [arXiv]
    [BibTeX]
    @inproceedings{2026_LouisEtAl_Behavioralgeometry_2602-00628,
      year = {2026},
      booktitle = {Proceedings of the 43rd International Conference on Machine Learning},
      series = {Proceedings of Machine Learning Research},
      volume = {306},
      month = jul,
      archiveprefix = {arXiv},
      eprint = {2602.00628},
      arxiv = {arXiv:2602.00628},
      primaryclass = {cs.LG},
      author = {Schiekiera, Louis and Zimmer, Max and Roux, Christophe and Pokutta, Sebastian and Günther, Fritz},
      title = {From Associations to Activations: Comparing Behavioral and Hidden-State Semantic Geometry in LLMs}
    }
  5. Roux, C., Martínez-Rubio, D., and Pokutta, S. (2025). Implicit Riemannian Optimism with Applications to Min-Max Problems. Proceedings of the 42nd International Conference on Machine Learning, 267, 52139–52172. Associated with ICML 2025. [arXiv]
    [BibTeX]
    @inproceedings{2025_RouxMartinezrubioPokutta_ImplicitRiemannian,
      year = {2025},
      booktitle = {Proceedings of the 42nd International Conference on Machine Learning},
      series = {Proceedings of Machine Learning Research},
      volume = {267},
      month = may,
      pages = {52139--52172},
      archiveprefix = {arXiv},
      eprint = {2501.18381},
      arxiv = {arXiv:2501.18381},
      primaryclass = {math.OC},
      author = {Roux, Christophe and Martínez-Rubio, David and Pokutta, Sebastian},
      title = {Implicit Riemannian Optimism with Applications to Min-Max Problems}
    }
  6. Martínez-Rubio, D., Roux, C., Criscitiello, C., and Pokutta, S. (2025). Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties. Proceedings of The 28th International Conference on Artificial Intelligence and Statistics, 258, 280–288. Associated with AISTATS 2025. [arXiv]
    [BibTeX]
    @inproceedings{2023_MartinezrubioRouxCriscitielloPokutta_Riemannianminmax,
      year = {2025},
      booktitle = {Proceedings of The 28th International Conference on Artificial Intelligence and Statistics},
      series = {Proceedings of Machine Learning Research},
      volume = {258},
      month = jan,
      pages = {280--288},
      archiveprefix = {arXiv},
      eprint = {2305.16186},
      arxiv = {arXiv:2305.16186},
      primaryclass = {math.OC},
      author = {Martínez-Rubio, David and Roux, Christophe and Criscitiello, Christopher and Pokutta, Sebastian},
      title = {Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties}
    }
  7. Roux, C., Zimmer, M., and Pokutta, S. (2025, January). On the Byzantine-Resilience of Distillation-Based Federated Learning. International Conference on Learning Representations 2025. Associated with ICLR 2025. [arXiv]
    [BibTeX]
    @inproceedings{2024_RouxZimmerPokutta_Byzantineresilience,
      year = {2025},
      booktitle = {International Conference on Learning Representations 2025},
      publisher = {ICLR (OpenReview)},
      month = jan,
      archiveprefix = {arXiv},
      eprint = {2402.12265},
      arxiv = {arXiv:2402.12265},
      primaryclass = {cs.LG},
      author = {Roux, Christophe and Zimmer, Max and Pokutta, Sebastian},
      title = {On the Byzantine-Resilience of Distillation-Based Federated Learning}
    }
  8. Martínez-Rubio, D., Roux, C., and Pokutta, S. (2024). Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point. Proceedings of the 41st International Conference on Machine Learning, 235. Associated with ICML 2024. [URL] [arXiv]
    [BibTeX]
    @inproceedings{2024_MartinezrubioRouxPokutta_Riemanniangradientdescent,
      year = {2024},
      booktitle = {Proceedings of the 41st International Conference on Machine Learning},
      series = {Proceedings of Machine Learning Research},
      volume = {235},
      url = {https://proceedings.mlr.press/v235/marti-nez-rubio24a.html},
      archiveprefix = {arXiv},
      eprint = {2403.10429},
      arxiv = {arXiv:2403.10429},
      primaryclass = {math.OC},
      author = {Martínez-Rubio, David and Roux, Christophe and Pokutta, Sebastian},
      title = {Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point}
    }
  9. Martínez-Rubio, D., Roux, C., Criscitiello, C., and Pokutta, S. (2023). Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties. Accepted at Optimization for Machine Learning. [arXiv]
    [BibTeX]
    @misc{2023_MartinezrubioRouxCriscitielloPokutta_Riemannianminmax:1,
      howpublished = {Accepted at Optimization for Machine Learning},
      year = {2023},
      month = may,
      archiveprefix = {arXiv},
      eprint = {2305.16186},
      arxiv = {arXiv:2305.16186},
      primaryclass = {math.OC},
      author = {Martínez-Rubio, David and Roux, Christophe and Criscitiello, Christopher and Pokutta, Sebastian},
      title = {Accelerated Methods for Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties}
    }

Articles, chapters and books

  1. Kerdreux, T., Roux, C., d’Aspremont, A., and Pokutta, S. (2021). Linear Bandits on Uniformly Convex Sets. Journal of Machine Learning Research, 22(284), 1–23. [URL] [arXiv] [summary]
    [BibTeX]
    @article{2021_KerdreuxRouxDaspremontPokutta_Linearbandits,
      year = {2021},
      journal = {Journal of Machine Learning Research},
      month = mar,
      volume = {22},
      number = {284},
      pages = {1--23},
      url = {https://jmlr.org/papers/v22/21-0277.html},
      archiveprefix = {arXiv},
      eprint = {2103.05907},
      arxiv = {arXiv:2103.05907},
      primaryclass = {cs.LG},
      author = {Kerdreux, Thomas and Roux, Christophe and d'Aspremont, Alexandre and Pokutta, Sebastian},
      title = {Linear Bandits on Uniformly Convex Sets},
      summary = {https://www.pokutta.com/blog/research/2021/04/03/linearBandits.html}
    }

Projects

SynLab MODAL 05M20ZBM
Research Campus MODAL SynLab

This project develops the SCIP Optimization Suite and generalizes application-specific advances from MODAL's vertical labs into exact methods for constraint integer programming. The focus is on structure recognition, nonlinear constraints, and efficient implementation on modern architectures.

SynLab MODAL 05M20ZBM
Apr 2020 to Mar 2030
24
74

Talks and posters

Conference and workshop talks

Sep 2026
Recent Progress in Language Models for Mathematics by Christophe Roux
IOL @ Speinshart Scientific Center for AI and SuperTech, Speinshart
Jul 2025
Online Implicit Riemannian Optimization by Christophe Roux
8th International Conference on Continuous Optimization (ICCOPT), Los Angeles
May 2025
Implicit Riemannian Optimism with Applications to Min-Max Problems by Christophe Roux
Foundations and Frontiers: Interdisciplinary Perspectives on Mathematical Optimization, Nihonbashi
Mar 2023
Riemannian Optimization: How and Why? by Christophe Roux
Workshop on Optimization and Machine Learning, Waischenfeld

Research seminar talks

Mar 2026
Lower Bounds for Frank-Wolfe on Strongly Convex Sets by Christophe Roux
SIERRA Seminar at INRIA Paris, Paris
Jun 2025
Bounding Geometric Penalties in Riemannian Optimization by Christophe Roux
IOL Research Seminar (IOL), Berlin
Apr 2024
Bounding Geometric Penalties in Riemannian Optimization by Christophe Roux
CISPA Research seminar, Saarbrücken
Nov 2023
Bounding Geometric Penalties in First-Order Riemannian Optimization by Christophe Roux
Modern Methods in Applied Stochastics and Nonparametric Statistics, Berlin

Poster presentations

Jul 2025
Implicit Riemannian Optimism with Applications to Min-Max Problems by Christophe Roux
42nd International Conference on Machine Learning (ICML), Vancouver
May 2025
Accelerated Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties by Christophe Roux
28th AISTATS Conference, Phuket
Apr 2025
On the Byzantine-Resilience of Distillation-Based Federated Learning by Christophe Roux and Max Zimmer
13th International Conference on Learning Representations (ICLR), Singapore
Jul 2024
Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point by Christophe Roux
41st International Conference on Machine Learning (ICML), Vienna
Mar 2023
Accelerated Riemannian Min-Max Optimization Ensuring Bounded Geometric Penalties by Christophe Roux
Workshop on Optimization and Machine Learning, Waischenfeld

Events

Teaching

summer 2026
Lecturer for High-Dimensional Optimization and Learning at TUB
summer 2022
Teaching Assistant for Discrete Optimization and Machine Learning at TUB
winter 2021
Teaching Assistant for Discrete Optimization and Machine Learning at TUB