Saibo Geng

Saibo Geng

PhD student in EPFL

EPFL Data Science Lab

Biography

Hey there! I’m currently a Ph.D. student at EPFL’s Data Science Lab, where I’m advised by Prof. Robert West. My research interests include grammar-constrained decoding, efficient decoding methods, and domain-specific language generation with LLM.

During my time at EPFL, I had the chance to dive into the world of knowledge-graph enhanced LLM with Prof. Antoine Bosseult(NLP lab), text summarization with Diego Antognini(now at Google), language model for law with Rémi Lebret(AI lab), and LLM evaluation with Maxime Peyrard(now professor at CNRS France). Prior to joining EPFL, I received my B.S. in Physics from University Paris-Saclay, France.

Interests
  • Grammar-constrained Decoding
  • Efficient Decoding methods
  • Domain-Specific Language generation with LLM
Education
  • PhD in Computer Science, 2022-Now

    EPFL

Updates

Transformers-CFG is now available on GitHub
A grammar-constrained decoding library for LLM that supports CFG, EBNF, and unicode grammars
Low-memory Beam Search is merged into Huggingface Transformers
A low-memory beam search implementation that trades off speed for memory

Recent Posts