Publications

Peer-reviewed papers and preprints, newest first. Use the search box to filter by title, author, or venue.

2026

  1. PotARCin_Overview.png
    Claas Beger, Ryan Yi, and Melanie Mitchell
    In Advances in Neural Information Processing Systems (NeurIPS 2026), 2026
    TLDR: Extending ARC to five dimensions of rule understanding (definition, classification, constrained generation, editing, inversion) reveals a 25-52 point gap relative to standard ARC evaluation.
  2. Shortcut_Overview.png
    Claas Beger, Ryan Yi, Shuhao Fu, Arseny Moskvichev, Sarah W. Tsai, Sivasankaran Rajamanickam, and Melanie Mitchell
    In Advances in Neural Information Processing Systems (NeurIPS 2026), 2026
    TLDR: Vision-language models can perform well on abstract reasoning tasks without using the intended human-like core knowledge priors, so accuracy alone overstates their competence.
  3. Illusions of Abstraction in Contemporary AI
    Melanie Mitchell, Jacob G. Foster, Claas Beger, Ryan Yi, Shuhao Fu, Kaleda K. Denton, and Alessandro Palmarini
    Proceedings of the National Academy of Sciences (PNAS), 2026
    To appear
  4. Memento.jpg
    Chao Wan, Albert Gong, Mihir Mishra, Carl-Leander Henneking, Claas Beger, and Kilian Q. Weinberger
    Transactions on Machine Learning Research (TMLR), 2026
    Also known as Memento: Note-Taking for Your Future Self
    TLDR: Decomposing multi-hop questions into single-step Prolog definitions improves performance on various long-context question datasets.
  5. SpikeDecoder.png
    Claas Beger, Florian Walter, and Alois Knoll
    2026
    TLDR: A spiking neural network implementation of the Transformer decoder that reduces theoretical energy consumption by 87 to 93 percent compared to its ANN counterpart.
  6. Bongards.png
    Cassidy Langenfeld, Claas Beger, Gloria Geng, Wasu Top Piriyakulkij, Keya Hu, Yewen Pu, and Kevin Ellis
    In Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci 2026), 2026
    Full paper
    TLDR: Through a Bayesian approach combining natural language rules and program synthesis, models can approach human performance on visual pattern recognition puzzles (Bongard problems).
  7. CogSci_Logo.png
    Shuhao Fu, Claas Beger, Ryan Yi, Melanie Mitchell, Michael C. Frank, Raphaël Millière, Robert Hawkins, and Tomer D. Ullman
    In Proceedings of the Annual Meeting of the Cognitive Science Society (CogSci 2026), 2026
    Symposium
    TLDR: Symposium on evaluating language models with methods and principles from cognitive science.
  8. OmniCode.png
    Atharv Sonwane*, Eng-Shen Tu*, Wei-Chung Lu*, Claas Beger*, Carter Larsen, Debjit Dhar, Simon Alford, Rachel Chen, Ronit Pattanayak, Tuan Anh Dang, Guohao Chen, Gloria Geng, Kevin Ellis, and Saikat Dutta
    In Findings of the Association for Computational Linguistics: ACL 2026, 2026
    TLDR: A multilingual benchmark for LLM-based software engineering agents covering bug fixing, test generation, style fixing, and addressing code reviews.

2025

  1. Chart.png
    Award ribbon
    Claas Beger, Shuhao Fu, Ryan Yi, Arseny Moskvichev, and Melanie Mitchell
    In NeurIPS 2025 Workshop on Multimodal Algorithmic Reasoning (MAR), 2025
    Spotlight
    TLDR: The o3 model relies on diverse shortcuts and heuristics to solve ARC tasks. Tool use improves accuracy in the visual modality, while increased reasoning effort helps in the text modality.
  2. Figure_2_MIRAGE-1.png
    Alex Noviello*, Claas Beger*, Jacob Groner, Kevin Ellis, and Weinan Sun
    In NeurIPS 2025 Workshop on Interpreting Cognition in Deep Learning Models (CogInterp), 2025
    TLDR: An architecture that learns schemas and applies them iteratively can resolve arbitrarily deep compositional statements.
  3. Inverse.png
    Carl-Leander Henneking, and Claas Beger
    In NeurIPS 2025 Workshop on Regulatable Machine Learning (RegML), 2025
    TLDR: We refine Inverse Constitutional AI to extract interpretable principles from preference datasets for EU AI Act Article 10 compliance.
  4. Poster.png
    Award ribbon
    Claas Beger
    2025
    TLDR: Aligning models with human preferences does not guarantee that they pursue normative goals on our behalf; new alignment techniques may be required.
  5. citegeist-pipeline.jpg
    Award ribbon
    Claas Beger*, and Carl-Leander Henneking*
    2025
    TLDR: Through a multi-step retrieval and summarization pipeline with three configurable properties, Citegeist synthesizes related work for a given scientific paper.
  6. Error_Vis.jpg
    Claas Beger, and Saikat Dutta
    In 2025 IEEE/ACM International Workshop on Large Language Models for Code (LLM4Code), 2025
    TLDR: Language models struggle to dry-run simple and advanced code structures such as recursion, concurrency, and object-oriented programming.
  7. Content_Style_Sentiment_Clustering.jpg
    Carl-Leander Henneking*, and Claas Beger*
    2025
    TLDR: Using improved clustering and a more diverse embedding approach, our technique more accurately compresses preference datasets into human-readable constitutions.