Current interests

My Master's thesis explores how language models can be used to solve multi-step reasoning problems via task decomposition as the complexity of the tasks increases. My interests at the moment include:

  • Knowledge representation in deep models (e.g., latent embedding spaces), particularly using formal languages.
  • Deep architectures and methods for solving complex reasoning problems (e.g., mathematics, programming tasks, planning, etc.).
  • Reinforcement and imitation learning, particularly meta-learning the RL/IL process outside of classical algorithmic approaches.

My long term ambition is to design models capable of not just imitating training data, but of discovering and displaying new knowledge. Today, even the largest models struggle to extrapolate complex reasoning patterns in data and exhibit valuable novel behavior.

Research output

Type
Title
Authors
Year
Publisher
Recognitions
Links
workshopRecursive Decomposition with Dependencies for Generic Divide and Conquer ReasoningSergio Hernández-Gutiérrez, Minttu Alakuijala, Alexander V. Nikitin, Pekka Marttinen2024NeurIPS Sys2 Reasoning
workshopFollowing Ancestral Footsteps: Co-Designing Morphology and Behaviour with Self-Imitation LearningSergio Hernández-Gutiérrez, Ville Kyrki, Kevin S. Luck2024EARL RSS (oral presentation) and EWRLBest Workshop Paper Award (EARL RSS)
thesisSolving Reasoning Problems with Large Language Models via Recursive DecompositionSergio Hernández-Gutiérrez, Pekka Marttinen, Alexander Nikitin, Minttu Alakuijala2024Aalto University
seminarA Comprehensive Overview of Goal-Conditioned Hierarchical Reinforcement Learning: Algorithms, Challenges, and Future DirectionsSergio Hernández-Gutiérrez, Vivienne Wang2023Aalto University
thesisModal Logic Theorem Provers and Validity RatesSergio Hernández-Gutiérrez, Robin Hirsch2019University College London