profile photo

Paul‑Edouard Sarlin

EMAIL | RÉSUMÉ | LINKEDIN | GITHUB | TWITTER | SCHOLAR

PhD student in the Computer Vision and Geometry group at ETH Zurich.

I joined the group in February 2020, and am supervised by Prof. Marc Pollefeys. My research interests lie in the interplay between Computer Vision, 3D Geometry, and Deep Learning.

I was previously a research intern at Magic Leap in San Francisco. I obtained a Master’s degree in Robotics at ETH Zurich, during which I conducted research at ASL on visual localization and uncertainty estimation. Before this, I spent time at Traverse.ai, NUS, and EPFL.

News

06/2021: Our paper Back to the Feature will appear at CVPR 2021. Check out our cool visualizations 💥
05/2021: I received the Graduate Award 2020 of the SEW-Eurodrive Foundation for my Master's thesis SuperGlue.
04/2021: I joined the Microsoft Mixed Reality & AI lab in Zurich as a research intern.
08/2020: SuperGlue and my toolbox hloc won 4 ECCV 2020 competitions on visual localization. I gave two talks at two workshops (here and there), and released my slides below.
07/2020: I just released hloc, a new toolbox for visual localization and structure-from-motion with SuperGlue and other modern approaches.
06/2020: SuperGlue won 3 CVPR 2020 competitions: local features for visual localization, visual localization for handheld devices, and the image matching challenge. As a result, I gave 4 talks at various CVPR 2020 workshops, with recordings publicly available.
04/2020: My Master's thesis SuperGlue, conducted at Magic Leap, got accepted to CVPR 2020 for oral presentation! The code is now publicly available.
02/2020: I joined Prof. Marc Pollefeys’ group as a PhD student.
10/2019: Our Fishyscapes Benchmark paper was presented as an oral at the ICCV 2019 workshop on Autonomous Driving. The benchmark is up and running at fishyscapes.com.
06/2019: Our Hierarchical Localization paper won the Visual Localization Challenge at the CVPR 2019 workshop on Long-Term Visual Localization. The code is available on GitHub.
04/2019: I started my 6-month Master’s thesis with Tomasz Malisiewicz at Magic Leap in Sunnyvale, California.
04/2019: New preprint on uncertainty estimation: The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentation.
04/2019: My second paper From Coarse to Fine: Robust Hierarchical Localization at Large Scale got accepted to CVPR 2019.
09/2018: My first paper Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization got accepted to CoRL 2018.
06/2018: I started a 6-month internship at Magic Leap, Zurich.

My Research

Back to the Feature

Back to the Feature: Learning Robust Camera Localization from Pixels to Pose

Paul-Edouard Sarlin*, Ajaykumar Unagar*, Måns Larsson, Hugo Germain, Carl Toft, Viktor Larsson, Marc Pollefeys, Vincent Lepetit, Lars Hammarstrand, Fredrik Kahl, Torsten Sattler

CVPR 2021

Paper | Webpage | Code | Bibtex 
@inproceedings{sarlin21pixloc,
  author    = {Paul-Edouard Sarlin and
               Ajaykumar Unagar and
               Måns Larsson and
               Hugo Germain and
               Carl Toft and
               Viktor Larsson and
               Marc Pollefeys and
               Vincent Lepetit and
               Lars Hammarstrand and
               Fredrik Kahl and
               Torsten Sattler},
  title     = {{Back to the Feature}: Learning Robust Camera Localization from Pixels to Pose},
  booktitle = {CVPR},
  year      = {2021},
}
SuperGlue

SuperGlue: Learning Feature Matching with Graph Neural Networks

Paul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich

CVPR 2020 - oral presentation and winner of 7 competitions on localization and matching

Paper | Webpage | Code | Bibtex 
@inproceedings{sarlin2020superglue,
  title     = {{SuperGlue}: Learning Feature Matching with Graph Neural Networks},
  author    = {Paul-Edouard Sarlin and
               Daniel DeTone and
               Tomasz Malisiewicz and
               Andrew Rabinovich},
  booktitle = {CVPR},
  year      = {2020},
}
Fishyscapes

The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentation

Hermann Blum*, Paul-Edouard Sarlin*, Juan Nieto, Roland Siegwart, Cesar Cadena

ICCV Workshops 2019

Paper | Webpage | Bibtex 
@inproceedings{blum2019fishyscapes,
  title     = {The {Fishyscapes} Benchmark: Measuring Blind Spots in Semantic Segmentation},
  author    = {Hermann Blum and
               Paul-Edouard Sarlin and
               Juan Nieto and
               Roland Siegwart and
               Cesar Cadena},
  booktitle = {ICCV Workshops},
  year      = {2019}
}
CVPR 2019 teaser

From Coarse to Fine: Robust Hierarchical Localization at Large Scale

Paul-Edouard Sarlin, Cesar Cadena, Roland Siegwart, Marcin Dymczyk

CVPR 2019 - winner of the visual localization challenge

Paper | Code | Bibtex 
@inproceedings{sarlin2019coarse,
  title     = {From Coarse to Fine: Robust Hierarchical Localization at Large Scale},
  author    = {Paul-Edouard Sarlin and
               Cesar Cadena and
               Roland Siegwart and
               Marcin Dymczyk},
  booktitle = {CVPR},
  year      = {2019}
}
CoRL 2018 teaser

Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization

Paul-Edouard Sarlin, Frédéric Debraine, Marcin Dymczyk, Roland Siegwart, Cesar Cadena

CoRL 2018

Paper | Video | Code | Bibtex 
@inproceedings{hloc2018,
  title     = {Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization},
  author    = {Paul-Edouard Sarlin and
               Fr{\'{e}}d{\'{e}}ric Debraine and
               Marcin Dymczyk and
               Roland Siegwart and
               Cesar Cadena},
  booktitle = {Conference on Robot Learning (CoRL)},
  year      = {2018}
}

Talks

08/28/2020: Hierarchical Localization with hloc and SuperGlue. ECCV 2020 Workshop on Long-Term Visual Localization under Changing Conditions. Glasgow, UK. [Link | Slides]
08/23/2020: Hierarchical Localization with hloc and SuperGlue. ECCV 2020 Workshop on Map-based Localization for Autonomous Driving. Glasgow, UK. [Link | Slides]
06/19/2020: SuperGlue: Winner of the Image Matching Challenge. CVPR 2020 Workshop on Image Matching: Local Features & Beyond. Seattle WA, USA. [Link | Video]
06/15/2020: SuperGlue: Learning Feature Matching with Graph Neural Networks. CVPR 2020 Workshop on 3D Scene Understanding for Vision, Graphics, and Robotics. Seattle WA, USA. [Link | Video]
06/15/2020: SuperGlue for indoor and outdoor visual localization. CVPR 2020 Workshop on Long-Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM. Seattle WA, USA. [Link | Video]
06/15/2020: SuperGlue for day-night local feature matching. CVPR 2020 Workshop on Long-Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM. Seattle WA, USA. [Link | Video]
06/17/2019: From Coarse to Fine: Robust Hierarchical Localization at Large Scale. CVPR 2019 Workshop on Long-Term Visual Localization under Changing Conditions. Long beach CA, USA.

Awards