profile photo

Paul‑Edouard Sarlin

EMAIL | RÉSUMÉ | LINKEDIN | GITHUB | TWITTER

PhD student in the Computer Vision and Geometry group at ETH Zurich.

I joined the group in February 2020, and am supervised by Prof. Marc Pollefeys. My research interests lie in the interplay between Computer Vision, 3D Geometry, and Deep Learning.

I was previously a research intern at Magic Leap in San Francisco. I obtained a Master’s degree in Robotics at ETH Zurich, during which I conducted research at ASL on visual localization and uncertainty estimation. Before this, I spent time at Traverse.ai, NUS, and EPFL.

News

04/2021: I joined the Microsoft Mixed Reality & AI lab in Zurich as a research intern.
08/2020: SuperGlue and my toolbox hloc won 4 ECCV 2020 competitions on visual localization. I gave two talks at two workshops (here and there), and released my slides below.
07/2020: I just released hloc, a new toolbox for visual localization and structure-from-motion with SuperGlue and other modern approaches.
06/2020: SuperGlue won 3 CVPR 2020 competitions: local features for visual localization, visual localization for handheld devices, and the image matching challenge. As a result, I gave 4 talks at various CVPR 2020 workshops, with recordings publicly available.
04/2020: My Master's thesis SuperGlue, conducted at Magic Leap, got accepted to CVPR 2020 for oral presentation! The code is now publicly available.
02/2020: I joined Prof. Marc Pollefeys’ group as a PhD student.
10/2019: Our Fishyscapes Benchmark paper was presented as an oral at the ICCV 2019 workshop on Autonomous Driving. The benchmark is up and running at fishyscapes.com.
06/2019: Our Hierarchical Localization paper won the Visual Localization Challenge at the CVPR 2019 workshop on Long-Term Visual Localization. The code is available on GitHub.
04/2019: I started my 6-month Master’s thesis with Tomasz Malisiewicz at Magic Leap in Sunnyvale, California.
04/2019: New preprint on uncertainty estimation: The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentation.
04/2019: My second paper From Coarse to Fine: Robust Hierarchical Localization at Large Scale got accepted to CVPR 2019.
09/2018: My first paper Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization got accepted to CoRL 2018.
06/2018: I started a 6-month internship at Magic Leap, Zurich.

My Research

SuperGlue

SuperGlue: Learning Feature Matching with Graph Neural Networks

Paul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich

CVPR 2020 - oral presentation and winner of 7 competitions on localization and matching

Paper | Webpage | Code | Bibtex 
@inproceedings{sarlin2020superglue,
  title     = {{SuperGlue}: Learning Feature Matching with Graph Neural Networks},
  author    = {Paul-Edouard Sarlin and
               Daniel DeTone and
               Tomasz Malisiewicz and
               Andrew Rabinovich},
  booktitle = {CVPR},
  year      = {2020},
}
Fishyscapes

The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentation

Hermann Blum*, Paul-Edouard Sarlin*, Juan Nieto, Roland Siegwart, Cesar Cadena

ICCV Workshops 2019

Paper | Webpage | Bibtex 
@inproceedings{blum2019fishyscapes,
  title     = {The {Fishyscapes} Benchmark: Measuring Blind Spots in Semantic Segmentation},
  author    = {Hermann Blum and
               Paul-Edouard Sarlin and
               Juan Nieto and
               Roland Siegwart and
               Cesar Cadena},
  booktitle = {ICCV Workshops},
  year      = {2019}
}
CVPR 2019 teaser

From Coarse to Fine: Robust Hierarchical Localization at Large Scale

Paul-Edouard Sarlin, Cesar Cadena, Roland Siegwart, Marcin Dymczyk

CVPR 2019 - winner of the visual localization challenge

Paper | Code | Bibtex 
@inproceedings{sarlin2019coarse,
  title     = {From Coarse to Fine: Robust Hierarchical Localization at Large Scale},
  author    = {Paul-Edouard Sarlin and
               Cesar Cadena and
               Roland Siegwart and
               Marcin Dymczyk},
  booktitle = {CVPR},
  year      = {2019}
}
CoRL 2018 teaser

Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization

Paul-Edouard Sarlin, Frédéric Debraine, Marcin Dymczyk, Roland Siegwart, Cesar Cadena

CoRL 2018

Paper | Video | Code | Bibtex 
@inproceedings{hloc2018,
  title     = {Leveraging Deep Visual Descriptors for Hierarchical Efficient Localization},
  author    = {Paul-Edouard Sarlin and
               Fr{\'{e}}d{\'{e}}ric Debraine and
               Marcin Dymczyk and
               Roland Siegwart and
               Cesar Cadena},
  booktitle = {Conference on Robot Learning (CoRL)},
  year      = {2018}
}

Talks

08/28/2020: Hierarchical Localization with hloc and SuperGlue. ECCV 2020 Workshop on Long-Term Visual Localization under Changing Conditions. Glasgow, UK. [Link | Slides]
08/23/2020: Hierarchical Localization with hloc and SuperGlue. ECCV 2020 Workshop on Map-based Localization for Autonomous Driving. Glasgow, UK. [Link | Slides]
06/19/2020: SuperGlue: Winner of the Image Matching Challenge. CVPR 2020 Workshop on Image Matching: Local Features & Beyond. Seattle WA, USA. [Link | Video]
06/15/2020: SuperGlue: Learning Feature Matching with Graph Neural Networks. CVPR 2020 Workshop on 3D Scene Understanding for Vision, Graphics, and Robotics. Seattle WA, USA. [Link | Video]
06/15/2020: SuperGlue for indoor and outdoor visual localization. CVPR 2020 Workshop on Long-Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM. Seattle WA, USA. [Link | Video]
06/15/2020: SuperGlue for day-night local feature matching. CVPR 2020 Workshop on Long-Term Visual Localization, Visual Odometry and Geometric and Learning-based SLAM. Seattle WA, USA. [Link | Video]
06/17/2019: From Coarse to Fine: Robust Hierarchical Localization at Large Scale. CVPR 2019 Workshop on Long-Term Visual Localization under Changing Conditions. Long beach CA, USA.