Direkt zum Inhalt springen
Computer Vision Group
TUM Department of Informatics
Technical University of Munich

Technical University of Munich

Menu

Links

Informatik IX
Chair of Computer Vision & Artificial Intelligence

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:
CVG Group DVL Group

News

02.10.2020

We have five papers accepted to 3DV 2020!

30.09.2020

Our effcient deep network architectures form the AI engine of the project Slow Down COVID-19 at Harvard.

24.07.2020

Our practical course "Vision-based Navigation" (WS18, SS19) by Dr. Vladyslav Usenko and Nikolaus Demmel was honored as best practical course in the academic year 2018/2019 by the department for Informatics.

07.05.2020

We are organizing a workshop on Map-based Localization for Autonomous Driving at ECCV 2020, Glasgow, UK.

13.04.2020

Daniel Cremers received an ERC Advanced Grant (3.5 Mio Euro) for pioneering frontier research from the European Research Council. This constitutes his fifth ERC grant.

More


GN-Net: The Gauss-Newton Loss for Multi-Weather Relocalization

ICRA Presentation Video

Abstract

Direct SLAM methods have shown exceptional performance on odometry tasks. However, they are susceptible to dynamic lighting and weather changes while also suffering from a bad initialization on large baselines. To overcome this, we propose GN-Net: a network optimized with the novel Gauss-Newton loss for training weather invariant deep features, tailored for direct image alignment. Our network can be trained with pixel correspondences between images even from different sequences. Experiments on both simulated and real-world datasets demonstrate that our approach is more robust against bad initialization, variations in day-time, and weather changes thereby outperforming state-of-the-art direct and indirect methods. Furthermore, we release an evaluation benchmark for relocalization tracking against different types of weather.

Downloads

The paper can be downloaded at: https://arxiv.org/abs/1904.11932
The video is available at: https://youtu.be/gcbKeKX2eiE
The supplementary can be downloaded at: gn-net-supplementary.pdf
The relocalization tracking benchmark dataset can be downloaded at: gnnet_benchmark_v1.3.zip
Code related to our benchmark can be found at: https://github.com/Artisense-ai/GN-Net-Benchmark


Export as PDF, XML, TEX or BIB

Journal Articles
2020
[]GN-Net: The Gauss-Newton Loss for Multi-Weather Relocalization (L. von Stumberg, P. Wenzel, Q. Khan and D. Cremers), In IEEE Robotics and Automation Letters (RA-L), volume 5, 2020. ([arxiv][video][project page][supplementary]) [bibtex]
Powered by bibtexbrowser
Export as PDF, XML, TEX or BIB

Rechte Seite

Informatik IX
Chair of Computer Vision & Artificial Intelligence

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:
CVG Group DVL Group

News

02.10.2020

We have five papers accepted to 3DV 2020!

30.09.2020

Our effcient deep network architectures form the AI engine of the project Slow Down COVID-19 at Harvard.

24.07.2020

Our practical course "Vision-based Navigation" (WS18, SS19) by Dr. Vladyslav Usenko and Nikolaus Demmel was honored as best practical course in the academic year 2018/2019 by the department for Informatics.

07.05.2020

We are organizing a workshop on Map-based Localization for Autonomous Driving at ECCV 2020, Glasgow, UK.

13.04.2020

Daniel Cremers received an ERC Advanced Grant (3.5 Mio Euro) for pioneering frontier research from the European Research Council. This constitutes his fifth ERC grant.

More