Mathieu Aubry

Mathieu Aubry
He/Him - They/Them

I am a senior researcher at École des Ponts ParisTech (ENPC) in the Imagine group of the A3SI team, LIGM lab (UMR 8049).

I am interested in computer vision with a focus on unsupervised image collection analysis ( ERC DISCOVER ), and applications to historical data (also ANR VHS and ANR EIDA ) and Earth imagery analysis. To get an overview of my research, you can look at the ANR EnHerit (2017-2023) and ERC DISCOVER websites.

If you are interested in working with me for M2/PhD ( 2023 internship offers ), research engineer or postoc positions, please apply through this form (I will not answer e-mail applications).

Imagine / Email / CV / Bio / Google Scholar

Group	Publications	Teaching	Opinions

Group

Current PhD students:

Syrine Kalleli
Sonat Baltaci
Malamatenia Vlachou Efstathiou; (in History with Dominique Stuzmann at IRHT)
Ioannis Siglidis
Elliot Vincent (with Jean Ponce at INRIA/ENS)
Robin Champenois (at ENS in Art with Béatrice Joyeux-Prunel)

Current Post-doc: Raphaël Baena

Current RSE: Ségolène Albouy

Graduated PhD students:

Francisco Massa (with Renaud Marlet, now at Meta)
Vianney Loing (in Mechnaical Engineering, with Jean-François Caron, Olivier Baverel and Renaud Marlet, now at Arcure)
Théophile Dalens (at INRIA/ENS with Josef Sivic, now at Grabango)
Thibault Groueix (now at Adobe research)
Othman Sbaï (in CIFRE at FAIR with Camille Couprie, now at Meta)
Xi Shen (now at Tecent research)
Francois Darmon (with Pascal Monasse, transitioning to Meta)
Théo Deprelle (now at Veesual)
Simon Roburin (in CIFRE at Valeo AI with Patrick Perez and Renaud Marlet, now post-doc at EPFL)
Yann Labbé (at INRIA/ENS with Josef Sivic and Justin Caprentier, now at Meta)
Romain Loiseau (with Loïc Landrieu, now at the finance ministry)
Tom Monnier (now at Meta)

Past Post-doc: Nicolas Gonthier (now IPEF working at IGN)

Publications

Representative papers are highlighted. See Google Scholar for an up-to-date list.

	Diffusion Models as Data Mining Tools I. Siglidis, A. Holynski, A. Efros, M. Aubry, S. Ginosar ECCV 2024 paper \| project page
	Detecting Looted Archaeological Sites from Satellite Image Time Series E. Vincent, M. Saroufim, J. Chemla, Y. Ubelmann, P. Marquis, J. Ponce, M. Aubry ArXiv 2024 paper \| project page
	Satellite Image Time Series Semantic Change Detection: Novel Architecture and Analysis of Domain Shift E. Vincent, J. Ponce, M. Aubry ArXiv 2024 paper \| project page
	An Interpretable Deep Learning Approach for Morphological Script Type Analysis M. Vlachou Efstathiou, I. Siglidis, D. Stutzmann, M. Aubry IWCP 2024 (@ICDAR 2024) paper \| project page
	Historical Printed Ornaments: Dataset and Tasks S. K. Chaki , S. Baltaci , E. Vincent, R. Emonet, F. Vial-Bonacci, C. Bahier-Porte, M. Aubry, T. Fournel ICDAR 2024 paper \| project page
	Historical Astronomical Diagrams Decomposition in Geometric Primitives S. Kalleli, S. Trigg, S. Albouy, M. Husson, M Aubry ICDAR 2024 paper \| project page
	The Learnable Typewriter A Generative Approach to Text Line Analysis Y. Siglidis, N. Gonthier, J. Gaubil, T. Monnier, M. Aubry ICDAR 2024, IAPR best paper award paper \| project page
	Learnable Earth Parser: Discovering 3D Prototypes in Aerial Scans R. Loiseau, E. Vincent, M. Aubry, L. Landrieu CVPR 2024 paper \| project page
	Abstracts for our VHS and EIDA projects building vision tools for historians Z. S. Baltci, S. Kalleli, F. Aouinti, A. Guilbaud, S. Lazaris, S. Trigg, S. Albouy, S. Gessner, M. Husson, M. Aubry, presented at IAMAHA 2023 VHS \| EIDA
	Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitives T. Monnier, J. Austin, A. Kanazawa, A. Efros, M. Aubry NeurIPS 2023 paper \| project page
	Pixel-wise Agricultural Image Time Series Classification: Comparisons and a Deformable Prototype-based Approach E. Vincent, J. Ponce, M. Aubry ArXiv 2023 paper \| project page
	MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare Y. Labbé, L. Manuelli, A. Mousavian, S. Tyree, S. Birchfield, J. Tremblay, J. Carpentier, M. Aubry, D. Fox, J. Sivic CoRL 2022 paper \| project page
	A Model You Can Hear: Audio Classification with Playable Prototypes R. Loiseau, B. Bouvier, Y. Teytaut, E. Vincent, M. Aubry, L. Landrieu ISMIR 2022, CVPRw 2022 paper \| project page
	Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency T. Monnier, M. Fisher, A. Efros, M. Aubry ECCV 2022 paper \| project page
	Online Segmentation of LiDAR Sequences: Dataset and Algorithm R. Loiseau, M. Aubry, L. Landrieu ECCV 2022 paper \| project page
	Learning joint surface atlases T. Deprelle, T. Groueix, N. Aigerman, V. Kim, M. Aubry ArXiv 2022 paper \| project page
	NeuralWarp: Improving neural implicit surfaces geometry with patch warping F. Darmon, B. Bascle, J.-C. Devaux, P. Monasse, M. Aubry CVPR 2022 paper \| project page
	Focal Length and Object Pose Estimation via Render and Compare G. Ponimatkin, Labbé, B. Russell, M. Aubry, J. Sivic CVPR 2022 paper \| project page
	Spatially-consistent Feature Matching and Learning for Heritage Image Analysis X. Shen, R. Champenois, S. Ginosar, I. Pastrolin, M. Rousselot, O. Bounou, T. Monnier, S. Gidaris, F. Bougard, P.-G. Raverdy, M.-F. Limon, C. Bénévent, M. Smith, O. Poncet, K. Bender, B. Joyeux-Prunel, E. Honig, A. Efros, M. Aubry IJCV 2022 paper \| project page
	Re-ranking for image retrieval and transductive few-shot classification X. Shen, Y. Xiao, S. Hu, O. Sbai, M. Aubry NeurIPS 2021 paper \| project page
	Learning Co-segmentation by Segment Swapping for Retrieval and Discovery X. Shen, A. Efros, A. Joulin, M. Aubry ArXiv 2021, CVPR 2022 workshops paper \| project page
	Representing Shape Collections with Alignment-Aware Linear Models R. Loiseau, T. Monnier, M. Aubry, L. Landrieu 3DV 2021 paper \| project page
	Unsupervised Layered Image Decomposition into Object Prototypes T. Monnier, E. Vincent, J. Ponce, M. Aubry ICCV 2021 paper \| project page
	Image Collation: Matching illustrations in manuscripts R. Kaoua, X. Shen, A. Durr, S. Lazaris, D. Picard, M. Aubry ICDAR 2021 paper \| project page
	Deep Multi-View Stereo gone wild F. Darmon, B. Bascle, J.-C. Devaux, P. Monasse, M. Aubry 3DV 2021 paper \| project page
	Single-view robot pose and joint angle estimation via render & compare Y. Labbé, J. Carpentier, M. Aubry, J. Sivic CVPR 2021 paper \| project page
	Learning to Guide Local Feature Matches F. Darmon, M. Aubry , P. Monasse 3DV 2020 paper \| project page
	Spherical Perspective on Learning with Batch Norm S. Roburin, Y.de Mont-Marin, A. Bursuc, R.Marlet, P. Perez, M. Aubry ArXiv 2020, Neurocomputing 2022 paper \| project page
	Deep Transformation-Invariant Clustering T. Monnier, T. Groueix, M. Aubry NeurIPS 2020 paper \| project page
	docExtractor: An off-the-shelf historical document element extraction T. Monnier, M. Aubry ICFHR 2020 paper \| project page
	CosyPose: Consistent multi-view multi-object 6D pose estimation Y. Labbé, J. Carpentier, M. Aubry, J. Sivic ECCV 2020 paper \| project page
	Impact of base dataset design on few-shot image classification O. Sbai, C. Couprie, M. Aubry ECCV 2020 paper \| project page
	RANSAC-Flow: generic two-stage image alignment X. Shen, F. Darmon, A. Efros, M. Aubry ECCV 2020 paper \| project page
	Monte-Carlo Tree Search for Efficient Visually Guided Rearrangement Planning Y. Labbé, S. Zagoruyko, I. Kalevatykh, I. Laptev, J. Carpentier, M. Aubry, J. Sivic RAL 2020 paper \| project page
	Large-Scale Historical Watermark Recognition:dataset and a new consistency-based approach X. Shen, I. Pastrolin, O. Bounou, S. Gidaris, M. Smith, O. Poncet, M. Aubry ICPR 2020 paper \| project page \| Web App \| paper on Web App
	Bilinear image translation for temporal analysis of photo collections T. Dalens, M. Aubry, J. Sivic TPAMI 2019 paper
	Learning elementary structures for 3D shape generation and matching T. Deprelle, T. Groueix, M. Fisher, V. G. Kim, B. C. Russell, M. Aubry NeurIPS 2019 paper \| project page
	Unsupervised Image Decomposition in Vector Layers O. Sbai, C. Couprie, M. Aubry ArXiv 2019 / ICIP 2020 paper \| project page
	Deep Pose Estimation for Arbitrary 3D Objects Y. Xiao, X. Qiu, P-A Langlois M. Aubry, R. Marlet BMVC 2019 paper \| project page
	Unsupervised cycle-consistent deformation for shape matching T. Groueix, M. Fisher, V. G. Kim, B. C. Russell, M. Aubry SGP 2019 paper \| project page
	Discovering Visual Patterns in Art Collections with Spatially-consistent Feature Learning X. Shen, A. Efros, M. Aubry CVPR 2019 paper \| project page
	3D-CODED : 3D Correspondences by Deep Deformation T. Groueix, M. Fisher, V. G. Kim, B. C. Russell, M. Aubry ECCV 2018 paper \| project page
	Virtual Training for a Real Application: Accurate Object-Robot Relative Localization without Calibration V. Loing, R. Marlet, M. Aubry IJCV 2018 paper \| project page
	AtlasNet: A Papier-Mâché Approach to Learning Surface Generation T. Groueix, M. Fisher, V. G. Kim, B. C. Russell, M. Aubry CVPR 2018 paper \| project page
	3D Sketching using Multi-View Deep Volumetric Prediction J. Delanoy, M. Aubry, P. Isola, A. Efros, A. Bousseau I3D 2018 paper \| project page
	Crafting a multi-task CNN for viewpoint estimation F. Massa, R. Marlet and M. Aubry BMVC 2016 paper \| project page
	Automatic 3D Car Model Alignment for Mixed Image-Based Rendering R. Ortiz-Cayon, A. Djelouah, F. Massa, M. Aubry, G. Drettakis 3DV 2016 paper \| project page
	Deep Exemplar 2D-3D Detection by Adapting from Real to Rendered Views F. Massa, B. Russell and M. Aubry CVPR 2016 paper \| project page
	Learning Dense Correspondence via 3D-guided Cycle Consistency T. Zhou, P. Krähenbühland, M. Aubry, Q. Huang, and A. Efros CVPR, 2016 paper \| project page
	Dex-Net 1.0: A Cloud-Based Network of 3D Objects for Robust Grasp Planning Using a Multi-Armed Bandit Model with Correlated Rewards J. Mahler, F. Pokorny, B. Hou, M. Roderick, M. Laskey, M. Aubry, K. Kohlhoff, T. Kroeger, J. Kuffner, K. Goldberg ICRA, 2016 paper
	Understanding deep features with computer-generated imagery M. Aubry and B. Russell ICCV, 2015 paper \| project page
	Visual geo-localization of non-photographic depictions via 2D-3D alignment M. Aubry, B. Russell and J. Sivic Springer book chapter on Visual Analysis and Geo-Localization of Large Scale Imagery, 2015 paper
	Anisotropic Laplace-Beltrami Operators for Shape Analysis M. Andreux, E. Rodolà, M. Aubry, and D. Cremers Workshop on Non-Rigid Shape Analysis and Deformable Image Alignment (NORDIA), 2014 paper \| project page
	Seeing 3D chairs: exemplar part-based 2D-3D alignment using a large dataset of CAD models M. Aubry, D. Maturana, A. Efros, B. Russell and J. Sivic CVPR, 2014 paper \| project page
	Painting-to-3D Model Alignment Via Discriminative Visual Elements M. Aubry, B. Russell and J. Sivic ACM Transactions on Graphics, 2014 (presented at SIGGRAPH 2014) paper \| project page
	Fast Local Laplacian Filters: Theory and Applications M. Aubry, S. Paris, S. Hasinoff, J. Kautz, F. Durand ACM Transactions on Graphics, 2014 (presented at SIGGRAPH 2014) paper \| project page
	A Super-resolution Framework for High-Accuracy Multiview Reconstruction B. Goldluecke, M. Aubry, K. Kolev, D. Cremers IJCV 2014 paper
	Decoupling Photometry and Geometry in Dense Variational Camera Calibration M. Aubry, K. Kolev, B. Goldluecke, D. Cremers ICCV 2011 paper
	Pose-Consistent 3D Shape Segmentation Based on a Quantum Mechanical Feature Descriptor M. Aubry, U. Schlickewei, D. Cremers Pattern Recognition (Proc. DAGM), Springer, 2011 paper \| project page
	The Wave Kernel Signature: A Quantum Mechanical Approach To Shape Analysis M. Aubry, U. Schlickewei, D. Cremers ICCV workshop on Dynamic Shape Capture and Analysis (4DMOD) 2011 paper \| project page

Teaching

ENPC Deep Learning (M1/M2, since 2021)
MVA 3D reconstruction, Object Recognition and Deep Learning (M2, one lecture in each)
ENS Introduction to Computer Vision (M1/M2, 2017-2022)
ENPC Computer Vision for Mechanics of materials (L3, 2015-2021)

Opinions

The following links are a random collection of personal opinions, but you might want to have a look if you are interested in working with me, or are just curious. Note I am not an expert on any of these topics, feel free to send feedback or suggestions.

PhD life in my group
Sustainability, ecological crisis (and research)
Why should you go to academia?
Domination, diversity, inclusion (and research)
More to come, including the way I see/try to do research. Feel free to suggest more.

Projects

2015-2019: RAPID Tabasco project on low-supervision deep learning
2017-2018: France-Berkeley-Fund grant on Enhancing Heritage Image Databases
2018-2021: CIFRE PhD with Camille Couprie at Facebook AI Research
2018-2022: ANR JCJC EnHerit project on enhancing heritage image databases
2019-2022: CIFRE PhD with Patrick Perez and Renaud Marlet at Valeo AI
2021-2025: ANR VHS project on historical scientific illustrations
2022-2026: ANR EIDA project on historical astronomical diagrams
2023-2028: ERC starting grant DISCOVER on visual structures discovery

Contact

IMAGINE/LIGM
École des Ponts ParisTech
6-8, Av Blaise Pascal - Cité Descartes
Champs-sur-Marne
77455 Marne-la-Vallée cedex 2

email: mathieu [dot] aubry [at] imagine [dot] enpc [dot] fr
phone: +33 (0)1 64 15 21 74

Top / Imagine / Email / CV / Bio / Google Scholar

Website stolen from Jon Barron.