MatchMakerNet: Enabling Fragment Matching for Cultural Heritage Analysis

Ariana M. Villegas-Suarez, Cristian Lopez, Ivan Sipiran

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Automating the reassembly of fragmented objects is a complex task with applications in cultural heritage preservation, paleontology, and medicine. However, the matching subtask of the reassembly process has received limited attention, despite its crucial role in reducing the alignment search space. To address this gap, we propose Match-MakerNet, a network architecture designed to automate the pairing of object fragments for reassembly. By taking two point clouds as input and leveraging graph convolution alongside a simplified version of DGCNN, MatchMakerNet achieves remarkable results. After training on the Artifact (synthetic) dataset, we achieve an accuracy of 87.31% in all-to-all comparisons between the fragments. In addition, it demonstrates robust generalization capabilities, achieving 86.93% accuracy on the Everyday (synthetic) dataset and 83.03% on the Puzzles 3D (real-world) dataset. These findings highlight the effectiveness and versatility of Match-MakerNet in solving the matching subtask.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1624-1633
Number of pages10
ISBN (Electronic)9798350307443
DOIs
StatePublished - 2023
Event2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023 - Paris, France
Duration: 2 Oct 20236 Oct 2023

Publication series

NameProceedings - 2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023

Conference

Conference2023 IEEE/CVF International Conference on Computer Vision Workshops, ICCVW 2023
Country/TerritoryFrance
CityParis
Period2/10/236/10/23

Keywords

  • computer vision
  • objects 3d
  • reassembly

Fingerprint

Dive into the research topics of 'MatchMakerNet: Enabling Fragment Matching for Cultural Heritage Analysis'. Together they form a unique fingerprint.

Cite this