ENIGMA aims at addressing:

• Identification, traceability, and provenance research of Cultural goods through the development of the novel concept of a Unique Authenticity Identifier (UAI) via non-destructive methods, digital tools and 3D Digital recording technologies.
• Protection, restitution and safeguarding of endangered cultural heritage through Satellite monitoring of heritage sites, by alerting authorities of large-scale site destruction during armed conflicts.
• Prevention measures through evidence-based research through contributing to sharing and interlinking existing database and inventories via enhancing common standards, interoperability, and openness; validation through a number of pilot studies.
• Raise awareness and build capacity through Outreach, Dissemination, and Communication activities.

MIRALab is leading the task 3.2, “3D CG reconstruction from incomplete information”

The objective of the task is to develop a 3D CG reconstruction method that will:

• Reconstructs objects and statues which are not accessible or are not able to be digitized by man-made threats
• Exploits registered but incomplete information such as text, maps, photos, partial images, or videos.
• Make use of an advanced deep learning algorithm that can identify and trace of un-registered CGs by associating them to known properties through smart clustering tools.
• Provide realistic reconstructed un-registered 3D CGs.

• Complex problem to solve due to no reference model
• Complexity of defining datasets for ML methods from various format of data (registered data)
• Clustering algorithms
• Reliability problem on the existing dataset.

Keeping Up with the Traffickers – Explainable Machine Learning for Cultural Heritage Preservation in Low-Resource Domains

OUR PROPOSED SOLUTION

HANDLING DIVERSITY IN CULTURAL HERITAGE

EXAMPLES OF DAMAGED OBJECTS AND THEIR DAMAGED MASKS

Use Case – Custom Officers at Airports

When: During baggage checks, the custom officers encounter fragmented or partially damaged CH objects.

Who: a) customs officers initially handle the fragments, and b) archaeologists or CH experts are consulted for evaluation.

How (steps):

1. Customs officers take a 2D picture of the fragmented or partially damaged CH object to be uploaded in the ENIGMA platform.

1. Our 3D reconstruction module uses the 2D image to assemble an estimation of the fragments, creating a CH object. In case the object is only partially damaged, the solution will identify the damage and repair the 2D image. After this, a 3D reconstructed model of the object is generated.

1. Experts receive:

1. The assembled 2D image;

1. The visual representation of the damage and the repaired area;

1. The reconstructed 3D model;