... and here is a brief explanation of each slide:
A remember of Franco Ugo Rollo, professor at the Camerino University. It was not my fortune to know personally Prof. Rollo, but his name is surely well known also in my discipline (archeology).
"Digital faces: new technologies for the forensic facial reconstruction of the historical figures".
The presentation intend to be an overview of the digital methodologies of FFR with FLOSS, developed in the last two years on the blog ATOR with a spontaneous contribution of different authors.
The traditional work-flow involves several operations: 3D scanning the skull, preparing a replica, performing the anthropological analyses, placing the tissue depth markers, reconstructing the profile, modeling the muscles and skin, calibrating the model with the available sources and dressing it.
The same operations are necessary for the digital work-flow. Our main work has been to turn the traditional process into a digital one, using only FLOSS.
There are different technology to obtain a 3D digital copy of the original skull. The main two we are using are: SfM - IBM and X-ray CT.
IN 2009 Arc-Team perform the first test in applying SfM - IBM with FLOSS to Cultural Heritage, during its participation at the TOPOI excelent cluster of Berlin.
The test developed in a collaboration with the French researcher +Pierre Moulon (Université Paris - Est and Mikros Image; actually at Acute3D) to integrate SfM - IBM software in ArcheOS 4 (codename Caersar)
The first test (TOPOI Löwe) gave positive results
The process is mainly based on different photos with different orientations, computing the displacement of common points between images
To complete the 3D documentation of an object, the next step is the so-called mesh-editing, which can be performed in the software MeshLab (developed by the Visual Computing Lab at the ISTI - CNR of Pisa, Italy)
In order to validate the digital method of FFR, some unconventional procedures (derived from the hacker culture) have been adopted. With reverse engineering techniques, based on SfM, it has been possible to digitally replicate the process of past FFR projects and to compare the results.
The anthropological validation has been performed comparing the result of 3D models obtained with SfM - IBM and the relative results coming form 3D scan (the observed distortion remained in the range of 1 mm).
In several projects it is possible to work with DICOM data. In these cases the anthropological analysis is more accurate. (3D VS Voxel)
The main software we used for DICOM data is InVesalius, mainly developed at the Renato Archer Information of Technology Center, an institute of the Brazilian Ministry of Science and Technology.
"X-ray computed tomography (X-ray CT) is a technology that uses computer-processed X-rays to produce tomographic images (virtual 'slices') of specific areas of the scanned object, allowing the user to see inside without cutting." (Wikipedia)
Also in this case, the process was validated with unconventional procedures derived from hacker culture. With reverse engineering of CT videos it has been possible to rebuild DICOM data and the 3D model of different skulls, replicating FFR projects and comparing the results.
It is necessary to check and validate the protocol with a continuous methodological comparisonwith all the available resources. For this reason, we tried also the FFR of Henry the IV, a project in which Prof. Rollo was involved, rejecting (with other scholars) the attribution of the mummified head to the French king. Our test in this case is just an experiment, starting from low quality data, but it is a good example to show some benefits of digital FFR, like the possibility to quickly modify the reconstructed face (e.g. closing the mouth in order to perform superimposition with the death mask), an operation not so simple with tangible models.
Once obtained the 3D model, digital anthropological analyses do not differ from traditional ones.
In some cases, a virtual restoration of the model is necessary. The solution comes from symmetrical and boolean operations of 3D modeling software (Blender).
The whole process of 3D modeling is actually performed in the software Blender.
The first operation is to fix the 3D skull on the Frankfurt plane, which replicates the head position of a standing human figure.
Than tissue depth markers are placed. The software keeps automatically the correct normal of each marker.
In our works, for depth tissue markers, we use the tables of Degreef et alii (2006)
A second step is the profile reconstruction.
For nose shape we refer to G. Lebedinskaya method.
The validation of the method came mainly from the comparison between FFR models and the facial DICOM data of living people, a simple simple with digital techniques, using the software CloudCompaer. All this experiment were conducted ans blind test (the artist did not know the identity and the fisionomy of the people).
According to the blind test, main deviations were detected on the cheeks.
Like other 3D operations, muscles modeling has been performed in Blender.
The technique hes been continuously rationalized and optimize. For instance, once the main muscles are modeled with metaballs in Blender, the result can be reused in successive reconstructions through an anatomical deformation.
It is possible to reach more realistic results through specific modeling tools,
like the "sculpt mode" in Blender.
Also skin modeling is an operation to be performed in Blender
Again the technique has been optimized: In order to simplify and speed up the process, a neutral facial model has been created.
The neutral model can be anatomically deformed on different skulls to meet gender and age dimorphism.
At the same time, the neutral model can be deformed to meet the anatomical criteria which determine the individual dimorphism.
After the reconstruction process, two main models are defined: one with hair and one hairless.
Thanks to the latest developments of the software MakeHuman it is now possible to further simplify and speed up the technique. Our actual research is following this direction.
The first tests carried out in 2014 have yielded positive results, thanks to the new feature which loads base raster images. The software is also perfectly compatible with Blender.
A further development of the protocol will allow to obtain high quality forensic facial reconstructions, in less time, without the need to master the techniques of 3D modeling.
At the end of the FFR process, the final model is calibrated with historical, archaeological and medical sources.
In case of historical reconstructions, the model appearance (hairstyle and clothing) is calibrated depending on era and culture, while the physical characteristics (color of hair and eyes) are set basing on the ancestry.
The 3D printing technologies allow the materialization of the model with different levels of detail.
A case study: the forensic facial reconstruction of St. Anthony of Padua
The 3D scan was carried out on the bronze cast performed by R. Cremesini in 1981.
The cast done by R. Cremesini is very important, because it derives from the temporary anatomical reconnection of the skull and the jaw, which were separated since the first survey of the tomb (1263).
3D scan has been performed with the SfM - IBM software of the archaeological GNU/Linux distribution ArcheOS.
The final model has been presented Tuesday, June 10 at the event "Scoprendo il volto di Antonio" at the Centro Culturale S. Gaetano in PAdua (Italy)
SLIDE 47 - 50
Digital FFR allows to further define the details of the model to reach a more realistic result.
Thanks to the collaboration with the Centro de Tecnologia da Informação Renato Archer - CTI (Ministério da Ciência and Technology do Brasil) the model was printed in 3D.
One of the materialized models was repainted by the Brazilian Mari Bueno,
specialized in religious art.
Thank you for your attention!