DS0703 - Le numérique au service des arts, du patrimoine, des industries culturelles et éditoriales

Micro-geometry Approach of Texture Reproduction for Artistic Legacy – MATERIAL

Micro-geometry Approach of Texture Reproduction for Artistic Legacy

Museums have conflicting constraints: preserve the artifacts they are storing and make them available to public. Cultural artifacts are fragile and light sensitive. 3D scanning is used for sculptures but is limited. 3D printers are also limited in their range of colors. We address the full chain of material acquisition and restitution. Our idea is to scan cultural artifacts, capture all their material geometry and reproduce them. Reproduction can be done through 2.5D printing or virtual reality.

Context and objectives

Museums are operating under conflicting constraints: they have to preserve the artifacts they are storing, while making them available to the public, for viewing, and to researchers for studying. Many cultural artifacts are so fragile that simply exposing them to the light damages them. Recent advances have used 3D scanning, combined with virtual reality and 3D printing for the preservation and study of sculptures, and flatbed scanners for the preservation of books and prints. Both approaches are limited: they acquire the geometry and the color, but not complex material properties. <br />Several cultural artifacts, such as silk cloths and oil paints, have a subtle and complex appearance: their aspect changes depending on the incoming light and the position of the observer. Current scanners are not able to capture these subtle effects, and existing printers, either 2D or 3D, are unable to reproduce them. Existing research on material appearance shows that this microscopic geometry and color are essential in the overall appearance of materials. <br />Current 3D printers are limited in their spatial accuracy and in the gamut of colors they can reproduce. On the other hand, 2D printers are very good for spatial accuracy and color management, but are limited in the geometry of what they are printing: a flat surface. One of the partners in this project, Océ Print Logic Technologies, has developed a prototype 2.5D printer, capable of printing protruding surfaces, with the color and spatial accuracy of a 2D printer. <br />Our goal in this project is to address the entire chain of material acquisition and restitution, based on this micro-geometry. Our idea is to scan complex cultural artifacts, such as cloths, capturing all the geometry of their materials at the microscopic level, then process the information to further reproduce the artifacts for study by public and researchers. Reproduction can be either done through virtual reality or through 3D models.

The Museum of Ethnography in Bordeaux University has many cultural artifacts; some are so fragile that exposing them to bright light would damage them. Most of them are cloths, such as jackets, dresses or coats, of great importance for ethnological studies of the corresponding cultures. The Museum would like to make these collections available to the public without exposing the originals. They need replicas of their collections, either digital or physical. The problem is more difficult than for books or statues reproduction, because of the nature of the material: what is important is the micro-geometry of the material, both for the visual appearance and for ethnological studies.
At the other end, Océ Print Logic Technologies is developing a 2.5D color printer. This technology is already functional. Working in 2.5D, they overcome many limitations of 3D printers: they have high spatial accuracy and a large color gamut defined in a per-pixel basis and comparable to standard 2D color printers. Hardware and software parts are still active research topics.
Our goal is to bring together the needs for cultural heritage preservation of the Museum and the capacity for cultural heritage reproduction by Océ, creatins physical replicas of cultural artifacts, including subtle texture effects. The problem is more challenging than it appears, and the two research teams in Computer Graphics (Manao and Maverick) will have to solve difficult research issues such as:
• Developing a compact, portable acquisition device.
• Compact representations for acquired data.
• Predicting material appearance for 2.5D printing.

We subdivide the work into three work packages:
• WP1: from the material to the digital representation: our first goal is to acquire the local micro- geometry and appearance of the objects. Then, to convert this dataset into other representations, suitable for interactive display or physical reproduction.
• WP2: from the digital representation to the material: we first want to predict the appearance of a printed material depending on the local distribution of micro-facets. Then, use this knowledge to predict whether a material can be reproduced or not, and suggest a perceptually similar replacement in the event of having a constraint in the reproduction stage.
• WP3: a practical application challenge: exhibition at the Museum of Ethnography: we plan to combine the technologies developed in the first two work packages in a Museum exhibition, making fragile cultural artifacts available to the public. This will prove the robustness and applicability of our technologies, on one of the most challenging cases.

This project will have at least three major societal impacts:
• First, preservation and reproduction of cultural heritage artifacts. With the technology we will develop, museums will be able to make accurate reproductions of cultural heritage artifacts for public display while keeping the originals for preservation. Some reproductions may be even available for handling, for example for children, disabled visitors and exhibitions.
• Second, the research problems we will have to solve during the project will also have a greater impact for 2.5D printer manufacturers. We will have to address the issue of predicting whether the printer is able to reproduce a given material (including color and reflectance properties), and if not, to suggest the material that can be printed that is as close as possible for human visual perception. This problem is equivalent to the issue of color fidelity in 2D printers, but much more complex due to micro-geometry effects. The tools we will develop will help the industry of 2.5D printers, and give Océ Print Logic Technologies a strong advantage over competitors.
• Third, the problematic of material acquisition is not limited to museums and cultural heritage. It is also an issue for designers and artists trying to reproduce a specific object, for example leather seats in the virtual prototype of a car, or fabrics for designing clothes or virtual characters. Material acquisition tools developed for this project will have applications for these users as well.

1 international journal:
- A Two-Scale Microfacet Reflectance Model Combining Reflection and Diffraction, N. Holzschuch, R. Pacanowski, ACM Transactions on Graphics, 2017, 36 (4). DOI: 10.1145/3072959.3073621, hal.inria.fr/hal-01515948/

4 international conferences:
- The Effects of Digital Cameras Optics and Electronics for Material Acquisition, N. Holzschuch, R. Pacanowski, EG Workshop on Material Appearance Modeling, Helsinki, Finland. 2017, hal.inria.fr/hal-01576742/

- Isotropic BRDF Measurements with Quantified Uncertainties, R. Hegedus, A. Lucat, J. Redon, R. Pacanowski, EG Workshop on Material Appearance Modeling, Dublin, Ireland. 2016, hal.inria.fr/hal-01342568

- Estimating Local Beckmann Roughness for Complex BSDFs, N. Holzschuch, A. Kaplanyan, J. Hanika, C. Dachsbacher, ACM Siggraph talks, Jul 2016, DOI : 10.1145/2897839.2927416, hal.inria.fr/hal-01312227/

- Capturing Spatially Varying Anisotropic Reflectance Parameters using Fourier Analysis, A. Fichet, I. Sato, N. Holzschuch, Graphics Interface, 2016, hal.inria.fr/hal-01302120

Museums are operating under conflicting constraints: they have to preserve the artifacts they are storing, while making them available to the public and to researchers. Many cultural artifacts are so fragile that sim-ply exposing them to light degrades them. Recent advances have used 3D scanning, combined with virtual reality and 3D printing for the preservation and study of sculptures, and flatbed scanners for the preservation of books and prints. Both approaches are limited: they acquire the geometry and the color, but not complex material properties. Current 3D printers are also limited in the range of colors and details they can reproduce.

Several cultural artifacts, such as silk cloths and oil paints, have a subtle and complex appearance: their as-pect changes depending on the incoming light and the position of the observer. Current scanners are not able to capture these subtle effects, and existing printers, either 2D or 3D, are unable to reproduce them. Existing research on material appearance shows that this microscopic geometry and color are essential in the overall appearance of materials.

Our goal in this project is to address the entire chain of material acquisition and restitution, based on this micro-geometry. Our idea is to scan complex cultural artifacts, such as cloths, capturing all the geometry of their materials at the microscopic level, then process the information to further reproduce the artifacts for study by public and researchers. Reproduction can be either through virtual reality or through 3D models. This ambitious vision is made possible by the joint expertise brought of the consortium partners:
- Manao (a research team from the Institut d’Optique in Bordeaux) has a strong expertise in acquisition on local micro-geometry and reflectance properties, as well as material representation.
- Maverick (an Inria research team in Grenoble) has a strong expertise in photorealistic rendering and material representations.
- The Ethnographic Museum of Bordeaux University (MEB) has complex artifacts, including costumes from South-East Asia. It also has expertise in cultural heritage conservation, study and valorization.
- Océ Print Logic Technologies is a research and development center of Océ/Canon; they are developing a prototype 2.5D color printer, with high spatial and color accuracy.

This project fits into the Axe 3 of Défi 7 of the 2015 ANR general call, “Le numérique au service des arts, du patrimoine, des industries culturelles et éditoriales”.

Project coordinator

Monsieur Nicolas Holzschuch (Institut National de Recherche en Informatique et en Automatique)

The author of this summary is the project coordinator, who is responsible for the content of this summary. The ANR declines any responsibility as for its contents.

Partner

INRIA GRA- MAVERICK Institut National de Recherche en Informatique et en Automatique
OCE PRINT LOGIC TECHNOLOGIES SA
IOGS LP2N
MEB Musée d'Ethnographie de l'Université de Bordeaux

Help of the ANR 642,306 euros
Beginning and duration of the scientific project: September 2015 - 48 Months

Useful links

Explorez notre base de projets financés

 

 

ANR makes available its datasets on funded projects, click here to find more.

Sign up for the latest news:
Subscribe to our newsletter