JP3241099U - Cultural property digitization and restoration system - Google Patents

Abstract

A cultural property digitization and restoration system is provided. A cultural property digitization and restoration system of the present invention includes a carrier and a server. The carrier is a cover structure, multiple angle-adjustable light projectors and one or more video cameras are installed inside the carrier, and the angle-adjustable light projectors are installed with a visible light lamp, an infrared lamp and an ultraviolet lamp. ing. The server 2 is connected to the signals of the angle-adjustable light projector and the video camera. [Selection drawing] Fig. 9

Description

The present invention relates to a cultural property digitization and restoration system, and more particularly to a cultural property digitization and restoration system that integrates reflectance conversion imaging technology, 3D modeling technology and multi-wavelength imaging technology.

The preservation of cultural heritage is determined by its constituent materials and complex processes such as degradation and environmental influences, and the accuracy of monitoring techniques to assess these changes is necessary for appropriate protection and restoration strategies.
Currently, there are many types of collections and restoration-related techniques on the market. Using high-resolution microscope, 3D digital control microscopic observation scientific appraisal method is carried out on the characteristics and properties of ceramic glaze etching traces. Or CN 104596442 A104596442 "Auxiliary Device and Method for 3D Scanning" uses the reflection principle of a plane mirror, places a plane mirror around the object to be scanned, and scans the surface and sides of the object at the same time. Then, the object is flipped and the back and sides are scanned at the same time, and the two depth maps are aligned using the match points of the side parts of the two depth maps to obtain stereoscopic mapping. Or China Patent Application Publication No. 109064552 "Cultural Relic Virtual Restoration Method and Restoration System" uses VR glasses and projectors to virtually restore cultural relics.

However, the related techniques such as conventional collection cultural properties and restoration are all used for surveying or appraisal analysis of specific cultural properties or cultural properties using special materials. Considering the cost of instrumentation and the efficiency of 3D models when digitizing holdings relative to other cultural properties, all currently used 3D modeling techniques rely on using optical scanners to overlay cultural property photographs. In order to create a 3D model of each cultural property, the quality is poor, and it is impossible to completely reduce the 3D detailed features and fine streak patterns of the cultural property. Moreover, the 3D model of the cultural property can only be applied for VR or digital exhibition, is not suitable for digitizing the cultural property in the collection, and cannot be directly applied to the restoration of the cultural property.
In addition, the 3D model technology using the high-resolution microscope can obtain a high-resolution 3D model, but the time required for 3D modeling is very long, the file size is very large, and the cost of the equipment used is very high. cost is high, and there is no economic effect for the use of digitization of large-scale cultural properties or collections of large-scale cultural properties. In addition, since this technology can only reveal 3D detailed features of cultural properties, this technology is only suitable for highly accurate appraisal of cultural properties, and is not suitable for digitizing cultural properties in collections and restoring cultural properties. be.

In response to the above problems, the present invention addresses the many problems and drawbacks that arise when the inventors apply the conventional 3D model technology to the digitization and restoration work of cultural properties in the collection. It was devised based on many years of research and development experience in surveying-related technology.
The purpose of this invention is to integrate the reflective conversion imaging technology, 3D model technology and multi-wavelength imaging technology into the digitization and restoration platform of cultural relics, and combine the reflective conversion imaging device, 3D model equipment and multi-wavelength imaging device. 3D image data and signals such as images of cultural properties are acquired by performing optical and image processing on the captured signals, adjusting the contrast of the image, drawing out the features, and making it rich in color. , color tones, patterns, streak patterns, temporal changes, and spatial distribution disciplines of images, and by providing situational classifications such as the shape of cultural properties and the type of distribution structure, we are able to preserve, restore, and It is to provide scientific data for inspection.
Reflectance Transformation Imaging (RTI) is a quantitative reflectance transformation imaging technique that projects illumination onto the surface of an object from multiple angles through a rapid, accurate and non-contact method to capture surface topography. Rapidly change the signal and surface area, generate a sequence, form a concave normal direction, and calculate the detailed signal of the object surface stripes and geometric patterns, and this enhanced function can calculate the rate of change of direction. can be increased to enhance the perception of surface streaks and shape features of cultural relics. RTI also allows for image analysis and quantitative data, allowing the extension of image recording to the analysis of survey changes.
The 3D model technology is realized by a stereoscopic imaging technique using optics, a stereoscopic imaging technique using laser, or a composite technique of a stereoscopic imaging technique using optics and a stereoscopic imaging technique using laser. The optical stereoscopic imaging technique performs stereoscopic image processing on the signal of the optical scanner, and in combination with the two-dimensional digital image sequence, derives the technique of stereoscopic depth of structure through image matching technology. Optical stereoscopic reconstruction produces a digital model of the real thing by sensing and analyzing structural geometry and streak data. In recent years, digital camera technology has developed rapidly, the resolution has reached 10 million pixels, and the price has decreased. A 3D image-based scanning technique that reconstructs a 3D model of an object by acquiring streak signals is very economical.
The multi-wavelength imaging technology has the advantage of analyzing by optical images of different wavelengths and frequencies, identifying weak data and quantitatively detecting it, and acquiring the characteristic signals of the chart. It is possible to analyze optical images in the frequency band from ultraviolet and visible light to infrared, inspect and measure relatively weak data of cultural properties, and acquire weak data of cultural properties. The present invention mainly obtains the color and brightness distribution of cultural relics by visible light images. By penetrating the pigment layer of cultural relics through the transmission effect of infrared rays, it is possible to observe whether there are other weak data invisible to the naked eye on the bottom layer of the pigment layer, such as the overlapping of color layers or the background of the pattern, and the infrared rays are Due to its excellent carbon sensing ability, it can detect weak ink lines. It is also useful for inspecting and measuring weak ink lines and observing the unique style of a painting or the skill of a painter. When the cultural property is irradiated with ultraviolet rays, it emits fluorescence with different wavelengths or intensities for different substances, so it can be determined whether the cultural property has been invaded or eroded by organic substances or microorganisms, and this technology Inspection of restoration or repair traces will make it convenient for conservation and repair engineers to repair cultural properties, and will be the basis for compensation for damages when the cultural properties are rented and the basis for replacement of the cultural properties.

To achieve the above objectives, the collections digitization and restoration system of the present invention includes at least a carrier and a server.
The carrier has a cover structure, a plurality of angle-adjustable light projectors and one or more video cameras are installed inside the carrier, and the angle-adjustable light projectors include a visible light lamp, an infrared lamp and an ultraviolet lamp. is installed.
The server is connected to the signals of the angle-adjustable light projector and the video camera, and is equipped with a reflection conversion imaging module, a stereoscopic imaging module, a multi-wavelength imaging module and a data processing module.
The reflective transform imaging module captures reflective transform imaging data of cultural relics through the visible light lamp of the angle-adjustable light projector and the video camera.
The stereoscopic image module captures 3D stereoscopic image data of cultural relics through the video camera.
The multi-wavelength photography module captures multi-wavelength image data of cultural relics through the visible light lamp, the infrared lamp, the ultraviolet lamp and the video camera of the angle-adjustable light projector.
The data processing module has features using image 3D models and designs, 3D point clouds and automatic overlay by computing the data captured by the reflectance conversion imaging module, the stereoscopic imaging module and the multi-wavelength imaging module. Identify and quantitatively detect images, data, and acquire data such as stereoscopic automatic capture systems.

1 is a three-dimensional view of embodiment 1 of the present invention; FIG. Figure 2 is a side view of the carrier of Figure 1; Figure 2 is a plan view of the carrier of Figure 1; FIG. 3 is a front view of the three-light-source angle-adjustable light projector of the present invention assembled together; FIG. 3 is a side view of the three-light-source angle-adjustable light projector of the present invention assembled together; FIG. 4 is a schematic diagram showing the assembled state of the adjustment element of the present invention; Fig. 2 is a three-dimensional view of embodiment 2 of the present invention; FIG. 2 is a schematic diagram showing the use state of the present invention; 1 is a configuration diagram of a server system according to the present invention; FIG.

The following description provides a better understanding of the present invention. An implementation of the holdings digitization and restoration system includes at least a carrier 1 and a server 2, as shown in FIGS. 1-9.
The cover structure of the carrier 1 may be a square, semi-circular, cylindrical, etc. structure. A plurality of angle-adjustable light projectors 10 and one or more video cameras 11 are installed inside the carrier 1, or a plurality of laser rangefinders 12 (see FIG. 7) are added to increase the accuracy of the 3D model. . A video camera 11 is installed in the middle of the carrier 1, that is, in the central position. Said server 2 is connected to the signals of angle-adjustable light projector 10, video camera 11 and laser rangefinder 12, and can be connected to wired or wireless signals. and a wireless signal transmitter 13 is installed in the carrier 1 (see FIG. 7), the wireless signal transmitter 13 is connected to the signals of the angle-adjustable light projector 10, the video camera 11 and the laser rangefinder 12; Through the signal transmitter 13 , the angle adjustable light projector 10 , the video camera 11 and the laser rangefinder 12 are connected to the wireless signal of the server 2 .

A visible light lamp 100 , an infrared lamp 101 and an ultraviolet lamp 102 are installed in the angle adjustable light projector 10 . The visible light lamp 100, the infrared lamp 101 and the ultraviolet lamp 102 are independent lighting fixtures, or an integrated three-light source lamp assembled with the visible light lamp 100, the infrared lamp 101 and the ultraviolet lamp 102 (Fig. 4 and 5) can be used. In order to finely adjust the irradiation angle of the light source, an angle adjuster 103 is installed in the angle-adjustable light projector 10, and it is possible to illuminate downward at an oblique angle (because there is no reflection angle of light when illuminating vertically). , the illumination angle of the light source must not be perpendicular to the surface of the cultural property).

As shown in FIG. 8, when the video camera 11 is plural, it can capture 3D reconstructed images by an optical scanner for the 3D model.

As shown in FIGS. 1 to 3, the cover structure of the carrier 1 is provided with a frame 14 and a plurality of sets of movable pedestals 15, the frame 14 is provided with a plurality of sets of first rail grooves 140, and the movable pedestal is installed. 15, a plurality of sets of second rail grooves 150 are installed. A plurality of sets of adjustment elements 16 are installed between the frame 14 and the mobile cradle 15 so that the mobile cradle 15 can be adjusted to any position within the frame 14 . As shown in FIG. 6 , the adjustment element 16 is provided with a right angle clasp 160 , a plurality of bolts 161 and a plurality of nuts 162 , the right angle clasp 160 is provided with bolts 161 on both sides, and the frame 14 The nuts are installed in the first rail groove 140 and in the second rail groove 150 of the movable platform 15 . When the nuts 162 in the first rail groove 140 and the second rail groove 150 are tightened with the bolts 161, the frame 14 and the movable platform 15 are fixed to each other, and when the bolts 161 and the nuts 162 are loosened, the movable platform 15 is fixed to the frame 14. By moving above and adjusting the position, the movable mount 15 can be adjusted to any position within the frame 14, so adjustment can be made according to the shape and size of the cultural property. A moving mechanism 141 is installed at the bottom of the frame 14 to assist the frame 14 for mobile scanning. The moving mechanism 141 has a normal wheelset structure or a power wheelset structure, that is, a structure in which the driving wheels are controlled, and the power wheelset structure allows the server 2 to accurately move the position, and automatically Reducing human error by correcting the position. A lens hood (not shown in the drawings) is placed outside the frame 14 to prevent external light sources from affecting the captured results.

As shown in FIG. 9 , the server 2 is equipped with a reflection conversion imaging module 20 , a stereoscopic imaging module 21 , a multi-wavelength imaging module 22 and a data processing module 23 . The reflectance transform imaging module 20 captures the reflectance transform imaging data of cultural relics through the visible light lamp 100 of the angle-adjustable light projector 10 and the video camera 11, and the stereoscopic image module 21 captures the reflectance transform imaging data of the cultural relic through the video camera 11 (and the laser Through the rangefinder 12), the 3D stereoscopic image data of the cultural relic is captured, and the multi-wavelength photography module 22 is through the visible light lamp 100, the infrared lamp 101, the ultraviolet lamp 102 and the video camera 11 of the angle adjustable light projector 10, Capture multi-wavelength image data of cultural relics (including images from normal optical scans, infrared scans, and ultraviolet scans). The data processing module 23 computes the data captured by the reflectance conversion imaging module 20, the stereoscopic imaging module 21 and the multi-wavelength imaging module 22 to produce an image 3D model and a pattern with enhanced high-precision features, 3D points. By acquiring data such as images with features using clusters and automatic overlays, identifying and quantitatively detecting weak data, and automatic capture systems for stereoscopic images, the data can be used to identify cultural properties in the collection. Widely used for preservation, restoration, inspection, etc.
The reflectance transform imaging technique (RTI) is an image-based recording method that captures the surface reflectance-related signal for each pixel in the image and stores it at a mathematically-given location in the normal direction perpendicular to the surface direction. From and RTI files, from a fixed camera position, project light from different directions, take multiple digital photographs, and then generate signals for each image. Reflection of light is determined by the normal position of the object surface, and the angle of incidence of light and the included angle of the normal are equal to the angle of reflection of light and the included angle of the normal, and the position of the camera is fixed, so each image , the normal position can be determined by the ray of . At this time, a series of images with different bright spots and the same shadows are generated. RTI computes the surface normal of each pixel in the image, and the normal value and red, green, blue (RGB) color signals in each pixel are stored simultaneously to efficiently convert color and true 3D shape signals. By recording well, the user can control the illumination angle of the image surface and inspect its surface normal vector, and the illumination information of the image can be obtained through the model of the mathematical surface calculated and processed, and the characteristics of various fine stripes. can be strengthened.
Therefore, when the user conducts an inspection using the Reviewer, by selecting the direction of the virtual light source, the 3D fine streak patterns appearing under different light sources with different trajectories are observed. In actual operation, RTI is a kind of computational photography technology, which collects and analyzes 40-100 images with fixed light sources at different positions, and the image recognition software used infers the position of the light source. If possible, generate a 3D mathematical representation of the surface of the organism. Reviewer-edited software computes the surface Normal Vector from the image, further characterizing the surface and showing detail. With several recording and exhibition modes in the reviewer, various reflections are enhanced by applying mathematics to surface normals and RGB signals, and the enhancement tool (or rendering mode) can be used to determine surface shape and color. Through the shape data of the RTI image, the reviewer's enhancement function allows each pixel to reveal more of the signal of interest than when using only RGB data filters. The enhancement tools are Basic rendering modes, Specular enhancement mode, or Normals Visualzation mode, where the Basic rendering mode is an RTI image without enhancement. So this mode has no parameters. The specular enhancement mode isolates the RGB signals and when specular is enhanced, the value of bright areas is reduced and the entire surface is illuminated by transmitting the specular reflection of the affected area to the area in question. The normal visualization mode shows a pixel-by-pixel normal rendering of the surface of the artifact, the normal values X, Y and Z quantities of each pixel in the rendering representing red, green and blue, respectively, and the normal of each pixel Directions are indicated by specific colors.
Through the 3D image technology using the 3D image technology optics, the 3D image technology can be realized by a 3D image technology using a laser or a composite technology of a 3D image technology using optics and a 3D image technology using a laser. The optical stereoscopic imaging technique performs stereoscopic image processing on the signal of the optical scanner, and in combination with the two-dimensional digital image sequence, derives the technique of stereoscopic depth of structure through image matching technology. Optical stereoscopic reconstruction produces a digital model of the real thing by detecting and analyzing structural geometry and streak data. In recent years, digital camera technology has developed rapidly, the resolution has reached 10 million pixels, and the price has decreased. A 3D image-based scanning technique that reconstructs a 3D model of an object by acquiring streak signals is very economical.
Stereoscopic imaging technology using lasers is a technology that has existed for a long time. The precision of 3D modeling is enhanced by combining the stereoscopic imaging technology using the laser and the stereoscopic imaging technology using optics.
The multi-wavelength imaging technology uses optical images with different wavelengths and frequencies for analysis, has the advantage of identifying and quantitatively detecting weak data, and can acquire the characteristic signals of the map. can. Ultraviolet, visible light and infrared one series wave band optical image analysis, can inspect and measure relatively weak data of cultural relics, and obtain weak data of cultural relics. The present invention mainly obtains the color and brightness distribution of cultural relics by visible light images. By penetrating the pigment layer of cultural relics through the transmission effect of infrared rays, it is possible to observe whether there are other weak data invisible to the naked eye on the bottom layer of the pigment layer, such as the overlapping of color layers or the background of the pattern, and the infrared rays Due to its excellent carbon sensing ability, it can detect weak ink lines. It is also useful for inspecting and measuring weak ink lines and observing the unique style of a painting or the skill of a painter. When the cultural property is irradiated with ultraviolet light, it emits fluorescence with different wavelengths or intensities for different materials, so it can be determined whether the cultural property has been invaded or eroded by organic substances or microorganisms. In addition, this technology can be used to inspect restoration or repair marks, making it convenient for conservation and repair engineers to repair cultural properties, as well as being the basis for compensatory damages when cultural properties are rented out, and when cultural properties are replaced. .

Therefore, when operating the digitization and restoration system of the holding cultural property of the present invention, after the carrier 1 is erected on the cultural property, the structure of the frame 14 and the mobile stand 15 of the carrier 1 is adjusted according to the size of the cultural property. do. Controlling angle-adjustable light projector 10, video camera 11, laser rangefinder 12 and moving mechanism 141 through server 2 to capture a piece of data, or controlling capture by segments (depending on the size of cultural relics), Reflection transform imaging technology, 3D modeling technology and multi-wavelength imaging technology can acquire the necessary data. Furthermore, through the data processing module 23 of the server 2, image 3D models and enhanced high-precision feature designs, feature images using 3D point clouds and automatic overlays, weak data can be identified and quantitatively detected. It is possible to acquire data such as an automatic capture system for stereoscopic images, and to apply the data to preservation, restoration, inspection, VR (virtual reality), AR (augmented reality), etc. of cultural properties in the collection. With this invention, it is possible to completely reduce the characteristics of the 3D structure of cultural assets and perfectly record even the details that cannot be seen with the naked eye. Accuracy, high definition, low cost, wide range of applications (such as digitization of national cultural relics or private cultural relics, growth records of human bodies or animals and plants, etc.), the configuration of the present invention is the most practical. is high and has an economic effect.

The aspects or modes of use of the invention are not limited to the examples described above. It is obvious that a person having ordinary knowledge in the technical field to which the present invention belongs can conceive of various modifications or modifications within the scope of the technical ideas described in the scope of utility model registration claims. It is understood that these also belong to the technical scope of the present invention.

Reference Signs List 1 carrier 10 angle-adjustable light projector 100 visible light lamp 101 infrared lamp 102 ultraviolet lamp 103 angle adjuster 11 video camera 12 laser rangefinder 13 radio signal transmitter 14 frame 140 first rail groove 141 moving mechanism 15 moving mount 150 Second Rail Groove 16 Adjustment Element 160 Right Angle Clamp 161 Bolt 162 Nut 2 Server 20 Reflection Conversion Imaging Module 21 Stereo Image Module 22 Multi-Wavelength Imaging Module 23 Data Processing Module

Claims (10)

including a carrier and a server;
The carrier has a cover structure, a plurality of angle-adjustable light projectors and one or more video cameras are installed inside the carrier, and the angle-adjustable light projectors include a visible light lamp, an infrared lamp and an ultraviolet lamp. is installed and
the server is connected to the signals of the angle-adjustable light projector and the video camera, the server is equipped with a reflection conversion imaging module, a stereoscopic imaging module, a multi-wavelength imaging module and a data processing module;
the reflective transform imaging module captures reflective transform imaging data of cultural relics through the visible light lamp of the angle-adjustable light projector and the video camera;
the stereoscopic image module captures 3D stereoscopic image data of cultural relics through the video camera;
the multi-wavelength photography module captures multi-wavelength image data of cultural relics through the visible light lamp, the infrared lamp, the ultraviolet lamp and the video camera of the angle-adjustable light projector;
The data processing module has features using image 3D models and designs, 3D point clouds and automatic overlay by computing the data captured by the reflectance conversion imaging module, the stereoscopic imaging module and the multi-wavelength imaging module. A digitization and restoration system for cultural assets characterized by identifying and quantitatively detecting images, data, and acquiring data such as an automatic capture system for stereoscopic images. 2. The method of claim 1, characterized in that a plurality of laser rangefinders are installed inside the carrier, and the laser rangefinders are connected to the signal of the server, so as to enhance the accuracy of the 3D model of the stereoscopic image module. cultural heritage digitization and restoration system. a wireless signal transmitter installed on the carrier, connecting the wireless signal transmitter to the signals of the angle-adjustable light projector, the video camera and the laser rangefinder; 3. The cultural relics digitization and restoration system according to claim 2, characterized in that it is connected to a wireless signal of the light projector, the video camera and the laser rangefinder and the server. The digitization and restoration of cultural properties according to claim 1, wherein the angle-adjustable light projector uses a three-light source lamp, which is an integral assembly of the visible light lamp, the infrared lamp, and the ultraviolet lamp. system. 2. The light projector according to claim 1, wherein an angle adjuster is installed in the angle-adjustable light projector so that the irradiation angle of the light source can be finely adjusted and the light can be irradiated at an oblique angle. cultural heritage digitization and restoration system. a frame and a plurality of sets of movable cradles are installed on the cover structure of the carrier, and a plurality of sets of first rail grooves are installed on the frame so that the movable cradle can be adjusted to any position in the frame; The cultural relic according to claim 1, characterized in that a plurality of sets of second rail grooves are installed on the mobile platform, and a plurality of sets of adjustment elements are installed between the frame and the mobile platform. Digitization and restoration system. The adjusting element is provided with a right-angle catch, a plurality of bolts and a plurality of nuts, the bolts are installed on both sides of the right-angle catch, and the first rail groove of the frame and the first rail of the mobile platform are installed. The nut is installed in the second rail groove,
By adjusting the position, the mobile platform can be adjusted to any position in the frame, and the bolts are installed in the first rail groove so that the adjustment can be made according to the shape and size of the cultural property. and when the nuts in the second rail grooves are tightened, the frame and the mobile platform are fixed to each other, and when the bolts and the nuts are loosened, the mobile platform moves on the frame. The cultural property digitization and restoration system according to claim 6. The system for digitizing and restoring cultural relics according to claim 1, wherein a moving mechanism is installed at the bottom of the frame to assist the frame in moving scanning. The movement mechanism is a driving wheel-controlled structure, and the driving wheel-controlled structure is moved and automatically corrected by the server to reduce human error. The cultural property digitization and restoration system according to claim 8. The cultural relics digitizing and restoration system according to claim 1, characterized in that a lens hood is installed outside the frame to prevent external light sources from affecting the captured results.

Images