CN117319807B - Light and shadow imaging method and system for karst cave dome - Google Patents

Light and shadow imaging method and system for karst cave dome Download PDF

Info

Publication number
CN117319807B
CN117319807B CN202311621353.9A CN202311621353A CN117319807B CN 117319807 B CN117319807 B CN 117319807B CN 202311621353 A CN202311621353 A CN 202311621353A CN 117319807 B CN117319807 B CN 117319807B
Authority
CN
China
Prior art keywords
image
adopting
dome
light
hdr
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311621353.9A
Other languages
Chinese (zh)
Other versions
CN117319807A (en
Inventor
苏横军
肖洋洋
邓瑶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanchang Lingxing Information Technology Co ltd
Original Assignee
Nanchang Lingxing Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanchang Lingxing Information Technology Co ltd filed Critical Nanchang Lingxing Information Technology Co ltd
Priority to CN202311621353.9A priority Critical patent/CN117319807B/en
Publication of CN117319807A publication Critical patent/CN117319807A/en
Application granted granted Critical
Publication of CN117319807B publication Critical patent/CN117319807B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/741Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/85Camera processing pipelines; Components thereof for processing colour signals for matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/957Light-field or plenoptic cameras or camera modules

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to the technical field of optical imaging, in particular to a light and shadow imaging method and system of a karst cave dome, comprising the following steps: based on the illumination condition in the rock tunnel, the self-adaptive exposure control algorithm is adopted to carry out multi-exposure shooting, and a multi-exposure image sequence is generated through a high dynamic range synthesis technology. According to the invention, the self-adaptive exposure control algorithm and the high dynamic range synthesis technology can effectively capture a multi-exposure image sequence under a variable illumination condition, the color and detail richness of an HDR image are ensured, the HDR fusion algorithm of the Debevec and the Malik is combined with the global tone mapping method to improve the contrast ratio, the sense of reality is enhanced, the light field camera provides light angle information and depth information, a high-quality three-dimensional model is generated, the details are enhanced, the spectral deconvolution technology and the characteristic spectral line analysis support material analysis, the three-dimensional rendering technology is combined with the light shadow effect simulation and the multi-spectral data fusion to improve the material authenticity, and the comprehensive visual model of the karst cave dome is closer to the actual situation.

Description

Light and shadow imaging method and system for karst cave dome
Technical Field
The invention relates to the technical field of optical imaging, in particular to a light and shadow imaging method and system of a karst cave dome.
Background
Optical imaging technology is a technology covering a number of branch fields, mainly involving the conversion of visible light or other electromagnetic waves into images or photographs so that one can observe and analyze the visual information of an object. This field includes various imaging techniques such as photography, optical microscopy, telescopes, infrared imaging, X-ray imaging, and the like.
The method of imaging the light of the dome of the rock cavity is a specific optical imaging technology, and aims to capture and present the light effect inside the dome of the rock cavity. The main purpose of this method is to record and display the unique light, color and texture inside the cave, and it is generally aimed at promoting the protection and research of cultural heritage by recording and presenting the light, color and texture inside the cave, helping to preserve the wall paintings, engravings and other artwork in the cultural heritage. Powerful tools are provided for tourism and education, so that tourists and students can better appreciate and understand beautiful landscapes inside the karst cave, and cultural and natural historical education experiences of the tourists and students are enhanced. Data and insights are provided for scientific research to understand light propagation and reflection, to study microclimate inside a cave, or to explore other scientific problems associated with a cave. To achieve these goals, methods of light imaging of a cave dome typically use optical devices, such as cameras, light control devices, and illumination devices, to capture light, color, and texture on the dome. This involves special lighting techniques such as point light sources, soft light sources or multi-light source lighting to present the best visual effect without damaging the inside of the cave. The image data may be further post-processed and analyzed to improve image quality and rendering.
Existing methods of dome light imaging of a cave often suffer from a number of disadvantages. Conventional methods have difficulty balancing exposure under varying illumination inside the cave, resulting in images that lose much detail in color and brightness. Moreover, the lack of high dynamic range techniques results in insufficient detail capture in high contrast scenes, affecting the quality of the final image. In addition, these methods often fail to effectively capture the light angle information, lack accurate processing of depth information, and result in insufficient refinement of the three-dimensional model generation, and failure to carefully reveal the shape, size, and surface texture of the dome of the rock cavity. In the aspect of material analysis, the prior art cannot comprehensively utilize spectral deconvolution and characteristic spectral line analysis, so that accurate material data cannot be provided. Finally, due to the lack of advanced three-dimensional rendering and light shadow simulation technologies, the authenticity and visual effect of materials are difficult to reach ideal states, and high requirements on the details and the authenticity of the dome of the rock cavern in scientific research and protection work cannot be fully met.
Disclosure of Invention
The invention aims to solve the defects in the prior art, and provides a light and shadow imaging method and system for a cave dome.
In order to achieve the above purpose, the present invention adopts the following technical scheme: a method of light imaging a cave dome comprising the steps of:
S1: based on the illumination condition in the rock tunnel, performing multiple exposure shooting by adopting a self-adaptive exposure control algorithm, and generating a multi-exposure image sequence by a high dynamic range synthesis technology;
s2: based on the multi-exposure image sequence, adopting a high dynamic range fusion algorithm of the development and the Malik to synthesize images, and using a global tone mapping method to optimize contrast to generate an HDR karst cave dome image;
s3: capturing light angle information by adopting a light field camera technology based on the HDR karst dome image, and performing depth information processing by a Fourier slice photography method to generate a light field data set;
s4: based on the light field data set, adopting a structured light triangulation method and a laser time flight measurement technology to perform three-dimensional scanning, and performing detail enhancement processing to generate a three-dimensional model of the karst cave dome;
s5: based on the HDR karst cave dome image, performing material analysis by adopting a spectral deconvolution technology and a characteristic spectral line analysis method, and processing light information by an image fusion technology to generate a multispectral analysis report;
s6: based on the three-dimensional model of the rock hole dome and the multispectral analysis report, adopting a three-dimensional rendering technology to simulate the light and shadow effect, and fusing multispectral data to increase the authenticity of materials, so as to generate a comprehensive visual model of the rock hole dome;
The sequence of multi-exposure images includes multi-exposure-level cave images, the HDR cave dome images include color and intensity information over a wide dynamic range, the light field dataset includes light ray information at multiple perspectives, and the three-dimensional model of the cave dome specifically refers to a digital representation reflecting the shape, size, and surface texture of the cave dome.
As a further scheme of the invention, based on the illumination condition in the rock tunnel, the self-adaptive exposure control algorithm is adopted to carry out multi-exposure shooting, and the steps of generating a multi-exposure image sequence by a high dynamic range synthesis technology are specifically as follows:
s101: optimizing illumination distribution by adopting a histogram equalization algorithm based on illumination conditions in the rock cavern, performing automatic white balance adjustment, performing exposure parameter evaluation, and generating exposure parameter configuration;
s102: based on the exposure parameter configuration, adopting a multi-region photometry algorithm to perform sequence shooting and image capturing to generate an original multi-exposure image set;
s103: based on the original multi-exposure image set, adopting a characteristic point matching and image registration algorithm to correct shooting deviation, and carrying out image alignment to generate an aligned multi-exposure image set;
S104: and based on the aligned multi-exposure image set, adopting a high dynamic range fusion technology to combine brightness information and expand the dynamic range to generate a multi-exposure image sequence.
As a further scheme of the present invention, based on the multi-exposure image sequence, an image synthesis is performed by adopting a high dynamic range fusion algorithm of the Debevec and the Malik, and a global tone mapping method is used to optimize contrast, and the step of generating an HDR karst cave dome image specifically comprises:
s201: based on the multi-exposure image sequence, adopting a Debeck and Marek HDR algorithm to expand the dynamic range of the image, and performing fusion processing to generate an intermediate HDR image;
s202: based on the intermediate HDR image, adopting a color space conversion algorithm to perform tone correction and color correction to generate a color corrected HDR image;
s203: based on the color corrected HDR image, adopting a local tone mapping algorithm to carry out detail enhancement and carrying out local contrast optimization to generate a locally enhanced HDR image;
s204: and based on the locally enhanced HDR image, performing global contrast adjustment by adopting a global tone mapping method, and performing brightness optimization to generate an HDR karst cave dome image.
As a further scheme of the present invention, based on the HDR karst cave dome image, light angle information is captured by adopting a light field camera technology, and depth information processing is performed by a Fourier slice photography method, and the step of generating a light field data set specifically includes:
s301: based on the HDR karst cave dome image, adopting a light field camera shooting technology to capture light angles, and carrying out preliminary light field data collection to generate preliminary light field information;
s302: based on the preliminary light field information, adopting a ray tracing rendering algorithm to perform path calculation and refining light field data to generate refined light field data;
s303: based on the refined light field data, carrying out frequency domain analysis by adopting a Fourier transform algorithm, and extracting frequency information to generate a frequency analysis result;
s304: based on the frequency analysis result, a Fourier slice imaging technology is executed, depth information cutting is carried out, and a light field data set is constructed to generate the light field data set.
As a further scheme of the invention, based on the light field data set, a structured light triangulation method is adopted to combine with a laser time flight measurement technology to perform three-dimensional scanning, and detail enhancement processing is performed, so that a three-dimensional model of a karst cave dome is generated specifically by the following steps:
S401: based on the light field data set, adopting a phase difference algorithm to perform structured light coding, performing space point cloud acquisition, performing point cloud splicing, and generating a preliminary three-dimensional point cloud;
s402: based on the preliminary three-dimensional point cloud, performing distance measurement by adopting a direct time flight method, performing point cloud calibration, performing noise filtering, and generating a calibrated three-dimensional point cloud;
s403: based on the calibrated three-dimensional point cloud, performing gridding treatment by using a poisson reconstruction method, performing surface reconstruction, performing detail optimization, and generating a three-dimensional grid model;
s404: based on the three-dimensional grid model, performing model optimization by adopting a multi-scale detail enhancement technology, performing texture mapping, and performing coloring treatment to generate a three-dimensional model of the dome of the karst cave.
As a further scheme of the invention, based on the HDR karst dome image, a spectral deconvolution technology and a characteristic spectral line analysis method are adopted to analyze materials, and the optical information is processed through an image fusion technology, so that a multispectral analysis report is generated specifically by the following steps:
s501: performing material spectrum decomposition by least square method spectrum deconvolution based on the HDR karst dome image, performing spectrum data preliminary analysis, and performing wavelength screening to generate preliminary material spectrum data;
S502: based on the preliminary material spectrum data, performing characteristic spectral line analysis by adopting Gaussian model fitting, performing material identification, extracting the characteristic data, and generating a material spectrum characteristic analysis report;
s503: based on the material spectrum characteristic analysis report, processing multispectral data by adopting a weighted average image fusion method, enhancing a spectrum image, and adjusting a dynamic range to generate an enhanced multispectral image;
s504: and based on the enhanced multispectral image, performing image processing by adopting an information entropy image fusion method, performing color correction, performing image quality optimization, and generating a multispectral analysis report.
As a further scheme of the invention, based on the three-dimensional model and the multispectral analysis report of the rock hole dome, adopting a three-dimensional rendering technology to simulate the light and shadow effect, and fusing multispectral data to increase the authenticity of materials, the steps for generating the comprehensive visual model of the rock hole dome are specifically as follows:
s601: based on the three-dimensional model of the karst cave dome, performing light shadow simulation by adopting a ray tracing rendering technology, performing virtual illumination setting, performing visual effect preview, and generating a preliminary rendering model;
s602: based on the preliminary rendering model, performing material rendering by adopting a physical rendering method, performing material authenticity enhancement, performing map detail adjustment, and generating a material map rendering model;
S603: based on the material map rendering model, performing environment light simulation by adopting a global illumination algorithm, performing multi-light source setting, performing light and shadow balance adjustment, and generating an environment illumination adjustment model;
s604: and based on the environment illumination adjustment model, adopting a multispectral data fusion technology, and combining multispectral information with the three-dimensional model to generate a comprehensive visual model of the dome of the karst cave.
The system comprises an image acquisition module, an HDR image generation module, a light field information acquisition module, a three-dimensional reconstruction module, a material spectrum analysis module and a light shadow simulation rendering module.
As a further scheme of the invention, the image acquisition module optimizes illumination distribution by adopting a histogram equalization algorithm based on illumination conditions in a rock tunnel, performs automatic white balance adjustment, performs sequence shooting and image capturing based on a multi-region photometry algorithm, and generates an aligned multi-exposure image set;
the HDR image generation module expands the dynamic range of the image by adopting a Debeck and Marek HDR algorithm based on the aligned multi-exposure image set, corrects the tone by adopting a color space conversion algorithm, and enhances the detail by utilizing a local tone mapping algorithm to generate an HDR karst cave dome image;
The light field information capturing module captures light angles by adopting a light field camera shooting technology based on an HDR karst cave dome image, performs path calculation by adopting a ray tracing rendering algorithm, performs frequency domain analysis by adopting a Fourier transform algorithm, and generates a light field data set;
the three-dimensional reconstruction module performs structured light coding by adopting a phase difference algorithm based on a light field data set, performs space point cloud acquisition, performs point cloud splicing, performs distance measurement based on a direct time flight method, performs point cloud calibration, performs gridding processing by using a poisson reconstruction method, performs surface reconstruction, and generates a three-dimensional model of a karst dome;
the material spectrum analysis module performs material spectrum decomposition by adopting least square method spectrum deconvolution based on an HDR karst cave dome image, performs spectrum data primary analysis, performs wavelength screening, performs characteristic spectral line analysis based on Gaussian model fitting, performs material identification, and generates a material spectrum characteristic analysis report;
the light and shadow simulation rendering module is based on a three-dimensional model of the rock hole dome, performs light and shadow simulation by adopting a ray tracing rendering technology, performs virtual illumination setting, performs material rendering by adopting a physical-based rendering method, performs material authenticity enhancement, combines multispectral information with the three-dimensional model on the basis of a multispectral data fusion technology, and generates a comprehensive visual model of the rock hole dome.
As a further scheme of the invention, the image acquisition module comprises an illumination optimization sub-module, an exposure configuration sub-module and an image capturing sub-module;
the HDR image generation module comprises a dynamic range expansion sub-module, a tone correction sub-module and a detail enhancer module;
the light field information capturing module comprises a light angle capturing sub-module, a light rendering sub-module and a frequency domain analyzing sub-module;
the three-dimensional reconstruction module comprises a structured light coding sub-module, a distance measurement sub-module and a surface reconstruction sub-module;
the material spectrum analysis module comprises a material spectrum decomposition sub-module, a characteristic spectral line analysis sub-module and a material identification sub-module;
the light and shadow simulation rendering module comprises a light and shadow simulation sub-module, a material rendering sub-module and a multispectral fusion sub-module.
Compared with the prior art, the invention has the advantages and positive effects that:
according to the invention, through the application of the self-adaptive exposure control algorithm and the high dynamic range synthesis technology, a multi-exposure image sequence can be effectively captured and generated under the changeable illumination condition in the rock cave, so that the richness of color and brightness information and the accurate capture of details in a final HDR image are ensured. The HDR fusion algorithm of the development and the Malik can greatly improve the contrast ratio by combining the global tone mapping method, so that the image is more similar to the image seen by human eyes, and the realism of the image is enhanced. The introduction of the light field camera technology not only provides light angle information, but also accurately processes depth information by means of a Fourier slicing photography method, so that three-dimensional scanning can generate a high-quality three-dimensional model and enhance details on the basis of a structured light triangulation method and a laser time flight measurement technology. The spectrum deconvolution technology and the characteristic spectral line analysis method are applied to material analysis, and provide accurate data support for multispectral analysis reports. The three-dimensional rendering technology is used, and the combination of the shadow effect simulation and the multispectral data is combined, so that the authenticity of materials is greatly improved, and the generated comprehensive visual model of the karst cave dome is more matched with the actual situation in vision.
Drawings
FIG. 1 is a schematic workflow diagram of the present invention;
FIG. 2 is a S1 refinement flowchart of the present invention;
FIG. 3 is a S2 refinement flowchart of the present invention;
FIG. 4 is a S3 refinement flowchart of the present invention;
FIG. 5 is a S4 refinement flowchart of the present invention;
FIG. 6 is a S5 refinement flowchart of the present invention;
FIG. 7 is a S6 refinement flowchart of the present invention;
FIG. 8 is a system flow diagram of the present invention;
FIG. 9 is a schematic diagram of a system framework of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the description of the present invention, it should be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like indicate orientations or positional relationships based on the orientation or positional relationships shown in the drawings, merely to facilitate describing the present invention and simplify the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the present invention. Furthermore, in the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
Example 1
Referring to fig. 1, the present invention provides a technical solution: a method of light imaging a cave dome comprising the steps of:
s1: based on the illumination condition in the rock tunnel, performing multiple exposure shooting by adopting a self-adaptive exposure control algorithm, and generating a multi-exposure image sequence by a high dynamic range synthesis technology;
s2: based on the multi-exposure image sequence, adopting a high dynamic range fusion algorithm of the Debevec and the Malik to synthesize images, and using a global tone mapping method to optimize contrast to generate an HDR karst cave dome image;
s3: capturing light angle information by adopting a light field camera technology based on an HDR karst dome image, and performing depth information processing by a Fourier slice photography method to generate a light field data set;
s4: based on the light field data set, adopting a structured light triangulation method and a laser time flight measurement technology to perform three-dimensional scanning, and performing detail enhancement processing to generate a three-dimensional model of the dome of the rock cavern;
s5: based on an HDR karst cave dome image, performing material analysis by adopting a spectral deconvolution technology and a characteristic spectral line analysis method, and processing light information by an image fusion technology to generate a multispectral analysis report;
S6: based on a three-dimensional model and a multispectral analysis report of the rock hole dome, adopting a three-dimensional rendering technology to simulate a light and shadow effect, and fusing multispectral data to increase the authenticity of materials, so as to generate a comprehensive visual model of the rock hole dome;
the sequence of multi-exposure images includes a multi-exposure level cave image, the HDR cave dome image includes color and intensity information over a wide dynamic range, the light field dataset includes light ray information at multiple perspectives, and the three-dimensional model of the cave dome specifically refers to a digital representation reflecting the shape, size, and surface texture of the cave dome.
Through an adaptive exposure control algorithm and a high dynamic range synthesis technology, a multi-exposure image sequence can be generated, and rock cavity images with different exposure levels are captured, so that rich detail information is reserved. This helps to improve the quality and fidelity of the hole dome image.
And (3) performing image synthesis by adopting a high dynamic range fusion algorithm of the development and the Malik, and optimizing contrast by using a global tone mapping method to generate an HDR karst cave dome image. The method can effectively process color and brightness information in a wide dynamic range, so that details of the dome of the karst cave are more clearly visible, and the visual impact of the image is enhanced.
Light angle information is captured based on a light field camera technology, and depth information processing is performed through a Fourier slice photography method, so that a light field data set is generated. The method can accurately acquire the light information under multiple visual angles, and provides a reliable data base for subsequent three-dimensional scanning and model generation.
And carrying out three-dimensional scanning by adopting a structured light triangulation method and combining a laser time flight measurement technology, and carrying out detail enhancement processing to generate a three-dimensional model of the dome of the rock tunnel. The method can accurately reflect the shape, the size and the surface texture of the dome of the rock cavity, and provides an important basis for subsequent material analysis and visualization.
And (3) performing material analysis by adopting a spectral deconvolution technology and a characteristic spectral line analysis method based on the HDR karst dome image, and processing optical information by adopting an image fusion technology to generate a multispectral analysis report. The method can accurately analyze the material characteristics of the dome of the karst cave, and provides an important reference basis for subsequent light and shadow effect simulation and comprehensive visualization.
Based on a three-dimensional model and a multispectral analysis report of the rock hole dome, adopting a three-dimensional rendering technology to simulate the light and shadow effect, and fusing multispectral data to increase the authenticity of materials, so as to generate a comprehensive visual model of the rock hole dome. The method can intuitively display the light and shadow effect and the material characteristics of the dome of the rock cavity, and provides a powerful reference basis for decision makers.
Referring to fig. 2, based on the illumination condition inside the cave, the adaptive exposure control algorithm is adopted to perform multiple exposure shooting, and the steps of generating the multi-exposure image sequence through the high dynamic range synthesis technology are specifically as follows:
s101: optimizing illumination distribution by adopting a histogram equalization algorithm based on illumination conditions in the rock cavern, performing automatic white balance adjustment, performing exposure parameter evaluation, and generating exposure parameter configuration;
s102: based on exposure parameter configuration, adopting a multi-region photometry algorithm to perform sequence shooting and image capturing to generate an original multi-exposure image set;
s103: based on the original multi-exposure image set, adopting a characteristic point matching and image registration algorithm to correct shooting deviation, and carrying out image alignment to generate an aligned multi-exposure image set;
s104: and (3) based on the aligned multi-exposure image set, adopting a high dynamic range fusion technology to combine brightness information and expand the dynamic range to generate a multi-exposure image sequence.
And optimizing the illumination distribution by using a histogram equalization algorithm according to the illumination condition inside the rock cavern. Thus, the brightness distribution in the image can be balanced, and the condition of overexposure or underexposure is avoided. Meanwhile, automatic white balance adjustment is performed to ensure color accuracy of the image. Next, the exposure parameters are evaluated, generating an exposure parameter configuration. This can be adjusted according to the lighting conditions and shooting requirements inside the cave to obtain the best exposure effect.
And according to the exposure parameter configuration, adopting a multi-region photometry algorithm to carry out sequence shooting. By dividing the screen into a plurality of areas and measuring the luminance value of each area separately, the exposure can be controlled more accurately. During shooting, it is necessary to ensure that the camera is stable to avoid blurring of the image. After shooting is completed, an original multi-exposure image set is generated.
The original multi-exposure image set is processed. And performing shooting deviation correction by using a characteristic point matching and image registration algorithm. Alignment between images can be achieved by identifying feature points in the images and matching them to corresponding locations in other images. This eliminates the deviation caused by displacement or rotation at the time of photographing. Then, the images are aligned to generate an aligned multi-exposure image set.
The aligned multi-exposure image set is processed using a high dynamic range fusion technique. By combining the brightness information in the images at different exposure levels, the dynamic range of the image can be extended, so that details are more clearly visible. This results in a multi-exposure image sequence having a broader brightness range.
Referring to fig. 3, based on a multi-exposure image sequence, an image synthesis is performed by adopting a high dynamic range fusion algorithm of the Debevec and the Malik, and a global tone mapping method is used to optimize contrast, so that the HDR karst cave dome image is generated specifically by the following steps:
S201: based on the multi-exposure image sequence, adopting the Debeck and Marek HDR algorithms to expand the dynamic range of the image, and performing fusion processing to generate an intermediate HDR image;
s202: based on the intermediate HDR image, adopting a color space conversion algorithm to perform tone correction and performing color correction to generate a color corrected HDR image;
s203: based on the HDR image after color correction, adopting a local tone mapping algorithm to carry out detail enhancement and carrying out local contrast optimization to generate a locally enhanced HDR image;
s204: and (3) performing global contrast adjustment and brightness optimization by adopting a global tone mapping method based on the locally enhanced HDR image to generate an HDR karst cave dome image.
Based on the multi-exposure image sequence, the dynamic range of the image is expanded by adopting the Debeck and Marek HDR algorithm. By combining the brightness information in the images with different exposure levels, the dynamic range of the image can be expanded, so that details are more clearly visible. Next, fusion processing is performed to fuse the expanded luminance information together, generating an intermediate HDR image.
The intermediate HDR image is processed by a color space conversion algorithm. This step can convert the image from a linear color space to a non-linear color space to better represent the high dynamic range luminance information. Then, tone correction and color correction are performed to ensure color accuracy and consistency of the image. After these processes, a color corrected HDR image is generated.
And carrying out local tone mapping algorithm processing on the HDR image after color correction. This step allows for independent tone mapping of each region based on luminance information of the different regions in the image to enhance detail and optimize local contrast. This allows important details to be highlighted while maintaining overall image quality. After the local enhancement processing, a locally enhanced HDR image is generated.
The locally enhanced HDR image is processed using a global tone mapping method. This step allows the contrast to be adjusted over the entire image and the brightness to be optimized. By the global tone mapping method, the contrast of the image can be more balanced, and meanwhile, the definition of details is maintained. After these treatments, an HDR cave dome image is ultimately generated.
Referring to fig. 4, based on the HDR karst cave dome image, capturing light ray angle information by adopting a light field camera technology, and performing depth information processing by using a Fourier slice photography method, the steps of generating a light field data set are specifically as follows:
s301: based on an HDR karst cave dome image, adopting a light field camera shooting technology to capture the angles of light rays, and carrying out preliminary light field data collection to generate preliminary light field information;
S302: based on the preliminary light field information, adopting a ray tracing rendering algorithm to perform path calculation and refining light field data to generate refined light field data;
s303: based on the refined light field data, carrying out frequency domain analysis by adopting a Fourier transform algorithm, and extracting frequency information to generate a frequency analysis result;
s304: based on the frequency analysis result, a Fourier slice imaging technology is executed, depth information cutting is performed, and a light field data set is constructed to generate the light field data set.
Based on the HDR karst dome image, light angle capturing is performed using a light field camera shooting technique. By setting proper camera parameters and shooting angles, light information in different directions can be captured. After shooting is completed, preliminary light field data collection is carried out, and preliminary light field information is generated.
And processing the preliminary light field information by a ray tracing rendering algorithm. By simulating the propagation path of the light, the direction and intensity of the light corresponding to each pixel point can be calculated. And then, refining the light field data according to the calculation result to obtain more accurate ray information. After refinement processing, refined light field data are generated.
And carrying out frequency domain analysis of a Fourier transform algorithm on the refined light field data. By performing spectral conversion on the optical field data, information of different frequency components can be obtained. Then, the frequency information is extracted and further analyzed. These analysis results can be used for subsequent depth information cutting and light field dataset construction.
Based on the frequency analysis result, fourier slice imaging techniques are performed for depth information cutting. By converting the frequency information into spatial information, a depth value of each pixel point can be determined. These depth values are combined with corresponding ray information to construct a complete light field dataset.
Referring to fig. 5, based on the light field data set, the three-dimensional scanning is performed by adopting a structured light triangulation method and combining a laser time flight measurement technology, and the detail enhancement processing is performed, so that the steps for generating the three-dimensional model of the karst cave dome specifically include:
s401: based on the light field data set, adopting a phase difference algorithm to perform structured light coding, performing space point cloud acquisition, performing point cloud splicing, and generating a preliminary three-dimensional point cloud;
s402: based on the preliminary three-dimensional point cloud, performing distance measurement by adopting a direct time flight method, performing point cloud calibration, performing noise filtering, and generating a calibrated three-dimensional point cloud;
S403: based on the calibrated three-dimensional point cloud, performing gridding treatment by using a poisson reconstruction method, performing surface reconstruction, performing detail optimization, and generating a three-dimensional grid model;
s404: based on the three-dimensional grid model, adopting a multi-scale detail enhancement technology to perform model optimization, performing texture mapping, and performing coloring treatment to generate a three-dimensional model of the dome of the rock cavern.
Based on the light field dataset, structured light encoding is performed using a phase difference algorithm. By projecting structured light onto the dome of a rock cavity and recording the light field information reflected by it, the coordinates and intensity information of the spatial point can be obtained. And then, collecting the space point cloud, and splicing the point cloud data under different view angles according to the position and posture information of the camera to generate a preliminary three-dimensional point cloud.
And calibrating and noise filtering the preliminary three-dimensional point cloud. The direct time-of-flight method is used for distance measurement and the point cloud is calibrated according to known distance values to eliminate errors. Meanwhile, noise in the point cloud is removed by adopting a proper filtering algorithm, and the accuracy and quality of subsequent reconstruction are improved.
And carrying out gridding treatment and surface reconstruction on the calibrated three-dimensional point cloud. And converting the point cloud into a three-dimensional grid model by using a poisson reconstruction method so as to facilitate subsequent processing and visualization. In the gridding process, the size and shape of the grids can be adjusted according to the requirements so as to obtain a better reconstruction effect. Meanwhile, the grid model can be subjected to detail optimization so as to improve the smoothness and continuity of the model.
And carrying out detail enhancement processing on the generated three-dimensional grid model. The model is optimized using a multi-scale detail enhancement technique to highlight important detail portions. Meanwhile, texture mapping and coloring treatment can be performed, and real materials and illumination effects are added for the model, so that the model is more vivid and lively.
Referring to fig. 6, based on the HDR karst cave dome image, the material analysis is performed by adopting a spectral deconvolution technology and a characteristic spectral line analysis method, and the optical information is processed by an image fusion technology, so as to generate a multispectral analysis report specifically including:
s501: performing material spectrum decomposition by adopting least square method spectrum deconvolution based on the HDR karst dome image, performing spectrum data preliminary analysis, and performing wavelength screening to generate preliminary material spectrum data;
s502: based on the preliminary material spectrum data, performing characteristic spectral line analysis by adopting Gaussian model fitting, performing material identification, extracting the characteristic data, and generating a material spectrum characteristic analysis report;
s503: based on the material spectrum characteristic analysis report, processing multispectral data by adopting a weighted average image fusion method, enhancing a spectrum image, and adjusting a dynamic range to generate an enhanced multispectral image;
S504: based on the enhanced multispectral image, an information entropy image fusion method is adopted to perform image processing, color correction is performed, image quality optimization is performed, and a multispectral analysis report is generated.
Based on the HDR karst dome image, material spectrum decomposition is performed by using least square method spectrum deconvolution. By converting the HDR image into spectral data and performing spectral deconvolution, spectral components of different materials can be separated. And then, carrying out preliminary analysis on the spectral data, and screening the wavelengths according to the requirements to generate preliminary material spectral data.
Based on the preliminary material spectrum data, characteristic spectral line analysis is performed by using Gaussian model fitting. By fitting and analyzing the spectral data, the characteristic spectral line information of different materials can be extracted. And then, carrying out material identification according to the characteristic spectral line information, and extracting corresponding characteristic data. And finally, generating a material spectrum characteristic analysis report for describing the performance and difference of different materials on the spectrum.
The multispectral data is processed using a weighted average image fusion method based on the material spectral signature analysis report. By fusing the spectrum images of different wave bands, the contrast ratio and detail expression of the images can be improved. Meanwhile, the dynamic range can be adjusted so that the image is more balanced and natural. An enhanced multispectral image is ultimately generated.
Image processing is performed using an information entropy image fusion method based on the enhanced multispectral image. The importance degree of each image can be determined by calculating the information entropy value among different images, and corresponding fusion processing is carried out. At the same time, color correction and image quality optimization can also be performed to improve the readability and visualization of the report. And finally generating a multispectral analysis report.
Referring to fig. 7, based on a three-dimensional model of a cave dome and a multispectral analysis report, a three-dimensional rendering technology is adopted to simulate a light effect, multispectral data is fused to increase the authenticity of materials, and the steps for generating a comprehensive visual model of the cave dome are specifically as follows:
s601: based on a three-dimensional model of a karst cave dome, performing light and shadow simulation by adopting a ray tracing rendering technology, performing virtual illumination setting, performing visual effect preview, and generating a primary rendering model;
s602: based on the preliminary rendering model, performing material rendering by adopting a physical-based rendering method, performing material authenticity enhancement, and performing map detail adjustment to generate a material map rendering model;
s603: based on the material map rendering model, performing environment light simulation by adopting a global illumination algorithm, performing multi-light source setting, performing light and shadow balance adjustment, and generating an environment illumination adjustment model;
S604: based on the environment illumination adjustment model, a multispectral data fusion technology is adopted, multispectral information is combined with the three-dimensional model, and a comprehensive visual model of the karst cave dome is generated.
The step S604 specifically includes the following sub-steps:
s6041, obtaining the space coordinates of any space point in the three-dimensional grid model;
s6042, searching to obtain a texture pixel value corresponding to the current space point through a texture mapping function based on the space coordinates of the space point;
for texture mapping, specifically, the corresponding relation between the texture pixel (u, v) and the spatial coordinates (x, y, z) of any spatial point in the three-dimensional grid model is found, that is, the mapping function f is found, so that (u, v) =f (x, y, z).
S6043, searching a preset pixel light intensity mapping table according to the current texture pixel value to obtain the current light intensity corresponding to the current texture pixel value, and searching a preset light intensity wavelength mapping table according to the current light intensity to obtain the corresponding current wavelength;
in spectroscopy, pixels may be used to measure and represent the intensity distribution of a spectrum. In this case, each pixel may correspond to the light intensity of a specific wavelength. Spectroscopic analysis typically uses a spectrometer to scatter light into different wavelengths and an array of pixels (e.g., a CCD or CMOS sensor) to measure the light intensity at each wavelength.
S6044, carrying out band fusion on the current wavelength in the searched multispectral information and the space point of the corresponding space coordinate in the three-dimensional grid model to generate a comprehensive visual model of the karst cave dome.
Based on the three-dimensional model of the karst cave dome, the light and shadow simulation is performed by using a ray tracing rendering technology. By setting parameters such as the position, the intensity, the color and the like of the virtual light source, the real illumination effect can be simulated. And then, previewing the visual effect, and performing preliminary adjustment according to the requirement to generate a preliminary rendering model.
And based on the preliminary rendering model, rendering the material by adopting a physical-based rendering method. And according to the material characteristic information provided in the multispectral analysis report, applying corresponding material properties to different parts in the model, and carrying out detail adjustment of the texture mapping. Thus, the authenticity and detail performance of the material can be enhanced. And finally, generating a texture map rendering model.
And (3) based on the texture map rendering model, adopting a global illumination algorithm to simulate the ambient light. By arranging a plurality of light sources, the ambient light condition around the dome of the rock cave is simulated. Meanwhile, the balance adjustment of the light and shadow is carried out so as to ensure the overall coordination and naturalness of the illumination effect. And finally generating an environment illumination adjustment model.
And based on the environment illumination adjustment model, combining the multispectral information with the three-dimensional model by adopting a multispectral data fusion technology. According to the spectrum data of different wave bands provided in the multispectral analysis report, the spectrum data is applied to corresponding areas in the model, so that the authenticity and detail performance of the material are improved. Thus, the comprehensive visual model can be more real and vivid. And finally, generating a comprehensive visual model of the cave dome.
Referring to fig. 8, a light and image system of a cave dome is used for executing the light and image method of the cave dome, and the system comprises an image acquisition module, an HDR image generation module, a light field information acquisition module, a three-dimensional reconstruction module, a material spectrum analysis module and a light and image simulation rendering module.
The image acquisition module optimizes illumination distribution by adopting a histogram equalization algorithm based on illumination conditions in the rock cavern, performs automatic white balance adjustment, and performs sequence shooting and image capturing based on a multi-region photometry algorithm to generate an aligned multi-exposure image set;
the HDR image generation module expands the dynamic range of the image by adopting a Debeck and Marek HDR algorithm based on the aligned multi-exposure image set, corrects the tone by adopting a color space conversion algorithm, and enhances the detail by utilizing a local tone mapping algorithm to generate an HDR karst cave dome image;
The light field information capturing module captures light angles by adopting a light field camera shooting technology based on an HDR karst cave dome image, performs path calculation by adopting a ray tracing rendering algorithm, performs frequency domain analysis by adopting a Fourier transform algorithm, and generates a light field data set;
the three-dimensional reconstruction module performs structured light coding by adopting a phase difference algorithm based on the light field data set, performs space point cloud acquisition, performs point cloud splicing, performs distance measurement based on a direct time flight method, performs point cloud calibration, performs gridding treatment by using a poisson reconstruction method, performs surface reconstruction, and generates a three-dimensional model of a karst cave dome;
the material spectrum analysis module performs material spectrum decomposition by adopting least square method spectrum deconvolution based on the HDR karst dome image, performs spectrum data primary analysis, performs wavelength screening, performs characteristic spectral line analysis based on Gaussian model fitting, performs material identification, and generates a material spectrum characteristic analysis report;
the light shadow simulation rendering module is based on a three-dimensional model of the rock hole dome, performs light shadow simulation by adopting a ray tracing rendering technology, performs virtual illumination setting, performs material rendering by adopting a physical-based rendering method, performs material authenticity enhancement, combines multispectral information with the three-dimensional model on the basis of a multispectral data fusion technology, and generates a comprehensive visual model of the rock hole dome.
In the image acquisition module, a histogram equalization algorithm is adopted to optimize illumination distribution and perform automatic white balance adjustment, and sequence shooting and image capturing are performed based on a multi-region photometry algorithm to generate an aligned multi-exposure image set. The step can effectively improve the brightness and contrast of the image, so that the subsequent processing is more accurate.
The HDR image generation module expands the dynamic range of the image of the aligned multi-exposure image set by using the Debeck and Marek HDR algorithm, corrects the tone by using a color space conversion algorithm, and enhances the detail by using a local tone mapping algorithm to generate an HDR karst cave dome image. The method can effectively improve the detail expressive force and color reproducibility of the image, so that the shadow effect of the dome of the rock cavern is more real.
The light field information capturing module captures light angles by adopting a light field camera shooting technology based on an HDR karst cave dome image, performs path calculation by adopting a ray tracing rendering algorithm, performs frequency domain analysis by adopting a Fourier transform algorithm, and generates a light field data set. The method can provide more comprehensive and accurate light information, and provides a basis for subsequent three-dimensional reconstruction and material analysis.
The three-dimensional reconstruction module performs structured light coding by adopting a phase difference algorithm based on the light field data set, performs space point cloud acquisition and point cloud splicing, performs distance measurement and point cloud calibration based on a direct time flight method, performs gridding treatment and surface reconstruction by utilizing a poisson reconstruction method, and generates a three-dimensional model of the dome of the karst cave. The method can realize accurate geometric modeling of the dome of the rock cavity, and provides a basis for subsequent material analysis and light shadow simulation.
The material spectrum analysis module is used for carrying out material spectrum decomposition by adopting least square method spectrum deconvolution based on the HDR karst cave dome image, carrying out spectrum data primary analysis and wavelength screening, carrying out characteristic spectral line analysis and material identification based on Gaussian model fitting, and generating a material spectrum characteristic analysis report. The method can accurately identify and analyze the dome material of the rock tunnel, and provides a basis for subsequent light and shadow simulation.
The light shadow simulation rendering module is based on a three-dimensional model of the karst cave dome, performs light shadow simulation by adopting a ray tracing rendering technology, performs virtual illumination setting, performs material rendering by adopting a physical-based rendering method, performs material authenticity enhancement, combines multispectral information with the three-dimensional model by adopting a multispectral data fusion technology, and generates a comprehensive visual model of the karst cave dome. This step enables a realistic presentation and visual display of the hole dome.
Referring to fig. 9, the image acquisition module includes an illumination optimization sub-module, an exposure configuration sub-module, and an image capturing sub-module;
the HDR image generation module comprises a dynamic range expansion sub-module, a tone correction sub-module and a detail enhancer module;
the light field information capturing module comprises a light ray angle capturing sub-module, a light ray rendering sub-module and a frequency domain analyzing sub-module;
the three-dimensional reconstruction module comprises a structured light coding sub-module, a distance measurement sub-module and a surface reconstruction sub-module;
the material spectrum analysis module comprises a material spectrum decomposition sub-module, a characteristic spectral line analysis sub-module and a material identification sub-module;
the light shadow simulation rendering module comprises a light shadow simulation sub-module, a material rendering sub-module and a multispectral fusion sub-module.
In the image acquisition module, an illumination optimization submodule optimizes illumination distribution in a rock cavity by adopting a histogram equalization algorithm and performs automatic white balance adjustment. The exposure configuration submodule performs sequence shooting and image capturing based on a multi-region photometry algorithm, and generates an aligned multi-exposure image set.
In the HDR image generation module, a dynamic range expansion sub-module uses the Debeck and Marek HDR algorithm to expand the dynamic range of the image of the aligned multi-exposure image set. The tone correction sub-module performs tone correction on the HDR image using a color space conversion algorithm. The detail enhancement submodule utilizes a local tone mapping algorithm to carry out detail enhancement on the HDR image to generate an HDR karst cave dome image.
In the light field information capturing module, a light ray angle capturing sub-module captures light ray angles by adopting a light field camera shooting technology based on an HDR karst cave dome image. The ray rendering sub-module adopts a ray tracing rendering algorithm to perform path calculation. The frequency domain analysis submodule applies a Fourier transform algorithm to carry out frequency domain analysis on the light data to generate a light field data set.
In the three-dimensional reconstruction module, the structured light coding submodule carries out structured light coding by adopting a phase difference algorithm based on the light field data set and carries out space point cloud acquisition. The distance measurement submodule is used for measuring the distance based on a direct time flight method and calibrating the point cloud. And the surface reconstruction submodule performs gridding treatment and surface reconstruction by using a poisson reconstruction method to generate a three-dimensional model of the dome of the rock cavity.
In the material spectrum analysis module, a material spectrum decomposition submodule carries out material spectrum decomposition by adopting least square method spectrum deconvolution based on an HDR rock cave dome image, and carries out spectrum data preliminary analysis and wavelength screening. And the characteristic spectral line analysis submodule performs characteristic spectral line analysis based on Gaussian model fitting and performs material identification. And finally, generating a material spectrum characteristic analysis report.
In the light shadow simulation rendering module, the light shadow simulation submodule is based on a three-dimensional model of a rock hole dome, adopts a ray tracing rendering technology to perform light shadow simulation, and performs virtual illumination setting. The material rendering sub-module performs material rendering by applying a physical-based rendering method, and the authenticity of the material is enhanced. The multispectral fusion submodule combines multispectral information with the three-dimensional model based on multispectral data fusion technology to generate a comprehensive visual model of the dome of the karst cave.
The present invention is not limited to the above embodiments, and any equivalent embodiments which can be changed or modified by the technical disclosure described above can be applied to other fields, but any simple modification, equivalent changes and modification made to the above embodiments according to the technical matter of the present invention will still fall within the scope of the technical disclosure.

Claims (2)

1. A method of light imaging a cave dome, the method comprising the steps of:
based on the illumination condition in the rock tunnel, performing multiple exposure shooting by adopting a self-adaptive exposure control algorithm, and generating a multi-exposure image sequence by a high dynamic range synthesis technology;
Based on the multi-exposure image sequence, adopting a high dynamic range fusion algorithm of the development and the Malik to synthesize images, and using a global tone mapping method to optimize contrast to generate an HDR karst cave dome image;
capturing light angle information by adopting a light field camera technology based on the HDR karst dome image, and performing depth information processing by a Fourier slice photography method to generate a light field data set;
based on the light field data set, adopting a structured light triangulation method and a laser time flight measurement technology to perform three-dimensional scanning, and performing detail enhancement processing to generate a three-dimensional model of the karst cave dome;
based on the HDR karst cave dome image, performing material analysis by adopting a spectral deconvolution technology and a characteristic spectral line analysis method, and processing light information by an image fusion technology to generate a multispectral analysis report;
based on the three-dimensional model of the rock hole dome and the multispectral analysis report, adopting a three-dimensional rendering technology to simulate the light and shadow effect, and fusing multispectral data to increase the authenticity of materials, so as to generate a comprehensive visual model of the rock hole dome;
the multi-exposure image sequence comprises a multi-exposure-level cave image, the HDR cave dome image comprises color and brightness information in a wide dynamic range, the light field data set comprises light ray information under multiple view angles, and the three-dimensional model of the cave dome specifically refers to a digital representation reflecting the shape, the size and the surface texture of the cave dome;
Based on the illumination condition in the rock tunnel, the self-adaptive exposure control algorithm is adopted to carry out multi-exposure shooting, and the steps of generating a multi-exposure image sequence by a high dynamic range synthesis technology are specifically as follows:
optimizing illumination distribution by adopting a histogram equalization algorithm based on illumination conditions in the rock cavern, performing automatic white balance adjustment, performing exposure parameter evaluation, and generating exposure parameter configuration;
based on the exposure parameter configuration, adopting a multi-region photometry algorithm to perform sequence shooting and image capturing to generate an original multi-exposure image set;
based on the original multi-exposure image set, adopting a characteristic point matching and image registration algorithm to correct shooting deviation, and carrying out image alignment to generate an aligned multi-exposure image set;
based on the aligned multi-exposure image set, adopting a high dynamic range fusion technology to combine brightness information and expand the dynamic range to generate a multi-exposure image sequence;
based on the multi-exposure image sequence, adopting a high dynamic range fusion algorithm of the development and the Malik to synthesize images, and optimizing contrast by using a global tone mapping method, wherein the step of generating an HDR karst cave dome image comprises the following steps:
Based on the multi-exposure image sequence, adopting a Debeck and Marek HDR algorithm to expand the dynamic range of the image, and performing fusion processing to generate an intermediate HDR image;
based on the intermediate HDR image, adopting a color space conversion algorithm to perform tone correction and color correction to generate a color corrected HDR image;
based on the color corrected HDR image, adopting a local tone mapping algorithm to carry out detail enhancement and carrying out local contrast optimization to generate a locally enhanced HDR image;
based on the locally enhanced HDR image, global contrast adjustment is carried out by adopting a global tone mapping method, and brightness optimization is carried out, so that an HDR karst cave dome image is generated;
based on the HDR karst cave dome image, capturing light ray angle information by adopting a light field camera technology, and performing depth information processing by a Fourier slice photography method, wherein the step of generating a light field data set comprises the following steps:
based on the HDR karst cave dome image, adopting a light field camera shooting technology to capture light angles, and carrying out preliminary light field data collection to generate preliminary light field information;
based on the preliminary light field information, adopting a ray tracing rendering algorithm to perform path calculation and refining light field data to generate refined light field data;
Based on the refined light field data, carrying out frequency domain analysis by adopting a Fourier transform algorithm, and extracting frequency information to generate a frequency analysis result;
based on the frequency analysis result, performing a Fourier slice imaging technology, performing depth information cutting, constructing a light field data set and generating the light field data set;
based on the light field data set, adopting a structured light triangulation method and a laser time flight measurement technology to perform three-dimensional scanning, and performing detail enhancement processing, the method specifically comprises the following steps of:
based on the light field data set, adopting a phase difference algorithm to perform structured light coding, performing space point cloud acquisition, performing point cloud splicing, and generating a preliminary three-dimensional point cloud;
based on the preliminary three-dimensional point cloud, performing distance measurement by adopting a direct time flight method, performing point cloud calibration, performing noise filtering, and generating a calibrated three-dimensional point cloud;
based on the calibrated three-dimensional point cloud, performing gridding treatment by using a poisson reconstruction method, performing surface reconstruction, performing detail optimization, and generating a three-dimensional grid model;
based on the three-dimensional grid model, performing model optimization by adopting a multi-scale detail enhancement technology, performing texture mapping, and performing coloring treatment to generate a three-dimensional model of the dome of the karst cave;
Based on the HDR karst cave dome image, performing material analysis by adopting a spectral deconvolution technology and a characteristic spectral line analysis method, and processing light information by an image fusion technology, wherein the steps for generating a multispectral analysis report specifically comprise:
performing material spectrum decomposition by least square method spectrum deconvolution based on the HDR karst dome image, performing spectrum data preliminary analysis, and performing wavelength screening to generate preliminary material spectrum data;
based on the preliminary material spectrum data, performing characteristic spectral line analysis by adopting Gaussian model fitting, performing material identification, extracting the characteristic data, and generating a material spectrum characteristic analysis report;
based on the material spectrum characteristic analysis report, processing multispectral data by adopting a weighted average image fusion method, enhancing a spectrum image, and adjusting a dynamic range to generate an enhanced multispectral image;
based on the enhanced multispectral image, performing image processing by adopting an information entropy image fusion method, performing color correction, performing image quality optimization, and generating a multispectral analysis report;
based on the three-dimensional model and the multispectral analysis report of the rock hole dome, adopting a three-dimensional rendering technology to simulate the light and shadow effect, and fusing multispectral data to increase the authenticity of materials, the steps for generating the comprehensive visual model of the rock hole dome are specifically as follows:
Based on the three-dimensional model of the karst cave dome, performing light shadow simulation by adopting a ray tracing rendering technology, performing virtual illumination setting, performing visual effect preview, and generating a preliminary rendering model;
based on the preliminary rendering model, performing material rendering by adopting a physical rendering method, performing material authenticity enhancement, performing map detail adjustment, and generating a material map rendering model;
based on the material map rendering model, performing environment light simulation by adopting a global illumination algorithm, performing multi-light source setting, performing light and shadow balance adjustment, and generating an environment illumination adjustment model;
and based on the environment illumination adjustment model, adopting a multispectral data fusion technology, and combining multispectral information with the three-dimensional model to generate a comprehensive visual model of the dome of the karst cave.
2. A light shadow imaging system of a cave dome, which is characterized in that the system comprises an image acquisition module, an HDR image generation module, a light field information acquisition module, a three-dimensional reconstruction module, a material spectrum analysis module and a light shadow simulation rendering module by applying the light shadow imaging method of the cave dome of claim 1;
the image acquisition module optimizes illumination distribution by adopting a histogram equalization algorithm based on illumination conditions in the rock cavern, performs automatic white balance adjustment, performs sequence shooting and image capturing based on a multi-region photometry algorithm, and generates an aligned multi-exposure image set;
The HDR image generation module expands the dynamic range of the image by adopting a Debeck and Marek HDR algorithm based on the aligned multi-exposure image set, corrects the tone by adopting a color space conversion algorithm, and enhances the detail by utilizing a local tone mapping algorithm to generate an HDR karst cave dome image;
the light field information capturing module captures light angles by adopting a light field camera shooting technology based on an HDR karst cave dome image, performs path calculation by adopting a ray tracing rendering algorithm, performs frequency domain analysis by adopting a Fourier transform algorithm, and generates a light field data set;
the three-dimensional reconstruction module performs structured light coding by adopting a phase difference algorithm based on a light field data set, performs space point cloud acquisition, performs point cloud splicing, performs distance measurement based on a direct time flight method, performs point cloud calibration, performs gridding processing by using a poisson reconstruction method, performs surface reconstruction, and generates a three-dimensional model of a karst dome;
the material spectrum analysis module performs material spectrum decomposition by adopting least square method spectrum deconvolution based on an HDR karst cave dome image, performs spectrum data primary analysis, performs wavelength screening, performs characteristic spectral line analysis based on Gaussian model fitting, performs material identification, and generates a material spectrum characteristic analysis report;
The light and shadow simulation rendering module is based on a three-dimensional model of the rock hole dome, performs light and shadow simulation by adopting a ray tracing rendering technology, performs virtual illumination setting, performs material rendering by adopting a physical-based rendering method, performs material authenticity enhancement, combines multispectral information with the three-dimensional model on the basis of a multispectral data fusion technology, and generates a comprehensive visual model of the rock hole dome.
CN202311621353.9A 2023-11-30 2023-11-30 Light and shadow imaging method and system for karst cave dome Active CN117319807B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311621353.9A CN117319807B (en) 2023-11-30 2023-11-30 Light and shadow imaging method and system for karst cave dome

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311621353.9A CN117319807B (en) 2023-11-30 2023-11-30 Light and shadow imaging method and system for karst cave dome

Publications (2)

Publication Number Publication Date
CN117319807A CN117319807A (en) 2023-12-29
CN117319807B true CN117319807B (en) 2024-02-02

Family

ID=89285267

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311621353.9A Active CN117319807B (en) 2023-11-30 2023-11-30 Light and shadow imaging method and system for karst cave dome

Country Status (1)

Country Link
CN (1) CN117319807B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106530263A (en) * 2016-10-19 2017-03-22 天津大学 Single-exposure high-dynamic range image generation method adapted to medical image
CN107390880A (en) * 2017-09-15 2017-11-24 西安建筑科技大学 One kind is based on the contactless multi-angle input equipment of shadow and input method
CN113409186A (en) * 2021-06-30 2021-09-17 上海科技大学 Single picture re-polishing method, system, terminal and storage medium based on priori knowledge
CN115235369A (en) * 2022-03-14 2022-10-25 西安电子科技大学 Polarization three-dimensional imaging method, system and application of color target
CN115883755A (en) * 2022-12-09 2023-03-31 苏州航遥启程科技有限公司 Multi-exposure image fusion method under multi-type scene
CN116912138A (en) * 2023-06-15 2023-10-20 宁波大学 Dynamic multi-exposure light field image fusion method based on structure consistency detection

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8525900B2 (en) * 2009-04-23 2013-09-03 Csr Technology Inc. Multiple exposure high dynamic range image capture
EP3430795A1 (en) * 2016-03-14 2019-01-23 Koninklijke Philips N.V. Saturation processing specification for dynamic range mappings
US20230171509A1 (en) * 2020-05-11 2023-06-01 Qualcomm Incorporated Optimizing high dynamic range (hdr) image processing based on selected regions

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106530263A (en) * 2016-10-19 2017-03-22 天津大学 Single-exposure high-dynamic range image generation method adapted to medical image
CN107390880A (en) * 2017-09-15 2017-11-24 西安建筑科技大学 One kind is based on the contactless multi-angle input equipment of shadow and input method
CN113409186A (en) * 2021-06-30 2021-09-17 上海科技大学 Single picture re-polishing method, system, terminal and storage medium based on priori knowledge
CN115235369A (en) * 2022-03-14 2022-10-25 西安电子科技大学 Polarization three-dimensional imaging method, system and application of color target
CN115883755A (en) * 2022-12-09 2023-03-31 苏州航遥启程科技有限公司 Multi-exposure image fusion method under multi-type scene
CN116912138A (en) * 2023-06-15 2023-10-20 宁波大学 Dynamic multi-exposure light field image fusion method based on structure consistency detection

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
A Multi Exposure Synthetic HDR Image Algorithm based on Cascaded Network;Li Yu,et al.;《 2020 17th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)》;全文 *
石湾陶瓷艺术的数字化保护与虚拟展示技术的研究;陈伊妮.;《中国优秀硕士学位论文全文数据库(电子期刊)》;全文 *
高动态范围图像的生成算法研究;吴卓钊.;《中国优秀硕士学位论文全文数据库(电子期刊)》;全文 *

Also Published As

Publication number Publication date
CN117319807A (en) 2023-12-29

Similar Documents

Publication Publication Date Title
US11410320B2 (en) Image processing method, apparatus, and storage medium
Apollonio et al. A photogrammetry-based workflow for the accurate 3D construction and visualization of museums assets
US11210839B2 (en) Photometric image processing
CN102244757B (en) Color calibration method of large multi-projection screen based on projector-camera system
US11893701B2 (en) Method for simulating natural perception in virtual and augmented reality scenes
CN109314753A (en) Medial view is generated using light stream
US11526067B2 (en) Lighting assembly for producing realistic photo images
CN110148204A (en) For indicating the method and system of virtual objects in the view of true environment
AU2003298666A1 (en) Reality-based light environment for digital imaging in motion pictures
CN109118581A (en) Image processing method and device, electronic equipment, computer readable storage medium
CN110458964B (en) Real-time calculation method for dynamic illumination of real environment
JP2013127774A (en) Image processing device, image processing method, and program
KR20190005642A (en) Method for synthesizing virtual content for augmented reality and apparatus using the same
CN114998545A (en) Three-dimensional modeling shadow recognition system based on deep learning
Gajic et al. SIMULATION OF PHOTOGRAMMETRY-BASED 3D DATA ACQUISITION.
CN117319807B (en) Light and shadow imaging method and system for karst cave dome
KR101004350B1 (en) Fabricating method and apparatus for shaded relief map
JP2021068272A (en) Image processing system, image processing method and program
CN109446945A (en) Threedimensional model treating method and apparatus, electronic equipment, computer readable storage medium
Hanusch A new texture mapping algorithm for photorealistic reconstruction of 3D objects
JP6768431B2 (en) Image generator and program
Georgopoulos et al. A simpler method for large scale digital orthophoto production
US20180089889A1 (en) Dynamically creating and presenting a three-dimensional (3d) view of a scene by combining color, brightness, and intensity from multiple scan data sources
KR100682978B1 (en) System to extract optical characteristic maps from one's photographic face images and its method
Madden et al. Utilising E-on Vue and Unity 3D scenes to generate synthetic images and videos for visible signature analysis

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant