CN115100082A - High-precision color display system based on hyperspectral camera - Google Patents
High-precision color display system based on hyperspectral camera Download PDFInfo
- Publication number
- CN115100082A CN115100082A CN202211017204.7A CN202211017204A CN115100082A CN 115100082 A CN115100082 A CN 115100082A CN 202211017204 A CN202211017204 A CN 202211017204A CN 115100082 A CN115100082 A CN 115100082A
- Authority
- CN
- China
- Prior art keywords
- hyperspectral
- color
- subunit
- camera
- spectrum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001228 spectrum Methods 0.000 claims abstract description 82
- 238000000701 chemical imaging Methods 0.000 claims abstract description 49
- 238000010606 normalization Methods 0.000 claims abstract description 15
- 238000012545 processing Methods 0.000 claims abstract description 4
- 230000007613 environmental effect Effects 0.000 claims abstract description 3
- 238000003384 imaging method Methods 0.000 claims description 53
- 238000000605 extraction Methods 0.000 claims description 31
- 230000003595 spectral effect Effects 0.000 claims description 23
- 238000005286 illumination Methods 0.000 claims description 13
- 239000000284 extract Substances 0.000 claims description 7
- 230000003287 optical effect Effects 0.000 claims description 7
- 239000011159 matrix material Substances 0.000 claims description 6
- 238000012937 correction Methods 0.000 claims description 3
- 238000011161 development Methods 0.000 abstract description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 239000003086 colorant Substances 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 108010001267 Protein Subunits Proteins 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000003745 diagnosis Methods 0.000 description 4
- 239000003814 drug Substances 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000011248 coating agent Substances 0.000 description 2
- 238000000576 coating method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000002411 adverse Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 125000005842 heteroatom Chemical group 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/58—Extraction of image or video features relating to hyperspectral data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
Abstract
The invention discloses a high-precision color display system based on a hyperspectral camera, which comprises a hyperspectral imaging module, a calibration module, a program module for equipment control and true color image restoration; the hyperspectral imaging module is used for recording space and spectrum information of a scene and storing data; the calibration module is used for calibrating the environmental light source during the current collection and carrying out normalization processing on the spectrum information of the subsequent scene; and the program module for equipment control and true color image restoration is used for coordinating all modules to run according to logic, completing calibration, data acquisition and color reconstruction and outputting a three-dimensional spectrum cube and a true color image. The invention obtains the space and spectrum information of the scene at the same time, accurately calculates the tristimulus values under the CIE1931 XYZ chromaticity system according to the characteristic spectrum of the scene, overcomes the problem of color distortion when a common RGB camera records the scene, and further promotes the development of the related fields of color display.
Description
Technical Field
The invention relates to a high-precision color display system based on a hyperspectral camera, which is suitable for the fields of hyperspectral imaging technology, display technology and the like.
Background
The color is a psychological feeling generated after visible light acts on human eyes, and can be divided into a light source color, an object color and a fluorescent color according to a physical mechanism. For the characterization of colors, the commission internationale de l' eclairage (CIE) has specified, by numerous human eye experiments, a series of color spaces that accurately represent the reception of colors by the human eye independently of the device. At present, most of records of color scenes are recorded by using an RGB (red, green and blue) three-color digital camera, however, the RGB three-color digital camera only has three spectral channels and cannot acquire all spectral information of visible light wave bands, so that accurate colors cannot be obtained essentially, some similar colors cannot be distinguished, different color cameras use different RGB (red, green and blue) optical filters, built-in algorithms are different, the real colors of scenes shot by a common digital camera cannot avoid introducing chromatic aberration, and the adverse effect on the development of subsequent research work can be caused.
The hyperspectral imaging technology combines the advantages of the spectrum technology and the imaging technology, and can simultaneously obtain two-dimensional space information and one-dimensional spectrum information of an object to be measured. Therefore, the hyperspectral technology combined with the atlas can obtain richer information of objects, and is widely applied to the fields of aerospace, medicine, agriculture, food safety and the like. The hyperspectral imaging technology can be divided into a scanning type, a staring type and a snapshot type according to the working principle. The scanning hyperspectral imaging is generally based on a grating light splitting principle, can image a large field of view, and is high in spectral dimension precision, a general scanning hyperspectral face-to-face imaging system needs to spend a large amount of time for mechanical scanning, and the problems of the hyperspectral imaging system in the aspects of volume, mechanical stability and the like need to be considered; the staring type hyperspectral imaging system generally adopts a tunable filter, including a tunable filter, an acousto-optic tunable filter and the like, and obtains information of different spectral bands by changing the state of the filter, so that a spectral resolution and a time balance point need to be searched; the snapshot-type hyperspectral imaging system can image only by a single exposure, but the inherent contradiction between the spectral resolution and the spatial resolution is irreconcilable.
Disclosure of Invention
The invention aims to provide a high-precision color display system based on a hyperspectral camera, aiming at the problems of information loss when a traditional digital camera records a scene and color distortion generated during subsequent display.
In order to solve the technical problems, the invention adopts the technical scheme that:
a high-precision color display system based on a hyperspectral camera comprises a hyperspectral imaging module, a calibration module, a program module for equipment control and true color image restoration;
the hyperspectral imaging module is used for recording space and spectrum information of a scene and storing data;
the calibration module is used for calibrating the environmental light source during current acquisition and normalizing the spectral information of the subsequent scene;
and the program modules for controlling the equipment and restoring the true color image are used for coordinating all the modules to run according to logic, finishing calibration, data acquisition and color reconstruction and outputting a three-dimensional spectrum cube and the true color image.
And the lighting module is further arranged to uniformly illuminate the part to be imaged in a low-light environment.
The hyperspectral imaging module structurally comprises a monochromatic CMOS camera, a spectrum extraction unit and an imaging lens.
The spectrum extraction unit is a staring type hyperspectral imaging device based on a tunable filter or a hyperspectral imaging device utilizing a grating spread spectrum principle; the hyperspectral imaging device utilizing the principle of expanding the spectrum by the grating is a scanning hyperspectral area imaging device based on a moving part or a hyperspectral line imaging device independent of the moving part.
The imaging mode of the hyperspectral imaging module comprises a surface imaging mode and a line imaging mode.
The calibration module acquires spectral information of the light source by shooting a standard white board placed on an object plane.
The program module for controlling the equipment and restoring the true color image comprises an equipment control unit and a spectral imaging unit;
the equipment control unit comprises an equipment connection subunit, an image preview subunit, a parameter setting subunit and a data acquisition and storage subunit;
the spectral imaging unit comprises a light source calibration subunit, a three-dimensional spectral cube extraction subunit and a normalization and color restoration subunit.
The parameter setting subunit is used for setting a camera exposure parameter, a picture bit depth parameter, a picture saving format parameter, a tunable filter wavelength range parameter, a tunable filter wavelength interval parameter, a motion platform speed and a motion range of the motion platform; the data acquisition and storage subunit is used for changing the state of the tunable optical filter or the motion platform and storing the camera data.
The three-dimensional spectrum cube extraction subunit extracts a three-dimensional spectrum cube according to the existing hyperspectral image data;
and the normalization and color restoration subunit normalizes the three-dimensional spectrum cube and extracts the reflection spectrum of the scene.
The normalization and color heteroatom unit is used for selectively restoring tristimulus values of a CIE1931 XYZ standard chromaticity system of a scene under different light source illumination conditions, converting the tristimulus values into color coordinates of an sRGB or non-sRGB color space, and displaying a true color picture of the scene under the illumination conditions;
using colour stimulus functions
And an irradiation light source I (lambda) to irradiate
And the wavelength coordinates of I (λ) are set to be coincident, and the tristimulus values of the CIE1931 XYZ color system are obtained according to the following formula:
wherein λ is 1 、λ 2 Respectively, the lower limit and the upper limit of the wavelength, and the above integral formula is further discretized into:
after the XYZ tristimulus values are obtained, the values are stored, and chromaticity coordinates in the sRGB color space are further obtained for displaying on different devices; firstly, a linear value rgb in sRGB color space is obtained:
secondly, solving a nonlinear value RGB under the sRGB color space:
solving the numerical range of the chromaticity coordinate of the sRGB to be 0-1, storing the value into a matrix element corresponding to the pixel point, solving the chromaticity coordinate of the sRGB color space of all the pixels of the scene picture according to the steps, and restoring the color information of the scene for display;
aiming at a color space different from sRGB, firstly solving an M matrix to obtain a linear value of a corresponding color space, and comprising the following steps of:
obtaining the chromaticity space chromaticity coordinate (x) r ，y r ），（x g ，y g ) And (x) b ，y b ) And reference white point (X) b ，Y b ，Z w ）；
Secondly, using the formula:
after the linear value is obtained, gamma correction is carried out to obtain a nonlinear value.
The invention has the beneficial effects that:
compared with the prior art, the high-precision color display system based on the hyperspectral camera acquires data, obtains spectral information of an object, solves the problem of incomplete shooting, can perfectly solve the problem of chromatic aberration brought by a common RGB digital camera because each spectrum necessarily corresponds to a determined color, and can store image spectral data as a standard. In addition, the obtained tristimulus values under the CIE1931 XYZ standard chromaticity system are media for mutual conversion of various color spaces, and the shot scenes can be displayed on a display with any color gamut by using the parameters, so that the related research in the color field is greatly promoted.
Drawings
FIG. 1 is a schematic structural diagram of a high-precision color display system based on a hyperspectral camera.
Fig. 2 is a schematic structural diagram of a high-precision color display system based on a hyperspectral camera in a low-light working environment.
Fig. 3 is a schematic structural diagram of a hyperspectral imaging module of a hyperspectral camera-based high-precision color display system according to the invention.
FIG. 4 is an optical path diagram of a gaze-based hyperspectral imaging module based on a liquid crystal tunable filter according to the invention.
FIG. 5 is a schematic diagram of a hyperspectral imaging module utilizing the principle of grating spread spectrum according to the invention.
FIG. 6 is an optical path diagram of a hyperspectral imaging module of the invention using the principle of grating spread spectrum.
FIG. 7 is a functional block diagram of the program modules for device control and true color image restoration according to the present invention.
In the figure, the device comprises a monochrome CMOS camera 1, a spectrum extraction unit 2, an imaging lens 3, a calibration module 4, an illumination module 5, a liquid crystal tunable filter and conversion control subunit 6 thereof, an imaging subunit 7, an object plane 8, a focusing lens 9, a wedge prism 10, a grating 11, a collimating lens 12 and a slit 13.
Detailed Description
The invention is further illustrated with reference to the following figures and examples.
As shown in fig. 1, a high-precision color display system based on a hyperspectral camera includes a hyperspectral imaging module (a monochrome CMOS camera 1, a spectrum extraction unit 2, an imaging lens 3), a calibration module 4, a program module for device control and true color image restoration (not shown in fig. 1).
The hyperspectral imaging modules are used for recording space and spectrum information of a scene and storing data, and the hyperspectral imaging modules with different structures or imaging modes can be selected according to different working scenes; the calibration module 4 is used for calibrating the ambient light source during the secondary acquisition, and normalizing the spectral information of the subsequent scene.
And the program module for controlling the equipment and restoring the true color image is used for coordinating all modules to run according to logic, finishing calibration, data acquisition and color reconstruction and outputting a three-dimensional spectrum cube and the true color image.
The high-precision color display system based on the hyperspectral camera needs to introduce an illumination module (as shown in figure 2) in a low-light environment, uniformly illuminates parts needing imaging, and the illumination module is a coaxial illumination system and uniformly illuminates the parts needing imaging in the low-light environment so as to reduce the exposure time of the hyperspectral camera, thereby avoiding the problem of image jitter caused by overlong scene recording time.
The hyperspectral imaging module structurally comprises a monochromatic CMOS camera 1, a spectrum extraction unit 2 and an imaging lens 3, and the structures of different spectrum extraction units can be selected according to different working scenes.
The imaging mode of the hyperspectral imaging module comprises a surface imaging mode and a line imaging mode, and different imaging modes can be selected according to different working scenes.
The spectrum extraction unit 2 is a staring hyperspectral imaging device based on a tunable filter or a hyperspectral imaging device utilizing a grating spread spectrum principle; the hyperspectral imaging device based on the principle of expanding the spectrum by the grating is a scanning hyperspectral area imaging device based on a moving part or a hyperspectral line imaging device independent of the moving part. Compared with a scanning hyperspectral imaging device, the staring hyperspectral imaging device has higher speed, does not sacrifice spatial resolution, can relatively quickly acquire space and spectrum information of a scene, and can shorten the acquisition time to several seconds in a non-low light environment.
The staring type hyperspectral imaging device comprises a monochromatic CMOS camera, a liquid crystal tunable filter, a conversion control subunit, an imaging subunit and an imaging lens, wherein the imaging subunit comprises structures such as relay imaging and the like. The imaging subunit composed of structures such as relay imaging and the like images the image formed by the imaging lens onto a photosensitive chip of the CMOS through a tunable filter, the state of the tunable filter is changed, and monochrome images under the filters in different states are recorded by a monochrome camera; the scanning type hyperspectral surface imaging device utilizing the principle of expanding the spectrum by the grating has the advantage that higher-precision spectral information can be acquired, and the device comprises a motion platform, a monochromatic CMOS camera, a focusing lens, a PGP light splitting structure, a collimating lens, a slit, an imaging lens and the like. The motion stage typically effects scanning of the hyperspectral imaging apparatus by moving either the hyperspectral camera or the sample. The imaging lens images a target on the slit, the slit only penetrates through an image of one line area, then the slit is collimated into parallel light to be incident on the PGP structure, and the parallel light is split by the PGP structure and then focused by the focusing lens at different wavelengths or angles on different positions of the camera photosensitive chip; compared with a scanning type hyperspectral surface imaging device utilizing the grating spread spectrum principle, the hyperspectral line imaging device utilizing the grating spread spectrum principle has no moving part, so that only line imaging can be carried out, extremely high time resolution can be achieved under the condition of greatly sacrificing the spatial resolution, and the hyperspectral surface imaging device is only suitable for certain specific occasions.
The calibration module acquires spectral information of the light source by shooting a standard white board placed on an object plane, and calibration is performed firstly when scene data is collected each time so as to remove influences of factors such as a camera, an imaging lens and an environment on the scene spectral information.
The program module for controlling the equipment and restoring the true color image comprises an equipment control unit and a spectral imaging unit.
As shown in fig. 7, the device control unit includes a camera and tunable filter or a motion stage device connection subunit, an image preview subunit, a parameter setting subunit, and a data acquisition and storage subunit.
As shown in fig. 7, the spectral imaging unit includes a light source labeling subunit, a three-dimensional spectral cube extraction subunit, and a normalization and color restoration subunit.
The parameter setting subunit sets a camera exposure parameter, a picture bit depth parameter, a picture saving format parameter, a tunable filter wavelength range parameter, a tunable filter wavelength interval parameter, a motion platform speed and a motion range of the motion platform.
The data acquisition and storage subunit comprises a step of changing the state of the tunable optical filter or the motion platform and a step of storing camera data.
And the three-dimensional spectrum cube extraction subunit extracts a three-dimensional spectrum cube according to the existing hyperspectral image data.
The normalization and color restoration subunit firstly extracts a calibrated light source spectrum, normalizes the three-dimensional spectrum cube, and collects the three-dimensional spectrum cube data under the same exposure condition with a calibrated light source, so that the three-dimensional spectrum cube data can be directly divided by the three-dimensional spectrum cube data to obtain a reflectivity spectral line and extract a reflection spectrum R (lambda) of a scene.
And the normalization and color reatomization unit is used for selecting and restoring tristimulus values of a CIE1931 XYZ standard chromaticity system of the scene under different light source illumination conditions, converting the tristimulus values into color coordinates of color spaces such as sRGB (Red, Green, blue, Red, blue, Green, blue, green, blue, green, blue, green, blue, green, blue, green, blue, green, blue, green, blue, green, blue, green. Using colour stimulus functions
And an irradiation light source I (lambda) to irradiate
The wavelength coordinates of the light source and the wavelength coordinates of the light source I (λ) are set to be coincident with each other, and the CIE1931 XYZ chromaticity system can be obtained from the following equationTristimulus values of (a):
wherein λ 1 、λ 2 Respectively, the lower and upper wavelength limits. Since the data is discretized, the above integral equation can be further discretized as:
after the XYZ tristimulus values are obtained, the values are saved, and further chromaticity coordinates in the sRGB color space are obtained for display on different devices. Firstly, a linear value rgb in sRGB color space is obtained:
secondly, solving a nonlinear value RGB under the sRGB color space:
and solving the numerical range of the chromaticity coordinate of the sRGB to be 0-1, storing the value into a matrix element corresponding to the pixel point, solving the chromaticity coordinate of the sRGB color space of all the pixels of the scene picture according to the steps, and restoring the color information of the scene for display.
Aiming at the color space different from sRGB, an M matrix can be firstly obtained to obtain the linear value of the corresponding color space, and the steps are as follows:
obtaining the chromaticity space chromaticity coordinate (x) r ，y r ），（x g ，y g ) And (x) b ，y b ) And reference white point (X) b ，Y b ，Z w ）；
Secondly, using the formula:
after the linear value is obtained, gamma correction is carried out to obtain a nonlinear value.
The program operating logic (solid arrow in fig. 6) when the program module for controlling the device and restoring the true color image executes the calibration light source operation is as follows:
(1) the spectrum extraction unit is a staring type hyperspectral imaging device:
firstly, calling an equipment connecting subunit to connect a camera and a tunable optical filter;
invoking an image preview subunit to observe an image;
calling a parameter setting subunit, scanning the tunable filter, setting the exposure time of the camera, and not generating an overexposed image;
invoking a data acquisition and storage subunit and storing the hyperspectral data of the standard whiteboard;
and fifthly, calling a light source calibration subunit, and calculating and applying the light source spectrum calibrated at this time.
(2) The spectrum extraction unit is a hyperspectral surface imaging device utilizing a grating spread spectrum principle:
calling an equipment connecting subunit to connect a camera and a motion platform;
invoking an image preview subunit to observe an image;
calling a parameter setting subunit, setting the motion range and speed of the motion platform, and setting the exposure time of the camera without generating an overexposed image;
invoking a data acquisition and storage subunit, and storing the standard white board hyperspectral data;
and fifthly, calling a light source calibration sub-unit, and calculating and applying the light source spectrum calibrated at this time.
The spectrum extraction unit is a high spectral line imaging device utilizing the principle of expanding the spectrum by a grating
Calling an equipment connection subunit to connect with a camera;
invoking an image preview subunit to observe an image;
calling a parameter setting subunit to set the exposure time of the camera without generating an overexposed image;
invoking a data acquisition and storage subunit, and storing the standard white board hyperspectral data;
and fifthly, calling a light source calibration subunit, and calculating and applying the light source spectrum calibrated at this time.
The program working logic (dotted arrow in fig. 6) when the program module for controlling the device and restoring the true color image executes the work of acquiring scene data is as follows:
firstly, calling an image preview subunit to observe an image;
a data acquisition and storage subunit is called to store the scene hyperspectral data;
calling a three-dimensional spectrum cube extraction subunit, and generating a three-dimensional spectrum cube according to the existing image data;
and invoking a normalization and color restoration subunit to generate a final true color image.
Example 1
As shown in fig. 1, 2, 3, 4, the high-precision color display system based on the hyperspectral camera comprises a monochrome CMOS camera 1, a spectrum extraction unit 2, an imaging lens 3, a calibration module 4, an illumination module 5, program modules for device control and true color image restoration (program modules, not shown in fig. 1-4); the monochromatic COMS camera 1, the spectrum extraction unit 2 and the imaging lens 3 are sequentially connected. In the embodiment, the spectrum extraction unit 2 is composed of a liquid crystal tunable filter, a conversion control subunit 6 and an imaging subunit 7, wherein the imaging subunit 7 is a relay imaging structure; the calibration module 4 is a standard white board; the lighting module 5 is a coaxial lighting system, which is introduced only in low light environments.
The present embodiment changes the transmittance of the filter by modulating the voltage of the liquid crystal tunable filter.
In the embodiment, the high-precision color display system based on the hyperspectral camera utilizes the staring hyperspectral imaging device based on the liquid crystal tunable filter to acquire hyperspectral data of the face and the tongue coating (object surface 8) within seconds to obtain a chromatism-free image, and can be used for assisting diagnosis of diagnosis on a traditional Chinese medicine line and tongue diagnosis.
The implementation steps of this example are as follows:
firstly, connecting a liquid crystal tunable filter and a monochrome CMOS camera to a computer, opening a program module, and calling an equipment connecting subunit to connect equipment;
secondly, placing the standard white board on the object surface, firstly calling an image preview subunit to check whether an image exists, and moving the position of the standard white board to enable the image to be in the middle of the image and to be a clear image;
calling a parameter setting subunit, scanning the wave band of the liquid crystal tunable filter, adjusting the exposure value of the camera, ensuring that the picture without overexposure is obtained, and setting other camera parameters;
invoking a data acquisition and storage subunit and storing the hyperspectral data of the standard whiteboard;
calling a light source calibration sub-unit, and calculating light source spectrum information calibrated by a standard white board;
sixthly, moving away the standard white board, placing the face fixing device on the object plane, and calling an image preview subunit to ensure that the face or the tongue is in the middle of the picture and forms a clear image;
seventhly, calling a data acquisition and storage subunit to store the hyperspectral data of the face or the tongue coating, wherein the process lasts for several seconds, and the patient should be kept still in the process;
calling a three-dimensional spectrum cube extraction subunit, and processing picture data acquired by a hyperspectral camera;
ninthly, generating a true color image by using the normalization and color restoration sub-units;
the red (R) stores the three-dimensional spectrum cube and true color image data for on-line diagnosis of traditional Chinese medicine.
Example 2
As shown in fig. 1, 2, 5, 6, the high-precision color display system based on hyperspectral camera comprises a monochrome CMOS camera 1, a spectrum extraction unit 2, an imaging lens 3, a calibration module 4, an illumination module 5, a program module for device control and restoration of true color images (program module, not shown in fig. 1, 2, 5, 6), a motion stage and a checkerboard (not shown in fig. 1, 2, 5, 6); the monochromatic COMS camera 1, the spectrum extraction unit 2 and the imaging lens 3 are sequentially connected. The spectrum extraction unit 2 in the embodiment is composed of a focusing lens 9, a wedge prism 10, a grating 11, a collimating lens 12 and a slit 13; the calibration module 4 is a standard white board; the lighting module 5 is a coaxial lighting system, which is introduced only in low light environments.
The embodiment scans the space spectrum information of the whole specimen object plane by connecting and simultaneously operating the motion platform and the hyperspectral camera.
In the embodiment, the high-precision color display system based on the hyperspectral camera utilizes the scanning type hyperspectral imaging device based on the grating spread spectrum principle to perform high-precision map scanning and color recording on static specimens.
The implementation steps of this example are as follows:
firstly, connecting a motion platform and a monochromatic CMOS camera to a computer, opening a program module, and calling an equipment connecting subunit to connect equipment;
secondly, placing the checkerboard on the object plane, firstly calling an image preview subunit to check whether an image exists, and moving the position of the checkerboard to enable the image to be in the middle of the image and to be a clear image;
thirdly, changing the checkerboard grid into a standard white board, calling a parameter setting subunit, operating a motion table, adjusting the exposure value of the camera, ensuring that no overexposed picture is obtained, and setting other camera parameters;
invoking a data acquisition and storage subunit, and storing the hyperspectral data of the standard white board;
calling a light source calibration sub-unit, and calculating light source spectrum information calibrated by a standard white board;
sixthly, moving away the standard white board, placing the specimen on the object plane, and calling the image preview subunit to view the image;
seventhly, calling a data acquisition and storage subunit to store the sample data, wherein the process lasts for tens of seconds, and the object plane is ensured not to move in the process;
calling a three-dimensional spectrum cube extraction subunit to process picture data acquired by a hyperspectral camera;
ninthly, generating a true color image by using the normalization and color restoration sub-units;
the r holds the three-dimensional spectral cube and true color image data.
Example 3
As shown in fig. 1, 2, 5, 6, the high-precision color display system based on the hyperspectral camera includes a monochrome CMOS camera 1, a spectrum extraction unit 2, an imaging lens 3, a calibration module 4, an illumination module 5, a program module for device control and restoration of true color images (program module, not shown in fig. 1, 2, 5, 6) and a checkerboard (not shown in fig. 1, 2, 5, 6); the monochromatic COMS camera 1, the spectrum extraction unit 2 and the imaging lens 3 are sequentially connected. The spectrum extraction unit 2 in the embodiment is composed of a focusing lens 9, a wedge prism 10, a grating 11, a collimating lens 12 and a slit 13; the calibration module 4 is a standard white board; the lighting module 5 is a coaxial lighting system, which is introduced only in low light environments.
The embodiment records the line spectrum of the axial one-dimensional space of the test tube through the hyperspectral line imaging camera based on the grating spread spectrum principle, quickly performs high-precision spectrum scanning and color recording on the solution in the test tube, and can be used for the subsequent research on the aspects of liquid uniformity, component composition and the like.
The implementation steps of this example are as follows:
firstly, connecting a single-color CMOS camera to a computer, opening a program module, and calling an equipment connecting module to connect a subunit;
secondly, placing the checkerboard on the object plane, firstly calling an image preview subunit to check whether an image exists, and moving the position of the checkerboard to enable the image to have a clear image in the image;
thirdly, changing the checkerboard grid into a standard white board, calling a parameter setting subunit, operating a motion table, adjusting the exposure value of the camera, ensuring that no overexposed picture is obtained, and setting other camera parameters;
invoking a data acquisition and storage subunit and storing the hyperspectral data of the standard whiteboard;
calling a light source calibration sub-unit, and calculating light source spectrum information calibrated by a standard white board;
sixthly, moving away the standard white board, placing the test tube on the object plane, and calling the image preview subunit to view the image;
seventhly, calling a data acquisition and storage subunit to store data;
calling a three-dimensional spectrum cube extraction subunit, and processing picture data acquired by a hyperspectral camera;
ninthly, generating a true color image by using the normalization and color restoration sub-units;
the r holds the three-dimensional spectral cube and true color image data.
The above description is only an embodiment of the present invention, and any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A high accuracy color display system based on hyperspectral camera which characterized in that: the device comprises a hyperspectral imaging module, a calibration module, a program module for equipment control and true color image restoration;
the hyperspectral imaging module is used for recording space and spectrum information of a scene and storing data;
the calibration module is used for calibrating the environmental light source during the current collection and carrying out normalization processing on the spectral information of the subsequent scene;
and the program module for controlling the equipment and restoring the true color image is used for coordinating all modules to run according to logic, finishing calibration, data acquisition and color reconstruction and outputting a three-dimensional spectrum cube and the true color image.
2. The hyperspectral camera-based high-precision color display system according to claim 1, wherein: and an illumination module is further arranged to uniformly illuminate the part to be imaged in a low-light environment.
3. The hyperspectral camera-based high-precision color display system according to claim 1, wherein: the hyperspectral imaging module structurally comprises a monochromatic CMOS camera, a spectrum extraction unit and an imaging lens.
4. A high-precision color display system based on a hyperspectral camera according to claim 3 is characterized in that: the spectrum extraction unit is a staring type hyperspectral imaging device based on a tunable filter or a hyperspectral imaging device utilizing a grating spread spectrum principle; the hyperspectral imaging device utilizing the principle of expanding the spectrum by the grating is a scanning hyperspectral imaging device based on a moving part or a hyperspectral line imaging device independent of the moving part.
5. The hyperspectral camera-based high-precision color display system according to claim 1, wherein: the imaging mode of the hyperspectral imaging module comprises a surface imaging mode and a line imaging mode.
6. The hyperspectral camera-based high-precision color display system according to claim 1, wherein: the calibration module acquires spectral information of the light source by shooting a standard white board placed on an object surface.
7. The hyperspectral camera-based high-precision color display system according to claim 1, wherein: the program module for controlling the equipment and restoring the true color image comprises an equipment control unit and a spectral imaging unit;
the equipment control unit comprises an equipment connection subunit, an image preview subunit, a parameter setting subunit and a data acquisition and storage subunit;
the spectral imaging unit comprises a light source calibration subunit, a three-dimensional spectral cube extraction subunit and a normalization and color restoration subunit.
8. The hyperspectral camera-based high-precision color display system according to claim 7, wherein: the parameter setting subunit is used for setting a camera exposure parameter, a picture bit depth parameter, a picture storage format parameter, a tunable filter wavelength range parameter, a tunable filter wavelength interval parameter, a motion platform speed and a motion range of the motion platform; the data acquisition and storage subunit is used for changing the state of the tunable optical filter or the motion platform and storing the camera data.
9. The hyperspectral camera-based high-precision color display system according to claim 7, wherein: the three-dimensional spectrum cube extraction subunit extracts a three-dimensional spectrum cube according to the existing hyperspectral image data;
and the normalization and color restoration subunit normalizes the three-dimensional spectrum cube and extracts the reflection spectrum of the scene.
10. The hyperspectral camera-based high-precision color display system according to claim 7, wherein: the normalization and color reatomization unit is used for selecting and restoring tristimulus values of a CIE1931 XYZ standard chromaticity system of a scene under different light source illumination conditions, converting the tristimulus values into color coordinates of an sRGB or non-sRGB color space, and displaying a true color picture of the scene under the illumination conditions;
using colour stimulus functions
And an irradiation light source I (lambda) to irradiate
And the wavelength coordinates of I (λ) are set to be coincident, and the tristimulus values of the CIE1931 XYZ color system are obtained according to the following formula:
wherein λ is 1 、λ 2 Respectively, the lower limit and the upper limit of the wavelength, and the above integral formula is further discretized into:
after the XYZ tristimulus values are obtained, the values are stored, and chromaticity coordinates in the sRGB color space are further obtained for displaying on different devices; firstly, a linear value rgb in sRGB color space is obtained:
secondly, solving a nonlinear value RGB under the sRGB color space:
solving the numerical range of the chromaticity coordinate of the sRGB to be 0-1, storing the value in a matrix element corresponding to the pixel point, solving the chromaticity coordinate of the sRGB color space of all the pixels of the scene picture according to the steps, and restoring the color information of the scene for display;
aiming at a color space different from sRGB, firstly solving an M matrix to obtain a linear value of a corresponding color space, and comprising the following steps of:
obtaining the chromaticity space chromaticity coordinate (x) r ，y r ），（x g ，y g ) And (x) b ，y b ) And reference white point (X) b ，Y b ，Z w ）；
Secondly, using the formula:
after the linear value is obtained, gamma correction is carried out to obtain a nonlinear value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211017204.7A CN115100082A (en) | 2022-08-24 | 2022-08-24 | High-precision color display system based on hyperspectral camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211017204.7A CN115100082A (en) | 2022-08-24 | 2022-08-24 | High-precision color display system based on hyperspectral camera |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115100082A true CN115100082A (en) | 2022-09-23 |
Family
ID=83300603
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211017204.7A Pending CN115100082A (en) | 2022-08-24 | 2022-08-24 | High-precision color display system based on hyperspectral camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115100082A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115690388A (en) * | 2023-01-03 | 2023-02-03 | 优尼科(青岛)微电子有限公司 | Image data preprocessing method and device based on Fabry-Perot cavity spectral imaging |
| CN116718271A (en) * | 2023-08-07 | 2023-09-08 | 北京理工大学 | High-speed hyperspectral imaging system and method |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103411676A (en) * | 2013-01-21 | 2013-11-27 | 中国计量学院 | Color measurement instrument for measuring object color by use of linear variable filter |
| CN104168475A (en) * | 2014-08-15 | 2014-11-26 | 浙江大学 | Digital-camera-parameter-variable imaging type method for obtaining color tristimulus value |
| CN107197225A (en) * | 2017-06-13 | 2017-09-22 | 浙江大学 | Color digital camera white balance correcting based on chromatic adaptation model |
| CN107941337A (en) * | 2017-11-16 | 2018-04-20 | 北京理工大学 | Fast illuminated spectrum imaging method, device and optical spectrum imagers |
| CN110207824A (en) * | 2019-06-04 | 2019-09-06 | 浙江理工大学 | Textile color measurement system and method based on high spectrum image acquisition |
| CN112710395A (en) * | 2020-12-08 | 2021-04-27 | 浙江理工大学 | Microscopic hyperspectral imaging system and color measurement method for micron-level color measurement |
| CN113984732A (en) * | 2021-11-25 | 2022-01-28 | 台州安奇灵智能科技有限公司 | Staring molded line laser high spectral depth imaging system |
-
2022
- 2022-08-24 CN CN202211017204.7A patent/CN115100082A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103411676A (en) * | 2013-01-21 | 2013-11-27 | 中国计量学院 | Color measurement instrument for measuring object color by use of linear variable filter |
| CN104168475A (en) * | 2014-08-15 | 2014-11-26 | 浙江大学 | Digital-camera-parameter-variable imaging type method for obtaining color tristimulus value |
| CN107197225A (en) * | 2017-06-13 | 2017-09-22 | 浙江大学 | Color digital camera white balance correcting based on chromatic adaptation model |
| CN107941337A (en) * | 2017-11-16 | 2018-04-20 | 北京理工大学 | Fast illuminated spectrum imaging method, device and optical spectrum imagers |
| CN110207824A (en) * | 2019-06-04 | 2019-09-06 | 浙江理工大学 | Textile color measurement system and method based on high spectrum image acquisition |
| CN112710395A (en) * | 2020-12-08 | 2021-04-27 | 浙江理工大学 | Microscopic hyperspectral imaging system and color measurement method for micron-level color measurement |
| CN113984732A (en) * | 2021-11-25 | 2022-01-28 | 台州安奇灵智能科技有限公司 | Staring molded line laser high spectral depth imaging system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115690388A (en) * | 2023-01-03 | 2023-02-03 | 优尼科(青岛)微电子有限公司 | Image data preprocessing method and device based on Fabry-Perot cavity spectral imaging |
| CN115690388B (en) * | 2023-01-03 | 2023-03-10 | 优尼科(青岛)微电子有限公司 | Image data preprocessing method and device based on Fabry-Perot cavity spectral imaging |
| CN116718271A (en) * | 2023-08-07 | 2023-09-08 | 北京理工大学 | High-speed hyperspectral imaging system and method |
| CN116718271B (en) * | 2023-08-07 | 2023-11-14 | 北京理工大学 | High-speed hyperspectral imaging system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115100082A (en) | High-precision color display system based on hyperspectral camera | |
| KR102394823B1 (en) | Hybrid Spectral Imager | |
| CN111256826B (en) | Display screen chrominance measuring method and device and terminal equipment | |
| Ohsawa et al. | Six band HDTV camera system for spectrum-based color reproduction | |
| CN104168475B (en) | A kind of imaging type of digital camera changeable parameters obtains the method for color tristimulus values | |
| US7884980B2 (en) | System for capturing graphical images using hyperspectral illumination | |
| US20060221209A1 (en) | Apparatus and method for acquiring and combining images of a scene with multiple optical characteristics at multiple resolutions | |
| WO2017121058A1 (en) | All-optical information acquisition system | |
| US8976239B2 (en) | System and apparatus for color correction in transmission-microscope slides | |
| JPH1196333A (en) | Color image processor | |
| US7616314B2 (en) | Methods and apparatuses for determining a color calibration for different spectral light inputs in an imaging apparatus measurement | |
| CN109459136A (en) | A kind of method and apparatus of colour measurement | |
| US8169475B2 (en) | Image processing system, imaging system, and microscope imaging system | |
| Zhang et al. | Color matching criteria in augmented reality | |
| CN107941337A (en) | Fast illuminated spectrum imaging method, device and optical spectrum imagers | |
| CN115638962A (en) | Optical performance measurement method of near-to-eye display equipment based on binocular camera | |
| JP4174707B2 (en) | Spectroscopic measurement system, color reproduction system | |
| RU2684749C1 (en) | Method of compound digital images of various spectral ranges | |
| CN105744267B (en) | Acquisition tristimulus values method based on quantic digital camera changeable parameters | |
| Kretkowski et al. | Development of an XYZ digital camera with embedded color calibration system for accurate color acquisition | |
| JP2010190741A (en) | Measuring device, measuring method, and imaging device | |
| JP2007147507A (en) | Spectrometry and optical spectrometer | |
| Zhbanova | Design and investigation of a digital photocolorimeter | |
| Gebejes et al. | Color and image characterization of a three CCD seven band spectral camera | |
| CN110726536A (en) | Color correction method for color digital reflection microscope |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220923 |