CN116546173A - Method, device, equipment and computer storage medium for self-correcting projection parameters - Google Patents
Method, device, equipment and computer storage medium for self-correcting projection parameters Download PDFInfo
- Publication number
- CN116546173A CN116546173A CN202310469420.3A CN202310469420A CN116546173A CN 116546173 A CN116546173 A CN 116546173A CN 202310469420 A CN202310469420 A CN 202310469420A CN 116546173 A CN116546173 A CN 116546173A
- Authority
- CN
- China
- Prior art keywords
- projection
- image
- verification
- color data
- parameters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000003860 storage Methods 0.000 title claims abstract description 16
- 238000012795 verification Methods 0.000 claims abstract description 118
- 238000012937 correction Methods 0.000 claims abstract description 94
- 238000012360 testing method Methods 0.000 claims abstract description 93
- 238000004590 computer program Methods 0.000 claims description 18
- 238000001514 detection method Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 description 20
- 238000002310 reflectometry Methods 0.000 description 12
- 238000005192 partition Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 239000003086 colorant Substances 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000003702 image correction Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000005670 electromagnetic radiation Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 239000004135 Bone phosphate Substances 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 210000003764 chromatophore Anatomy 0.000 description 1
- 230000004456 color vision Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000003631 expected effect Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000001795 light effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000001328 optic nerve Anatomy 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- LENZDBCJOHFCAS-UHFFFAOYSA-N tris Chemical compound OCC(N)(CO)CO LENZDBCJOHFCAS-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut
Abstract
The application provides a method, a device, equipment and a computer storage medium for self-correcting projection parameters, and relates to the technical field of projection. The method comprises the following steps: the method comprises the steps of determining a test image according to a correction instruction, outputting projection parameters corresponding to the test image to a projection module to control the projection module to emit light beams to a projection surface, controlling an image sensor to collect light beams reflected by the projection surface to obtain a verification image, calculating error coefficients of the projection surface according to the test image and the verification image, and correcting the output projection parameters according to the error coefficients. According to the projection parameter automatic correction method and device, automatic correction of the projection parameters is achieved according to the practical application environment of the projection equipment, and the efficiency of the projection parameter automatic correction is improved. Under the condition that the correction instruction is detected, the output projection parameters are automatically adjusted according to the correction instruction, the operation is simple, and the use experience of the projection equipment can be improved.
Description
Technical Field
The application belongs to the technical field of projection, and particularly relates to a method, a device, equipment and a computer storage medium for self-correcting projection parameters.
Background
The projection device is a device for projecting pictures and videos onto a curtain or a wall, and is widely applied to multiple scenes such as media presentation and home theater. Among the performance indexes of the projection device, the color level of the projection image is an extremely important index for measuring the difference between the display color and the actual color, and the quality of the display effect is determined to a certain extent. In the actual use process, as the service time of the projection device increases, the color of the projection image is changed due to the change of the light source of the projection device, and in addition, the type, reflectivity and ambient light of the projection surface all affect the color observed by a viewer, so that the color correction needs to be performed on the projection image of the projection device in order to ensure the color accuracy.
However, the existing image correction technology often needs to manually correct the projection color according to the change of the above influencing factors, and is complex in operation. The related method for automatically correcting the color of the projection image can be adjusted only aiming at a single influencing factor, and when the influencing factors are more, the color correction precision is low and the projected image color state is poor easily.
Disclosure of Invention
The embodiment of the application provides a method, a device, equipment and a computer storage medium for self-correcting projection parameters, which can solve the problem of low correction precision in the existing image correction technology.
In a first aspect, an embodiment of the present application provides a method for self-correcting a projection parameter, including: acquiring a correction instruction, and determining a test image according to the correction instruction; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks; outputting projection parameters corresponding to the test image to the projection module to control the projection module to emit light beams to the projection surface; controlling an image sensor to acquire a light beam reflected by a projection surface to obtain a verification image; calculating an error coefficient of the projection surface according to the test image and the verification image; and correcting the output projection parameters according to the error coefficients.
Compared with the prior art, the embodiment of the application has the beneficial effects that:
according to the embodiment, the test image is determined according to the correction instruction, the projection parameters corresponding to the test image are output to the projection module, so that the projection module is controlled to emit light beams to the projection surface, the image sensor is controlled to collect light beams reflected by the projection surface, the verification image is obtained, the error coefficient of the projection surface is calculated according to the test image and the verification image, the output projection parameters are corrected according to the error coefficient, automatic correction of the projection parameters according to the actual application environment of the projection equipment is achieved, the self-correction efficiency of the projection parameters is improved, under the condition that the correction instruction is detected, the output color projection parameters are automatically adjusted according to the correction instruction, the operation is simple, and the use experience of the projection equipment can be improved.
In a second aspect, an embodiment of the present application provides a device for self-correcting a projection parameter, including: the first determining module is used for acquiring the correction instruction and determining a test image according to the correction instruction; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks; the projection module is used for outputting projection parameters corresponding to the test image to the projection module so as to control the projection module to emit light beams to the projection surface; the first processing module is used for controlling the image sensor to acquire the light beam reflected by the projection surface to obtain a verification image; the second determining module is used for calculating an error coefficient of the projection surface according to the test image and the check image; and the second processing module is used for correcting the output projection parameters according to the error coefficient.
In a third aspect, embodiments of the present application provide a projection apparatus for self-correcting projection parameters, including: the processor is used for acquiring the correction instruction, determining a test image according to the correction instruction and outputting projection parameters corresponding to the test image; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks; the projection module is used for acquiring projection parameters and emitting light beams to the projection surface according to the projection parameters; the image sensor is used for collecting the light beam reflected by the projection surface to obtain a verification image; and the processor is also used for acquiring the check image, calculating an error coefficient of the projection surface according to the test image and the check image, and correcting the output projection parameters according to the error coefficient.
In a fourth aspect, embodiments of the present application provide a computer readable storage medium storing a computer program, which when executed by a processor, implements a method for self-correcting projection parameters as in any of the first aspects.
In a fifth aspect, embodiments of the present application provide a computer program product, which when run on a terminal device, causes the terminal device to perform the method of projection parameter self-correction of any one of the above aspects.
It will be appreciated that the advantages of the second to fifth aspects may be found in the relevant description of the first aspect, and are not described here again.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following description will briefly introduce the drawings that are needed in the embodiments or the description of the prior art, it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic structural diagram of a projection apparatus according to an embodiment of the present application.
FIG. 2 is a flow chart of a method for self-correction of projection parameters according to an embodiment of the present application;
FIG. 3a is a schematic diagram of a check image for single color block global correction provided by an embodiment of the present application;
FIG. 3b is a schematic diagram of a verification image for single color block local correction provided by an embodiment of the present application;
FIG. 3c is a schematic diagram of a multi-color block globally corrected verification image provided in an embodiment of the present application;
FIG. 3d is a schematic diagram of a multi-color block partial correction verification image provided in an embodiment of the present application;
fig. 4 is a schematic structural diagram of a device for self-correcting projection parameters according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It should be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
As used in this specification and the appended claims, the term "if" may be interpreted as "when..once" or "in response to a determination" or "in response to detection" depending on the context. Similarly, the phrase "if a determination" or "if a [ described condition or event ] is detected" may be interpreted in the context of meaning "upon determination" or "in response to determination" or "upon detection of a [ described condition or event ]" or "in response to detection of a [ described condition or event ]".
In addition, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
The method for self-correcting the projection parameters can be applied to terminal equipment such as projection equipment and the like, wherein the projection equipment comprises an image sensor. The embodiment of the application does not limit the specific type of the terminal equipment.
Color is produced by the presence of the visible band (380-780 nm wavelength) of electromagnetic radiation, which acts on the retina of the human eye in which the chromatophore cells are stimulated by light, which is converted by the optic nerve into color perception. The color of the object is generated by the fact that the object itself emits light or by the fact that electromagnetic radiation from the observed object is received by the human eye through reflection, transmission and diffuse reflection.
The color observed by human eyes is reflected by the projection surface to act on human eyes by projecting an image onto the projection surface by the projection device. Therefore, the color deviation sources of the projection display mainly comprise the following parts: firstly, the projection optical characteristics of projection equipment are that different projection equipment has different color reproduction mechanisms, and aiming at the same output requirement, different optical mechanisms and light splitting devices are applied to generate light rays with different spectral bands, so that color differences are brought. Even with the same projection device, the light source output energy of the projection device appears to decay over time, thereby causing color differences. In addition, the color deviation source further includes optical interference of the reflective surface and the external environment of projection, the intensity of the reflected light is related to the reflectivity of the reflective surface, meanwhile, the external environment light can be mixed with the projected light to generate color so that the primary colors generate color difference, even white natural light can raise the brightness of the projection, and darker color can be lost, which can cause compression of the color gamut range and adverse effect on the projected display color. Finally, the color difference of the projection display is also related to physiological and psychological factors of the observer, and as the service object of the projection display is always the visual system of the observer, the quality of the display is judged by the visual experience of the observer, and the final display effect is influenced by the subjective feeling of the observer. Therefore, in order to objectively measure the quality of the projected color display effect, the correction of the color projection parameters output by the projection device according to the present embodiment is performed in the CIE color space.
The present application is described in further detail below with reference to the attached drawings and specific examples.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a projection apparatus with self-correction of projection parameters according to the present embodiment. As shown in fig. 1, the projection device 1 of this embodiment includes an image sensor 10, a processor 11, a projection module 12, and a computer program 14 stored in a memory 13 that is executable on the processor 11. The processor 11 obtains the correction instruction when executing the computer program 14, determines a test image according to the correction instruction, outputs projection parameters corresponding to the test image, and sends the projection parameters to the projection module 12; controlling the image sensor 10 to collect the light beam reflected by the projection surface; the system is also used for acquiring a verification image, calculating an error coefficient of a projection surface according to the test image and the verification image, correcting the output projection parameter according to the error coefficient, and transmitting the corrected output projection parameter to the projection module 12; a projection module 12, configured to obtain projection parameters, and emit a light beam to a projection surface according to the projection parameters; the image sensor 10 is used for collecting the light beam reflected by the projection surface to obtain a verification image.
By way of example, the computer program 14 may be divided into one or more modules/units, which are stored in the memory 13 and executed by the processor 11 to complete the present application. One or more of the modules/units may be a series of computer program instruction segments capable of performing a specific function for describing the execution of the computer program 14 in the projection device 1.
In one embodiment, the image sensor 10 is a multispectral image sensor. The multispectral sensor has the characteristic that the multispectral sensor can sense colors more accurately under the multichannel, and the multispectral sensor arranged on the projection equipment is used for collecting the light beams reflected by the projection surface so as to calculate error coefficients more accurately, thereby completing the self-adaptive projection parameter correction.
Specifically, a nine-channel multispectral image sensor is preferred, each channel acquires optical signals of corresponding wave bands, and the optical signals of 9 different wave bands can be acquired by each pixel of the multispectral image sensor, so that more accurate color characteristics can be acquired finally.
Projection devices may include, but are not limited to, an image sensor 10, a processor 11, a projection module 12. It will be appreciated by those skilled in the art that fig. 1 is merely an example of a projection device 1 and is not intended to limit the projection device 1, and may include more or fewer components than shown, or may combine certain components, or different components, e.g., the projection device may further include an input-output device, a network access device, a bus, etc.
The processor 11 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The projection device may further comprise a memory 13, which memory 13 may be an internal storage unit of the projection device 1, such as a hard disk or a memory of the projection device 1. The memory 13 may also be an external storage device of the projection device 1, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital Card (SD), a Flash memory Card (Flash Card) or the like, which are provided on the projection device 1. The projection device 1 may also comprise both an internal storage unit and an external storage device of the projection device 1. The memory 13 is used to store a computer program and other programs and data required for the target device. The memory 13 may also be used to temporarily store data that has been output or is to be output.
It should be noted that, because the content of information interaction and execution process between the above devices/units is based on the same concept as the method embodiment of the present application, specific functions and technical effects thereof may be referred to in the method embodiment section, and will not be described herein again.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for self-correcting projection parameters according to the present embodiment. The method for self-correcting projection parameters in this embodiment is applied to the projection device shown in fig. 1.
As shown in fig. 2, the method for self-correcting projection parameters includes:
s101: acquiring a correction instruction, and determining a test image according to the correction instruction; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks.
Specifically, when the projection device receives the correction instruction, the projection device analyzes the correction instruction to determine a corresponding test image. The correction instruction is sent by other devices in communication with the projection device, or is a color correction instruction triggered and generated by a user pressing an external key, touching a screen or dragging a screen of the projection device, or is an image correction program started and based on a corresponding test image determined by an actual application environment when the projection device detects that the color output effect of image projection is inaccurate through an application environment autonomous detection function, and the embodiment does not limit the specific mode of triggering the correction instruction. The test image is indicated by a correction instruction, and an image which is projected to a projection surface by the projection device and used for correcting projection parameters is required.
S102: outputting projection parameters corresponding to the test image to the projection module to control the projection module to emit light beams to the projection surface.
Specifically, the projection parameters corresponding to the test image are values of three primary colors corresponding to RGB three-channel values of the test image preset in the projection device under the ideal projection condition. And transmitting a light beam to a projection surface through the projection module according to the projection parameters to complete initial projection of the test image. In the practical case of projection, the ambient light effect of the projection surface and the reflectivity effect of the projection surface tend to be non-uniform; for example, the projection surface is greatly influenced by ambient light due to the influence of the indoor illumination lamp, the projection surface is less influenced by ambient light due to the lower part of the projection surface, the influence of ambient light is not uniform in the whole projection surface, and the reflectivity of the projection surface may not be uniform. These conditions may cause the test image to be projected on the projection surface, failing to exhibit the desired projection effect.
Specifically, the test image includes black, red, blue or green monochromatic image blocks, or a multicolor image group formed by any combination of black, red, blue and green image blocks. Different test images can achieve different image correction effects.
S103: and controlling the image sensor to collect the light beam reflected by the projection surface to obtain a verification image.
Specifically, the projection device emits a light beam on the projection surface based on the projection parameters, and when the projection of the test image is completed, the condition that the projection effect is affected by the interference of ambient light or the non-uniform reflectivity of the projection surface may exist, and the light beam reflected by the projection surface needs to be collected by an image sensor in the projection device to obtain a verification image corresponding to the test image.
S104: and calculating an error coefficient of the projection surface according to the test image and the verification image.
Specifically, the projection parameters of the test image are tri-base values corresponding to red (R), green (G), and blue (B) tri-channel values of the target image identified by the projection device. Since the projection effect of the projection device is affected by factors such as ambient light and reflectivity of a projection surface during projection, it is necessary to correct color output parameters output during projection of the projection device based on an application environment. According to the parameter difference between the test image and the verification image, as an error coefficient of a projection plane, the projection parameter output by the projection device is adjusted based on the error coefficient, so that the image projected by the projection device based on the adjusted projection parameter reaches an expected state (namely, the image observed by a user through human eyes can reach an expected color output effect which is infinitely close to three channel values of red (R), green (G) and blue (B) of the projected image).
S105: and correcting the output projection parameters according to the error coefficients.
Specifically, the error coefficient of the projection equipment corrects the projection parameters to be output, and the projection module is used for projecting the projection parameters in the projection plane, so that the corrected projection result reaches the expected effect, the self-correction operation of the projection parameters is realized, and the optimization of the projection effect of the projection equipment is completed.
In one embodiment, calculating the error coefficient of the projection surface from the test image and the verification image includes: matching corresponding standard color data according to the test image; calculating the color data of the verification image to obtain verification color data; and calculating an error coefficient according to the standard color data and the verification color data.
The standard color data matched with the test image is data information prestored in the projection device. Standard color data can be obtained by: under ideal projection conditions (darkroom), the projection module is controlled to project a test image onto a projection surface (preferably a white standard curtain on the projection surface under ideal projection conditions), the image sensor records the distribution of color values of a detection area projected on the projection surface, and the recorded color values are prestored in a projection device (such as a memory of the projection device) as standard color data.
Correspondingly, the projection parameters of the test image are the tri-basic color values corresponding to the RGB tri-channel values of all the image blocks in the test image. The projection surface is an area for projecting the test image. It can be understood that the corresponding projection surface sizes are different according to the sizes of the test images. For example, the projection surface is a standard curtain (i.e., a white curtain), or a non-standard curtain (e.g., a beige curtain), or the projection surface is a wall specified by the user, or the like. The difference in projection planes will result in a color deviation in the perception of the human eye of the final imaging of the test image.
The storage form of the standard color data can also be different according to the difference of the test images. For example, the test image is a single-color image block, and the corresponding standard color data will be the color average value of the single-color image block projected on the projection surface under the ideal projection condition: x=x0, y=y0, z=z0, X represents a red equivalent, Y represents a green equivalent, and Z represents a blue equivalent. When the test image is a multi-color image group, it will distinguish which image blocks are included in the multi-color image group, and respectively confirm the average value of the colors of the black, red, blue and green image blocks projected on the projection surface under ideal conditions, and see table 1.
Table 1 standard color data corresponding to different image blocks
In one embodiment, the output projection parameters are corrected based on the error coefficients. Specifically, standard color data corresponding to the test image (i.e., image data obtained when the image sensor collects the reflected light beam from the projection surface under ideal projection conditions) is matched by a standard color chart. And calculating and determining the color data of the check image acquired by the image sensor to obtain check color data, and obtaining an error coefficient of the projection parameter by the difference value between the standard color data of the test image acquired by the image sensor under ideal conditions and the check data acquired by the image sensor under the current environment.
In one embodiment, calculating color data of the verification image to obtain verification color data includes: dividing the check image into areas to obtain a plurality of check sub-images; calculating color data of the verification sub-images to obtain sub-verification color data; and obtaining the verification color data according to the sub-verification color data of each region.
Specifically, in general, the influence of ambient light of the projection surface and the influence of reflectivity of the projection surface are uneven; for example, the effect of the indoor illumination lamp is affected, the effect of the ambient light on the upper part of the projection surface is large, the effect of the ambient light on the lower part of the projection surface is small, the effect of the ambient light on the whole projection surface is not uniform, the reflectivity of the projection surface is not uniform, at this time, the effect of the ambient light on the projection surface and the reflectivity of the projection surface are not uniform, pixel-by-pixel correction is required to be performed on the projection surface, namely, the verification image is divided into a plurality of verification sub-images, the color data of the verification sub-images of each region are calculated for each partitioned region, sub-verification color data are obtained, and the verification color data are obtained according to the sub-verification color data of each region.
By way of example and not limitation, after the region division, the minimum value of the verification sub-image may be at a pixel level, thereby implementing pixel level correction of the projection image by the projection device, that is, enabling the image observed by the user through the human eye to achieve the expected color output effect.
In one embodiment, the error coefficient is calculated according to standard color data and verification color data, and the error coefficient comprises: and calculating the difference value between the standard color data and the verification color data as an error coefficient.
Specifically, factors influencing the color output of the projection device mainly include ambient light and the reflectivity of the projection surface, and by collecting the light beams reflected in the projection surface, a calibration image is obtained to monitor the color state of the test image after the projection of the projection device, and a correction coefficient is determined based on the difference between the standard color data of the test image and the calibration color data calibration image, so that all influences caused by the ambient light and the reflectivity of the projection surface in the projection process of the projection device can be overcome. Accordingly, it is set that the target projection parameter is corrected by calculating the difference between the standard color data and the verification color data as an error coefficient.
It will be appreciated that the correction instructions may include, but are not limited to: single color block global correction, single color block local correction, multi-color block global correction, and multi-color block local correction.
(1) Monochromatic block global correction
In this embodiment, the method for self-correcting projection parameters includes: acquiring a correction instruction, and determining a monochrome image block (taking a black image block as an example) according to the correction instruction; outputting projection parameters corresponding to the test image to the projection module to control the projection module to emit light beams to the projection surface; controlling an image sensor to collect the light beam reflected by the projection surface to obtain a verification image (shown in figure 3 a); calculating an error coefficient of the projection surface according to the test image and the verification image; and correcting the output projection parameters according to the error coefficients.
The standard color data are x=xd0, y=yd0, and z=zd0. The projection area is confirmed from the verification image and the verification color data x=xd1, y=yd1, z=zd1 of the projection area of the verification image (e.g. the black area in fig. 3 a) are analyzed. Error coefficients x=xd1-xd0, y=yd1-yd0, z=zd1-zd0 can be obtained from the standard color data and the verification color data.
(2) Monochromatic block local correction
In this embodiment, the method for self-correcting projection parameters includes: acquiring a correction instruction, and determining a monochrome image block (taking a black image block as an example) according to the correction instruction; outputting projection parameters corresponding to the test image to the projection module to control the projection module to emit light beams to the projection surface; controlling an image sensor to acquire a light beam reflected by a projection surface to obtain a verification image; matching corresponding standard color data according to the test image; performing region division on the verification image to obtain a plurality of verification sub-images (shown in fig. 3 b); calculating color data of the verification sub-images to obtain sub-verification color data; obtaining verification color data according to the sub-verification color data of each region; calculating to obtain an error coefficient according to the standard color data and the verification color data; and correcting the output projection parameters according to the error coefficients.
The standard color data are x=xd0, y=yd0, and z=zd0. The projected area is identified from the verification image and the verification color data of each of the verification sub-images (e.g., black areas in fig. 3 b) in the projected area of the verification image is analyzed. It can be understood that, compared with the foregoing single-color block global correction, the embodiment considers the non-uniformity of the projection surface affected by the environment, and can more flexibly adjust the projection parameters of different areas for the partition of the verification image, thereby obtaining the projection parameter self-correction with higher precision.
Specifically, when the projection device receives the correction instruction, the projection image carried by the correction instruction is a test image formed by 8 black image blocks with uniform colors, the color mean value of three primary colors of red (X), green (Y) and blue (Z) of each black image block is (Xd 0, yd0 and Zd 0), the three values are recorded as sub-inspection color data corresponding to each verification sub-image, at the moment, when the projection device works under the condition of being influenced by ambient light and reflectivity, the 8 black image blocks with uniform colors are projected to the projection surface, the verification image of each black image block of each partition projected on the projection surface is acquired through an image sensor, and the color data of the verification image is determined to obtain the verification color data. At this time, the error coefficient of each partition measured at this time may be calculated according to the sub-verification color data corresponding to each verification sub-image previously stored in the apparatus and the above-mentioned verification color data, thereby determining the error coefficient of the test image. And correcting the projection parameters based on the error coefficients at the moment to obtain corrected projection parameters.
For example, the subtest color data corresponding to each of the verification sub-images in the test image is as follows:
table 2 standard color data and sub-test color data table for test images
Correspondingly, the XYZ values of the error coefficient of the obtained ambient light of the partition 1 are respectively: x=x d2 -X d0 、Y＝Y d2 -Y d0 、Z＝Z d2 -Z d0 The method comprises the steps of carrying out a first treatment on the surface of the The obtained ambient light of the partition 2 has the following XYZ values: x=x d3 -X d0 、Y＝Y d3 -Y d0 、Z＝Z d3 -Z d0 The method comprises the steps of carrying out a first treatment on the surface of the Acquisition environment of partition 3The error coefficient XYZ values of the light are respectively: x=x d4 -X d0 、Y＝Y d4 -Y d0 、Z＝Z d4 -Z d0 The method comprises the steps of carrying out a first treatment on the surface of the And by analogy, obtaining the error coefficient of each partition, thereby obtaining the error coefficient of the whole projection surface.
It will be appreciated that for convenience of description only, the number of 8 partitions is set here, and the number of actual partitions may be greater or smaller, so that the size of the partitioned partitions and the pixel size of the image sensor may be consistent at most.
(3) Multicolor block global correction
In this embodiment, the method for self-correcting projection parameters includes: acquiring a correction instruction, and determining a multicolor image group (taking black, red R, blue B and green G image blocks as examples) according to the correction instruction; outputting projection parameters corresponding to the test image to the projection module to control the projection module to emit light beams to the projection surface; controlling an image sensor to collect the light beam reflected by the projection surface to obtain a verification image (shown in fig. 3 c); matching corresponding standard color data according to the test image; performing region division on the verification image to obtain a plurality of verification sub-images (such as black, red R, blue B and green G image blocks in FIG. 3 c); calculating color data of the verification sub-images to obtain sub-verification color data; obtaining verification color data according to the sub-verification color data of each region; calculating to obtain an error coefficient according to the standard color data and the verification color data; and correcting the output projection parameters according to the error coefficients.
The standard color data corresponding to the multicolor image group is shown in table 1. Considering that the color of the projection surface itself may not be white, the effect of the color of the projection surface itself on the projection imaging needs to be considered. It can be appreciated that the error coefficients of different spectra can be calculated according to the present embodiment with respect to the foregoing single-color block global correction.
(4) Multicolor block local correction
In this embodiment, the method for self-correcting projection parameters includes: acquiring a correction instruction, and determining a multicolor image group (taking black, red R, blue B and green G image blocks as examples) according to the correction instruction; outputting projection parameters corresponding to the test image to the projection module to control the projection module to emit light beams to the projection surface; controlling an image sensor to collect the light beam reflected by the projection surface to obtain a verification image (shown in fig. 3 d); matching corresponding standard color data according to the test image; performing region division on the verification image to obtain a plurality of verification sub-images (such as black, red R, blue B and green G image blocks in FIG. 3 d); each of the check sub-images includes black, red R, blue B and green G tiles, one each. Calculating color data of the verification sub-images to obtain sub-verification color data; obtaining verification color data according to the sub-verification color data of each region; calculating to obtain an error coefficient according to the standard color data and the verification color data; and correcting the output projection parameters according to the error coefficients. The polychromatic block partial correction takes into account the error coefficients of the different spectra relative to the monochromatic block partial correction described above.
In one embodiment, the method further comprises: outputting the corrected projection parameters to the projection module to control the projection module to emit light beams to the projection surface; controlling an image sensor to acquire light beams reflected by a projection surface to obtain second color data of a verification image; determining a difference between the second color data and the projection parameter; and when the difference value is smaller than or equal to a preset detection threshold value, judging that the self-correction of the projection parameters is successful.
Specifically, after correcting the output projection parameters according to the error coefficients, outputting the corrected projection parameters to a projection module to control the projection module to emit light beams to a projection surface, and acquiring the light beams reflected by the projection surface by controlling an image sensor to obtain second color data (X1, Y1 and Z1) of a verification image; differences (X difference=x1-X0, Y difference=y1-Y0, Z difference=z1-Z0) between the second color data and standard color data (X0, Y0, Z0) corresponding to the test image matching are calculated. And when the difference value is smaller than or equal to a preset detection threshold value, judging that the correction result of the self-correction of the projection parameter is successful. And when the difference is larger than a preset detection threshold, judging that the correction result of the self-correction of the projection parameters is a correction failure. The preset detection threshold value can be specifically set according to actual conditions. For example, the preset detection threshold is set to (X-threshold=3, y-threshold=3, z-threshold=3). And correspondingly when the X difference value, the Y difference value and the Z difference value are smaller than the corresponding preset detection threshold values, judging that the self-correction result of the projection parameters is successful.
Or respectively projecting 24 color images in a standard 24 color card one by one through corrected projection equipment, and respectively collecting light beams reflected by a projection surface corresponding to each color image through an image sensor arranged on the projection equipment to obtain verification color data of a verification image corresponding to each color image; and calculating to obtain a difference value between the verification color data corresponding to each color image and the standard color data of each color, and evaluating a correction result of the projection parameter self-correction of each color image based on the difference value and a preset detection threshold value.
According to the embodiment, the test image is determined according to the correction instruction, the projection parameters corresponding to the test image are output to the projection module, so that the projection module is controlled to emit light beams to the projection surface, the image sensor is controlled to collect light beams reflected by the projection surface, the verification image is obtained, the error coefficient of the projection surface is calculated according to the test image and the verification image, the output projection parameters are corrected according to the error coefficient, automatic correction of the projection parameters according to the actual application environment of the projection equipment is realized, the self-correction efficiency of the projection parameters is improved, the output color projection parameters are automatically adjusted according to the correction instruction, the operation is simple, and the use experience of the projection equipment can be improved.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic of each process, and should not limit the implementation process of the embodiment of the present application in any way.
Referring to fig. 4, fig. 4 is a schematic diagram of an apparatus for self-correcting projection parameters according to the present embodiment, which includes modules for executing the steps in the above-mentioned method embodiments. Refer specifically to the description of the corresponding embodiment in fig. 2. For convenience of explanation, only the portions related to the present embodiment are shown.
In the present embodiment, the apparatus 4 for self-correcting projection parameters includes: a first determining module 401, configured to obtain a correction instruction, and determine a test image according to the correction instruction; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks; the projection module 402 is configured to output projection parameters corresponding to the test image to the projection module, so as to control the projection module to emit a light beam to the projection surface; the first processing module 403 is configured to control the image sensor to collect the light beam reflected by the projection surface, so as to obtain a verification image; a second determining module 404, configured to calculate an error coefficient of the projection surface according to the test image and the verification image; the second processing module 405 is configured to correct the output projection parameter according to the error coefficient.
In one embodiment, the second determining module includes: the matching sub-module is used for matching corresponding standard color data according to the test image; the first computing sub-module is used for computing the color data of the verification image to obtain verification color data; and the second calculation sub-module is used for calculating and obtaining an error coefficient according to the standard color data and the verification color data.
In one embodiment, a first computing sub-module includes: the area dividing unit is used for dividing the areas of the check images to obtain a plurality of check sub-images; the calculating unit is used for calculating the color data of the verification sub-image to obtain sub-verification color data; and the data determining unit is used for obtaining the verification color data according to the sub-verification color data of each area.
In one embodiment, the second computing sub-module includes: and a coefficient calculation unit for calculating a difference between the standard color data and the verification color data as an error coefficient.
In one embodiment, the apparatus for self-correcting projection parameters further comprises: the control module is used for outputting the corrected projection parameters to the projection module so as to control the projection module to emit light beams to the projection surface; the acquisition module is used for controlling the image sensor to acquire the light beam reflected by the projection surface and obtaining second color data of the verification image; the difference value determining module is used for determining a difference value between the second color data and the projection parameter; and the detection module is used for judging that the projection parameter self-correction is successful when the difference value is smaller than or equal to a preset detection threshold value.
According to the embodiment, the test image is determined according to the correction instruction, the projection parameters corresponding to the test image are output to the projection module, so that the projection module is controlled to emit light beams to the projection surface, the image sensor is controlled to collect light beams reflected by the projection surface, the verification image is obtained, the error coefficient of the projection surface is calculated according to the test image and the verification image, the output projection parameters are corrected according to the error coefficient, automatic correction of the projection parameters according to the actual application environment of the projection equipment is realized, the self-correction efficiency of the projection parameters is improved, the output color projection parameters are automatically adjusted according to the correction instruction, the operation is simple, and the use experience of the projection equipment can be improved.
The embodiments of the present application also provide a computer readable storage medium storing a computer program, where the computer program when executed by a processor implements steps of the foregoing method embodiments.
Embodiments of the present application provide a computer program product which, when run on a mobile terminal, causes the mobile terminal to perform steps that may be performed in the various method embodiments described above.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present application implements all or part of the flow of the method of the above embodiments, and may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, where the computer program, when executed by a processor, may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, executable files or in some intermediate form, etc. The computer readable medium may include at least: any entity or device capable of carrying computer program code to a photographing device/terminal apparatus, recording medium, computer Memory, read-Only Memory (ROM), random access Memory (RAM, random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. Such as a U-disk, removable hard disk, magnetic or optical disk, etc. In some jurisdictions, computer readable media may not be electrical carrier signals and telecommunications signals in accordance with legislation and patent practice.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/network device and method may be implemented in other manners. For example, the apparatus/network device embodiments described above are merely illustrative, e.g., the division of modules or elements is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
The above embodiments are only for illustrating the technical solution of the present application, and are not limiting thereof; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application, and are intended to be included in the scope of the present application.
Claims (10)
1. A method for self-correcting projection parameters, comprising:
acquiring a correction instruction, and determining a test image according to the correction instruction; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks;
Outputting projection parameters corresponding to the test image to a projection module to control the projection module to emit light beams to a projection surface;
controlling an image sensor to collect the light beam reflected by the projection surface to obtain a verification image;
calculating an error coefficient of the projection surface according to the test image and the verification image;
and correcting the output projection parameters according to the error coefficients.
2. The method of claim 1, wherein the calculating the error coefficient of the projection surface from the test image and the verification image comprises:
matching corresponding standard color data according to the test image;
calculating the color data of the verification image to obtain verification color data;
and calculating an error coefficient according to the standard color data and the verification color data.
3. The method of claim 2, wherein the calculating the color data of the verification image to obtain the verification color data comprises:
dividing the check image into areas to obtain a plurality of check sub-images;
calculating the color data of the verification sub-images to obtain sub-verification color data;
And obtaining the verification color data according to the sub-verification color data of each region.
4. A method according to claim 3, wherein said calculating an error coefficient from said standard color data and said verification color data comprises:
and calculating the difference value between the standard color data and the verification color data as the error coefficient.
5. The method of claim 1, wherein after correcting the output projection parameters according to the error coefficients, further comprising:
outputting the corrected projection parameters to a projection module to control the projection module to emit light beams to a projection surface;
controlling an image sensor to collect the light beam reflected by the projection surface to obtain second color data of the verification image;
determining a difference between the second color data and the projection parameter;
and when the difference value is smaller than or equal to a preset detection threshold value, judging that the self-correction of the projection parameters is successful.
6. The method of claim 1, wherein the image sensor is a multispectral image sensor.
7. An apparatus for self-correcting projection parameters, comprising:
The first determining module is used for acquiring a correction instruction and determining a test image according to the correction instruction; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks;
the projection module is used for outputting projection parameters corresponding to the test image to the projection module so as to control the projection module to emit light beams to a projection surface;
the first processing module is used for controlling the image sensor to collect the light beam reflected by the projection surface to obtain a verification image;
the second determining module is used for calculating an error coefficient of the projection surface according to the test image and the check image;
and the second processing module is used for correcting the output projection parameters according to the error coefficient.
8. A projection apparatus for self-correcting projection parameters, comprising:
the processor is used for acquiring the correction instruction, determining a test image according to the correction instruction and outputting projection parameters corresponding to the test image; the test image is a black, red, blue or green monochromatic image block or a multicolor image group formed by any combination of the black, red, blue and green image blocks;
The projection module is used for acquiring the projection parameters and emitting light beams to a projection surface according to the projection parameters;
the image sensor is used for collecting the light beams reflected by the projection surface to obtain a verification image;
the processor is also used for acquiring the check image, calculating an error coefficient of the projection surface according to the test image and the check image, and correcting the output projection parameter according to the error coefficient.
9. The projection device of claim 8, wherein the image sensor is a multispectral image sensor.
10. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program which, when executed by a processor, implements a method of self-correction of projection parameters according to any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310469420.3A CN116546173A (en) | 2023-04-25 | 2023-04-25 | Method, device, equipment and computer storage medium for self-correcting projection parameters |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310469420.3A CN116546173A (en) | 2023-04-25 | 2023-04-25 | Method, device, equipment and computer storage medium for self-correcting projection parameters |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116546173A true CN116546173A (en) | 2023-08-04 |
Family
ID=87453557
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310469420.3A Pending CN116546173A (en) | 2023-04-25 | 2023-04-25 | Method, device, equipment and computer storage medium for self-correcting projection parameters |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116546173A (en) |
-
2023
- 2023-04-25 CN CN202310469420.3A patent/CN116546173A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101376503B1 (en) | Method and system for 3d display calibration with feedback determined by a camera device | |
| US7866832B2 (en) | Multi-projector intensity blending system | |
| US20040140982A1 (en) | Image projection with display-condition compensation | |
| CN113170028B (en) | Method for generating image data of machine learning based imaging algorithm | |
| US9330587B2 (en) | Color adjustment based on object positioned near display surface | |
| US20200333184A1 (en) | Calibration apparatus, calibration method, spectral camera, and display apparatus | |
| US9826226B2 (en) | Expedited display characterization using diffraction gratings | |
| CN103688288B (en) | Method and optical projection system for changing input image data | |
| CN112669758B (en) | Display screen correction method, device, system and computer readable storage medium | |
| US20120327086A1 (en) | Image processing apparatus and image processing method | |
| US20050219380A1 (en) | Digital camera for determining chromaticity coordinates and related color temperature of an object and method thereof | |
| EP3507774A1 (en) | Method and system for capturing images for wound assessment with self color compensation | |
| CN107247384B (en) | Brightness compensation data acquisition system and method, and image brightness adjustment method and device | |
| US11740132B2 (en) | Method and apparatus for color lookup using a mobile device | |
| US20200221058A1 (en) | Projector, display system, image correction method, and colorimetric method | |
| US10176743B2 (en) | Method for adjusting color temperature and device | |
| CN106331665A (en) | Projection image adjustment method and projector | |
| WO2019244431A1 (en) | Lighting control system, lighting control method, and lighting control program | |
| JP7428090B2 (en) | Calibration device, calibration method, calibration program, and spectroscopic camera | |
| US20110148903A1 (en) | Image display system comprising a viewing conditions sensing device | |
| CN116546173A (en) | Method, device, equipment and computer storage medium for self-correcting projection parameters | |
| US10757381B2 (en) | Image projection apparatus and its control method | |
| US6404456B1 (en) | Calibrating projection displays | |
| Gadia et al. | Color management and color perception issues in a virtual reality theater | |
| EP1840542B1 (en) | Device, system and method for characterizing a colour device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |