CN114339172A - Projection correction method and device, projection equipment, chip and medium - Google Patents

Projection correction method and device, projection equipment, chip and medium Download PDF

Info

Publication number
CN114339172A
CN114339172A CN202111531019.5A CN202111531019A CN114339172A CN 114339172 A CN114339172 A CN 114339172A CN 202111531019 A CN202111531019 A CN 202111531019A CN 114339172 A CN114339172 A CN 114339172A
Authority
CN
China
Prior art keywords
image
coordinate information
screen
preset
pixel point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111531019.5A
Other languages
Chinese (zh)
Other versions
CN114339172B (en
Inventor
查林
王中琦
魏晓帆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Xinxin Microelectronics Technology Co Ltd
Original Assignee
Qingdao Xinxin Microelectronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Xinxin Microelectronics Technology Co Ltd filed Critical Qingdao Xinxin Microelectronics Technology Co Ltd
Priority to CN202111531019.5A priority Critical patent/CN114339172B/en
Publication of CN114339172A publication Critical patent/CN114339172A/en
Application granted granted Critical
Publication of CN114339172B publication Critical patent/CN114339172B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Transforming Electric Information Into Light Information (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The embodiment of the invention provides a projection correction method, a projection correction device, projection equipment, a chip and a medium, which are used for accurately adjusting the projection equipment. In the embodiment of the invention, when the projection equipment projects the preset image containing the preset identification symbol, the acquired image also contains the identification symbol, the target parameter for correcting the second coordinate information into the third coordinate information is determined according to the second coordinate information of the identification symbol in the acquired image and the third coordinate information in the preset image, and the projection parameter of the projection equipment is adjusted according to the target parameter and the first coordinate information of the screen in the image, so that the projection parameter of the projection equipment can be accurately adjusted to completely project the preset image on the screen.

Description

Projection correction method and device, projection equipment, chip and medium
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a projection correction method and apparatus, a projection device, a chip, and a medium.
Background
With the development of society, projection apparatuses are widely used in homes, offices, schools, entertainment places, and the like, and the projection apparatuses include short-focus laser televisions, projectors, and the like.
When the projection device projects the projection content onto the screen on the wall, the user is usually required to manually adjust the position of the projection device for many times to align the projection content with the frame of the screen. However, when a user uses the projection device at ordinary times, the projection device is often moved, which results in changing the relative position between the projection device and the screen, so that the projection content is no longer matched with the frame of the screen, and the adjustment is needed again.
Disclosure of Invention
The embodiment of the invention provides a projection correction method, a projection correction device, projection equipment, a chip and a medium, which are used for accurately adjusting the projection equipment.
In a first aspect, an embodiment of the present invention provides a projection correction method, where the method includes:
determining first coordinate information of a screen and second coordinate information of a preset identification symbol in an image according to the acquired image containing the screen when a preset image is projected onto the screen by a projection device, wherein the identification symbol is a symbol contained in the preset image;
acquiring third coordinate information of the pre-stored identification symbol in the preset image, and determining to correct the second coordinate information into a target parameter of the third coordinate information according to the second coordinate information and the third coordinate information; determining target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information;
and adjusting the projection parameters of the projection equipment according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
In a second aspect, an embodiment of the present invention further provides a projection correction apparatus, where the apparatus includes:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining first coordinate information of a screen in an image and second coordinate information of a preset identification symbol according to the acquired image containing the screen when a preset image is projected onto the screen by a projection device, and the identification symbol is the symbol contained in the preset image;
the processing module is used for acquiring prestored third coordinate information of the identification symbol in the preset image, and determining target parameters for correcting the second coordinate information into the third coordinate information according to the second coordinate information and the third coordinate information; determining target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information;
and the adjusting module is used for adjusting the projection parameters of the projection equipment according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
In a third aspect, an embodiment of the present invention further provides a projection apparatus, where the projection apparatus includes: the display control assembly, light source, light valve, projection lens;
the display control component is configured to:
adjusting the projection parameters according to the target coordinate information and fourth coordinate information of the boundary in the preset image;
for storing and executing executable instructions to implement the steps of projection correction as described in any of the above.
In a fourth aspect, an embodiment of the present invention further provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to run a computer program or instructions to implement any of the steps of the projection correction method described above.
In a fifth aspect, the present invention further provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program performs the steps of any one of the projection correction methods described above.
In the embodiment of the invention, the electronic device determines first coordinate information of a screen in the image and second coordinate information of a preset identification symbol according to an image which is acquired and contains the screen when the preset image is projected on the screen, determines a target parameter which corrects the second coordinate information into the third coordinate information according to third coordinate information of the identification symbol in the preset image and the second coordinate information, determines target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information of the screen in the image, and adjusts the projection parameter of the projection device according to the target coordinate information and fourth coordinate information of a boundary in the preset image. In the embodiment of the invention, when the projection equipment projects the preset image containing the preset identification symbol, the acquired image also contains the identification symbol, the target parameter for correcting the second coordinate information into the third coordinate information is determined according to the second coordinate information of the identification symbol in the acquired image and the third coordinate information in the preset image, and the projection parameter of the projection equipment is adjusted according to the target parameter and the first coordinate information of the screen in the image, so that the projection parameter of the projection equipment can be accurately adjusted to completely project the preset image on the screen.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1a is a schematic structural diagram of a projection apparatus according to an embodiment of the present invention;
fig. 1b is a second schematic structural diagram of a projection apparatus according to an embodiment of the invention;
fig. 1c is a third schematic structural diagram of a projection apparatus according to an embodiment of the present invention;
FIG. 1d is a fourth schematic view illustrating a structure of a projection apparatus according to an embodiment of the present invention;
fig. 1e is a fifth schematic structural diagram of a projection apparatus according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a projection calibration process according to an embodiment of the present invention;
FIG. 3a is a schematic diagram of a first image according to an embodiment of the present invention;
FIG. 3b is a schematic diagram of a second image according to an embodiment of the present invention;
FIG. 4 is a diagram illustrating a third default image according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a third image according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a projection calibration process according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a projection correction apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a chip according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the attached drawings, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the embodiments of the present invention, where "/" denotes an or meaning, for example, a/B may denote a or B; "and/or" in the text is only an association relationship describing an associated object, and means that three relationships may exist, for example, a and/or B may mean: three cases of a alone, a and B both, and B alone exist, and in addition, "a plurality" means two or more than two in the description of the embodiment of the present invention.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first" and "second" may explicitly or implicitly include one or more of the features, and in the description of embodiments of the invention, "plurality" means two or more unless indicated otherwise.
Hereinafter, some terms in the embodiments of the present invention are explained to facilitate understanding by those skilled in the art.
Pixel value: for a gray image, the pixel value of a pixel point is the gray value of the pixel point; for a color image, before the pixel values of the pixels are obtained, the color image is converted into a gray image, and the pixel values of the pixels in the gray image are the pixel values of the pixels in the color image.
After the pixel values are acquired, the gray scale image is converted into a color image for correction.
In the field of image processing, when a user uses a projector, the situation that the projector is not aligned with a screen occurs. The related art requires a user to manually adjust the position of the projection device for many times to align the projection content with the frame of the screen.
However, when a user uses the projection device at ordinary times, the projection device is often moved, which results in changing the relative position between the projection device and the screen, so that the projection content is no longer matched with the frame of the screen, and the adjustment is needed again.
In the embodiment of the invention, when the projection equipment projects the preset image containing the preset identification symbol, the acquired image also contains the identification symbol, the target parameter for correcting the second coordinate information into the third coordinate information is determined according to the second coordinate information of the identification symbol in the acquired image and the third coordinate information in the preset image, and the projection parameter of the projection equipment is adjusted according to the target parameter and the first coordinate information of the screen in the image, so that the projection parameter of the projection equipment can be accurately adjusted to completely project the preset image on the screen.
After the design idea of the embodiment of the present invention is introduced, some simple descriptions are provided below for application scenarios to which the technical solution of the embodiment of the present invention can be applied, and it should be noted that the application scenarios described below are only used for illustrating the embodiment of the present invention and are not limited. In specific implementation, the technical scheme provided by the embodiment of the invention can be flexibly applied according to actual needs.
Fig. 1a is a schematic structural diagram of a projection apparatus according to an embodiment of the present invention, fig. 1b is a second schematic structural diagram of the projection apparatus according to the embodiment of the present invention, fig. 1c is a third schematic structural diagram of the projection apparatus according to the embodiment of the present invention, and fig. 1d is a fourth schematic structural diagram of the projection apparatus according to the embodiment of the present invention.
As shown in fig. 1a and 1b, the projection device 100 may include a display control assembly 110, at least one light source 120, and a light valve 130. The display control component 110 may be a Digital Light Processing Chip (DLPC). Illustratively, the display control component 110 may be a DLPC 6540. The Light source 120 is a laser Light source or a bulb Light source or a semiconductor-material-chip (LED) Light source, and the Light source 120 may include at least one set of lasers corresponding to the at least one laser driving assembly 111. The at least one means one or more, and the plurality means two or more. The at least one group refers to one or more groups, the multiple groups refers to two or more groups, and each group of lasers may include one or more lasers. For example, referring to fig. 1a, if the light source 120 is a laser light source, the light source 120 includes a blue laser 121, a red laser 122, and a green laser 123. The light valve 130 is a digital micro-mirror device (DMD).
In the embodiment of the present invention, referring to fig. 1b, if the projection device is a projection television, the projection device may further include a power supply 140, a start control component 150, a program storage component 160, and a main control chip 170. The main control chip 170 is connected to the start control module 150 and the display control module 110, the power supply 140 is connected to the laser driving module 111, and the program storage module 160 is connected to the display control module 110.
The main control chip 170 sends a start command to the start control module 150, the start control module 150 starts to operate after receiving the start command, and outputs, for example, 1.1 volt (V), 1.8V, 3.3V, 2.5V, and 5V to the display control module 110 in sequence according to the power-on sequence of the start control module 150 to supply power to the display control module 110. After the power supply voltage and the timing are correct, the start control module 150 sends a power sense (power sense) signal and a power good (PWRGOOD) signal to the display control module 110, and after receiving the two control signals, the display control module 110 reads a program from the external program storage module 160 and initializes the program, and at this time, the whole projection apparatus starts to operate. The display control component 110 configures the actuation control component 150 via Serial Peripheral Interface (SPI) communication and instructs the actuation control component 150 to begin supplying power to the light valve 130. Then, the control component 150 is activated to output 3 voltages to the light valve 130, wherein each Voltage Bias (VBIAS) is, for example, 18V, a Voltage Reset (VRST) is, for example, -14V, and a Voltage Offset (VOFS) is, for example, 10V, and after the voltage of the light valve 130 is normal, the light valve 130 starts to operate. The display control component 110 sends the primary color level values of the sub-image to the light valve 130 at, for example, 594MHz through a high-speed serial interface (HSSI) to realize the display of the image. The power supply in the projection device is powered by power supply 140 converting, for example, 100V to 240V ac power to dc power to power the various components.
Referring to fig. 1c, if the light source 120 in the laser projection device comprises two sets of red lasers 1201, one set of blue lasers 1202 and one set of green lasers 1203, which are integrally arranged. The projection device may be referred to as a full color laser projection device. Because the temperature that blue laser 1202 can bear is higher, set up this blue laser 1202 in the middle of red laser 1201 and green laser 1203, this mode of arrangement is favorable to red laser 1201 and green laser 1203 fast heat dissipation more, makes the reliability of this integrated multiunit laser of setting higher. Referring to fig. 1c, the full color laser projection apparatus may further include four reflective mirrors 70, a lens assembly 80, a diffusion wheel 90, a light guide 60, a Total Internal Reflection (TIR) lens 11, a projection lens 12, and a projection screen 13. Wherein the lens assembly 80 includes first lenses 801-80, second lenses 802-80, and third lenses 803-80. One mirror 70 is provided for each set of lasers.
In the process of displaying the first frame sub-image by projection, the blue laser emitted from the blue laser 1202 is reflected by the reflective mirror 70 at the corresponding position, condensed by the first lens 801-80, homogenized by the diffusion wheel 90, and totally reflected by the light guide 60. The red laser emitted from the red laser 122 is reflected by the reflecting mirror 70 at the corresponding position, condensed by the first lens 801-80, subjected to speckle elimination and chromaticity dodging by the diffusion wheel 90, and subjected to total reflection dodging by the light guide pipe 60. The green laser light emitted from the green laser 1203 is reflected by the reflection lens 70 at the corresponding position, condensed by the first lens 801-80, subjected to speckle elimination and chromaticity dodging by the diffusion wheel 90, and subjected to total reflection dodging by the light guide pipe 60. The blue laser, the red laser and the green laser after being homogenized by the light guide 60 are shaped by the second lens 802-80 and the third lens 803-80 at a time, and enter the TIR lens 11 for total reflection, during the process that the three primary colors of light are irradiated to the light valve in a time sequence, the display control assembly 110 controls the light valve 40 to turn over according to the primary color gradation value of the pixel in the first frame sub-image, the light valve 40 after turning over reflects the light totally reflected by the TIR lens 11, and transmits the light through the TIR lens 11 again, and finally is projected onto the projection screen 13 through the projection lens 12.
Furthermore, as shown in fig. 1c, the projection apparatus may further include: and a first luminance sensor W1 disposed on the light exit side of each laser, the first luminance sensor W1 being for detecting the light emission luminance of the corresponding one of the lasers. The first luminance sensor W1 disposed on the light exit side of the blue laser 1202 may be a blue luminance sensor. The first luminance sensor W1 provided on the light exit side of the red laser 1201 may be a red luminance sensor. The first luminance sensor W1 provided on the light exit side of the green laser 1203 may be a green luminance sensor.
Alternatively, as shown in fig. 1c, the projection apparatus may further include: a second brightness sensor W2 disposed at the light exit side of the light guide 60, the second brightness sensor W2 may be a white light brightness sensor.
Still alternatively, the projection apparatus may include both the first brightness sensor W1 and the second brightness sensor W2.
In the related art, referring to fig. 1d, after receiving a 4K video signal or a digital television signal, a main control chip 170 of a projection television decodes the image signal, and transmits the image signal with a resolution of 3840 × 2160 minutes to a Field Programmable Gate Array (FPGA) 202 in the form of 8 VX1 signals at a rate of 60HZ, after the FPGA 202 processes the image signal with a resolution of 3840 × 2160, the FPGA 202 decomposes a frame of 4K (3840 × 2160) signals into 4 sub-frame 2K (1920 × 1080) signals and buffers the signals into 2 sets of Double Data Rate (DDR) 203 externally connected to the FPGA 202, where the DDR 203 is a 14-bit Address (ADDR) line and a 32-bit data (data) line. The FPGA power management outputs 1.1V, 1.15V, 1.5V, 2.5V, 3.3V, DDR _ VTT and DDR _ VREF are used for supplying power to the FPGA 202 and the DDR 203. The FPGA 202 inputs primary color gradation values of 2K (1920 × 1080) signals of one frame of sub-images into the first control chip 208 and the second control chip 209, respectively, in the form of 60-bit transistor-transistor logic (transistor logic) TTL data. The first control chip 208 and the second control chip 209 control the data amount of the gradation value of half of the primary color of one frame of the sub-image, respectively. And respectively sending the primary color gradation values of (960+32) × 1080 to the light valve 130 in a low-voltage differential signaling (LVDS) data format of 2 channels at 240Hz, and the excessive 32 columns of pixels are pixels needing to be overlapped. The first control chip 208 and the second control chip 209 each control half of the primary color gradation values of a frame of the sub-image, thereby realizing high-speed transmission of the primary color gradation values of the sub-image. The first control chip 208 controls 216 pairs to transmit 32 pairs of LVDS primary color level values to the light valve 130, controls half of the image display, and the second control chip 209 controls 2 pairs of 16 pairs to transmit 32 pairs of LVDS primary color level values to the light valve 130, and controls the other half of the image display, i.e. the first control chip 208 and the second control chip 209 control 4 pairs of 16 pairs of LVDS primary color level values to the light valve 211 at 240Hz for 2K (1920 × 1080) image display, and 200 millivolts (mV) amplitude between LVDS data pairs can effectively ensure signal integrity and reduce electromagnetic interference (EMI). The power supply of the first control chip 208 and the second control chip 209 is provided by the start control component 150, the first control chip 208 sends a control command to start the start control component 150 to work, and the start control component 150 sequentially outputs 1.1V, 1.8V, 3.3V, 2.5V and 5V according to the power-on sequence of the first control chip 208 and the second control chip 209 to supply power to the first control chip 208 and the second control chip 209. After the power supply voltage and the timing are correct, the start control module 150 is enabled to output two control signals posinse and PWRGOOD to the first control chip 208. After receiving the two control signals, the first control chip 208 starts to read a program from the external program storage component 210 for initialization operation, and at this time, the whole projection apparatus starts to operate, the first control chip 208 configures the start control component 150 through SPI communication, and sends a power supply start command to the light valve 130, and the start control component 150 outputs 3 voltages VBIAS of 18V, VRST-14V, and VOFS of operation of the light valve 130 after receiving the command, and can start to operate after the voltage of the light valve 130 is normal. Illustratively, the first control chip 208 and the second control chip 209 are both DLPCs 6421.
The display control assembly 110 provided by the embodiment of the disclosure can realize functions of one FPGA chip, 4 DDRs, the first control chip 208 and the second control chip 209 in the related art, thereby simplifying a circuit and reducing cost. And the PCB circuit board for arranging the display control assembly has simpler wiring and less stacking. Meanwhile, the size of the PCB is reduced, the cost of the PCB is reduced, and meanwhile, the miniaturization design of the projection equipment is facilitated. The other parts of the projection device using the integrated display control assembly 110 are unchanged, which facilitates the rapid introduction of products.
Fig. 1e is a fifth schematic structural diagram of a projection apparatus 100 according to an embodiment of the present invention. The projection apparatus 100 includes: a light source 120, a projection lens 12, a processor 14, and a projection screen 13. And the configuration shown in figure 1e is not to be construed as limiting the invention.
And the light source 120 is used for providing illumination for the projection lens 12, the processor 14 is used for modulating the light source light beam, and the projection lens 12 is used for imaging through the modulated light beam and projecting the light beam to the projection screen 13 to form an image.
A projection lens 12 for projecting an image on a projection screen;
and the processor 14 is configured to determine, according to the second coordinate information of the identifier in the acquired image and the third coordinate information of the identifier in the preset image, a target parameter for correcting the second coordinate information to the third coordinate information, and adjust the projection parameter of the projection device according to the target parameter and the first coordinate information of the screen in the image. In the present invention, the processor 130 is used to perform any of the methods of projection correction described herein.
And a projection screen 13 for displaying the image projected by the projection lens 12.
The above description is only for the purpose of illustrating the preferred embodiments of the present disclosure and is not to be construed as limiting the present disclosure, but rather as the following claims are intended to cover all modifications, equivalents, and improvements falling within the spirit and scope of the present disclosure.
To further illustrate the technical solutions provided by the embodiments of the present invention, the following detailed description is made with reference to the accompanying drawings and the specific embodiments. Although embodiments of the present invention provide the operational steps of the methods described in the following embodiments or figures, more or fewer operational steps may be included in the methods based on conventional or non-inventive efforts. In steps where no necessary causal relationship exists logically, the order of execution of the steps is not limited to that provided by embodiments of the present invention.
In order to accurately adjust a projection device, embodiments of the present invention provide a projection correction method, an apparatus, a projection device, a chip, and a medium.
Example 1:
fig. 2 is a schematic diagram of a projection correction process according to an embodiment of the present invention, where the process includes the following steps:
s201: according to an image which is acquired when a preset image is projected onto a screen by a projection device and contains the screen, first coordinate information of the screen in the image and second coordinate information of a preset identification symbol are determined, wherein the identification symbol is a symbol contained in the preset image.
The projection correction method provided by the embodiment of the invention is applied to electronic equipment, and the electronic equipment can be projection equipment, a PC (personal computer) or a server and other intelligent equipment.
In order to correct the projection of the projection device on the screen, in the embodiment of the present invention, the projection device projects a preset image on the screen, the electronic device obtains an image acquired when the projection device projects the preset image on the screen, and adjusts the projection parameters of the projection device according to the obtained image and the preset image.
Specifically, the projection device may first project a preset image, where a preset identification symbol exists in the preset image. And then the electronic equipment can acquire the acquired image containing the screen when the projection equipment projects the preset image, and the electronic equipment acquires the first coordinate information of the screen and the second coordinate information of the preset identification symbol in the acquired image. In the embodiment of the invention, if the electronic equipment is projection equipment, the electronic equipment controls the electronic equipment to project a preset image and sends an acquisition instruction to image acquisition equipment arranged at a fixed position of the projection equipment, the image acquisition equipment acquires the image after receiving the acquisition instruction and sends the acquired image to the electronic equipment, and the electronic equipment acquires the acquired image containing a screen; if the electronic equipment is intelligent equipment such as a PC or a server, the electronic equipment can send a projection instruction to the projection equipment, the projection equipment projects a preset image after receiving the projection instruction, the electronic equipment sends a collection instruction to image collection equipment arranged at a fixed position of the projection equipment after sending the projection instruction, the image collection equipment collects an image after receiving the collection instruction and sends the collected image to the electronic equipment, and the electronic equipment obtains the collected image containing a screen.
In addition, because the projection device is closer to the screen, a common image acquisition device may not be able to completely shoot the whole screen, and therefore, the image acquisition device used in the embodiment of the present invention is an ultra-wide angle image acquisition device. The ultra-wide angle image acquisition device is mounted at a fixed position of the projection device.
In the embodiment of the present invention, the electronic device may input the acquired image including the screen into the screen recognition model, and obtain an output of the screen recognition model, where the output is the first coordinate information of the screen in the image, and in addition, the electronic device may also input the acquired image including the screen into the symbol recognition model, and obtain an output of the symbol recognition model, where the output is the third coordinate information of a recognition symbol preset in the image, and the recognition symbol may be any image, for example, a circle.
S202: acquiring third coordinate information of the pre-stored identification symbol in the preset image, and determining to correct the second coordinate information into a target parameter of the third coordinate information according to the second coordinate information and the third coordinate information; and determining target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information.
In the embodiment of the present invention, when the parameter of the projection device is adjusted, the purpose is to completely project the preset image projected by the projection device on the screen, that is, the purpose is to align the boundary between the screen and the projected preset image.
In the embodiment of the invention, the electronic device may first acquire the target coordinate information mapping the first coordinate information of the screen in the image to the preset image, and then adjust the projection parameters of the projection device according to the target coordinate information mapping the screen to the preset image and the coordinate information of the boundary of the preset image.
Specifically, in order to obtain target coordinate information for mapping the first coordinate information of the screen in the image onto the preset image, the electronic device may first obtain a corresponding target parameter when the coordinate information in the image is mapped onto the preset image. In order to acquire a target parameter corresponding to the mapping of the coordinate information in the image onto the preset image, the electronic device acquires third coordinate information of a pre-stored identification symbol in the preset image, and determines the target parameter corresponding to the correction of the second coordinate information in the image into the third coordinate information in the preset image according to the third coordinate information of the identification symbol in the preset image and the second coordinate information of the identification symbol in the image.
In addition, because the ultra-wide-angle image acquisition equipment is adopted to acquire the image, the acquired image may have distortion, and the electronic equipment maps the position information in the acquired image to the preset image through the target parameter, so that the distortion of the acquired image is removed.
Specifically, the electronic device can describe the distortion condition through modes such as distortion function fitting according to the coordinate information of the same identifier in a preset image and the corresponding coordinate information in the image, the distortion function can be expressed in various modes such as a curved surface equation, and the target parameter of the distortion function can be solved according to the corresponding coordinate information. Specifically, in the embodiment of the present invention, how to determine the target parameter corresponding to the correction of the second coordinate information in the image to the third coordinate information in the preset image according to the coordinate information of at least two identifiers in one image and the corresponding coordinate information in another image is not described herein again for the prior art.
After the electronic equipment determines the corresponding target parameter, the electronic equipment determines to map the first coordinate information to the target coordinate information in the preset image according to the target parameter and the first coordinate information of the screen in the image.
S203: and adjusting the projection parameters of the projection equipment according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
In order to correct the projection of the projection device on the screen, the electronic device adjusts the projection parameters of the projection device according to the first coordinate information of the screen in the image mapped to the target coordinate information in the preset image and the fourth coordinate information of the boundary in the preset image, so that the projection content corresponding to the preset image is aligned to the frame of the screen. In the embodiment of the invention, the projection content corresponding to the preset image is aligned with the frame of the screen, so that the projection of the projection equipment can be corrected on the screen, and the geometric correction function is realized.
That is to say, in the embodiment of the present invention, the electronic device identifies the coordinate information of the corresponding preset identification symbol for the image acquired by the ultra-wide angle image acquisition device, identifies the position information of the screen in the image, then determines the corresponding target parameter by using the coordinate information of the identification symbol in the acquired image and the coordinate information in the preset image, performs distortion removal processing, determines the target coordinate information mapping the coordinate information of the screen to the preset image according to the target parameter and the coordinate information of the screen in the acquired image, and adjusts the parameter of the projection device according to the target coordinate information and the coordinate information of the boundary in the preset image, so as to automatically align the projection content to the screen, without a manual intervention process, implement automatic geometric correction, and effectively improve the use experience of the user.
In the embodiment of the invention, when the projection equipment projects the preset image containing the preset identification symbol, the acquired image also contains the identification symbol, the target parameter for correcting the second coordinate information into the third coordinate information is determined according to the second coordinate information of the identification symbol in the acquired image and the third coordinate information in the preset image, and the projection parameter of the projection equipment is adjusted according to the target parameter and the first coordinate information of the screen in the image, so that the projection parameter of the projection equipment can be accurately adjusted to completely project the preset image on the screen.
Example 2:
to obtain the first coordinate information of the screen in the captured image, on the basis of the above embodiment, in an embodiment of the present invention, the determining the first coordinate information of the screen in the image according to the captured image including the screen when the projection device projects the preset image onto the screen includes:
acquiring a first image which is acquired when a first preset image is projected onto a screen by a projection device and contains the screen, and acquiring a second image which is acquired when a second preset image is projected onto the screen by the projection device and contains the screen; wherein the first preset image is a white image, and the second preset image is a black image;
for each pixel point, determining a difference value between a first brightness value of the pixel point on a first image and a second brightness value of the pixel point on a second image, judging whether the difference value is larger than a first preset numerical value, and if so, determining the pixel point to be a pixel point of a region where a screen in the first image is located;
and determining first coordinate information of the screen in the first image according to the coordinate information of each pixel point of the area of the screen in the first image.
Due to the material of the screen, when the projection device projects the white image and the black image, the difference in brightness of the area where the screen is located in the image including the screen is relatively large, and therefore, in the embodiment of the present invention, in order to obtain the first coordinate information of the screen in the collected image, the projection device respectively projects the first preset image and the second preset image onto the screen, where the first preset image is the white image, and the second preset image is the black image. The first preset image and the second preset image have the same size and are both the same as the size of the image containing the preset identification symbol.
The electronic equipment acquires a first image which contains a screen and is acquired when the projection equipment projects the first preset image onto the screen, and acquires a second image which contains the screen and is acquired when the projection equipment projects the second preset image onto the screen. The electronic equipment acquires a first brightness value of each pixel point on a first image and a second brightness value of the pixel point on a second image aiming at each pixel point, acquires a difference value between the first brightness value and the second brightness value corresponding to the pixel point, judges whether the difference value is larger than a first preset numerical value or not, if the difference value is larger than the first preset numerical value, the fact that the brightness difference of the pixel point in the first image and the second image is large is indicated, and the fact that the pixel point is the pixel point of a region where a screen is located in the first image is indicated.
After each pixel point of the area where the screen is located in the first image is obtained, the electronic equipment determines first coordinate information of the screen in the first image according to the coordinate information of each pixel point of the area where the screen is located in the first image. The first coordinate information may be coordinate information of two preset vertices of an area where the screen is located, for example, coordinate information of an upper left corner and a lower right corner, or coordinate information of an upper right corner and a lower left corner.
FIG. 3a is a schematic diagram of a first image according to an embodiment of the present invention; fig. 3b is a schematic diagram of a second image according to an embodiment of the present invention.
Fig. 3a is a first image acquired by the image acquisition device when the projection device projects a white image, and fig. 3b is a second image acquired by the image acquisition device when the projection device projects a black image, as can be seen from fig. 3a and fig. 3b, when the projection device projects a white image, the first image acquired by the image acquisition device, and when the projection device projects a black image, the difference of the brightness of the area where the screen is located in the second image acquired by the image acquisition device is large, and the difference of the brightness of other areas such as the screen frame is small.
In the embodiment of the invention, when the projection equipment projects the white image and the black image, the brightness difference of the area where the screen is located in the acquired image is large, and the brightness difference of other areas is small, so that in the embodiment of the invention, when the projection equipment projects the white image, the acquired first image and when the projection equipment projects the black image, the acquired second image are obtained, and according to the difference value of the brightness values of the pixel points in the first image and the second image, whether the pixel points are the pixel points of the area where the screen is located in the first image is determined, so that the first coordinate information of the screen in the acquired image can be accurately determined.
Example 3:
in order to obtain the first coordinate information of the screen in the acquired image, on the basis of the foregoing embodiments, in an embodiment of the present invention, the determining the first coordinate information of the screen in the first image according to the coordinate information of each pixel point of the area where the screen is located in the first image includes:
determining each second pixel point at the boundary of the screen in the first image according to the coordinate information of each pixel point in the area of the screen in the first image;
aiming at each second pixel point, acquiring other second pixel points which are less than a first preset number from the second pixel point in the second pixel point, and determining each slope of each other second pixel point and the second pixel point; determining a target slope of the second pixel point according to each slope and the corresponding weight value;
and aiming at each second pixel point, acquiring the target slope of a second preset number of target second pixel points which are away from the second pixel point in the first preset direction, determining the slope difference value between the target slope of the target second pixel point and the target slope of the second pixel point, and if the absolute value of the slope difference value is larger than a second preset value, determining the first coordinate information of the screen in the first image according to the coordinate information of each second pixel point between the second pixel point and the target second pixel point in the first preset direction.
The coordinate information of the vertex of the screen in the first image can be used in the embodiment of the invention to represent the first coordinate information of the screen in the first image. Because the screen is rectangular, and the difference between the slope of the coordinate point near the vertex of the rectangle and the slope of the adjacent coordinate point and the slope of the pixel point at other positions and the slope of the adjacent pixel point is larger, in the embodiment of the invention, the coordinate information of the vertex of the screen in the first image can be determined according to the slope determined by each second pixel point and the adjacent second pixel point at the boundary of the screen in the first image, so that the first coordinate information of the screen in the first image can be determined.
The electronic device may determine, according to the coordinate information of each pixel point of the area where the screen is located in the first image, each second pixel point located at the boundary of the screen in the first image. Specifically, the method for the electronic device to determine each second pixel point located at the boundary of the screen in the first image may be: aiming at each pixel point in the area of the screen in the first image, if the pixel points adjacent to the pixel point in the four directions are all the pixel points located in the area of the screen, the pixel point is not the second pixel point located at the boundary of the screen, and if the pixel points adjacent to the pixel point in the four directions are not all the pixel points located in the area of the screen, the pixel point is determined to be the second pixel point located at the boundary of the screen.
After each second pixel point at the screen boundary in the first image is determined, the electronic equipment acquires other second pixel points, the distance between which and the second pixel point is smaller than a first preset number, in each second pixel point according to each second pixel point, and determines each slope of each other second pixel point and the second pixel point according to the acquired coordinate information of each other second pixel point and the coordinate information of the second pixel point. The first predetermined number may be any value, for example, 2, wherein the other second pixels which are less than the first predetermined number from the second pixel are in the same direction as the second pixel.
Specifically, in the embodiment of the present invention, according to the second pixel point and any other second pixel point, the process of determining the corresponding slope may be that a difference between a vertical coordinate of the other second pixel point and a vertical coordinate of the second pixel point is determined, a difference between an abscissa of the other second pixel point and an abscissa of the second pixel point is determined, and a ratio of the difference corresponding to the vertical coordinate to the difference corresponding to the abscissa is determined, which is the slope corresponding to the second pixel point and the other second pixel point.
And aiming at each second pixel point, determining the target slope of the second pixel point according to each obtained slope and the corresponding weight value.
Specifically, the formula adopted by the electronic device to determine the target slope of a certain second pixel point may be:
Slope_Cur(k)=Slope(k+1)*Weight(k+1)+…+Slope(k+N-1)*Weight(k+N-1)
the Slope _ cur (k) is a target Slope of the second pixel point, the Slope (k +1) and the Slope (k + N-1) are Slope values corresponding to the pixel point adjacent to the second pixel point and the second pixel point respectively, Weight (k +1) and Weight (k + N-1) are corresponding Weight values respectively, and the sum of Weight (k +1) + … + Weight (k + N-1) is equal to 1.
In the embodiment of the present invention, the range of the vertex of the screen is determined according to the target slope of each second pixel point, and specifically, the electronic device obtains, for each second pixel point, a target second pixel point preset by the second pixel point in the first preset direction, so as to obtain the target slope of the target second pixel point. The preset target second pixel points are second pixel points with a second preset number and a first preset direction from the second pixel points. The second predetermined number may be any number, such as 5.
Determining a slope difference value between a target slope of a target second pixel point and a target slope of the second pixel point, if the absolute value of the obtained slope difference value is greater than a second preset value, indicating that the slope of the second pixel point sends a sudden change, considering that the second pixel point reaches the vicinity of the vertex of the screen, determining that the vertex of the screen exists in the second pixel point between the second pixel point and the target second pixel point, and determining first coordinate information of the screen in the first image according to coordinate information of each second pixel point between the second pixel point and the target second pixel point in a first preset direction.
Specifically, in the embodiment of the present invention, the second pixel point corresponding to the vertex may be determined by using a morphological detection method with respect to the coordinate information of each second pixel point between the second pixel point and the target second pixel point, and the coordinate information of the second pixel point of each vertex is determined to be the first coordinate information of the screen in the first image. Specifically, how to determine the coordinate information of the vertex of the rectangle according to the coordinate information of the vertex and several coordinate points near the vertex by using a morphological detection method is the prior art and is not described herein again.
Example 4:
in order to determine the second coordinate information of the identifier preset in the image, on the basis of the foregoing embodiments, in an embodiment of the present invention, the determining the second coordinate information of the identifier preset in the image according to the image including the screen, which is acquired when the projection device projects the preset image onto the screen, includes:
acquiring a third image which is acquired and contains the screen when the projection equipment projects the third preset image onto the screen; the third preset image comprises identification symbols with at least two sizes, the identification symbols with each size are at least positioned in two adjacent rows, each row comprises identification symbols with one size, and identification symbols with smaller sizes, which are positioned in different rows, exist at the same positions as the identification symbols with larger sizes;
and identifying the third image, acquiring each identification symbol in the third image, determining a target identification symbol meeting requirements according to the size of each identification symbol in the third image, and acquiring second coordinate information of the target identification symbol in the third image.
In the embodiment of the present invention, in order to determine the second coordinate information of the identifier preset in the image, the electronic device may determine, when the third preset image is projected by the projection device, a target identifier that meets a requirement in the acquired third image, and further determine the second coordinate information of the target identifier in the third image.
Specifically, the electronic device may first acquire a third image including the screen, which is acquired when the projection device projects the third preset image onto the screen. The third preset image comprises identification symbols with at least two sizes, the identification symbols with each size are at least positioned in two adjacent rows, each row comprises identification symbols with one size, and identification symbols with smaller sizes, which are positioned in different rows, exist at the same positions as the identification symbols with larger sizes.
Fig. 4 is a schematic diagram of a third preset image according to an embodiment of the present invention. As can be seen from fig. 4, the third preset image includes three sizes of identification symbols, and for each size of identification symbol, the identification symbol is located in a preset number of adjacent rows, each row includes one size of identification symbol, and among the identification symbols located in different rows, there is a smaller size of identification symbol located at the same position as the larger size of identification symbol. In fig. 4, the horizontal lines are boundaries of the identification symbols of different sizes, and the identification symbols on the vertical lines are the identification symbols in the same column. That is to say that a smaller size identifier is present in the third preset image, at the same position as the larger size identifier.
The electronic device identifies the third image after acquiring the third image, and acquires each identification symbol in the third image, and since the third preset image includes identification symbols of at least two sizes, and the arrangement of the identification symbols is regular, in the embodiment of the present invention, the size of each identification symbol in the third image also has at least two sizes, so according to the size relationship of the sizes of the identification symbols in the third image, the identification symbol in the third image corresponding to the preset identification symbol can be determined as a target identification symbol, and after the target identification symbol in the third image is determined, second coordinate information of the target identification symbol in the third image is acquired.
In order to acquire each identification symbol in the third image, on the basis of the above embodiments, in an embodiment of the present invention, the acquiring each identification symbol in the third image includes:
aiming at the pixel value of each pixel point in the third image, if the pixel value is larger than a third preset numerical value, determining the pixel point as the pixel point of the area where the identification symbol is located, and acquiring each identification symbol in the third image according to the pixel point of the area where each identification symbol in the third image is located; and the identification symbol in the third preset image is a white identification symbol.
In the embodiment of the present invention, the pixel points in the area where the identifier is located in the third preset image are white pixel points, and the pixel points in other areas are black pixel points, and since the pixel value of the corresponding pixel point is larger when the projection device projects a white image, in the embodiment of the present invention, when each identifier is obtained in the third image, it may be determined whether the pixel value of the pixel point is larger than a third preset value, and if the pixel value of the pixel point is larger than the third preset value, it is determined that the pixel point is the pixel point in the white area in the third preset image, and it is determined that the pixel point is the pixel point corresponding to the identifier in the projected third preset image, that is, the pixel point is the pixel point in the area where the identifier is located in the third image.
After determining each pixel point of the region where the identifier is located, the electronic device may obtain each identifier in the third image according to the pixel point of the region where the identifier is located in the third image.
Example 5:
in order to accurately determine the target identification symbol in the third image, on the basis of the above embodiments, in an embodiment of the present invention, the determining the target identification symbol that meets the requirement according to the size of each identification symbol in the third image includes:
and determining a corresponding target identification symbol in the third image according to the size of the identification symbol of each line in the third image and the size relation of the identification symbol positioned in each line in the third preset image.
The third preset image is an image set by a preset rule, so that the size relationship of the identification symbols positioned on each row in the third preset image is stored in the electronic device in advance, and the third image is an image acquired when the third preset image is projected, that is, the size relationship of the identification symbols positioned on each row in the third image is the same as the size relationship of the identification symbols positioned on each row in the third image. Therefore, in the embodiment of the present invention, the electronic device may determine the size relationship of the identifier of each line in the third image according to the size of the identifier of each line in the third image, and may determine which identifier in the third preset image each identifier in the third image corresponds to according to the size relationship of the identifier of each line in the third image and the size relationship of the identifier located in each line in the third preset image, so as to determine the corresponding target identifier in the third image.
Fig. 5 is a schematic diagram of a third image according to an embodiment of the present invention. Fig. 5 is a third image captured when the projection apparatus provided in the embodiment of the present invention projects the image in fig. 4, as can be seen from fig. 5, the third image has distortion, but the arrangement of the identification symbols does not change, the horizontal line in fig. 5 is a boundary line of the identification symbols with different sizes, and the identification symbols on the vertical line are the identification symbols in the same column. In the embodiment of the present invention, the row number of each identification symbol may be determined according to the size of the identification symbol near the horizontal line, and the column number of each identification symbol may be determined according to the identification symbol corresponding to the vertical line.
In the embodiment of the present invention, a target row number and a target column number of a target identifier to be obtained may be stored in advance, and the electronic device obtains identifiers corresponding to the target row number and the target column number, and determines that the obtained identifier is the target identifier. Specifically, the electronic device may determine the row number and the column number of each identification symbol in the third preset image.
Since the third preset image includes identification symbols of at least two sizes, and each line includes an identification symbol of one size, in the embodiment of the present invention, it may be determined whether the size of the identification symbol in the upper adjacent line of the third image is different from the size of the identification symbol, if the size of the identification symbol is different from the size of the identification symbol, the line number of the identification symbol may be determined as the line number of at least one line number that is preset, and if the size of the identification symbol is different from the size of the identification symbol, the line number of the identification symbol in the upper adjacent line of the third preset image that is preset in the electronic device may be determined as the line number of the line in which the identification symbol in the upper adjacent line is different from the size of the identification symbol in the third preset image that is preset in the electronic device And determining which preset line number corresponds to each line according to the determined position relation of each line in the third image and the preset line number sequencing rule, and then determining the line number of each identification symbol in the third image according to the preset line number sequencing rule.
Taking the third preset image as fig. 4 and the third image acquired correspondingly as fig. 5 for example, as can be seen from fig. 4 and 5, when the electronic device acquires the target identification symbol, the line number of each identification symbol may be acquired first, when the line number is acquired, the size of the identification symbol in the line adjacent to the upper side of the identification symbol may be determined for any identification symbol in each line in the third image, whether the size is different from the size of the identification symbol, if the size is different from the size of the identification symbol, the line number of the identification symbol may be determined as the preset line number, since the third image includes identification symbols of three sizes, after determining that the two included identification symbols are different from the size of the identification symbol in the line adjacent to the upper side, the preset line numbers are 10 and 19, and the preset line numbers have an ordering rule that the line numbers in the third image are sequentially increased from top to bottom, it can be determined that the upper of the two rows has the row number 10 and the other row number 19. Thereby determining the line number corresponding to each identification symbol, and determining the corresponding target identification symbol according to the line number of each identification symbol.
In addition, since the identification symbols located in different rows in the third preset image, there is an identification symbol of a smaller size at the same position as the identification symbol of a larger size. That is, the identification symbols in the same column are present in the identification symbols in different rows in the third preset image, and because the third image is the image captured when the projection device projects the third preset image, the identification symbols in the same column are present in the identification symbols in different rows in the third image. Therefore, in the embodiment of the present invention, the electronic device determines the coordinate information of each identifier, and the electronic device determines, for each identifier, whether there is an identifier having the same position as the identifier and a different size from the identifier, where the position may be the origin at the upper left corner of the image, the horizontal right side is the x axis, the horizontal downward side is the y axis, the position is the same, and the abscissa of the finger, which may be the central point, is the same.
If the identification symbol with the same position as the identification symbol and different size from the identification symbol exists, the column where the identification symbol is located is a preset column where the identification symbol with the same position as the identification symbol with the larger size exists, the column numbers corresponding to the identification symbols with different sizes are determined to be preset column numbers according to the size relation of the column of the identification symbol, and the column number of each identification symbol in the third image can be determined according to the sequencing rule of the preset column numbers.
Taking the third preset image as fig. 4, and taking the acquired third image as fig. 5 for example, it can be known from the vertical line at the leftmost side (where the left side indicates the left and right sides shown in the figures) in fig. 4 and 5 that the identification symbol in the same column as the identification symbol in the middle row exists in the upper row (where the upper side indicates the upper and lower sides shown in the figures) in the third preset image; as can be seen from the middle vertical line in fig. 4 and 5, there is an identifier in the same column as the identifier in the lower row (where the lower direction is the upper and lower direction in the drawing); as can be seen from the vertical lines on the rightmost side of fig. 4 and 5 (where the left side indicates the left and right sides in the drawing), there are symbols in the upper row that are in the same column as the identifier in the middle row and the identifier in the lower row.
Therefore, after recognizing each identification symbol in the third preset image, the electronic device can determine whether the identification symbol of other sizes exists in the column where the identification symbol exists, and if the identification symbols of two other sizes exist, the column in which the identifier is located is the column corresponding to the rightmost vertical line in fig. 5, and if there is an identifier of another size, it is explained that the column in which the identification symbol is located is the column corresponding to the leftmost vertical line or the middle vertical line in figure 5, then in order to determine whether the column is a column in which there is an identifier in the same column as the middle row in the upper row in fig. 4, or a column in which there is an identifier in the same column as the middle row and the lower row in fig. 4, the determination may be made based on whether the identification symbol exists on the upper side or the lower side in fig. 5, thereby determining the column number of each column.
After the row number and the column number of each identification symbol in the third image are determined, the electronic device can determine the identification symbol as the target row number and the identification symbol as the target identification symbol according to the target row number and the target column number corresponding to the preset identification symbol to be searched.
In the embodiment of the invention, the third image acquired by the electronic equipment is acquired by the ultra-wide-angle image acquisition equipment, so that distortion occurs in the third image, and the line number and the column number of each identification symbol are determined line by line and column by column in the embodiment of the invention, so that the distortion problem of the ultra-wide-angle lens can be solved.
Fig. 6 is a schematic diagram of a projection correction process according to an embodiment of the present invention.
S601: the method comprises the steps of acquiring a first image which is acquired and contains a screen when a projection device projects a first preset image onto the screen, and acquiring a second image which contains the screen when the projection device projects a second preset image onto the screen, so as to obtain first coordinate information of the screen in the image.
S602: and when the projection equipment projects the third preset image onto the screen, the acquired third image containing the screen is acquired, the third image is identified, and second coordinate information of the identification symbol preset in the third image is acquired.
S603: and determining a target parameter for correcting the second coordinate information into third coordinate information according to the second coordinate information and the third coordinate information of the identifier in the third preset image.
S604: and determining target coordinate information of the first coordinate information in a preset image according to the target parameter and the first coordinate information of the screen in the first image.
S605: and adjusting the projection parameters of the projection equipment according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
Example 6:
fig. 7 is a schematic structural diagram of a projection correction apparatus according to an embodiment of the present invention, where the apparatus includes:
a determining module 701, configured to determine, according to an image including a screen and acquired when a projection device projects a preset image onto the screen, first coordinate information of the screen in the image and second coordinate information of a preset identifier, where the identifier is a symbol included in the preset image;
a processing module 702, configured to obtain third coordinate information of the identifier in the preset image, where the third coordinate information is pre-stored, and determine, according to the second coordinate information and the third coordinate information, a target parameter for correcting the second coordinate information to the third coordinate information; determining target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information;
an adjusting module 703 is configured to adjust the projection parameter of the projection device according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
In a possible implementation manner, the determining module 701 is specifically configured to acquire a first image including a screen when the projection device projects a first preset image onto the screen, and a second image including the screen when the projection device projects a second preset image onto the screen; wherein the first preset image is a white image, and the second preset image is a black image; for each pixel point, determining a difference value between a first brightness value of the pixel point on a first image and a second brightness value of the pixel point on a second image, judging whether the difference value is larger than a first preset numerical value, and if so, determining the pixel point to be a pixel point of a region where a screen in the first image is located; and determining first coordinate information of the screen in the first image according to the coordinate information of each pixel point of the area of the screen in the first image.
In a possible implementation manner, the determining module 701 is specifically configured to determine, according to coordinate information of each pixel point in an area where a screen is located in the first image, each second pixel point in the first image, where the second pixel point is located at a boundary of the screen; aiming at each second pixel point, acquiring other second pixel points which are less than a first preset number from the second pixel point in the second pixel point, and determining each slope of each other second pixel point and the second pixel point; determining a target slope of the second pixel point according to each slope and the corresponding weight value; and aiming at each second pixel point, acquiring the target slope of a second preset number of target second pixel points which are away from the second pixel point in the first preset direction, determining the slope difference value between the target slope of the target second pixel point and the target slope of the second pixel point, and if the absolute value of the slope difference value is larger than a second preset value, determining the first coordinate information of the screen in the first image according to the coordinate information of each second pixel point between the second pixel point and the target second pixel point in the first preset direction.
In a possible implementation manner, the determining module 701 is specifically configured to acquire a third image including the screen, which is acquired when the projection device projects the third preset image onto the screen; the third preset image comprises identification symbols with at least two sizes, the identification symbols with each size are at least positioned in two adjacent rows, each row comprises identification symbols with one size, and identification symbols with smaller sizes, which are positioned in different rows, exist at the same positions as the identification symbols with larger sizes; and identifying the third image, acquiring each identification symbol in the third image, determining a target identification symbol meeting requirements according to the size of each identification symbol in the third image, and acquiring second coordinate information of the target identification symbol in the third image.
In a possible implementation manner, the determining module 701 is specifically configured to, for a pixel value of each pixel point in the third image, determine, if the pixel value is greater than a third preset value, that the pixel point is a pixel point in a region where an identifier is located, and obtain, according to each pixel point in the third image that is in the region where the identifier is located, each identifier in the third image; and the identification symbol in the preset image is a white identification symbol.
In a possible implementation manner, the determining module 701 is specifically configured to determine the corresponding target identifier in the third image according to the size of the identifier in each line in the third image and the size relationship between the identifiers in each line in the third preset image.
Example 7:
fig. 8 is a schematic structural diagram of a chip according to an embodiment of the present invention. The chip includes one or more (including two) processors 801 and a communication interface 802.
Optionally, the chip also includes a memory 803, and the memory 803 may include both read-only memory and random access memory, and provides operating instructions and data to the processor. The portion of memory may also include non-volatile random access memory (NVRAM).
In some embodiments, as shown in FIG. 8, memory 803 stores elements, execution modules or data structures, or a subset thereof, or an expanded set thereof.
As shown in fig. 8, in the embodiment of the present invention, by calling an operation instruction stored in the memory 803 (the operation instruction may be stored in an operating system), a corresponding operation is performed.
As shown in fig. 8, a processor 801, which may also be referred to as a Central Processing Unit (CPU), controls the processing operations of the head-end device.
As shown in fig. 8, the memory 803 may include a read-only memory and a random access memory, and provides instructions and data to the processor. A portion of the memory 803 may also include NVRAM. For example, the application communication interfaces and memory are coupled together by a bus system 804, where the bus system 804 may include a power bus, a control bus, a status signal bus, etc., in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 804 in FIG. 8.
The method disclosed by the embodiment of the invention can be applied to a processor or realized by the processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The processor may be a general purpose processor, a Digital Signal Processor (DSP), an ASIC, an FPGA (field-programmable gate array) or other programmable logic device, discrete gate or transistor logic device, or discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.
Example 9:
on the basis of the foregoing embodiments, an embodiment of the present invention further provides a computer-readable storage medium, in which a computer program executable by an electronic device is stored, and when the program is run on the electronic device, the electronic device is caused to execute the following steps:
the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of:
determining first coordinate information of a screen and second coordinate information of a preset identification symbol in an image according to the acquired image containing the screen when a preset image is projected onto the screen by a projection device, wherein the identification symbol is a symbol contained in the preset image;
acquiring third coordinate information of the pre-stored identification symbol in the preset image, and determining to correct the second coordinate information into a target parameter of the third coordinate information according to the second coordinate information and the third coordinate information; determining target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information;
and adjusting the projection parameters of the projection equipment according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
In a possible embodiment, the determining, according to an image including a screen and acquired when a projection device projects a preset image onto the screen, first coordinate information of the screen in the image includes:
acquiring a first image which is acquired when a first preset image is projected onto a screen by a projection device and contains the screen, and acquiring a second image which is acquired when a second preset image is projected onto the screen by the projection device and contains the screen; wherein the first preset image is a white image, and the second preset image is a black image;
for each pixel point, determining a difference value between a first brightness value of the pixel point on a first image and a second brightness value of the pixel point on a second image, judging whether the difference value is larger than a first preset numerical value, and if so, determining the pixel point to be a pixel point of a region where a screen in the first image is located;
and determining first coordinate information of the screen in the first image according to the coordinate information of each pixel point of the area of the screen in the first image.
In a possible implementation manner, the determining, according to the coordinate information of each pixel point in the area where the screen is located in the first image, the first coordinate information of the screen in the first image includes:
determining each second pixel point at the boundary of the screen in the first image according to the coordinate information of each pixel point in the area of the screen in the first image;
aiming at each second pixel point, acquiring other second pixel points which are less than a first preset number from the second pixel point in the second pixel point, and determining each slope of each other second pixel point and the second pixel point; determining a target slope of the second pixel point according to each slope and the corresponding weight value;
and aiming at each second pixel point, acquiring the target slope of a second preset number of target second pixel points which are away from the second pixel point in the first preset direction, determining the slope difference value between the target slope of the target second pixel point and the target slope of the second pixel point, and if the absolute value of the slope difference value is larger than a second preset value, determining the first coordinate information of the screen in the first image according to the coordinate information of each second pixel point between the second pixel point and the target second pixel point in the first preset direction.
In a possible embodiment, the determining, according to the image including the screen collected when the projection device projects the preset image onto the screen, the second coordinate information of the identification symbol preset in the image includes:
acquiring a third image which is acquired and contains the screen when the projection equipment projects the third preset image onto the screen; the third preset image comprises identification symbols with at least two sizes, the identification symbols with each size are at least positioned in two adjacent rows, each row comprises identification symbols with one size, and identification symbols with smaller sizes, which are positioned in different rows, exist at the same positions as the identification symbols with larger sizes;
and identifying the third image, acquiring each identification symbol in the third image, determining a target identification symbol meeting requirements according to the size of each identification symbol in the third image, and acquiring second coordinate information of the target identification symbol in the third image.
In a possible embodiment, said obtaining each identifier in said third image comprises:
aiming at the pixel value of each pixel point in the third image, if the pixel value is larger than a third preset numerical value, determining that the pixel point is the pixel point of the area where the identification symbol is located, and acquiring each identification symbol in the third image according to each pixel point in the third image, which is the area where the identification symbol is located; and the identification symbol in the preset image is a white identification symbol.
In a possible embodiment, said determining a target identifier satisfying the requirement according to the size of each identifier in said third image comprises:
and determining a corresponding target identification symbol in the third image according to the size of the identification symbol of each line in the third image and the size relation of the identification symbol positioned in each line in the third preset image.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. A method of projection correction, the method comprising:
determining first coordinate information of a screen and second coordinate information of a preset identification symbol in an image according to the acquired image containing the screen when a preset image is projected onto the screen by a projection device, wherein the identification symbol is a symbol contained in the preset image;
acquiring third coordinate information of the pre-stored identification symbol in the preset image, and determining to correct the second coordinate information into a target parameter of the third coordinate information according to the second coordinate information and the third coordinate information; determining target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information;
and adjusting the projection parameters of the projection equipment according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
2. The method of claim 1, wherein determining the first coordinate information of the screen in the image according to the image including the screen collected when the projection device projects the preset image onto the screen comprises:
acquiring a first image which is acquired when a first preset image is projected onto a screen by a projection device and contains the screen, and acquiring a second image which is acquired when a second preset image is projected onto the screen by the projection device and contains the screen; wherein the first preset image is a white image, and the second preset image is a black image;
for each pixel point, determining a difference value between a first brightness value of the pixel point on a first image and a second brightness value of the pixel point on a second image, judging whether the difference value is larger than a first preset numerical value, and if so, determining the pixel point to be a pixel point of a region where a screen in the first image is located;
and determining first coordinate information of the screen in the first image according to the coordinate information of each pixel point of the area of the screen in the first image.
3. The method according to claim 2, wherein the determining the first coordinate information of the screen in the first image according to the coordinate information of each pixel point of the area where the screen is located in the first image comprises:
determining each second pixel point at the boundary of the screen in the first image according to the coordinate information of each pixel point in the area of the screen in the first image;
aiming at each second pixel point, acquiring other second pixel points which are less than a first preset number from the second pixel point in the second pixel point, and determining each slope of each other second pixel point and the second pixel point; determining a target slope of the second pixel point according to each slope and the corresponding weight value;
and aiming at each second pixel point, acquiring the target slope of a second preset number of target second pixel points which are away from the second pixel point in the first preset direction, determining the slope difference value between the target slope of the target second pixel point and the target slope of the second pixel point, and if the absolute value of the slope difference value is larger than a second preset value, determining the first coordinate information of the screen in the first image according to the coordinate information of each second pixel point between the second pixel point and the target second pixel point in the first preset direction.
4. The method of claim 1, wherein determining the second coordinate information of the identifier preset in the image according to the image including the screen collected when the projection device projects the preset image onto the screen comprises:
acquiring a third image which is acquired and contains the screen when the projection equipment projects the third preset image onto the screen; the third preset image comprises identification symbols with at least two sizes, the identification symbols with each size are at least positioned in two adjacent rows, each row comprises identification symbols with one size, and identification symbols with smaller sizes, which are positioned in different rows, exist at the same positions as the identification symbols with larger sizes;
and identifying the third image, acquiring each identification symbol in the third image, determining a target identification symbol meeting requirements according to the size of each identification symbol in the third image, and acquiring second coordinate information of the target identification symbol in the third image.
5. The method of claim 4, wherein said obtaining each identifier in the third image comprises:
aiming at the pixel value of each pixel point in the third image, if the pixel value is larger than a third preset numerical value, determining that the pixel point is the pixel point of the area where the identification symbol is located, and acquiring each identification symbol in the third image according to each pixel point in the third image, which is the area where the identification symbol is located; and the identification symbol in the preset image is a white identification symbol.
6. The method of claim 4, wherein determining a target identifier that meets the requirements based on the size of each identifier in the third image comprises:
and determining a corresponding target identification symbol in the third image according to the size of the identification symbol of each line in the third image and the size relation of the identification symbol positioned in each line in the third preset image.
7. A projection correction apparatus, characterized in that the apparatus comprises:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining first coordinate information of a screen in an image and second coordinate information of a preset identification symbol according to the acquired image containing the screen when a preset image is projected onto the screen by a projection device, and the identification symbol is the symbol contained in the preset image;
the processing module is used for acquiring prestored third coordinate information of the identification symbol in the preset image, and determining target parameters for correcting the second coordinate information into the third coordinate information according to the second coordinate information and the third coordinate information; determining target coordinate information of the first coordinate information in the preset image according to the target parameter and the first coordinate information;
and the adjusting module is used for adjusting the projection parameters of the projection equipment according to the target coordinate information and the fourth coordinate information of the boundary in the preset image.
8. A projection device, characterized in that the projection device comprises: the display control assembly, light source, light valve, projection lens;
the display control component is configured to:
adjusting the projection parameters according to the target coordinate information and fourth coordinate information of the boundary in the preset image;
for storing and executing executable instructions for carrying out the steps of projection correction according to any of claims 1-6.
9. A chip comprising a processor and a communication interface coupled to the processor, the processor being configured to execute a computer program or instructions to implement the steps of the projection correction method according to any of claims 1-6.
10. A computer-readable storage medium, characterized in that it stores a computer program which, when being executed by a processor, carries out the steps of the projection correction method according to any one of claims 1 to 6.
CN202111531019.5A 2021-12-14 2021-12-14 Projection correction method and device, projection equipment, chip and medium Active CN114339172B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111531019.5A CN114339172B (en) 2021-12-14 2021-12-14 Projection correction method and device, projection equipment, chip and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111531019.5A CN114339172B (en) 2021-12-14 2021-12-14 Projection correction method and device, projection equipment, chip and medium

Publications (2)

Publication Number Publication Date
CN114339172A true CN114339172A (en) 2022-04-12
CN114339172B CN114339172B (en) 2024-04-09

Family

ID=81050026

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111531019.5A Active CN114339172B (en) 2021-12-14 2021-12-14 Projection correction method and device, projection equipment, chip and medium

Country Status (1)

Country Link
CN (1) CN114339172B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115086625A (en) * 2022-05-12 2022-09-20 峰米(重庆)创新科技有限公司 Correction method, device and system of projection picture, correction equipment and projection equipment
CN115134569A (en) * 2022-06-22 2022-09-30 青岛海信激光显示股份有限公司 Image display method and projector

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1047951A (en) * 1989-06-07 1990-12-19 菲利浦光灯制造公司 The modulating system of projection kinescope
CA2025624A1 (en) * 1990-09-18 1992-03-19 Peter Joseph Inova Seamless video display
US20050052623A1 (en) * 2003-05-23 2005-03-10 Chao-Wang Hsiung Projecting system
KR20110082754A (en) * 2010-01-12 2011-07-20 엘지전자 주식회사 Mobile terminal and image projection method for mobile terminal
CN102271237A (en) * 2011-02-25 2011-12-07 鸿富锦精密工业(深圳)有限公司 Projection device and method thereof for correcting trapezoidal distortion
US20140333587A1 (en) * 2013-05-07 2014-11-13 Sony Corporation Interactive projection apparatus and the positioning method of the interactive pen
CN105141866A (en) * 2015-09-06 2015-12-09 青岛海信信芯科技有限公司 Projected image correction method and device
CN107728410A (en) * 2017-09-30 2018-02-23 歌尔科技有限公司 The image distortion correcting method and laser-projector of laser-projector
US20180220113A1 (en) * 2017-02-01 2018-08-02 Canon Kabushiki Kaisha Projection display system, information processing apparatus, information processing method, and storage medium therefor
CN108511052A (en) * 2017-02-24 2018-09-07 西门子保健有限责任公司 Method and projection for determining projection data set determine system
CN109104596A (en) * 2017-06-21 2018-12-28 中强光电股份有限公司 Optical projection system and the bearing calibration for showing image
CN111435985A (en) * 2019-01-15 2020-07-21 精工爱普生株式会社 Projector control method, projector and projection system
CN111726668A (en) * 2020-06-05 2020-09-29 青岛信芯微电子科技股份有限公司 FPGA, double-screen television, startup display method, equipment and medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1047951A (en) * 1989-06-07 1990-12-19 菲利浦光灯制造公司 The modulating system of projection kinescope
CA2025624A1 (en) * 1990-09-18 1992-03-19 Peter Joseph Inova Seamless video display
US20050052623A1 (en) * 2003-05-23 2005-03-10 Chao-Wang Hsiung Projecting system
KR20110082754A (en) * 2010-01-12 2011-07-20 엘지전자 주식회사 Mobile terminal and image projection method for mobile terminal
CN102271237A (en) * 2011-02-25 2011-12-07 鸿富锦精密工业(深圳)有限公司 Projection device and method thereof for correcting trapezoidal distortion
US20140333587A1 (en) * 2013-05-07 2014-11-13 Sony Corporation Interactive projection apparatus and the positioning method of the interactive pen
CN105141866A (en) * 2015-09-06 2015-12-09 青岛海信信芯科技有限公司 Projected image correction method and device
US20180220113A1 (en) * 2017-02-01 2018-08-02 Canon Kabushiki Kaisha Projection display system, information processing apparatus, information processing method, and storage medium therefor
CN108511052A (en) * 2017-02-24 2018-09-07 西门子保健有限责任公司 Method and projection for determining projection data set determine system
CN109104596A (en) * 2017-06-21 2018-12-28 中强光电股份有限公司 Optical projection system and the bearing calibration for showing image
CN107728410A (en) * 2017-09-30 2018-02-23 歌尔科技有限公司 The image distortion correcting method and laser-projector of laser-projector
CN111435985A (en) * 2019-01-15 2020-07-21 精工爱普生株式会社 Projector control method, projector and projection system
CN111726668A (en) * 2020-06-05 2020-09-29 青岛信芯微电子科技股份有限公司 FPGA, double-screen television, startup display method, equipment and medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115086625A (en) * 2022-05-12 2022-09-20 峰米(重庆)创新科技有限公司 Correction method, device and system of projection picture, correction equipment and projection equipment
CN115086625B (en) * 2022-05-12 2024-03-15 峰米(重庆)创新科技有限公司 Correction method, device and system for projection picture, correction equipment and projection equipment
CN115134569A (en) * 2022-06-22 2022-09-30 青岛海信激光显示股份有限公司 Image display method and projector
CN115134569B (en) * 2022-06-22 2024-04-02 青岛海信激光显示股份有限公司 Image display method and projector

Also Published As

Publication number Publication date
CN114339172B (en) 2024-04-09

Similar Documents

Publication Publication Date Title
US9299321B2 (en) Multi-projection system
US6932480B2 (en) Image processing system, projector, program, information storage medium and image processing method
CN100547478C (en) Projector and method for controlling projection
US7422331B2 (en) Image processing system, projector, and image processing method
JP3925521B2 (en) Keystone correction using part of the screen edge
US11895445B2 (en) Projection video display apparatus with variable light adjustment for multi-screen projection mode
CN114339172A (en) Projection correction method and device, projection equipment, chip and medium
JP2009200613A (en) Projector and display adjusting method of projector
US10638100B2 (en) Projector, multi-projection system, and method for controlling projector
JP2011091516A (en) Projector and display adjustment method of the projector
JP2011199717A (en) Projection type display device and image display method
CN114567762B (en) Correction method for projection image in projection plane and projection equipment
JP2010197487A (en) Display
JP2010130481A (en) Image projection apparatus
JP2009060393A (en) Document camera device, image processing device, image processing method, and program
EP3843078A1 (en) Method of controlling display device, and display device
CN114339182B (en) Focusing method of projection device, projection device and storage medium
US20240040077A1 (en) Image output apparatus including a plurality of projection parts and control method thereof
US20230254459A1 (en) Image projection apparatus
US12010465B2 (en) Projection video display apparatus with variable light adjustment for multiscreen projection mode
CN116033132A (en) Fault processing method of projection equipment and related equipment
JP2022075528A (en) Projection system and gamma curve correction method
JP2022077773A (en) Projection control unit, image projection system, method for actuating projection control unit, and program
JP2006217370A (en) Image processing system, projector, program, information storage medium, and image processing method
CN117692614A (en) Image display method, device, projection equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant