WO2022179108A1

WO2022179108A1 - Projection correction method and apparatus, storage medium, and electronic device

Info

Publication number: WO2022179108A1
Application number: PCT/CN2021/122446
Authority: WO
Inventors: 胡震宇; 付啸天; 孙世攀; 张聪
Original assignee: 深圳市火乐科技发展有限公司
Priority date: 2021-02-24
Filing date: 2021-09-30
Publication date: 2022-09-01
Also published as: CN113365040B; CN113365041A; CN112584116A; WO2022179109A1; CN112584116B; CN113365041B; CN113365040A

Abstract

The present invention relates to the technical field of projection, and relates to a projection correction method and apparatus, a storage medium, and an electronic device. The projection correction method comprises: projecting a correction image onto an imaging medium to obtain a projection correction image displayed on the imaging medium, and obtaining an acquired image; determining first position information of each second mark pattern in the acquired image; determining, according to the first position information of each second mark pattern and second position information of each first mark pattern, a first boundary formed by the projection correction image in the acquired image; determining a target projection area on the imaging medium according to the first boundary; and projecting an image to be projected onto the imaging medium according to the target projection area, so as to display, in the target projection area, information comprised in the image to be projected. According to the present invention, it can be ensured that distortion does not occur when the image to be projected is projected onto the imaging medium, the projection effect satisfying requirements of a user can be obtained, manual adjustment of the user is not needed, the operation is simple, and the efficiency of correcting the projection is high.

Description

Projection correction method, device, storage medium and electronic device

CROSS-REFERENCE TO RELATED APPLICATIONS

This disclosure claims the priority of a Chinese patent application with application number 202110206396.5 and entitled "Projection Correction Method, Apparatus, Storage Medium and Electronic Device" filed with the China Patent Office on February 24, 2021, the entire contents of which are incorporated by reference in in this disclosure.

technical field

The present disclosure relates to the field of projection technology, and in particular, to a projection correction method, device, storage medium and electronic device.

Background technique

In order to meet people's viewing needs for large-size screens, projection equipment is widely used in homes, offices, schools and entertainment venues. The projection device may project onto an imaging medium to display a corresponding projected image on the imaging medium, where the imaging medium may be, for example, a projection screen, a wall or a hard screen. However, when the projection device projects to the imaging medium, the projected image may be distorted, which affects the projection effect of the projection device. For example, for short-throw or ultra-short-throw projection equipment, pincushion distortion or barrel distortion may occur in the projected image projected by the projection equipment on the imaging medium due to the limitations of the design process, processing technology and assembly process of the projector. , this distortion will not disappear with the relative position of the projection device and the imaging medium.

SUMMARY OF THE INVENTION

In order to solve the problems existing in the related art, the present disclosure provides a projection correction method, apparatus, storage medium and electronic device.

In order to achieve the above object, according to a first aspect of the embodiments of the present disclosure, a projection correction method is provided, which is applied to a projection device, and the method includes:

Projecting a preset corrected image onto an imaging medium to obtain a projected corrected image displayed on the imaging medium, and acquiring a captured image; the captured image is determined according to an image obtained by photographing the projected corrected image by an image acquisition device The corrected image includes a plurality of first mark patterns, and the captured image includes a second mark pattern corresponding to each of the first mark patterns;

determining first position information of each of the second marking patterns in the captured image;

determining, according to the first position information of each of the second marking patterns and the second position information of each of the first marking patterns, a first boundary formed by the projection correction image in the captured image;

determining a target projection area on the imaging medium according to the first boundary;

The to-be-projected image is projected onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area.

According to a second aspect of the embodiments of the present disclosure, there is provided a projection correction apparatus, which is applied to a projection device, the apparatus comprising:

an acquisition module, configured to project a preset corrected image onto an imaging medium to obtain a projected corrected image displayed on the imaging medium, and acquire a captured image; the captured image is to capture the projected corrected image according to an image capturing device It is determined from the obtained image that the corrected image includes a plurality of first mark patterns, and the captured image includes a second mark pattern corresponding to each of the first mark patterns;

a processing module, configured to determine the first position information of each of the second marking patterns in the captured image;

The processing module is further configured to determine that the projection correction image is formed in the captured image according to the first position information of each of the second marking patterns and the second position information of each of the first marking patterns the first boundary of ;

The processing module is further configured to determine a target projection area on the imaging medium according to the first boundary;

The correction module is configured to project the to-be-projected image onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area.

According to a third aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, implements the steps of the method in any one of the above first aspects.

According to a fourth aspect of the embodiments of the present disclosure, there is provided an electronic device, comprising:

a memory on which a computer program is stored;

A processor for executing the computer program in the memory to implement the steps of any one of the methods in the first aspect.

Through the above technical solutions, the present disclosure first obtains a projected corrected image displayed on the imaging medium by projecting a preset corrected image onto the imaging medium, and acquires a captured image, wherein the captured image is a projected corrected image captured by an image capturing device The obtained image is determined, the corrected image includes a plurality of first marking patterns, the acquired image includes a second marking pattern corresponding to each first marking pattern, and then the first position of each second marking pattern in the acquired image is determined information, and according to the first position information of each second mark pattern and the second position information of each first mark pattern, determine the first boundary formed by the projection correction image in the captured image, and then according to the first boundary, determine the The target projection area on the imaging medium, and then the to-be-projected image is projected onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area. In the present disclosure, by determining a target projection area without distortion in the projection correction image, and projecting the to-be-projected image onto the imaging medium according to the target projection area, it can ensure that the to-be-projected image will not be distorted when projecting the to-be-projected image onto the imaging medium, and can obtain The projection effect that meets the user's requirements does not require manual adjustment by the user, the operation is simple, and the efficiency of correcting the projection is high.

Other features and advantages of the present disclosure will be described in detail in the detailed description that follows.

Description of drawings

The accompanying drawings are used to provide a further understanding of the present disclosure, and constitute a part of the specification, and together with the following detailed description, are used to explain the present disclosure, but not to limit the present disclosure. In the attached image:

1 is a flowchart of a projection correction method according to an exemplary embodiment;

FIG. 2 is a schematic diagram of a corrected image according to an exemplary embodiment;

Fig. 3 is a flow chart of step 101 shown in the embodiment shown in Fig. 1;

Fig. 4 is a flow chart of step 103 shown in the embodiment shown in Fig. 1;

Fig. 5 is a flow chart of step 104 shown in the embodiment shown in Fig. 1;

6 is a block diagram of a projection correction apparatus according to an exemplary embodiment;

Fig. 7 is a block diagram of an electronic device according to an exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

Before introducing the projection correction method, device, storage medium, and electronic device provided by the present disclosure, the application scenarios involved in various embodiments of the present disclosure are first introduced, and the application scenarios may include projection devices, image acquisition devices, and imaging media. The projection device can project the image or video played by itself onto the imaging medium to display the corresponding projected image on the imaging medium. The projection device may include, but is not limited to, a projector, a projection television, and the like. For example, the projection device may be a short-throw or ultra-short-throw projector, or a telephoto projector. The image acquisition device is used to capture the projection image displayed on the imaging medium. The image acquisition device can be a camera module (such as a camera, an image sensor, etc.) mounted on the projection device itself, or it can be connected to the projection device through a wired or wireless connection. The separated and movable camera module can also be a terminal with a shooting function (ie, third-party hardware), for example, the terminal can be a smart phone, a tablet computer, a smart watch, a smart bracelet, a PDA (English: Personal Digital Assistant, Chinese: personal digital assistant) and other terminals. The imaging medium may be a projection screen, a wall, a hard screen, or any other device capable of displaying the projection of the projection device, which is not specifically limited in the present disclosure.

In a scenario, when the projection image projected by the projection device on the imaging medium has pincushion distortion or barrel distortion, the projection image can be corrected in the manner shown in the following embodiment:

Fig. 1 is a flowchart of a projection correction method according to an exemplary embodiment. As shown in Figure 1, applied to a projection device, the method may include the following steps:

Step 101: Project a preset corrected image onto an imaging medium to obtain a projected corrected image displayed on the imaging medium, and acquire a captured image.

Wherein, the collected image is determined according to an image obtained by photographing the projected corrected image by the image collecting device, the corrected image includes a plurality of first mark patterns, and the collected image includes a second mark pattern corresponding to each of the first mark patterns.

For example, when the projection device projects an image onto the imaging medium, if the user finds that the projection image corresponding to the image has pincushion distortion or barrel distortion, a correction instruction can be sent to the projection device to correct the projected image. . For example, a corresponding correction button may be provided on the projection device, and the user may send a correction instruction to the projection device by pressing the correction button. Afterwards, the projection device can send corresponding prompt information to the user to prompt the user to adjust the position of the image capture device to a suitable position, so that the image capture device can accurately capture the projected image of the projection device on the imaging medium, so as to more accurately capture the image. Correct the projected image.

Specifically, when the image acquisition device is a movable camera module separated from the projection device, after receiving the correction instruction, the projection device can first project a prompt image on the imaging medium to prompt the user to move to the designated location Mobile camera module. For example, the camera module can shoot the prompt image, and send the image obtained by shooting the prompt image to the projection device, and the projection device determines whether the image obtained by the camera module shooting the prompt image and the prompt image meet the preset adjustment conditions. If the preset adjustment conditions are met, the projection device may determine that the user has adjusted the camera module to an appropriate position. Otherwise, the projection device may determine that the user has not adjusted the camera module to a proper position, and the projection device needs to project a new prompt image again to prompt the user to continue adjusting the camera module. The preset adjustment condition may be, for example, that the image obtained by the camera module shooting the prompt image includes the prompt image, and the proportion of the prompt image to the image obtained by the camera module shooting the prompt image is greater than or equal to a threshold (eg 50%). After the camera module is adjusted to an appropriate position, the projection device can project the corrected image including a plurality of first marking patterns onto the imaging medium to obtain the projected corrected image displayed on the imaging medium, and then the projected corrected image is displayed by the camera module. Shooting is performed, and the image obtained by shooting the projection-corrected image is sent to the projection device. The image obtained by shooting the projection correction image is preprocessed by the projection device (for example, the preprocessing may be: image format conversion, segmentation processing, image size conversion, etc.) to obtain the captured image. Wherein, the captured image includes a second marking pattern corresponding to each first marking pattern.

When the image acquisition device is a mobile phone with a shooting function, after receiving the correction instruction, the projection device can first project a prompt image on the imaging medium to prompt the user to use the mobile phone to pair the mobile phone with the projection device. After successful pairing, the projection device can project the corrected image onto the imaging medium to obtain the projected corrected image, and then prompts the user to align the camera interface of the mobile phone with the projected corrected image, and prompts the user to use the mobile phone to shoot the projected corrected image. Afterwards, the projection device can acquire the image obtained by shooting the projection correction image by the mobile phone, and preprocess the image obtained by shooting the projection correction image to obtain the captured image. Further, in order to reduce the amount of data that the projection device needs to process, the mobile phone can also preprocess the image obtained by shooting the projection correction image to obtain the captured image, and send the obtained captured image to the projection device.

The corrected image may be any image including a plurality of first marking patterns. As shown in a in Figure 2, when the corrected image is a checkerboard image, the first marking pattern can be any square in the checkerboard, and the projection device projects the corrected image onto the imaging medium, actually projecting the checkerboard onto the imaging medium. At this time, the image obtained by the image acquisition device shooting the projection-corrected image also includes the checkerboard, then the captured image obtained by preprocessing the image obtained by shooting the projection-corrected image also includes the checkerboard (that is, the captured image is also a checkerboard image) , the second mark pattern can be any square in the checkerboard. For another example, as shown in b in FIG. 2 , when the corrected image is an image including multiple circles, the first marking pattern can be any one of the multiple circles, and the image obtained by shooting the projected corrected image is also will include multiple circles, then the captured image obtained by preprocessing the image obtained by shooting the projection correction image also includes multiple circles (that is, the captured image is also an image including multiple circles), then the second mark pattern can be Any of multiple circles.

Step 102: Determine the first position information of each second mark pattern in the captured image.

In this step, the projection device may detect each second marker pattern in the captured image, and determine the first position information of each detected second marker pattern. Taking the corrected image as a checkerboard image and the first marking pattern as any square in the checkerboard as an example, the projection device can detect the checkerboard in the captured image, and determine each square included in the checkerboard in the captured image For example, the coordinates of the four corners of each square can be used as the location information of the square. Afterwards, the projection device may use the position information of each square included in the checkerboard in the captured image as the first position information.

Step 103 , according to the first position information of each second mark pattern and the second position information of each first mark pattern, determine a first boundary formed by the projection correction image in the captured image.

For example, prior information of the corrected image may be pre-stored in the projection device, and the prior information may include position information of the boundary of the corrected image and second position information of each first marker pattern in the corrected image. For example, when the corrected image is a checkerboard image, the coordinates of the four corners of each square (ie, the first marking pattern) included in the checkerboard in the corrected image may be used as the second position information of the square. Then, the projection device may determine the positional relationship between each first marking pattern and the boundary of the corrected image according to the second position information of each first marking pattern. Since the collected image is determined according to the image obtained by shooting the projected corrected image by the image collecting device, and the projected corrected image is obtained by projecting the corrected image. Therefore, the positional relationship between each second marker pattern and the first boundary formed by the projected corrected image in the captured image is the same as the positional relationship between each first marker pattern and the boundary of the corrected image. Then, the projection device can determine the first boundary formed by the projected corrected image in the captured image according to the positional relationship between each first marking pattern and the boundary of the corrected image.

Step 104: Determine the target projection area on the imaging medium according to the first boundary.

Further, after determining the first boundary, the projection device can first calculate the homography matrix between the imaging plane of the image acquisition device and the projection plane where the imaging medium is located, for example, when the main optical axis of the projector of the projection device is When parallel to the normal vector of the imaging medium, the projection plane and the projection plane of the light projector can be regarded as the same plane. Therefore, the homography matrix between the imaging plane and the projection plane can be calculated by using the first position information of each second marking pattern and the second position information of each first marking pattern, and by using the first position information and the second position information For calculating the homography matrix between the imaging plane and the projection plane with the two position information, reference may be made to the method described in the related art, and details are not repeated here. Afterwards, the projection device can map the first boundary on the projection plane through the homography matrix, so as to obtain the boundary corresponding to the first boundary on the imaging medium. Then, the projection device may determine a target projection area that satisfies the preset shape condition from the area enclosed by the boundary corresponding to the first boundary on the imaging medium. The preset shape condition may be, for example, the largest rectangular area with a size of 16:9 in the area enclosed by the boundary corresponding to the first boundary on the imaging medium, as the target projection area.

Step 105: Project the to-be-projected image onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area.

For example, after determining the target projection area, the projection device may first determine the third position information of the correction point corresponding to the target projection area, for example, the coordinates corresponding to each correction point may be used as the third position information. The correction point includes the corner points of the target projection area and the midpoint of each side of the target projection area, that is, the correction point includes 4 correction corner points and 4 correction midpoints. Then, the projection device can project the to-be-projected image onto the imaging medium according to the third position information to display the information included in the to-be-projected image in the target projection area, that is, to display the projection image corresponding to the to-be-projected image in the target projection area. Specifically, the projection device can process the to-be-projected image according to the coordinates of the eight correction points, so that when the projection device projects the to-be-projected image onto the imaging medium, the projection image corresponding to the to-be-projected image is no longer distorted. For example, if barrel distortion occurs in the previous projected image, the four correction corner points can be used as fixed points, and the to-be-projected image can be pulled back to the four correction midpoints. If pincushion distortion occurs in the previous projection image, the four correction midpoints can be used as fixed points, and the to-be-projected image can be pulled back to the four correction corner points.

It should be noted that if the projection image corresponding to the to-be-projected image is still distorted after the correction is completed, steps 101 to 105 may be repeated until the projection image corresponding to the to-be-projected image is no longer distorted.

FIG. 3 is a flowchart of step 101 shown in the embodiment shown in FIG. 1 . As shown in FIG. 3, step 101 may include the following steps:

Step 1011: Convert the image obtained by the image acquisition device to shoot the projection corrected image into a specified format to obtain a first image.

Step 1012 , perform segmentation processing on the first image to remove the area of the first image except the projection corrected image to obtain a second image.

Step 1013: Convert the second image to a specified image size to obtain a captured image.

For example, after receiving the image obtained by shooting the projection correction image sent by the image acquisition device, the projection device needs to preprocess the image obtained by shooting the projection correction image, so as to obtain a standardized acquisition image, so that the projection image can be subsequently processed. Make corrections. Specifically, the image obtained by shooting the projection correction image may be converted into a specified format to obtain the first image, and the specified format may be, for example, a BMP (English: Bitmap, Chinese: Bitmap File) graphic file format. The image obtained by shooting the projection-corrected image may also include other regions than the projection-corrected image. If the first image is directly used to correct the projection image, noise and data volume in subsequent processing will be increased. In order to reduce the noise and data volume in the subsequent processing, the projection device may perform segmentation processing on the first image (for example, a coarse-grained segmentation method may be used) to remove the area of the first image except the projection corrected image, and obtain the first image. Second image. Then, the projection device may convert the second image into a specified image size (for example: 720P), and use the converted second image as a captured image. Further, the projection device can also perform histogram equalization processing on the acquired image, and adjust the white balance and exposure time of the acquired image, so as to improve the quality of the acquired image.

It should be noted that, the second image obtained after the first image is segmented may still contain other regions than the projection corrected image. That is to say, preprocessing the image obtained by shooting the projection correction image is actually a coarse-grained processing method, and the acquired captured image does not only contain the projection correction image.

FIG. 4 is a flowchart of step 103 shown in the embodiment shown in FIG. 1 . As shown in FIG. 4, step 103 may include the following steps:

Step 1031: Determine the positional relationship between each first marking pattern and the second boundary of the corrected image according to each second positional information, where the positional relationship is used to represent the distance between the first marking pattern and the second boundary.

Step 1032, according to the positional relationship and each first positional information, determine the first region corresponding to the projection correction image in the captured image.

Illustratively, the projection device may calculate the distance between each first marking pattern and the second boundary according to the position information of the second boundary of the corrected image and the second position information of each first marking pattern in the prior information of the corrected image, to obtain the positional relationship between the first marking pattern and the second boundary. Then, according to the positional relationship between each first marking pattern and the second boundary, the projection device can use the proportional relationship between the pixels of the corrected image and the pixels of the captured image to determine the second marking pattern corresponding to the first marking pattern and the undetermined boundary positional relationship. Afterwards, the projection device can use the positional relationship between each second marking pattern and the pending boundary to determine the pending boundary corresponding to the projection correction image in the captured image. Then, the undetermined boundary is expanded outward by a specified pixel distance (for example: 20 pixels), and the area enclosed by the outwardly expanded undetermined boundary is used as the first area. Wherein, the undetermined boundary can be understood as a pre-assumed first boundary, and the first area can be understood as the approximate range of the projected corrected image in the captured image.

Step 1033: Determine the second area from the first area according to the color feature of the first area.

Step 1034: Perform edge recognition on the second area to obtain the first boundary.

Further, the projection device can extract the color feature of the first area, and according to the color feature of the first area, combined with the color feature difference between the second boundary and the surrounding area in the prior information of the corrected image, search for the color feature from the first area. The area with the same difference in color characteristics is used as the second area. Then, the projection device may perform edge recognition on the second area to recognize the boundary corresponding to the second area, and use the boundary as the first boundary. Wherein, to obtain the first boundary by performing edge recognition on the second region, reference may be made to the manner described in the related art, which will not be repeated here. It should be noted that the process of obtaining the first boundary is actually a fine-grained processing manner to further remove other regions in the captured image except the projection corrected image.

FIG. 5 is a flowchart of step 104 shown in the embodiment shown in FIG. 1 . As shown in FIG. 5, step 104 may include the following steps:

Step 1041: Determine a transformation matrix according to the first position information and the second position information.

Step 1042: Determine a third boundary corresponding to the first boundary on the imaging medium according to the transformation matrix.

For example, after determining the first boundary, the projection device may first calculate the transformation between the imaging plane and the projection plane according to the first position information of each second marker pattern and the second position information of each first marker pattern. A matrix (eg: a homography matrix). Afterwards, the projection device can use the transformation matrix to map the first boundary on the projection plane, so as to obtain a third boundary corresponding to the first boundary on the imaging medium.

Step 1043: Determine the target projection area according to the third boundary.

Further, the projection device may take the area enclosed by the third boundary as the area to be corrected, and determine the area that satisfies the preset shape condition from the area to be corrected as the target projection area. For example, the projection device may determine the pixel distance of each pixel to a specified boundary in the second boundary (eg, the boundary below and to the right of each pixel in the second boundary) according to the position information of each pixel in the area to be corrected. Then, the projection device can use a preset traversal search algorithm to perform a traversal search according to the pixel distance from each pixel to the specified boundary, and calculate the target projection area in the area to be corrected that satisfies the preset shape condition. The preset shape condition may be, for example, the largest rectangular area with a size of 16:9 in the area to be corrected as the target projection area.

To sum up, the present disclosure first obtains a projected corrected image displayed on the imaging medium by projecting a preset corrected image onto an imaging medium, and acquires a captured image, wherein the captured image is a projected corrected image captured by an image capturing device The obtained image is determined, the corrected image includes a plurality of first marking patterns, the acquired image includes a second marking pattern corresponding to each first marking pattern, and then the first position of each second marking pattern in the acquired image is determined information, and according to the first position information of each second mark pattern and the second position information of each first mark pattern, determine the first boundary formed by the projection correction image in the captured image, and then according to the first boundary, determine the The target projection area on the imaging medium, and then the to-be-projected image is projected onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area. In the present disclosure, by determining a target projection area without distortion in the projection correction image, and projecting the to-be-projected image onto the imaging medium according to the target projection area, it can ensure that the to-be-projected image will not be distorted when projecting the to-be-projected image onto the imaging medium, and can obtain The projection effect that meets the user's requirements does not require manual adjustment by the user, the operation is simple, and the efficiency of correcting the projection is high.

Fig. 6 is a block diagram of a projection correction apparatus according to an exemplary embodiment. As shown in FIG. 6, applied to projection equipment, the apparatus 200 includes:

The acquiring module 201 is configured to project a preset corrected image onto an imaging medium to obtain a projected corrected image displayed on the imaging medium, and acquire a captured image. The collected image is determined according to an image obtained by photographing the projected corrected image by the image collecting device, the corrected image includes a plurality of first mark patterns, and the collected image includes a second mark pattern corresponding to each of the first mark patterns.

The processing module 202 is configured to determine the first position information of each second mark pattern in the captured image.

The processing module 202 is further configured to determine, according to the first position information of each second mark pattern and the second position information of each first mark pattern, a first boundary formed by the projection correction image in the captured image.

The processing module 202 is further configured to determine the target projection area on the imaging medium according to the first boundary.

The correction module 203 is configured to project the to-be-projected image onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area.

Optionally, the obtaining module 201 includes:

The first conversion sub-module is used to convert the image obtained by the image acquisition device shooting the projection corrected image into a specified format to obtain the first image.

The segmentation sub-module is used to perform segmentation processing on the first image, so as to remove the area in the first image except the projection corrected image to obtain the second image.

The second conversion submodule is used to convert the second image into a specified image size to obtain the captured image.

Optionally, the corrected image is a checkerboard image, the first marking pattern is any square in the checkerboard, and the processing module 202 includes:

The detection submodule is used to detect the checkerboard in the collected image, and determine the position information of each square included in the checkerboard in the collected image.

The first determination submodule is configured to use the position information of each square included in the checkerboard in the collected image as the first position information.

Optionally, the processing module 202 includes:

The second determination sub-module is configured to determine the positional relationship between each first marking pattern and the second boundary of the corrected image according to each second positional information, where the positional relationship is used to characterize the first marking pattern and the second boundary the distance.

The second determination submodule is further configured to determine, according to the positional relationship and each first positional information, the first region corresponding to the projection correction image in the captured image.

The second determination submodule is further configured to determine the second area from the first area according to the color feature of the first area.

The identification sub-module is used for performing edge identification on the second area to obtain the first boundary.

Optionally, the processing module 202 includes:

The calculation submodule is configured to determine the transformation matrix according to the first position information and the second position information.

The third determination submodule is configured to determine, according to the transformation matrix, a third boundary corresponding to the first boundary on the imaging medium.

The third determining submodule is further configured to determine the target projection area according to the third boundary.

Optionally, the third determination submodule is used for:

The area enclosed by the third boundary is used as the area to be corrected.

Determine the area that meets the preset shape condition from the area to be corrected as the target projection area.

Optionally, the correction module 203 includes:

The fourth determination sub-module is used for determining the third position information of the correction point corresponding to the target projection area. The correction points include the corners of the target projection area and the midpoints of each side of the target projection area.

The correction sub-module projects the to-be-projected image onto the imaging medium according to the third position information.

Regarding the apparatus in the above-mentioned embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be described in detail here.

FIG. 7 is a block diagram of an electronic device 300 according to an exemplary embodiment. As shown in FIG. 7 , the electronic device 300 may include: a processor 301 and a memory 302 . The electronic device 300 may also include one or more of a multimedia component 303 , an input/output (I/O) interface 304 , and a communication component 305 .

Wherein, the processor 301 is used to control the overall operation of the electronic device 300 to complete all or part of the steps in the above-mentioned projection correction method. The memory 302 is used to store various types of data to support operations on the electronic device 300, such data may include, for example, instructions for any application or method operating on the electronic device 300, and application-related data, Such as contact data, messages sent and received, pictures, audio, video, and so on. The memory 302 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (Static Random Access Memory, SRAM for short), electrically erasable programmable read-only memory ( Electrically Erasable Programmable Read-Only Memory (EEPROM for short), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (Read-Only Memory, ROM for short), magnetic memory, flash memory, magnetic disk or optical disk. Multimedia components 303 may include screen and audio components. Wherein the screen can be, for example, a touch screen, and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may be further stored in memory 302 or transmitted through communication component 305 . The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 304 provides an interface between the processor 301 and other interface modules, and the above-mentioned other interface modules may be a keyboard, a mouse, a button, and the like. These buttons can be virtual buttons or physical buttons. The communication component 305 is used for wired or wireless communication between the electronic device 300 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or one or more of them The combination is not limited here. Therefore, the corresponding communication component 305 may include: Wi-Fi module, Bluetooth module, NFC module and so on.

In an exemplary embodiment, the electronic device 300 may be implemented by one or more application-specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), digital signal processors (Digital Signal Processor, DSP for short), digital signal processing devices (Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), controller, microcontroller, microprocessor or other electronic components Implementation is used to perform the above-mentioned projection correction method.

In another exemplary embodiment, there is also provided a computer-readable storage medium comprising program instructions, the program instructions implement the steps of the above-mentioned projection correction method when executed by a processor. For example, the computer-readable storage medium can be the above-mentioned memory 302 including program instructions, and the above-mentioned program instructions can be executed by the processor 301 of the electronic device 300 to complete the above-mentioned projection correction method.

In another exemplary embodiment, there is also provided a computer program product comprising a computer program executable by a programmable apparatus, the computer program having, when executed by the programmable apparatus, for performing the above The code section of the projection correction method.

The preferred embodiments of the present disclosure have been described above in detail with reference to the accompanying drawings. However, the present disclosure is not limited to the specific details of the above-mentioned embodiments. Various simple modifications can be made to the technical solutions of the present disclosure within the scope of the technical concept of the present disclosure. These simple modifications all fall within the protection scope of the present disclosure.

In addition, it should be noted that the various specific technical features described in the above-mentioned specific embodiments can be combined in any suitable manner unless they are inconsistent. In order to avoid unnecessary repetition, the present disclosure provides The combination method will not be specified otherwise.

In addition, the various embodiments of the present disclosure can also be arbitrarily combined, as long as they do not violate the spirit of the present disclosure, they should also be regarded as the contents disclosed in the present disclosure.

Claims

A projection correction method, characterized in that, applied to projection equipment, the method comprising:

Projecting a preset corrected image onto an imaging medium to obtain a projected corrected image displayed on the imaging medium, and acquiring a captured image; the captured image is determined according to an image obtained by photographing the projected corrected image by an image acquisition device wherein the corrected image includes a plurality of first marking patterns, and the captured image includes a second marking pattern corresponding to each of the first marking patterns;

determining first position information of each of the second marking patterns in the captured image;

determining, according to the first position information of each of the second marking patterns and the second position information of each of the first marking patterns, a first boundary formed by the projection correction image in the captured image;

determining a target projection area on the imaging medium according to the first boundary;

The to-be-projected image is projected onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area.
The method according to claim 1, wherein the acquiring the captured image comprises:

Converting the image obtained by the image acquisition device shooting the projection correction image into a specified format to obtain a first image;

Performing segmentation processing on the first image to remove the area of the first image except the projection correction image to obtain a second image;

Converting the second image to a specified image size to obtain the acquired image.
The method according to claim 1, wherein the corrected image is a checkerboard image, and the first mark pattern is any square in the checkerboard; the determining of each of the collected images The first position information of the second marking pattern includes:

Detecting the checkerboard in the captured image, and determining the position information of each square included in the checkerboard in the captured image;

The position information of each square included in the checkerboard in the acquired image is used as the first position information.
The method according to claim 1, wherein the projection correction image is determined according to the first position information of each of the second marking patterns and the second position information of each of the first marking patterns The first boundary formed in the acquired image includes:

According to each of the second position information, a positional relationship between each of the first marking patterns and the second boundary of the corrected image is determined, and the positional relationship is used to characterize the first marking pattern and the first marking pattern. the distance between the two boundaries;

determining, according to the positional relationship and each of the first positional information, a first region corresponding to the projection correction image in the captured image;

determining a second area from the first area according to the color feature of the first area;

Perform edge recognition on the second area to obtain the first boundary.
The method according to claim 1, wherein the determining a target projection area on the imaging medium according to the first boundary comprises:

determining a transformation matrix according to the first position information and the second position information;

determining, according to the transformation matrix, a third boundary corresponding to the first boundary on the imaging medium;

The target projection area is determined according to the third boundary.
The method according to claim 5, wherein the determining the target projection area according to the third boundary comprises:

Taking the area enclosed by the third boundary as the area to be corrected;

An area satisfying a preset shape condition is determined from the to-be-corrected area as the target projection area.
The method according to claim 1, wherein the projecting the to-be-projected image onto the imaging medium according to the target projection area comprises:

determining the third position information of the correction point corresponding to the target projection area; the correction point includes the corner point of the target projection area and the midpoint of each side of the target projection area;

According to the third position information, the to-be-projected image is projected onto the imaging medium.
A projection correction device, characterized in that, when applied to projection equipment, the device comprises:

an acquisition module, configured to project a preset corrected image onto an imaging medium to obtain a projected corrected image displayed on the imaging medium, and acquire a captured image; the captured image is to capture the projected corrected image according to an image capturing device It is determined from the obtained image that the corrected image includes a plurality of first mark patterns, and the captured image includes a second mark pattern corresponding to each of the first mark patterns;

a processing module, configured to determine the first position information of each of the second marking patterns in the captured image;

The processing module is further configured to determine that the projection correction image is formed in the captured image according to the first position information of each of the second marking patterns and the second position information of each of the first marking patterns the first boundary of ;

The processing module is further configured to determine a target projection area on the imaging medium according to the first boundary;

The correction module is configured to project the to-be-projected image onto the imaging medium according to the target projection area, so as to display the information included in the to-be-projected image in the target projection area.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the steps of the method according to any one of claims 1-7 are implemented.
An electronic device, comprising:

a memory on which a computer program is stored;

A processor for executing the computer program in the memory to implement the steps of the method of any one of claims 1-7.