WO2023078091A1

WO2023078091A1 - Projection image superposition method and apparatus, electronic device and storage medium

Info

Publication number: WO2023078091A1
Application number: PCT/CN2022/126373
Authority: WO
Inventors: 杨思琪; 谷飞; 周伟明; 李屹
Original assignee: 深圳光峰科技股份有限公司
Priority date: 2021-11-03
Filing date: 2022-10-20
Publication date: 2023-05-11
Also published as: CN116074482A

Abstract

The present application discloses a projection image superposition method and apparatus, an electronic device and a storage medium, and relates to the technical field of projection. The method comprises: using one projection device of at least two projection devices as a reference projection device, and a projection device other than the reference projection device as a superposition projection device; using a source image of the reference projection device as a reference source image, acquiring coordinates of the reference source image as first coordinates; calculating coordinates of a projection source image as second coordinates according to the first coordinates and a first conversion relationship, the first conversion relationship being a conversion relationship between the reference source image and the projection source image, and the projection source image being a source image of a superposition projection device; and controlling the superposition projection device to adjust the projection source image according to the second coordinates so that a projection picture projected by the superposition projection device on the basis of the adjusted projection source image is superposed with a reference picture projected by the reference projection device on the basis of the reference source image, thereby avoiding distortion of a displayed picture.

Description

Superimposition method, device, electronic equipment and storage medium for projected images

technical field

The present application relates to the field of projection technology, and more specifically, to a method, device, electronic device, and storage medium for superimposing projection images.

Background technique

Projection devices use optical elements to magnify an image and project it onto a screen. Due to factors such as high ambient light brightness in the environment, or the distance between the projection device and the screen, the brightness of the image projected by the projection device is low, and the projection effect is not good. Usually, the pictures projected by multiple projection devices are superimposed manually, but the manually superimposed pictures are prone to picture misalignment, resulting in problems such as distortion of the final projected picture.

Contents of the invention

In view of the above problems, the present application proposes a method, device, electronic device and storage medium for superimposing projected images, which can solve the above problems.

In the first aspect, an embodiment of the present application provides a method for superimposing projected pictures, the method comprising: taking one of at least two projection devices as a reference projection device, and taking one of the at least two projection devices as a reference projection device, and Other projection devices outside the reference projection device are used as superposition projection devices; the source image of the reference projection device is used as the reference source image, and the coordinates of the reference source image are obtained as the first coordinates; according to the first conversion relationship and the obtained the first coordinates, and calculate the coordinates of the projection source image as the second coordinates, wherein the first conversion relationship is the conversion relationship between the reference source image and the projection source image, and the projection source image is the Superimposing the source image of the projection device; controlling the superimposition and projection device to adjust the projection source image according to the second coordinates, so that the projection screen projected by the superposition and projection device based on the adjusted projection source image is consistent with the The reference projection device superimposes the reference picture projected based on the reference source image.

In the second aspect, an embodiment of the present application provides an apparatus for overlaying projected pictures, the apparatus comprising: a device determination module, configured to use one of at least two projection devices as a reference projection device, and set the at least In the two projection devices, other projection devices except the reference projection device are used as superposition projection devices; the first coordinate acquisition module is used to use the source image of the reference projection device as a reference source image, and obtain the reference source image The coordinates of the projection source image are used as the first coordinates; the second coordinate acquisition module is configured to calculate the coordinates of the projection source image as the second coordinates according to the first conversion relationship and the first coordinates, wherein the first conversion relationship is the reference A conversion relationship between a source image and the projection source image, the projection source image being the source image of the superimposition projection device; a superposition module, configured to control the superposition projection device to adjust the projection according to the second coordinates source image, so that the projection picture projected by the superposition projection device based on the adjusted projection source image is superimposed on the reference picture projected by the reference projection device based on the reference source image.

In a third aspect, the embodiment of the present application provides an electronic device, including: one or more processors; memory; one or more application programs, wherein the one or more application programs are stored in the memory and Configured to be executed by the one or more processors, the one or more application programs are configured to perform the above method.

In a fourth aspect, the embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code can be invoked by a processor to execute the above method.

The method, device, electronic device and storage medium for superimposing projection images provided by the present application are provided with at least two projection devices for projection, and one of the at least two projection devices is used as a reference projection device, and other than the reference projection device The projection device is used as a superposition projection device, and the source image of the reference projection device is used as the reference source image, and the coordinates of the reference source image are obtained as the first coordinates, and the coordinates of the projection source image are calculated as the second coordinates according to the first coordinates and the first conversion relationship. Two coordinates, wherein the first conversion relationship is the conversion relationship between the reference source image and the projection source image, the projection source image is the source image of the overlay projection device, and the overlay projection device is controlled to adjust the projection source image according to the second coordinate, so that the overlay The projection screen projected by the projection device based on the adjusted projection source image is superimposed on the reference screen projected by the reference projection device based on the reference source image, which avoids distortion of the displayed screen, and the two screens are automatically superimposed, so that the brightness of the displayed screen enhanced.

These or other aspects of the present application will be more concise and understandable in the description of the following embodiments.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 shows a schematic diagram of a projection system provided by an embodiment of the present application;

FIG. 2 shows a schematic diagram of a projection system provided by another embodiment of the present application;

FIG. 3 shows a schematic diagram of a projection system provided in another embodiment of the present application;

FIG. 4 shows a schematic flowchart of a method for superimposing projection images provided by an embodiment of the present application;

FIG. 5 shows a schematic flowchart of a method for superimposing projection images provided by another embodiment of the present application;

FIG. 6 shows a schematic flow chart of step S220 of the method for overlaying projected images shown in FIG. 5 of the present application;

FIG. 7 shows another schematic flowchart of step S220 of the method for overlaying projected images shown in FIG. 5 of the present application;

FIG. 8 shows a schematic flow chart of a method for superimposing projected images provided in yet another embodiment of the present application;

FIG. 9 shows a schematic diagram of a projection screen provided by an embodiment of the present application;

FIG. 10 shows a schematic diagram of a projection screen provided by another embodiment of the present application;

Fig. 11 shows a block diagram of an apparatus for superimposing projected pictures provided by another embodiment of the present application;

FIG. 12 shows a block diagram of an electronic device for performing a method for superimposing projected pictures according to an embodiment of the present application according to an embodiment of the present application;

Fig. 13 shows a storage unit for storing or carrying program codes for realizing the method for superimposing projected images according to the embodiment of the present application according to the embodiment of the present application.

Detailed ways

In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

Projection devices use optical elements to magnify an image and project it onto a screen. Due to factors such as high ambient light brightness in the environment, or the distance between the projection device and the screen, if only one projection device is used for projection, the brightness of the image projected by the projection device will be low, and the projection effect will not be good. If the projector is technically improved to enhance the brightness of the projection screen, usually the increase in the brightness of the projection screen is not linearly related to the increase in the cost of the projector, and the increase in brightness usually requires several times the cost increase, and technically improved Has a higher degree of difficulty. Usually, the pictures projected by multiple projection devices are superimposed manually. However, the manually superimposed pictures are prone to picture misalignment, smearing, etc., resulting in problems such as distortion of the final projected picture, and the labor cost caused by manual superimposition is also high. higher.

In view of the above-mentioned technical problems, the inventor discovered and proposed a superposition method, device, electronic equipment and storage medium of projected images after long-term research. At least two projection devices include a reference projection device and a superposition projection device. The first coordinates of the reference source image and the first conversion relationship are obtained to obtain the second coordinates of the projection source image of the superimposed projection device, and the projection source image is adjusted according to the second coordinates, so that the superimposed projection device projects based on the adjusted projection source image The projection picture is superimposed with the reference picture projected by the reference projection device based on the reference source image, which avoids distortion of the displayed picture, and the projection cost is low.

In order to better understand the method, device, electronic device, and storage medium for superimposing projection images provided in the embodiments of the present application, the application environment applicable to the embodiments of the present application will be described below first.

Referring to FIG. 1 , a projection system 100 includes at least two projection devices 110 and a projection screen 120 . At least two projection devices 110 project pictures to the projection screen 120 , and the pictures projected by the at least two projection devices 110 are superimposed within the range of a to b, so that the brightness of the pictures on the projection screen 120 is enhanced. The installation positions of at least two projection devices 110 can be arranged in a stacked vertical direction as shown in FIG. 1 , or in a stacked arrangement in a horizontal direction in FIG. 2 , or in both horizontal and vertical directions shown in FIG. Overlay arrangement.

It should be noted that the installation positions of at least two projection devices 110 are not limited to those shown in Fig. 1-Fig. One location is enough.

FIG. 4 shows a schematic flow chart of a method for superimposing projected pictures provided by an embodiment of the present application. By controlling superimposition of pictures projected by at least two projection devices, the brightness of projected pictures can be improved. In a specific embodiment, the method for superimposing projected pictures is applied to the projection system 100 shown in FIG. 1 , the superimposing device 200 for projected pictures shown in FIG. The electronic device 300 of the device 200 . In this embodiment, the specific process of this embodiment will be described by taking the superposition method of projected images applied to the electronic device 300 as an example, wherein the electronic device 300 may be a computer, a server, or the like. The process shown in FIG. 4 will be described in detail below, and the superimposition method of the projection screen may specifically include the following steps:

Step S110, use one of the at least two projection devices as a reference projection device, and use other projection devices in the at least two projection devices except the reference projection device as superposition projection devices.

There are at least two projection devices in the projection system, any one of the at least two projection devices is used as the reference projection device, and the other projection devices in the at least two projection devices except the reference projection device are used as superposition projection devices, and the reference projection device The brightness, definition, image size and other parameters have been set, and the overlay projection device sets its own parameters with reference to the reference projection device.

Optionally, the number of at least two projection devices can be determined according to the distance between the projection device and the projection screen. When the distance between the two is farther, the number of projection devices can be set to be more. When the distance between is shorter, the number of projection devices can be set to be less. The number of at least two projection devices can also be determined according to the brightness of the projection environment where the projection devices are located. When the ambient brightness is brighter, the number of projection devices can be set to be larger; Set less.

Step S120, using the source image of the reference projection device as a reference source image, and acquiring the coordinates of the reference source image as first coordinates.

The source image of the reference projection device is used as the reference source image, wherein the reference source image is used for projection by the reference projection device. Get the coordinates of the reference source image as the first coordinates. It can be understood that the first coordinate represents the position of the reference source image in the reference projector.

In one embodiment, in order to reduce the amount of subsequent calculations, the position of the reference source image is expressed by feature points on the reference source image. A feature point at any position is determined on the reference source image as a first feature point, and the coordinates of the first feature point on the reference source image are acquired as first coordinates.

Optionally, the number of the first feature point may be one. As a manner, the first feature point may be a certain position marked by the user in the reference source image, or a certain pixel point marked by the user. As another way, the first feature point may also be a preset special point, for example, the area at the upper left corner of each frame of reference source image is set as the first feature point.

Optionally, there may be multiple first feature points. As a manner, the first feature point may be multiple positions marked by the user in the reference source image, or multiple pixel points at different positions marked by the user. As another way, the first feature point may also be a plurality of preset special points, for example, the four upper corners of each frame of the reference source image are set as the first feature point.

Step S130, according to the first conversion relationship and the first coordinates, calculate the coordinates of the projection source image as the second coordinates. Wherein, the first conversion relationship is a conversion relationship between the reference source image and the projection source image, and the projection source image is a source image of the overlay projection device.

In order to improve the display effect and superimpose the display picture, at least two projection devices can project the same picture to be superimposed. Therefore, the source images of at least two projection devices are the same, that is, the reference source image and the projection source image are the same, which is understandable Yes, all projection devices project the same content. The first conversion relationship is the conversion relationship between the reference source image and the projection source image. Since the first coordinates are coordinates on the reference projection source image, the first conversion relationship and the first coordinates can be used to calculate The coordinates of the first feature point on the projection source image are used as the second coordinates.

In one implementation manner, according to the first conversion relationship and the first coordinates, the coordinates of the first feature point on the projection source image are calculated as the second coordinates. The location of the projection source image is expressed by the second coordinates of the feature points on the projection source image.

Step S140, controlling the superposition and projection device to adjust the projection source image according to the second coordinates, so that the projection picture projected by the superposition and projection device based on the adjusted projection source image is the same as that of the reference projection device based on The reference picture projected by the reference source image is superimposed.

The reference projection device projects a reference picture on the projection screen based on the reference source image. The image projected by the superimposed projection device needs to be superimposed on the position where the reference image is located to achieve brightness superposition. Therefore, the electronic device controls the superposition and projection device to adjust the projection source image according to the second coordinates to correct the projection source image. As a method, when the second coordinate is within the range corresponding to the projection source image, Two-coordinate adjustment of the projection source image, when the second coordinate is not within the range corresponding to the projection source image, an error message will be displayed, for example, prompting "The projection screen cannot cover the reference screen, please replace or turn off the overlay projection device". The projection screen projected by the superposition projection device based on the adjusted projection source image is superimposed on the reference screen, so that the projection screen and the reference screen are completely overlapped, and the superposition of brightness is realized, so that the brightness of the screen displayed on the projection screen is improved, the screen is clearer, and the color is brighter. more gorgeous.

Wherein, the brightness of the picture finally displayed on the display screen is the sum of the brightness projected by at least two projection devices, and the number of superimposed projection devices determines the multiple of brightness improvement. For example, when the number of at least two projection devices is 2, the number of superimposed projection devices is 1, and the brightness of the finally superimposed picture is doubled. When the number of at least two projection devices is 3, the number of superimposed projection devices is 2, and the brightness of the finally superimposed picture is doubled.

Optionally, the superimposition of the projected picture and the reference picture can be realized by adjusting the projection lens of the superimposition projection device, for example, zooming adjustment, movement adjustment, etc. of the projection lens of the superposition projection device.

When the projected image projected by the overlay projection device based on the projection source image is larger than the reference image, the zoom adjustment can be realized by adjusting the focal length of the projection lens, and the adjusted projection image projected by the overlay projection device based on the projection source image can be overlaid on the reference image , so as to achieve the superposition of brightness. Or, when the projection picture projected by the superimposition projection device is smaller than the reference picture, the zoom adjustment is realized by adjusting the focal length of the projection lens, and the projection picture projected by the adjusted superposition projection device based on the projection source image can be overlaid on the reference picture, thereby realizing Superposition of brightness.

When the projection picture projected by the superimposition projection device based on the projection source image is misaligned with the reference picture, move and adjust the projection lens of the superposition projection device, or move the superposition projection device so that the projection picture projected by the superposition projection device is superimposed on the reference picture, thereby To achieve the superposition of brightness.

It should be noted that when the position of the projection device among the at least two projection devices moves, the first conversion relationship needs to be updated. When the projection parameters of the reference projection device change, for example, the reference image projected by the reference projection device shrinks, the first conversion relationship also needs to be updated to ensure that the source images can overlap after projection.

It should be noted that the reference original image is the same as the projection source image.

The method for superimposing projected images provided by the present application includes setting at least two projection devices for projection, using one of the at least two projection devices as a reference projection device, and using other projection devices other than the reference projection device as superimposed projection devices. The source image of the reference projection device is used as the reference source image, and the coordinates of the reference source image are obtained as the first coordinates, and the coordinates of the projection source image are calculated as the second coordinates according to the first coordinates and the first conversion relationship, wherein the first conversion The relationship is the conversion relationship between the reference source image and the projection source image, the projection source image is the source image of the overlay projection device, and the overlay projection device is controlled to adjust the projection source image according to the second coordinate, so that the overlay projection device is based on the adjusted projection source The projection screen projected by the image is superimposed on the reference screen projected by the reference projection device based on the reference source image, which avoids distortion of the displayed screen, and the two screens are automatically superimposed, making the displayed screen brighter, clearer, and more colorful. gorgeous.

On the basis of the previous embodiment, this embodiment provides a method for superimposing projected pictures, in order to make the projected picture projected by the superimposing projection device based on the projection source image be superimposed on the reference picture projected by the reference projection device based on the reference source image In general, by adjusting or setting the projection source image of the superimposed projection device, since the reference base of the spatial position where the acquired projection source image is located is the superimposed projection device, and the reference base of the spatial position where the reference source image is located is the reference projection device, The references of the projection source image and the reference source image are different. Therefore, before adjusting the overlay projection device, it is necessary to obtain the transformation relationship between the spatial position of the projection source image and the spatial position of the reference source image in advance, that is, the first coordinate position. Specifically, FIG. 5 shows a schematic flow chart of a method for superimposing projected images provided in another embodiment of the present application. Please refer to FIG. 5 . The method for superimposing projected images may specifically include the following steps:

Step S210, using one of the at least two projection devices as a reference projection device, and using other projection devices in the at least two projection devices except the reference projection device as superposition projection devices.

Wherein, for the specific description of step S210, please refer to step S110, which will not be repeated here.

Step S220, when the reference picture projected by the reference projection device is superimposed on the projection picture projected by the superposition projection device, acquire a second conversion relationship, and acquire a third conversion relationship, wherein the second conversion relationship is the A conversion relationship between a reference source image and a reference image, the reference image is obtained by shooting a projected reference picture by an imaging device, the third conversion relationship is a conversion relationship between the projection source image and a projection image, the The projected image is obtained by capturing and projecting a projected picture by the imaging device.

In the debugging stage, when the reference picture projected by the reference projection device and the projection picture projected by the overlay projection device are superimposed, please refer to FIG. 6, and obtaining the second conversion relationship may include the following sub-steps:

Sub-step S221. Obtain the third coordinates of the second feature point on the reference source image.

A feature point at any position on the reference source image is determined as a second feature point, and a third coordinate P _{ori-reference} of the second feature point on the reference source image is obtained.

Optionally, the number of the second feature point may be one. As a manner, the second feature point may be a certain position marked by the user in the reference source image, or a certain pixel point marked by the user. As another way, the second feature point may also be a preset special point, for example, the area at the upper left corner of each frame of the reference source image is set as the second feature point.

Optionally, there may be multiple second feature points. As a manner, the second feature point may be multiple positions marked by the user in the reference source image, or multiple pixel points at different positions marked by the user. As another way, the second feature point may also be a plurality of preset special points, for example, the four upper corners of each frame of the reference source image are set as the second feature point.

Optionally, the second feature point may be the same as the first feature point, that is, the first feature point and the second feature point are the same point on the reference source image.

Sub-step S222, acquiring fourth coordinates of the second feature point on the reference image.

The reference projection device projects a reference picture on the projection screen based on the reference source image, and the reference picture is captured by the camera device to obtain a reference image. It can be understood that the content displayed in the reference image is the reference picture. Wherein, the camera device may be a device of a projection system, may be a separate camera device, or may be a camera device in an electronic device. The camera device sends the captured reference image to the electronic device, and the reference base of the spatial position where the reference image is located is the electronic device. The electronic device acquires the fourth coordinate P _{ori-reference} of the second feature point on the reference image.

It should be noted that both the third coordinate and the fourth coordinate are for the same display content, but the display content is under different reference standards.

Sub-step S223: Obtain the second conversion relationship according to the third coordinate and the fourth coordinate.

According to the third coordinate P _{ori-reference} and the fourth coordinate P _{ori-reference} , the second conversion relationship H ₀ is obtained. For example, H ₀ =P _ori- _reference ^-1 *P _{ori-reference} .

Optionally, the second conversion relationship may also be a product between the third coordinate P _{ori-reference} and the fourth coordinate P _{ori-reference} .

Referring to Figure 7, obtaining the third conversion relationship may include the following sub-steps:

Sub-step S224, acquiring fifth coordinates of the second feature point on the projection source image.

A feature point at any position is determined on the projection source image as a second feature point, and a fifth coordinate P _{ori-projection} of the second feature point on the projection source image is obtained.

Optionally, the number of the second feature point may be one. As a manner, the second feature point may be a certain position marked by the user in the projection source image, or a certain pixel point marked by the user. As another way, the second feature point may also be a preset special point, for example, the area at the upper left corner of the projection source image of each frame is set as the second feature point.

Optionally, there may be multiple second feature points. As a manner, the second feature point may be multiple positions marked by the user in the projection source image, or multiple pixel points at different positions marked by the user. As another way, the second feature point may also be a plurality of preset special points, for example, the regions of the four upper corners of each frame of the projection source image are set as the second feature point.

Optionally, the second feature point may be the same as the first feature point, that is, the first feature point and the second feature point are the same point on the projection source image.

Sub-step S225, acquiring the sixth coordinates of the second feature point on the projected image.

The projection projection device projects a projection picture on the projection screen based on the projection source image, and the projection picture is captured by a camera device to obtain a projection image. It can be understood that the content displayed in the projection image is the projection picture. Wherein, the camera device may be a device of a projection system, may be a separate camera device, or may be a camera device in an electronic device. The imaging device sends the projected image taken to the electronic device, and the reference base of the spatial position of the projected image is the electronic device. The electronic device acquires the sixth coordinate P _{ori-projection} of the second feature point on the reference image.

It should be noted that both the fifth coordinate and the sixth coordinate are for the same display content, but the display content is under different reference standards.

Sub-step S226: Obtain the third conversion relationship according to the fifth coordinate and the sixth coordinate.

According to the fifth coordinate P _{ori-projection} and the sixth coordinate P _{ori-projection} , the third transformation relation H is obtained. For example, H=P _ori- _projection ^-1 *P _{ori-projection} .

Optionally, the third conversion relationship may also be a product between the fifth coordinate P _{ori-projection} and the sixth coordinate P _{ori-projection} .

Step S230. Obtain the first conversion relationship according to the second conversion relationship and the third conversion relationship.

Since the fourth coordinate P _{ori of the second transformation relation—the reference position of the datum} is the electronic equipment, and the sixth coordinate P _{ori—the reference position of the projection} of the third transformation relation is also the electronic equipment, therefore, since in the commissioning stage, the reference projection equipment The projected reference picture is superimposed on the projection picture projected by the superimposed projection device, and then the projected picture obtained by shooting is also the same as the reference picture. It can be considered that the fourth coordinate P _{ori-reference} and the sixth coordinate P _{ori-projection} are relative to the electronic equipment. Overlap. That is to say, the fourth coordinate P _{ori-reference} is also the sixth coordinate P _{ori-projection} , and the two can replace each other. According to obtaining the second conversion relationship H ₀ =P _ori-base ^-1 *P _ori-base and the third conversion relationship H=P _{ori-projection} ^-1 *P _{ori-projection} , the obtained first conversion relationship T can be T =H ₀ /H=P _{ori-reference} *P _{ori-projection} ^-1 .

Optionally, the first conversion relationship may also be T=H/H ₀ =P _{ori-reference} ^-1 *P _{ori-projection} .

Step S240, use the source image of the reference projection device as the reference source image, and acquire the coordinates of the reference source image as the first coordinates.

Step S250: Calculate the coordinates of the projection source image as the second coordinates according to the first transformation relationship and the first coordinates, wherein the first transformation relationship is the transformation between the reference source image and the projection source image relationship, the projection source image is the source image of the overlay projection device.

Step S260, controlling the superposition and projection device to adjust the projection source image according to the second coordinates, so that the projection picture projected by the superposition and projection device based on the adjusted projection source image is the same as that of the reference projection device based on The reference picture projected by the reference source image is superimposed.

Wherein, for the specific description of step S240-step S260, please refer to step S120-step S140, which will not be repeated here.

The method for superimposing projected images provided by the present application includes setting at least two projection devices for projection, using one of the at least two projection devices as a reference projection device, and using other projection devices other than the reference projection device as superimposed projection devices. The source image of the reference projection device is used as the reference source image, and the coordinates of the reference source image are obtained as the first coordinates, and the first conversion relationship is obtained according to the second conversion relationship and the third conversion relationship, and then according to the first coordinates and the first conversion relationship, Calculate the coordinates of the projection source image as the second coordinates, wherein the first conversion relationship is the conversion relationship between the reference source image and the projection source image, the projection source image is the source image of the superimposed projection device, and the superimposed projection device is controlled according to the second The coordinates of the projection source image are adjusted so that the projection image projected by the superposition projection device based on the adjusted projection source image and the reference image projected by the reference projection device based on the reference source image are superimposed, avoiding distortion of the displayed image, and the two images Automatic superimposition makes the brightness of the displayed picture enhanced, the picture is clearer, and the color is more gorgeous.

Optionally, before superimposing the projected picture on the reference picture, it is also necessary to pre-adjust the superimposed projection device, such as focus adjustment and/or zoom adjustment. Specifically, FIG. 8 shows the Please refer to FIG. 8 for a schematic flow chart of the method for superimposing projection images. The method for superimposing projection images may specifically include the following steps:

Step S310, using one of the at least two projection devices as a reference projection device, and using other projection devices in the at least two projection devices except the reference projection device as superposition projection devices.

Step S320, using the source image of the reference projection device as the reference source image, and acquiring the coordinates of the reference source image as the first coordinates.

Wherein, for the specific description of step S310-step S320, please refer to step S110-step S120, which will not be repeated here.

Step S330, receiving the screen image obtained by shooting the projection screen by the imaging device.

A projection screen is displayed on the projection screen, or a projection screen and a reference screen are displayed, and the camera device shoots the projection screen to obtain a screen image, because the projection screen captured by the projection device is a projection image. The captured reference picture is the reference image, and when only the projection picture is displayed on the projection screen, the screen image includes the projection image. When the projected image and the reference image are displayed on the projection screen, the screen image includes the projected image and the reference image.

Step S340, when the screen image satisfies a preset condition, control the superposition projection device to adjust.

Wherein, the preset condition is a condition of poor display effect, for example, the preset condition indicates that the definition is not good, or indicates that the projected image and the reference image are not superimposed.

In one embodiment, when only the projection screen is displayed on the projection screen, the initial reference screen projected by the reference projection device and the initial projection screen projected by the superimposed projection device. Adjustments may include focus adjustments and magnification adjustments. When the definition of the initial projected image in the screen image is less than a preset definition, the superposition projection device is controlled to perform focus adjustment, so that the adjusted displayed projection image has a higher definition.

In another embodiment, when the projected picture and the reference picture are displayed on the projection screen, when the initial projected image in the screen image does not cover the initial reference image in the screen image, the superimposed projection is controlled The device performs zoom adjustment, wherein the coverage refers to that the area of the adjusted projected image is larger than the reference image. For example, referring to FIG. 9 , on the projection screen 120, a reference image 122 and an initial projection image 121-1 are displayed, and the superposition projection device is adjusted to enlarge the initial projection image 121-1 to obtain an enlarged projection image 121-2. The enlarged projected image 121 - 2 covers the reference image 122 .

It should be noted that only one adjustment may not achieve a better effect, and repeated adjustments are required. The camera device re-shots the screen to obtain a screen image and sends it to the electronic device, and the electronic device receives the screen image re-shot by the camera device; When the re-shot screen image satisfies the preset condition, the overlay projection device is controlled to adjust, and the adjustment is repeated until the re-shot screen image does not meet the preset condition.

Step S350: Calculate the coordinates of the projection source image as the second coordinates according to the first transformation relation and the first coordinate, wherein the first transformation relation is the transformation between the reference source image and the projection source image relationship, the projection source image is the source image of the overlay projection device.

Step S360, controlling the superposition and projection device to adjust the projection source image according to the second coordinates, so that the projection picture projected by the superposition and projection device based on the adjusted projection source image is the same as that of the reference projection device based on The reference picture projected by the reference source image is superimposed.

In the preprocessing adjustment stage, the area of the initial projected image is adjusted to be larger than the area of the reference image. In the superposition stage, the adjusted projection image needs to be reduced to the same size as the reference image to realize the superposition of the two images.

In one embodiment, the number of superimposed projection devices can be multiple, as shown in Figure 10, the number of superimposed projection devices can be 4, and the number of adjusted projection pictures 121-2 projected is 4 , the projection source image is adjusted through the second coordinates, and the projection image projected by the superimposed projection device based on the adjusted projection source image is reflected on the screen, and the adjusted projection image 121-2 is reduced to the reference The screens 122 have the same area, and the reduced projection screen is moved to the position where the reference screen 122 is located to realize superimposition.

Wherein, for the specific description of step S350-step S360, please refer to step S130-step S140, which will not be repeated here.

The superposition of the projected pictures provided by this embodiment pre-adjusts the superimposed projection device, so that the projected pictures projected by the superimposed projection device can obtain a good display effect, so that the superimposed pictures can obtain a good form effect.

In order to realize the above-mentioned method embodiments, this embodiment provides a projection screen superimposition device. FIG. 11 shows a block diagram of a projection screen superposition device provided by another embodiment of the present application. Please refer to FIG. 11, the projection screen superimposition The apparatus 200 includes: a device determination module 210 , a first coordinate acquisition module 220 , a second coordinate acquisition module 230 and a superposition module 240 .

A device determination module 210, configured to use one of the at least two projection devices as a reference projection device, and use other projection devices in the at least two projection devices except the reference projection device as a superposition projection device;

The first coordinate acquiring module 220 is configured to use the source image of the reference projection device as a reference source image, and obtain the coordinates of the reference source image as first coordinates;

The second coordinate acquisition module 230 is configured to calculate the coordinates of the projection source image as the second coordinates according to the first conversion relationship and the first coordinate, wherein the first conversion relationship is the reference source image and the projection A conversion relationship between source images, the projection source image being the source image of the overlay projection device;

A superposition module 240, configured to control the superimposition and projection device to adjust the projection source image according to the second coordinates, so that the projection picture projected by the superposition and projection device based on the adjusted projection source image is consistent with the reference The projection device superimposes the reference picture projected based on the reference source image.

Optionally, the first coordinate acquisition module 220 includes: a first coordinate acquisition submodule. The second coordinate acquisition module 230 includes: a second coordinate acquisition submodule.

The first coordinate acquiring submodule is configured to acquire the coordinates of the first feature point on the reference source image as the first coordinates.

The second coordinate acquisition submodule is configured to calculate the coordinates of the first feature point on the projection source image as the second coordinates according to the first conversion relationship and the first coordinates.

Optionally, the apparatus 200 for superimposing projected images further includes: a first acquiring module and a second acquiring module.

A first acquiring module, configured to acquire a second conversion relationship when the reference picture projected by the reference projection device is superimposed on the projection picture projected by the superposition projection device, and acquire a third conversion relationship, wherein the second conversion The relationship is the conversion relationship between the reference source image and the reference image, the reference image is obtained by shooting the projected reference picture by the imaging device, and the third conversion relationship is the conversion between the projection source image and the projection image relationship, the projection image is obtained from the projected projection screen captured by the imaging device;

A second obtaining module, configured to obtain the first conversion relationship according to the second conversion relationship and the third conversion relationship.

Optionally, the first acquisition module includes: a third coordinate acquisition submodule, a fourth coordinate acquisition submodule, and a first conversion relationship acquisition submodule.

A third coordinate acquiring submodule, configured to acquire third coordinates of the second feature point on the reference source image;

A fourth coordinate acquiring submodule, configured to acquire fourth coordinates of the second feature point on the reference image;

The first conversion relationship obtaining submodule is configured to obtain the second conversion relationship according to the third coordinate and the fourth coordinate.

Optionally, the first acquisition module includes: a fifth coordinate acquisition submodule, a sixth coordinate acquisition submodule, and a second conversion relationship acquisition submodule.

A fifth coordinate acquiring submodule, configured to acquire fifth coordinates of the second feature point on the projection source image;

A sixth coordinate acquiring submodule, configured to acquire sixth coordinates of the second feature point on the projected image;

The second conversion relationship obtaining submodule is configured to obtain the third conversion relationship according to the fifth coordinate and the sixth coordinate.

The superimposing device 200 for projecting images further includes: a photographing module and an adjusting module.

The shooting module is used to receive the screen image obtained by shooting the projection screen by the camera device;

An adjustment module, configured to control the overlay projection device to adjust when the screen image satisfies a preset condition.

Optionally, an initial reference picture projected by the reference projection device and an initial projection picture projected by the superposition projection device are projected on the projection screen, and the screen image includes an initial reference image corresponding to the reference picture and For the initial projection image corresponding to the initial projection image, the adjustment module includes: a focus adjustment sub-module and an enlargement adjustment sub-module.

A focus adjustment submodule, configured to control the overlay projection device to perform focus adjustment when the definition of the initial projected image in the screen image is less than a preset definition; and/or

The magnification adjustment sub-module is configured to control the superposition projection device to perform magnification adjustment when the initial projection image in the screen image does not cover the initial reference image in the screen image.

Optionally, the superimposing device 200 for projecting images further includes: a reshooting module and a repeated adjustment module.

A recapture module, configured to receive a screen image recaptured by the camera device;

The repeated adjustment module is used to control the overlay projection device to adjust when the re-shot screen image meets the preset condition until the re-shot screen image does not meet the preset condition.

Optionally, the superposition module 240 includes: a superposition submodule.

The superposition sub-module is configured to control the superposition and projection device to adjust the projection source image according to the second coordinate when the second coordinate is within a range corresponding to the projection source image.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the modules/units/subunits/components in the device described above can refer to the corresponding processes in the foregoing method embodiments, which are not repeated here. repeat.

In several embodiments provided in this application, the coupling or direct coupling or communication connection between the modules shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or modules may be electrical, mechanical or otherwise.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules.

Fig. 12 shows a block diagram of an electronic device for performing a method for superimposing projected images according to an embodiment of the present application according to an embodiment of the present application. Please refer to Fig. 12, which shows an electronic device provided by an embodiment of the present application. The electronic device 300 may include a processor 331, a communication module 332, a memory 333 and a bus. The bus can be an ISA bus, a PCI bus, an EISA bus, a CAN bus, and the like. The bus can be divided into address bus, data bus, control bus and so on. in:

The memory 333 is used to store programs. Specifically, the memory 333 can be used to store software programs and various data. The memory 333 may mainly include a program storage area and a data storage area, wherein the program storage area may store programs required to operate at least one function and may include program codes, and the program codes may include computer operation instructions. In addition to storing programs, the memory 333 can also temporarily store messages that the communication module 332 needs to send. The memory 333 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one solid state disk (Solid State Disk, SSD for short).

The processor 331 is used to execute the programs stored in the memory 333 . When the program is executed by the processor, the steps of the method for timing quality inspection of customer service messages in the above embodiments are realized.

The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the customer service message timing quality inspection method in the above-mentioned embodiments is implemented, and The same technical effect can be achieved, so in order to avoid repetition, details will not be repeated here. Among them, computer-readable storage media, such as read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), SSD, electrically erasable programmable read-only memory (Electrically Erasable Programmable read only memory, referred to as EEPROM) or flash memory (Flash Memory, referred to as Flash).

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is more best implementation. Based on such an understanding, the technical solution of the present application can be embodied in the form of a software product in essence or the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, SSD, Flash ) includes several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method of each embodiment of the present application.

Fig. 13 shows the storage unit used to store or carry the program codes for implementing the method for superimposing projected images according to the embodiment of the present application according to the embodiment of the present application. Please refer to 13, which shows a kind of A structural block diagram of a computer readable storage medium. Program codes are stored in the computer-readable medium 400, and the program codes can be invoked by a processor to execute the methods described in the foregoing method embodiments.

The computer readable storage medium 400 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 400 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium). The computer-readable storage medium 400 has a storage space for program code 410 for executing any method steps in the above methods. These program codes can be read from or written into one or more computer program products. Program code 410 may, for example, be compressed in a suitable form.

To sum up, the method, device, electronic device and storage medium for superimposing projection images provided by this application have at least two projection devices for projection, and one of the at least two projection devices is used as the reference projection device, except Other projection devices other than the reference projection device are used as overlay projection devices, the source image of the reference projection device is used as the reference source image, and the coordinates of the reference source image are obtained as the first coordinates, and the projection source is calculated according to the first coordinates and the first conversion relationship The coordinates of the image are used as the second coordinates, wherein the first conversion relationship is the conversion relationship between the reference source image and the projection source image, the projection source image is the source image of the overlay projection device, and the overlay projection device is controlled to adjust the projection source according to the second coordinates image, so that the projection screen projected by the superposition projection device based on the adjusted projection source image and the reference screen projected by the reference projection device based on the reference source image are superimposed, avoiding distortion of the displayed screen, and the two screens are automatically superimposed, so that The brightness of the displayed picture is enhanced.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not drive the essence of the corresponding technical solutions away from the spirit and scope of the technical solutions of the various embodiments of the present application.

Claims

A method for superimposing projected pictures, characterized in that the method comprises:

Using one of the at least two projection devices as a reference projection device, and using other projection devices in the at least two projection devices except the reference projection device as a superposition projection device;

using the source image of the reference projection device as a reference source image, and obtaining the coordinates of the reference source image as first coordinates;

According to the first conversion relationship and the first coordinates, calculate the coordinates of the projection source image as the second coordinates, wherein the first conversion relationship is the conversion relationship between the reference source image and the projection source image, so The projection source image is the source image of the superposition projection device;

controlling the superposition projection device to adjust the projection source image according to the second coordinates, so that the projection picture projected by the superposition projection device based on the adjusted projection source image is the same as that of the reference projection device based on the reference Base frame overlay projected from the source image.
The method according to claim 1, wherein the obtaining the coordinates of the reference source image as the first coordinates comprises:

Obtaining the coordinates of the first feature point on the reference source image as the first coordinates;

The calculating the coordinates of the projection source image as the second coordinates according to the first conversion relationship and the first coordinates includes:

Calculate the coordinates of the first feature point on the projection source image as the second coordinates according to the first conversion relationship and the first coordinates.
The method according to claim 1, wherein, before calculating the coordinates of the projection source image as the second coordinates according to the first conversion relationship and the first coordinates, further comprising:

When the reference picture projected by the reference projection device is superimposed on the projection picture projected by the superposition projection device, a second conversion relationship is acquired, and a third conversion relationship is acquired, wherein the second conversion relationship is the reference source image and the conversion relationship between the reference image, the reference image is obtained from the projected reference picture taken by the imaging device, the third conversion relationship is the conversion relationship between the projection source image and the projection image, and the projection image is Obtained by capturing the projected projection screen by the imaging device;

The first conversion relationship is obtained according to the second conversion relationship and the third conversion relationship.
The method according to claim 3, wherein said obtaining the second conversion relationship comprises:

Obtaining the third coordinates of the second feature point on the reference source image;

Acquiring fourth coordinates of the second feature point on the reference image;

The second conversion relationship is obtained according to the third coordinate and the fourth coordinate.
The method according to claim 4, wherein said obtaining the third conversion relationship comprises:

Acquiring fifth coordinates of the second feature point on the projection source image;

Acquiring the sixth coordinates of the second feature point on the projected image;

The third conversion relationship is obtained according to the fifth coordinate and the sixth coordinate.
The method according to claim 1, characterized in that, after using the source image of the reference projection device as the reference source image and obtaining the coordinates of the reference source image as the first coordinates, further comprising:

Receive the screen image obtained by shooting the projection screen with the camera equipment;

When the screen image satisfies a preset condition, the superposition projection device is controlled to adjust.
The method according to claim 6, wherein the projection screen is projected with an initial reference picture projected by the reference projection device and an initial projection picture projected by the superposition projection device, and the screen image includes The initial reference image corresponding to the reference picture and the initial projection image corresponding to the initial projection picture; when the screen image satisfies a preset condition, controlling the superposition projection device to adjust includes:

When the resolution of the initial projected image in the screen image is less than a preset resolution, controlling the superposition projection device to perform focus adjustment; and/or

When the initial projected image in the screen image does not cover the initial reference image in the screen image, the superposition projection device is controlled to perform zoom adjustment.
The method according to claim 6, wherein when the screen image satisfies a preset condition, after controlling the overlay projection device to adjust, further comprising:

receiving a screen image recaptured by the camera device;

When the recaptured screen image satisfies the preset condition, the superimposed projection device is controlled to adjust until the recaptured screen image does not satisfy the preset condition.
The method according to any one of claims 1-8, wherein the controlling the superposition projection device to adjust the projection source image according to the second coordinates comprises:

When the second coordinates are within a range corresponding to the projection source image, the superposition and projection device is controlled to adjust the projection source image according to the second coordinates.
A superposition device for projected pictures, characterized in that the device comprises:

A device determination module, configured to use one of the at least two projection devices as a reference projection device, and use other projection devices of the at least two projection devices except the reference projection device as superimposed projection devices;

A first coordinate acquiring module, configured to use the source image of the reference projection device as a reference source image, and acquire the coordinates of the reference source image as first coordinates;

The second coordinate acquisition module is configured to calculate the coordinates of the projection source image as the second coordinates according to the first conversion relationship and the first coordinate, wherein the first conversion relationship is the reference source image and the projection source A conversion relationship between images, the projection source image is the source image of the superimposed projection device;

A superposition module, configured to control the superposition projection device to adjust the projection source image according to the second coordinates, so that the projection picture projected by the superposition projection device based on the adjusted projection source image is different from the reference projection The device overlays the reference picture projected based on the reference source image.
An electronic device, characterized in that it comprises:

one or more processors;

memory;

one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the one or more processors, the one or more application programs are configured to perform The method according to any one of claims 1-9.
A computer-readable storage medium, characterized in that program codes are stored in the computer-readable storage medium, and the program codes can be invoked by a processor to execute the method according to any one of claims 1-9.