CN111314680B - Method and device for realizing projection picture superposition and projection system - Google Patents
Method and device for realizing projection picture superposition and projection system Download PDFInfo
- Publication number
- CN111314680B CN111314680B CN201910363809.3A CN201910363809A CN111314680B CN 111314680 B CN111314680 B CN 111314680B CN 201910363809 A CN201910363809 A CN 201910363809A CN 111314680 B CN111314680 B CN 111314680B
- Authority
- CN
- China
- Prior art keywords
- projection
- image
- small
- superposition
- area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the invention relates to the technical field of projection superposition, and particularly discloses a method and a device for realizing projection picture superposition and a projection system. This application adopts the mode that a plurality of projection arrangement throw the little proportion characteristic map to the projection plane respectively, the overlapping of projection picture has been avoided, shoot the projection plane image through image acquisition device, acquire each projection arrangement's little proportion projection area, screen out the projection arrangement as the background and regard its actual projection area as expectation projection area, change each actual projection area as superimposed projection arrangement to expectation projection area again, the quick stack of projection picture pixel of having realized a plurality of projection arrangement, the degree of difficulty and the with low costs of realizing the projection picture of a plurality of projection arrangements are superimposed have been reduced.
Description
Technical Field
The invention relates to the technical field of projection superposition, and particularly discloses a method and a device for realizing projection picture superposition and a projection system.
Background
In some projection scenes, in order to improve the display brightness of the projection images and achieve a three-dimensional display effect, a plurality of projection images need to be overlaid to achieve a better display effect. Therefore, how to conveniently and rapidly realize the superposition of the projection images of a plurality of projection devices is a problem which needs to be solved at present.
Disclosure of Invention
In view of the above, the present application provides a method, an apparatus, and a projection system for implementing superposition of projection images, in which a plurality of projection apparatuses project small-scale feature maps onto a projection plane, a camera captures an image of the projection plane, a projection apparatus serving as a background is screened out, superposition adjustment parameters of the projection apparatuses serving as the superposition are calculated, and superposition of the projection images of the plurality of projection apparatuses is implemented quickly.
In order to solve the above technical problems, the technical solution provided by the present invention is a method for implementing projection image superposition, which is applied to a projection system, wherein the projection system includes an image acquisition device and at least 2 projection devices, and the method includes:
s11: sending an image projection command to each projection device to enable each projection device to project a respective small-scale feature map to a projection surface, wherein the small-scale feature maps on the projection surface are not overlapped;
s12: sending an image acquisition command to an image acquisition device so as to enable the image acquisition device to acquire a projection plane image, wherein the projection plane image is an integral image containing all small-scale characteristic images on a projection plane;
s13: calculating actual projection areas of the projection devices in the projection plane images according to the small-scale feature maps of the projection devices and the corresponding small-scale feature images, selecting the projection devices as backgrounds, using the rest projection devices as overlapped projection devices, and calculating overlapping adjustment parameters of the projection devices as overlaps, wherein the overlapping adjustment parameters of the projection devices as overlaps are used for adjusting the actual projection areas of the projection devices as overlaps to the actual projection areas of the projection devices as backgrounds;
s14: and sending the superposition adjustment parameters of the projection devices which are used as the superposition to the corresponding projection devices, so that the projection devices which are used as the superposition adjust the projection images according to the corresponding superposition adjustment parameters.
Preferably, the method of S13, comprising:
s131: acquiring a small-scale characteristic image area corresponding to each projection device in the projection surface image;
s132: acquiring a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device;
s133: calculating the actual projection area of each projection device in the projection plane image according to the corresponding small-scale characteristic image area of each projection device in the projection plane image and the characteristic pattern reduction ratio of the small-scale characteristic image of each projection device;
s134: screening out one projection device with the largest overlapping area between the actual projection area of the projection device and the actual projection areas of other projection devices as a projection device of the background, wherein the other projection devices are used as overlapped projection devices;
s135: and taking the actual projection area of the projection device as the background as the expected projection area of each projection device as the superposition, and calculating the superposition adjustment parameter of each projection device as the superposition according to the expected projection area and the actual projection area of each projection device as the superposition.
Preferably, the method of S131 includes:
identifying characteristic patterns in each small-scale characteristic image in the projection surface image, obtaining the number information of the projection device corresponding to each small-scale characteristic image, and identifying the corresponding small-scale characteristic image area of each small-scale characteristic image in the projection surface image;
and establishing a corresponding relation between the number information of each projection device and the small-scale characteristic image area.
Preferably, the method of S132 includes:
acquiring a characteristic pattern reduction ratio of a small-scale characteristic diagram preset by each projection device; or
And acquiring a small-scale characteristic diagram and an original characteristic diagram preset by each projection device, and calculating a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device relative to the original characteristic diagram.
Preferably, the method of S133 includes:
acquiring a small-scale feature map of each projection device, and converting the small-scale feature map into a pixel coordinate conversion relation of 4 corners of an original feature map;
acquiring pixel coordinates of 4 corner points of a small-scale characteristic image area corresponding to each projection device in the projection plane image;
and calculating 4 angular point pixel coordinates of an actual projection area of each projection device in the projection plane image according to the 4 angular point pixel coordinate transformation relation transformed to the original characteristic diagram by the small-scale characteristic diagram of each projection device and the 4 angular point pixel coordinates of the corresponding small-scale characteristic image area of each projection device in the projection plane image.
The invention also provides a device for realizing projection image superposition, which is applied to a projection system, wherein the projection system comprises an image acquisition device and at least 2 projection devices, and the device comprises:
the image projection module is used for sending an image projection command to each projection device so as to enable each projection device to project a small-scale feature image to a projection surface respectively, and the small-scale feature images on the projection surface are not overlapped;
the image acquisition module is used for sending an image acquisition command to the image acquisition device so as to enable the image acquisition device to acquire a projection plane image, wherein the projection plane image is an integral image containing all small-scale characteristic images on a projection plane;
the parameter calculation module is used for calculating the actual projection area of each projection device in the projection plane image according to the small-scale feature map of each projection device and the corresponding small-scale feature image, selecting the projection device as the background, calculating the superposition adjusting parameter of each projection device as the superposition, wherein the superposition adjusting parameter of the projection device as the superposition is used for adjusting the actual projection area of the projection device as the superposition to the actual projection area of the projection device as the background;
and the parameter sending module is used for sending the superposition adjustment parameters of the projection devices which are used for superposition to the corresponding projection devices so as to enable the projection devices which are used for superposition to adjust the projection images according to the corresponding superposition adjustment parameters.
Preferably, the parameter calculation module includes:
the projection area acquisition unit is used for acquiring a corresponding small-scale characteristic image area of each projection device in the projection surface image;
a reduction ratio acquisition unit for acquiring a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device;
an actual region calculation unit, configured to calculate an actual projection region of each projection apparatus in the projection surface image according to a corresponding small-scale feature image region of each projection apparatus in the projection surface image and a feature pattern reduction ratio of a small-scale feature map of each projection apparatus;
the background device screening unit is used for screening out one projection device with the largest overlapping area between the actual projection area of the projection device and the actual projection areas of other projection devices as a background projection device, and the other projection devices are used as overlapped projection devices;
and the adjustment parameter calculation unit is used for taking the actual projection area of the projection device as the background as the expected projection area of each projection device as the superposition, and calculating the superposition adjustment parameter of each projection device as the superposition according to the expected projection area and the actual projection area of each projection device as the superposition.
Preferably, the projection region acquiring unit includes:
the image information acquisition component is used for identifying the characteristic patterns in each small-scale characteristic image in the projection surface image, acquiring the number information of the projection device corresponding to each small-scale characteristic image, and identifying the small-scale characteristic image area corresponding to each small-scale characteristic image in the projection surface image;
and the corresponding relation establishing component is used for establishing the corresponding relation between the number information of each projection device and the small-scale characteristic image area.
Preferably, the method of the reduction ratio obtaining unit includes:
acquiring a characteristic pattern reduction ratio of a small-scale characteristic diagram preset by each projection device; or
And acquiring a small-scale characteristic diagram and an original characteristic diagram preset by each projection device, and calculating a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device relative to the original characteristic diagram.
Preferably, the actual region calculating unit includes:
the coordinate relation acquisition component is used for acquiring the pixel coordinate transformation relation of 4 angular points of the small-scale characteristic diagram of each projection device transformed to the original characteristic diagram;
the corner coordinate acquisition component is used for acquiring 4 corner pixel coordinates of a small-scale characteristic image area corresponding to each projection device in the projection surface image;
and the actual coordinate calculation component is used for calculating 4 angular point pixel coordinates of an actual projection area of each projection device in the projection plane image according to the 4 angular point pixel coordinate transformation relation of the small-scale feature map of each projection device transformed to the original feature map and the 4 angular point pixel coordinates of the corresponding small-scale feature image area of each projection device in the projection plane image.
The application also provides a device for realizing the superposition of the projection pictures, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor realizes the method for realizing the superposition of the projection pictures when executing the computer program.
The application also provides a projection system, which comprises an image acquisition device and at least 2 projection devices, and further comprises a device for realizing projection picture superposition.
Compared with the prior art, the beneficial effects of the method are detailed as follows: this application is through adopting a plurality of projection arrangement to throw the mode of little proportion characteristic map to the projection plane respectively, has avoided the overlapping of projection picture, shoots the projection plane image through image acquisition device, the screening is as the projection arrangement of background and regard its actual projection region as expectation projection region, the actual projection region that will regard as superimposed projection arrangement again changes to expectation projection region, the quick stack of a plurality of projection arrangement's projection picture pixel has been realized, projection picture stack degree of difficulty and with low costs have been reduced.
Drawings
Fig. 1 is a schematic flowchart of a method for implementing superposition of projection pictures according to an embodiment of the present invention;
fig. 2 is a schematic diagram of an architecture for implementing superposition of projection images by 3 projection apparatuses according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of a method for calculating an actual projection area of each projection apparatus in the projection plane image according to a small-scale feature map of each projection apparatus and a corresponding small-scale feature image, selecting a projection apparatus as a background, and calculating an overlay adjustment parameter of each projection apparatus as an overlay, where the overlay adjustment parameter of the projection apparatus as the overlay is used to adjust the actual projection area of the projection apparatus as the overlay to the actual projection area of the projection apparatus as the background according to the embodiment of the present invention;
fig. 4 is a schematic structural diagram of an apparatus for implementing superposition of projection pictures according to an embodiment of the present invention;
FIG. 5 is a diagram of a projection system according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood by those skilled in the art, the present invention will be further described in detail with reference to the accompanying drawings and specific embodiments.
As shown in fig. 1, an embodiment of the present invention provides a method for implementing superposition of projection pictures, which is applied to a projection system, where the projection system includes an image acquisition device and at least 2 projection devices, each projection device is provided with a respective original feature map and a small-scale feature map, or each projection device is provided with a respective small-scale feature map and a feature pattern reduction ratio, where the original feature map includes feature patterns, the feature patterns in the original feature map are full-screen feature pattern maps, the small-scale feature maps are non-full-screen feature pattern maps obtained by reducing the feature patterns in the original feature map according to the feature pattern reduction ratio at an original pixel ratio, the feature patterns in the small-scale feature maps are transparent maps at the center and around the center of the map, and the feature patterns include identification marks of the projection devices, and the specific method includes:
s11: sending an image projection command to each projection device to enable each projection device to project a respective small-scale feature image to the projection surface, wherein the small-scale feature images on the projection surface are not overlapped;
s12: sending an image acquisition command to an image acquisition device so that the image acquisition device acquires a projection plane image, wherein the projection plane image is an integral image containing all small-scale characteristic images on a projection plane;
s13: calculating actual projection areas of the projection devices in the projection plane images according to the small-scale feature maps of the projection devices and the corresponding small-scale feature images, selecting the projection devices as backgrounds, using the rest projection devices as overlapped projection devices, and calculating overlapping adjustment parameters of the projection devices as overlaps, wherein the overlapping adjustment parameters of the projection devices as overlaps are used for adjusting the actual projection areas of the projection devices as overlaps to the actual projection areas of the projection devices as backgrounds;
s14: and sending the superposition adjustment parameters of the projection devices which are used as the superposition to the corresponding projection devices, so that the projection devices which are used as the superposition adjust the projection images according to the corresponding superposition adjustment parameters.
It should be noted that each projection device may be provided with an original feature map, and when the projection device projects the original feature map to the projection plane, an actual projection area of the projection device may be seen, but if each projection device projects the original feature map to the projection plane, the original feature images on the projection plane may be overlapped, which may cause great difficulty in image processing and calculation when the projection pictures are overlapped, so that the feature patterns in the original feature map are reduced at the original pixel scale according to a certain reduction ratio (1> reduction ratio >0), that is, reduced according to the feature pattern reduction ratio and then projected, thereby avoiding mutual interference caused by overlapping pictures of multiple projection devices. The characteristic pattern reduction ratio can be set according to the actual requirements of customers, the original characteristic pattern is reduced according to a certain characteristic pattern reduction ratio to obtain a small-scale characteristic pattern, the essence of the small-scale characteristic pattern is that the characteristic pattern is reduced and then placed in the middle of the small-scale characteristic pattern, the periphery of the small-scale characteristic pattern is a transparent image, the small-scale characteristic pattern is consistent with the pattern content in the original characteristic pattern, and only the size of a pattern area is different. The original feature map may be a map with a frame, a map with a corner mark, or a planar geometric figure, for example, a map with only a frame (image regions are determined by identifying corners of the frame), an identification two-dimensional code map (image regions are determined by identifying positions of the two-dimensional code map, and the identification two-dimensional code map also includes corners and frames), or a map including regular geometric patterns (circles, rectangles, etc.), and four corner positions of the entire projection picture are calculated after the patterns are identified, which are all maps with obvious boundary features (lines, corners, etc.), that is, the original feature map referred to in this application.
The original characteristic diagram and the small-scale characteristic diagram of each projection device both contain identification marks corresponding to the projection devices, and because the actual projection area and the superposition adjustment parameters can be calculated only by determining which projection device corresponds to which projection area on the projection surface during image identification, the small-scale characteristic diagram can contain the identification marks of the projection devices, or the identification marks of the projection devices can be directly used as the small-scale characteristic diagram, or one identification mark can be placed in the center of the small-scale characteristic diagram. Taking the example of the Aruco code as shown in FIG. 2, other easily identifiable flags such as QRCode are also possible. The small scale feature map may also be designed specifically for higher image accuracy.
In S11, an image projection command is sent to each projection device so that each projection device projects the respective small-scale feature map onto the projection surface, but the small-scale feature maps cannot be overlapped with each other on the projection surface, otherwise the result of image recognition is affected. In general, after the projection devices which need to superpose projection pictures are normally placed in sequence, the small-scale feature maps projected by the projection devices are not overlapped on the projection plane.
In S12, the image capturing device is a device with an image capturing function, and may be a camera, a smart phone, a tablet computer, a notebook computer, or the like. The shooting position of the image acquisition device is not limited, and only all small-scale characteristic images on the projection surface can be integrally shot for subsequent calculation, but the definition also needs to meet the requirement of conventional pixels.
As shown in fig. 3, the method of SS13 includes:
s131: acquiring a small-scale characteristic image area corresponding to each projection device in a projection surface image;
s132: acquiring a characteristic pattern reduction ratio of a small-scale characteristic diagram of each projection device;
s133: calculating the actual projection area of each projection device in the projection plane image according to the corresponding small-scale characteristic image area of each projection device in the projection plane image and the characteristic pattern reduction ratio of the small-scale characteristic image of each projection device;
s134: screening out one projection device with the largest overlapping area between the actual projection area of the projection device and the actual projection areas of other projection devices as a projection device of the background, wherein the other projection devices are used as overlapped projection devices;
s135: the actual projection area of the projection device as the background is used as the expected projection area of each projection device as the superposition, and the superposition adjustment parameter of each projection device as the superposition is calculated according to the expected projection area and the actual projection area of each projection device as the superposition, wherein the superposition adjustment parameter of each projection device as the superposition is used for adjusting the actual projection area of the projection device as the superposition to the actual projection area of the projection device as the background.
Specifically, the method of S131 includes:
s1311: identifying characteristic patterns in each small-scale characteristic image in the projection surface image, obtaining the number information of the projection device corresponding to each small-scale characteristic image, and identifying the corresponding small-scale characteristic image area of each small-scale characteristic image in the projection surface image;
s1312: and establishing a corresponding relation between the number information of the projection device and the small-scale characteristic image area.
Specifically, the method of S132 includes: acquiring a characteristic pattern reduction ratio of a small-scale characteristic diagram preset by each projection device; or acquiring a small-scale characteristic diagram and an original characteristic diagram preset by each projection device, and calculating the characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device relative to the original characteristic diagram. The feature pattern reduction ratio of the small-scale feature map of each projection device may be stored in the projection device, in a device for realizing the superposition of projection pictures, or in a server.
Specifically, the method of S133 includes:
s1331: acquiring a small-scale feature map of each projection device, and converting the small-scale feature map into a 4-corner pixel coordinate conversion relation of an original feature map;
s1332: acquiring pixel coordinates of 4 corner points of a small-scale characteristic image area corresponding to each projection device in a projection plane image;
s1333: and calculating the 4 angular point pixel coordinates of the actual projection area of each projection device in the projection plane image according to the 4 angular point pixel coordinate transformation relation transformed to the original characteristic diagram by the small-scale characteristic diagram of each projection device and the 4 angular point pixel coordinates of the corresponding small-scale characteristic image area of each projection device in the projection plane image.
It should be noted that, when the identification mark of the projection apparatus is the small-scale feature map of the projection apparatus, the existing mature algorithm may be used to identify the identification mark, so as to obtain the size position of the identification mark and the projection apparatus number information corresponding to the identification mark.
Next, to obtain the original feature map and the small-scale feature map of the projection apparatus through the number information of the projection apparatus, or obtain the feature pattern reduction ratio, the original feature map and the small-scale feature map of the projection apparatus may be stored in the projection apparatus, may also be stored in an apparatus for implementing projection image superposition, and may also be stored on a remote server.
For example, the projection system shown in fig. 2 includes 3 projection devices, namely, projection device C1, projection device C2, and projection device C3, and calculates the positions of the actual projection areas of the 3 projection devices, namely, the actual projection area ABCD of projection device C1, the actual projection area EFGH of projection device C2, and the actual projection area IJKL of projection device C3, using the small-scale feature images of the projection surface, where the specific calculation method includes: since the small-scale feature map and the original feature map of C1 are known, the pixel coordinates of the small-scale feature map in the original feature map are known. According to the 4-corner pixel coordinates of the small-scale feature map and the 4-corner pixel coordinates of the original feature map, namely according to the corresponding relation of eight corners, a homography transformation matrix H1 is calculated by using a Direct Linear transformation method (Direct Linear Transform) or a least square method, namely H1 represents the coordinate transformation relation from the small-scale feature map of C1 to the original feature map. According to the projection plane image which is shot by an image acquisition device and contains the small-scale feature images projected by C1, C2 and C3, a C1 small-scale feature image area abcd, a C2 small-scale feature image area efgh and a C3 small-scale feature image area ijkl are found in the projection plane image, wherein a specific search method can be used for searching corners or matching image templates and the like, and the method is not particularly required and is not limited. Using homography matrix correspondences
Wherein (u1, v1), (u2, v2) are the pixel coordinates of the corresponding points of the original feature map and the small-scale feature map respectively, and S is a constant scale factor. Therefore, the positions of 4 corner points of the original feature image can be calculated according to the positions of four corner points of the C1 small-scale feature image on the projection plane, namely ABCD is obtained by ABCD according to H1 transformation, similarly, H2 is assumed to represent the coordinate transformation relation between the C2 small-scale feature image and the original feature image, EFGH is obtained by H2 transformation, H3 is assumed to represent the coordinate transformation relation between the C3 small-scale feature image and the original feature image, and Ijkl is obtained by IJKL transformation according to H3, so that the complete projection area/actual projection area of C1, C2 and C3 is found.
The method of S134 includes calculating and summing intersections between the actual projection area of each projection apparatus and the actual projection areas of other projection apparatuses, and screening the projection apparatus with the largest intersection as the projection apparatus of the background. The specific method comprises the following steps: after obtaining the actual projection areas of C1, C2, and C3, respectively calculating and adding the intersections of the actual projection areas of C2 and C3 for C1, respectively calculating and adding the intersections of the actual projection areas of C1 and C3 for C2, respectively calculating and adding the intersections of the actual projection areas of C1 and C2 for C3, respectively, selecting the maximum value of the intersections, that is, selecting the projection apparatus with projection apparatus C2 as the background, changing the actual projection area of C1 into an EFGH area through a homography transformation matrix according to the obtained actual projection area position EFGH of projection apparatus C2, that is, completely coinciding with the projection area of C2, that is, completing the superposition process of C1C2, changing the actual projection area of C3 into an EFGH area through a homography transformation matrix, that is completely coinciding with the projection area of C2, that is, completing the superposition process of C2C 3C 2. The specific calculation method comprises the following steps: the homography transformation matrix N1 (superposition adjustment parameters) from ABCD to EFGH is calculated by using a least square method, and N1 acts on the projection image of the projection device C1, so that a desired projection picture area ABCD can be obtained, namely, the superposition process is completed, and the like, and the homography transformation matrix calculation method comprises a least square method or a DLT method. By analogy, any two or more projection devices can adopt the same method to perform projection picture superposition, so that projection pictures of a plurality of projection devices can be superposed.
According to the technical scheme, the projection areas of the plurality of projection devices are positioned by projecting the small-scale characteristic diagrams, the projection images of the plurality of projection devices are superposed by photographing through the external/external image acquisition device and the homography method, the operation is simple, the calculation difficulty is small, and the method is very suitable for wide popularization.
The device for implementing the superposition of projection pictures provided in the embodiments of the present invention is described below, and it should be noted that for the description of the device for implementing the superposition of projection pictures, reference may be made to the above method for implementing the superposition of projection pictures, which is not described in detail below.
As shown in fig. 4, an embodiment of the present invention provides an apparatus for implementing superposition of projection pictures, which is applied to a projection system, where the projection system includes an image acquisition device and at least 2 projection devices, and the apparatus includes:
the image projection module 21 is configured to send an image projection command to each projection apparatus, so that each projection apparatus projects a respective small-scale feature map to a projection surface, where the small-scale feature maps on the projection surface are not overlapped;
the image acquisition module 22 is configured to send an image acquisition command to an image acquisition device, so that the image acquisition device acquires a projection plane image, where the projection plane image is an overall image including all small-scale feature images on a projection plane;
a parameter calculating module 23, configured to calculate an actual projection area of each projection apparatus in the projection plane image according to the small-scale feature map of each projection apparatus and the corresponding small-scale feature image, select the projection apparatus as a background, and calculate a superimposition adjustment parameter of each projection apparatus as a superimposition, where the superimposition adjustment parameter of the projection apparatus as the superimposition is used to adjust the actual projection area of the projection apparatus as the superimposition to the actual projection area of the projection apparatus as the background;
and the parameter sending module 24 is configured to send the overlay adjustment parameters of each projection apparatus as the overlay to the corresponding projection apparatus, so that each projection apparatus as the overlay adjusts the projection image according to the corresponding overlay adjustment parameters.
The parameter calculation module 23 includes:
the projection area acquisition unit is used for acquiring a corresponding small-scale characteristic image area of each projection device in the projection surface image;
a reduction ratio acquisition unit for acquiring a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device;
an actual region calculation unit, configured to calculate an actual projection region of each projection apparatus in the projection surface image according to a corresponding small-scale feature image region of each projection apparatus in the projection surface image and a feature pattern reduction ratio of a small-scale feature map of each projection apparatus;
the background device screening unit is used for screening out one projection device with the largest overlapping area between the actual projection area of the projection device and the actual projection areas of other projection devices as a background projection device, and the other projection devices are used as overlapped projection devices;
and the adjustment parameter calculation unit is used for taking the actual projection area of the projection device as the background as the expected projection area of each projection device as the superposition, and calculating the superposition adjustment parameter of each projection device as the superposition according to the expected projection area and the actual projection area of each projection device as the superposition.
It should be noted that the projection region acquisition unit includes:
the image information acquisition component is used for identifying the characteristic patterns in each small-scale characteristic image in the projection surface image, acquiring the number information of the projection device corresponding to each small-scale characteristic image, and identifying the small-scale characteristic image area corresponding to each small-scale characteristic image in the projection surface image;
and the corresponding relation establishing component is used for establishing the corresponding relation between the number information of each projection device and the small-scale characteristic image area.
It should be noted that the method for reducing the ratio obtaining unit includes: acquiring a characteristic pattern reduction ratio of a small-scale characteristic diagram preset by each projection device; or acquiring a small-scale feature map and an original feature map preset by each projection device, and calculating a feature pattern reduction ratio of the small-scale feature map of each projection device relative to the original feature map.
It should be noted that the actual region calculating unit includes:
the coordinate relation acquisition component is used for acquiring the pixel coordinate transformation relation of 4 angular points of the small-scale characteristic diagram of each projection device transformed to the original characteristic diagram;
the corner coordinate acquisition component is used for acquiring 4 corner pixel coordinates of a small-scale characteristic image area corresponding to each projection device in the projection surface image;
and the actual coordinate calculation component is used for calculating 4 angular point pixel coordinates of an actual projection area of each projection device in the projection plane image according to the 4 angular point pixel coordinate transformation relation of the small-scale feature map of each projection device transformed to the original feature map and the 4 angular point pixel coordinates of the corresponding small-scale feature image area of each projection device in the projection plane image.
The calculation method of the adjustment parameter calculation unit includes calculating and summing intersections between the actual projection area of each projection device and the actual projection areas of other projection devices, and screening the projection device with the largest intersection as the projection device of the background.
The embodiment of the invention also provides a device for realizing the superposition of the projection pictures, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor realizes the method for realizing the superposition of the projection pictures when executing the computer program.
As shown in fig. 5, an embodiment of the present invention further provides a projection system, which includes an image acquisition device, at least 2 projection devices, and the device for implementing superposition of projection pictures, where the device for implementing superposition of projection pictures establishes communication with the image acquisition device and each projection device respectively.
The projection device can be preset with a small-scale feature map and an original feature map, and projects the small-scale feature map to the projection surface in response to an image projection command sent by the device for realizing the superposition of the projection pictures. The projection device may also preset an original feature map and a feature pattern reduction ratio, and in response to an image projection command sent by the device for realizing the superposition of projection pictures, the feature pattern in the original feature map is reduced according to the feature pattern reduction ratio at the original pixel ratio to generate a small-scale feature map, and the small-scale feature map is projected onto the projection plane. The projection device may also preset a feature pattern reduction ratio and a feature pattern reduction ratio, and project the small-scale feature map to the projection plane in response to an image projection command sent by the device for realizing the superposition of the projection pictures.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the same element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for realizing projection picture superposition is applied to a projection system, the projection system comprises an image acquisition device and at least 2 projection devices, and the method comprises the following steps:
s11: sending an image projection command to each projection device to enable each projection device to project a respective small-scale feature map to a projection surface, wherein the small-scale feature maps on the projection surface are not overlapped;
s12: sending an image acquisition command to an image acquisition device so as to enable the image acquisition device to acquire a projection plane image, wherein the projection plane image is an integral image containing all small-scale characteristic images on a projection plane;
s13: calculating actual projection areas of the projection devices in the projection plane images according to the small-scale feature maps of the projection devices and the corresponding small-scale feature images, selecting the projection devices as backgrounds, using the rest projection devices as overlapped projection devices, and calculating overlapping adjustment parameters of the projection devices as overlaps, wherein the overlapping adjustment parameters of the projection devices as overlaps are used for adjusting the actual projection areas of the projection devices as overlaps to the actual projection areas of the projection devices as backgrounds;
s14: and sending the superposition adjustment parameters of the projection devices which are used as the superposition to the corresponding projection devices, so that the projection devices which are used as the superposition adjust the projection images according to the corresponding superposition adjustment parameters.
2. The method for realizing superposition of projection pictures according to claim 1, wherein the method of S13 comprises:
s131: acquiring a small-scale characteristic image area corresponding to each projection device in the projection surface image;
s132: acquiring a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device;
s133: calculating the actual projection area of each projection device in the projection plane image according to the corresponding small-scale characteristic image area of each projection device in the projection plane image and the characteristic pattern reduction ratio of the small-scale characteristic image of each projection device;
s134: screening out one projection device with the largest overlapping area between the actual projection area of the projection device and the actual projection areas of other projection devices as a projection device of the background, wherein the other projection devices are used as overlapped projection devices;
s135: and taking the actual projection area of the projection device as the background as the expected projection area of each projection device as the superposition, and calculating the superposition adjustment parameter of each projection device as the superposition according to the expected projection area and the actual projection area of each projection device as the superposition.
3. The method for realizing superposition of projection pictures according to claim 2, wherein said method of S131 comprises:
identifying characteristic patterns in each small-scale characteristic image in the projection surface image, obtaining the number information of the projection device corresponding to each small-scale characteristic image, and identifying the corresponding small-scale characteristic image area of each small-scale characteristic image in the projection surface image;
and establishing a corresponding relation between the number information of each projection device and the small-scale characteristic image area.
4. The method for implementing superposition of projection pictures according to claim 2, wherein said method of S132 comprises:
acquiring a characteristic pattern reduction ratio of a small-scale characteristic diagram preset by each projection device; or
And acquiring a small-scale characteristic diagram and an original characteristic diagram preset by each projection device, and calculating a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device relative to the original characteristic diagram.
5. The method for realizing superposition of projection pictures according to claim 2, wherein the method of S133 comprises:
acquiring a small-scale feature map of each projection device, and converting the small-scale feature map into a pixel coordinate conversion relation of 4 corners of an original feature map;
acquiring pixel coordinates of 4 corner points of a small-scale characteristic image area corresponding to each projection device in the projection plane image;
and calculating 4 angular point pixel coordinates of an actual projection area of each projection device in the projection plane image according to the 4 angular point pixel coordinate transformation relation transformed to the original characteristic diagram by the small-scale characteristic diagram of each projection device and the 4 angular point pixel coordinates of the corresponding small-scale characteristic image area of each projection device in the projection plane image.
6. The utility model provides a realize device that projection picture superposes which characterized in that is applied to projection system, projection system includes image acquisition device and at least 2 projection arrangement, realize the device that projection picture superposes and include:
the image projection module is used for sending an image projection command to each projection device so as to enable each projection device to project a small-scale feature image to a projection surface respectively, and the small-scale feature images on the projection surface are not overlapped;
the image acquisition module is used for sending an image acquisition command to the image acquisition device so as to enable the image acquisition device to acquire a projection plane image, wherein the projection plane image is an integral image containing all small-scale characteristic images on a projection plane;
the parameter calculation module is used for calculating the actual projection area of each projection device in the projection plane image according to the small-scale feature map of each projection device and the corresponding small-scale feature image, selecting the projection device as the background, calculating the superposition adjusting parameter of each projection device as the superposition, wherein the superposition adjusting parameter of the projection device as the superposition is used for adjusting the actual projection area of the projection device as the superposition to the actual projection area of the projection device as the background;
and the parameter sending module is used for sending the superposition adjustment parameters of the projection devices which are used for superposition to the corresponding projection devices so as to enable the projection devices which are used for superposition to adjust the projection images according to the corresponding superposition adjustment parameters.
7. The apparatus for implementing superposition of projection pictures according to claim 6, wherein the parameter calculating module comprises:
the projection area acquisition unit is used for acquiring a corresponding small-scale characteristic image area of each projection device in the projection surface image;
a reduction ratio acquisition unit for acquiring a characteristic pattern reduction ratio of the small-scale characteristic diagram of each projection device;
an actual region calculation unit, configured to calculate an actual projection region of each projection apparatus in the projection surface image according to a corresponding small-scale feature image region of each projection apparatus in the projection surface image and a feature pattern reduction ratio of a small-scale feature map of each projection apparatus;
the background device screening unit is used for screening one projection device with the largest overlapping area between the actual projection area of the background device and the actual projection areas of other projection devices as a superposed projection device;
and the adjustment parameter calculation unit is used for taking the actual projection area of the projection device as the background as the expected projection area of each projection device as the superposition, and calculating the superposition adjustment parameter of each projection device as the superposition according to the expected projection area and the actual projection area of each projection device as the superposition.
8. The apparatus for implementing superposition of projection pictures according to claim 7, wherein the projection area obtaining unit comprises:
the image information acquisition component is used for identifying the characteristic patterns in each small-scale characteristic image in the projection surface image, acquiring the number information of the projection device corresponding to each small-scale characteristic image, and identifying the small-scale characteristic image area corresponding to each small-scale characteristic image in the projection surface image;
and the corresponding relation establishing component is used for establishing the corresponding relation between the number information of each projection device and the small-scale characteristic image area.
9. An apparatus for implementing overlay of projection pictures, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for implementing overlay of projection pictures according to any one of claims 1 to 5 when executing the computer program.
10. A projection system comprising an image acquisition device and at least 2 projection devices, and further comprising a device for realizing projection picture superposition according to any one of claims 6 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910363809.3A CN111314680B (en) | 2019-04-30 | 2019-04-30 | Method and device for realizing projection picture superposition and projection system |
| PCT/CN2020/078186 WO2020220827A1 (en) | 2019-04-30 | 2020-03-06 | Method and device for realizing projected picture superimposition, and projection system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910363809.3A CN111314680B (en) | 2019-04-30 | 2019-04-30 | Method and device for realizing projection picture superposition and projection system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111314680A CN111314680A (en) | 2020-06-19 |
| CN111314680B true CN111314680B (en) | 2021-08-17 |
Family
ID=71146569
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910363809.3A Active CN111314680B (en) | 2019-04-30 | 2019-04-30 | Method and device for realizing projection picture superposition and projection system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111314680B (en) |
| WO (1) | WO2020220827A1 (en) |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011142597A (en) * | 2010-01-09 | 2011-07-21 | Seiko Epson Corp | Projector and control method thereof |
| JP2014225182A (en) * | 2013-05-17 | 2014-12-04 | 株式会社リコー | Image projection system, image processing apparatus, and program |
| JP6659129B2 (en) * | 2015-12-03 | 2020-03-04 | キヤノン株式会社 | Projection apparatus, control method thereof, and projection system |
| JP2017191307A (en) * | 2016-04-11 | 2017-10-19 | セイコーエプソン株式会社 | Projection system, projector, and control method for projector |
| CN106773478B (en) * | 2017-04-07 | 2018-08-24 | 成都市极米科技有限公司 | More projection screen methods of adjustment and device |
| CN107959836A (en) * | 2017-11-15 | 2018-04-24 | 苏州佳世达光电有限公司 | A kind of projecting method and optical projection system |
| CN110769228B (en) * | 2019-04-30 | 2022-05-06 | 成都极米科技股份有限公司 | Method and device for realizing projection picture splicing and projection system |
-
2019
- 2019-04-30 CN CN201910363809.3A patent/CN111314680B/en active Active
-
2020
- 2020-03-06 WO PCT/CN2020/078186 patent/WO2020220827A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| CN111314680A (en) | 2020-06-19 |
| WO2020220827A1 (en) | 2020-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113365041B (en) | Projection correction method, projection correction device, storage medium and electronic equipment | |
| CN110769228B (en) | Method and device for realizing projection picture splicing and projection system | |
| CN111750820B (en) | Image positioning method and system | |
| US10593014B2 (en) | Image processing apparatus, image processing system, image capturing system, image processing method | |
| KR100796849B1 (en) | Method for photographing panorama mosaics picture in mobile device | |
| CN102484724A (en) | Projection image area detecting device | |
| CN104170371B (en) | Realize the method and camera installation of self-service group photo | |
| CN108717704B (en) | Target tracking method based on fisheye image, computer device and computer readable storage medium | |
| CN111401266A (en) | Method, device, computer device and readable storage medium for positioning corner points of drawing book | |
| US11523056B2 (en) | Panoramic photographing method and device, camera and mobile terminal | |
| CN111866523B (en) | Panoramic video synthesis method and device, electronic equipment and computer storage medium | |
| CN114640833B (en) | Projection picture adjusting method, device, electronic equipment and storage medium | |
| CN114615480B (en) | Projection screen adjustment method, apparatus, device, storage medium, and program product | |
| US20230342973A1 (en) | Image processing method and apparatus, device, storage medium, and computer program product | |
| TWI615808B (en) | Image processing method for immediately producing panoramic images | |
| CN111314680B (en) | Method and device for realizing projection picture superposition and projection system | |
| WO2023151271A1 (en) | Model presentation method and apparatus, and electronic device and storage medium | |
| CN111314679B (en) | Method and device for realizing projection picture superposition and projection system | |
| CN111028290B (en) | Graphic processing method and device for drawing book reading robot | |
| CN115086625A (en) | Correction method, device and system of projection picture, correction equipment and projection equipment | |
| KR102135961B1 (en) | Apparatus and method of processing images | |
| US10013736B1 (en) | Image perspective transformation system | |
| CN115174879B (en) | Projection screen correction method, apparatus, computer device and storage medium | |
| CN115278184B (en) | Projection picture correction method and device | |
| JP2005122327A (en) | Photographing apparatus, and its image processing method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |