WO2020220831A1 - Method and apparatus for realizing superposition of projected pictures, and projection system - Google Patents

Method and apparatus for realizing superposition of projected pictures, and projection system Download PDF

Info

Publication number
WO2020220831A1
WO2020220831A1 PCT/CN2020/078366 CN2020078366W WO2020220831A1 WO 2020220831 A1 WO2020220831 A1 WO 2020220831A1 CN 2020078366 W CN2020078366 W CN 2020078366W WO 2020220831 A1 WO2020220831 A1 WO 2020220831A1
Authority
WO
WIPO (PCT)
Prior art keywords
projection
image
superimposed
small
projection device
Prior art date
Application number
PCT/CN2020/078366
Other languages
French (fr)
Chinese (zh)
Inventor
钟波
肖适
王鑫
张立造
Original Assignee
成都极米科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 成都极米科技股份有限公司 filed Critical 成都极米科技股份有限公司
Publication of WO2020220831A1 publication Critical patent/WO2020220831A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Definitions

  • the invention relates to the technical field of projection superimposition, and specifically discloses a method, a device and a projection system for realizing projection image superposition.
  • the present application provides a method, device, and projection system for realizing projection image superposition.
  • Two projection devices respectively project a superimposition feature map and a small-scale superposition feature map to the projection surface, and the camera captures the projection surface image to obtain the superimposition feature.
  • the image area and the small-scale superimposed characteristic image area are transformed, and the small-scale superimposed characteristic image area is transformed into the superimposed characteristic image area to quickly realize the superimposition of the projection images of the two projection devices.
  • the technical solution provided by the present invention is a method for realizing projection screen superposition, which is applied to a projection system.
  • the projection system includes an image acquisition device, a first projection device, and a second projection device.
  • the superimposed feature map preset by the projection device and the small-scale superimposed feature map preset by the second projection device have a pixel difference, and the method includes:
  • S11 Send a superimposed image projection command to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the preset superimposed feature map to the projection surface.
  • a small-scale superimposed feature image where the superimposed feature image and the small-scale superimposed feature image on the projection surface have an overlapping area, and the overlapping area does not block the four corner points of the superimposed feature image;
  • S12 Send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device acquires a projection surface image, where the projection surface image is an overall image including a small-scale superimposed feature image and superimposed feature image on the projection surface;
  • S14 Send the overlay adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the overlay adjustment parameter.
  • the method of step S13 includes:
  • S131 Identify the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, identify the small-scale superimposed characteristic image area in the projection surface image, and obtain the second A small-scale projection area of the projection device in the projection surface image;
  • S132 Obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map, and the ratio in the projection surface image A small-scale projection area, calculating the actual projection area of the second projection device in the projection surface image;
  • S133 Calculate the overlay adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
  • the method further includes the step: S10: establishing communication with the first projection device and the second projection device.
  • step S10 includes:
  • S1011 Send a recognition image projection command to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps on the projection surface, and the Two small-scale recognition feature images do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
  • S1012 Send a recognition image capture command to the image capture device, so that the image capture device captures a projection surface image, where the projection surface image is an overall image including two small-scale recognition feature images on the projection surface;
  • S1014 Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  • step S10 includes:
  • S1023 Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  • the present invention also provides a device for superimposing projection images, which is applied to a projection system.
  • the projection system includes an image acquisition device, a first projection device, and a second projection device.
  • the superimposition feature map preset by the first projection device is
  • the small-scale superimposed feature map preset by the second projection device has a pixel difference, and the device includes:
  • the superimposed image projection module is used to send superimposed image projection commands to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the Projecting a preset small-scale superimposed feature map on a surface, where the superimposed feature image and the small-scale superimposed feature image on the projection surface have overlapping areas, and the overlapping area does not block the four corner points of the superimposed feature image;
  • the superimposed image acquisition module is used to send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device collects a projection surface image, and the projection surface image is a whole including a small-scale superimposed feature image on the projection surface and a superimposed feature image image;
  • a superposition parameter calculation module configured to calculate superposition adjustment parameters of the second projection device according to the projection surface image
  • the superimposition parameter sending module is configured to send the superimposition adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the superimposition adjustment parameter.
  • the superposition parameter calculation module includes:
  • the image recognition unit is used to recognize the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, and is also used to recognize the small-scale superposition in the projection surface image A characteristic image area to obtain a small-scale projection area of the second projection device in the projection surface image;
  • the area calculation unit is used to obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and according to the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map and the projection A small-scale projection area in the surface image, calculating the actual projection area of the second projection device in the projection surface image;
  • the parameter calculation unit is configured to calculate the superimposition adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
  • it further includes a communication establishment module for establishing communication with the first projection device and the second projection device.
  • the communication establishment module includes:
  • the recognition image projection unit is used to send recognition image projection commands to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps to the projection surface, so The two small-scale recognition feature images on the projection surface do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
  • the recognition image acquisition unit is configured to send a recognition image acquisition command to the image acquisition device, so that the image acquisition device acquires a projection surface image, and the projection surface image is an overall image containing two small-scale recognition characteristic images on the projection surface;
  • a serial number information acquisition unit used to identify the identification marks in the two small-scale identification feature images in the projection surface image, and acquire serial number information of the two projection devices;
  • Number communication establishment unit respectively establish communication with the first projection device and the second projection device according to the number information of the two projection devices.
  • the communication establishment module includes:
  • Broadcast sending unit for sending broadcast to all projection devices
  • the information receiving unit is used to receive the number information returned by the two projection devices
  • the communication establishment unit is used to establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  • the present invention also provides a device for realizing projection screen superimposition, including a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor realizes the foregoing when the computer program is executed.
  • the method of realizing the projection screen superimposition including a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor realizes the foregoing when the computer program is executed.
  • the present invention also provides a projection system, which includes an image acquisition device and at least two projection devices, and also includes the above-mentioned device for superimposing projection images.
  • the present application uses the first projection device to project the superimposed feature map on the projection surface, and the second projection device projects the small-scale superimposed feature map on the projection surface, thereby avoiding the projection image
  • the corner points are overlapped, the projection surface image is captured by the image acquisition device, the actual projection area of the second projection device is calculated, and then the actual projection area of the second projection device is transformed into the superimposed characteristic image area, which can realize two or more projection devices.
  • the precise superposition of the projection screen pixels reduces the difficulty and low cost of the projection screen superposition.
  • FIG. 1 is a schematic flowchart of a method for superimposing projection images provided by an embodiment of the present invention
  • FIG. 2 is a schematic diagram of an architecture for realizing superimposition of projection images provided by an embodiment of the present invention
  • FIG. 3 is a schematic flowchart of another method for superimposing projection images according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of the structure of the identifying projection device provided by an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a device for realizing superimposition of projection images provided by an embodiment of the present invention.
  • Fig. 6 is an architectural diagram of a projection system provided by an embodiment of the present invention.
  • the embodiment of the present invention provides a method for realizing projection image superposition, which is applied to a projection system.
  • the projection system includes an image acquisition device, a first projection device, and a second projection device.
  • the first projection device is preset There is a pixel difference between the superimposed feature map and the small-scale superimposed feature map preset by the second projection device.
  • the specific method includes:
  • S11 Send a superimposed image projection command to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the preset superimposed feature map to the projection surface.
  • a small-scale superimposed feature image where the superimposed feature image and the small-scale superimposed feature image on the projection surface have an overlapping area, and the overlapping area does not block the four corner points of the superimposed feature image;
  • S12 Send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device acquires a projection surface image, where the projection surface image is an overall image including a small-scale superimposed feature image and superimposed feature image on the projection surface;
  • S14 Send the overlay adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the overlay adjustment parameter.
  • both projection devices are provided with superimposed feature maps and small-scale superimposed feature maps.
  • the superimposed feature maps of the first projection device and the small-scale superimposed feature maps of the second projection device have a pixel difference.
  • the small-scale superimposed feature map has a pixel difference with the superimposed feature map of the second projection device.
  • the purpose of setting the pixel difference is to obtain the area of the projection surface image where the feature image is superimposed and the area of the small-scale superimposed feature image in the projection surface image.
  • the superimposed feature map can be a transparent framed map
  • the small-scale superimposed feature map can be a black framed map.
  • the first projection device is controlled to project the superimposed feature map.
  • the reference projection image can be determined As long as the projection area of the second projection device is changed to the position of the reference projection screen, the superposition of the projection screen is completed.
  • Each projection device is provided with its own overlay feature map and scale overlay feature map.
  • the projection device projects the overlay feature map to the projection surface, the actual projection area of the projection device can be seen, but each projection device projects the overlay feature to the projection surface
  • the map will cause the images on the projection surface to overlap, and it is very easy to block the four corners of the superimposed feature image, which brings great difficulty to image processing and calculation when implementing image superposition, so the superimposed feature map is based on certain features
  • the pattern reduction ratio (1>reduction ratio>0) is reduced and re-projected to avoid overlapping of the images of multiple projection devices, and also avoids the overlap of the superimposed feature maps projected by the first projection device and the superimposed feature maps projected by the second projection device. interference.
  • the feature pattern reduction ratio can be set according to the actual needs of customers.
  • the feature pattern in the overlay feature map is reduced by the feature pattern reduction ratio under the original pixel ratio to obtain a small-scale overlay feature map.
  • the essence of the small-scale overlay feature map is to superimpose features.
  • the feature pattern of the map is reduced and placed in the upper part of the small-scale superimposed feature map, and the surrounding is a transparent image.
  • the small-scale superimposed feature map and the superimposed feature map have the same image content, but the size of the image area is different.
  • step S11 after the first projection device projects the superimposed feature map on the projection surface, since the superimposed feature map on the projection surface is the reference projection area for finally displaying the projection image, we can also project the superimposed feature After the picture, perform operations such as keystone correction on the projection screen to make the projection screen rectangular or have a better effect.
  • step S11 when the second projection device projects the small-scale superimposed feature image on the projection surface, the small-scale superimposed feature image on the projection surface cannot block the four corner points of the superimposed feature image, that is, the small-scale superimposed feature image
  • the superimposed feature image can be inside the frame of the superimposed feature image, or outside the frame of the superimposed feature image, or overlap with the superimposed feature image, but it must not cover the four corners of the superimposed feature image, otherwise it will affect the result of image recognition .
  • the image acquisition device refers to a device with an image shooting function, which may be a camera, a smart phone, a tablet computer, a notebook computer, and the like.
  • the shooting position of the image acquisition device is not limited. It is only required that all small-scale superimposed feature images and superimposed feature images on the projection surface can be taken as a whole for subsequent calculations. Of course, the definition also needs to meet the requirements of conventional pixels.
  • step S13 includes:
  • S131 Identify the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, identify the small-scale superimposed characteristic image area in the projection surface image, and obtain the second A small-scale projection area of the projection device in the projection surface image;
  • S132 Obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map, and the ratio in the projection surface image A small-scale projection area, calculating the actual projection area of the second projection device in the projection surface image;
  • S133 Calculate the overlay adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
  • the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device can be stored in the second projection device, can also be stored in a device that realizes projection screen overlap, or can be stored on a server.
  • the embodiment of the present invention provides a schematic diagram of an architecture for realizing projection screen overlap.
  • the projection system includes projection devices C1 and C2.
  • the projection device C1 is the first projection device, and the projection device C2 is the second projection device. It is necessary to locate the position of the projection area of the two projection devices.
  • the projection device C1 projects the superimposed feature map, that is, directly projects the transparent image with a frame in the middle, and the projection device C2 projects a small-scale superimposed feature map.
  • the projection device C1 only displays the frame and the center part is printed. Black background (the black background of the projection device means that the brightness is very low or 0), C2 projects a small-scale superimposed feature map with pixel difference in the central part of C1 to locate the projection area. Since the images projected by C1 and C2 are known, the mutual inclusion relationship between the images found according to the image recognition can be matched and corresponding to the projection image area and the projection device.
  • the next step is to calculate the actual projection area of the projection device C2.
  • the specific calculation methods include: Since the small-scale superimposed feature map and the superimposed feature map of C2 are known, the pixel coordinates of the small-scale superimposed feature map in the superimposed feature map are Known. According to the small-scale superposition of the four corner pixel coordinates of the feature map and the four corner pixel coordinates of the superimposed feature map, that is, according to the corresponding relationship of the eight corner points, use the direct linear transformation method (Direct Linear Transform) or the least square method to calculate The homography transformation matrix H2, that is, H2 represents the coordinate transformation relationship from the small-scale superimposed feature map of C2 to the superimposed feature map.
  • the homography transformation matrix H2 that is, H2 represents the coordinate transformation relationship from the small-scale superimposed feature map of C2 to the superimposed feature map.
  • the projection surface image of the small-scale superimposed feature map projected by C2 taken by the image acquisition device on the projection surface Find the C2 small-scale superimposed feature image area EFGH in the image.
  • the specific search method here can be corner search or image template matching. There are no specific requirements and no restrictions here. Use homography matrix correspondence
  • (u1, v1), (u2, v2) are the pixel coordinates of the corresponding points of the superimposed feature map and the small-scale superimposed feature map, respectively, and S is a constant scale factor. Therefore, the positions of the four corner points of the superimposed feature image can be calculated from the positions of the four corner points of the C2 small-scale superimposed feature image on the projection surface, that is, the efgh can be obtained by EFGH according to the H1 transformation, so as to find the complete projection area/actual projection of C2 area.
  • the specific calculation method includes: using the least square method to calculate the homography transformation matrix N1 (superimposition adjustment parameter) from efgh to ABCD.
  • N1 superimposition adjustment parameter
  • the calculation methods of homography change matrix include least square method or DLT method.
  • the actual projection area of the projection device C2 can also be used as the reference projection area, and the actual projection area of the projection device C1 can be transformed to the actual projection area of C2.
  • the projection screens of 2 or more projection devices are superimposed.
  • the embodiment of the present invention also provides a method for realizing projection screen superimposition.
  • the difference from Embodiment 1 is that before step S11, the method further includes the following step: S10: establishing communication with the first projection device and the second projection device.
  • a method of step S10 includes:
  • S1011 Send a recognition image projection command to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps on the projection surface, and the Two small-scale recognition feature images do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
  • S1012 Send a recognition image capture command to the image capture device, so that the image capture device captures a projection surface image, where the projection surface image is an overall image including two small-scale recognition feature images on the projection surface;
  • S1014 Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  • the small-scale identification feature map can include
  • the identification mark of the projection device can also be used as a small-scale identification feature map.
  • An identification mark can be placed in the center of the small-scale identification feature map, as shown in Figure 3, taking the Aruco code as an example, or it can be other easily recognizable marks such as QRcode.
  • a small-scale recognition feature map can also be specially designed.
  • the image acquisition device collects the projection surface image, which is the overall image including all the small-scale recognition feature images on the projection surface; recognizes each small-scale recognition feature image in the projection surface image, and obtains the number information of each projection device; The number information can establish communication with each projection device through a wired network or a wireless network.
  • step S10 includes:
  • S1023 Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  • the technical solution of the present application recognizes the superimposed characteristic image and the small-scale superimposed characteristic image in the projection surface image, performs positioning of the desired projection area and the projection area of the second projection device, and performs both functions by taking pictures with an external image acquisition device and a homography transformation method.
  • the superposition of the projection images of the two projection devices is simple to operate and difficult to calculate, which is very suitable for wide promotion.
  • the following describes the device for realizing projection screen superimposition provided by the embodiment of the present invention. It should be noted that the description of the device for realizing projection screen superimposition can refer to the above method for realizing projection screen superimposition, which will not be repeated hereafter.
  • an embodiment of the present invention provides a device for superimposing projection screens, which is applied to a projection system.
  • the projection system includes an image acquisition device, a first projection device, and a second projection device.
  • the set superimposed feature map has a pixel difference with the small-scale superimposed feature map preset by the second projection device, and the specific device includes:
  • the superimposed image projection module 21 is used to send a superimposed image projection command to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map, the second projection
  • the device projects a preset small-scale superimposed feature image on a projection surface, the superimposed feature image on the projection surface and the small-scale superimposed feature image have an overlapped area, and the overlapped area does not block the four corner points of the superimposed feature image ;
  • the superimposed image acquisition module 22 is configured to send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device collects a projection surface image, and the projection surface image includes a small-scale superimposed feature image on the projection surface and a superimposed feature image Overall image
  • the superposition parameter calculation module 23 is configured to calculate superposition adjustment parameters of the second projection device according to the projection surface image
  • the superimposition parameter sending module 24 is configured to send the superimposition adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the superimposition adjustment parameter.
  • the parameter calculation module 23 includes:
  • the image recognition unit is used to recognize the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, and is also used to recognize the small-scale superposition in the projection surface image A characteristic image area to obtain a small-scale projection area of the second projection device in the projection surface image;
  • the area calculation unit is used to obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and according to the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map and the projection A small-scale projection area in the surface image, calculating the actual projection area of the second projection device in the projection surface image;
  • the parameter calculation unit is configured to calculate the superimposition adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
  • the device also includes:
  • It also includes a communication establishment module for establishing communication with the first projection device and the second projection device.
  • the communication establishment module may include:
  • the recognition image projection unit is used to send recognition image projection commands to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps to the projection surface, so The two small-scale recognition feature images on the projection surface do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
  • the recognition image acquisition unit is configured to send a recognition image acquisition command to the image acquisition device, so that the image acquisition device collects a projection surface image, the projection surface image being an overall image including two small-scale recognition characteristic images on the projection surface;
  • a serial number information acquisition unit used to identify the identification marks in the two small-scale identification feature images in the projection surface image, and acquire serial number information of the two projection devices;
  • Number communication establishment unit respectively establish communication with the first projection device and the second projection device according to the number information of the two projection devices.
  • another way of the communication establishment module may also include:
  • Broadcast sending unit for sending broadcast to all projection devices
  • the information receiving unit is used to receive the number information returned by the two projection devices
  • the communication establishment unit is used to establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  • the embodiment of the present invention also provides a device for realizing projection screen overlay, including a memory, a processor, and a computer program stored on the memory and running on the processor.
  • a device for realizing projection screen overlay including a memory, a processor, and a computer program stored on the memory and running on the processor.
  • the processor executes the computer program, Realize the above-mentioned method of realizing projected picture superimposition.
  • the device can realize the superposition of the projection images of multiple projection devices.
  • the specific method can be to first determine a projection device as the reference projection screen, and then use each remaining projection device in turn with the projection device as the reference projection screen to calculate the superimposition adjustment parameters using the above-mentioned method of realizing projection screen superposition, and obtain After the superposition adjustment parameters of each projection device are adjusted, the image is simultaneously projected and the projected image is adjusted.
  • an embodiment of the present invention also provides a projection system, including an image acquisition device and at least two projection devices, and also includes the above-mentioned device for realizing projection screen superimposition.
  • the device for realizing projection screen superimposition and the image acquisition device are respectively Establish communication with each projection device.

Abstract

The present invention relates to the technical field of projection superposition, and specifically disclosed are a method and apparatus for realizing superposition of projected pictures, and a projection system. According to the present application, a superposed feature image is projected to a projection plane by means of a first projection apparatus, and a small-scale superposed feature image is projected to the projection plane by means of a second projection apparatus, thus avoiding overlap of angular points of projected images; and a projection plane image is photographed by means of an image collection apparatus, an actual projection area of the second projection apparatus is calculated, and then the actual projection area of the second projection apparatus is transformed to a superposed feature image region, such that precise superposition of pixels of projected pictures of two or more projection apparatuses can be realized, thus reducing the difficulty in superposing the projected pictures, and costs being low.

Description

实现投影画面叠加的方法、装置及投影系统Method, device and projection system for realizing projection screen superposition 技术领域Technical field
本发明涉及投影叠加技术领域,具体公开一种实现投影画面叠加的方法、装置及投影系统。The invention relates to the technical field of projection superimposition, and specifically discloses a method, a device and a projection system for realizing projection image superposition.
背景技术Background technique
在一些投影场景中,为了提高投影画面的显示亮度和实现三维显示效果,需要将多个投射画面叠加,以达到一个更好的展示效果。因此,如何方便快速的实现多个投影装置的投影画面叠加是目前亟需解决的问题。In some projection scenes, in order to improve the display brightness of the projection screen and achieve a three-dimensional display effect, multiple projection screens need to be superimposed to achieve a better display effect. Therefore, how to conveniently and quickly superimpose projection images of multiple projection devices is a problem that needs to be solved urgently.
发明内容Summary of the invention
有鉴于此,本申请提供一种实现投影画面叠加的方法、装置及投影系统,通过两个投影装置分别向投影面投射叠加特征图和小比例叠加特征图,摄像头拍摄投影面图像,获取叠加特征图像区域和小比例叠加特征图像区域,将小比例叠加特征图像区域变换到叠加特征图像区域,快速实现两个投影装置的投影画面叠加。In view of this, the present application provides a method, device, and projection system for realizing projection image superposition. Two projection devices respectively project a superimposition feature map and a small-scale superposition feature map to the projection surface, and the camera captures the projection surface image to obtain the superimposition feature. The image area and the small-scale superimposed characteristic image area are transformed, and the small-scale superimposed characteristic image area is transformed into the superimposed characteristic image area to quickly realize the superimposition of the projection images of the two projection devices.
为解决以上技术问题,本发明提供的技术方案是一种实现投影画面叠加的方法,应用于投影系统,所述投影系统包括图像采集装置、第一投影装置和第二投影装置,所述第一投影装置预设的叠加特征图与所述第二投影装置预设的小比例叠加特征图具有像素差,所述方法包括:In order to solve the above technical problems, the technical solution provided by the present invention is a method for realizing projection screen superposition, which is applied to a projection system. The projection system includes an image acquisition device, a first projection device, and a second projection device. The superimposed feature map preset by the projection device and the small-scale superimposed feature map preset by the second projection device have a pixel difference, and the method includes:
S11:向第一投影装置和第二投影装置发送叠加图像投射命令,以使所述第一投影装置向投影面投射预设的叠加特征图、所述第二投影装置向投影面投射预设的小比例叠加特征图,所述投影面上的叠加特征图像与小比例叠加特征图像具有重叠区域,且所述重叠区域未遮挡所述叠加特征图像的四个角点;S11: Send a superimposed image projection command to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the preset superimposed feature map to the projection surface. A small-scale superimposed feature image, where the superimposed feature image and the small-scale superimposed feature image on the projection surface have an overlapping area, and the overlapping area does not block the four corner points of the superimposed feature image;
S12:向图像采集装置发送叠加图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上小比例叠加特征图像和叠加特征图像的 整体图像;S12: Send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device acquires a projection surface image, where the projection surface image is an overall image including a small-scale superimposed feature image and superimposed feature image on the projection surface;
S13:根据所述投影面图像计算第二投影装置的叠加调整参数;S13: Calculate the superimposition adjustment parameter of the second projection device according to the projection surface image;
S14:将所述第二投影装置的叠加调整参数发送给第二投影装置,以使所述第二投影装置按所述叠加调整参数调整投射图像。S14: Send the overlay adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the overlay adjustment parameter.
优选的,所述步骤S13的方法包括:Preferably, the method of step S13 includes:
S131:识别所述投影面图像中的叠加特征图像区域,获得第二投影装置在所述投影面图像中的期望投影区域,识别所述投影面图像中的小比例叠加特征图像区域,获得第二投影装置在所述投影面图像中的小比例投影区域;S131: Identify the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, identify the small-scale superimposed characteristic image area in the projection surface image, and obtain the second A small-scale projection area of the projection device in the projection surface image;
S132:获取第二投影装置的小比例叠加特征图的特征图案缩小比值,根据第二投影装置的小比例叠加特征图、小比例叠加特征图的特征图案缩小比值和在所述投影面图像中的小比例投影区域,计算第二投影装置在所述投影面图像中的实际投影区域;S132: Obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map, and the ratio in the projection surface image A small-scale projection area, calculating the actual projection area of the second projection device in the projection surface image;
S133:根据第二投影装置在所述投影面图像中的实际投影区域和第二投影装置在所述投影面图像中的期望投影区域计算第二投影装置的叠加调整参数。S133: Calculate the overlay adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
优选的,在所述步骤S11前,还包括步骤:S10:与第一投影装置和第二投影装置建立通信。Preferably, before the step S11, the method further includes the step: S10: establishing communication with the first projection device and the second projection device.
优选的,所述步骤S10的方法,包括:Preferably, the method of step S10 includes:
S1011:向第一投影装置和第二投影装置发送识别图像投射命令,以使所述第一投影装置和第二投影装置分别向投影面投射各自的小比例识别特征图,所述投影面上的两个小比例识别特征图像未重叠,所述小比例识别特征图包含投影装置的识别标识;S1011: Send a recognition image projection command to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps on the projection surface, and the Two small-scale recognition feature images do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
S1012:向图像采集装置发送识别图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上两个小比例识别特征图像的整体图像;S1012: Send a recognition image capture command to the image capture device, so that the image capture device captures a projection surface image, where the projection surface image is an overall image including two small-scale recognition feature images on the projection surface;
S1013:识别所述投影面图像中两个小比例识别特征图像中的识别标识,获取 两个投影装置的编号信息;S1013: Identify the identification marks in the two small-scale identification feature images in the projection surface image, and obtain the number information of the two projection devices;
S1014:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。S1014: Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
优选的,所述步骤S10的方法,包括:Preferably, the method of step S10 includes:
S1021:向所有投影装置发送广播;S1021: Send a broadcast to all projection devices;
S1022:接收两个投影装置返回的编号信息;S1022: Receive the number information returned by the two projection devices;
S1023:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。S1023: Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
本发明还提供一种实现投影画面叠加的装置,应用于投影系统,所述投影系统包括图像采集装置、第一投影装置和第二投影装置,所述第一投影装置预设的叠加特征图与所述第二投影装置预设的小比例叠加特征图具有像素差,所述装置包括:The present invention also provides a device for superimposing projection images, which is applied to a projection system. The projection system includes an image acquisition device, a first projection device, and a second projection device. The superimposition feature map preset by the first projection device is The small-scale superimposed feature map preset by the second projection device has a pixel difference, and the device includes:
叠加图像投射模块,用于向第一投影装置和第二投影装置发送叠加图像投射命令,以使所述第一投影装置向投影面投射预设的叠加特征图、所述第二投影装置向投影面投射预设的小比例叠加特征图,所述投影面上的叠加特征图像与小比例叠加特征图像具有重叠区域,且所述重叠区域未遮挡所述叠加特征图像的四个角点;The superimposed image projection module is used to send superimposed image projection commands to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the Projecting a preset small-scale superimposed feature map on a surface, where the superimposed feature image and the small-scale superimposed feature image on the projection surface have overlapping areas, and the overlapping area does not block the four corner points of the superimposed feature image;
叠加图像采集模块,用于向图像采集装置发送叠加图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上小比例叠加特征图像和叠加特征图像的整体图像;The superimposed image acquisition module is used to send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device collects a projection surface image, and the projection surface image is a whole including a small-scale superimposed feature image on the projection surface and a superimposed feature image image;
叠加参数计算模块,用于根据所述投影面图像计算第二投影装置的叠加调整参数;A superposition parameter calculation module, configured to calculate superposition adjustment parameters of the second projection device according to the projection surface image;
叠加参数发送模块,用于将所述第二投影装置的叠加调整参数发送给第二投影装置,以使所述第二投影装置按所述叠加调整参数调整投射图像。The superimposition parameter sending module is configured to send the superimposition adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the superimposition adjustment parameter.
优选的,所述叠加参数计算模块包括:Preferably, the superposition parameter calculation module includes:
图像识别单元,用于识别所述投影面图像中的叠加特征图像区域,获得第二投 影装置在所述投影面图像中的期望投影区域,还用于识别所述投影面图像中的小比例叠加特征图像区域,获得第二投影装置在所述投影面图像中的小比例投影区域;The image recognition unit is used to recognize the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, and is also used to recognize the small-scale superposition in the projection surface image A characteristic image area to obtain a small-scale projection area of the second projection device in the projection surface image;
区域计算单元,用于获取第二投影装置的小比例叠加特征图的特征图案缩小比值,根据第二投影装置的小比例叠加特征图、小比例叠加特征图的特征图案缩小比值和在所述投影面图像中的小比例投影区域,计算第二投影装置在所述投影面图像中的实际投影区域;The area calculation unit is used to obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and according to the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map and the projection A small-scale projection area in the surface image, calculating the actual projection area of the second projection device in the projection surface image;
参数计算单元,用于根据第二投影装置在所述投影面图像中的实际投影区域和第二投影装置在所述投影面图像中的期望投影区域计算第二投影装置的叠加调整参数。The parameter calculation unit is configured to calculate the superimposition adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
优选的,还包括通信建立模块,用于与第一投影装置和第二投影装置建立通信。Preferably, it further includes a communication establishment module for establishing communication with the first projection device and the second projection device.
优选的,所述通信建立模块包括:Preferably, the communication establishment module includes:
识别图像投射单元,用于向第一投影装置和第二投影装置发送识别图像投射命令,以使所述第一投影装置和第二投影装置分别向投影面投射各自的小比例识别特征图,所述投影面上的两个小比例识别特征图像未重叠,所述小比例识别特征图包含投影装置的识别标识;The recognition image projection unit is used to send recognition image projection commands to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps to the projection surface, so The two small-scale recognition feature images on the projection surface do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
识别图像采集单元,用于向图像采集装置发送识别图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上两个小比例识别特征图像的整体图像;The recognition image acquisition unit is configured to send a recognition image acquisition command to the image acquisition device, so that the image acquisition device acquires a projection surface image, and the projection surface image is an overall image containing two small-scale recognition characteristic images on the projection surface;
编号信息获取单元,用于识别所述投影面图像中两个小比例识别特征图像中的识别标识,获取两个投影装置的编号信息;A serial number information acquisition unit, used to identify the identification marks in the two small-scale identification feature images in the projection surface image, and acquire serial number information of the two projection devices;
编号通信建立单元:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。Number communication establishment unit: respectively establish communication with the first projection device and the second projection device according to the number information of the two projection devices.
优选的,所述通信建立模块包括:Preferably, the communication establishment module includes:
广播发送单元,用于向所有投影装置发送广播;Broadcast sending unit for sending broadcast to all projection devices;
信息接收单元,用于接收两个投影装置返回的编号信息;The information receiving unit is used to receive the number information returned by the two projection devices;
通信建立单元,用于根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。The communication establishment unit is used to establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
本发明还提供一种实现投影画面叠加的装置,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述的实现投影画面叠加的方法。The present invention also provides a device for realizing projection screen superimposition, including a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor realizes the foregoing when the computer program is executed. The method of realizing the projection screen superimposition.
本发明还提供一种投影系统,包括图像采集装置和至少2个投影装置,还包括上述的实现投影画面叠加的装置。The present invention also provides a projection system, which includes an image acquisition device and at least two projection devices, and also includes the above-mentioned device for superimposing projection images.
本申请与现有技术相比,其有益效果详细说明如下:本申请通过第一投影装置向投影面投射叠加特征图,第二投影装置向投影面投射小比例叠加特征图,避免了投影画面的角点重叠,通过图像采集装置拍摄投影面图像,计算第二投影装置的实际投影区域,再将第二投影装置的实际投影区域变换到叠加特征图像区域,能够实现两个或者多个投影装置的投影画面像素的精确叠加,降低了投影画面叠加难度且成本低。Compared with the prior art, the beneficial effects of the present application are described in detail as follows: the present application uses the first projection device to project the superimposed feature map on the projection surface, and the second projection device projects the small-scale superimposed feature map on the projection surface, thereby avoiding the projection image The corner points are overlapped, the projection surface image is captured by the image acquisition device, the actual projection area of the second projection device is calculated, and then the actual projection area of the second projection device is transformed into the superimposed characteristic image area, which can realize two or more projection devices. The precise superposition of the projection screen pixels reduces the difficulty and low cost of the projection screen superposition.
附图说明Description of the drawings
图1为本发明实施例提供的一种实现投影画面叠加的方法的流程示意图;FIG. 1 is a schematic flowchart of a method for superimposing projection images provided by an embodiment of the present invention;
图2为本发明实施例提供的实现投影画面叠加的架构示意图;FIG. 2 is a schematic diagram of an architecture for realizing superimposition of projection images provided by an embodiment of the present invention;
图3为本发明实施例提供的另一种实现投影画面叠加的方法的流程示意图;FIG. 3 is a schematic flowchart of another method for superimposing projection images according to an embodiment of the present invention;
图4为本发明实施例提供的识别投影装置的架构示意图;4 is a schematic diagram of the structure of the identifying projection device provided by an embodiment of the present invention;
图5为本发明实施例提供的实现投影画面叠加的装置的结构示意图;FIG. 5 is a schematic structural diagram of a device for realizing superimposition of projection images provided by an embodiment of the present invention;
图6为本发明实施例提供的投影系统架构图。Fig. 6 is an architectural diagram of a projection system provided by an embodiment of the present invention.
具体实施方式Detailed ways
为了使本领域的技术人员更好地理解本发明的技术方案,下面结合附图和具体实施例对本发明作进一步的详细说明。In order to enable those skilled in the art to better understand the technical solutions of the present invention, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.
如图1所示,本发明实施例提供了一种实现投影画面叠加的方法,应用于投影系统,该投影系统包括图像采集装置、第一投影装置和第二投影装置,第一投影装置预设的叠加特征图与所述第二投影装置预设的小比例叠加特征图具有像素差,具体的方法包括:As shown in FIG. 1, the embodiment of the present invention provides a method for realizing projection image superposition, which is applied to a projection system. The projection system includes an image acquisition device, a first projection device, and a second projection device. The first projection device is preset There is a pixel difference between the superimposed feature map and the small-scale superimposed feature map preset by the second projection device. The specific method includes:
S11:向第一投影装置和第二投影装置发送叠加图像投射命令,以使所述第一投影装置向投影面投射预设的叠加特征图、所述第二投影装置向投影面投射预设的小比例叠加特征图,所述投影面上的叠加特征图像与小比例叠加特征图像具有重叠区域,且所述重叠区域未遮挡所述叠加特征图像的四个角点;S11: Send a superimposed image projection command to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the preset superimposed feature map to the projection surface. A small-scale superimposed feature image, where the superimposed feature image and the small-scale superimposed feature image on the projection surface have an overlapping area, and the overlapping area does not block the four corner points of the superimposed feature image;
S12:向图像采集装置发送叠加图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上小比例叠加特征图像和叠加特征图像的整体图像;S12: Send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device acquires a projection surface image, where the projection surface image is an overall image including a small-scale superimposed feature image and superimposed feature image on the projection surface;
S13:根据所述投影面图像计算第二投影装置的叠加调整参数;S13: Calculate the superimposition adjustment parameter of the second projection device according to the projection surface image;
S14:将所述第二投影装置的叠加调整参数发送给第二投影装置,以使所述第二投影装置按所述叠加调整参数调整投射图像。S14: Send the overlay adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the overlay adjustment parameter.
需要说明的是,两个投影装置均设置有叠加特征图和小比例叠加特征图,第一投影装置的叠加特征图与第二投影装置的小比例叠加特征图具有像素差,第一投影装置的小比例叠加特征图与第二投影装置的叠加特征图具有像素差,设置像素差的目的是为了能够通过图像识别,获取投影面图像中叠加特征图像的区域和小比例叠加特征图像的区域。例如,叠加特征图可以是透明的带边框图,小比例叠加特征图可以是黑色的带边框图,控制第一投影装置投射叠加特征图,通过识别叠加特征图的边框,就可以确定基准投影画面的位置,而第二投影装置的投影区域只要变化到基准投影画面的位置,就完成了投影画面的叠加。It should be noted that both projection devices are provided with superimposed feature maps and small-scale superimposed feature maps. The superimposed feature maps of the first projection device and the small-scale superimposed feature maps of the second projection device have a pixel difference. The small-scale superimposed feature map has a pixel difference with the superimposed feature map of the second projection device. The purpose of setting the pixel difference is to obtain the area of the projection surface image where the feature image is superimposed and the area of the small-scale superimposed feature image in the projection surface image. For example, the superimposed feature map can be a transparent framed map, and the small-scale superimposed feature map can be a black framed map. The first projection device is controlled to project the superimposed feature map. By identifying the frame of the superimposed feature map, the reference projection image can be determined As long as the projection area of the second projection device is changed to the position of the reference projection screen, the superposition of the projection screen is completed.
每个投影装置设置有各自的叠加特征图和比例叠加特征图,当投影装置向投影面投射叠加特征图时可以看到该投影装置的实际投影区域,但是各个投影装置都向 投影面投射叠加特征图时会造成投影面上的图像重叠,也非常容易挡住叠加特征图像的四个角点,在实现图像叠加时给图像处理和计算带来很大的难度,因此将叠加特征图按一定的特征图案缩小比值(1>缩小比例>0)缩小再投射,避免多个投影装置的画面重叠,也避免了第一投影装置投射的叠加特征图和第二投影装置投射的叠加特征图重叠而造成相互干扰。特征图案缩小比值可以根据客户实际需求设定,将叠加特征图中的特征图案在原始像素比例下按特征图案缩小比值缩小后得到小比例叠加特征图,小比例叠加特征图的实质是将叠加特征图的特征图案缩小后置于小比例叠加特征图中部,而周围为透明图像的图,小比例叠加特征图与叠加特征图中的图像内容是一致的,只是图像区域的大小不一样。Each projection device is provided with its own overlay feature map and scale overlay feature map. When the projection device projects the overlay feature map to the projection surface, the actual projection area of the projection device can be seen, but each projection device projects the overlay feature to the projection surface The map will cause the images on the projection surface to overlap, and it is very easy to block the four corners of the superimposed feature image, which brings great difficulty to image processing and calculation when implementing image superposition, so the superimposed feature map is based on certain features The pattern reduction ratio (1>reduction ratio>0) is reduced and re-projected to avoid overlapping of the images of multiple projection devices, and also avoids the overlap of the superimposed feature maps projected by the first projection device and the superimposed feature maps projected by the second projection device. interference. The feature pattern reduction ratio can be set according to the actual needs of customers. The feature pattern in the overlay feature map is reduced by the feature pattern reduction ratio under the original pixel ratio to obtain a small-scale overlay feature map. The essence of the small-scale overlay feature map is to superimpose features. The feature pattern of the map is reduced and placed in the upper part of the small-scale superimposed feature map, and the surrounding is a transparent image. The small-scale superimposed feature map and the superimposed feature map have the same image content, but the size of the image area is different.
需要说明的是,在步骤S11中,在第一投影装置向投影面投射叠加特征图后,由于投影面上的叠加特征图是最终展现投影画面的基准投影区域,我们也可以在投射了叠加特征图后,对投影画面进行梯形校正等操作,使投影画面为矩形或者效果更佳。It should be noted that, in step S11, after the first projection device projects the superimposed feature map on the projection surface, since the superimposed feature map on the projection surface is the reference projection area for finally displaying the projection image, we can also project the superimposed feature After the picture, perform operations such as keystone correction on the projection screen to make the projection screen rectangular or have a better effect.
需要说明的是,在步骤S11中,在第二投影装置向投影面投射小比例叠加特征图时,在投影面上的小比例叠加特征图像不能遮挡叠加特征图像的四个角点,即小比例叠加特征图像可以在叠加特征图像的边框内,也可以在叠加特征图像的边框外,也可以与叠加特征图像重叠,但一定不能覆盖叠加特征图像的四个角点,否则会影响图像识别的结果。It should be noted that in step S11, when the second projection device projects the small-scale superimposed feature image on the projection surface, the small-scale superimposed feature image on the projection surface cannot block the four corner points of the superimposed feature image, that is, the small-scale superimposed feature image The superimposed feature image can be inside the frame of the superimposed feature image, or outside the frame of the superimposed feature image, or overlap with the superimposed feature image, but it must not cover the four corners of the superimposed feature image, otherwise it will affect the result of image recognition .
需要说明的是,在步骤S12中,图像采集装置是指具备图像拍摄功能的装置,可以是摄像头,智能手机,平板电脑,笔记本电脑等。图像采集装置的拍摄位置并未限定,只要求是能够整体拍摄投影面上的所有小比例叠加特征图像和叠加特征图像用于后续的计算,当然清晰度也需要满足常规像素要求。It should be noted that, in step S12, the image acquisition device refers to a device with an image shooting function, which may be a camera, a smart phone, a tablet computer, a notebook computer, and the like. The shooting position of the image acquisition device is not limited. It is only required that all small-scale superimposed feature images and superimposed feature images on the projection surface can be taken as a whole for subsequent calculations. Of course, the definition also needs to meet the requirements of conventional pixels.
具体的,步骤S13的方法包括:Specifically, the method of step S13 includes:
S131:识别所述投影面图像中的叠加特征图像区域,获得第二投影装置在所述 投影面图像中的期望投影区域,识别所述投影面图像中的小比例叠加特征图像区域,获得第二投影装置在所述投影面图像中的小比例投影区域;S131: Identify the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, identify the small-scale superimposed characteristic image area in the projection surface image, and obtain the second A small-scale projection area of the projection device in the projection surface image;
S132:获取第二投影装置的小比例叠加特征图的特征图案缩小比值,根据第二投影装置的小比例叠加特征图、小比例叠加特征图的特征图案缩小比值和在所述投影面图像中的小比例投影区域,计算第二投影装置在所述投影面图像中的实际投影区域;S132: Obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map, and the ratio in the projection surface image A small-scale projection area, calculating the actual projection area of the second projection device in the projection surface image;
S133:根据第二投影装置在所述投影面图像中的实际投影区域和第二投影装置在所述投影面图像中的期望投影区域计算第二投影装置的叠加调整参数。S133: Calculate the overlay adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
需要说明的是,第二投影装置的小比例叠加特征图的特征图案缩小比值可以存储在第二投影装置内,也可以存储在实现投影画面重叠的装置内,也可以存储在服务器上。It should be noted that the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device can be stored in the second projection device, can also be stored in a device that realizes projection screen overlap, or can be stored on a server.
如图2所示,本发明实施例提供了一种实现投影画面重叠的架构示意图,投影系统包括投影装置C1和C2,投影装置C1是第一投影装置,投影装置C2是第二投影装置,首先需要定位2个投影装置的投影区域的位置,投影装置C1投射叠加特征图,即直接投射中部透明的带边框图,投影装置C2投射小比例叠加特征图,投影装置C1只显示边框,中心部分打黑色背景(投影装置的黑色背景是指亮度很低或者为0),C2在C1内部中心部分投出具有像素差的小比例叠加特征图进行投影区域定位。由于C1和C2投射出的图都是已知的,根据图像识别查找到的图像相互包含关系,即可进行投影图像区域与投影装置的匹配对应。As shown in FIG. 2, the embodiment of the present invention provides a schematic diagram of an architecture for realizing projection screen overlap. The projection system includes projection devices C1 and C2. The projection device C1 is the first projection device, and the projection device C2 is the second projection device. It is necessary to locate the position of the projection area of the two projection devices. The projection device C1 projects the superimposed feature map, that is, directly projects the transparent image with a frame in the middle, and the projection device C2 projects a small-scale superimposed feature map. The projection device C1 only displays the frame and the center part is printed. Black background (the black background of the projection device means that the brightness is very low or 0), C2 projects a small-scale superimposed feature map with pixel difference in the central part of C1 to locate the projection area. Since the images projected by C1 and C2 are known, the mutual inclusion relationship between the images found according to the image recognition can be matched and corresponding to the projection image area and the projection device.
接下来要计算投影装置C2的实际投影区域,具体计算方法包括:由于C2的小比例叠加特征图与叠加特征图是已知的,因此小比例叠加特征图在叠加特征图中的像素坐标是已知的。根据小比例叠加特征图的4个角点像素坐标和叠加特征图的4个角点像素坐标,即根据八个角点的对应关系,利用直接线性变换法(Direct Linear Transform)或者最小二乘法计算出单应变换矩阵H2,即H2表征了C2的小比例叠加 特征图到叠加特征图的坐标变换关系,根据图像采集装置拍摄的包含C2投射的小比例叠加特征图的投影面图像,在投影面图像中找到C2小比例叠加特征图像区域EFGH,这里具体查找办法可以用角点查找,或者用图像模板匹配等方法,没有具体要求,这里不做限制。利用单应矩阵对应关系The next step is to calculate the actual projection area of the projection device C2. The specific calculation methods include: Since the small-scale superimposed feature map and the superimposed feature map of C2 are known, the pixel coordinates of the small-scale superimposed feature map in the superimposed feature map are Known. According to the small-scale superposition of the four corner pixel coordinates of the feature map and the four corner pixel coordinates of the superimposed feature map, that is, according to the corresponding relationship of the eight corner points, use the direct linear transformation method (Direct Linear Transform) or the least square method to calculate The homography transformation matrix H2, that is, H2 represents the coordinate transformation relationship from the small-scale superimposed feature map of C2 to the superimposed feature map. According to the projection surface image of the small-scale superimposed feature map projected by C2 taken by the image acquisition device, on the projection surface Find the C2 small-scale superimposed feature image area EFGH in the image. The specific search method here can be corner search or image template matching. There are no specific requirements and no restrictions here. Use homography matrix correspondence
Figure PCTCN2020078366-appb-000001
Figure PCTCN2020078366-appb-000001
其中(u1,v1),(u2,v2)分别为叠加特征图和小比例叠加特征图对应点的像素坐标,S为一个常数比例因子。因此可以由投影面上的C2小比例叠加特征图像四个角点的位置计算出叠加特征图像4个角点的位置,即由EFGH根据H1变换得到efgh,从而找到C2的完整投影区域/实际投影区域。Among them, (u1, v1), (u2, v2) are the pixel coordinates of the corresponding points of the superimposed feature map and the small-scale superimposed feature map, respectively, and S is a constant scale factor. Therefore, the positions of the four corner points of the superimposed feature image can be calculated from the positions of the four corner points of the C2 small-scale superimposed feature image on the projection surface, that is, the efgh can be obtained by EFGH according to the H1 transformation, so as to find the complete projection area/actual projection of C2 area.
获得C2的实际投影区域之后,根据已经得到投影装置C1的投影区域位置ABCD,将C2的实际投影区域通过单应变换矩阵变成ABCD区域,即和C1的投影区域完全重合,即完成了双屏的叠加过程。具体计算方法包括:用最小二乘法计算从efgh到ABCD的单应变换矩阵N1(叠加调整参数),N1作用于投影装置C2,则可以得到期望的投影画面区域ABCD,即完成叠加过程。单应变化矩阵计算方法包括最小二乘法或者DLT方法。以此类推,任意的两个投影装置都可以采用相同的方法进行投影画面叠加,因此可以实现多个投影装置的投影画面叠加。After obtaining the actual projection area of C2, according to the projection area position ABCD of the projection device C1, the actual projection area of C2 is transformed into the ABCD area through the homography transformation matrix, that is, it completely overlaps the projection area of C1, that is, the dual screen is completed The superposition process. The specific calculation method includes: using the least square method to calculate the homography transformation matrix N1 (superimposition adjustment parameter) from efgh to ABCD. When N1 acts on the projection device C2, the desired projection image area ABCD can be obtained, that is, the superposition process is completed. The calculation methods of homography change matrix include least square method or DLT method. By analogy, any two projection devices can use the same method to superimpose the projection images, so that the projection images of multiple projection devices can be superimposed.
在另一个实施例中,采用与上面实施例相同的算法,还可以将投影装置C2的实际投影区域作为基准的投影区域,将投影装置C1的实际投影区域变换到C2的实际投影区域上,实现2个或者多个投影装置的投影画面叠加。In another embodiment, using the same algorithm as the above embodiment, the actual projection area of the projection device C2 can also be used as the reference projection area, and the actual projection area of the projection device C1 can be transformed to the actual projection area of C2. The projection screens of 2 or more projection devices are superimposed.
本发明实施例还提供了一种实现投影画面叠加的方法,与实施例1的区别是在步骤S11前,还包括步骤:S10:与第一投影装置和第二投影装置建立通信。The embodiment of the present invention also provides a method for realizing projection screen superimposition. The difference from Embodiment 1 is that before step S11, the method further includes the following step: S10: establishing communication with the first projection device and the second projection device.
具体的,步骤S10的一种方法包括:Specifically, a method of step S10 includes:
S1011:向第一投影装置和第二投影装置发送识别图像投射命令,以使所述第一投影装置和第二投影装置分别向投影面投射各自的小比例识别特征图,所述投影面上的两个小比例识别特征图像未重叠,所述小比例识别特征图包含投影装置的识别标识;S1011: Send a recognition image projection command to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps on the projection surface, and the Two small-scale recognition feature images do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
S1012:向图像采集装置发送识别图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上两个小比例识别特征图像的整体图像;S1012: Send a recognition image capture command to the image capture device, so that the image capture device captures a projection surface image, where the projection surface image is an overall image including two small-scale recognition feature images on the projection surface;
S1013:识别所述投影面图像中两个小比例识别特征图像中的识别标识,获取两个投影装置的编号信息;S1013: Identify the identification marks in the two small-scale identification feature images in the projection surface image, and obtain the number information of the two projection devices;
S1014:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。S1014: Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
如图3进行举例说明,在与投影装置建立通信时,需要确定有哪些编号的投影装置,还需要确定各个投影装置对应在投影面上的哪块投影区域,因此小比例识别特征图中可以包含投影装置的识别标识,也可以将投影装置的识别标识作为小比例识别特征图。可以在小比例识别特征图中心放置一个识别标识,如图3中所示以Aruco码为例,也可以是其他易于识别的标志如QRcode。为了实现更高的图像精度,也可以特别设计小比例识别特征图。As shown in Figure 3 for example, when establishing communication with the projection device, it is necessary to determine which numbered projection devices are, and it is also necessary to determine which projection area on the projection surface each projection device corresponds to. Therefore, the small-scale identification feature map can include The identification mark of the projection device can also be used as a small-scale identification feature map. An identification mark can be placed in the center of the small-scale identification feature map, as shown in Figure 3, taking the Aruco code as an example, or it can be other easily recognizable marks such as QRcode. In order to achieve higher image accuracy, a small-scale recognition feature map can also be specially designed.
向所有投影装置发送识别图像投射命令,以使所有投影装置向投影面投射小比例识别特征图,投影面上的各个小比例识别特征图像未重叠;向图像采集装置发送识别图像采集命令,以使图像采集装置采集投影面图像,投影面图像是包括投影面上所有小比例识别特征图像的整体图像;识别投影面图像中的各个小比例识别特征图像,获取各个投影装置的编号信息;通过获取的编号信息可以通过有线网络或者无线网络与各个投影装置建立通信。Send recognition image projection commands to all projection devices so that all projection devices project small-scale recognition feature maps on the projection surface, and the small-scale recognition feature images on the projection surface do not overlap; send recognition image capture commands to the image capture device to make The image acquisition device collects the projection surface image, which is the overall image including all the small-scale recognition feature images on the projection surface; recognizes each small-scale recognition feature image in the projection surface image, and obtains the number information of each projection device; The number information can establish communication with each projection device through a wired network or a wireless network.
具体的,步骤S10的另一种方法包括:Specifically, another method of step S10 includes:
S1021:向所有投影装置发送广播;S1021: Send a broadcast to all projection devices;
S1022:接收两个投影装置返回的编号信息;S1022: Receive the number information returned by the two projection devices;
S1023:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。S1023: Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
需要说明的是,由于多个投影装置通过网络进行通信,因此可以在投影装置的网络中向各个投影装置发送广播,要求投影装置返回各自的编号信息,接收到投影装置的编号信息后,可以在网络中通过获取的编号信息与各个投影装置建立通信。It should be noted that because multiple projection devices communicate through the network, it is possible to send a broadcast to each projection device in the network of the projection device, requesting the projection device to return their respective number information, and after receiving the number information of the projection device, you can The network establishes communication with each projection device through the acquired number information.
本申请的技术方案通过识别投影面图像中的叠加特征图像和小比例叠加特征图像,进行期望投影区域和第二投影装置的投影区域定位,通过外接图像采集装置拍照和单应性变换方法进行两个投影装置的投影画面的叠加,操作简单,且计算难度小,非常适于广泛推广。The technical solution of the present application recognizes the superimposed characteristic image and the small-scale superimposed characteristic image in the projection surface image, performs positioning of the desired projection area and the projection area of the second projection device, and performs both functions by taking pictures with an external image acquisition device and a homography transformation method. The superposition of the projection images of the two projection devices is simple to operate and difficult to calculate, which is very suitable for wide promotion.
下面对本发明实施例提供的实现投影画面叠加的装置进行介绍,需要说明的是,有关实现投影画面叠加的装置的说明可参见上文的实现投影画面叠加的方法,以下并不做赘述。The following describes the device for realizing projection screen superimposition provided by the embodiment of the present invention. It should be noted that the description of the device for realizing projection screen superimposition can refer to the above method for realizing projection screen superimposition, which will not be repeated hereafter.
如图5所示,本发明实施例提供一种实现投影画面叠加的装置,应用于投影系统,该投影系统包括图像采集装置、第一投影装置和第二投影装置,所述第一投影装置预设的叠加特征图与所述第二投影装置预设的小比例叠加特征图具有像素差,具体的装置包括:As shown in FIG. 5, an embodiment of the present invention provides a device for superimposing projection screens, which is applied to a projection system. The projection system includes an image acquisition device, a first projection device, and a second projection device. The set superimposed feature map has a pixel difference with the small-scale superimposed feature map preset by the second projection device, and the specific device includes:
叠加图像投射模块21,用于用于向第一投影装置和第二投影装置发送叠加图像投射命令,以使所述第一投影装置向投影面投射预设的叠加特征图、所述第二投影装置向投影面投射预设的小比例叠加特征图,所述投影面上的叠加特征图像与小比例叠加特征图像具有重叠区域,且所述重叠区域未遮挡所述叠加特征图像的四个角点;The superimposed image projection module 21 is used to send a superimposed image projection command to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map, the second projection The device projects a preset small-scale superimposed feature image on a projection surface, the superimposed feature image on the projection surface and the small-scale superimposed feature image have an overlapped area, and the overlapped area does not block the four corner points of the superimposed feature image ;
叠加图像采集模块22,用于向图像采集装置发送叠加图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上小比例叠加特征图 像和叠加特征图像的整体图像;The superimposed image acquisition module 22 is configured to send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device collects a projection surface image, and the projection surface image includes a small-scale superimposed feature image on the projection surface and a superimposed feature image Overall image
叠加参数计算模块23,用于根据所述投影面图像计算第二投影装置的叠加调整参数;The superposition parameter calculation module 23 is configured to calculate superposition adjustment parameters of the second projection device according to the projection surface image;
叠加参数发送模块24,用于将所述第二投影装置的叠加调整参数发送给第二投影装置,以使所述第二投影装置按所述叠加调整参数调整投射图像。The superimposition parameter sending module 24 is configured to send the superimposition adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the superimposition adjustment parameter.
具体的,参数计算模块23包括:Specifically, the parameter calculation module 23 includes:
图像识别单元,用于识别所述投影面图像中的叠加特征图像区域,获得第二投影装置在所述投影面图像中的期望投影区域,还用于识别所述投影面图像中的小比例叠加特征图像区域,获得第二投影装置在所述投影面图像中的小比例投影区域;The image recognition unit is used to recognize the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, and is also used to recognize the small-scale superposition in the projection surface image A characteristic image area to obtain a small-scale projection area of the second projection device in the projection surface image;
区域计算单元,用于获取第二投影装置的小比例叠加特征图的特征图案缩小比值,根据第二投影装置的小比例叠加特征图、小比例叠加特征图的特征图案缩小比值和在所述投影面图像中的小比例投影区域,计算第二投影装置在所述投影面图像中的实际投影区域;The area calculation unit is used to obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and according to the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map and the projection A small-scale projection area in the surface image, calculating the actual projection area of the second projection device in the projection surface image;
参数计算单元,用于根据第二投影装置在所述投影面图像中的实际投影区域和第二投影装置在所述投影面图像中的期望投影区域计算第二投影装置的叠加调整参数。The parameter calculation unit is configured to calculate the superimposition adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
具体的,装置还包括:Specifically, the device also includes:
还包括通信建立模块,用于与第一投影装置和第二投影装置建立通信。It also includes a communication establishment module for establishing communication with the first projection device and the second projection device.
具体的,通信建立模块可以包括:Specifically, the communication establishment module may include:
识别图像投射单元,用于向第一投影装置和第二投影装置发送识别图像投射命令,以使所述第一投影装置和第二投影装置分别向投影面投射各自的小比例识别特征图,所述投影面上的两个小比例识别特征图像未重叠,所述小比例识别特征图包含投影装置的识别标识;The recognition image projection unit is used to send recognition image projection commands to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps to the projection surface, so The two small-scale recognition feature images on the projection surface do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
识别图像采集单元,用于向图像采集装置发送识别图像采集命令,以使所述图 像采集装置采集投影面图像,所述投影面图像是包含投影面上两个小比例识别特征图像的整体图像;The recognition image acquisition unit is configured to send a recognition image acquisition command to the image acquisition device, so that the image acquisition device collects a projection surface image, the projection surface image being an overall image including two small-scale recognition characteristic images on the projection surface;
编号信息获取单元,用于识别所述投影面图像中两个小比例识别特征图像中的识别标识,获取两个投影装置的编号信息;A serial number information acquisition unit, used to identify the identification marks in the two small-scale identification feature images in the projection surface image, and acquire serial number information of the two projection devices;
编号通信建立单元:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。Number communication establishment unit: respectively establish communication with the first projection device and the second projection device according to the number information of the two projection devices.
具体的,通信建立模块另一种方式还可以包括:Specifically, another way of the communication establishment module may also include:
广播发送单元,用于向所有投影装置发送广播;Broadcast sending unit for sending broadcast to all projection devices;
信息接收单元,用于接收两个投影装置返回的编号信息;The information receiving unit is used to receive the number information returned by the two projection devices;
通信建立单元,用于根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。The communication establishment unit is used to establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
本发明实施例还提供一种实现投影画面叠加的装置,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现上述的实现投影画面叠加的方法。该装置可以实现多个投影装置的投影画面叠加。具体的方法,可以先确定一个作为基准投影画面的投影装置,再将剩下每1个投影装置依次与作为基准投影画面的投影装置采用上述的实现投影画面叠加的方法计算出叠加调整参数,获得了各个投影装置的叠加调整参数后再同时投射图像并调整投射图像。The embodiment of the present invention also provides a device for realizing projection screen overlay, including a memory, a processor, and a computer program stored on the memory and running on the processor. When the processor executes the computer program, Realize the above-mentioned method of realizing projected picture superimposition. The device can realize the superposition of the projection images of multiple projection devices. The specific method can be to first determine a projection device as the reference projection screen, and then use each remaining projection device in turn with the projection device as the reference projection screen to calculate the superimposition adjustment parameters using the above-mentioned method of realizing projection screen superposition, and obtain After the superposition adjustment parameters of each projection device are adjusted, the image is simultaneously projected and the projected image is adjusted.
如图6所示,本发明实施例还提供一种投影系统,包括图像采集装置和至少2个投影装置,还包括上述的实现投影画面叠加的装置,实现投影画面叠加的装置分别与图像采集装置和各个投影装置建立通信。As shown in FIG. 6, an embodiment of the present invention also provides a projection system, including an image acquisition device and at least two projection devices, and also includes the above-mentioned device for realizing projection screen superimposition. The device for realizing projection screen superimposition and the image acquisition device are respectively Establish communication with each projection device.
需要说明的是,本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. For the same and similar parts between the various embodiments, refer to each other. can.
还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括上述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should also be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations There is any such actual relationship or order between. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device that includes a series of elements includes not only those elements, but also includes Other elements of, or also include elements inherent to this process, method, article or equipment. Without more restrictions, the elements defined by the sentence "including a..." do not exclude the existence of other identical elements in the process, method, article or equipment including the above elements.
对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown in this document, but should conform to the widest scope consistent with the principles and novel features disclosed in this document.

Claims (10)

  1. 一种实现投影画面叠加的方法,其特征在于,应用于投影系统,所述投影系统包括图像采集装置、第一投影装置和第二投影装置,所述第一投影装置预设的叠加特征图与所述第二投影装置预设的小比例叠加特征图具有像素差,所述方法包括:A method for realizing the superposition of projection images, characterized in that it is applied to a projection system, the projection system includes an image acquisition device, a first projection device, and a second projection device, the superposition feature map preset by the first projection device and The small-scale superimposed feature map preset by the second projection device has a pixel difference, and the method includes:
    S11:向第一投影装置和第二投影装置发送叠加图像投射命令,以使所述第一投影装置向投影面投射预设的叠加特征图、所述第二投影装置向投影面投射预设的小比例叠加特征图,所述投影面上的叠加特征图像与小比例叠加特征图像具有重叠区域,且所述重叠区域未遮挡所述叠加特征图像的四个角点;S11: Send a superimposed image projection command to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the preset superimposed feature map to the projection surface. A small-scale superimposed feature image, where the superimposed feature image and the small-scale superimposed feature image on the projection surface have an overlapping area, and the overlapping area does not block the four corner points of the superimposed feature image;
    S12:向图像采集装置发送叠加图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上小比例叠加特征图像和叠加特征图像的整体图像;S12: Send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device acquires a projection surface image, where the projection surface image is an overall image including a small-scale superimposed feature image and superimposed feature image on the projection surface;
    S13:根据所述投影面图像计算第二投影装置的叠加调整参数;S13: Calculate the superimposition adjustment parameter of the second projection device according to the projection surface image;
    S14:将所述第二投影装置的叠加调整参数发送给第二投影装置,以使所述第二投影装置按所述叠加调整参数调整投射图像。S14: Send the overlay adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the overlay adjustment parameter.
  2. 根据权利要求1所述的实现投影画面叠加的方法,其特征在于,所述步骤S13的方法包括:The method for realizing projected picture superimposition according to claim 1, wherein the method of step S13 comprises:
    S131:识别所述投影面图像中的叠加特征图像区域,获得第二投影装置在所述投影面图像中的期望投影区域,识别所述投影面图像中的小比例叠加特征图像区域,获得第二投影装置在所述投影面图像中的小比例投影区域;S131: Identify the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, identify the small-scale superimposed characteristic image area in the projection surface image, and obtain the second A small-scale projection area of the projection device in the projection surface image;
    S132:获取第二投影装置的小比例叠加特征图的特征图案缩小比值,根据第二投影装置的小比例叠加特征图、小比例叠加特征图的特征图案缩小比值和在所述投影面图像中的小比例投影区域,计算第二投影装置在所述投影面图像中的实际投影区域;S132: Obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map, and the ratio in the projection surface image A small-scale projection area, calculating the actual projection area of the second projection device in the projection surface image;
    S133:根据第二投影装置在所述投影面图像中的实际投影区域和第二投影装置 在所述投影面图像中的期望投影区域计算第二投影装置的叠加调整参数。S133: Calculate the overlay adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
  3. 根据权利要求1所述的实现投影画面叠加的方法,其特征在于,在所述步骤S11前,还包括步骤:S10:与第一投影装置和第二投影装置建立通信。The method for realizing projection screen superimposition according to claim 1, characterized in that, before the step S11, the method further comprises the following step: S10: establishing communication with the first projection device and the second projection device.
  4. 根据权利要求3所述的实现投影画面叠加的方法,其特征在于,所述步骤S10的方法,包括:The method for realizing projected image superimposition according to claim 3, wherein the method of step S10 includes:
    S1011:向第一投影装置和第二投影装置发送识别图像投射命令,以使所述第一投影装置和第二投影装置分别向投影面投射各自的小比例识别特征图,所述投影面上的两个小比例识别特征图像未重叠,所述小比例识别特征图包含投影装置的识别标识;S1011: Send a recognition image projection command to the first projection device and the second projection device, so that the first projection device and the second projection device respectively project their small-scale recognition feature maps on the projection surface, and the Two small-scale recognition feature images do not overlap, and the small-scale recognition feature image includes the identification mark of the projection device;
    S1012:向图像采集装置发送识别图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上两个小比例识别特征图像的整体图像;S1012: Send a recognition image capture command to the image capture device, so that the image capture device captures a projection surface image, where the projection surface image is an overall image including two small-scale recognition feature images on the projection surface;
    S1013:识别所述投影面图像中两个小比例识别特征图像中的识别标识,获取两个投影装置的编号信息;S1013: Identify the identification marks in the two small-scale identification feature images in the projection surface image, and obtain the number information of the two projection devices;
    S1014:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。S1014: Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  5. 根据权利要求3所述的实现投影画面叠加的方法,其特征在于,所述步骤S10的方法,包括:The method for realizing projected image superimposition according to claim 3, wherein the method of step S10 includes:
    S1021:向所有投影装置发送广播;S1021: Send a broadcast to all projection devices;
    S1022:接收两个投影装置返回的编号信息;S1022: Receive the number information returned by the two projection devices;
    S1023:根据两个投影装置的编号信息分别与第一投影装置和第二投影装置建立通信。S1023: Establish communication with the first projection device and the second projection device respectively according to the number information of the two projection devices.
  6. 一种实现投影画面叠加的装置,其特征在于,应用于投影系统,所述投影系统包括图像采集装置、第一投影装置和第二投影装置,所述第一投影装置预设的叠加特征图与所述第二投影装置预设的小比例叠加特征图具有像素差,所述装置包 括:A device for realizing superimposition of projection images, characterized in that it is applied to a projection system. The projection system includes an image acquisition device, a first projection device, and a second projection device. The superimposition feature map preset by the first projection device and The small-scale superimposed feature map preset by the second projection device has a pixel difference, and the device includes:
    叠加图像投射模块,用于向第一投影装置和第二投影装置发送叠加图像投射命令,以使所述第一投影装置向投影面投射预设的叠加特征图、所述第二投影装置向投影面投射预设的小比例叠加特征图,所述投影面上的叠加特征图像与小比例叠加特征图像具有重叠区域,且所述重叠区域未遮挡所述叠加特征图像的四个角点;The superimposed image projection module is used to send superimposed image projection commands to the first projection device and the second projection device, so that the first projection device projects the preset superimposed feature map to the projection surface, and the second projection device projects the Projecting a preset small-scale superimposed feature map on a surface, where the superimposed feature image and the small-scale superimposed feature image on the projection surface have overlapping areas, and the overlapping area does not block the four corner points of the superimposed feature image;
    叠加图像采集模块,用于向图像采集装置发送叠加图像采集命令,以使所述图像采集装置采集投影面图像,所述投影面图像是包含投影面上小比例叠加特征图像和叠加特征图像的整体图像;The superimposed image acquisition module is used to send a superimposed image acquisition command to the image acquisition device, so that the image acquisition device collects a projection surface image, and the projection surface image is a whole including a small-scale superimposed feature image on the projection surface and a superimposed feature image image;
    叠加参数计算模块,用于根据所述投影面图像计算第二投影装置的叠加调整参数;A superposition parameter calculation module, configured to calculate superposition adjustment parameters of the second projection device according to the projection surface image;
    叠加参数发送模块,用于将所述第二投影装置的叠加调整参数发送给第二投影装置,以使所述第二投影装置按所述叠加调整参数调整投射图像。The superimposition parameter sending module is configured to send the superimposition adjustment parameter of the second projection device to the second projection device, so that the second projection device adjusts the projected image according to the superimposition adjustment parameter.
  7. 根据权利要求6所述的实现投影画面叠加的装置,其特征在于,所述叠加参数计算模块包括:The device for realizing superposition of projection images according to claim 6, wherein the superposition parameter calculation module comprises:
    图像识别单元,用于识别所述投影面图像中的叠加特征图像区域,获得第二投影装置在所述投影面图像中的期望投影区域,还用于识别所述投影面图像中的小比例叠加特征图像区域,获得第二投影装置在所述投影面图像中的小比例投影区域;The image recognition unit is used to recognize the superimposed characteristic image area in the projection surface image, obtain the desired projection area of the second projection device in the projection surface image, and is also used to recognize the small-scale superposition in the projection surface image A characteristic image area to obtain a small-scale projection area of the second projection device in the projection surface image;
    区域计算单元,用于获取第二投影装置的小比例叠加特征图的特征图案缩小比值,根据第二投影装置的小比例叠加特征图、小比例叠加特征图的特征图案缩小比值和在所述投影面图像中的小比例投影区域,计算第二投影装置在所述投影面图像中的实际投影区域;The area calculation unit is used to obtain the feature pattern reduction ratio of the small-scale superimposed feature map of the second projection device, and according to the small-scale superimposed feature map of the second projection device, the feature pattern reduction ratio of the small-scale superimposed feature map and the projection A small-scale projection area in the surface image, calculating the actual projection area of the second projection device in the projection surface image;
    参数计算单元,用于根据第二投影装置在所述投影面图像中的实际投影区域和第二投影装置在所述投影面图像中的期望投影区域计算第二投影装置的叠加调整参数。The parameter calculation unit is configured to calculate the superimposition adjustment parameter of the second projection device according to the actual projection area of the second projection device in the projection surface image and the expected projection area of the second projection device in the projection surface image.
  8. 根据权利要求6所述的实现投影画面叠加的装置,其特征在于,还包括通信建立模块,用于与第一投影装置和第二投影装置建立通信。The device for realizing projection screen superimposition according to claim 6, further comprising a communication establishment module for establishing communication with the first projection device and the second projection device.
  9. 一种实现投影画面叠加的装置,包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如权利要求1-5中任一项所述的实现投影画面叠加的方法。A device for superimposing projection screens, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor executes the computer program as follows: The method for realizing superimposition of projected images according to any one of claims 1-5.
  10. 一种投影系统,其特征在于,包括图像采集装置和至少2个投影装置,还包括如权利要求6-8中任一项所述的实现投影画面叠加的装置。A projection system, characterized by comprising an image acquisition device and at least two projection devices, and further comprising the device for realizing projection screen superimposition according to any one of claims 6-8.
PCT/CN2020/078366 2019-04-30 2020-03-09 Method and apparatus for realizing superposition of projected pictures, and projection system WO2020220831A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910363760.1 2019-04-30
CN201910363760.1A CN111314679B (en) 2019-04-30 2019-04-30 Method and device for realizing projection picture superposition and projection system

Publications (1)

Publication Number Publication Date
WO2020220831A1 true WO2020220831A1 (en) 2020-11-05

Family

ID=71146658

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/078366 WO2020220831A1 (en) 2019-04-30 2020-03-09 Method and apparatus for realizing superposition of projected pictures, and projection system

Country Status (2)

Country Link
CN (1) CN111314679B (en)
WO (1) WO2020220831A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011029727A (en) * 2009-07-21 2011-02-10 Canon Inc Image projector
JP2013074475A (en) * 2011-09-28 2013-04-22 Mitsubishi Electric Corp Projection type display device
CN103533276A (en) * 2013-10-21 2014-01-22 北京理工大学 Method for quickly splicing multiple projections on plane
CN105376540A (en) * 2014-08-27 2016-03-02 中强光电股份有限公司 Projection display system and correction method of projection area
JP2017017509A (en) * 2015-06-30 2017-01-19 キヤノン株式会社 Projection apparatus and projection method
US20170180689A1 (en) * 2015-12-22 2017-06-22 Canon Kabushiki Kaisha Multi-projector alignment refinement

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5239326B2 (en) * 2007-12-19 2013-07-17 ソニー株式会社 Image signal processing apparatus, image signal processing method, image projection system, image projection method and program
CN103309133B (en) * 2012-03-12 2015-08-26 联想(北京)有限公司 A kind of projecting method and a kind of electronic equipment
JP2016001781A (en) * 2014-06-11 2016-01-07 ソニー株式会社 Information processing apparatus, information processing method, program, and image display device
CN108668116B (en) * 2017-03-30 2020-10-23 梯西爱尔爱麦克斯(上海)数字技术有限公司 Projection control method and device and projector

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011029727A (en) * 2009-07-21 2011-02-10 Canon Inc Image projector
JP2013074475A (en) * 2011-09-28 2013-04-22 Mitsubishi Electric Corp Projection type display device
CN103533276A (en) * 2013-10-21 2014-01-22 北京理工大学 Method for quickly splicing multiple projections on plane
CN105376540A (en) * 2014-08-27 2016-03-02 中强光电股份有限公司 Projection display system and correction method of projection area
JP2017017509A (en) * 2015-06-30 2017-01-19 キヤノン株式会社 Projection apparatus and projection method
US20170180689A1 (en) * 2015-12-22 2017-06-22 Canon Kabushiki Kaisha Multi-projector alignment refinement

Also Published As

Publication number Publication date
CN111314679B (en) 2021-06-29
CN111314679A (en) 2020-06-19

Similar Documents

Publication Publication Date Title
WO2020220832A1 (en) Method and apparatus for achieving projection picture splicing, and projection system
JP7231306B2 (en) Method, Apparatus and System for Automatically Annotating Target Objects in Images
US6618076B1 (en) Method and apparatus for calibrating projector-camera system
US8228378B2 (en) Real-time composite image comparator
US20190295216A1 (en) Image processing apparatus, image processing system, image capturing system, image processing method
US20160371855A1 (en) Image based measurement system
US11282232B2 (en) Camera calibration using depth data
TWI587241B (en) Method, device and system for generating two - dimensional floor plan
JP2020187358A (en) Projection system, projection apparatus and calibrating method for displayed image thereof
US20180098200A1 (en) Position determination device, position determining method, and storage medium
JP6096634B2 (en) 3D map display system using virtual reality
JP2008193640A (en) Terminal and program for superimposing and displaying additional image on photographed image
WO2015100723A1 (en) Method and photographing device for implementing self-service group photo taking
WO2017179432A1 (en) Image projection method and image projection device for three-dimensional object for projection
WO2021254324A1 (en) Method and apparatus for acquiring display element information of tiled screen
JP6686547B2 (en) Image processing system, program, image processing method
TWI615808B (en) Image processing method for immediately producing panoramic images
Portalés et al. An efficient projector calibration method for projecting virtual reality on cylindrical surfaces
CN114615480A (en) Projection picture adjusting method, projection picture adjusting device, projection picture adjusting apparatus, storage medium, and program product
TWI610282B (en) Method and system for modular display frame
WO2020220831A1 (en) Method and apparatus for realizing superposition of projected pictures, and projection system
WO2023151271A1 (en) Model presentation method and apparatus, and electronic device and storage medium
WO2020220827A1 (en) Method and device for realizing projected picture superimposition, and projection system
EP4283986A1 (en) Electronic apparatus and control method thereof
US20180061135A1 (en) Image display apparatus and image display method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20798320

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20798320

Country of ref document: EP

Kind code of ref document: A1