WO2017084286A1 - Multi-interactive projection system and method - Google Patents

Multi-interactive projection system and method Download PDF

Info

Publication number
WO2017084286A1
WO2017084286A1 PCT/CN2016/083257 CN2016083257W WO2017084286A1 WO 2017084286 A1 WO2017084286 A1 WO 2017084286A1 CN 2016083257 W CN2016083257 W CN 2016083257W WO 2017084286 A1 WO2017084286 A1 WO 2017084286A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
image
action
identifying
operating body
Prior art date
Application number
PCT/CN2016/083257
Other languages
French (fr)
Chinese (zh)
Inventor
杨伟樑
高志强
王梓
Original Assignee
广景视睿科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广景视睿科技（深圳）有限公司 filed Critical 广景视睿科技（深圳）有限公司
Publication of WO2017084286A1 publication Critical patent/WO2017084286A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present invention relates to the field of projection processing technologies, and in particular, to a system and method for multiple interactive projection.
  • a projector (also known as a projector) is a device that projects an image or video onto a screen.
  • the image or video projected onto the screen is magnified several times or tens of times while maintaining sharpness. It is convenient for people to watch and gives people an open view. Therefore, the projector is very popular among users.
  • interactive projection which refers to the use of computer vision technology and projection display technology, so that users can directly use the foot or hand to interact with the virtual scene on the projection area.
  • the specific principle of the interactive projection system is that the image capture device is used to capture and capture the user, and then the image analysis system analyzes and adjusts the projected image to create an interactive effect between the user and the projection area.
  • an image capturing device is usually installed only on one side of a projection area, and the user can only perform an interactive operation within the capture range of a single image capturing device, limiting The scope of user interaction, interaction Sexuality.
  • the technical problem to be solved by the present invention is to provide a multi-interactive projection system and method, which can realize the operation of two projections on different projection areas in a different operation area, thereby realizing multiple interactive projection.
  • a technical solution adopted by the present invention is to provide a multi-interactive projection system, including a processor, a projector, a first video capture device, and a second video capture device, respectively, and the processor
  • the first video capture device is connected to the second video capture device;
  • the projector is configured to receive a projection image sent by the processor, and project the projection image;
  • the first video capture device is configured to collect a first video image when the first operating body performs the interactive operation in the first operating area;
  • the second video capturing device is configured to collect the second video image when the second operating body performs the interactive operation in the second operating area
  • the position of each pixel in the first video image and the second video image has a mapping relationship with the position of each pixel of the projected image;
  • the processor is configured to: identify according to the first video image a first operation performed by the first operating body, and the first operating action is located at a first video position in the first video image; And taking a first mapping position in the projected image that is mapped to the first video position
  • the step of the processor identifying the first operation performed by the first operating body according to the first video image includes: performing two consecutive images in the first video image according to an image difference algorithm Performing a subtraction process to obtain motion data of the first operating body, and identifying a first operation action corresponding to the motion data of the first operating body; the processor identifying the according to the second video image
  • the step of the second operation performed by the second operating body includes: performing subtraction processing on two consecutive frames of the second video image according to the image difference algorithm to obtain motion data of the second operating body And identifying a second operation action corresponding to the motion data of the second operating body.
  • the step of the processor adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action comprises: identifying the first operation instruction according to the first operation action Identifying, in the projected image, a first operated object corresponding to the first mapping position, performing an operation indicated by the first operation instruction on the first operated object, and a second operation action, identifying a second operation instruction, identifying a second operated object corresponding to the second mapping position in the projected image, and performing the second on the second operated object
  • the operation indicated by the instruction is operated, and the projected image is adjusted according to the performed operation.
  • the system further includes a first voice collection device and a second voice collection device, where the first voice collection device is configured to collect the first one that is sent when the first operation body performs an interaction operation in the first operation area. a voice command; the second voice collection device is configured to collect a second voice command that is sent when the first operator performs an interaction operation in the second operation area;
  • the step of the processor adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, according to the first mapping position, the first operation action, and the second Mapping the position and the second operational action, and adjusting the projected image in conjunction with the first voice command and the second voice command.
  • the first video capture device and the second video capture device are both imaging devices configured with a charge coupled device CCD or a complementary metal oxide semiconductor CMOS.
  • the projector is a digital light processing DLP micro projection device with a zoom function.
  • another technical solution adopted by the present invention is to provide a method for multiple interactive projection, which comprises: after the projector projects the projected image, the first operating body is acquired during the interaction operation in the first operation area. a first video image, and a second video image when the second operation is performed in the second operation area, the position of each pixel in the first video image and the second video image and each pixel of the projected image
  • the position of the point has a mapping relationship; the first operation action performed by the first operation body is identified according to the first video image, and the first operation action is located at a first video position in the first video image Obtaining a first mapping position in the projected image that is mapped to the first video position; identifying, according to the second video image, a second operation performed by the second operating body, and the second The action operation is located at a second video position in the second video image; acquiring a second image of the projected image that is mapped to the second video position Position; position according to the first mapping, the operation of the first operation, a second operation and
  • identifying the first operating body includes: performing subtraction processing on two consecutive frames of the first video image according to the image difference algorithm to obtain motion data of the first operating body, and identifying the first operating body
  • the first operation action corresponding to the motion data; the step of identifying the second operation performed by the second operator according to the second video image comprises: according to the image difference algorithm, the The two consecutive frames of the two video images are subjected to subtraction processing to obtain motion data of the second operating body, and the second operation action corresponding to the motion data of the second operating body is identified.
  • the step of adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action comprises: identifying the first operation instruction according to the first operation action, and identifying a first operated object corresponding to the first mapping position in the projected image, performing an operation indicated by the first operation instruction on the first operated object, and according to the a second operation instruction, identifying a second operation instruction, identifying a second operated object corresponding to the second mapping position in the projected image, and executing the second operation instruction on the second operated object The indicated operation, and adjusting the projected image according to the performed operation.
  • the method further includes: collecting the first voice command of the first operating body when the first video image of the first operating body is operated in the first operating area;
  • the method further includes: collecting the second voice command of the second operating body; according to the first mapping position, the first operating action And adjusting, by the second mapping position and the second operation action, the projection image, according to the first mapping position, the first operation action, the second mapping position, and the second operation action, and combining the first voice command And the second voice Let the projection image be adjusted.
  • the invention has the beneficial effects that the first video image of the first operating body and the second video image of the second operation are collected according to the prior art, and the first operation action is identified according to the first video image.
  • a first video location, the second operation action and the second video location are identified according to the second video image, and the second mapping mapped by the first mapping location, the first operational action, and the second video location mapped according to the first video location.
  • the position and the second operation action adjust the projection image, so that the two operation bodies operate the projection image in different operation areas, thereby implementing multiple interactive projection.
  • FIG. 1 is a schematic diagram of an embodiment of a multi-interactive projection system of the present invention
  • FIG. 2 is a flow chart of an embodiment of a multi-interactive projection of the present invention.
  • a multi-interactive projection system 20 includes a processor 21, a projector 22, a first video capture device 23, and a second video capture device 24.
  • the processor 21 and the projector 22, the first video capture device 23, and The second video capture device 24 is connected.
  • the connection between the processor 21 and the projector 22, the first video capture device 23, and the second video capture device 24 may be a wired connection or a wireless connection, for example, a WIFI wireless connection, a Bluetooth wireless connection. , 3G or 4G wireless communication connection and so on.
  • the processor 21 can run a Windows operating system, an Android operating system, an iOS operating system, etc., a processor 21 running the operating system, it is convenient to expand the function of the system 20 with multiple interactive projections.
  • the projector 22 is configured to receive a projection image sent by the processor 21 and project a projection image.
  • the first video capture device 23 is configured to collect the first video image when the first operating body performs the interactive operation in the first operating region.
  • the second video capture device 24 is configured to collect a second video image when the second operating body performs an interactive operation in the second operation area.
  • the positions of the respective pixels in the first video image and the second video image have a mapping relationship with the positions of the respective pixel points of the projected image.
  • the first operation body performs the interaction operation, which means that the first operation body operates the projection image
  • the second operation body performs the interaction operation, which means that the second operation body operates the projection image.
  • the processor 21 is configured to identify, according to the first video image, a first operation performed by the first operating body, and the first operation action is located at a first video position in the first video image, and acquire the first video in the projected image a first mapping position of the position mapping, a second operation performed by the second operating body according to the second video image, and a second action operation being located at the second video position in the second video image to acquire the projected image A second mapping location that is mapped to the second video location.
  • the first mapping position refers to a position corresponding to the first operation action in the projected image after the first operation action is mapped to the projection image
  • the second operation position is after the second operation action is mapped to the projection image, and the second operation action is projected. The corresponding position in the image.
  • the processor 21 is further configured to adjust the projection image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, and send the adjusted projection image to the projector 22 to cause the projector 22 to perform the projection adjustment.
  • Projection image In short, after the operation body is operated, the projection image is adjusted according to the operation action of the operation body, which is equivalent to the adjustment of the projection image due to the operation of the operation body, and the interactive projection is realized; further, the present invention
  • the two operating bodies can be operated in two different operating regions, and the projected images are adjusted according to the operating actions of the two operating bodies to realize multiple interactive projections.
  • the projector 22 projects the badminton game interface. The operation area is played, and the badminton game is adjusted according to the operation of the player, and the badminton game interface projected by the projector 22 is also changed.
  • first operation area and the second operation area may be located on the front and rear sides of the projection area of the projector 22, the front side of the projection area is the side where the projector 22 is located, and the rear side of the projection area is far from the projector.
  • the above description only describes the manner in which two operating bodies operate in two different operating areas to realize multiple interactive projections. Those skilled in the art can also set three or four operating areas according to the technical idea of the present invention.
  • the operating bodies are located in different operating areas for operation, enabling multiple interactive projections.
  • the step of identifying the operation operation may be performed in combination with the image difference algorithm
  • the step of the processor 21 identifying the first operation action performed by the first operation body according to the first video image includes: the processor 21 according to the image difference algorithm
  • the two consecutive frames of the first video image are subjected to subtraction processing to obtain motion data of the first operational body, and identify a first operational motion corresponding to the motion data of the first operational body.
  • the processor 21 identifies, according to the second video image, the second operation performed by the second operating body, and performs subtraction processing on the two consecutive frames of the second video image according to the image difference algorithm to obtain a second operation.
  • the motion data of the body identifies a second operation action corresponding to the motion data of the second operator.
  • other methods of identifying the operating actions of the operating body may also be collected, for example: By tracking the hand motion trajectories of the first operating body and the second operating body, the first operating action and the second operating action are respectively identified according to the hand motion trajectories of the first operating body and the second operating body.
  • the step of the processor 21 adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action comprises: identifying the first operation instruction according to the first operation action, and identifying the first image in the projection image a first operated object corresponding to the position, performing an operation indicated by the first operation instruction on the first operated object, and identifying the second operation instruction according to the second operation action, identifying the second and second in the projected image
  • the second operated object corresponding to the mapping position, for the second operated object performs an operation indicated by the second operation instruction, and adjusts the projected image according to the operation.
  • the operation action and the operation instruction may be predetermined to establish a correspondence relationship, for example, the hand support opening represents the opening instruction, the hand support is used to represent the closing instruction, the hand sliding to the right represents the rightward switching, and the like.
  • the voice command of the operating body can also be collected, and the projection content is adjusted in combination with the voice command.
  • the multi-interactive projection system 20 further includes a first voice collection device 25 and a second voice collection device 26.
  • the first voice collection device 25 is configured to collect a first voice command that is sent when the first operator performs an interaction operation in the first operation area.
  • the second voice collection device 26 is configured to collect a second voice command that is sent when the first operator performs an interaction operation in the second operation area.
  • the processor 21 adjusts the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, including: according to the first mapping position, the first operation action, the second mapping position, and the second operation action And combining the first voice command and the second voice command to adjust the projected image.
  • the first video capture device 23 and the second video capture device 24 are preferably imaging devices configured with a charge coupled device CCD or a complementary metal oxide semiconductor CMOS
  • the projector 22 is preferably Digital light processing DLP micro projection device with zoom function.
  • the first video image of the first operating body and the second video image of the second operation are collected, and the first operation action and the first video position are identified according to the first video image, according to the second video image. Identifying the second operation action and the second video position, and adjusting the projection image according to the first mapping position mapped by the first video position, the first operation action, the second mapping position mapped by the second video position, and the second operation action,
  • the two operating bodies are operated on the projected image in different operation areas, thereby implementing multiple interactive projections.
  • the present invention further provides an embodiment of a method of interactive projection. Please refer to Figure 2, the method includes:
  • Step S301 After the projection image is projected by the projector, collect the first video image when the first operation body performs the interaction operation in the first operation area, and collect the first operation body when the second operation body performs the interaction operation in the second operation area.
  • a video image wherein a position of each pixel in the first video image and the second video image has a mapping relationship with a position of each pixel of the projected image;
  • the interaction of the first operating body in the first operating region refers to the operation of the first operating body for the projected image
  • the interaction of the second operating body in the second operating region refers to the second operating body for the projected image.
  • the operation performed, for example, is to project a projected image of the automobile part, and the operating body performs a two-handed movement for the projected image of the automobile part.
  • Step S302 Identify, according to the first video image, a first operation performed by the first operating body, and the first operation action is located at a first video position in the first video image;
  • Step S302 can be specifically as follows: Image difference algorithm, the first video shadow Performing subtraction processing on the two consecutive frames of the image, obtaining motion data of the first operating body, and identifying a first operating motion corresponding to the motion data of the first operating body.
  • Image difference algorithm the first video shadow Performing subtraction processing on the two consecutive frames of the image, obtaining motion data of the first operating body, and identifying a first operating motion corresponding to the motion data of the first operating body.
  • other manners of identifying the first operating body such as gesture tracking recognition, etc., may also be collected.
  • Step S303 Acquire a first mapping position in the projected image that is mapped to the first video position.
  • the first mapping position is a position at which the first operational action is reflected to the projected image.
  • Step S304 Identify a second operation performed by the second operating body according to the second video image, and the second action operation is located at the second video position in the second video image;
  • the second operation action may also be combined with the image difference algorithm, and the step S304 may be specifically: subtracting two consecutive frames of the second video image according to the image difference algorithm to obtain the motion of the second operation body.
  • the data identifies a second operational action corresponding to the motion data of the second operational body.
  • other manners of identifying the second operating body of the second operating body such as gesture tracking recognition and the like, may also be collected.
  • Step S305 Acquire a second mapping position in the projected image that is mapped to the second video position.
  • the second mapping position refers to the position at which the second operational action is mapped to the projected image.
  • Step S306 Adjust the projection image according to the first mapping position, the first operation action, the second mapping position, and the second operation action.
  • step S306 is specifically: identifying the first operation instruction according to the first operation action, and identifying the projection image a first operated object corresponding to the first mapping position, performing an operation indicated by the first operation instruction on the first operated object, and identifying the second operation instruction and identifying the projected image according to the second operation action And a second operated object corresponding to the second mapped position, performing an operation indicated by the second operation instruction on the second operated object, and adjusting the projected image according to the performed operation.
  • the time is performed according to the time sequence of the operations performed by the first operating body and the second operating body, for example, the first operating body is first performed.
  • the interactive operation after the second operation body performs the interaction operation, firstly adjusts the projection content according to the interaction operation of the first operation body, and then adjusts the projection content according to the interaction operation of the second operation body.
  • the voice command of the operation body may be collected, and the projection content is adjusted in combination with the voice command, and the first video image when the first operation body performs the interaction operation in the first operation area is collected. And acquiring a first voice command of the first operating body, and collecting a second video image of the second operating body when acquiring the second video image when the second operating body performs the interaction operation in the second operating area Voice command.
  • Step S306 is specifically: adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, in combination with the first voice command and the second voice command.
  • the first video image of the first operating body and the second video image of the second operation are collected, and the first operation action and the first video position are identified according to the first video image, according to the second video image. Identifying the second operation action and the second video position, and adjusting the projection image according to the first mapping position mapped by the first video position, the first operation action, the second mapping position mapped by the second video position, and the second operation action, Realize two operating bodies in The different operating areas operate on the projected image to achieve multiple interactive projections.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The present invention discloses a system and a method for multi-interactive projection. The system comprises a processor, a projector, a first video capture device and a second video capture device. The first video capture device captures a first video image, and the second video capture device captures a second video image. The processor is used for identifying a first operation action performed by a first operation body and a first video position of the first operation action; obtaining a first mapping position mapped to the first video position; identifying a second operation action performed by a second operation body and a second video position of the second operation action; obtaining a second mapping position in a projected image that is mapped to the second video position; and adjusting the projected image according to the first mapping position, the first operation action, the second mapping position and the second operation action, and transmitting the adjusted projected image to the projector. Through the above-described method, the present invention realizes that the two operation bodies operate on the projected image in different operation areas, thereby realizing multi-interactive projection.

Description

[根据细则26改正01.06.2016]　一种多互动投影的系统及方法[Correction according to Rule 26 01.06.2016] A multi-interactive projection system and method 技术领域Technical field
[根据细则26改正01.06.2016]　
本发明涉及投影处理技术领域，特别是涉及一种多互动投影的系统及方法。[Correct according to Rule 26 01.06.2016]
The present invention relates to the field of projection processing technologies, and in particular, to a system and method for multiple interactive projection.
背景技术Background technique
投影仪(又称投影机)，是一种可以将图像或视频投射到幕布上的设备，其投影到幕布上的图像或者视频在保持清晰度的情况下呈现数倍或者数十倍进行放大，方便人们观看，也给予人们开阔的视野，因此，投影仪深受用户的欢迎。A projector (also known as a projector) is a device that projects an image or video onto a screen. The image or video projected onto the screen is magnified several times or tens of times while maintaining sharpness. It is convenient for people to watch and gives people an open view. Therefore, the projector is very popular among users.
目前，在投影技术领域出现一种新型的投影方式：互动投影，互动投影是指：采用计算机视觉技术和投影显示技术，使用户可以直接使用脚或手与投影区域上的虚拟场景进行交互的一种投影方式。互动投影系统的具体原理为：是通过图像捕捉设备对用户进行捕捉拍摄，然后由影像分析系统分析，调整投影图像，使用户与投影区域之间产生互动的效果。但是本发明的发明人在长期的研究中发现：在目前的互动投影技术中，通常只在投影区域一侧安装图像捕捉设备，用户只能在单一图像捕捉设备的捕捉范围内进行互动操作，限制用户的互动操作的范围，互动 性单一。At present, there is a new type of projection in the field of projection technology: interactive projection, which refers to the use of computer vision technology and projection display technology, so that users can directly use the foot or hand to interact with the virtual scene on the projection area. Kind of projection. The specific principle of the interactive projection system is that the image capture device is used to capture and capture the user, and then the image analysis system analyzes and adjusts the projected image to create an interactive effect between the user and the projection area. However, the inventors of the present invention have found in a long-term research that in the current interactive projection technology, an image capturing device is usually installed only on one side of a projection area, and the user can only perform an interactive operation within the capture range of a single image capturing device, limiting The scope of user interaction, interaction Sexuality.
发明内容Summary of the invention
[根据细则26改正01.06.2016]　
本发明主要解决的技术问题是提供一种多互动投影的系统及方法，能够实现两个操作体在不同操作区域对投影图像进行操作，从而实现多互动投影。[Correct according to Rule 26 01.06.2016]
The technical problem to be solved by the present invention is to provide a multi-interactive projection system and method, which can realize the operation of two projections on different projection areas in a different operation area, thereby realizing multiple interactive projection.
为解决上述技术问题，本发明采用的一个技术方案是：提供一种多互动投影的系统，包括处理器、投影仪、第一视频采集装置和第二视频采集装置，所述处理器分别与投影仪、第一视频采集装置和第二视频采集装置连接；所述投影仪，用于接收所述处理器发送的投影图像，并投射所述投影图像；所述第一视频采集装置，用于采集第一操作体在第一操作区域内进行交互操作时的第一视频影像；所述第二视频采集装置，用于采集第二操作体在第二操作区域内进行交互操作时的第二视频影像，其中，所述第一视频影像和第二视频影像中各个像素点的位置与投影图像的各个像素点的位置具有映射关系；所述处理器，用于：根据所述第一视频影像，识别所述第一操作体所进行的第一操作动作，以及所述第一操作动作位于所述第一视频影像中的第一视频位置；获取所述投影图像中与所述第一视频位置相映射的第一映射位置；根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作，以及所述第二动作操作位于所述第二视频影像中的第二视频位置；获取所述投影图像中与所述第二视频位置相映射的第二映射位置；根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像，并向 所述投影仪发送调整后的投影图像，以使所述投影仪投射所述调整后的投影图像。In order to solve the above technical problem, a technical solution adopted by the present invention is to provide a multi-interactive projection system, including a processor, a projector, a first video capture device, and a second video capture device, respectively, and the processor The first video capture device is connected to the second video capture device; the projector is configured to receive a projection image sent by the processor, and project the projection image; and the first video capture device is configured to collect a first video image when the first operating body performs the interactive operation in the first operating area; the second video capturing device is configured to collect the second video image when the second operating body performs the interactive operation in the second operating area The position of each pixel in the first video image and the second video image has a mapping relationship with the position of each pixel of the projected image; the processor is configured to: identify according to the first video image a first operation performed by the first operating body, and the first operating action is located at a first video position in the first video image; And taking a first mapping position in the projected image that is mapped to the first video position; identifying, according to the second video image, a second operation performed by the second operating body, and the second action And operating a second video location in the second video image; acquiring a second mapping location in the projection image that is mapped to the second video location; according to the first mapping location, the first operation action, The second mapping position and the second operational action adjust the projected image and The projector transmits the adjusted projected image to cause the projector to project the adjusted projected image.
其中，所述处理器根据所述第一视频影像，识别所述第一操作体所进行的第一操作动作的步骤包括：根据图像差分算法，将所述第一视频影像中连续的两帧图像进行相减处理，得到所述第一操作体的运动数据，并识别所述第一操作体的运动数据所对应的第一操作动作；所述处理器根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作的步骤包括：根据所述图像差分算法，将所述第二视频影像中连续的两帧图像进行相减处理，得到所述第二操作体的运动数据，识别所述第二操作体的运动数据所对应的第二操作动作。The step of the processor identifying the first operation performed by the first operating body according to the first video image includes: performing two consecutive images in the first video image according to an image difference algorithm Performing a subtraction process to obtain motion data of the first operating body, and identifying a first operation action corresponding to the motion data of the first operating body; the processor identifying the according to the second video image The step of the second operation performed by the second operating body includes: performing subtraction processing on two consecutive frames of the second video image according to the image difference algorithm to obtain motion data of the second operating body And identifying a second operation action corresponding to the motion data of the second operating body.
其中，所述处理器根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：根据所述第一操作动作，识别第一操作指令，识别所述投影图像中与所述第一映射位置相对应的第一被操作对像，对所述第一被操作对像，执行所述第一操作指令所指示的操作，以及，根据所述第二操作动作，识别第二操作指令，识别所述投影图像中与所述第二映射位置相对应的第二被操作对像，对所述第二被操作对像，执行所述第二操作指令所指示的操作，并根据所述执行的操作，调整投影图像。The step of the processor adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action comprises: identifying the first operation instruction according to the first operation action Identifying, in the projected image, a first operated object corresponding to the first mapping position, performing an operation indicated by the first operation instruction on the first operated object, and a second operation action, identifying a second operation instruction, identifying a second operated object corresponding to the second mapping position in the projected image, and performing the second on the second operated object The operation indicated by the instruction is operated, and the projected image is adjusted according to the performed operation.
其中，所述系统还包括第一语音采集装置和第二语音采集装置；所述第一语音采集装置，用于采集所述第一操作体在第一操作区域内进行交互操作时发出的第一语音命令；所述第二语音采集装置，用于采集所述第一操作体在第二操作区域内进行交互操作时发出的第二语音命令； 所述处理器根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作，并结合所述第一语音命令和第二语音命令，调整所述投影图像。The system further includes a first voice collection device and a second voice collection device, where the first voice collection device is configured to collect the first one that is sent when the first operation body performs an interaction operation in the first operation area. a voice command; the second voice collection device is configured to collect a second voice command that is sent when the first operator performs an interaction operation in the second operation area; The step of the processor adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, according to the first mapping position, the first operation action, and the second Mapping the position and the second operational action, and adjusting the projected image in conjunction with the first voice command and the second voice command.
其中，所述第一视频采集装置和第二视频采集装置均为配置有电荷耦合元件CCD或互补金属氧化物半导体CMOS的摄像设备。The first video capture device and the second video capture device are both imaging devices configured with a charge coupled device CCD or a complementary metal oxide semiconductor CMOS.
其中，所述投影仪为具有变焦功能的数字光处理DLP微型投影设备。Wherein, the projector is a digital light processing DLP micro projection device with a zoom function.
为解决上述技术问题，本发明采用的另一个技术方案是：提供一种多互动投影的方法，包括在投影仪向投射投影图像后，采集第一操作体在第一操作区域内进行交互操作时的第一视频影像，以及采集第二操作在第二操作区域内进行交互操作时的第二视频影像，所述第一视频影像和第二视频影像中各个像素点的位置与投影图像的各个像素点的位置具有映射关系；根据所述第一视频影像，识别所述第一操作体所进行的第一操作动作，以及所述第一操作动作位于所述第一视频影像中的第一视频位置；获取所述投影图像中与所述第一视频位置相映射的第一映射位置；根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作，以及所述第二动作操作位于所述第二视频影像中的第二视频位置；获取所述投影图像中与所述第二视频位置相映射的第二映射位置；根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像。In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a method for multiple interactive projection, which comprises: after the projector projects the projected image, the first operating body is acquired during the interaction operation in the first operation area. a first video image, and a second video image when the second operation is performed in the second operation area, the position of each pixel in the first video image and the second video image and each pixel of the projected image The position of the point has a mapping relationship; the first operation action performed by the first operation body is identified according to the first video image, and the first operation action is located at a first video position in the first video image Obtaining a first mapping position in the projected image that is mapped to the first video position; identifying, according to the second video image, a second operation performed by the second operating body, and the second The action operation is located at a second video position in the second video image; acquiring a second image of the projected image that is mapped to the second video position Position; position according to the first mapping, the operation of the first operation, a second operation and a second operating position mapping to adjust the projected image.
其中，所述根据所述第一视频影像，识别所述第一操作体所进行的 第一操作动作的步骤包括：根据图像差分算法，将所述第一视频影像中连续的两帧图像进行相减处理，得到所述第一操作体的运动数据，并识别所述第一操作体的运动数据所对应的第一操作动作；所述根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作的步骤包括：根据所述图像差分算法，将所述第二视频影像中连续的两帧图像进行相减处理，得到所述第二操作体的运动数据，识别所述第二操作体的运动数据所对应的第二操作动作。Wherein, according to the first video image, identifying the first operating body The step of the first operation includes: performing subtraction processing on two consecutive frames of the first video image according to the image difference algorithm to obtain motion data of the first operating body, and identifying the first operating body The first operation action corresponding to the motion data; the step of identifying the second operation performed by the second operator according to the second video image comprises: according to the image difference algorithm, the The two consecutive frames of the two video images are subjected to subtraction processing to obtain motion data of the second operating body, and the second operation action corresponding to the motion data of the second operating body is identified.
其中，所述根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：根据所述第一操作动作，识别第一操作指令，识别所述投影图像中与所述第一映射位置相对应的第一被操作对像，对所述第一被操作对像，执行所述第一操作指令所指示的操作，以及，根据所述第二操作动作，识别第二操作指令，识别所述投影图像中与所述第二映射位置相对应的第二被操作对像，对所述第二被操作对像，执行所述第二操作指令所指示的操作，并根据所述执行的操作，调整投影图像。The step of adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action comprises: identifying the first operation instruction according to the first operation action, and identifying a first operated object corresponding to the first mapping position in the projected image, performing an operation indicated by the first operation instruction on the first operated object, and according to the a second operation instruction, identifying a second operation instruction, identifying a second operated object corresponding to the second mapping position in the projected image, and executing the second operation instruction on the second operated object The indicated operation, and adjusting the projected image according to the performed operation.
其中，在所述采集第一操作体在第一操作区域内进行交互操作时的第一视频影像时，所述方法还包括采集所述第一操作体的第一语音命令；在所述采集第二操作体在第二操作区域内进行交互操作时的第二视频影像时，所述方法还包括采集所述第二操作体的第二语音命令；根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作，并结合所述第一语音命令和第二语音命 令，调整所述投影图像。The method further includes: collecting the first voice command of the first operating body when the first video image of the first operating body is operated in the first operating area; When the second operating image is in the second operation area, the method further includes: collecting the second voice command of the second operating body; according to the first mapping position, the first operating action And adjusting, by the second mapping position and the second operation action, the projection image, according to the first mapping position, the first operation action, the second mapping position, and the second operation action, and combining the first voice command And the second voice Let the projection image be adjusted.
本发明的有益效果是：区别于现有技术的情况，本发明采集第一操作体的第一视频影像，以及第二操作的第二视频影像，根据第一视频影像识别出第一操作动作和第一视频位置，根据第二视频影像识别出第二操作动作和第二视频位置，根据第一视频位置所映射的第一映射位置、第一操作动作、第二视频位置所映射的第二映射位置和第二操作动作调整投影图像，实现两个操作体在不同操作区域对投影图像进行操作，进而实现多互动投影。The invention has the beneficial effects that the first video image of the first operating body and the second video image of the second operation are collected according to the prior art, and the first operation action is identified according to the first video image. a first video location, the second operation action and the second video location are identified according to the second video image, and the second mapping mapped by the first mapping location, the first operational action, and the second video location mapped according to the first video location The position and the second operation action adjust the projection image, so that the two operation bodies operate the projection image in different operation areas, thereby implementing multiple interactive projection.
附图说明DRAWINGS
图1是本发明多互动投影的系统实施方式的示意图；1 is a schematic diagram of an embodiment of a multi-interactive projection system of the present invention;
图2是本发明多互动投影的方式实施方式的流程图。2 is a flow chart of an embodiment of a multi-interactive projection of the present invention.
具体实施方式detailed description
下面结合附图和实施方式对本发明进行详细说明。The invention will now be described in detail in conjunction with the drawings and embodiments.
请参阅图1，多互动投影的系统20包括处理器21、投影仪22、第一视频采集装置23和第二视频采集装置24，处理器21分别与投影仪22、第一视频采集装置23和第二视频采集装置24连接。值得说明的是：处理器21与投影仪22、第一视频采集装置23和第二视频采集装置24之间的连接可以为有线连接，也可以为无线连接，例如：WIFI无线连接，蓝牙无线连接、3G或者4G无线通信连接等等。处理器21可以运行有Windows操作系统、Android操作系统及iOS操作系统等等，处理器 21运行操作系统，可以方便扩展多互动投影的系统20的功能。Referring to FIG. 1, a multi-interactive projection system 20 includes a processor 21, a projector 22, a first video capture device 23, and a second video capture device 24. The processor 21 and the projector 22, the first video capture device 23, and The second video capture device 24 is connected. It should be noted that the connection between the processor 21 and the projector 22, the first video capture device 23, and the second video capture device 24 may be a wired connection or a wireless connection, for example, a WIFI wireless connection, a Bluetooth wireless connection. , 3G or 4G wireless communication connection and so on. The processor 21 can run a Windows operating system, an Android operating system, an iOS operating system, etc., a processor 21 running the operating system, it is convenient to expand the function of the system 20 with multiple interactive projections.
投影仪22，用于接收处理器21发送的投影图像，并投射投影图像。在投影仪22投射投影图像后，第一视频采集装置23，用于采集第一操作体在第一操作区域内进行交互操作时的第一视频影像。第二视频采集装置24，用于采集第二操作体在第二操作区域内进行交互操作时的第二视频影像。其中，第一视频影像和第二视频影像中各个像素点的位置与投影图像的各个像素点的位置具有映射关系。而第一操作体进行交互操作，是指第一操作体操作投图像，同样的，第二操作体进行交互操作，是指第二操作体操作投图像。The projector 22 is configured to receive a projection image sent by the processor 21 and project a projection image. After the projector 22 projects the projected image, the first video capture device 23 is configured to collect the first video image when the first operating body performs the interactive operation in the first operating region. The second video capture device 24 is configured to collect a second video image when the second operating body performs an interactive operation in the second operation area. The positions of the respective pixels in the first video image and the second video image have a mapping relationship with the positions of the respective pixel points of the projected image. The first operation body performs the interaction operation, which means that the first operation body operates the projection image, and the second operation body performs the interaction operation, which means that the second operation body operates the projection image.
处理器21，用于根据第一视频影像，识别第一操作体所进行的第一操作动作，以及第一操作动作位于第一视频影像中的第一视频位置，获取投影图像中与第一视频位置相映射的第一映射位置，根据第二视频影像，识别第二操作体所进行的第二操作动作，以及第二动作操作位于所述第二视频影像中的第二视频位置，获取投影图像中与第二视频位置相映射的第二映射位置。第一映射位置是指第一操作动作映射至投影图像后，第一操作动作在投影图像中对应的位置，第二映射位置是指第二操作动作映射至投影图像后，第二操作动作在投影图像中对应的位置。The processor 21 is configured to identify, according to the first video image, a first operation performed by the first operating body, and the first operation action is located at a first video position in the first video image, and acquire the first video in the projected image a first mapping position of the position mapping, a second operation performed by the second operating body according to the second video image, and a second action operation being located at the second video position in the second video image to acquire the projected image A second mapping location that is mapped to the second video location. The first mapping position refers to a position corresponding to the first operation action in the projected image after the first operation action is mapped to the projection image, and the second operation position is after the second operation action is mapped to the projection image, and the second operation action is projected. The corresponding position in the image.
处理器21还用于根据第一映射位置、第一操作动作、第二映射位置和第二操作动作调整投影图像，并向投影仪22发送调整后的投影图像，以使投影仪22投射调整后的投影图像。简而言之，在操作体进行操作后，投影图像根据操作体的操作动作进行调整，相当于投影图像的调整是由于操作体进行操作造成的，实现互动投影；进一步的，本发明 可以由两个操作体在两个不同操作区域进行操作，根据两个操作体的操作动作调整投影图像，实现多互动投影，例如：投影仪22将羽毛球游戏界面进行投影两个比赛队员可以位于不同操作区域进行比赛，并根据队员的操作调节羽毛球游戏，并且投影仪22所投影的羽毛球游戏界面也会发会变化。The processor 21 is further configured to adjust the projection image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, and send the adjusted projection image to the projector 22 to cause the projector 22 to perform the projection adjustment. Projection image. In short, after the operation body is operated, the projection image is adjusted according to the operation action of the operation body, which is equivalent to the adjustment of the projection image due to the operation of the operation body, and the interactive projection is realized; further, the present invention The two operating bodies can be operated in two different operating regions, and the projected images are adjusted according to the operating actions of the two operating bodies to realize multiple interactive projections. For example, the projector 22 projects the badminton game interface. The operation area is played, and the badminton game is adjusted according to the operation of the player, and the badminton game interface projected by the projector 22 is also changed.
值得说明的是：第一操作区域和第二操作区域可以位于投影仪22的投影区域的前后两侧，投影区域的前侧为投影仪22所在一侧，投影区域的后侧是指远离投影仪22的一侧；当然，在其它替代实施方式中，第一操作区域和第二操作区域也可以同时位于投影区域的前侧或者后侧。另外，上述只是描述两个操作体在两个不同操作区域进行操作，实现多互动投影的方式，本领域技术人员也可以根据本发明的技术思想设置三个、四个等多个操作区域，多个操作体位于不同的操作区域进行操作，实现多互动投影。It should be noted that the first operation area and the second operation area may be located on the front and rear sides of the projection area of the projector 22, the front side of the projection area is the side where the projector 22 is located, and the rear side of the projection area is far from the projector. One side of 22; of course, in other alternative embodiments, the first operating area and the second operating area may also be located on the front or rear side of the projected area at the same time. In addition, the above description only describes the manner in which two operating bodies operate in two different operating areas to realize multiple interactive projections. Those skilled in the art can also set three or four operating areas according to the technical idea of the present invention. The operating bodies are located in different operating areas for operation, enabling multiple interactive projections.
具体的，在识别操作动作，可以结合图像差分算法进行，则处理器21根据第一视频影像，识别第一操作体所进行的第一操作动作的步骤包括：处理器21根据图像差分算法，将第一视频影像中连续的两帧图像进行相减处理，得到第一操作体的运动数据，并识别第一操作体的运动数据所对应的第一操作动作。处理器21根据第二视频影像，识别第二操作体所进行的第二操作动作的步骤包括：根据图像差分算法，将第二视频影像中连续的两帧图像进行相减处理，得到第二操作体的运动数据，识别第二操作体的运动数据所对应的第二操作动作。当然，在其它替代实施方式中，也可以采集其它方式识别操作体的操作动作，例如： 通过追踪第一操作体和第二操作体的手部运动轨迹，根据第一操作体和第二操作体的手部运动轨迹分别识别出第一操作动作和第二操作动作。Specifically, the step of identifying the operation operation may be performed in combination with the image difference algorithm, and the step of the processor 21 identifying the first operation action performed by the first operation body according to the first video image includes: the processor 21 according to the image difference algorithm The two consecutive frames of the first video image are subjected to subtraction processing to obtain motion data of the first operational body, and identify a first operational motion corresponding to the motion data of the first operational body. The processor 21 identifies, according to the second video image, the second operation performed by the second operating body, and performs subtraction processing on the two consecutive frames of the second video image according to the image difference algorithm to obtain a second operation. The motion data of the body identifies a second operation action corresponding to the motion data of the second operator. Of course, in other alternative embodiments, other methods of identifying the operating actions of the operating body may also be collected, for example: By tracking the hand motion trajectories of the first operating body and the second operating body, the first operating action and the second operating action are respectively identified according to the hand motion trajectories of the first operating body and the second operating body.
处理器21根据第一映射位置、第一操作动作、第二映射位置和第二操作动作调整投影图像的步骤包括：根据第一操作动作，识别第一操作指令，识别投影图像中与第一映射位置相对应的第一被操作对像，对第一被操作对像，执行第一操作指令所指示的操作，以及，根据第二操作动作，识别第二操作指令，识别投影图像中与第二映射位置相对应的第二被操作对像，对第二被操作对像，执行所述第二操作指令所指示的操作，并根据所述操作，调整投影图像。操作动作与操作指令可以预定建立对应关系，例如：手撑打开代表打开指令，手撑合起作代表关闭指令，手向右滑动代表向右切换等等。The step of the processor 21 adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action comprises: identifying the first operation instruction according to the first operation action, and identifying the first image in the projection image a first operated object corresponding to the position, performing an operation indicated by the first operation instruction on the first operated object, and identifying the second operation instruction according to the second operation action, identifying the second and second in the projected image The second operated object corresponding to the mapping position, for the second operated object, performs an operation indicated by the second operation instruction, and adjusts the projected image according to the operation. The operation action and the operation instruction may be predetermined to establish a correspondence relationship, for example, the hand support opening represents the opening instruction, the hand support is used to represent the closing instruction, the hand sliding to the right represents the rightward switching, and the like.
为了提高交互投影的交互性，还可以采集操作体的语音命令，结合语音命令进行调整投影内容，则多互动投影的系统20还包括第一语音采集装置25和第二语音采集装置26。第一语音采集装置25，用于采集第一操作体在第一操作区域内进行交互操作时发出的第一语音命令。第二语音采集装置26，用于采集第一操作体在第二操作区域内进行交互操作时发出的第二语音命令。处理器21根据第一映射位置、第一操作动作、第二映射位置和第二操作动作调整投影图像的步骤包括：根据第一映射位置、第一操作动作、第二映射位置和第二操作动作，并结合第一语音命令和第二语音命令，调整投影图像。在本发明实施方式中，第一视频采集装置23和第二视频采集装置24均优选为配置有电荷耦合元件CCD或互补金属氧化物半导体CMOS的摄像设备，投影仪22优选为 具有变焦功能的数字光处理DLP微型投影设备。In order to improve the interactivity of the interactive projection, the voice command of the operating body can also be collected, and the projection content is adjusted in combination with the voice command. The multi-interactive projection system 20 further includes a first voice collection device 25 and a second voice collection device 26. The first voice collection device 25 is configured to collect a first voice command that is sent when the first operator performs an interaction operation in the first operation area. The second voice collection device 26 is configured to collect a second voice command that is sent when the first operator performs an interaction operation in the second operation area. The processor 21 adjusts the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, including: according to the first mapping position, the first operation action, the second mapping position, and the second operation action And combining the first voice command and the second voice command to adjust the projected image. In the embodiment of the present invention, the first video capture device 23 and the second video capture device 24 are preferably imaging devices configured with a charge coupled device CCD or a complementary metal oxide semiconductor CMOS, and the projector 22 is preferably Digital light processing DLP micro projection device with zoom function.
在本发明实施方式中，采集第一操作体的第一视频影像，以及第二操作的第二视频影像，根据第一视频影像识别出第一操作动作和第一视频位置，根据第二视频影像识别出第二操作动作和第二视频位置，根据第一视频位置所映射的第一映射位置、第一操作动作、第二视频位置所映射的第二映射位置和第二操作动作调整投影图像，实现两个操作体在不同操作区域对投影图像进行操作，进而实现多互动投影。In the embodiment of the present invention, the first video image of the first operating body and the second video image of the second operation are collected, and the first operation action and the first video position are identified according to the first video image, according to the second video image. Identifying the second operation action and the second video position, and adjusting the projection image according to the first mapping position mapped by the first video position, the first operation action, the second mapping position mapped by the second video position, and the second operation action, The two operating bodies are operated on the projected image in different operation areas, thereby implementing multiple interactive projections.
本发明又提供互动投影的方法实施方式。请参阅图2，方法包括：The present invention further provides an embodiment of a method of interactive projection. Please refer to Figure 2, the method includes:
步骤S301：在投影仪投射投影图像后，采集第一操作体在第一操作区域内进行交互操作时的第一视频影像，以及采集第二操作体在第二操作区域内进行交互操作时的第二视频影像，其中，第一视频影像和第二视频影像中各个像素点的位置与投影图像的各个像素点的位置具有映射关系；Step S301: After the projection image is projected by the projector, collect the first video image when the first operation body performs the interaction operation in the first operation area, and collect the first operation body when the second operation body performs the interaction operation in the second operation area. a video image, wherein a position of each pixel in the first video image and the second video image has a mapping relationship with a position of each pixel of the projected image;
第一操作体在第一操作区域内进行交互操作是指第一操作体针对投影图像所进的操作，第二操作体在第二操作区域内进行交互操作是指第二操作体针对投影图像所进行的操作，例如：在投影汽车部件的投影图像，操作体针对汽车部件的投影图像执行两手张开的动作。The interaction of the first operating body in the first operating region refers to the operation of the first operating body for the projected image, and the interaction of the second operating body in the second operating region refers to the second operating body for the projected image. The operation performed, for example, is to project a projected image of the automobile part, and the operating body performs a two-handed movement for the projected image of the automobile part.
步骤S302：根据第一视频影像，识别第一操作体所进行的第一操作动作，以及第一操作动作位于第一视频影像中的第一视频位置；Step S302: Identify, according to the first video image, a first operation performed by the first operating body, and the first operation action is located at a first video position in the first video image;
操作体在操作前后，其视频影像是不相同的，因此，可以通过图像差分算法，识别两相邻的视频影像的差别，进而识别出操作体的操作动作，则步骤S302又可具体为：根据图像差分算法，将所述第一视频影 像中连续的两帧图像进行相减处理，得到所述第一操作体的运动数据，并识别所述第一操作体的运动数据所对应的第一操作动作。当然，在其它替代实施方式中，也可以采集其它方式识别第一操作体的第一操作动作，例如：手势追踪识别等等。The video images of the operating body are different before and after the operation. Therefore, the image difference algorithm can be used to identify the difference between the two adjacent video images, thereby identifying the operation action of the operating body. Step S302 can be specifically as follows: Image difference algorithm, the first video shadow Performing subtraction processing on the two consecutive frames of the image, obtaining motion data of the first operating body, and identifying a first operating motion corresponding to the motion data of the first operating body. Of course, in other alternative embodiments, other manners of identifying the first operating body, such as gesture tracking recognition, etc., may also be collected.
步骤S303：获取投影图像中与第一视频位置相映射的第一映射位置；Step S303: Acquire a first mapping position in the projected image that is mapped to the first video position.
第一映射位置是为第一操作动作映至到投影图像时所处的位置。The first mapping position is a position at which the first operational action is reflected to the projected image.
步骤S304：根据第二视频影像，识别第二操作体所进行的第二操作动作，以及第二动作操作位于所述第二视频影像中的第二视频位置；Step S304: Identify a second operation performed by the second operating body according to the second video image, and the second action operation is located at the second video position in the second video image;
第二操作动作也可以结合图像差分算法进行识别的，则步骤S304又可具体为：根据图像差分算法，将第二视频影像中连续的两帧图像进行相减处理，得到第二操作体的运动数据，识别第二操作体的运动数据所对应的第二操作动作。当然，在其它替代实施方式中，也可以采集其它方式识别第二操作体的第二操作动作，例如：手势追踪识别等等。The second operation action may also be combined with the image difference algorithm, and the step S304 may be specifically: subtracting two consecutive frames of the second video image according to the image difference algorithm to obtain the motion of the second operation body. The data identifies a second operational action corresponding to the motion data of the second operational body. Of course, in other alternative embodiments, other manners of identifying the second operating body of the second operating body, such as gesture tracking recognition and the like, may also be collected.
步骤S305：获取投影图像中与第二视频位置相映射的第二映射位置；Step S305: Acquire a second mapping position in the projected image that is mapped to the second video position.
第二映射位置是指第二操作动作映射至投影图像中所处于的位置。The second mapping position refers to the position at which the second operational action is mapped to the projected image.
步骤S306：根据第一映射位置、第一操作动作、第二映射位置和第二操作动作调整投影图像。Step S306: Adjust the projection image according to the first mapping position, the first operation action, the second mapping position, and the second operation action.
在第一操作体和第二操作体进行操作，根据第一操作体和第二操作体的操作调整投影图像，实现多互动投影。在本发明一种实现，步骤S306具体为：根据第一操作动作，识别第一操作指令，识别投影图像中与 第一映射位置相对应的第一被操作对像，对第一被操作对像，执行所第一操作指令所指示的操作，以及，根据第二操作动作，识别第二操作指令，识别投影图像中与所述第二映射位置相对应的第二被操作对像，对第二被操作对像，执行第二操作指令所指示的操作，并根据执行的操作，调整投影图像。The first operating body and the second operating body are operated to adjust the projected image according to the operations of the first operating body and the second operating body to realize multiple interactive projection. In an implementation of the present invention, step S306 is specifically: identifying the first operation instruction according to the first operation action, and identifying the projection image a first operated object corresponding to the first mapping position, performing an operation indicated by the first operation instruction on the first operated object, and identifying the second operation instruction and identifying the projected image according to the second operation action And a second operated object corresponding to the second mapped position, performing an operation indicated by the second operation instruction on the second operated object, and adjusting the projected image according to the performed operation.
值得说明的：在根据第一操作体和第二操作体的操作调整投影内容时，是根据第一操作体和第二操作体所进行的操作的时间顺序进行，例如：第一操作体先进行交互操作，第二操作体后进行交互操作，则先根据第一操作体的交互操作调整投影内容，再根据第二操作体的交互操作调整投影内容。It should be noted that when the projection content is adjusted according to the operation of the first operating body and the second operating body, the time is performed according to the time sequence of the operations performed by the first operating body and the second operating body, for example, the first operating body is first performed. The interactive operation, after the second operation body performs the interaction operation, firstly adjusts the projection content according to the interaction operation of the first operation body, and then adjusts the projection content according to the interaction operation of the second operation body.
进一步的，为了提高交互投影的交互性，还可以采集操作体的语音命令，结合语音命令进行调整投影内容，在采集第一操作体在第一操作区域内进行交互操作时的第一视频影像时，还可采集第一操作体的第一语音命令，以及在采集第二操作体在第二操作区域内进行交互操作时的第二视频影像时，还可以采集所述第二操作体的第二语音命令。步骤S306具体为：根据第一映射位置、第一操作动作、第二映射位置和第二操作动作，并结合第一语音命令和第二语音命令，调整投影图像。Further, in order to improve the interactivity of the interactive projection, the voice command of the operation body may be collected, and the projection content is adjusted in combination with the voice command, and the first video image when the first operation body performs the interaction operation in the first operation area is collected. And acquiring a first voice command of the first operating body, and collecting a second video image of the second operating body when acquiring the second video image when the second operating body performs the interaction operation in the second operating area Voice command. Step S306 is specifically: adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, in combination with the first voice command and the second voice command.
在本发明实施方式中，采集第一操作体的第一视频影像，以及第二操作的第二视频影像，根据第一视频影像识别出第一操作动作和第一视频位置，根据第二视频影像识别出第二操作动作和第二视频位置，根据第一视频位置所映射的第一映射位置、第一操作动作、第二视频位置所映射的第二映射位置和第二操作动作调整投影图像，实现两个操作体在 不同操作区域对投影图像进行操作，进而实现多互动投影。In the embodiment of the present invention, the first video image of the first operating body and the second video image of the second operation are collected, and the first operation action and the first video position are identified according to the first video image, according to the second video image. Identifying the second operation action and the second video position, and adjusting the projection image according to the first mapping position mapped by the first video position, the first operation action, the second mapping position mapped by the second video position, and the second operation action, Realize two operating bodies in The different operating areas operate on the projected image to achieve multiple interactive projections.
以上所述仅为本发明的实施方式，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。 The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Claims (10)

  1. 一种多互动投影的系统，其特征在于，包括处理器、投影仪、第一视频采集装置和第二视频采集装置，所述处理器分别与投影仪、第一视频采集装置和第二视频采集装置连接；A multi-interaction projection system, comprising: a processor, a projector, a first video capture device, and a second video capture device, wherein the processor is respectively connected to the projector, the first video capture device, and the second video capture device Device connection
    所述投影仪，用于接收所述处理器发送的投影图像，并投射所述投影图像；The projector is configured to receive a projection image sent by the processor, and project the projection image;
    所述第一视频采集装置，用于采集第一操作体在第一操作区域内进行交互操作时的第一视频影像；The first video capture device is configured to collect a first video image when the first operation body performs an interaction operation in the first operation area;
    所述第二视频采集装置，用于采集第二操作体在第二操作区域内进行交互操作时的第二视频影像，其中，所述第一视频影像和第二视频影像中各个像素点的位置与投影图像的各个像素点的位置具有映射关系；The second video capture device is configured to collect a second video image when the second operation body performs an interaction operation in the second operation area, where the positions of the pixels in the first video image and the second video image are Mapping with the position of each pixel of the projected image;
    所述处理器，用于：The processor is configured to:
    根据所述第一视频影像，识别所述第一操作体所进行的第一操作动作，以及所述第一操作动作位于所述第一视频影像中的第一视频位置；Identifying, according to the first video image, a first operation performed by the first operating body, and the first operating action is located at a first video position in the first video image;
    获取所述投影图像中与所述第一视频位置相映射的第一映射位置；Obtaining a first mapping location in the projected image that is mapped to the first video location;
    根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作，以及所述第二动作操作位于所述第二视频影像中的第二视频位置；Identifying, according to the second video image, a second operation performed by the second operating body, and the second action operation being located at a second video position in the second video image;
    获取所述投影图像中与所述第二视频位置相映射的第二映射位置；Obtaining a second mapping location in the projected image that is mapped to the second video location;
    根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像，并向所述投影仪发送调整后的投影图像，以使 所述投影仪投射所述调整后的投影图像。Adjusting the projection image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, and transmitting the adjusted projection image to the projector, so that The projector projects the adjusted projected image.
  2. 根据权利要求1所述的系统，其特征在于，The system of claim 1 wherein:
    所述处理器根据所述第一视频影像，识别所述第一操作体所进行的第一操作动作的步骤包括：The step of the processor identifying the first operation performed by the first operating body according to the first video image includes:
    根据图像差分算法，将所述第一视频影像中连续的两帧图像进行相减处理，得到所述第一操作体的运动数据，并识别所述第一操作体的运动数据所对应的第一操作动作；Performing subtraction processing on two consecutive frames of the first video image according to the image difference algorithm to obtain motion data of the first operating body, and identifying the first corresponding to the motion data of the first operating body Operational action
    所述处理器根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作的步骤包括：The step of the processor identifying the second operation performed by the second operating body according to the second video image includes:
    根据所述图像差分算法，将所述第二视频影像中连续的两帧图像进行相减处理，得到所述第二操作体的运动数据，识别所述第二操作体的运动数据所对应的第二操作动作。Performing subtraction processing on two consecutive frames of the second video image according to the image difference algorithm to obtain motion data of the second operating body, and identifying a motion corresponding to the motion data of the second operating body Second operation action.
  3. 根据权利要求1所述的系统，其特征在于，The system of claim 1 wherein:
    所述处理器根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：The step of the processor adjusting the projected image according to the first mapping position, the first operating action, the second mapping position, and the second operating action includes:
    根据所述第一操作动作，识别第一操作指令，识别所述投影图像中与所述第一映射位置相对应的第一被操作对像，对所述第一被操作对像，执行所述第一操作指令所指示的操作，Identifying, according to the first operation action, a first operation instruction, identifying a first operated object corresponding to the first mapping position in the projected image, and performing the performing on the first operated object The operation indicated by the first operation instruction,
    以及，as well as,
    根据所述第二操作动作，识别第二操作指令，识别所述投影图像中与所述第二映射位置相对应的第二被操作对像，对所述第二被操作对像，执行所述第二操作指令所指示的操作，并根据所述执行的操作，调 整投影图像。Determining, according to the second operation action, a second operation instruction, identifying a second operated object corresponding to the second mapping position in the projected image, and performing the performing on the second operated object The operation indicated by the second operation instruction, and according to the operation performed Whole projection image.
  4. 根据权利要求1所述的系统，其特征在于，所述系统还包括第一语音采集装置和第二语音采集装置；The system of claim 1 wherein said system further comprises a first voice collection device and a second voice collection device;
    所述第一语音采集装置，用于采集所述第一操作体在第一操作区域内进行交互操作时发出的第一语音命令；The first voice collection device is configured to collect a first voice command that is sent when the first operation body performs an interaction operation in the first operation area;
    所述第二语音采集装置，用于采集所述第一操作体在第二操作区域内进行交互操作时发出的第二语音命令；The second voice collection device is configured to collect a second voice command that is sent when the first operation body performs an interaction operation in the second operation area;
    所述处理器根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作，并结合所述第一语音命令和第二语音命令，调整所述投影图像。The step of the processor adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, according to the first mapping position, the first operation action, and the second Mapping the position and the second operational action, and adjusting the projected image in conjunction with the first voice command and the second voice command.
  5. 根据权利要求1所述的系统，其特征在于，The system of claim 1 wherein:
    所述第一视频采集装置和第二视频采集装置均为配置有电荷耦合元件CCD或互补金属氧化物半导体CMOS的摄像设备。The first video capture device and the second video capture device are both imaging devices configured with a charge coupled device CCD or a complementary metal oxide semiconductor CMOS.
  6. 根据权利要求1所述的系统，其特征在于，The system of claim 1 wherein:
    所述投影仪为具有变焦功能的数字光处理DLP微型投影设备。The projector is a digital light processing DLP microprojection device with a zoom function.
  7. 一种多互动投影的方法，其特征在于，包括：A method for multiple interactive projection, characterized in that it comprises:
    在投影仪投射投影图像后，采集第一操作体在第一操作区域内进行交互操作时的第一视频影像，以及采集第二操作体在第二操作区域内进行交互操作时的第二视频影像，所述第一视频影像和第二视频影像中各个像素点的位置与投影图像的各个像素点的位置具有映射关系；After the projection image is projected by the projector, the first video image when the first operation body performs the interaction operation in the first operation area, and the second video image when the second operation body performs the interaction operation in the second operation area are collected. The position of each pixel in the first video image and the second video image has a mapping relationship with the position of each pixel of the projected image;
    根据所述第一视频影像，识别所述第一操作体所进行的第一操作动 作，以及所述第一操作动作位于所述第一视频影像中的第一视频位置；Identifying, according to the first video image, a first operation performed by the first operating body And the first operation action is located at a first video position in the first video image;
    获取所述投影图像中与所述第一视频位置相映射的第一映射位置；Obtaining a first mapping location in the projected image that is mapped to the first video location;
    根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作，以及所述第二动作操作位于所述第二视频影像中的第二视频位置；Identifying, according to the second video image, a second operation performed by the second operating body, and the second action operation being located at a second video position in the second video image;
    获取所述投影图像中与所述第二视频位置相映射的第二映射位置；Obtaining a second mapping location in the projected image that is mapped to the second video location;
    根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像。The projected image is adjusted according to the first mapping position, the first operation action, the second mapping position, and the second operation action.
  8. 根据权利要求7所述的方法，其特征在于，The method of claim 7 wherein:
    所述根据所述第一视频影像，识别所述第一操作体所进行的第一操作动作的步骤包括：The step of identifying the first operation performed by the first operating body according to the first video image includes:
    根据图像差分算法，将所述第一视频影像中连续的两帧图像进行相减处理，得到所述第一操作体的运动数据，并识别所述第一操作体的运动数据所对应的第一操作动作；Performing subtraction processing on two consecutive frames of the first video image according to the image difference algorithm to obtain motion data of the first operating body, and identifying the first corresponding to the motion data of the first operating body Operational action
    所述根据所述第二视频影像，识别所述第二操作体所进行的第二操作动作的步骤包括：The step of identifying the second operation performed by the second operating body according to the second video image includes:
    根据所述图像差分算法，将所述第二视频影像中连续的两帧图像进行相减处理，得到所述第二操作体的运动数据，识别所述第二操作体的运动数据所对应的第二操作动作。Performing subtraction processing on two consecutive frames of the second video image according to the image difference algorithm to obtain motion data of the second operating body, and identifying a motion corresponding to the motion data of the second operating body Second operation action.
  9. 根据权利要求7所述的方法，其特征在于，The method of claim 7 wherein:
    所述根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：The step of adjusting the projected image according to the first mapping position, the first operating action, the second mapping position, and the second operating action includes:
    根据所述第一操作动作，识别第一操作指令，识别所述投影图像中 与所述第一映射位置相对应的第一被操作对像，对所述第一被操作对像，执行所述第一操作指令所指示的操作，Identifying, according to the first operation action, a first operation instruction, identifying the projected image Performing, by the first operated object corresponding to the first mapping position, an operation indicated by the first operation instruction on the first operated object,
    以及，as well as,
    根据所述第二操作动作，识别第二操作指令，识别所述投影图像中与所述第二映射位置相对应的第二被操作对像，对所述第二被操作对像，执行所述第二操作指令所指示的操作，并根据所述执行的操作，调整投影图像。Determining, according to the second operation action, a second operation instruction, identifying a second operated object corresponding to the second mapping position in the projected image, and performing the performing on the second operated object The second operation instruction instructs the operation, and adjusts the projected image according to the performed operation.
  10. 根据权利要求7所述的方法，其特征在于，The method of claim 7 wherein:
    在所述采集第一操作体在第一操作区域内进行交互操作时的第一视频影像时，所述方法还包括采集所述第一操作体的第一语音命令；The method further includes collecting a first voice command of the first operating body when the first video image is obtained when the first operating body is in the first operating region;
    在所述采集第二操作体在第二操作区域内进行交互操作时的第二视频影像时，所述方法还包括采集所述第二操作体的第二语音命令；The method further includes collecting a second voice command of the second operator when the second video image is obtained when the second operating body performs the interaction operation in the second operation area;
    根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作调整所述投影图像的步骤包括：The step of adjusting the projected image according to the first mapping position, the first operating action, the second mapping position, and the second operating action comprises:
    根据所述第一映射位置、第一操作动作、第二映射位置和第二操作动作，并结合所述第一语音命令和第二语音命令，调整所述投影图像。 And adjusting the projected image according to the first mapping position, the first operation action, the second mapping position, and the second operation action, in combination with the first voice command and the second voice command.
PCT/CN2016/083257 2015-11-20 2016-05-25 Multi-interactive projection system and method WO2017084286A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510811560.XA CN105446623A (en) 2015-11-20 2015-11-20 Multi-interaction projection method and system
CN201510811560.X 2015-11-20

Publications (1)

Publication Number Publication Date
WO2017084286A1 true WO2017084286A1 (en) 2017-05-26

Family

ID=55556890

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/083257 WO2017084286A1 (en) 2015-11-20 2016-05-25 Multi-interactive projection system and method

Country Status (2)

Country Link
CN (1) CN105446623A (en)
WO (1) WO2017084286A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113247007A (en) * 2021-06-22 2021-08-13 肇庆小鹏新能源投资有限公司 Vehicle control method and vehicle

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104699240B (en) * 2015-02-09 2018-01-23 联想(北京)有限公司 A kind of control method and electronic equipment
CN105446623A (en) * 2015-11-20 2016-03-30 广景视睿科技（深圳）有限公司 Multi-interaction projection method and system
CN106055092A (en) * 2016-05-18 2016-10-26 广景视睿科技（深圳）有限公司 Method and system for implementing interactive projection
CN106095098A (en) * 2016-06-07 2016-11-09 深圳奥比中光科技有限公司 Body feeling interaction device and body feeling interaction method
CN106293346A (en) * 2016-08-11 2017-01-04 深圳市金立通信设备有限公司 The changing method of a kind of virtual reality what comes into a driver's and terminal

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101872241A (en) * 2009-04-26 2010-10-27 艾利维公司 Set up the method and system of the network game communal space
CN101995943A (en) * 2009-08-26 2011-03-30 介面光电股份有限公司 Three-dimensional image interactive system
CN103176733A (en) * 2011-12-20 2013-06-26 西安天动数字科技有限公司 Electronic interactive aquarium system
CN105446623A (en) * 2015-11-20 2016-03-30 广景视睿科技（深圳）有限公司 Multi-interaction projection method and system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8749557B2 (en) * 2010-06-11 2014-06-10 Microsoft Corporation Interacting with user interface via avatar
CN103218058A (en) * 2012-01-18 2013-07-24 北京德信互动网络技术有限公司 Human-machine interaction system and method based on projection technology
CN103455141B (en) * 2013-08-15 2016-07-06 无锡触角科技有限公司 The calibration steps of interactive projection system and depth transducer and projector
CN203930308U (en) * 2014-05-15 2014-11-05 上海味寻信息科技有限公司 A kind of novel interactive projector
CN104217619B (en) * 2014-09-19 2017-05-17 广东建业显示信息技术有限公司 Multi-user dance teaching interactive projection device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101872241A (en) * 2009-04-26 2010-10-27 艾利维公司 Set up the method and system of the network game communal space
CN101995943A (en) * 2009-08-26 2011-03-30 介面光电股份有限公司 Three-dimensional image interactive system
CN103176733A (en) * 2011-12-20 2013-06-26 西安天动数字科技有限公司 Electronic interactive aquarium system
CN105446623A (en) * 2015-11-20 2016-03-30 广景视睿科技（深圳）有限公司 Multi-interaction projection method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113247007A (en) * 2021-06-22 2021-08-13 肇庆小鹏新能源投资有限公司 Vehicle control method and vehicle

Also Published As

Publication number Publication date
CN105446623A (en) 2016-03-30

Similar Documents

Publication Publication Date Title
WO2017084286A1 (en) Multi-interactive projection system and method
US11860511B2 (en) Image pickup device and method of tracking subject thereof
US9270941B1 (en) Smart video conferencing system
JP2013257686A5 (en)
JP2019135879A (en) Preview image display method and device, and terminal
US8941706B2 (en) Image processing for a dual camera mobile device
CN104777991B (en) A kind of remote interaction optical projection system based on mobile phone
WO2016029641A1 (en) Photograph acquisition method and apparatus
CN106600548B (en) Fisheye camera image processing method and system
WO2016070688A1 (en) Remote control method and system for virtual operation interface
JP5612774B2 (en) Tracking frame initial position setting device and operation control method thereof
JP6057570B2 (en) Apparatus and method for generating stereoscopic panoramic video
TWI547177B (en) Viewing Angle Switching Method and Camera Therefor
JP2013257686A (en) Projection type image display apparatus, image projecting method, and computer program
US20130202158A1 (en) Image processing device, image processing method, program and recording medium
TW201024908A (en) Panoramic image auto photographing method of digital photography device
WO2017197779A1 (en) Method and system for implementing interactive projection
JP2014138275A (en) Imaging apparatus, remote operation terminal, camera system, method and program for controlling the imaging apparatus, and method and program for controlling the remote operation terminal
WO2014185169A1 (en) Image processing device, image processing method, and program
CN203966055U (en) Wireless interaction optical projection system
TWI451344B (en) Gesture recognition system and method
TW201414307A (en) Conference terminal and video processing method thereof
KR100660137B1 (en) Input apparatus using a raser pointer and system for offering presentation using the apparatus
KR102404130B1 (en) Device for transmitting tele-presence image, device for receiving tele-presence image and system for providing tele-presence image
KR101629324B1 (en) Multimedia device, multiple image sensors having different types and the method for controlling the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16865467

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 31.8.18)

122 Ep: pct application non-entry in european phase

Ref document number: 16865467

Country of ref document: EP

Kind code of ref document: A1