CN105892673A - Method for real-time interaction of audience with 3D stereoscopic program in cinema environment - Google Patents
Method for real-time interaction of audience with 3D stereoscopic program in cinema environment Download PDFInfo
- Publication number
- CN105892673A CN105892673A CN201610263888.7A CN201610263888A CN105892673A CN 105892673 A CN105892673 A CN 105892673A CN 201610263888 A CN201610263888 A CN 201610263888A CN 105892673 A CN105892673 A CN 105892673A
- Authority
- CN
- China
- Prior art keywords
- action
- spectators
- audiences
- speed
- audience
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
Abstract
The invention discloses a method for real-time interaction of audiences with a 3D stereoscopic program in a cinema environment. The method comprises the following steps: capturing infrared waves; acquiring video frames, and extracting video foreground by using a background difference algorithm; checking a foreground outline and performing connected domain processing; tracking a target by using a connected domain tracking method; in characteristic areas calibrated in camera imaging areas, according to the sequence that action of the audiences is captured among the characteristic areas, and the movement direction and the speed of action captured in the characteristic areas, of the audiences, recognizing action of the audiences; according to interaction plots and audience action recognition results, converting the movement direction and the speed of the action of the audience into a response action instruction, and inputting the action instruction into an action response program interface. The practical situation that the cinema environment is relatively poor in visibility and relatively large in audience number is sufficiently considered, and interaction of the audiences and the program content is achieved.
Description
Technical field
The present invention relates to the response of 3D digital three-dimensional film and interactive field, three-dimensional with 3D particularly to spectators under a kind of theatre environment
The method of programme content real-time interactive.
Background technology
The cinema of current main flow mainly plays 2D digital movie and 3D digital three-dimensional film.Development along with film entertainment technologies
With the requirement of casino market, dynamic cinema technology is arisen at the historic moment.Dynamic cinema, on the basis of 3D solid movie theatre, adds spectators' week
The various specially good effects in collarette border, the multidimensional seat of specialty and interactive game equipment, film plot combines the development of various special effects, makes
Spectators are obtained in that the omnibearing impressions such as vision, audition, sense of touch, olfactory sensation when watching the film of dynamic cinema, allow spectators' body
Face its border.But this dynamic cinema there is also some shortcomings, first, it is fewer that dynamic cinema generally can accommodate spectators, logical
The most only 20 to 30 people, are far smaller than viewing number while mainstream motion pictures institute；Second, the audience interaction of dynamic cinema is experienced
Mainly generated by specialty seat, the specially good effect prearranged and interactive game equipment, such as film occur CrossBones, corpse,
During shark, spectators can serve as the role of film, picks up stage property gun and they are shot dead, but this interaction mode cannot adapt to main
The environment of stream movie theatre, because in theatre environment, it is impossible to support the interaction of up to a hundred people.
Additionally, in addition to dynamic cinema, also have for amusement and the interaction mode of game, such as xbox and kinect etc..These
Conventional interaction mode uses motion capture equipment to catch the limb action of participant, then utilizes action recognition process side
Limb action is identified understanding by method.Some conventional interaction detection and implementation method also cannot adapt to the environment of movie theatre.This is
Because conventional interaction detection and implementation are primarily directed to as several little individualities, it is impossible to adapt to the interactive requirement of up to a hundred people.
Realize in the environment of visibility abundance it addition, common interaction detection and implementation are mainly, and at the viewing environment of movie theatre
In, visibility is relatively low, it is impossible to directly apply existing interactive approach.
Summary of the invention
The technical problem to be solved is to provide spectators and 3D solid programme content real-time interactive under a kind of theatre environment
Method, this method takes into full account the practical situation that in movie theatre viewing environment, visibility is poor, viewing number is relatively more, designs pin
Spectators' motion capture method to theatre environment, by action identification method based on template matching, the action building spectators understands
Model, the result understood for spectators' action, 3D solid program generates action response in real time, and real by large scene
Time Rendering present, it is achieved the real-time interactive under theatre environment.
For solving above-mentioned technical problem, the technical solution used in the present invention is:
Spectators and the method for 3D solid programme content real-time interactive under a kind of theatre environment, comprise the following steps:
Use the infrared waves on the infrared bracelet of cameras capture spectators；Obtain frame of video figure, use background difference algorithm to extract video
Prospect；By searching prospect profile and doing Connected area disposal$ the region in prospect is divided into some targets；Use connected domain is followed the tracks of
Method follow the tracks of target, preserve and followed the tracks of the track data of agglomerate；
The characteristic area demarcated in video camera imaging region, according to the order of the spectators' action captured between characteristic area, with
And the direction of motion of the spectators' action captured in characteristic area and speed, identify the action of spectators；
According to interactive plot and spectators' action recognition result, by the direction of motion of spectators' action and speed-shifting be response to the left,
To the right, upwards, downwards, forward, action command backward, these action commands are input in action response routine interface.
Further, the wavelength of the infrared waves of described cameras capture is 850nm/940nm.
Further, the method that is identified the action of spectators is particularly as follows: according to the change of spectators' action location of pixels in the picture
Change, solve the direction of motion and the speed of action,WithWherein, IHRepresent direction
Vector,WithRepresent t respectively1And t2The position of moment action, IVRepresent velocity magnitude, | | represent Euclidean distance fortune
Operator.
Further, also include 3D program generation step, i.e. according to the action command of input, call corresponding interactive clue,
Operation result is presented with 3D stereogenic.
Compared with prior art, the invention has the beneficial effects as follows:
(1) the inventive method has taken into full account the practical situation that theatre environment visibility is poor, viewing number is relatively more, it is achieved
Interaction between spectators and programme content, provides effective technical support for the multi-person interactive under large scene, thus is interactive
The universal of film is laid a good foundation.
(2), during the inventive method can be generalized to other application scenarios, shop etc., Ke Yishi are experienced in such as scientific exhibit shop, science popularization
The most people Interactive Experience simultaneously.
(3) the inventive method equipment needed thereby is simple, low cost, it is easy to be widely popularized.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of the method for spectators and 3D solid programme content real-time interactive under theatre environment of the present invention.
Fig. 2 is spectators and cameras capture infrared waves in the method for 3D solid programme content real-time interactive under theatre environment of the present invention
Schematic diagram.
Fig. 3 is spectators and motion detection trace flow in the method for 3D solid programme content real-time interactive under theatre environment of the present invention
Schematic diagram.
Fig. 4 is spectators and action recognition schematic diagram in the method for 3D solid programme content real-time interactive under theatre environment of the present invention.
Detailed description of the invention
The present invention is further detailed explanation with detailed description of the invention below in conjunction with the accompanying drawings.
Motion capture under the first step, low-visibility conditions
During motion picture projection, the illumination in movie theatre is all in the reflection light of closed mode, only screen, and visibility is poor.Therefore,
Utilize spectators to wear infrared bracelet, launch the infrared waves of 850nm/940nm wavelength, and before the camera lens of video camera, install filter additional,
The infrared waves only accepting 850nm/940nm wavelength pass through filter (as shown in Figure 2), thus are not affecting the situation of spectators' viewing
The lower rather dark environment of reduction, for the impact of video imaging quality, uses the multiple-camera demarcated to viewing area dividing simultaneously
The method gathering spectators' real-time action video, expands spectators' action imaging region in video significantly, improves action with this
The quality caught.
Concrete, each video camera method by background difference, the action of spectators is distinguished with surrounding, then passes through
The method that connected domain is followed the tracks of, it is achieved the tracking of action each to spectators, as shown in Figure 3.(1) infrared filtering: by shooting
The method installing filter at machine camera lens additional, the infrared waves transmission of the 850nm/940nm wavelength that infrared bracelet spectators worn is sent
Enter in video camera；(2) obtain foreground image: obtain frame of video figure, use background difference algorithm to extract video foreground；(3) inspection
Survey fresh target: by searching prospect profile and doing Connected area disposal$ the region in prospect is divided into some targets；(4) target with
Track: the method using connected domain to follow the tracks of follows the tracks of target, preserves the track data having followed the tracks of agglomerate.
Second step, action recognition
Change according to spectators' action location of pixels in the picture, solve the direction of motion and the speed of action.
In formula, IHRepresent direction vector,WithRepresent t respectively1And t2The position of moment action
Put, and | | represent Euclidean distance operator.
In formula, IVRepresent velocity magnitude,WithRepresent t respectively1And t2The position of moment action
Put, and | | represent Euclidean distance operator.
The characteristic area demarcated in video camera imaging region, according to capturing to obtain the order of spectators' action between characteristic area, with
And the direction of motion of the spectators' action captured in characteristic area and speed, the action to spectators is identified.It is exemplified below,
As shown in Figure 4.
According to spectators position at seat in movie theatre, it is achieved demarcated 7 pieces of regions, and numbered respectively from 1 to 7, in figure
Shown in square frame.Cameras capture to the infrared light that sends of bracelet, show as white border circular areas in the picture.When white hot spot
Occur in successively in square frame 1, square frame 2 and square frame 3, and solve judgement by above-mentioned speed and direction, the speed of hot spot
Size exceedes the threshold value being previously set, and direction is downward, then is considered as spectators and is doing the action waved downwards.
In hot spot occurs in square frame 4, square frame 5, square frame 1, square frame 6 and square frame 7 successively, and spot velocity is more than setting
Threshold value, and velocity attitude is to the right, then is considered as spectators and is doing the action waved to the right.By that analogy, by being previously set
The order of capturing motion between spectators' action and characteristic area, and the speed of action and direction, it is possible to realize under theatre environment
The identification of spectators' action.
3rd step, action real-time response
According to the interactive plot designed in advance and spectators' action recognition result, by the direction of motion and the speed-shifting of spectators' action
For response to the left, to the right, upwards, downwards, forward, the action command such as backward, these instructions are input to action response journey
In sequence interface.3D program generates program and inputs according to instruction, calls corresponding interactive clue, and result program run is with 3D
Stereogenic presents.
Claims (4)
1. spectators and the method for 3D solid programme content real-time interactive under a theatre environment, it is characterised in that comprise the following steps:
Use the infrared waves on the infrared bracelet of cameras capture spectators；Obtain frame of video figure, use background difference algorithm to extract video
Prospect；By searching prospect profile and doing Connected area disposal$ the region in prospect is divided into some targets；Use connected domain is followed the tracks of
Method follow the tracks of target, preserve and followed the tracks of the track data of agglomerate；
The characteristic area demarcated in video camera imaging region, according to the order of the spectators' action captured between characteristic area, with
And the direction of motion of the spectators' action captured in characteristic area and speed, identify the action of spectators；
According to interactive plot and spectators' action recognition result, by the direction of motion of spectators' action and speed-shifting be response to the left,
To the right, upwards, downwards, forward, action command backward, these action commands are input in action response routine interface.
2. spectators and the method for 3D solid programme content real-time interactive under theatre environment as claimed in claim 1, it is characterised in that
The wavelength of the infrared waves of described cameras capture is 850nm/940nm.
3. spectators and the method for 3D solid programme content real-time interactive under theatre environment as claimed in claim 1 or 2, its feature exists
In, method that the action of spectators is identified particularly as follows: according to the change of spectators' action location of pixels in the picture, solution is set out
The direction of motion made and speed,WithWherein, IHRepresent direction vector,
WithRepresent t respectively1And t2The position of moment action, IVRepresent velocity magnitude, | | represent Euclidean distance operator.
4. spectators and the method for 3D solid programme content real-time interactive under theatre environment as claimed in claim 3, it is characterised in that
Also include 3D program generation step, i.e. according to the action command of input, call corresponding interactive clue, by operation result with 3D
Stereogenic presents.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610263888.7A CN105892673A (en) | 2016-04-26 | 2016-04-26 | Method for real-time interaction of audience with 3D stereoscopic program in cinema environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610263888.7A CN105892673A (en) | 2016-04-26 | 2016-04-26 | Method for real-time interaction of audience with 3D stereoscopic program in cinema environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105892673A true CN105892673A (en) | 2016-08-24 |
Family
ID=56704675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610263888.7A Pending CN105892673A (en) | 2016-04-26 | 2016-04-26 | Method for real-time interaction of audience with 3D stereoscopic program in cinema environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105892673A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110493642A (en) * | 2019-07-23 | 2019-11-22 | 天脉聚源(杭州)传媒科技有限公司 | A kind of virtual interactive event watching method, system, device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201332447Y (en) * | 2008-10-22 | 2009-10-21 | 康佳集团股份有限公司 | Television for controlling or operating game through gesture change |
| CN102360247A (en) * | 2011-10-09 | 2012-02-22 | 长沙学院 | Finger mouse for identifying space actions |
| CN103150579A (en) * | 2013-02-25 | 2013-06-12 | 东华大学 | Abnormal human behavior detecting method based on video sequence |
| CN103927001A (en) * | 2013-01-14 | 2014-07-16 | 马克西姆综合产品公司 | System and method for discerning complex gestures using an array of optical sensors |
-
2016
- 2016-04-26 CN CN201610263888.7A patent/CN105892673A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201332447Y (en) * | 2008-10-22 | 2009-10-21 | 康佳集团股份有限公司 | Television for controlling or operating game through gesture change |
| CN102360247A (en) * | 2011-10-09 | 2012-02-22 | 长沙学院 | Finger mouse for identifying space actions |
| CN103927001A (en) * | 2013-01-14 | 2014-07-16 | 马克西姆综合产品公司 | System and method for discerning complex gestures using an array of optical sensors |
| CN103150579A (en) * | 2013-02-25 | 2013-06-12 | 东华大学 | Abnormal human behavior detecting method based on video sequence |
Non-Patent Citations (1)
| Title |
|---|
| 徐姗姗等: "基于连通域合并的多运动目标跟踪", 《第十四届全国信号处理学术年会(CCSP-2009)论文集》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110493642A (en) * | 2019-07-23 | 2019-11-22 | 天脉聚源(杭州)传媒科技有限公司 | A kind of virtual interactive event watching method, system, device and storage medium |
| CN110493642B (en) * | 2019-07-23 | 2023-11-17 | 北京拉近众博科技有限公司 | Virtual interactive viewing method, system, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11019283B2 (en) | Augmenting detected regions in image or video data | |
| CN108986189B (en) | Method and system for capturing and live broadcasting of real-time multi-person actions based on three-dimensional animation | |
| US9710972B2 (en) | Immersion photography with dynamic matte screen | |
| US8922718B2 (en) | Key generation through spatial detection of dynamic objects | |
| CN102221887B (en) | Interactive projection system and method | |
| CN105765959B (en) | Method and system for producing video works | |
| US20170134714A1 (en) | Device and method for creating videoclips from omnidirectional video | |
| US20180225852A1 (en) | Apparatus and method for generating best-view image centered on object of interest in multiple camera images | |
| US11514654B1 (en) | Calibrating focus/defocus operations of a virtual display based on camera settings | |
| EP1889471A1 (en) | Method, apparatus and system for alternate image/video insertion | |
| CN106331521A (en) | Film and television production system based on combination of network virtual reality and real shooting | |
| CN111726518A (en) | System for capturing images and camera device | |
| Sabirin et al. | Toward real-time delivery of immersive sports content | |
| CN114173021B (en) | Virtual broadcasting method and system based on high-definition multi-screen | |
| US11328436B2 (en) | Using camera effect in the generation of custom synthetic data for use in training an artificial intelligence model to produce an image depth map | |
| JP2015537417A (en) | Video processing device using difference camera | |
| CN105892673A (en) | Method for real-time interaction of audience with 3D stereoscopic program in cinema environment | |
| Harrison et al. | Pseudo-3d video conferencing with a generic webcam | |
| Hashimoto et al. | Generation of see-through baseball movie from multi-camera views | |
| JP2005223487A (en) | Digital camera work apparatus, digital camera work method, and digital camera work program | |
| Maruhashi et al. | A method for identification of moving objects by integrative use of a camera and accelerometers | |
| Liang et al. | Video2Cartoon: Generating 3D cartoon from broadcast soccer video | |
| Kasuya et al. | Automatic player's view generation of real soccer scenes based on trajectory tracking | |
| JP2005182402A (en) | Field area detection method, system therefor and program | |
| Lashkia et al. | A team play analysis support system for soccer games |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160824 |