CN103533445B - Flying theater playing system based on active interaction - Google Patents
Flying theater playing system based on active interaction Download PDFInfo
- Publication number
- CN103533445B CN103533445B CN201310517394.3A CN201310517394A CN103533445B CN 103533445 B CN103533445 B CN 103533445B CN 201310517394 A CN201310517394 A CN 201310517394A CN 103533445 B CN103533445 B CN 103533445B
- Authority
- CN
- China
- Prior art keywords
- film
- interaction
- spectators
- mutual
- interactive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The invention discloses a flying theater playing system based on active interaction. The flying theater playing system has the advantages of simpleness, convenience, easy operation and the like; users do not need additional learning and training, and can interact with a story through common and natural ways such as waving, shouting and the like, so that a stronger and more natural immersive user experience can be created, and the entertainment, funniness and sense of reality of a film can be increased; the flying theater playing system does not require an additional capture device and can directly use a monitoring infrared camera and a microphone in a theater as interactive capture devices, so that hardware resources can be fully used, the device expense is not brought to the theater and the realistic experience of the theater can be improved.
Description
Technical field
The present invention relates to a kind of movie theatre Play System that circles in the air based on initiatively mutual.
Background technology
In recent years, the development of China theme park is very swift and violent, from the eighties in 20th century so far, 2500, formula tourist spot, theme park is totally developed in the whole nation, infusion of financial resources reaches more than 3,000 hundred million yuan.4D movie theatre is a project common in theme park.
4D movie theatre is on the basis of 3D three-dimensional film, to introduce environmental effects analog simulation and the novel video display product that forms, i.e. the space of thinking of three-dimensional three-dimensional film and surrounding environment simulation composition.Spectators are in the time appreciating three-dimensional film, according to the variation of substance film, can experience in real time wind, rain, thunder, electricity, clash into, pat the event corresponding with stereopsis that occurred that wait at one's side, 4D seat has water spray, jet, vibration, sweep the functions such as leg, environmental simulation emulation refers in movie theatre and is provided with and snows, rain, lightning, the special effect devices such as smog, build a kind of environment consistent with substance film, by giving spectators the physical stimulation with movie contents interlock, strengthen the effect of telepresenc, spectators can comprehensive impression from vision, the sense of hearing, the fresh stimulation that sense of touch brings.
Along with the continuous increase of spectators' amusement demand and the continuous progress of technology, huge curtain vault screen cinema is favored gradually.Different from 4D movie theatre, what huge curtain vault screen cinema showed is 2D image, but also can allow spectators well experience the feeling of immersion of vision, can easily allow spectators be dissolved in the atmosphere of film.But, no matter be 4D movie theatre or huge curtain vault screen cinema, do not support the feedback that spectators are mutual.
The movie theatre that circles in the air is a kind of emerging special efficacy amusement film, spectators take by the lifting seat of big machinery system control to movie theatre center in the air, high-definition digital projector projects huge hemisphere screen by extraordinary fish eye lens by picture, sight line region from the spectators crown to underfooting is all surrounded completely by grand mute, in fully experiencing extremely powerful ball curtain movie and television contents, the stimulation impression of the unsettled flight that can also undergo.Except reaching the effect of 4D movie theatre, huge curtain vault screen cinema, also can add on this basis the telegraphy interactive devices such as simulated flight mechanism, allow spectators at the environment experience of safety to circling in the air, interactive recreation texts.But the current movie theatre that circles in the air only offers spectators' telegraphy and experiences, spectators still can not carry out the mutual or control story of a play or opera with the story of a play or opera.
At present, the problem existing in movie theatre of circling in the air is mainly manifested in:
1. the cinema system technology of circling in the air production domesticization is not enough, import dependency degree is high;
2. circle in the air in movie theatre and lack opening and interactivity, though telegraphy interactive device is provided, only offers spectators' telegraphy and experience, be still alternately one-side, spectators can not be with the story of a play or opera mutual or control role;
3. circle in the air movie theatre as a kind of special screne, real-time and interactivity are had to very high requirement, itself brought huge challenge alternately, principal element comprises:
(1) noisy, the dim environment of movie theatre, the accuracy that severe jamming is mutual;
(2) identification of group behavior interactive instruction in movie theatre.
Summary of the invention
The object of invention is exactly in order to address the above problem, and a kind of movie theatre Play System that circles in the air based on initiatively mutual is provided.This system has simply, the advantage such as convenient, easy to operate, by the natural interactive style of colony's voice and gesture in public arena, realize a class and circle in the air in movie theatre user by voice and gesture and story of a play or opera interaction, carry out story of a play or opera selection or control, do not need the extra learning training of user, user can be by common natural way and the story of a play or opera interaction such as waving, shout, and creation can allow the more natural immersion more by force that user experiences experience, and increases recreational, interest and the sense of reality of film.And, this system does not need extra capture device, can directly utilize monitoring infrared camera in movie theatre and microphone as mutual capture device, can make full use of hardware resource, not only can not bring cost of device to movie theatre, the sense of reality that can also increase movie theatre is experienced.
To achieve these goals, the present invention adopts following technical scheme:
Based on the initiatively mutual movie theatre Play System that circles in the air, comprise film preprocessing subsystem and the movie subsystem based on initiatively mutual; Wherein, comprise playing module, interaction feature trapping module, resolve external file module and touch-screen based on the mutual movie subsystem of active; Film preprocessing subsystem comprises the interactive information generation module relevant to substance film and configuration file generation module;
Described interactive information generation module, comprises interactive mode generation module and interaction locations and film mapping block, wherein:
Interactive mode generation module, is connected with film mapping block with interaction locations, according to different substance films, different film beholder, generates different interactive modes, has avoided all changeless defects of interactive mode of all films, all beholders;
Interaction locations and film mapping block, according to film plot, different interaction locations is set, interaction times is not subject to the restriction of system, generate as required different mutual numbers, corresponding two scheduling parameter of each interaction locations, set up and the mapping of dispatching film by scheduling parameter, communicate by letter with configuration file generation module;
Configuration file generation module, for storing mutual film information, the alternately mapping of key frame positional information, mutual frame and scheduling film and the information of scheduling film, with parsing external file module communication;
Playing module, for providing movie medium, with touch-screen two-way communication;
Interaction feature trapping module, with touch-screen two-way communication, be used for obtaining user profile, and identify colony's user behavior, after analyzing spectators individual instruction collection, system to individual instruction set analyze, adopt method based on statistics to obtain the general character of individual instruction, be group interaction instruction, for controlling the developing direction of film plot;
Resolve external file module, the interaction feature that reception interaction feature trapping module is caught, the storage information of configuration file generation module, with touch-screen two-way communication, complete the interaction of spectators and substance film;
Touch-screen, receives spectators' program request, the requirement of watching, with playing module, interaction feature trapping module, parsing external file module, interactive information generation module and the two-way communication of configuration file generation module.
Described playing module comprises video player, sound equipment, projector and screen.
Described interaction feature trapping module comprises infrared camera and microphone apparatus.
Based on the Interactive control method of the above-mentioned movie theatre Play System that circles in the air, comprise the following steps:
(1) configuration file is set: Moviemaking person completes the setting to configuration file by film preprocessing subsystem;
(2) open interaction feature trapping module: utilize user profile capture device: infrared camera and microphone apparatus, image, action and the acoustic information set of catching spectators;
(3) open playing module: by touch-screen, the film of watching is wanted in spectators' selection, opens video player, the synchronous trigger of resolving external file module that starts;
(4) whether trigger Real-Time Monitoring reaches the interaction locations that video file is corresponding, if do not arrive interaction locations, continues displaying video; If arrival interaction locations, player starts to carry out alternately by voice and captions prompting user;
(5) select interactive mode: movie theatre keeper can determine whether to carry out mutual and select which kind of interactive mode according to actual conditions, if do not carried out alternately, continues to play selected video, since then, treats that video playback is complete, and whole reciprocal process is complete; Otherwise need to select interactive mode, interactive mode has three kinds, is respectively: gesture interaction, interactive voice and multichannel are mutual;
(6) mutual if step 5 is selected to proceed, the interactive information that the interactive mode of selecting according to keeper is caught user, according to the broadcasting speed of interactive information adjustment video;
(7) player, according to the speed displaying video after adjusting, treats that video playback is complete, and whole reciprocal process is complete.
The gesture feature extracting method of infrared camera in described step (2), specifically comprises the following steps:
(2-1) background extraction image;
(2-2) infrared camera is caught image in real time, and and step 2-1 in the background image that obtains carry out calculus of differences: if difference is greater than the threshold value setting in advance, think that difference synthetic image is foreground image, i.e. spectators' gesture; If difference is not more than the threshold value setting in advance, think that spectators' mutual effect is not ideal enough, ignore the image of now catching, recapture image also carries out calculus of differences, and this process circulates always until difference is greater than the threshold value setting in advance;
(2-3) foreground image is carried out to morphology processing, comprise dilation and erosion operation, object is the assorted point of eliminating in foreground image;
(2-4) length of the individual arm of spectators in calculating interaction area, and set is analyzed to spectators' personal feature, the method of employing based on statistics obtains the general character of personal feature, it is group interaction feature, consider from system real time, system is using the average of all spectators' arm length as group interaction feature, thus the broadcasting that touches corresponding film.
In described step (2), Mike's subset extracts the method for phonetic feature, and concrete steps are:
(2-a) statistics background sound volume characteristics: obtain the background sound volume in film when Moviemaking;
(2-b) wave volume of microphones capture and background sound volume are carried out to additive operation, obtain spectators' wave volume, as with the mutual feature of film, thereby touch corresponding movie.
The specific implementation method of adjusting the broadcasting speed of video in described step (6) is:
(a) select gesture interaction, network infra red camera is caught spectators' arm length, adjusts the speed of video playback according to the length of arm;
(b), while selecting interactive voice, microphones capture spectators' yell, according to the speed of the volume adjustment video playback of hubbub;
(c) while selecting multichannel interactive mode, network infra red camera is caught spectators' arm length, and microphones capture spectators' hubbub obtains final mutual information data according to the predetermined weights of system, and adjusts the speed of video playback according to these data.
In described step (c), choosing of weights, is subject to the constraint of movie theatre scene, film, according to formula:
dim∈[0,1],vol∈[0,1]
Wherein ω
h, ω
vbe respectively the shared weights of spectators colony gesture and sound; Dim represents the dim degree of movie theatre scene, and dim numerical value is larger, illustrates that scene is more dim, and vice versa; Vol represents the wave volume of substance film, and vol numerical value is larger, illustrates that film self sound is larger, and vice versa; And dim, vol are normalized; a
1, a
2, b
1, b
2be the constant that is less than 1, be used for ensureing ω
h, ω
vbelong to the positive number that is less than 1.
The present invention can arrange different constraints according to different films, for single film design, all ineffective to any 4D film.
Operation principle of the present invention is: spectators enter after film scene, the film interactive information of editing according to Moviemaking person starts to play film, original seat that circles in the air is simulated corresponding film scene, spectators are progressively incorporated in film plot, at this moment according to the setting of film, voice and captions prompting spectators and substance film carry out interaction, and spectators can carry out interaction by mode and the film of brandishing arm, scream., resolve external file, and trigger the interaction of spectators and substance film, the scheduling that main manifestations is mutual film by infrared camera and microphones capture spectators gesture, voice messaging based on the mutual movie theatre Play System that circles in the air.
Beneficial effect of the present invention is:
1, directly utilize the watch-dog in movie theatre, make full use of existing hardware resource, do not bring extra-pay consumption, increased on the contrary recreational, interest and the sense of reality of movie theatre; For juvenile's science popularization film, can bring stronger experience effect.
The ability 2, with the behavior of identification group interaction, the interbehavior in movie theatre is no longer personal behavior, belongs to group behavior, the interaction feature that needs corresponding strategy analysis to catch, thus determine group behavior feature;
3, the advantage such as convenient, easy to operate, do not need the extra learning training of user, user can be by common natural way and the story of a play or opera interaction such as waving, shout, and creation can allow the more natural immersion more by force that user experiences experience, and increases recreational, interest and the sense of reality of film.
Brief description of the drawings
Fig. 1 is interactive movie theatre technology overall construction drawing;
Fig. 2 is interactive cinema system hardware composition structure chart;
Fig. 3 is film preprocessing subsystem structure chart;
Fig. 4 is the movie subsystem structure figure based on initiatively mutual;
Fig. 5 is interactive movie theatre operational flowchart;
Fig. 6 is the gesture feature extracting method based on infrared camera;
Fig. 7 is the Speech Feature Extraction based on microphone;
Fig. 8 is multichannel interactive mode flow chart.
Embodiment:
Below in conjunction with accompanying drawing and embodiment, the invention will be further described.
As shown in Figure 1, being a kind ofly mainly divided into two parts based on the mutual movie theatre Play System that circles in the air initiatively, is respectively film preprocessing subsystem and the movie subsystem based on initiatively mutual.
Moviemaking person, according to substance film, by film preprocessing subsystem, completes the location to film interaction locations, and sets up and dispatch the mapping relations of film, and the information that responds mutual film is stored in external file, is called configuration file;
Based on initiatively mutual movie subsystem, the ActiveX control that utilizes Windows MCI control and VC6.0 to carry is realized the broadcasting of film, importantly can respond spectators' interactive operation.Catch spectators' population hand attitude and phonetic feature based on the mutual movie subsystem of active by infrared camera and microphone apparatus, and show with the form of progress bar; Then by resolving the data in configuration file, complete spectators' interactive operation.
As shown in Figure 2, to encircle curtain as example, when fixing after annular screen, projector is arranged on the ceiling in movie theater or on wall, and Mei Liangtai projector is one group, composition one width stereoscopic picture plane, every group of horizontal view angle in screen is 60 degree, adopts the mounting means of stack up and down; Sound equipment is distributed in movie theatre wall surrounding, to cause shock sense on the spot in person.In order to ensure good viewing effect, spectators seat is arranged near the center of circle of arc screen.The microphone apparatus of catching spectators' interactive information is arranged on spectators' seat back or wall; Network infra red camera is arranged on spectators' upper front.
As shown in Figure 3, film preprocessing subsystem is mainly made up of interactive information generation module and configuration file generation module; Interactive information generation module can be divided into again interactive mode generation module and interaction locations and two parts of film mapping block:
(1) interactive mode generation module
According to the result of broadcast of on-the-spot movie theatre, Moviemaking person can select different interactive modes, comprises gesture interaction, interactive voice and multichannel interactive mode.
(2) interaction locations and film mapping block
According to substance film, Moviemaking person can arrange different interaction locations, and corresponding two scheduling parameter of each interaction locations, set up and the mapping of dispatching film by scheduling parameter; System, is determined by substance film without any constraint completely to the setting of interaction locations.
(3) configuration file generation module
In configuration file, deposit following information in: mutual film information, mutual key frame positional information, mutual frame and the mapping of scheduling film, the information of scheduling film; Configuration file adopts XML file format, is generated by configuration file generation module, is finally used by mutual movie sub system analysis.
As shown in Figure 4, comprise playing module, interaction feature trapping module, resolve external file module and touch-screen based on the mutual movie subsystem of active.
(1) playing module
There is the function of general player, comprise open, close, play, suspend, stop, the function such as full frame, progress monitoring, video information are checked.
(2) interaction feature trapping module
System selects infrared camera and microphone apparatus as interaction feature capture device.
Gesture interaction system based on vision is generally that computer obtains hand attitude information by image capture device, the single-frame static images of obtaining or multiple image sequence is carried out to Treatment Analysis, thereby judge user view, carries out alternately with user.But this method is affected by change of background, ambient lighting variation etc. easily, gesture performance changes larger, very complicated to the analysis of images of gestures, be difficult to ensure the real-time of interactive system, and under infrared visual condition, be subject to the interference of these factors smaller.Consider the factors such as movie theatre scene is noisy and dim, and consider the existence of supervisory control system in the movie theatre that circles in the air, the present invention makes full use of hardware resource, selects infrared camera as image capture device, obtains user's image information.
System, by infrared camera and microphones capture spectators' hand attitude and phonetic feature, because interbehavior in movie theatre belongs to group behavior, also needs the feature to catching to carry out group behavior analysis; For ensureing the real-time of system, adopt the mean value of all individualities as interaction feature, determine group behavior; In addition, also show spectators' interaction feature with progress bar and digital form on the right side of player, spectators can intuitively see the interactive information of colony.
(3) external file parsing module
Movie subsystem based on initiatively mutual is by resolving the data in configuration file, and the interaction feature obtaining according to interaction feature trapping module, triggers corresponding interactive operation, completes the interaction of spectators and substance film.
As shown in Figure 5, interactive movie theatre, except having the function of general player, the most important thing is to have introduced mutual control operation, and spectators can carry out interactive operation with substance film, embodies spectators' subjective initiative, and concrete operation step is as follows.
(1) configuration file is set, Moviemaking person completes by film preprocessing subsystem;
(2) open user profile capture device, infrared camera and microphone;
(3) open video player, and select played file;
(4) play selected video file, and synchronously start trigger;
(5) whether trigger Real-Time Monitoring reaches the interaction locations that video file is corresponding, if do not arrive interaction locations, continues displaying video; If arrival interaction locations, player starts to carry out alternately by voice and captions prompting user;
(6) whether keeper can determine to carry out mutual and select which kind of interactive mode according to actual conditions, if do not carried out alternately, continues to play selected video, since then, treats that video playback is complete, and whole reciprocal process is complete; Otherwise need to select interactive mode, interactive mode has three kinds, is respectively: gesture interaction, interactive voice and multichannel are mutual;
(7) mutual if step 6 is selected to proceed, the interactive information that the interactive mode of selecting according to keeper is caught user, according to the broadcasting speed of interactive information adjustment video; Concrete implementing method is: in the time selecting gesture interaction, network infra red camera is caught spectators' arm length, adjusts the speed of video playback according to the length of arm; In the time selecting interactive voice, microphones capture spectators' yell, according to the speed of the volume adjustment video playback of hubbub; When elected majority passage interactive mode, network infra red camera is caught spectators' arm length, and microphones capture spectators' hubbub obtains final mutual information data according to the predetermined weights of system, and adjusts the speed of video playback according to these data;
(8) player, according to the speed displaying video after adjusting, treats that video playback is complete, and whole reciprocal process is complete.
As shown in Figure 6, based on the Visual Tracking System of infrared camera, the video of catching is processed in real time, user's hand attitude is detected in real time, control corresponding interactive operation.System is mainly made up of video acquisition part and video processing part.
The emphasis of this part is under dim background, and the hand attitude of colony is extracted.
Gesture feature extracting method based on infrared camera, specific implementation process is:
(1) background extraction image;
(2) infrared camera is caught image in real time, and and the first step in the background image that obtains carry out calculus of differences: if difference is greater than the threshold value setting in advance, think that difference synthetic image is foreground image, i.e. spectators' gesture; If difference is not more than the threshold value setting in advance, think that spectators' mutual effect is not ideal enough, ignore the image of now catching, recapture image also carries out calculus of differences, and this process circulates always until difference is greater than the threshold value setting in advance;
(3) foreground image is carried out to morphology processing, mainly comprise dilation and erosion operation, object is the assorted point of eliminating in foreground image;
(4) calculate the length of spectators' arm in interaction area, and by the average of all spectators' arm length as hand attitude interaction feature, thereby touch corresponding movie.
As shown in Figure 7, the performance of speech recognition system is very easily subject to the impact of noise in environment, and particularly in movie theatre under noisy environment, and in actual environment, mostly noise is additive noise, and therefore in movie theatre, the difficulty of speech recognition strengthens.Consider the requirement of this special screne of movie theatre to real-time and the object of user interactions amusement, choose user's wave volume as phonetic feature, realize the object of user interactions amusement with simple phonetic feature.
Specific implementation process taking wave volume as feature:
(1) statistics background sound volume characteristics, is mainly the volume in film, in the time of Moviemaking, can obtain;
(2) wave volume of microphones capture and background sound volume are carried out additive operation, obtain spectators' wave volume, as with the mutual feature of film, thereby touch corresponding movie.
As shown in Figure 8: multichannel interactive mode has merged gesture interaction and two kinds of control modes of interactive voice; The weight of two kinds of interactive modes in system analysis configuration file, the feature of utilizing gesture interaction and interactive voice to obtain, then the method for weighted sum obtains new film velocity, thereby triggers the broadcasting of corresponding film.
By reference to the accompanying drawings the specific embodiment of the present invention is described although above-mentioned; but not limiting the scope of the invention; one of ordinary skill in the art should be understood that; on the basis of technical scheme of the present invention, those skilled in the art do not need to pay various amendments that creative work can make or distortion still in protection scope of the present invention.
Claims (7)
1. the movie theatre Play System that circles in the air based on initiatively mutual, is characterized in that: comprise film preprocessing subsystem and the movie subsystem based on initiatively mutual; Wherein, comprise playing module, interaction feature trapping module, resolve external file module and touch-screen based on the mutual movie subsystem of active; Film preprocessing subsystem comprises the interactive information generation module relevant to substance film and configuration file generation module;
Described interactive information generation module, comprises interactive mode generation module and interaction locations and film mapping block, wherein:
Interactive mode generation module, is connected with film mapping block with interaction locations, according to different substance films, different film beholder, generates different interactive modes, has avoided all changeless defects of interactive mode of all films, all beholders;
Interaction locations and film mapping block, according to film plot, different interaction locations is set, interaction times is not subject to the restriction of system, generate as required different mutual numbers, corresponding two scheduling parameter of each interaction locations, set up and the mapping of dispatching film by scheduling parameter, communicate by letter with configuration file generation module;
Configuration file generation module, for storing mutual film information, the alternately mapping of key frame positional information, mutual frame and scheduling film and the information of scheduling film, with parsing external file module communication;
Playing module, for providing movie medium, with touch-screen two-way communication;
Interaction feature trapping module, with touch-screen two-way communication, be used for obtaining user profile, and identify colony's user behavior, after analyzing spectators individual instruction collection, system to individual instruction set analyze, adopt method based on statistics to obtain the general character of individual instruction, be group interaction instruction, for controlling the developing direction of film plot;
Resolve external file module, the interaction feature that reception interaction feature trapping module is caught, the storage information of configuration file generation module, with touch-screen two-way communication, complete the interaction of spectators and substance film;
Touch-screen, receives spectators' program request, the requirement of watching, with playing module, interaction feature trapping module, parsing external file module, interactive information generation module and the two-way communication of configuration file generation module.
2. a kind of movie theatre Play System that circles in the air based on initiatively mutual as claimed in claim 1, is characterized in that: described playing module comprises video player, sound equipment, projector and screen.
3. a kind of movie theatre Play System that circles in the air based on initiatively mutual as claimed in claim 1, is characterized in that: described interaction feature trapping module comprises infrared camera and microphone apparatus.
4. an Interactive control method for the movie theatre Play System that circles in the air based on initiatively mutual based in claim 1-3 any one, is characterized in that: comprise the following steps:
(1) configuration file is set: Moviemaking person completes the setting to configuration file by film preprocessing subsystem;
(2) open interaction feature trapping module: utilize user profile capture device: infrared camera and microphone apparatus, image, action and the acoustic information set of catching spectators;
(3) open playing module: by touch-screen, the film of watching is wanted in spectators' selection, opens video player, the synchronous trigger of resolving external file module that starts;
(4) whether trigger Real-Time Monitoring reaches the interaction locations that video file is corresponding, if do not arrive interaction locations, continues displaying video; If arrival interaction locations, player starts to carry out alternately by voice and captions prompting user;
(5) select interactive mode: movie theatre keeper can determine whether to carry out mutual and select which kind of interactive mode according to actual conditions, if do not carried out alternately, continues to play selected video, since then, treats that video playback is complete, and whole reciprocal process is complete; Otherwise need to select interactive mode, interactive mode has three kinds, is respectively: gesture interaction, interactive voice and multichannel are mutual;
(6) mutual if step 5 is selected to proceed, the interactive information that the interactive mode of selecting according to keeper is caught user, according to the broadcasting speed of interactive information adjustment video;
(7) player, according to the speed displaying video after adjusting, treats that video playback is complete, and whole reciprocal process is complete; The specific implementation method of adjusting the broadcasting speed of video in described step (6) is:
(a) select gesture interaction, network infra red camera is caught spectators' arm length, adjusts the speed of video playback according to the length of arm;
(b), while selecting interactive voice, microphones capture spectators' yell, according to the speed of the volume adjustment video playback of hubbub;
(c) while selecting multichannel interactive mode, network infra red camera is caught spectators' arm length, and microphones capture spectators' hubbub obtains final mutual information data according to the predetermined weights of system, and adjusts the speed of video playback according to these data.
5. Interactive control method as claimed in claim 4, is characterized in that: the gesture feature extracting method of infrared camera in described step (2), specifically comprises the following steps:
(2-1) background extraction image;
(2-2) infrared camera is caught image in real time, and and step 2-1 in the background image that obtains carry out calculus of differences: if difference is greater than the threshold value setting in advance, think that difference synthetic image is foreground image, i.e. spectators' gesture; If difference is not more than the threshold value setting in advance, think that spectators' mutual effect is not ideal enough, ignore the image of now catching, recapture image also carries out calculus of differences, and this process circulates always until difference is greater than the threshold value setting in advance;
(2-3) foreground image is carried out to morphology processing, comprise dilation and erosion operation, object is the assorted point of eliminating in foreground image;
(2-4) calculate the length of spectators' arm in interaction area, and by the average of all spectators' arm length as hand attitude interaction feature, thereby touch corresponding movie.
6. Interactive control method as claimed in claim 4, is characterized in that: in described step (2), microphone apparatus extracts the method for phonetic feature, and concrete steps are:
(2-a) statistics background sound volume characteristics: obtain the background sound volume in film when Moviemaking;
(2-b) wave volume of microphones capture and background sound volume are carried out to additive operation, obtain spectators' wave volume, as with the mutual feature of film, thereby touch corresponding movie.
7. Interactive control method as claimed in claim 4, is characterized in that: in described step (c), choosing of weights, is subject to the constraint of movie theatre scene, film, according to formula:
dim∈[0,1],vol∈[0,1]
Wherein ω
h, ω
vbe respectively the shared weights of spectators colony gesture and sound; Dim represents the dim degree of movie theatre scene, and dim numerical value is larger, illustrates that scene is more dim, and vice versa; Vol represents the wave volume of substance film, and vol numerical value is larger, illustrates that film self sound is larger, and vice versa; And dim, vol are normalized; a
1, a
2, b
1, b
2be the constant that is less than 1, be used for ensureing ω
h, ω
vbelong to the positive number that is less than 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310517394.3A CN103533445B (en) | 2013-10-28 | 2013-10-28 | Flying theater playing system based on active interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310517394.3A CN103533445B (en) | 2013-10-28 | 2013-10-28 | Flying theater playing system based on active interaction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103533445A CN103533445A (en) | 2014-01-22 |
| CN103533445B true CN103533445B (en) | 2014-07-02 |
Family
ID=49935049
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310517394.3A Expired - Fee Related CN103533445B (en) | 2013-10-28 | 2013-10-28 | Flying theater playing system based on active interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103533445B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105792003A (en) * | 2014-12-19 | 2016-07-20 | 张鸿勋 | Interactive multimedia production system and method |
| US10249091B2 (en) * | 2015-10-09 | 2019-04-02 | Warner Bros. Entertainment Inc. | Production and packaging of entertainment data for virtual reality |
| CN107135399B (en) * | 2017-03-29 | 2019-10-01 | 网易传媒科技（北京）有限公司 | Interactive control method, equipment and the computer readable storage medium of video |
| CN110554766A (en) * | 2018-05-31 | 2019-12-10 | 柯刚铠 | Interaction method and vehicle-mounted interaction device |
| CN109333544B (en) * | 2018-09-11 | 2020-07-17 | 厦门大学 | Doll interaction method for marionette performance participated by audience |
| CN111163304B (en) * | 2019-12-27 | 2021-10-08 | 扬州哈工科创机器人研究院有限公司 | Method and device for fusing film and matrix mechanical unit |
| CN111479135A (en) * | 2020-06-01 | 2020-07-31 | 湖南快乐阳光互动娱乐传媒有限公司 | Method and device for controlling playing effect of video |
| CN113490048B (en) * | 2021-07-28 | 2023-06-27 | 广东金马游乐股份有限公司 | Dynamic video system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201168449Y (en) * | 2008-04-02 | 2008-12-24 | 宁波新文三维股份有限公司 | Interactive movie theatre |
| CN102671397A (en) * | 2012-04-16 | 2012-09-19 | 宁波新文三维股份有限公司 | Seven-dimensional cinema and interaction method thereof |
| CN103055524A (en) * | 2013-01-21 | 2013-04-24 | 上海恒润数码影像科技有限公司 | Positioning device, four-dimensional interactive cinema and interacting method utilizing same |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ES2544966T3 (en) * | 2009-06-22 | 2015-09-07 | Cinvolve Bvba | Method for an interactive digital cinema system |
-
2013
- 2013-10-28 CN CN201310517394.3A patent/CN103533445B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201168449Y (en) * | 2008-04-02 | 2008-12-24 | 宁波新文三维股份有限公司 | Interactive movie theatre |
| CN102671397A (en) * | 2012-04-16 | 2012-09-19 | 宁波新文三维股份有限公司 | Seven-dimensional cinema and interaction method thereof |
| CN103055524A (en) * | 2013-01-21 | 2013-04-24 | 上海恒润数码影像科技有限公司 | Positioning device, four-dimensional interactive cinema and interacting method utilizing same |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103533445A (en) | 2014-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103533445B (en) | Flying theater playing system based on active interaction | |
| Pavlik | Journalism in the age of virtual reality: How experiential media are transforming news | |
| CN106303555B (en) | A kind of live broadcasting method based on mixed reality, device and system | |
| WO2021114881A1 (en) | Intelligent commentary generation method, apparatus and device, intelligent commentary playback method, apparatus and device, and computer storage medium | |
| CN108933970A (en) | The generation method and device of video | |
| US20200035026A1 (en) | Techniques for immersive virtual reality experiences | |
| CN105049747B (en) | A kind of system for identifying still image and being converted to Dynamic Announce | |
| CN109333544B (en) | Doll interaction method for marionette performance participated by audience | |
| CN110472099B (en) | Interactive video generation method and device and storage medium | |
| CN109635616A (en) | Interactive approach and equipment | |
| JP2023501832A (en) | Realization method, apparatus and related products for lens division | |
| Artstein et al. | Time-offset interaction with a holocaust survivor | |
| CN113709543A (en) | Video processing method and device based on virtual reality, electronic equipment and medium | |
| CN110928416A (en) | Immersive scene interactive experience simulation system | |
| CN103324488A (en) | Method and device for obtaining special effect information | |
| CN113687720A (en) | Multi-person online virtual reality education system and use method thereof | |
| CN108052206B (en) | Video playing method and device and electronic equipment | |
| CN112843693B (en) | Method and device for shooting image, electronic equipment and storage medium | |
| CN111265851B (en) | Data processing method, device, electronic equipment and storage medium | |
| KR102200239B1 (en) | Real-time computer graphics video broadcasting service system | |
| CN202929567U (en) | Virtual character animation performance system | |
| CN204233735U (en) | A kind of 5D body sense interactive game device | |
| CN106331525A (en) | Realization method for interactive film | |
| CN113875227A (en) | Information processing apparatus, information processing method, and program | |
| CN102654955A (en) | Gesture-recognition-based interactive sand table system and application thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140702 Termination date: 20161028 |