CN101465957A - System for implementing remote control interaction in virtual three-dimensional scene - Google Patents
System for implementing remote control interaction in virtual three-dimensional scene Download PDFInfo
- Publication number
- CN101465957A CN101465957A CN 200810205010 CN200810205010A CN101465957A CN 101465957 A CN101465957 A CN 101465957A CN 200810205010 CN200810205010 CN 200810205010 CN 200810205010 A CN200810205010 A CN 200810205010A CN 101465957 A CN101465957 A CN 101465957A
- Authority
- CN
- China
- Prior art keywords
- scene
- control
- animation
- virtual
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention relates to a system and a controlling method for realizing remote control interaction in a virtual three-dimensional scene. An interactive control system solves how to carry out the interaction and control on a virtual studio scene, animation and an object in the scene by an operator. The system mainly comprises three modules: first, a three-dimensional producing and real-time rendering module; second, a playing and controlling module; third, an interactive module. The interactive module includes subsystems such as a wireless remote control subsystem, a voice recognizing subsystem, an image recognizing subsystem, a position tracking subsystem (an action recognizing subsystem), a touch screen subsystem (a visual multimedia playing and controlling interface and a multi-point touch controlling method are provided), and the like. A three-dimensional real-time rendering engine can be driven by the playing and controlling module by the operator through various interactive methods, thus realizing the selectively instant playing of the virtual scene and the controlling of the virtual object. The system can be applied to virtual studios of television stations and other virtual interactive demonstrating occasions.
Description
Technical field:
The present invention relates generally to three-dimensional emulation technology and mutual control technology, is that a kind of TV station interactive virtual studio that relates to is reported, and the virtual demo system of human-computer interaction of high-end interaction multimedia displaying field, other fields application.
Background technology:
The present invention is the high-end demo system that virtual real-time rendering engine technique of a kind of 3D and various mutual control technology combine, wherein 3D real-time rendering engine technique is a kind of technology that is widely used in TV station's virtual studio at present, the 3D animation that it will be made in advance by hardware, virtual scene are played up out in real time when broadcasting and are combined by buckleing as the picture of synthetic technology with host, welcome guest, thereby realize the report application under a kind of 3D virtual scene.Be characterized in utilizing the 3D technology can realize the introducing of various gorgeous purpose 3D effects and virtual three-dimensional object, and in same program, realize the switching of different scenes, and finish inaccessiable effect in a lot of outdoor scenes studio.
The broadcasting and TV that are applied in of such 3D virtual studio have following characteristics:
1, can play up the scene of making of general three-dimensional software
The 3D Virtual Studio System.Except that compatible two dimension, available general three-dimensional software such as 3d Studio Max and Maya make has three-dimensional scenics such as material, virtual light and video camera, animation.By unusual powerful hardware renderer function, can be in real time three-dimensional object or animation be played up and help D1 resolution, the video of 32 colours.
2, can lead directly to live telecast or pre-recorded videos
When video and 3D rendering were mixed mutually, 3D virtual studio series can make the user that straight-through video is pasted object surface in the virtual scene.Can support live straight-through video of multichannel and multi-channel A VI/MPEG video, full D1 resolution or low.And can make such as effects such as glass or ripples lines.
3, can realize the combination of virtual module cordwood system type
Virtual scene, virtual large-screen, dummy object, virtual special efficacy, external video, animation file are separate, at any time cordwood system type combination, and the mode that all can adopt What You See Is What You Get is carried out movement locus editor arbitrarily, all can realize D translation, rotation and convergent-divergent, and guarantee correct perspective relation.
4, can virtual a plurality of video windows
Can add a plurality of virtual large-screen windows in the virtual scene and be used to play different videos, wherein can play the outer video of two-way, no matter and the position of virtual large-screen how, can both guarantee the broadcast level quality of video pictures in the large-screen.Vision signal in the virtual large-screen can be accepted component vide, digital video signal.
5, Du Te virtual video camera allows you show scene from any angle
Virtual video camera can be used for taking the scene part that far exceeds the studio scope, i.e. unlimited blue-box function.Virtual video camera the section of film making can be in the same place with the seamless combination that real camera is clapped.
6, system has foreground depth key function
Can realize operator's passing through and blocking in three-dimensional virtual scene easily by this function; And need not any operation and just can realize dummy object, virtual video plate and virtual special efficacy encircling operation person motion, realize blocking automatically.The program operator can pass through at the virtual background interlayer, makes that synthetic picture is truer.Can realize blowing, rain, snow, virtual effect such as space is roamed, volcano eruption, make program making true and peculiar more.
7, serial system has multimachine position binary channels function
Make the output of different seats in the plane can carry out the stunt switching easily, realize fading in, fade out, draw effects such as picture, DVE, also realized pre-prison function easily.
8, serial flexibility is big, easy to use
When scene replacing, seat in the plane change, the location of carrying out video camera and virtual background again is very easy, and all parameters are measured automatically by computer, and operating personnel only need click the mouse and confirm, front and back only needed to finish in several minutes; In case finish the location, only need by traditional image capture method video camera to be done push-and-pull, yawing and pitching operation simply, can realize the virtual programs making.Even making the multimachine interdigit switches, required action only is the form with the click video camera, and various video compositions such as prospect, background, the broadcast of large-screen window all can be finished in field flyback at same frame, have guaranteed that flicker free is switched in the multimachine position, black seamless switching is beated, do not had to nothing.
Operating personnel even he is not long time of contact, also can operate native system easily.Operating personnel both can carry out default programme with keyboard, mouse and handle, also can make amendment.
9, series can record with other A/V/editing equipment is integrated
Any analog or digital looks audio frequency output and all can record with the A/V of different class/and editing equipment, special efficacy, captions, making cut bank are integrated, even connect the real-time MPEG encoder and carry out compressed digital and look the Network Transmission of audio frequency (containing the internet).
The conventional control technology of 3D render engine is to realize layout, control and the parameter setting of 3D scene by the Control Software that each company writes alone.Be installed on the controller on backstage, the control personnel cooperate the switching of finishing scene and the control of various 3D effects by software with operator in the studio.
Because the coordinate synchronization problem that is limited by between backstage control personnel and the front-end operations person all is greatly affected such virtual studio program on the continuity of performance of operator's scene and whole program, operator's have to listen to carefully the at any time instruction of backstage instructor in broadcasting in the ear arteries and veins, remember own residing position constantly but also get, the operator reads original text, the program form of expression is single, only is background and operator are synthesized together.
Of the present inventionly various mutual control devices are provided for the operator, the control of program scene has been handed over to operator's hand from the instructor in broadcasting, thereby improved operator's dynamic role greatly, make the switching of program scene more natural and tripping, and the object in backer and the virtual scene also can be realized having greatly enriched the expressive force of program alternately.
The main interaction technique that the present invention relates to comprises:
1. speech recognition technology: voice signal is input in the main frame after gathering, and by voice analysis software defined voice command is compared, and coincidence rate surpasses certain numerical value and promptly is considered to send certain instruction.This instruction can be output and be used to control other equipment or system.Voice command can provide discrimination after training.
2. image recognition technology: its basic principle be catch human body by camera certain position (for example: shape hand) and the information of motion, and send this information to main frame, main frame stores the form of this information with data, by software systems the data of storage are analyzed, and the result after will analyzing exports to controlled equipment, to reach a kind of effect of interaction.This technical applications is more extensive, can be used for advertising media, education, amusement or the like, thereby the degree of depth that reaches human body and content of multimedia is mutual.
3. motion capture and position tracking technique: can realize track capturing to human motion by wireless location or infrared tracking technique.Human body is set a track terminal equipment in certain location, main frame can this location information of terminals of real-time tracking, after this information via sampling, can compare with predefined track definition information, coincidence rate surpasses certain numerical value and promptly is considered to send certain instruction.This instruction and positional information be exportable to be used for mutual control.Track definition can be by training to provide discrimination.
4.Media poster high-speed multimedia browser technology: this is to be a kind of high speed picture and text interaction technique that realizes that on touch-screen graphical control interface is developed, and this technology can realize the high speed of mass digital content is browsed.Can easily browse other high-resolution pictures of satellite photo level by this technology, and compatible multiple multimedia form file, as sound, video, text, flash, html etc., the content of multimedia of big data quantity is incorporated on the user interface, arbitrarily drag, amplify, dwindle, switch, give the brand-new use experience of people.
This technology is in conjunction with having used the multiple point touching technology, can realize synchronous tracking and trajectory analysis to a plurality of fingers, thereby realize realizing comparatively complicated and lively control mode with finger, as with the random zoomed image of the finger of two hands, can realize the effects such as solid upset of image with the rotation of singlehanded some fingers.
This technology has realized the control to virtual real-time three-dimensional render engine, and can gather the image of virtual real-time three-dimensional render engine output, is presented in the touch-screen control picture that can monitor so that the operator to be provided one.By this picture, the operator can also control the object in the virtual scene, as move, convergent-divergent etc.
Summary of the invention:
Realize the method for remote control interaction in a kind of virtual three-dimensional scene, it is characterized in that, comprise step:
1) three-dimensional scenic making step, utilize the three-dimensional property parameters of making software development three-dimensional scenic file and deriving each object (Object) in the scene (as track, the position, size, angle etc.), and utilize and broadcast control module extraction document scene information and thingness parameter, generate the scene playlist;
2) associated steps utilizes the broadcast control module that the control signal of interactive control equipment is related with given scenario, calls and plays with the control scene; The control signal of interactive control equipment is related with the property parameters of specified object, with the motion of control dummy object;
3) operating procedure, the operator can control calling of each scene at random or by sequence by various interactive control equipments, and can carry out real-time assignment to the thingness parameter in the three-dimensional scenic by interactive control equipment, with the real-time calling control of realization, as choose and mobile jobbie the dummy object in the virtual scene;
4) play up the broadcast step, utilize real-time three-dimensional render engine technology to realize the operator is controlled the real-time rendering broadcast of three-dimensional scenic (wherein comprising controlled subject) down.
The method that realizes remote control interaction in the described virtual three-dimensional scene comprises that further described interactive control equipment can be one or more combinations in the following equipment:
1) wireless electron remote control equipment is as Digiplex, remote control switch, infrared trigger switch;
2) touch panel device;
3) speech recognition apparatus;
4) position tracking device is as electromagnetic type and infrared type position tracking device;
5) image identification and tracking equipment are as gesture identification and tracking system;
The method that realizes remote control interaction in the described virtual three-dimensional scene comprises that further wherein said associated steps also comprises following one or more combination:
1) wireless electron remote control equipment and calling of certain scene are associated;
2) zone of the predetermined registration operation in the touch-screen and calling of certain scene are associated;
3) position of felt pen in the touch-screen or finger is moved and the position attribution parameter correlation of certain dummy object connection;
4) will discern different a plurality of finger manipulation orders by the multiple point touching technology in the touch-screen, and be associated with the switching of scene or the property parameters of dummy object;
5) recognition command of speech recognition apparatus and the switching of scene are associated;
6) with the positional information of position tracking device and the position attribution parameter correlation connection of certain dummy object;
7) different command of the different motion track representative by action recognition technology recognizing site tracking equipment, and and the switching of scene be associated;
8) by image identification and tracking equipment, the different command of the different action of identification human body (as gesture) representative, and follow the tracks of the positional information of certain appointed part (as finger tip) and the switching of scene or the property parameters of dummy object and be associated.
The method that realizes remote control interaction in the described virtual three-dimensional scene further comprises, wherein said playing up broadcasted step and can be called independently third party's real time 3-D image render engine by interface instruction, for example the real-time rendering work station DVG that provides of Israel Orad company.
Realize the system of remote control interaction in a kind of virtual three-dimensional scene, it is characterized in that system comprises:
1) three-dimensional scenic is made module: this module can import general three-dimensional and make for example three-dimensional scenic file that completes such as 3D MAX and/or create the three-dimensional scenic masterplate voluntarily of software, and derives the property parameters of object;
2) broadcast control module: be used to the backstage control that provides scene animation playlist, scene animation preview, virtual interactive control setting, scene animation to play, the function of render engine control;
3) mutual control signal processing module: this module is mainly finished the analyzing and processing to the control signal of multiple interactive control equipment, and the control signal of formation normalizing is to control virtual scene and dummy object;
4) application system module: according to applied logic and flow scheme design and store the application corresponding mode, cooperate general broadcast control module to use, application examples is the game class program in this way, question and answer class program;
5) play up output module: this module mainly comprises three-dimensional real-time rendering engine, and the broadcast control module drives according to interface protocol and plays up output module, and promptly drive 3 d rendering engine scene is carried out real-time rendering, and output video.
The system that realizes remote control interaction in the described virtual three-dimensional scene further comprises, the described application system module module of for example guessing: this module is responsible for mainly that player's basis is set, every related setting of taking turns guess result and scene animation, and play up output control module the every result being passed to after taking turns guess and finishing, this module provides the interface with external program, supports guess result's automatic generation or result's manual typing.
The system that realizes remote control interaction in the described virtual three-dimensional scene comprises that further described interactive control equipment can be one or more combinations in the following equipment:
1) wireless electron remote control equipment is as Digiplex, remote control switch, infrared trigger switch;
2) touch panel device;
3) speech recognition apparatus;
4) position tracking device is as electromagnetic type and infrared type position tracking device;
5) image identification and tracking equipment are as gesture identification and tracking system;
The system that realizes remote control interaction in the described virtual three-dimensional scene further comprises, described touch panel device can provide a visual image manipulation interface, generation is edited by multimedia presentation software (as high-speed multimedia demoware Media Poster) in this interface, can be on screen setting operation object or zone arbitrarily, different interfaces in the toggle screen, and by interface Synchronization Control real-time rendering engine, the picture that this engine is played up also can by the touch-screen work station by synchronous acquisition in the touch-screen picture.
The system that realizes remote control interaction in the described virtual three-dimensional scene comprises that further the described interaction control effect of playing up output control module comprises one or more in the following effect:
1, next animation: the broadcast of next animation in the control scene;
2, a last animation: a last animation of scene is got back in control, and current animation is got back to first frame simultaneously;
3, animation play to suspend: the time-out of the scene animation in the controls playing, the animation that for example circulates, can be by the circulation animation stop to reach the effect of selecting at random;
4, animation is play: the scene animation after control suspends continues to play;
5, animation stops: what scene animation was play stops, and gets back to the animation foremost;
6, video playback: the broadcast of the video file that control is inserted, supported video file format has .avi .mov .mpeg .rmvb .wmv;
7, video playback is suspended: the broadcast of the video file that control is inserted suspends;
8, any animation: the broadcast of animation arbitrarily in the control scene;
9, get back to the scene animation top: a key is got back to the top animation of current scene, is primarily aimed at NG situation in performance recording;
10, skipping of animation: can skip certain animation during broadcast, play-over next animation;
11, the selection of scene internal objects, mobile, rotation is amplified, and dwindles.
Social benefit and economic benefit
1. virtual interaction systems can improve that present virtual programs form is single, and program operator and scene and broadcast content can't be realized mutual problem, can improve the rich of virtual programs performance form greatly.
2. virtual interaction systems is transferred control to operator or program participant, in the TV broadcast field is a revolutionary breakthrough, the people relies on no longer only in backstage technical staff's the control that cooperates with the interaction of virtual scene, this will save the human cost of performance recording greatly, provide and record efficient.
3. the introducing of various control devices has brought the innovation of virtual programs design concept in the virtual interaction systems, can realize the program category that in the past can't realize in virtual studio, helps the lifting that virtual studio is being worth.
4. virtual interaction systems is performed in a radio or TV programme the field except that being applied to TV station, also can be used in other high-end displaying occasion, as all kinds of exhibitions, three-dimensional artificial laboratory, military commanding center etc., the introducing of various control devices will and have been promoted very big impetus to the application of three dimensional virtual technique.
Description of drawings
Shown in the accompanying drawing 1 is the modular configuration diagram of whole system;
Shown in the accompanying drawing 2 is the allocation plan of whole system, focuses on the description of the technology realization of virtual interaction;
Shown in the accompanying drawing 3 is the flow chart of whole system work;
Shown in the accompanying drawing 4 is the picture of the subsystem of touch-screen and Media Poster combination, personnel can be by the content of multimedia in touch-screen switching virtual background and (amplifying/dwindle/drag/switch) the Media Poster system of operation simultaneously, and is input in the virtual large-screen by video acquisition;
Shown in the accompanying drawing 5 is the realization schematic diagram of speech recognition subsystem;
Shown in the accompanying drawing 6 is the realization schematic diagram of image recognition subsystem;
Solving blue screens with the two work station methods of synchronization and buckle schematic diagram shown in the accompanying drawing 7 as problem.
Embodiment
1. system architecture
1.1 virtual interaction systems Technical Architecture
1.1.1 virtual interaction systems module is formed
Virtual interaction systems is mainly 5 modules, and the one, three-dimensional scenic is made module, broadcasts control module, mutual control signal processing module, the application system module is played up output module.As shown in Figure 1.
The function of each module is as follows:
1) three-dimensional scenic is made module: this module can import general three-dimensional and make for example three-dimensional scenic file that completes such as 3D MAX of software, also can create the three-dimensional scenic masterplate voluntarily, and need to derive the property parameters of object;
2) broadcast control module: be used to the backstage control that provides scene animation playlist, scene animation preview, virtual interactive control setting, scene animation to play, the function of render engine control;
3) mutual control signal processing module: this module is mainly finished the analyzing and processing to the control signal of multiple interactive control equipment, and the control signal of formation normalizing is to control virtual scene and dummy object;
4) application system module: as the game class program, question and answer class program etc. relates to the application system module of directed applied logic and flow process, cooperates general broadcast control module to use.For example: many people guess class recreation mainly by the game control module in the virtual interactive control system (mark is set, to the related animation of, mistake etc.), put the related animation that pre-sets according to every rolling hitch carpostrote and realize.The game control module does not relate to the rule of recreation, only plays corresponding animation after obtaining the result.Under the support that the automatic judgement system of independently playing is arranged, then can be connected with virtual interactive control system by routine interface, can realize that full-range automation broadcasts; As do not have automatic judgement system then the manual input results in backstage control the broadcast of corresponding animation;
5) play up output module: this module mainly comprises three-dimensional real-time rendering engine, and the broadcast control module drives according to interface protocol and plays up output module, and promptly drive 3 d rendering engine scene is carried out real-time rendering, and output video.
The workflow of system is:
Three-dimensional scenic is made after module finishes dummy object and scene creation, the parameter of scene and object is imported to the broadcast control module, broadcast control module scene is directly created related (seeing Fig. 2 steps A) with object with the distinct interaction mode in the mutual control signal processing module, and accept the information that mutual control signal processing module is sent, immediately call between associated scenario and object, and drive the 3 d rendering engine of playing up output module and play up in real time and output image; Perhaps mutual control signal processing module is related with the application system module creation (seeing Fig. 2 step B) earlier, the application system module is set up related with the broadcast control module again, the application system module is made logic determines after receiving the information that mutual control signal processing module sends, send corresponding informance by the result to broadcasting control module, broadcast control module and call between associated scenario immediately and object, and drive the 3 d rendering engine of playing up output module and play up in real time and output image; The application system module can be according to different program demands and flow scheme design (as game shows etc.), full-automation that finally can the record and broadcast flow process.
Wherein, mutual control signal processing module is to realize the emphasis of virtual interacting, and it has comprised wireless remote control, speech recognition, image identification, position tracking (action recognition) and touch-screen subsystems such as (a visual multimedia Broadcast Control interface and multiple point touching control device are provided).
The system of mutual control signal processing module realizes as shown in Figure 3.
Interactive module (Digiplex, speech recognition, image identification, position tracking/motion capture, infrared touch panel etc.) sends information by the internal lan network to broadcasting control module in operator's control, triggering, broadcast and send instruction by predefined agreement to rendering module (render engine) after control module receives instruction, render engine will be play specific scene, animation and export two-way SDI vision signal simultaneously by instruction.One road SDI vision signal directly inserts the control platform system that leads, another road SDI vision signal is input to touch-screen Control work station by video frequency collection card, the operator can on the touch-screen by software on the scene of input, do various interactive operations (as: amplify the scene picture, on video the setting-out annotations and comments, referring to Fig. 4) be input at the signal that will integrate and lead in the control platform.
1.1.2 mutual each subsystem of control signal processing module is introduced:
The controlled in wireless subsystem, switch electronic controller, handheld electronic control terminal produce control signal by the physics extruding of finger, infrared tube passes through to intercept infrared ray and produces control signal, and wireless controller is by control signal under the wireless network reception and be transferred to broadcast Control work station.Our pre-defined pairing controlled function of different control signals in ONU On-Air Workstation.When broadcasting, control and send instruction broadcast scene animation by preestablishing controlled function to render engine after work station is received the control signal of wireless terminal.
Set in advance a scene animation of moving into one's husband's household upon marriage as us, and a pair of infrared tube is settled in corresponding position in virtual studio.When the operator passes infrared tube in the studio, trigger control signal, wireless controller sends to the broadcast controlling platform with him after receiving signal, platform can send to the instruction that render engine is play the animation that opens the door, therefore in synthetic scene, door can be opened, and the operator can pass through from door.Finish the effect of from door, walking out.
The advantage of this control subsystem is radio function, reception by wireless receiver replaces wired mode, thereby can be according to the difference of programme content form, change the position of wireless control terminal easily, and need not consider how transmission line is hidden, increase operator's moving region greatly.
Speech recognition subsystem, sound by microphone acquisition operations person passes to broadcast Control work station with its digital coding, by with the contrast of sound bank, identify the digital information that is comprised in operator's language, as in control broadcast machine we pre-defined " next one " the voice messaging correspondence be the control command of playing next animation, the operator says " the next animation of let us now ", wherein the voice messaging of " next one " is collected into the instruction that the back controller identifies its correspondence, and sending the instruction of playing next animation to render engine, render engine broadcasts the animation of next scene.Referring to Fig. 5.
The serious forgiveness that focuses on speech recognition of this system,
The image recognition subsystem, catch pictorial information (as finger) and the movement locus thereof that identifies the body local position by camera, and send information to the broadcast main control system, main frame stores the form of this information with data, by software systems the data of storage are analyzed and reconfigured, and the data after will analyzing are carried out related with control command, broadcast that controller is real-time after receiving operator's local image signal to send control instruction corresponding to render engine, play scene animation.
Its main feature is to wear any equipment on one's body the operator, fully by visual seizure and recognition technology, identify the local location of health, and follow the tracks of its movement locus, control instruction corresponding is talked about and matched to movement locus under storage numeral, after when program broadcasts, capturing same movement locus, broadcast the automatic sending controling instruction of controlling platform and play up output module, play the scene animation of appointment.This subsystem also has the multiple spot function, camera can be caught the action message of two fingers simultaneously and it is passed to main frame synchronously, the shift position that main control system identifies two fingers is translated into control command and is transferred to render engine, the rotation of object object in the control virtual scene, stretches and dwindles.
Referring to Fig. 6.
(action recognition) subsystem is followed the tracks of in the position, by for example hand of wireless or infrared position tracking device is installed on one's body the operator, this tracking equipment can hand motion track record when performance recording with the operator under, and send this information to main frame by radio receiver, main frame receives down and can some specific activities such as hand motion (brandishing down on hand) be discerned after the information, confirm will send instruction to virtual engine by predefined corresponding function after the action coupling, virtual engine is play relevant scene animation.It is corresponding that the technology of motion capture simultaneously can be discerned object control also can be real-time and render engine, as holding tracking means on hand, main frame can send to render engine in real time with the motion track that identifies when the operator moved on hand tracking means, render engine real-time with predefined object (for example: virtual umbrella) in synthetic picture, place and follow moving of its on the tracking means and move.
The touch-screen subsystem, infrared touch panel is set to blueness, puts light blue button at the screen inside-paint, in touch-screen Control work station by its triggering function (last one/next bar/any animation/video playback/stop etc.) of MP software definition.Because the chroma key device can be deducted infrared touch panel is whole, after the button in light blue button and the virtual scene or other dummy object are alignd, the program effect of clicking light blue button control virtual scene object animation correspondence in the canopy of making video recording will be that the operator directly clicks button in the virtual scene or the animation in the dummy object control virtual scene.But this mode interoperation reaches the program effect beyond the clicking trigger animation, such as the effect of pulling video window.
MP (Mediaposter) picture and text Control Software is installed Mediaposter picture and text control interactive medium software respectively on two complete synchronous main control systems.The content of two machines is in full accord, and all with same touch panel communication (by usb or rs232), wherein the DVI video of a main frame is input to touch-screen and shines by MP blue screening that superpose on picture, another synchronous main frame is given render engine with the DVI video signal transmission, input is presented in the virtual scene as one road video, the touch-screen content that video camera when broadcasting in the studio is taken is blue, synthesize in virtual scene and can be gone by button, but the operator can see in the touch-screen that thereby blue content carries out alternately, another master synchronization that links to each other with render engine of while will not add the video information that hides photograph and will be transferred to render engine, the part that touch-screen is gone by button in virtual scene imports and does not add the blue video that hides photograph, thereby has solved the problem that the blue content meeting was gone by button when the content in the touch-screen combined with virtual scene.System construction drawing is referring to Fig. 7.
MP software provides the two-dimentional content of multimedia of touch-screen inside simultaneously, hosting is handled two-dimensional content as amplifying picture, video in touch-screen, drag picture, the button of one page under clicking in the screen, when two-dimensional content is put into the action of next pictures in triggering screen, send control information to control ONU On-Air Workstation, thereby the animation that work station makes render engine play scene change by predefined instruction reaches combining of 3D and 3D content.Referring to Fig. 4.
1.1.3 scene animation control effect
The scene animation control effect that virtual interaction systems provides comprises one or more in the following effect:
1, next animation: the broadcast of next animation in the control scene;
2, a last animation: a last animation of scene is got back in control, and current animation is got back to first frame simultaneously;
3, animation play to suspend: the time-out of the scene animation in the controls playing, the animation that for example circulates, can be by the circulation animation stop to reach the effect of selecting at random;
4, animation is play: the scene animation after control suspends continues to play;
5, animation stops: what scene animation was play stops, and gets back to the animation foremost;
6, video playback: the broadcast of the video file that control is inserted, supported video file format has .avi .mov .mpeg .rmvb .wmv;
7, video playback is suspended: the broadcast of the video file that control is inserted suspends;
8, any animation: the broadcast of animation arbitrarily in the control scene;
9, get back to the scene animation top: a key is got back to the top animation of current scene, is primarily aimed at NG situation in performance recording;
10, skipping of animation: can skip certain animation during broadcast, play-over next animation;
11, the selection of scene internal objects, mobile, rotation is amplified, and dwindles.
These controlled function can be associated with the control signal of interactive module fully, thereby realize external control.The controlling platform while is as the backup scenario of interactive module in reality is broadcasted, especially programme televised live goes wrong or during operator's misoperation when the equipment in the interactive module, the control personnel are led on the backstage can be by the respective action of the synchronous complete operation person in controlling platform interface on the controller, and guarantees the normal broadcast of program.
Claims (9)
1, realize the method for remote control interaction in a kind of virtual three-dimensional scene, it is characterized in that, comprise step:
1) three-dimensional scenic making step utilizes three-dimensional make software development three-dimensional scenic file and derivation
The property parameters of each object (Object) in the scene (as track, position, size, angle etc.), and utilize and broadcast control module extraction document scene information and thingness parameter, the scene playlist generated;
2) associated steps utilizes the broadcast control module that the control signal of interactive control equipment is related with given scenario, calls and plays with the control scene; The control signal of interactive control equipment is related with the property parameters of specified object, with the motion of control dummy object;
3) operating procedure, the operator can control calling of each scene at random or by sequence by various interactive control equipments, and can carry out real-time assignment to the thingness parameter in the three-dimensional scenic by interactive control equipment, with the real-time calling control of realization, as choose and mobile jobbie the dummy object in the virtual scene;
4) play up the broadcast step, utilize real-time three-dimensional render engine technology to realize the operator is controlled the real-time rendering broadcast of three-dimensional scenic (wherein comprising controlled subject) down.
2, realize the method for remote control interaction in the virtual three-dimensional scene as claimed in claim 1, described interactive control equipment can be one or more combinations in the following equipment:
1) wireless electron remote control equipment is as Digiplex, remote control switch, infrared trigger switch;
2) touch panel device;
3) speech recognition apparatus;
4) position tracking device is as electromagnetic type and infrared type position tracking device;
5) image identification and tracking equipment are as gesture identification and tracking system.
3, realize the method for remote control interaction in the virtual three-dimensional scene described in claim 1, wherein said associated steps also comprises following one or more combination:
1) wireless electron remote control equipment and calling of certain scene are associated;
2) zone of the predetermined registration operation in the touch-screen and calling of certain scene are associated;
3) position of felt pen in the touch-screen or finger is moved and the position attribution parameter correlation of certain dummy object connection;
4) will discern different a plurality of finger manipulation orders by the multiple point touching technology in the touch-screen, and
Be associated with the switching of scene or the property parameters of dummy object;
5) recognition command of speech recognition apparatus and the switching of scene are associated;
6) with the positional information of position tracking device and the position attribution parameter correlation connection of certain dummy object;
7) different command of the different motion track representative by action recognition technology recognizing site tracking equipment, and and the switching of scene be associated;
8) by image identification and tracking equipment, the different command of the different action of identification human body (as gesture) representative, and follow the tracks of the positional information of certain appointed part (as finger tip) and the switching of scene or the property parameters of dummy object and be associated.
4, realize the method for remote control interaction in the virtual three-dimensional scene described in claim 1, wherein said playing up broadcasted step and can be called independently third party's real time 3-D image render engine by interface instruction, for example the real-time rendering work station DVG that provides of Israel Orad company.
5, realize the system of remote control interaction in a kind of virtual three-dimensional scene, it is characterized in that system comprises:
1) three-dimensional scenic is made module: this module can import general three-dimensional and make for example three-dimensional scenic file that completes such as 3DMAX and/or create the three-dimensional scenic masterplate voluntarily of software, and derives the property parameters of object;
2) broadcast control module: be used to the backstage control that provides scene animation playlist, scene animation preview, virtual interactive control setting, scene animation to play, the function of render engine control;
3) mutual control signal processing module: this module is mainly finished the analyzing and processing to the control signal of multiple interactive control equipment, and the control signal of formation normalizing is to control virtual scene and dummy object;
4) application system module: according to applied logic and flow scheme design and store the application corresponding mode, cooperate general broadcast control module to use, application examples is the game class program in this way, question and answer class program;
5) play up output module: this module mainly comprises three-dimensional real-time rendering engine, and the broadcast control module drives according to interface protocol and plays up output module, and promptly drive 3 d rendering engine scene is carried out real-time rendering, and output video.
6, realize the system of remote control interaction in the virtual three-dimensional scene as claimed in claim 5, the described application system module module of for example guessing: this module is responsible for mainly that player's basis is set, every related setting of taking turns guess result and scene animation, and play up output control module the every result being passed to after taking turns guess and finishing, this module provides the interface with external program, supports guess result's automatic generation or result's manual typing.
7, realize the system of remote control interaction in the virtual three-dimensional scene as claimed in claim 5, described interactive control equipment can be one or more combinations in the following equipment:
1) wireless electron remote control equipment is as Digiplex, remote control switch, infrared trigger switch;
2) touch panel device;
3) speech recognition apparatus;
4) position tracking device is as electromagnetic type and infrared type position tracking device;
5) image identification and tracking equipment are as gesture identification and tracking system.
8, realize the system of remote control interaction in the virtual three-dimensional scene as claimed in claim 5, described touch panel device can provide a visual image manipulation interface, generation is edited by multimedia presentation software (as high-speed multimedia demoware Media Poster) in this interface, can be on screen setting operation object or zone arbitrarily, different interfaces in the toggle screen, and by interface Synchronization Control real-time rendering engine, the picture that this engine is played up also can by the touch-screen work station by synchronous acquisition in the touch-screen picture.
9, realize the system of remote control interaction in the virtual three-dimensional scene as claimed in claim 5, the described interaction control effect of playing up output control module comprises one or more in the following effect:
1, next animation: the broadcast of next animation in the control scene;
2, a last animation: a last animation of scene is got back in control, and current animation is got back to first frame simultaneously;
3, animation play to suspend: the time-out of the scene animation in the controls playing, the animation that for example circulates, can be by the circulation animation stop to reach the effect of selecting at random;
4, animation is play: the scene animation after control suspends continues to play;
5, animation stops: what scene animation was play stops, and gets back to the animation foremost;
6, video playback: the broadcast of the video file that control is inserted, supported video file format has .avi .mov .mpeg .rmvb .wmv;
7, video playback is suspended: the broadcast of the video file that control is inserted suspends;
8, any animation: the broadcast of animation arbitrarily in the control scene;
9, get back to the scene animation top: a key is got back to the top animation of current scene, is primarily aimed at NG situation in performance recording;
10, skipping of animation: can skip certain animation during broadcast, play-over next animation;
11, the selection of scene internal objects, mobile, rotation is amplified, and dwindles.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102050103A CN101465957B (en) | 2008-12-30 | 2008-12-30 | System for implementing remote control interaction in virtual three-dimensional scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102050103A CN101465957B (en) | 2008-12-30 | 2008-12-30 | System for implementing remote control interaction in virtual three-dimensional scene |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101465957A true CN101465957A (en) | 2009-06-24 |
| CN101465957B CN101465957B (en) | 2011-01-26 |
Family
ID=40806290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008102050103A Expired - Fee Related CN101465957B (en) | 2008-12-30 | 2008-12-30 | System for implementing remote control interaction in virtual three-dimensional scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101465957B (en) |
Cited By (62)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101916163A (en) * | 2010-08-02 | 2010-12-15 | 周寅 | Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation |
| CN101945124A (en) * | 2010-08-19 | 2011-01-12 | 周寅 | Method for downloading videos during roaming in micro-video and peer-to-peer network-based virtual network map |
| CN101977291A (en) * | 2010-11-10 | 2011-02-16 | 江苏惠通集团有限责任公司 | RF4CE protocol-based multi-functional digital TV control system |
| CN101980116A (en) * | 2010-10-18 | 2011-02-23 | 北京理工大学 | Three-dimensional touch controller |
| CN102081500A (en) * | 2010-12-21 | 2011-06-01 | 北京迈思奇科技有限公司 | Display control method, device and system |
| CN102111672A (en) * | 2009-12-29 | 2011-06-29 | 康佳集团股份有限公司 | Method, system and terminal for viewing panoramic images on digital television |
| CN101692693B (en) * | 2009-09-29 | 2011-09-28 | 北京中科大洋科技发展股份有限公司 | Multifunctional integrated studio system and a method |
| CN102340690A (en) * | 2011-09-13 | 2012-02-01 | 苏州美娱网络科技有限公司 | Interactive television program system and realization method |
| CN102566865A (en) * | 2010-12-27 | 2012-07-11 | 爱国者电子科技(天津)有限公司 | Computer device for distinguishing touch event and distinguishing method thereof |
| CN102576247A (en) * | 2009-09-16 | 2012-07-11 | 迪斯尼实业公司 | Hyperlinked 3d video inserts for interactive television |
| CN102622159A (en) * | 2011-01-28 | 2012-08-01 | 炬力集成电路设计有限公司 | Portable equipment as well as realizing method and system of user interface of same |
| CN102668573A (en) * | 2009-11-16 | 2012-09-12 | Lg电子株式会社 | Image display apparatus and operating method thereof |
| CN102693091A (en) * | 2012-05-22 | 2012-09-26 | 深圳市环球数码创意科技有限公司 | Method for realizing three dimensional virtual characters and system thereof |
| CN101599182B (en) * | 2009-07-29 | 2012-10-03 | 威盛电子股份有限公司 | Three-dimensional object rotating method, and corresponding computer system thereof |
| CN102902485A (en) * | 2012-10-25 | 2013-01-30 | 北京华达诺科技有限公司 | 360-degree panoramic multi-point touch display platform establishment method |
| CN102999165A (en) * | 2012-12-11 | 2013-03-27 | 广东威创视讯科技股份有限公司 | Infrared identification-based virtual reality system and interactive method |
| CN103037253A (en) * | 2012-10-26 | 2013-04-10 | 青岛海信电器股份有限公司 | Remote control system and remote control method |
| CN103051967A (en) * | 2012-12-20 | 2013-04-17 | 康佳集团股份有限公司 | Method and system for guiding user to carry out function configuration of smart television |
| CN103080882A (en) * | 2010-09-09 | 2013-05-01 | 索尼公司 | Information processing device, method of processing information, and program |
| CN103105929A (en) * | 2013-01-05 | 2013-05-15 | 北京农业信息技术研究中心 | Interactive design and experience method of virtual agricultural park and system |
| CN103413353A (en) * | 2013-07-31 | 2013-11-27 | 天脉聚源(北京)传媒科技有限公司 | Resource showing method, device and terminal |
| CN103458288A (en) * | 2013-09-02 | 2013-12-18 | 湖南华凯创意展览服务有限公司 | Gesture sensing method, gesture sensing device and audio/video playing system |
| CN103529947A (en) * | 2013-10-31 | 2014-01-22 | 京东方科技集团股份有限公司 | Display device and control method thereof and gesture recognition method |
| CN104168406A (en) * | 2014-09-02 | 2014-11-26 | 北京中科大洋科技发展股份有限公司 | Studio linkage broadcasting controlling system and method |
| CN104391453A (en) * | 2014-10-22 | 2015-03-04 | 北京恒泰实达科技股份有限公司 | Visual control room signal control method and system |
| CN104461606A (en) * | 2013-09-13 | 2015-03-25 | 现代自动车株式会社 | Customized interface system and operating method thereof |
| CN104537720A (en) * | 2014-12-15 | 2015-04-22 | 天脉聚源(北京)传媒科技有限公司 | Method and device for multi-terminal synchronous presentation of 3D models |
| CN104866101A (en) * | 2015-05-27 | 2015-08-26 | 世优（北京）科技有限公司 | Real-time interactive control method and real-time interactive control device of virtual object |
| CN105227807A (en) * | 2015-09-28 | 2016-01-06 | 北京方瑞博石数字技术有限公司 | Immersive VR playing platform |
| CN106205434A (en) * | 2016-08-08 | 2016-12-07 | 华中科技大学 | A kind of intelligent guide system for realizing travel at one's own expense |
| US9547802B2 (en) | 2013-12-31 | 2017-01-17 | Industrial Technology Research Institute | System and method for image composition thereof |
| CN106792246A (en) * | 2016-12-09 | 2017-05-31 | 福建星网视易信息系统有限公司 | A kind of interactive method and system of fusion type virtual scene |
| CN106933957A (en) * | 2017-01-24 | 2017-07-07 | 上海东方传媒技术有限公司 | Acquisition system and method |
| CN107111340A (en) * | 2014-12-29 | 2017-08-29 | 索尼互动娱乐美国有限责任公司 | Method and system for carrying out user mutual in virtual or augmented reality scene using head mounted display |
| CN107301679A (en) * | 2016-04-15 | 2017-10-27 | 孙万霖 | Virtual reality house viewing system |
| CN107454438A (en) * | 2016-06-01 | 2017-12-08 | 深圳看到科技有限公司 | Panoramic video preparation method |
| US9930128B2 (en) | 2011-09-30 | 2018-03-27 | Nokia Technologies Oy | Method and apparatus for accessing a virtual object |
| CN108008816A (en) * | 2017-12-01 | 2018-05-08 | 华中师范大学 | A kind of virtual method for weaving of " Tujia " picture weaving in silk based on Kinect and system |
| WO2018095355A1 (en) * | 2016-11-24 | 2018-05-31 | 腾讯科技（深圳）有限公司 | Virtual object control method and related device |
| CN108230076A (en) * | 2016-12-21 | 2018-06-29 | 百度在线网络技术（北京）有限公司 | Show the method and electronic equipment of vegetable |
| CN108596964A (en) * | 2018-05-02 | 2018-09-28 | 厦门美图之家科技有限公司 | Depth data acquisition methods, device and readable storage medium storing program for executing |
| CN108885522A (en) * | 2016-12-30 | 2018-11-23 | 谷歌有限责任公司 | Render the content in 3D environment |
| CN109327694A (en) * | 2018-11-19 | 2019-02-12 | 威创集团股份有限公司 | A kind of 3D control room method for changing scenes, device, equipment and storage medium |
| CN109333544A (en) * | 2018-09-11 | 2019-02-15 | 厦门大学 | A kind of image exchange method for the marionette performance that spectators participate in |
| CN109364485A (en) * | 2018-10-22 | 2019-02-22 | 镇江悦乐网络科技有限公司 | A kind of three-dimensional network game engine system |
| WO2019042183A1 (en) * | 2017-08-31 | 2019-03-07 | 腾讯科技（深圳）有限公司 | Virtual scene display method and device, and storage medium |
| CN109993837A (en) * | 2019-04-11 | 2019-07-09 | 山东数字人科技股份有限公司 | A kind of methods of exhibiting and display systems of embryology data |
| CN110163861A (en) * | 2018-07-11 | 2019-08-23 | 腾讯科技（深圳）有限公司 | Image processing method, device, storage medium and computer equipment |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
| CN110503609A (en) * | 2019-07-15 | 2019-11-26 | 电子科技大学 | A kind of image rain removing method based on mixing sensor model |
| CN110989837A (en) * | 2019-11-29 | 2020-04-10 | 上海海事大学 | Virtual reality system for passenger liner experience |
| CN111083312A (en) * | 2019-12-30 | 2020-04-28 | 北京文香信息技术有限公司 | Studio system and program video production method and device |
| CN111192575A (en) * | 2019-03-29 | 2020-05-22 | 码赫镭(上海)数字科技有限公司 | Integrated control system for multimedia digital exhibition |
| CN111526114A (en) * | 2019-04-04 | 2020-08-11 | 重庆点控科技有限公司 | Multi-mode control broadcast control system |
| CN112200893A (en) * | 2020-12-10 | 2021-01-08 | 成都完美时空网络技术有限公司 | Animation generation method, device and equipment for virtual article and storage medium |
| CN114283646A (en) * | 2021-12-17 | 2022-04-05 | 江苏圣邦教育科技有限公司 | Laboratory simulation system based on virtual reality combination |
| CN114356090A (en) * | 2021-12-31 | 2022-04-15 | 北京字跳网络技术有限公司 | Control method, control device, computer equipment and storage medium |
| CN114845148A (en) * | 2022-04-29 | 2022-08-02 | 深圳迪乐普数码科技有限公司 | Interaction control method and device for host to virtual object in virtual studio |
| CN114885147A (en) * | 2022-07-12 | 2022-08-09 | 中央广播电视总台 | Fusion production and broadcast system and method |
| CN115243065A (en) * | 2022-07-19 | 2022-10-25 | 广州博冠信息科技有限公司 | Method and device for scheduling light and package and electronic equipment |
| CN115278280A (en) * | 2022-07-19 | 2022-11-01 | 广州博冠信息科技有限公司 | Audio and package scheduling method and device and electronic equipment |
| CN116781958A (en) * | 2023-08-18 | 2023-09-19 | 成都索贝数码科技股份有限公司 | XR-based multi-machine-position presentation system and method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6124862A (en) * | 1997-06-13 | 2000-09-26 | Anivision, Inc. | Method and apparatus for generating virtual views of sporting events |
| US20070248283A1 (en) * | 2006-04-21 | 2007-10-25 | Mack Newton E | Method and apparatus for a wide area virtual scene preview system |
| US7692647B2 (en) * | 2006-09-14 | 2010-04-06 | Microsoft Corporation | Real-time rendering of realistic rain |
| CN101068347A (en) * | 2007-05-25 | 2007-11-07 | 胡晓峰 | Virtual news generating system and method |
-
2008
- 2008-12-30 CN CN2008102050103A patent/CN101465957B/en not_active Expired - Fee Related
Cited By (91)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101599182B (en) * | 2009-07-29 | 2012-10-03 | 威盛电子股份有限公司 | Three-dimensional object rotating method, and corresponding computer system thereof |
| CN102576247B (en) * | 2009-09-16 | 2016-05-04 | 迪斯尼实业公司 | For the hyperlink 3D video plug-in unit of interactive TV |
| CN102576247A (en) * | 2009-09-16 | 2012-07-11 | 迪斯尼实业公司 | Hyperlinked 3d video inserts for interactive television |
| CN101692693B (en) * | 2009-09-29 | 2011-09-28 | 北京中科大洋科技发展股份有限公司 | Multifunctional integrated studio system and a method |
| CN102668573B (en) * | 2009-11-16 | 2015-01-21 | Lg电子株式会社 | Image display apparatus and operating method thereof |
| CN102668573A (en) * | 2009-11-16 | 2012-09-12 | Lg电子株式会社 | Image display apparatus and operating method thereof |
| CN102111672A (en) * | 2009-12-29 | 2011-06-29 | 康佳集团股份有限公司 | Method, system and terminal for viewing panoramic images on digital television |
| CN101916163A (en) * | 2010-08-02 | 2010-12-15 | 周寅 | Method for keeping interactive playing of cooperative and gradually-variational panoramic video under space-time transformation |
| CN101945124B (en) * | 2010-08-19 | 2012-12-12 | 周寅 | Method for downloading videos during roaming in micro-video and peer-to-peer network-based virtual network map |
| CN101945124A (en) * | 2010-08-19 | 2011-01-12 | 周寅 | Method for downloading videos during roaming in micro-video and peer-to-peer network-based virtual network map |
| CN103080882A (en) * | 2010-09-09 | 2013-05-01 | 索尼公司 | Information processing device, method of processing information, and program |
| CN101980116A (en) * | 2010-10-18 | 2011-02-23 | 北京理工大学 | Three-dimensional touch controller |
| CN101980116B (en) * | 2010-10-18 | 2012-07-25 | 北京理工大学 | Three-dimensional touch controller |
| CN101977291A (en) * | 2010-11-10 | 2011-02-16 | 江苏惠通集团有限责任公司 | RF4CE protocol-based multi-functional digital TV control system |
| CN102081500A (en) * | 2010-12-21 | 2011-06-01 | 北京迈思奇科技有限公司 | Display control method, device and system |
| CN102566865A (en) * | 2010-12-27 | 2012-07-11 | 爱国者电子科技(天津)有限公司 | Computer device for distinguishing touch event and distinguishing method thereof |
| CN102622159A (en) * | 2011-01-28 | 2012-08-01 | 炬力集成电路设计有限公司 | Portable equipment as well as realizing method and system of user interface of same |
| CN102340690A (en) * | 2011-09-13 | 2012-02-01 | 苏州美娱网络科技有限公司 | Interactive television program system and realization method |
| US9930128B2 (en) | 2011-09-30 | 2018-03-27 | Nokia Technologies Oy | Method and apparatus for accessing a virtual object |
| CN102693091A (en) * | 2012-05-22 | 2012-09-26 | 深圳市环球数码创意科技有限公司 | Method for realizing three dimensional virtual characters and system thereof |
| CN102902485A (en) * | 2012-10-25 | 2013-01-30 | 北京华达诺科技有限公司 | 360-degree panoramic multi-point touch display platform establishment method |
| CN103037253A (en) * | 2012-10-26 | 2013-04-10 | 青岛海信电器股份有限公司 | Remote control system and remote control method |
| CN103037253B (en) * | 2012-10-26 | 2016-02-10 | 青岛海信电器股份有限公司 | Remote control system and method for remotely controlling |
| CN102999165A (en) * | 2012-12-11 | 2013-03-27 | 广东威创视讯科技股份有限公司 | Infrared identification-based virtual reality system and interactive method |
| CN102999165B (en) * | 2012-12-11 | 2015-10-28 | 广东威创视讯科技股份有限公司 | A kind of virtual reality system based on infrared identification and exchange method |
| CN103051967A (en) * | 2012-12-20 | 2013-04-17 | 康佳集团股份有限公司 | Method and system for guiding user to carry out function configuration of smart television |
| CN103105929A (en) * | 2013-01-05 | 2013-05-15 | 北京农业信息技术研究中心 | Interactive design and experience method of virtual agricultural park and system |
| CN103105929B (en) * | 2013-01-05 | 2016-02-10 | 北京农业信息技术研究中心 | Virtural agriculture garden Interactive Design and experiential method and system |
| CN103413353A (en) * | 2013-07-31 | 2013-11-27 | 天脉聚源(北京)传媒科技有限公司 | Resource showing method, device and terminal |
| CN103413353B (en) * | 2013-07-31 | 2016-09-14 | 天脉聚源(北京)传媒科技有限公司 | A kind of resource exhibition method, device and terminal |
| CN103458288A (en) * | 2013-09-02 | 2013-12-18 | 湖南华凯创意展览服务有限公司 | Gesture sensing method, gesture sensing device and audio/video playing system |
| CN104461606A (en) * | 2013-09-13 | 2015-03-25 | 现代自动车株式会社 | Customized interface system and operating method thereof |
| CN103529947A (en) * | 2013-10-31 | 2014-01-22 | 京东方科技集团股份有限公司 | Display device and control method thereof and gesture recognition method |
| WO2015062251A1 (en) * | 2013-10-31 | 2015-05-07 | 京东方科技集团股份有限公司 | Display device and control method therefor, and gesture recognition method |
| US9547802B2 (en) | 2013-12-31 | 2017-01-17 | Industrial Technology Research Institute | System and method for image composition thereof |
| CN104168406A (en) * | 2014-09-02 | 2014-11-26 | 北京中科大洋科技发展股份有限公司 | Studio linkage broadcasting controlling system and method |
| CN104168406B (en) * | 2014-09-02 | 2017-08-15 | 北京中科大洋科技发展股份有限公司 | Link broadcast control method for a kind of studio |
| CN104391453A (en) * | 2014-10-22 | 2015-03-04 | 北京恒泰实达科技股份有限公司 | Visual control room signal control method and system |
| CN104537720A (en) * | 2014-12-15 | 2015-04-22 | 天脉聚源(北京)传媒科技有限公司 | Method and device for multi-terminal synchronous presentation of 3D models |
| CN107111340A (en) * | 2014-12-29 | 2017-08-29 | 索尼互动娱乐美国有限责任公司 | Method and system for carrying out user mutual in virtual or augmented reality scene using head mounted display |
| CN107111340B (en) * | 2014-12-29 | 2020-09-01 | 索尼互动娱乐股份有限公司 | Method and system for user interaction in virtual or augmented reality scenes |
| CN104866101B (en) * | 2015-05-27 | 2018-04-27 | 世优（北京）科技有限公司 | The real-time interactive control method and device of virtual objects |
| CN104866101A (en) * | 2015-05-27 | 2015-08-26 | 世优（北京）科技有限公司 | Real-time interactive control method and real-time interactive control device of virtual object |
| CN105227807A (en) * | 2015-09-28 | 2016-01-06 | 北京方瑞博石数字技术有限公司 | Immersive VR playing platform |
| CN105227807B (en) * | 2015-09-28 | 2018-04-10 | 北京方瑞博石数字技术有限公司 | Immersive VR playing platform |
| CN107301679A (en) * | 2016-04-15 | 2017-10-27 | 孙万霖 | Virtual reality house viewing system |
| CN107454438A (en) * | 2016-06-01 | 2017-12-08 | 深圳看到科技有限公司 | Panoramic video preparation method |
| CN107454438B (en) * | 2016-06-01 | 2020-03-13 | 深圳看到科技有限公司 | Panoramic video production method |
| CN106205434B (en) * | 2016-08-08 | 2019-04-12 | 华中科技大学 | A kind of intelligent guide system for realizing travel at one's own expense |
| CN106205434A (en) * | 2016-08-08 | 2016-12-07 | 华中科技大学 | A kind of intelligent guide system for realizing travel at one's own expense |
| WO2018095355A1 (en) * | 2016-11-24 | 2018-05-31 | 腾讯科技（深圳）有限公司 | Virtual object control method and related device |
| US10796668B2 (en) | 2016-11-24 | 2020-10-06 | Tencent Technology (Shenzhen) Company Limited | Virtual object control method and related device |
| CN106792246A (en) * | 2016-12-09 | 2017-05-31 | 福建星网视易信息系统有限公司 | A kind of interactive method and system of fusion type virtual scene |
| CN106792246B (en) * | 2016-12-09 | 2021-03-09 | 福建星网视易信息系统有限公司 | Method and system for interaction of fusion type virtual scene |
| CN108230076A (en) * | 2016-12-21 | 2018-06-29 | 百度在线网络技术（北京）有限公司 | Show the method and electronic equipment of vegetable |
| US11113863B2 (en) | 2016-12-30 | 2021-09-07 | Google Llc | Rendering content in a 3D environment |
| CN108885522B (en) * | 2016-12-30 | 2021-07-06 | 谷歌有限责任公司 | Rendering content in a 3D environment |
| CN108885522A (en) * | 2016-12-30 | 2018-11-23 | 谷歌有限责任公司 | Render the content in 3D environment |
| CN106933957A (en) * | 2017-01-24 | 2017-07-07 | 上海东方传媒技术有限公司 | Acquisition system and method |
| US11341706B2 (en) | 2017-08-31 | 2022-05-24 | Tencent Technology (Shenzhen) Company Limited | Virtual scene display method and apparatus, and storage medium |
| WO2019042183A1 (en) * | 2017-08-31 | 2019-03-07 | 腾讯科技（深圳）有限公司 | Virtual scene display method and device, and storage medium |
| US11620784B2 (en) | 2017-08-31 | 2023-04-04 | Tencent Technology (Shenzhen) Company Limited | Virtual scene display method and apparatus, and storage medium |
| CN108008816A (en) * | 2017-12-01 | 2018-05-08 | 华中师范大学 | A kind of virtual method for weaving of " Tujia " picture weaving in silk based on Kinect and system |
| CN108596964A (en) * | 2018-05-02 | 2018-09-28 | 厦门美图之家科技有限公司 | Depth data acquisition methods, device and readable storage medium storing program for executing |
| CN108596964B (en) * | 2018-05-02 | 2020-07-03 | 厦门美图之家科技有限公司 | Depth data acquisition method and device and readable storage medium |
| CN110163861A (en) * | 2018-07-11 | 2019-08-23 | 腾讯科技（深圳）有限公司 | Image processing method, device, storage medium and computer equipment |
| CN109333544B (en) * | 2018-09-11 | 2020-07-17 | 厦门大学 | Doll interaction method for marionette performance participated by audience |
| CN109333544A (en) * | 2018-09-11 | 2019-02-15 | 厦门大学 | A kind of image exchange method for the marionette performance that spectators participate in |
| CN109364485A (en) * | 2018-10-22 | 2019-02-22 | 镇江悦乐网络科技有限公司 | A kind of three-dimensional network game engine system |
| CN109327694A (en) * | 2018-11-19 | 2019-02-12 | 威创集团股份有限公司 | A kind of 3D control room method for changing scenes, device, equipment and storage medium |
| CN109327694B (en) * | 2018-11-19 | 2021-03-09 | 威创集团股份有限公司 | 3D control room scene switching method, device, equipment and storage medium |
| CN111192575A (en) * | 2019-03-29 | 2020-05-22 | 码赫镭(上海)数字科技有限公司 | Integrated control system for multimedia digital exhibition |
| CN111526114A (en) * | 2019-04-04 | 2020-08-11 | 重庆点控科技有限公司 | Multi-mode control broadcast control system |
| CN109993837A (en) * | 2019-04-11 | 2019-07-09 | 山东数字人科技股份有限公司 | A kind of methods of exhibiting and display systems of embryology data |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
| CN110503609A (en) * | 2019-07-15 | 2019-11-26 | 电子科技大学 | A kind of image rain removing method based on mixing sensor model |
| CN110989837B (en) * | 2019-11-29 | 2023-03-24 | 上海海事大学 | Virtual reality system for passenger liner experience |
| CN110989837A (en) * | 2019-11-29 | 2020-04-10 | 上海海事大学 | Virtual reality system for passenger liner experience |
| CN111083312B (en) * | 2019-12-30 | 2021-04-20 | 北京文香信息技术有限公司 | Studio system and program video production method and device |
| CN111083312A (en) * | 2019-12-30 | 2020-04-28 | 北京文香信息技术有限公司 | Studio system and program video production method and device |
| CN112200893A (en) * | 2020-12-10 | 2021-01-08 | 成都完美时空网络技术有限公司 | Animation generation method, device and equipment for virtual article and storage medium |
| CN114283646A (en) * | 2021-12-17 | 2022-04-05 | 江苏圣邦教育科技有限公司 | Laboratory simulation system based on virtual reality combination |
| CN114356090A (en) * | 2021-12-31 | 2022-04-15 | 北京字跳网络技术有限公司 | Control method, control device, computer equipment and storage medium |
| CN114356090B (en) * | 2021-12-31 | 2023-11-07 | 北京字跳网络技术有限公司 | Control method, control device, computer equipment and storage medium |
| CN114845148A (en) * | 2022-04-29 | 2022-08-02 | 深圳迪乐普数码科技有限公司 | Interaction control method and device for host to virtual object in virtual studio |
| CN114845148B (en) * | 2022-04-29 | 2024-05-03 | 深圳迪乐普数码科技有限公司 | Interaction control method and device for host in virtual studio to virtual object |
| CN114885147A (en) * | 2022-07-12 | 2022-08-09 | 中央广播电视总台 | Fusion production and broadcast system and method |
| CN115243065A (en) * | 2022-07-19 | 2022-10-25 | 广州博冠信息科技有限公司 | Method and device for scheduling light and package and electronic equipment |
| CN115278280A (en) * | 2022-07-19 | 2022-11-01 | 广州博冠信息科技有限公司 | Audio and package scheduling method and device and electronic equipment |
| CN116781958A (en) * | 2023-08-18 | 2023-09-19 | 成都索贝数码科技股份有限公司 | XR-based multi-machine-position presentation system and method |
| CN116781958B (en) * | 2023-08-18 | 2023-11-07 | 成都索贝数码科技股份有限公司 | XR-based multi-machine-position presentation system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101465957B (en) | 2011-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101465957B (en) | System for implementing remote control interaction in virtual three-dimensional scene | |
| KR101270780B1 (en) | Virtual classroom teaching method and device | |
| KR101367260B1 (en) | A virtual lecturing apparatus for configuring a lecture picture during a lecture by a lecturer | |
| CN104639861B (en) | A kind of high definition recording and broadcasting system | |
| KR20200024441A (en) | Smart Realtime Lecture, Lecture Capture and Tele-Presentation-Webinar, VR Class room, VR Conference method using Virtual/Augmented Reality Class Room and Artificial Intelligent Virtual Camera Switching technologies | |
| CN108282598B (en) | Software broadcasting guide system and method | |
| US10531158B2 (en) | Multi-source video navigation | |
| Zhang et al. | An automated end-to-end lecture capture and broadcasting system | |
| KR101351085B1 (en) | Physical picture machine | |
| US20070122786A1 (en) | Video karaoke system | |
| CN101827207A (en) | Host visual three-dimensional virtual studio interactive control system | |
| KR20170029725A (en) | Method and apparatus for generating video lecture by synthesizing multiple images | |
| CN205622745U (en) | Real -time synthesis system of virtual reality true man | |
| CN103282962A (en) | Sequencing content | |
| CN101854529A (en) | Multi-picture webcast method for audience segmentation | |
| CN110750161A (en) | Interactive system, method, mobile device and computer readable medium | |
| CN113395540A (en) | Virtual broadcasting system, virtual broadcasting implementation method, device and equipment, and medium | |
| CN113473207A (en) | Live broadcast method and device, storage medium and electronic equipment | |
| CN106657719A (en) | Intelligent virtual studio system | |
| CN114363689A (en) | Live broadcast control method and device, storage medium and electronic equipment | |
| CN115529498A (en) | Live broadcast interaction method and related equipment | |
| CN109982096A (en) | 360 ° of VR content broadcast control systems of one kind and method | |
| CN107888890A (en) | It is a kind of based on the scene packing device synthesized online and method | |
| CN206302475U (en) | A kind of intelligent virtual studio system | |
| CN114666648B (en) | Video playing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 200092 Shanghai City 1299 Zhoujiazui Road No. 21, Room 201 Co-patentee after: Shanghai Media Group, Inc. Patentee after: Ying Xufeng Address before: 200092 Shanghai City 1299 Zhoujiazui Road No. 21, Room 201 Co-patentee before: Shanghai Media Group Patentee before: Ying Xufeng |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110126 Termination date: 20161230 |