CN101340598A - Method and apparatus for implementing three-dimensional playing of media - Google Patents
Method and apparatus for implementing three-dimensional playing of media Download PDFInfo
- Publication number
- CN101340598A CN101340598A CNA2008101180415A CN200810118041A CN101340598A CN 101340598 A CN101340598 A CN 101340598A CN A2008101180415 A CNA2008101180415 A CN A2008101180415A CN 200810118041 A CN200810118041 A CN 200810118041A CN 101340598 A CN101340598 A CN 101340598A
- Authority
- CN
- China
- Prior art keywords
- module
- texture
- video
- interface
- threedimensional model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Image Generation (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a method for realizing the three-dimensional playing of media; the method comprises the steps that: drawing data of a three-dimensional model is generated according to the display configuration information of the three-dimensional model; at least one local or remote media source file is read; the media source file is decoded and generates two paths of data respectively, namely, audio signal data and video picture data; at least one path data in the audio signal generated after the decoding is output and played; multiple displaying objects including the video pictures are obtained according to texture display configuration information and are taken as the texture in the specific location of the three-dimensional model, so as to generate texture drawing data; and the drawing data of the three-dimensional model and the texture drawing data are received, and a graphics engine is dispatched to draw the three-dimensional model and the texture so as to display the three-dimensional model and the texture by a displaying interface.
Description
Technical field
The present invention designs technical field of video processing, concretely, relates to a kind of three-dimensional method and device of playing of medium of realizing.
Background technology
At present, no matter on computers, still on Digital Television, PDA, mobile phone, MP4 or the like terminal, can watch video.Particularly enter today of huge numbers of families in the Internet, network and Internet video become the brand-new channel of multimedia information dissemination, various video contents, no matter be the individual video of making by domestic consumer, or video frequency program by the professional media making, not only can watch this locality, can also allow Internet user all over the world watch by network download or online broadcast whenever and wherever possible.
Along with the raising of user's request, the effect that represents of video also becomes diversified.In video frequency program, not only can break for commercialsy at present, can also embed 3-D view.When playing the weather forecast video, the three-dimensional picture of the earth of rotation appears in video pictures for example.But this 3-D view just is fabricated in the video when the early stage video editing and goes, in case just can't the demonstration of three-dimensional picture be changed after video production is finished, also can't carry out interaction with the user.
In addition, the user can open a plurality of videos simultaneously when watching video, switch between different video by user interest or demand.For the implementation of video switch, mainly contain following several at present:
(1) direct Switch Video in video player
The effect that this mode switching mode shows is substantially similar to changes the platform effect when seeing TV.The platform effect of changing when seeing TV is: the next channel of the of short duration blank screen last frame of former video (or rest on) → begin to play.At present the switching flow of video player is mostly: stop next video of current video → play when next video buffer advertisement → begin to play.
On the effect that picture represents, above-mentioned directly in video player the defective of Switch Video mainly be that the switching of video is unsmooth, allow the user of operation feel too lofty.And during next video buffer, the user can only be forced to rest on the advertisement picture, the wait of having no alternative.And this compulsory advertisement is sent to concerning the user, because simple and crude its effect of publicity also can be had a greatly reduced quality.
(2) smooth and seamless is switched
In application number is 200610063668.6 Chinese patent application, disclose the application for a patent for invention of denomination of invention, by reference its full content has been herein incorporated at this for " a kind of computer multi-video player method and device ".Be by the D3D interface video of two-way through decoding to be shown on the different forms of same screen in this application for a patent for invention, the technology of this patent application has realized the smooth and seamless switching between a plurality of videos, but can not realize the three-dimensional result of broadcast of video.
3-D effect when (3) utilizing the Flash technology to realize different videos and scene switching
Utilize the Flash technology various scenes to switch effect, user experience is also good.But the three-dimensional that realizes video in Flash is switched, and following several significant deficiency is arranged:
1) Flash can only play the proprietary format video
Flash only supports its peculiar video format, i.e. the broadcast of FLV video, and other various main flow video formats comprise that the video of WMV, Real, MPEG-4 or the like form all can't directly be play in Flash.
Therefore Video service provider needs to spend more time in the making of video content, and its video by distinctive transcoding instrument, could be play in Flash after video changed into the FLV form.
In addition, also need more memory space to store the video file of different-format.
The more important thing is that the video quality of FLV also is difficult to reach the high definition standard at present, therefore this conversion can cause the decline of video pictures quality.
2) the efficient non-constant of Flash when showing 3-D graphic
Owing to Flash mainly is the instrument of developing for the demonstration 2 D animation.Therefore lack a large amount of three-dimensional scenics and the needed algorithm support of models show, such as projection algorithm, real-time light source or the like.Therefore show in Flash that 3-D graphic can only write algorithm or the use shared algorithm of increasing income separately, development efficiency is low, and the performance of algorithm does not have collateral security.
Can't use 3 d modeling software in addition among the Flash, as the threedimensional model of complexity of 3DS Max, Maya or the like design, as human body, automobile or the like by specialty.
Therefore the 3-D effect that can realize in Flash at present all is very simple three-dimensional body, or utilizes the variation (amplification as picture is dwindled) of X-Y scheme to come Boris DVE, threedimensional model that represents relative complex and effect that can't be level and smooth.
Based on above reason, the effect of the three-dimensional of Flash switching at present mainly is the switching that is used for picture, or on the FLV video switch that duration is short, image quality is not high, be difficult to be applied in the middle of the application of the video more to video format, that image quality is high, the time is long.
Summary of the invention
One of purpose of the present invention is to provide a kind of three-dimensional method of playing of medium that realizes, to realize the three-dimensional result of broadcast of video.
Correspondingly, another object of the present invention is to provide a kind of three-dimensional device of playing of medium of realizing.
To achieve these goals, the embodiment of the invention provides a kind of three-dimensional method of playing of medium that realizes, this method comprises:
Generate the threedimensional model drawing data according to threedimensional model configurations shown information;
Read at least one source of media file of Local or Remote;
Described at least one source of media file is decoded each self-generating audio signal and video pictures signal two paths of data;
At least one circuit-switched data in the audio signal of decoding generation is play output;
Obtain a plurality of display object that comprise described video pictures according to texture configurations shown information, and will these a plurality of display object as the texture of the assigned address of threedimensional model, generate the texture drawing data; And
Receive described threedimensional model drawing data and texture drawing data, call graphics engine drawing three-dimensional model and texture to show by display interface.
The embodiment of the invention also provides a kind of three-dimensional device of playing of medium of realizing, this device comprises:
The three-dimensional modeling module is used for generating the threedimensional model drawing data according to threedimensional model configurations shown information;
Source of media file read module is used to read at least one source of media file of Local or Remote;
The audio/video decoding module is used for described at least one source of media file is decoded each self-generating audio signal and video pictures signal two paths of data;
Audio frequency represents module, and at least one circuit-switched data in the audio signal of audio/video decoding module generation is play output;
The texture drafting module is used for obtaining a plurality of display object that comprise described video pictures according to texture configurations shown information, and will these a plurality of display object as the texture of the assigned address of threedimensional model, generate the texture drawing data; And
Picture represents module, is used to receive described threedimensional model drawing data and texture drawing data, calls graphics engine drawing three-dimensional model and texture to show by display interface.
The present invention utilizes graphics engine structure three dimensions and show a plurality of display units that comprise medium such as video pictures in the three dimensions threedimensional model, thereby realizes the three-dimensional result of broadcast of medium.
Description of drawings
Accompanying drawing described herein is used to provide further understanding of the present invention, constitutes the application's a part, does not constitute limitation of the invention.In the accompanying drawings:
Fig. 1 is the structural representation of the three-dimensional device of playing of realization medium of the embodiment of the invention;
Fig. 2 is for being plotted to two video requency frame datas respectively the schematic diagram on cubical two faces in the embodiment of the invention;
Fig. 3 is the three-dimensional schematic flow sheet of playing of the realization video of the embodiment of the invention;
Fig. 4 is the initialized flow chart in Fig. 3 median surface;
Fig. 5 is the detailed process schematic diagram that threedimensional model is drawn among Fig. 3;
Fig. 6 is the detailed process schematic diagram that texture is drawn among Fig. 3;
Fig. 7 is the detailed process schematic diagram that Fig. 3 median surface alternative events are handled;
Fig. 8 is for being that the model and the texture of example drawn schematic diagram with cube rotate effect Switch Video and advertisement in the embodiment of the invention;
Fig. 9 is the interface schematic diagram after the cube of Fig. 8 correspondence rotates to the B face;
Figure 10 is for being that the model and the texture of example drawn schematic diagram with stack three-dimensional body on video in the embodiment of the invention.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, specific embodiments of the invention are elaborated below in conjunction with accompanying drawing.At this, illustrative examples of the present invention and explanation thereof are used to explain the present invention, but not as a limitation of the invention.
In embodiments of the present invention, what realize is when many videos, video are play with Flash or the like with picture, video, can with level and smooth, can switch different video, video and picture, video and Flash by mutual 3-D effect.
So-called 3-D effect is meant that different videos, picture or Flash are when switching, can show with the variation (by far and closely appearing on the interface, the video of current broadcast meanwhile is near and far to die down as a video) of virtual three-dimensional scene or the motion of three-dimensional body (as the rotation of cube or annulus, roll or the like).
Be that to play with the three-dimensional that realizes video on computers be that example illustrates technical scheme of the present invention in the embodiment of the invention.But the present invention is not limited to realize on computers that the three-dimensional of video plays, also can be at set-top box, mobile phone, MP4 etc. other can carry out realizing on the terminal that respective graphical handles that the three-dimensional of video plays.
Present embodiment provides a kind of three-dimensional device of playing of medium of realizing.In order to realize the three-dimensional result of broadcast of video, the technical problem that the embodiment of the invention mainly will solve is:
1) draw the space of virtual three-dimensional on computers, and in virtual three-dimensional space drawing three-dimensional model (comprising three-dimensional scenic or three-dimensional physics);
2) video, picture and the Flash with various forms decodes, and decoded picture is shown in the three dimensions as texture; And
3) in virtual three-dimensional space, catch interface incident (as user's operational motion, boundary element incident, timer event etc.), and response interface incident real-time update shows.
As above technical problem can realize that this device mainly comprises following structure by the three-dimensional playing device of the medium of the embodiment of the invention shown in Figure 1:
Graphics engine, graphics engine adaptation module, picture represent module, three-dimensional modeling module, texture drafting module, interface management module, source of media read module, audio/video decoding module and audio frequency and represent module.Below these modules are described:
(1) interface management module
Described interface management module is used for being responsible for the definition of user interface and is responsible for defining response interface alternative events how (as user's operation etc.).Therefore the interface management module comprises interface definition module and interface alternation module again, wherein:
Described interface definition module is for the ease of unified whole user interface.When various media contents show in a concentrated three-dimension interaction interface simultaneously, not only need to coordinate various contents synchronously, substep shows, and need process user mutual, respond to users action or the like.Therefore need pre-defined template, playing plan and script, so that video content and other media informations are controlled.Can utilize the XML configuration file to come predefined template, playing plan and script etc. are configured by the interface definition module.Certain described configuration also can realize by manual configuration or by input command is capable.
Described interface definition module is described user interface configuration with the interface defined file (configuration file) of XML form, comprise: the layout of user interface, specification (as identification number of boundary element such as the literal that is used to show, picture, video, Flash, threedimensional model, size specification, transparency Alpha value etc.), and the description of the resource file address of each boundary element etc.Owing to will realize the three-dimensional display of video, the demonstration of main realization threedimensional model and the demonstration of the drafting texture on the threedimensional model, therefore, we can say that also the interface definition module in the present embodiment comprises by the configuration information of interface defined file definition: threedimensional model configurations shown information (as the layout of threedimensional model, specification, data pattern file address etc.) and texture configurations shown information (as texture layout, specification, source of media file address, picture file address etc.).In addition, this interface definition module is in the defined file of interface, define also how process user is operated and the interface incident, particularly, the mutual configuration information of this definition module definable interface, interface incident, to monitor and respond which user's operation or boundary element incident with indication interface alternation module, and the event-handling method that is used to respond user's operation.
Described interface alternation module is the requirement according to the interface definition module, monitors and respond various interfaces incident.Wherein main interface event type comprises: user interactive (as mouse move, click, keyboard or the like); The boundary element incident (as video playback finish, video buffer begins and finish or the like); Timer (Timer) incident (as 16 o'clock sharps, every 10 minutes or the like).
(2) three-dimensional modeling module
The effect of three-dimensional modeling module is to calculate needed three-dimensional figure, comprises the threedimensional model drawing data of various three-dimensional shapes.With a cube is example, the three-dimensional modeling module can be according to given length and width parameters such as high size, cubical anchor point, calculate this cubical threedimensional model drawing data, comprise that six needed 12 triangle number of face reach X, the Y of central point and Z coordinate (if cube is placed on the two dimensional surface, then having only X, Y coordinate) etc. according to this.And picture represents module and will call graphics engine by the graphics engine adapter and according to the threedimensional model drawing data this cube is plotted on the needed position.
The three-dimensional modeling module of the embodiment of the invention is when user interface is initialized, can read the threedimensional model configurations shown information that defines in the definition module of interface, promptly calculate the threedimensional model drawing data according to the requirement to threedimensional model in the definition module of interface, perhaps read by the threedimensional model drawing data in the threedimensional model file of threedimensional model importing module importing according to the threedimensional model file address that provides in the definition module of interface, and these data are exported to picture represent module, be used for the drafting at interface.But in the process of user interface interaction, to calculate threedimensional model drawing data after this interface incident takes place in real time according to the generation of interface incident, promptly when (as user key-press or the like) takes place in various interfaces incident, configuration requirement in the three-dimensional modeling module meeting reception interface interactive module, again the threedimensional model drawing data to each boundary element calculates, and the interface after new data are exported to picture and represent module and draw to upgrade.
(3) threedimensional model imports module
For the three-dimensional scenic or the model of relative complex, all be that 3 d modeling software (commonly used have 3DS Max, Maya, Poser or the like) with specialty is set up threedimensional model as the dummy model of actual objects such as human body, cartoon figure, automobile.This threedimensional model imports the threedimensional model file (as * .X model file) that module is responsible for reading to assigned address according to the requirement of interface definition module professional 3 d modeling software output.
(4) source of media read module
Described source of media read module is responsible for reading media resource (comprising video file, video flowing or Flash etc.) according to the media resource address in the definition module of interface.Source of media can be a document form, also can be the form of stream (Streaming); Can be stored in local file system, also can be stored in (with the URL address designation) in the network.
(5) audio/video decoding module
Audio frequency and video and Flash that described audio/video decoding module mainly is responsible for various forms that the source of media read module is read decode, and decoded video data is exported to the texture drafting module.
Because the video content data amount is very big, therefore present video by Network Transmission or propagation generally all is through after coding, the compression, transmit with the form of file or stream again, because the coding that adopts is different with the standard of compression, therefore just needing specific decoder video could be reduced in decoding can picture displayed.
Described audio/video decoding module reads one or more media resources (as video file or video flowing) of the various forms (as forms such as WMV, Real, MPEG-2, MPEG-4, SWF) that the source of media read module transmits, call corresponding audio/video decoder (Codec) according to form, each media resource decoding is reduced into the Voice ﹠ Video two paths of data.The Voice ﹠ Video data of output will be by difference output sound output equipment (audio frequency represents module) and texture drafting module after decoding was finished.
In fact the video data of video file or video flowing decoded reduction in the audio/video decoding module is exactly picture (the being frame) data of playing continuously with given pace, as per second 25 frames.That is to say that the video data that is output to the texture drafting module is exactly these continuous frame data in fact.
Audio/video decoding module acquiescence supports to comprise the video format of series such as WMV, MPEG 2/3/4, Real in the present embodiment, also supports SWF Flash file.Can support the audio/video decoding of more more formats in addition by the mode of extended coding plug-in unit.
(6) audio frequency represents module
Described audio frequency represents module to be responsible at least one road audio signal of audio/video decoding module output is play output.This audio frequency represents module can be the sound device of computer or intelligent terminal, as sound card etc.
In addition, described audio frequency represents module can also be controlled multipath audio signal according to the requirement of interface definition module and interface alternation module, as one tunnel audio signal is play, other audio signals is controlled to be quiet etc.
(7) texture drafting module
Described texture drafting module not only can read picture, also is responsible for the video pictures data of audio/video decoding module output are plotted on the specific triangles (or plane of being made up of one group of triangle) of threedimensional model according to the requirement of interface definition module as the texture of threedimensional model.
The texture drafting module receives the video requency frame data (image data) that the audio/video decoding module sends over, perhaps read picture file to assigned address, according to the requirement of interface definition module,, generate the texture drawing data with the texture of these pictures as the assigned address of threedimensional model.Utilize picture to represent the interface that module provides, these pictures can be plotted on the corresponding triangle that has constituted three-dimensional scenic or object as texture.Give an example, the texture drafting module can be plotted to two video requency frame datas (video 1 and video 2) that the audio/video decoding module sends over respectively on cubical A face and the B face, as shown in Figure 2.Among Fig. 2, video 1 is the film video, and video 2 is advertising image or video.
(8) picture represents module
Described picture represents module to be responsible for according to three-dimensional modeling module and the given interface data (threedimensional model drawing data and texture drawing data) of texture drafting module, calls the api interface of graphics engine by the graphics engine adaptor module, draws user interface.
Picture represents module can constantly upgrade the demonstration of whole user interface according to certain frame per second (frame per second) as 25 frame/seconds (being that per second refreshes demonstration 25 times).Like this as long as after the operation of catching the user, three-dimensional modeling module and/or texture drafting module just can calculate the variation that shows after the operation, how all boundary elements (comprising video, three-dimensional scenic or object or the like) should show after promptly calculating operation, picture represents the data of module invokes three-dimensional modeling module and/or texture drafting module, by graphics engine update displayed successively.Can catch user's operation or interface operation in three dimensions thus, real-time update shows.
For example, catch the action event such as input, click of user's keyboard, mouse by the interface alternation module.The interface alternation module is after capturing customer incident, will be according to the event handling logic that pre-defines in the definition module of interface, the result of event handling is outputed to respectively among three-dimensional modeling module or the texture drafting module, and the update displayed that finally picture is represented module exerts an influence.Such as two keyboard hot keys of definable in the definition module of interface " L " and " R ", when the user pressed " L " key, the three-dimensional cube on the interface was to anticlockwise 1 degree; When the user pressed " R " key, the three-dimensional cube on the interface was to right rotation 1 degree.The interface alternation module will be responsible for the input of supervisory user, when the user presses " L " key, will trigger this incident of interface alternation resume module, and the interface alternation module will be called the three-dimensional modeling module and notify this cube to anticlockwise 1 degree; According to similar method, when the user presses " L " or " R " key at every turn, all will trigger the respective handling logic of interface alternation module, the interface alternation module can be informed the three-dimensional modeling module with each event handling result, the three-dimensional modeling module will constantly send to picture with new model parameter and represent module, and picture represents module can repaint three-dimensional cube on the interface according to the model parameter after upgrading.At this moment, the user just can see own thereupon constantly by " L " and " R " key of lower keyboard, and the three-dimensional cubic on the interface is known from experience left rotation and right rotation.In this example,, therefore can rotate according to cubical rotation automatically because video or other figures on some of the cube are to be used as cubical texture to draw up.
(9) graphics engine
Graphics engine described in the present embodiment is the 3D graphics engine of main flow on the computer, comprise DirectX and OpenGL etc., described graphics engine is used to construct a virtual three dimensions, and draws various three-dimensional virtual scene or the three-dimensional virtual objects that are used to show display object such as video, picture and Flash in this virtual three dimensions.
3D such as DirectX and OpenGL graphics engine is the graphics engine of present main flow, has mainly comprised a large amount of API application development interfaces.Utilize these interfaces, real-time rendering goes out various 3D scenes and model on computers.Be mainly used in computer game, network virtual community or the like field at present.Wherein DirectX is Microsoft's platform, comprise various PC versions Microsoft Windows operating system, be used for the most universal graphics engine of the Windows CE operating system of smart machine.OpenGL then is various Linux/Unix operating systems, comprises the graphics engine that equipment such as PC, set-top box are all supported.
These graphics engines all are the demonstrations that realizes three-dimensional body by leg-of-mutton drafting, and can be on triangle pinup picture, promptly draw texture.Because all video cards are all supported these graphics engines at present, therefore utilize the graphic chips of video card and show storage, can draw triangle with the millions of speed of per second on computers, the speed of per second tens is drawn texture.Be professional 3D performance evaluating software 3Dmark05 measured performance index below:
Machine one:
IBM T40 notebook computer, CPU:Intel Pentium-M 1.5GHZ, internal memory: 512MB, video card: ATI Mobility Radeon 7500 shows: deposit 32MB, OS:Windows XP.
Test result: triangle (triangle) quantity that per second is drawn: 3.4M triangles/s, the texture (Texel) that per second is drawn is counted: 242.6M Texels/s.
Machine two:
Desktop computer, CPU:Intel Pentium-4 3.0GHz Hyperthreading, internal memory: 1GB, video card: ASUS Extreme AX550 Series, video memory: 256MB, OS:Windows XP.
Test result: the number of triangles that per second is drawn: 62.3M triangles/s, the texture that per second is drawn is counted: 658.8M Texels/s.
As seen, for common computer, can both satisfy the performance requirement aspect three-dimensional virtual scene, three-dimensional body drafting and video pictures reduction.
(10) graphics engine adapter
Present embodiment has been designed and Implemented the graphics engine adapter at different graphics engines, and the figure API that is used for different graphics engines is provided encapsulates, and provides a standard graphics to draw interface for picture represents module.Therefore present embodiment can be applied to hardware and software platform comparatively widely, Microsoft's platform still not, and also portable is to platforms such as Linux, Unix; PC computer still not, also portable can be realized effect of the present invention with identical mechanism like this to smart machines such as set-top box, mobile phones on the various graphics engines (as DirectX, OpenGL etc.) of various device (as computer, set-top box, mobile phone etc.), various platform (as Windows, Linux etc.).
As above describe as can be known, the three-dimensional modeling module in the device shown in Figure 1 can be calculated the threedimensional model drawing data; Picture represents module can call graphics engine based on described threedimensional model drawing data drawing three-dimensional model (comprising virtual three-dimensional scene or three-dimensional body) in virtual three-dimensional space by the graphics engine adapter; The texture drafting module can (comprise independent literal with a plurality of videos, picture, being literal shows with the form of picture) and display object such as Flash generate the texture drawing data as the texture of assigned address on the threedimensional model (triangle), picture represents module and calls graphics engine by the graphics engine adapter equally texture is plotted on three-dimensional scenic or the object; The interface alternation module can be caught and response interface incident or user's operation, with the demonstration of control real-time update user interface.Therefore, utilize device shown in Figure 1, can realize the three-dimensional result of broadcast of video, for the user brings new experience.
Embodiment 2
Present embodiment provides a kind of and realizes the three-dimensional method of playing of medium by the device among the embodiment 1.As shown in Figure 3, this method comprises the steps:
All or part of step in this method can instruct relevant hardware to finish by application program.Below above-mentioned steps is described in detail.
(1) interface initialization
When carrying out this step constantly by application program, application program can be automatically finished the interface initialization according to flow process as shown in Figure 4.Shown in Figure 4, this step comprises the steps: again
Load and the initialization graphics engine according to system environments, and load and the corresponding graphics engine adapter of this graphics engine.
Step 402 reads user interface definition file.
The user interface definition module reads the XML file of definition of user's interface.
The user interface definition module is responsible for resolving user interface definition file.The layout of user interface, various boundary elements and the resource location that is comprised have been defined in the interface definition XML form.
The user interface definition module can be successively passes to three-dimensional modeling module or texture drafting module with the interface data of required drafting (need draw model tabulation and the texture list).
Step 404 judges whether should represent in addition, but does not also have the three-dimensional scenic or the object of drafting.
The threedimensional model tabulation that sends over of process user interface definition module successively of three-dimensional modeling module is all completed until all models.If the three-dimensional modeling module is judged the threedimensional model (three-dimensional scenic and three-dimensional body) that has drafting or not, enter step 405; After all models that should represent are all completed, jump to step 406.
Three-dimensional modeling module and threedimensional model import all threedimensional models that will draw of resume module, need threedimensional model to import module in case of necessity and import the threedimensional model file, generate the threedimensional model drawing data by the threedimensional model MBM according to the threedimensional model file again.Detailed process is referring to flow process (two): three-dimensional scenic and object are drawn flow process.
Step 406 judges in the interface whether need represent in addition, but does not also have picture and text, video or the Flash of drafting.
Process user interface definition module medium (picture and text, video or the Flash) tabulation of sending successively of texture drafting module is all completed until all medium.If the texture drafting module is judged the texture that has drafting or not, enter step 405; After all textures that should draw are all completed, jump to step 408.
The texture drafting module calls source of media read module and all medium that will draw of audio/video decoding resume module.Detailed process is referring to flow process (three): texture is drawn flow process.
Step 408 begins to monitor the interface alternation incident.
After the drafting of having finished all three-dimensional scenics and object, texture, the initial drawing work of user interface is promptly finished.
User interactive module will begin to monitor the interface alternation incident, as user operation case or the like according to the requirement of user interface definition module.In case incident takes place, and just responds according to predefined event handling logic.Carry out flow process that the interface alternation time handles surface current journey (four) as follows: interface alternation time handling process.
(2) threedimensional model is drawn flow process
According to the requirement of interface definition module and interface alternation module, flow process is drawn three-dimensional scenic and the object on the interface as shown in Figure 5.
Step 501 is obtained the three-dimensional scenic in the interface definition or the defined parameters of object.
The three-dimensional modeling module is during by interface definition module or interface alternation module invokes, needs the other side that the relevant parameter of three-dimensional scenic and object is provided, position of placing such as scene or object or the like.Import the threedimensional model file if desired, then need to provide the storage address of file.
Step 502 judges whether to need to import threedimensional model.
If when calling the three-dimensional modeling module, be provided with the address of threedimensional model file, then the three-dimensional modeling module will be thought and need import threedimensional model from the threedimensional model file.
If the file address is not set, then flow process jumps to step 504.
Step 503 reads the threedimensional model file.
Three-dimensional modeling module invokes threedimensional model imports module, reads the threedimensional model file (as the model file of suffix .X by name) on the assigned address.
Step 504 is calculated the threedimensional model parameter.
On the one hand the three-dimensional modeling module can more built-in threedimensional model commonly used, and interface definition module or interface alternation module be the parameter of given these models (as size specification or the like) directly; The three-dimensional modeling module can directly go out to draw needed model data according to calculation of parameter.
The three-dimensional modeling module also need be done the secondary computing according to the requirement of interface definition module or interface alternation module after reading the threedimensional model file on the other hand, such as according to display resolution uniform zoom or the like.
The three-dimensional modeling module will be calculated good threedimensional model parameter and send to picture and represent module.Picture represents module will call the api interface that graphics engine provides according to the threedimensional model parameter by the graphics engine adapter, drawing three-dimensional scene and object.
The three-dimensional modeling module need write down the key mark and the parameter of these scenes or object in internal memory behind all threedimensional models of completing.Particularly when on these objects, drawing texture, need read these signs and parameter.
(3) texture is drawn flow process
According to the requirement of interface definition module and interface alternation module, flow process is plotted to video, picture or Flash on the interface as the texture of three-dimensional scenic and object as shown in Figure 6.Flow process shown in Figure 6 comprises:
Step 601 is obtained texture and is drawn required video, picture and text and Flash parameter.
The texture drafting module needs it that relevant parameter is provided during by interface definition module or interface alternation module invokes, the address of video, Flash and the picture of drawing such as needs, be plotted on which model where or the like.
Step 602 need to judge whether picture file.If desired, execution in step 603; If do not need, forward step 604 to.
Step 603 reads picture file.
What draw as texture if desired is picture, and then the texture drafting module will read picture file according to the picture address parameter to assigned address by the source of media read module.The texture drafting module is supported the picture format of various main flows, comprises BMP, PNG, JPG or the like.
Step 604 need to judge whether the Flash file.If desired, execution in step 605; If do not need, forward step 606 to.
Step 605-606 loads the Flash file and carries out audio/video decoding.
That draw as texture if desired is Flash, and then the texture drafting module will call that mounted Flash player (Flash Player) loads Flash (is the file of .SWF as suffix) on the computer to assigned address by the source of media read module.
Step 607 need to judge whether video flowing or file.If desired, execution in step 608; If do not need, forward step 610 to.
Step 608 reads video flowing or file.
What draw as texture if desired is video, and then the texture drafting module will read by the source of media read module and formulate locational video flowing or video file.
Video flowing that the source of media read module reads or video file, the texture drafting module will call corresponding audio/video decoder (Codec) according to its video format, the decoding of the audio, video data that compressed is reduced into voice data and video data, and exports voice data to audio frequency and represent the unit.The texture drafting module is responsible for receiving video data.
The texture drafting module corresponds to the assigned address of specified three-dimensional model with the video data of audio/video decoding module output and other pictures or Flash as texture, generates the texture rendering parameter, and calls picture according to the texture rendering parameter and represent module.
Picture represents the requirement of module according to the texture drafting module, calls the api interface of graphics engine by the graphics engine adapter, video data is plotted to the assigned address of designated model (scene or object).
Texture drafting module and picture represent module after drawing texture, relevant parameter can be kept in the internal memory, use for refreshing next time when drawing.
(4) interface alternation event handling flow process
After the initialization of finishing the interface, the interface alternation module will be responsible for monitoring the interface alternation incident of the present invention program's application program, comprise user operation case, boundary element incident and timer (Timer) incident.As shown in Figure 7.This flow process specifically comprises:
Step 701 is monitored the interface alternation incident, judges whether that event occurs.
In case the incident that interface alternation module interface alternation module is monitored takes place, then execution in step 702, the identification event type.
By the identification to event type, the interface alternation module will be called events corresponding and handle function capturing events and relevant parameter, as mouse position, and key code or the like.
Step 703 judges whether institute's generation incident needs to handle.
After the interface alternation module obtains incident and relevant parameter, can be with reference to the requirement of interface definition module, only the incident that needs are handled is handled.If the incident of monitoring needs to handle, then enter step 704; If this incident does not need to handle, then forward step 701 to, the interface alternation module then continues to monitor the generation of next event.
Step 704 judges whether to redraw three-dimensional scenic or object.If desired, execution in step 705 if do not need, forwards step 707 to.
Step 705 is calculated the relevant parameter that repaints needed three-dimensional modeling.
If judge that according to the processing requirements of the incident of monitoring needs redraw three-dimensional scenic or object, the interface alternation module will be called the three-dimensional modeling module and again three-dimensional scenic or the object that is presented on the interface be carried out the computing of three-dimensional modeling relevant parameter, perhaps read in new three-dimensional modeling data again, generate new threedimensional model drawing data.
Step 707 judges whether to repaint texture, and if desired, execution in step 708 if do not need, forwards step 710 to.
Step 708 is calculated and is repainted needed parametric texture.
If judge that according to the processing requirements of the incident of monitoring needs repaint texture, the interface alternation module will be called the texture drafting module and again the source of media such as video of having drawn be refreshed, and the new source of media that perhaps reads, decodes regenerates the texture drawing data.
Example 1. will be an example with " cube rotate effect Switch Video and advertisement " below, and the method for the embodiment of the invention is described.
This example will show wmv video, Flash advertisement, mms video flowing and jpg advertisement picture respectively on A, B, C and four faces of D of a three-dimensional cube, and will be achieved as follows effect (as schematically shown in Figure 8):
1) user controls this cubical rotation by " L " on the keypad and " R " key, and the user whenever presses primary key, just this cube is revolved respectively to the left or to the right to turn 90 degrees.
2) when the video of A (or C face) just towards the user, and when being in the state of buffering, cube shows Flash advertisement and display advertising on the B (or D face) to anticlockwise 90 degree automatically; When the video buffer of A (or C face) finish can play after, cube automatically to right rotation 90 degree, begins to watch video again.
Concrete performing step is as follows:
1 draws the initialization interface
1.1 initialization DirectX graphics engine and Direct adapter, and the refresh rate of DirectX was set to for 25 frame/seconds, promptly per second redraws 25 times.
1.2 read the interface defined file.
The interface definition module reads and resolves configuration file (interface defined file) config.xml that is stored in local file system, and from config.xml, read and need to draw a cube, the length and width height is 400 pixels, and initial position is the center position of user interface.
Defined the address that needs the wmv video, Flash advertisement, mms video flowing and the jpg picture that show on A, B, C and the D face respectively in the defined file of interface.
Also require the interface alternation module to monitor video buffer incident and keyboard incident in this outer boundary defined file.
1.3 draw the cube threedimensional model.
Be built-in with cube model in the three-dimensional modeling module, need not to read outside model file.Therefore the three-dimensional modeling module reaches each leg-of-mutton size, position or the like according to the required number of triangles of three-dimensional module configurations shown information calculations institute's cube in the defined file of interface.
Picture represents the triangle parameter of module according to the computing of three-dimensional modeling module, calls the graphic interface of DirectX by adapter, draws these triangles with the speed of 25 frame/seconds, promptly repaints in the per second 25 times.
1.4 read and draw jpg advertisement picture.
The texture drafting module defines requirement according to the interface, reads the ad.jpg picture file in the local file system, and the picture in this picture file is generated the texture drawing data as texture and according to the display position of picture on cube.
Picture represents module and calls by adapter on two triangles that the api interface of DirectX graphics engine is plotted to the ad.jpg picture file in cubical D face as its texture.
1.5 load and draw the Flash advertisement
The source of media read module defines requirement according to the interface, reads the advertisement Flash file ad.swf in the local file system.Then this machine of audio/video decoding module invokes with Flash Player this SWF file of decoding, audio frequency is outputed to audio frequency represent module, video is outputed to the texture drafting module, and the texture drafting module generates the texture drawing data with video as the texture on the cube B face.
Picture represents module calls the DirectX graphics engine by adapter api interface the video pictures of ad.swf output is plotted on two triangles of cube B face.
1.6 begin to monitor the interface incident
The interface alternation module begins to monitor video and keyboard incident according to the requirement of interface definition module.
2 response video buffer incidents
2.1 begin to read and play the wmv video file, trigger the video buffer incident simultaneously.
The source of media read module reads the video file movie.wmv that is stored in local system according to the requirement of user interface definition, and gives the audio/video decoding module with the video file that reads;
The interface alternation module received the source of media read module and was connected and the video buffer incident with the video that the audio/video decoding module sends out this moment.
When sending incident, the audio/video decoding module continues to use Video Decoder (as Microsoft wmvv9) and audio decoder, video and voice data in the reduction movie.wmv file are exported to audio frequency with voice data and are represented module, and video data is exported to the texture drafting module;
Meanwhile according to the requirement of user interface definition, interface alternation resume module video buffer incident promptly began to carry out the 2.2nd step.The decoding and the 2.2nd step that it should be noted that movie.wmv carry out simultaneously.
2.2 user interactive module turn to cubical B face over against the user.
The interface alternation module is according to the requirement of user interface definition, and notice three-dimensional modeling module turn to cubical B face over against the user.
The three-dimensional modeling module will calculate from the current display position of cube, be turned to required each frame that repaints of B face clockwise, and each frame is exported to picture according to the frequency of 25 frame/seconds represent module, and picture represents module these frames are drawn out.
From user's impression, constantly draw the picture of processing with the speed of per second 25 frames, be exactly a kind of very level and smooth cube upset animation effect.
After turning, user experience to be when the movie. video in buffering time, cube can be turned to the B face automatically, shows the Flash advertisement of this face.Cube rotate to behind the B face the interface as shown in Figure 9.
2.3 begin to draw the wmv video, trigger video simultaneously and begin broadcast event.
When cube turn to the B face, the audio/video decoding module is under the cooperation of source of media read module, finished reading and decoding work of movie.wmv video file, the texture drafting module is according to user interface definition then " definition; send to show that request represents module to picture; require its video data, be plotted to cubical A face with the output of audio/video decoding module.
When sending the demonstration request, trigger video and begin broadcast event, and the interface alternation module will capture this incident, beginning execution in step 2.4.
Meanwhile, picture represents module and will constantly be plotted on the user interface according to the video requency frame data that the speed of 25 frame/seconds is come out decoding.
2.4 the interface alternation module turn to cubical A face over against the user.
When the interface alternation module captures after video begins broadcast event, will require the three-dimensional modeling module that cube is turn to the A face.
The three-dimensional modeling module is turned to calculating each frame in the process of A face, and exports to picture with the frequency of 25 frame/seconds and represent module.
In step 2.3 and step 2.4, picture represents the rendering request that module receives " cube turn to the A face " and " movie.wmv frame of video picture is plotted to the A face as texture " that three-dimensional modeling module and texture drafting module send simultaneously, when picture represents the render requests of module in conjunction with both, by calling graphics engine, during with the continuous rendered frame of speed of 25 frame/seconds, the user just can experience in the process of cube upset, and the video page or leaf on the cube A face is in the animation effect of synchronous broadcast.Cube rotation get back to behind the A face the interface as shown in Figure 8.
2.5 read and play the mms video flowing, trigger the video buffer incident simultaneously.
Similar with step 2.3, when the user was turned to cubical C face, the source of media read module read the mms video flowing of assigned address according to the requirement of user interface definition, and gives the audio/video decoding module with the video flowing that reads;
The interface alternation module received the source of media read module and was connected and the video buffer incident with the video that the audio/video decoding module sends out this moment.
When sending incident, the audio/video decoding module continues to use mms Video Decoder and audio decoder, goes back video and voice data in the original video stream, voice data is exported to audio frequency represent module, and video data is exported to the texture drafting module;
Meanwhile according to the requirement of user interface definition, interface alternation resume module video buffer incident promptly began to carry out the 2.6th step.
2.6 the interface alternation module turn to cubical D face in the face of the user.
The interface alternation module is according to the requirement of user interface definition, and notice three-dimensional modeling module turn to cubical D face over against the user.
The three-dimensional modeling module will calculate from the current display position of cube, be turned to required each frame that repaints of D face clockwise, and each frame is exported to picture according to the frequency of 25 frame/seconds represent module, and picture represents module these frames are drawn out.
From user's impression, constantly draw the picture of processing with the speed of per second 25 frames, be exactly a kind of very level and smooth cube upset animation effect.
After turning, user experience to be when the mms video flowing in buffering time, cube can be turned to the D face automatically, shows the jpg display advertising of this face.
2.7 begin to draw the mms video, and the triggering video begins broadcast event.
When cube turn to the D face, the audio/video decoding module is under the cooperation of source of media read module, finished reading and decoding work of mms video flowing, the texture drafting module is according to the definition of interface definition module then, send and show that request represents module to picture, require its video data, be plotted to cubical C face the output of audio/video decoding module.
When sending the demonstration request, trigger video and begin broadcast event, and the interface alternation module will capture this incident, beginning execution in step 2.8.
Meanwhile, picture represents module and will constantly be plotted on the user interface according to the video requency frame data that the speed of 25 frame/seconds is come out decoding.
2.8 the interface alternation module turn to cubical C face in the face of the user.
When the interface alternation module captures after video begins broadcast event, will require the three-dimensional modeling module that cube is turn to the C face.
The three-dimensional modeling module is turned to calculating each frame in the process of C face, and exports to picture with the frequency of 25 frame/seconds and represent module.
3 response user key-press incidents
3.1 the user presses lower keyboard " R " key, and cube is translated into the D face over against user's face by the A face.
When the user presses lower keyboard " R " key, " interface alternation module " will capture user's key-press event automatically, and judge by be that key, when find the user by be " R " key the time, will require the three-dimensional modeling module that cube is turned over to the right and turn 90 degrees.If over against the user be the A face time, the three-dimensional modeling module will calculate each the frame picture that is turned to the D face from the A face, and export to picture and represent module.
Picture represents module and redraws user interface by the speed of 25 frame/seconds.
3.2 the user presses lower keyboard " L " key, and cube is turned back the A face over against user's face by the D face.
When the user presses lower keyboard " L " key, " interface alternation module " will capture user's key-press event automatically, and judge by be that key, when find the user by be " L " key the time, will require the three-dimensional modeling module that cube is turned over left and turn 90 degrees.If over against the user be the D face time, the three-dimensional modeling module will calculate each the frame picture that is turned to the A face from the A face, and export to picture and represent module.
Picture represents module and redraws the interface by the speed of 25 frame/seconds, and what show to the user is the advertisement picture.
Obviously, when picture represents module and constantly repaints the picture of cube upset, also at the video movie.wmv picture of constantly drawing on the A face.Therefore the user just can experience ownly when the control cube overturns, and the video on the A face is always in continuous broadcast, and can be out of shape along with the distortion of A face along with cubical upset.
Need to prove at this, the source of media read module reads the order that wmv video, Flash advertisement, mms video flowing and texture drafting module read the jpg picture and can define by the interface defined file according to broadcast request in this example, and is not limited to above-described sequence of steps.
2. examples of example are the method that example illustrates the embodiment of the invention with " three-dimensional body superposes on video ".
This example is on an in progress video pictures, and stack shows the cube (cubical A, B, C and D face show wmv video, Flash advertisement, mms video flowing and jpg picture respectively) of going up example, as schematically shown in Figure 10.Utilize technical scheme of the present invention, this example will be showed following effect:
1) in progress background video, keypad " A " then superposes and shows a three-dimensional cube;
2) user can control cubical demonstration;
A) with the cubical rotation of keyboard " R " and " L " key control;
B) when mouse is positioned on the cube, the user utilizes in the mouse roller scalable and dwindle cube;
C) when mouse is positioned on the cube, the user presses left mouse button can pull cube, unclamps the position that the back cube will be placed to left button mouse place when unclamping.
The specific implementation flow process is as follows:
1 draws the initialization interface
1.1 initialization DirectX graphics engine and Direct adapter.And the refresh rate of DirectX was set to for 25 frame/seconds, and promptly per second redraws 25 times.
1.2 read the interface defined file
The interface definition module reads and resolves configuration file (interface defined file) config.xml that is stored in local file system.Require middle position among the Config.xml, draw the rectangle of long 400 pixels, wide 400 pixels in user interface, and on rectangle display background wmv video.
Also require the interface alternation module to monitor video buffer incident and keyboard incident in this outer boundary defined file.
1.3 read, decode and the rendering context video
The source of media read module reads the video file bk.wmv that is stored in local system according to the requirement of user interface definition, and gives the audio/video decoding module with the video file that reads;
The audio/video decoding module is used Microsoft wmv v9 Video Decoder and audio decoder, and video and voice data in the reduction bk.wmv file are exported to audio frequency with voice data and represented module, and video data is exported to the texture drafting module;
The texture drafting module is according to the definition of user interface definition, sends to show that request represents module to picture, requires its video data with the output of audio/video decoding module, is plotted on two triangles of background rectangle with the speed of 25 frame/seconds.
1.4 monitor the keyboard key-press event
After finishing the drafting at initialization interface, the interface alternation module is monitored the user key-press incident of keyboard and mouse according to the requirement of user interface definition.
2 response buttons " A " are drawn the stack cube on background video
2.1 the user presses " A " key, draws the cube threedimensional model
Require among the config.xml to draw a cube on the background video rectangle when the user presses lower keyboard " A " key, the length and width height is 200 pixels, and initial position is the center position of user interface.
Therefore when the interface alternation module listens to the user by " A " key of lower keyboard, will call three-dimensional modeling module, texture drafting module, picture and represent module and other modules according to the drafting of the flow process described in the last example " cube effect Switch Video and advertisement " cube.
2.2 continue to monitor mouse and KeyEvent
After having drawn cube, the interface alternation module continues the requirement according to user interface definition, monitors the user key-press incident of keyboard and mouse.
The cube that 3 control stacks show
3.1 the user presses " R " or " L " key, revolving cube threedimensional model
When the interface alternation module listens to the user by " R " on the lower keyboard and " L " key, will realize cubical rotation according to the flow process of describing in the step in the last example " cube effect Switch Video and advertisement " " response user key-press incident ".
3.2 the user amplifies the cube threedimensional model that contracts with mouse
When the interface alternation module listens to the scroll key at user's roll mouse middle part, judge at first whether mouse pointer is positioned at cubical viewing area, if the rotating direction of key and distance calculation go out the multiple that the cube needs amplify and dwindle in this zone then in will be according to mouse, the three-dimensional modeling module will calculate show to amplify and dwindles each frame of required drafting in the effect of process, and calls picture and represent module and draw out with the speed of 25 frame/seconds.
When this moment, the effect seen of user was exactly a scroll key when key in the own roll mouse, cube will be along with the direction and the distance of rolling, did corresponding amplification and dwindled.
3.3 the user moves the cube threedimensional model with mouse
When the interface alternation module listens to the user when pressing left mouse button (and not unclamping), judge at first whether mouse pointer is positioned at cubical viewing area, whether be moved if then continue to monitor mouse.
When mouse moves, then go out needs cube new position to display according to the distance calculation that moves.The reposition parameter that the three-dimensional modeling module constantly will show according to cube calculates each frame that will draw from the original position to the reposition, and calls picture and represent module and draw out with the speed of 25 frame/seconds.
When finding that the user unclamps left mouse button, the mouse moving incident will no longer be monitored and respond to the interface alternation module.
The effect that this moment, the user saw is that when oneself pressed left mouse button and rolling mouse on cube, cube was constantly along with the mouse pointer indication is shifted one's position.When the user unclamps left mouse button, cube will rest on the arrow locations last when unclamping left button.
Utilize the flow process of similar example, the three-dimensional body of a plurality of different shapes that can in progress video, superpose; And the in progress video that shows as a setting also can be to play on a three-dimensional body, and promptly from user's experience, a three-dimensional body is superimposed upon on another exactly.
Utilize graphics engine adapter shown in Figure 1 can adapt to the variation of various graphics engine.On the different hardware environmental basis, the embodiment of the invention just only need simply be handled can move to terminals such as set-top box (Digital Television or IPTV) and mobile phone terminal with top described scheme from computer platform.Handle for example as follows:
(1) graphics engine that can provide according to set-top box or cell phone platform, exploitation is at the new graphics adapter of this engine.Because many equipment, the graphics engine that carries as mobile phone lacks three-dimensional algorithm, function and display interface, therefore the two-dimentional display interface that provides in the new graphics engine need be provided graphics adapter, design and Implement three-dimensional algorithm, as projection, light or the like, so just can guarantee that the effect that the present invention program embodies can show processing normally on set-top box or mobile phone.
(2) because the bottom layer application program development interface collection that provides in the terminal equipment operating systems such as set-top box or mobile phone, also incomplete same with the sets of interfaces that computer operating system can provide, therefore need revise correlative code of the present invention according to the sets of interfaces that terminal operating systems such as set-top box or mobile phone provide, with guarantee to comprise that audio/video decoding, source of media read, other block code of interface management module or the like can move on new equipment normally.
As long as finished the transplanting of application program and the exploitation of new graphics engine adapter, the present invention just can realize on new operating system platform, new equipment.
One of ordinary skill in the art will appreciate that all or part of step that realizes in the foregoing description method can instruct relevant hardware to finish by program, this program can be stored in the computer read/write memory medium, such as ROM/RAM, magnetic disc, CD etc.Wherein, when said procedure by machine, when loading and carrying out as computer, this machine becomes in order to participate in system of the present invention or device.
Above-described specific embodiment; purpose of the present invention, technical scheme and beneficial effect are further described; institute is understood that; the above only is specific embodiments of the invention; and be not intended to limit the scope of the invention; within the spirit and principles in the present invention all, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (28)
1. realize the three-dimensional method of playing of medium for one kind, it is characterized in that this method comprises:
Generate the threedimensional model drawing data according to threedimensional model configurations shown information;
Read at least one source of media file of Local or Remote;
Described at least one source of media file is decoded each self-generating audio signal and video pictures signal two paths of data;
At least one circuit-switched data in the audio signal of decoding generation is play output;
Obtain a plurality of display object that comprise described video pictures according to texture configurations shown information, and will these a plurality of display object as the texture of the assigned address of threedimensional model, generate the texture drawing data; And
Receive described threedimensional model drawing data and texture drawing data, call graphics engine drawing three-dimensional model and texture to show by display interface.
2. method according to claim 1 is characterized in that, this method also comprises:
The graphics application program interface that two or more graphics engines is provided encapsulates, and a general graphics engine calling interface is provided.
3. method according to claim 1 is characterized in that, this method also comprises:
Catch the interface incident, the interface incident that mutual configuration information response captures according to the interface incident produces new threedimensional model configurations shown information and/or texture configurations shown information;
According to new threedimensional model layout configurations information and/or texture layout configurations information, corresponding renewal threedimensional model drawing data and/or texture drawing data;
According to threedimensional model drawing data and/or the texture drawing data update displayed interface upgraded.
4. method according to claim 3 is characterized in that:
Described interface incident comprises: user operation case, boundary element incident and/or timer event.
5. method according to claim 4 is characterized in that:
Described user operation case comprises: mouse moves, click and/or button operation.
6. method according to claim 4 is characterized in that:
Described boundary element incident comprises: video playback finishes, video buffer begins and/or video buffer finishes video content.
7. method according to claim 4 is characterized in that:
Described timer event comprises: integral point incident, setting-up time incident and/or every the special time incident.
8. method according to claim 3 is characterized in that, this method also comprises:
Define initial threedimensional model configurations shown information, initial texture configurations shown information and the mutual configuration information of interface incident, generate the threedimensional model drawing data according to initial threedimensional model configurations shown information, generate the texture drawing data according to initial texture configurations shown information, and the interface incident that mutual configuration information response captures according to the interface incident.
9. according to claim 1 or 8 described methods, it is characterized in that this method also comprises:
The data source address information of definition threedimensional model reads the threedimensional model file according to this data source address information to assigned address, and generates the threedimensional model drawing data based on the threedimensional model file that reads.
10. method according to claim 1 is characterized in that, this method also comprises:
The data source address information of definition display object arrives assigned address reading displayed object source file according to this data source address information, to obtain display object.
11. method according to claim 5 is characterized in that:
Described source of media file comprises: video, video flowing or Flash file.
12. method according to claim 1 is characterized in that:
Described a plurality of display object comprise in video pictures and the following object one of at least:
Flash, literal and picture.
13., it is characterized in that according to right 1 described method:
Described threedimensional model comprises three-dimensional scenic and/or three-dimensional body.
14. method according to claim 1 is characterized in that:
The described graphics engine that calls was 25 frame/seconds according to the data that receive with the frequency that threedimensional model and texture show by display interface.
15. realize the three-dimensional device of playing of medium, it is characterized in that this device comprises for one kind:
The three-dimensional modeling module is used for generating the threedimensional model drawing data according to threedimensional model configurations shown information;
Source of media file read module is used to read at least one source of media file of Local or Remote;
The audio/video decoding module is used for described at least one source of media file is decoded each self-generating audio signal and video pictures signal two paths of data;
Audio frequency represents module, and at least one circuit-switched data in the audio signal of audio/video decoding module generation is play output;
The texture drafting module is used for obtaining a plurality of display object that comprise described video pictures according to texture configurations shown information, and will these a plurality of display object as the texture of the assigned address of threedimensional model, generate the texture drawing data; And
Picture represents module, is used to receive described threedimensional model drawing data and texture drawing data, calls graphics engine drawing three-dimensional model and texture to show by display interface.
16. device according to claim 15 is characterized in that, this device also comprises:
The graphics engine adaptor module, the graphics application program interface that is used for two or more graphics engines is provided encapsulates, and a general graphics engine calling interface is provided.
17. device according to claim 15 is characterized in that, this device also comprises:
The interface alternation module, be used to catch the interface incident, the interface incident that mutual configuration information response captures according to the interface incident produces new threedimensional model configurations shown information and/or texture configurations shown information and outputs to three-dimensional modeling module and/or texture drafting module respectively;
Described three-dimensional modeling module and/or texture drafting module receive described new threedimensional model hour configuration information and/or texture configurations shown information respectively, and corresponding renewal threedimensional model drawing data and/or texture drawing data.
18. device according to claim 17 is characterized in that:
Described interface incident comprises: user operation case, boundary element incident and/or timer event.
19. device according to claim 18 is characterized in that:
Described user operation case comprises: mouse moves, click and/or button operation.
20. device according to claim 18 is characterized in that:
Described boundary element incident comprises: video playback finishes, video buffer begins and/or video buffer finishes video content.
21. device according to claim 18 is characterized in that:
Described timer event comprises: integral point incident, setting-up time incident and/or every the special time incident.
22. device according to claim 17 is characterized in that, this device also comprises:
The interface definition module is used to define initial threedimensional model configurations shown information, initial texture configurations shown information and the mutual configuration information of interface incident, and provides respectively to described three-dimensional modeling module, texture drafting module and interface alternation module.
23. device according to claim 22 is characterized in that:
Described interface definition module also defines the data source address information of threedimensional model;
This device comprises that also threedimensional model imports module, is used for reading the threedimensional model file according to this data source address information to assigned address, and described threedimensional model drafting module generates the threedimensional model drawing data based on the threedimensional model file that reads.
24. device according to claim 15 is characterized in that, this device also comprises:
Described interface definition module also defines the data source address information of display object, and described texture drafting module arrives assigned address reading displayed object source file according to this data source address information, to obtain display object.
25. device according to claim 15 is characterized in that:
Described source of media file comprises: video, video flowing or Flash file.
26. device according to claim 15 is characterized in that:
Described a plurality of display object comprise in video pictures and the following object one of at least:
Flash, literal and picture.
27., it is characterized in that according to right 15 described devices:
Described threedimensional model comprises three-dimensional scenic and/or three-dimensional body.
28. device according to claim 15 is characterized in that:
It was 25 frame/seconds that described picture represents the frequency that the module invokes graphics engine refreshes display interface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008101180415A CN101340598A (en) | 2008-08-07 | 2008-08-07 | Method and apparatus for implementing three-dimensional playing of media |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2008101180415A CN101340598A (en) | 2008-08-07 | 2008-08-07 | Method and apparatus for implementing three-dimensional playing of media |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101340598A true CN101340598A (en) | 2009-01-07 |
Family
ID=40214529
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2008101180415A Pending CN101340598A (en) | 2008-08-07 | 2008-08-07 | Method and apparatus for implementing three-dimensional playing of media |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101340598A (en) |
Cited By (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102147926A (en) * | 2011-01-17 | 2011-08-10 | 中兴通讯股份有限公司 | Three-dimensional (3D) icon processing method and device and mobile terminal |
| CN102523473A (en) * | 2011-12-01 | 2012-06-27 | 中兴通讯股份有限公司 | Three-dimensional interface display device, method and terminal |
| CN102523461A (en) * | 2011-11-25 | 2012-06-27 | 北京东方艾迪普科技发展有限公司 | Dynamic three-dimension supporting multi-source access large-screen playing method |
| CN102685417A (en) * | 2011-03-17 | 2012-09-19 | 青岛海信电器股份有限公司 | Method for switching channels of television, device and television |
| CN102789348A (en) * | 2011-05-18 | 2012-11-21 | 北京东方艾迪普科技发展有限公司 | Interactive three dimensional graphic video visualization system |
| CN102830978A (en) * | 2012-08-23 | 2012-12-19 | 上海创图网络科技发展有限公司 | Visual 3D (third-generation) programming system and application thereof |
| CN102917237A (en) * | 2012-06-21 | 2013-02-06 | 深圳市茁壮网络股份有限公司 | Three-dimensional (3D) video playing method, device and system |
| CN102915686A (en) * | 2011-08-06 | 2013-02-06 | 董亮 | Mobile terminal advertisement showing method based on three-dimensional scene |
| CN102999245A (en) * | 2012-03-23 | 2013-03-27 | 广州市凡拓数码科技有限公司 | Realization method, realization system and manufacturing method for electronic single building body |
| CN102999244A (en) * | 2012-03-23 | 2013-03-27 | 广州市凡拓数码科技有限公司 | Realization method, realization system and manufacturing method for exhibition of electronic house type |
| CN103456035A (en) * | 2013-09-06 | 2013-12-18 | 福建星网视易信息系统有限公司 | Device and method for achieving video three-dimensional display |
| CN103729190A (en) * | 2013-12-31 | 2014-04-16 | 天津华永无线科技有限公司 | Method for displaying unified parsing of multiple media on mobile terminal |
| CN103796064A (en) * | 2014-02-21 | 2014-05-14 | 深圳创维－Rgb电子有限公司 | Play method, player and display device |
| WO2015018299A1 (en) * | 2013-08-07 | 2015-02-12 | 北京奇虎科技有限公司 | Method and device for implementing a user interface |
| CN105007480A (en) * | 2015-07-06 | 2015-10-28 | 上海玮舟微电子科技有限公司 | Naked-eye three-dimensional (3D) display method and system for 3D data |
| CN105812764A (en) * | 2014-12-30 | 2016-07-27 | 孙彬丰 | Three dimensional image generation method for instant plaster picture |
| CN105898483A (en) * | 2015-12-30 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Virtual interactive video play method and play device |
| CN105915885A (en) * | 2016-03-02 | 2016-08-31 | 优势拓展（北京）科技有限公司 | 3D interaction display method and system of fish-eye image |
| CN107239268A (en) * | 2016-03-29 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of method for processing business, device and intelligent terminal |
| CN108786113A (en) * | 2018-05-25 | 2018-11-13 | 腾讯科技(成都)有限公司 | data playing method and device, storage medium and electronic device |
| CN109510990A (en) * | 2018-10-25 | 2019-03-22 | 深圳市腾讯信息技术有限公司 | Image processing method and device, computer readable storage medium, electronic equipment |
| CN109523614A (en) * | 2018-11-28 | 2019-03-26 | 珠海金山网络游戏科技有限公司 | A kind of 3D animation deriving method, 3D animation playing method and device |
| CN110149509A (en) * | 2019-04-11 | 2019-08-20 | 宁波大学 | A kind of three-dimensional video-frequency method for relocating |
| US11113874B2 (en) | 2018-05-31 | 2021-09-07 | Advanced New Technologies Co., Ltd. | Displaying rich text on 3D models |
| WO2021232931A1 (en) * | 2020-05-20 | 2021-11-25 | 中兴通讯股份有限公司 | Channel switching method and apparatus, and device, system, and storage medium |
-
2008
- 2008-08-07 CN CNA2008101180415A patent/CN101340598A/en active Pending
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102147926A (en) * | 2011-01-17 | 2011-08-10 | 中兴通讯股份有限公司 | Three-dimensional (3D) icon processing method and device and mobile terminal |
| WO2012097556A1 (en) * | 2011-01-17 | 2012-07-26 | 中兴通讯股份有限公司 | Three dimensional (3d) icon processing method, device and mobile terminal |
| CN102685417B (en) * | 2011-03-17 | 2015-09-16 | 青岛海信电器股份有限公司 | The method of television set zapping, device and television set |
| CN102685417A (en) * | 2011-03-17 | 2012-09-19 | 青岛海信电器股份有限公司 | Method for switching channels of television, device and television |
| CN102789348A (en) * | 2011-05-18 | 2012-11-21 | 北京东方艾迪普科技发展有限公司 | Interactive three dimensional graphic video visualization system |
| CN102915686A (en) * | 2011-08-06 | 2013-02-06 | 董亮 | Mobile terminal advertisement showing method based on three-dimensional scene |
| CN102523461A (en) * | 2011-11-25 | 2012-06-27 | 北京东方艾迪普科技发展有限公司 | Dynamic three-dimension supporting multi-source access large-screen playing method |
| CN102523473A (en) * | 2011-12-01 | 2012-06-27 | 中兴通讯股份有限公司 | Three-dimensional interface display device, method and terminal |
| CN102523473B (en) * | 2011-12-01 | 2016-08-31 | 南京中兴软件有限责任公司 | A kind of three-dimensional interface display device, method and terminal |
| WO2013078859A1 (en) * | 2011-12-01 | 2013-06-06 | 中兴通讯股份有限公司 | Three-dimensional interface display device, method and terminal |
| CN102999245A (en) * | 2012-03-23 | 2013-03-27 | 广州市凡拓数码科技有限公司 | Realization method, realization system and manufacturing method for electronic single building body |
| CN102999244A (en) * | 2012-03-23 | 2013-03-27 | 广州市凡拓数码科技有限公司 | Realization method, realization system and manufacturing method for exhibition of electronic house type |
| CN102917237B (en) * | 2012-06-21 | 2015-11-11 | 深圳市茁壮网络股份有限公司 | A kind of 3D video broadcasting method, device and system |
| CN102917237A (en) * | 2012-06-21 | 2013-02-06 | 深圳市茁壮网络股份有限公司 | Three-dimensional (3D) video playing method, device and system |
| CN102830978A (en) * | 2012-08-23 | 2012-12-19 | 上海创图网络科技发展有限公司 | Visual 3D (third-generation) programming system and application thereof |
| WO2015018299A1 (en) * | 2013-08-07 | 2015-02-12 | 北京奇虎科技有限公司 | Method and device for implementing a user interface |
| CN103456035A (en) * | 2013-09-06 | 2013-12-18 | 福建星网视易信息系统有限公司 | Device and method for achieving video three-dimensional display |
| CN103729190A (en) * | 2013-12-31 | 2014-04-16 | 天津华永无线科技有限公司 | Method for displaying unified parsing of multiple media on mobile terminal |
| CN103729190B (en) * | 2013-12-31 | 2017-01-04 | 天津华永无线科技有限公司 | The method that various kinds of media analytic uniform shows on mobile terminals |
| CN103796064A (en) * | 2014-02-21 | 2014-05-14 | 深圳创维－Rgb电子有限公司 | Play method, player and display device |
| CN103796064B (en) * | 2014-02-21 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | Player method, player and display device |
| CN105812764A (en) * | 2014-12-30 | 2016-07-27 | 孙彬丰 | Three dimensional image generation method for instant plaster picture |
| CN105007480A (en) * | 2015-07-06 | 2015-10-28 | 上海玮舟微电子科技有限公司 | Naked-eye three-dimensional (3D) display method and system for 3D data |
| CN105898483A (en) * | 2015-12-30 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Virtual interactive video play method and play device |
| CN105915885A (en) * | 2016-03-02 | 2016-08-31 | 优势拓展（北京）科技有限公司 | 3D interaction display method and system of fish-eye image |
| CN107239268A (en) * | 2016-03-29 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of method for processing business, device and intelligent terminal |
| CN108786113A (en) * | 2018-05-25 | 2018-11-13 | 腾讯科技(成都)有限公司 | data playing method and device, storage medium and electronic device |
| US11113874B2 (en) | 2018-05-31 | 2021-09-07 | Advanced New Technologies Co., Ltd. | Displaying rich text on 3D models |
| CN109510990A (en) * | 2018-10-25 | 2019-03-22 | 深圳市腾讯信息技术有限公司 | Image processing method and device, computer readable storage medium, electronic equipment |
| CN109523614A (en) * | 2018-11-28 | 2019-03-26 | 珠海金山网络游戏科技有限公司 | A kind of 3D animation deriving method, 3D animation playing method and device |
| CN109523614B (en) * | 2018-11-28 | 2023-01-03 | 珠海金山数字网络科技有限公司 | 3D animation export method, 3D animation playing method and device |
| CN110149509A (en) * | 2019-04-11 | 2019-08-20 | 宁波大学 | A kind of three-dimensional video-frequency method for relocating |
| CN110149509B (en) * | 2019-04-11 | 2020-10-27 | 宁波大学 | Three-dimensional video repositioning method |
| WO2021232931A1 (en) * | 2020-05-20 | 2021-11-25 | 中兴通讯股份有限公司 | Channel switching method and apparatus, and device, system, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101340598A (en) | Method and apparatus for implementing three-dimensional playing of media | |
| CN111861561B (en) | Advertisement information positioning and displaying method and corresponding device, equipment and medium thereof | |
| CN113244614B (en) | Image picture display method, device, equipment and storage medium | |
| CN103456254A (en) | Multi-touch interactive multimedia digital signage system | |
| CN102750724A (en) | Three-dimensional and panoramic system automatic-generation method based on images | |
| CN103679204A (en) | Image identification and creation application system and method based on intelligent mobile device platform | |
| CA2406047A1 (en) | A graphical user interface for digital media and network portals using detail-in-context lenses | |
| CN108668168B (en) | Android VR video player based on Unity3D and design method thereof | |
| CN109508090B (en) | Augmented reality panel system with interchangeability | |
| CN103384311B (en) | Interdynamic video batch automatic generation method | |
| CN107911737A (en) | Methods of exhibiting, device, computing device and the storage medium of media content | |
| CN114245228B (en) | Page link release method and device and electronic equipment | |
| TW201510900A (en) | Incentives for acknowledging product advertising within media content | |
| CN113660528B (en) | Video synthesis method and device, electronic equipment and storage medium | |
| CN112135161A (en) | Dynamic effect display method and device of virtual gift, storage medium and electronic equipment | |
| WO2024077909A1 (en) | Video-based interaction method and apparatus, computer device, and storage medium | |
| CN112261433A (en) | Virtual gift sending method, virtual gift display device, terminal and storage medium | |
| US20240169595A1 (en) | Method for analyzing user input regarding 3d object, device, and non-transitory computer-readable recording medium | |
| US20150352442A1 (en) | Game having a Plurality of Engines | |
| EP1890262A1 (en) | Virtual 3D models for display | |
| CN117579885A (en) | Special effect display method and system for live broadcasting room | |
| CN113132800A (en) | Video processing method and device, video player, electronic equipment and readable medium | |
| WO2022183967A1 (en) | Video picture display method and apparatus, and device, medium and program product | |
| KR101842108B1 (en) | More than 4k ultra-high resolution embedded system based on extended multi-dispaly avainlable for real-time interaction | |
| CN117215442A (en) | Display processing method, display processing device, electronic device, storage medium, and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20090107 |