CN101425863B - Mobile terminal for supporting rich media service - Google Patents
Mobile terminal for supporting rich media service Download PDFInfo
- Publication number
- CN101425863B CN101425863B CN2007101637623A CN200710163762A CN101425863B CN 101425863 B CN101425863 B CN 101425863B CN 2007101637623 A CN2007101637623 A CN 2007101637623A CN 200710163762 A CN200710163762 A CN 200710163762A CN 101425863 B CN101425863 B CN 101425863B
- Authority
- CN
- China
- Prior art keywords
- scene
- module
- stream
- mobile terminal
- demultiplexing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 25
- 238000012545 processing Methods 0.000 claims abstract description 10
- 230000003993 interaction Effects 0.000 claims description 23
- 238000012423 maintenance Methods 0.000 claims description 8
- 230000001360 synchronised effect Effects 0.000 claims description 7
- 238000000034 method Methods 0.000 abstract description 6
- 230000008569 process Effects 0.000 abstract description 6
- 230000007547 defect Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a mobile terminal supporting rich media services, which is characterized in that the mobile terminal comprises a network transmission module, a de-multiplexing module, an AV stream decoding module, a TT stream decoding module and a scene processing module; the mobile terminal which supports rich media services and is formed by connecting the modules can update scenes in the using process of services and solve the problem that each medium takes up excessive socket resources in the services.
Description
Technical Field
The present invention relates to a mobile terminal, and in particular, to a mobile terminal supporting rich media services.
Background
Rich media (a dynamic interactive set of multimedia data such as audio, video, graphics, text, etc.) is no longer fresh when being transmitted over the internet and played by a PC, but for mobile terminal devices, rich media has not been widely used due to the problems of high latency, low bandwidth of wireless networks, low performance of terminal devices, non-uniform screen resolution, etc.
MPEG-4 bifs (binary Format for scenes) cannot be applied to a mobile terminal because its content organization and binary coding structure do not consider the characteristics of a mobile system. FLASH, the primary form of rich media on PCs, has enjoyed great success on the internet, but is not commercially supported to a greater extent due to its proprietary aspects, particularly on mobile platforms.
At present, when an svg (scalable Vector graphics) technology is used to implement rich media service, the following defects exist: (1) in the process of using the service, the scene is not updated and is displayed after being downloaded to the mobile terminal at one time; (2) aiming at each media type needing to interact with the outside in a scene, a single TCP or UDP socket needs to be established with a corresponding server, so that a lot of socket resources are occupied, even a complex application scene cannot be provided due to the limitation of the number of sockets supported by a mobile terminal (generally, only a few sockets), and the further development of services is limited.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a mobile terminal supporting rich media service, so as to solve the following defects existing in the prior SVG technology when realizing rich media service: (1) in the process of using the service, the scene is not updated and is displayed after being downloaded to the mobile terminal at one time; (2) aiming at the problems that each media type needing to interact with the outside in a scene needs to establish a single TCP or UDP socket with a corresponding server, occupies a lot of socket resources, even cannot provide a complex application scene because of being limited by the number of sockets supported by a mobile terminal, and limits the further development of services.
In order to solve the above problem, the present invention provides a mobile terminal supporting a rich media service, comprising: the system comprises a network transmission module, a demultiplexing module, an AV stream decoding module, a TT stream decoding module, a scene tree maintenance module, a scene synchronization and display module, a scene event module, a scene remote interaction module and a scene application module; wherein,
the network transmission module is used for taking charge of content transmission between the mobile terminal and the remote server; receiving a multiplexing stream transmitted by a remote server, and sending the multiplexing stream to the demultiplexing module; receiving a scene acquisition command sent by a scene remote interaction module of the mobile terminal, and sending the scene acquisition command to the remote server;
the demultiplexing module is used for demultiplexing the multiplexed stream sent by the network transmission module, demultiplexing a single stream into an audio/video (AV) stream and a synchronous text (TT) stream, and sending the AV stream and the TT stream to the AV stream decoding module for use;
the AV stream decoding module is used for decoding and caching the audio/video AV stream sent by the demultiplexing module according to a specified audio/video coding format, and playing the audio/video AV stream under the control of the scene processing module;
the TT stream decoding module is used for decoding and caching the synchronous text TT stream sent by the demultiplexing module and outputting the TT stream under the control of the scene processing module;
the scene processing module is used for decoding and caching the scene stream sent by the demultiplexing module, operating the scene tree according to the decoded scene replacing or updating command and the scene content, and establishing and maintaining the scene tree; and controlling time synchronization, drawing and playing among the media streams; the system is responsible for receiving various DOM events and locally controlling the management and scene display of the scene tree; when interaction with a remote server is needed, a replacement scene or an update scene is obtained through the network transmission module; and for scheduling and messaging by other modules, and to provide associated user interfaces for use by user input devices.
The mobile terminal of the present invention, wherein the scene processing module includes: a scene stream decoding module, a scene tree maintenance module, a scene synchronization and presentation module, a scene event module, a scene remote interaction module and a scene application module, wherein,
the scene stream decoding module is used for decoding and caching the scene stream sent by the demultiplexing module and outputting an access unit;
the scene tree maintenance module is used for operating the scene tree according to the scene replacing or updating command and the scene content decoded by the demultiplexing module, and establishing and maintaining the scene tree;
the scene synchronization and display module is used for controlling time synchronization, drawing and playing among the media streams according to the scene event module and the script program;
the scene event module is used for receiving various DOM events and locally controlling the management and scene display of the scene tree; when interaction with a remote server is needed, the scene remote interaction module is controlled to acquire a replacement scene or an update scene;
the scene remote interaction module is used for acquiring a replacement scene or an update scene on a remote server through the network transmission module under the control of the scene event module;
the scene application module is used for being responsible for scheduling and message transmission of other modules and providing related user interfaces for user input equipment to use.
The mobile terminal of the present invention, wherein the demultiplexing module is further configured to demultiplex a single stream into other media streams.
Wherein, further include: and the other media stream decoding module is used for decoding and caching the other media streams sent by the demultiplexing module, and outputting the other media streams under the control of the scene synchronization and display module.
The mobile terminal of the invention, wherein the scene application module is a main control module of the scene application.
The mobile terminal of the invention can update scenes in the process of using services and solve the problem that each media occupies too much socket resources in the services.
Drawings
Fig. 1 is a detailed structural diagram of a mobile terminal supporting rich media service according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating operations between mobile terminal modules supporting a rich media service according to an embodiment of the present invention;
fig. 3 is a block diagram of a mobile terminal supporting a rich media service according to an embodiment of the present invention.
Detailed Description
The invention provides a mobile terminal supporting rich media service, which solves the following defects existing in the prior SVG technology when realizing rich media service: (1) in the process of using the service, the scene is not updated and is displayed after being downloaded to the mobile terminal at one time; (2) aiming at the problems that each media type needing to interact with the outside in a scene needs to establish a single TCP or UDP socket with a corresponding server, occupies a lot of socket resources, even cannot provide a complex application scene because of being limited by the number of sockets supported by a mobile terminal, and limits the further development of services. The following detailed description of the embodiments is not intended to limit the invention.
Fig. 3 is a block diagram of a mobile terminal supporting a rich media service according to the present invention. The general idea of the invention is as follows: a scene transmission link is maintained between the mobile terminal and the remote server, the mobile terminal initially downloads a basic scene, and when the scene needs to be updated remotely, a scene updating command is sent through the transmission link to the remote server to acquire a replacement scene or scene updating content. Therefore, the remote server can continuously transmit the changed scenes to the mobile terminal for showing.
In order to solve the problem that each medium occupies too much socket resources in the existing service, and simultaneously, in order to reduce a large amount of delay caused by too many transmission links and better perform time synchronization among each medium, each medium can be multiplexed in one link for transmission. The media are multiplexed in a link at the remote server and demultiplexed at the mobile terminal.
As shown in fig. 1, the mobile terminal supporting rich media service proposed by the present invention includes the following modules: the system comprises a network transmission module, a demultiplexing module, an AV stream decoding module, a TT stream decoding module, other media stream decoding modules, a scene stream decoding module, a scene tree maintenance module, a scene synchronization and display module, a scene event module, a scene remote interaction module and a scene application module; wherein,
and the network transmission module is used for taking charge of content transmission between the mobile terminal and the remote server. Receiving a multiplexing stream transmitted by a remote server, and transmitting the multiplexing stream to a demultiplexing module; receiving a scene acquisition command sent by a scene remote interaction module of the mobile terminal, and sending the scene acquisition command to a remote server;
the demultiplexing module: the device is used for demultiplexing the multiplexed stream sent by the network transmission module, and demultiplexing a single stream into an Audio/Video (AV) stream, a synchronous text TT (TimedText) stream and other media streams for each media stream decoding module to use;
the AV stream decoding module is used for decoding and caching the audio and video stream sent by the demultiplexing module according to a specified audio and video coding format, and playing the audio and video stream under the control of the scene synchronization and display module;
the TT stream decoding module is used for decoding and caching the synchronous text sent by the demultiplexing module and outputting the synchronous text under the control of the scene synchronization and display module;
the other media stream decoding module is used for decoding and caching other media streams (such as JPG pictures) sent by the demultiplexing module, and outputting the other media streams under the control of the scene synchronization and display module;
the scene stream decoding module is used for decoding and caching the scene stream sent by the demultiplexing module and outputting an access unit;
the scene tree maintenance module is used for operating the scene tree according to the decoded scene replacing or updating command and the scene content, and establishing and maintaining the scene tree;
the scene synchronization and display module is used for controlling time synchronization, drawing and playing among the media according to the scene event and the script program;
the scene event module is used for receiving various Document Object Model (DOM) (documentobject model) events, and locally controlling the management and scene display of a scene tree; when interaction with a remote server is needed, a scene remote interaction module is controlled to acquire a replacement scene or an update scene;
and the scene remote interaction module is used for acquiring a replacement scene or an updated scene on the remote server through the network transmission module under the control of the scene event.
The scene application module is a main control module of the scene application and is used for being responsible for scheduling and message transmission of other modules and providing related user interfaces for user input equipment to use.
As shown in fig. 2, the steps of the flow of the specific implementation operation among the modules of the mobile terminal according to the present invention are as follows:
(1) the demultiplexing module demultiplexes the transmitted multiplexing stream into media streams such as scene streams, audios and videos and the like;
(2) the audio and video stream and the like are decoded by a media stream decoding module such as the audio and video stream and the like, and each decoded media data is output and output under the control of the scene synchronization and display module;
(3) the scene stream is decoded by a scene stream decoding module and is output to an access unit;
(4) the scene tree maintenance module operates the scene tree according to the decoded scene replacing or updating command and the scene content to establish and maintain the scene tree;
(5) the scene synchronization and display module performs actual display of a scene according to the constructed scene tree and the decoded media data such as audio and video;
(6) the scene event module receives DOM events and carries out local interaction and remote interaction according to different operation objects; and during local interaction, the scene tree is controlled to change and the scene is displayed, and during remote interaction, the scene remote interaction module is controlled to acquire or update the scene from a remote server.
By adopting the mobile terminal provided by the embodiment of the invention, the scene can be updated in the process of using the service, and the problem that each media occupies too much socket resources in the service is solved.
The present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof, and it is therefore intended that all such changes and modifications as fall within the true spirit and scope of the invention be considered as within the following claims.
Claims (5)
1. A mobile terminal supporting a rich media service, comprising: the system comprises a network transmission module, a demultiplexing module, an AV stream decoding module, a TT stream decoding module and a scene processing module; wherein,
the network transmission module is used for taking charge of content transmission between the mobile terminal and the remote server; receiving a multiplexing stream transmitted by a remote server, and sending the multiplexing stream to the demultiplexing module; receiving a scene acquisition command sent by a scene remote interaction module of the mobile terminal, and sending the scene acquisition command to the remote server;
the demultiplexing module is used for demultiplexing the multiplexed stream sent by the network transmission module, demultiplexing a single stream into an audio/video (AV) stream and a synchronous text (TT) stream, and sending the AV stream and the TT stream to the AV stream decoding module for use;
the AV stream decoding module is used for decoding and caching the audio/video AV stream sent by the demultiplexing module according to a specified audio/video coding format, and playing the audio/video AV stream under the control of the scene processing module;
the TT stream decoding module is used for decoding and caching the synchronous text TT stream sent by the demultiplexing module and outputting the TT stream under the control of the scene processing module;
the scene processing module is used for decoding and caching the scene stream sent by the demultiplexing module, operating the scene tree according to the decoded scene replacing or updating command and the scene content, and establishing and maintaining the scene tree; and controlling time synchronization, drawing and playing among the media streams; the system is responsible for receiving various Document Object Model (DOM) events and locally controlling the management and scene display of a scene tree; when interaction with a remote server is needed, a replacement scene or an update scene is obtained through the network transmission module; and for scheduling and messaging by other modules, and to provide associated user interfaces for use by user input devices.
2. The mobile terminal of claim 1, wherein the scene processing module comprises: a scene stream decoding module, a scene tree maintenance module, a scene synchronization and presentation module, a scene event module, a scene remote interaction module and a scene application module, wherein,
the scene stream decoding module is used for decoding and caching the scene stream sent by the demultiplexing module and outputting an access unit;
the scene tree maintenance module is used for operating the scene tree according to the scene replacing or updating command and the scene content decoded by the demultiplexing module, and establishing and maintaining the scene tree;
the scene synchronization and display module is used for controlling time synchronization, drawing and playing among the media streams according to the scene event module and the script program;
the scene event module is used for receiving various Document Object Model (DOM) events and locally controlling the management and scene display of a scene tree; when interaction with a remote server is needed, the scene remote interaction module is controlled to acquire a replacement scene or an update scene;
the scene remote interaction module is used for acquiring a replacement scene or an update scene on a remote server through the network transmission module under the control of the scene event module;
the scene application module is used for being responsible for scheduling and message transmission of other modules and providing related user interfaces for user input equipment to use.
3. The mobile terminal of claim 1, wherein the demultiplexing module is further configured to demultiplex a single stream into other media streams.
4. The mobile terminal of claim 3, further comprising: and the other media stream decoding module is used for decoding and caching the other media streams sent by the demultiplexing module, and outputting the other media streams under the control of the scene synchronization and display module.
5. The mobile terminal of claim 2, wherein the scene application module is a master control module for a scene application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007101637623A CN101425863B (en) | 2007-10-30 | 2007-10-30 | Mobile terminal for supporting rich media service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007101637623A CN101425863B (en) | 2007-10-30 | 2007-10-30 | Mobile terminal for supporting rich media service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101425863A CN101425863A (en) | 2009-05-06 |
| CN101425863B true CN101425863B (en) | 2011-03-23 |
Family
ID=40616226
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007101637623A Expired - Fee Related CN101425863B (en) | 2007-10-30 | 2007-10-30 | Mobile terminal for supporting rich media service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101425863B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101963953B (en) * | 2010-09-08 | 2012-05-23 | 东莞电子科技大学电子信息工程研究院 | Cache optimization method for mobile rich media player |
| CN101945106B (en) * | 2010-09-08 | 2013-03-27 | 东莞电子科技大学电子信息工程研究院 | Transmission method of rich media scene in broadcast network |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1230076A (en) * | 1998-03-24 | 1999-09-29 | 三菱电机株式会社 | Digital video receiving apparatus |
| CN1317909A (en) * | 2000-04-04 | 2001-10-17 | 皇家菲利浦电子有限公司 | Network of forming one joint point in one data stream, its transmitting terminal and method thereof |
| CN1578503A (en) * | 2003-07-21 | 2005-02-09 | 三星电子株式会社 | Apparatus and method for processing a multimedia audio signal during a voice call |
-
2007
- 2007-10-30 CN CN2007101637623A patent/CN101425863B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1230076A (en) * | 1998-03-24 | 1999-09-29 | 三菱电机株式会社 | Digital video receiving apparatus |
| CN1317909A (en) * | 2000-04-04 | 2001-10-17 | 皇家菲利浦电子有限公司 | Network of forming one joint point in one data stream, its transmitting terminal and method thereof |
| CN1578503A (en) * | 2003-07-21 | 2005-02-09 | 三星电子株式会社 | Apparatus and method for processing a multimedia audio signal during a voice call |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101425863A (en) | 2009-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101888409B (en) | Remote information issuing and monitoring system based on wide area network and control method thereof | |
| CN101917391B (en) | Method for playing network video and system for playing network video | |
| US11025982B2 (en) | System and method for synchronizing content and data for customized display | |
| CN104683884A (en) | Live method and system for stream medium | |
| CN106134146A (en) | Process continuous print multicycle content | |
| CN101478636A (en) | Game system based on IPTV and implementation method thereof | |
| CN111355976B (en) | Video live broadcast method and system based on HEVC standard | |
| CN102577416B (en) | The methods, devices and systems of content of multimedia are exported for selectivity | |
| CN105812377A (en) | Transport mechanisms for dynamic rich media scenes | |
| CN101883097A (en) | Method and device for realizing that server equipment shares screen of client equipment | |
| US20080271097A1 (en) | System And Method For Receiving And Playing Network Television Programs | |
| US11558654B2 (en) | System and method for operating a transmission network | |
| CN104883375A (en) | Digital media information issuing operation management cloud platform system and video playing method thereof | |
| JP2016508679A (en) | System, apparatus, and method for sharing a screen having multiple visual components | |
| CN103945141A (en) | Video processing appartaus, method and server | |
| CN105898506A (en) | Method and system for multi-screen playing of media files | |
| CN101594538A (en) | A kind of advertisement in digital television player method and system | |
| CN113055712A (en) | Multi-screen splicing display method and system | |
| CN101127780A (en) | Method for downloading, saving and replaying online video and construction of online video network | |
| CN106209824A (en) | The cloud edit methods of data, system and the client of cloud editor | |
| CN101425863B (en) | Mobile terminal for supporting rich media service | |
| CN101299709A (en) | Flow type medium server system based on internet | |
| EP2814256A1 (en) | Method and apparatus for modifying a stream of digital content | |
| WO2012113460A1 (en) | Method and system for combining more than one content data to a single resulting media and making this resulting media available to a content directory service (upnp) or digital media server (dlna) | |
| JP5709277B2 (en) | Method and apparatus for distributing multimedia content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20160608 Address after: 100004, room 7, building 1, building 19, building No. A, main street, Chaoyang District, Beijing Patentee after: CHINA HOPE INTERNATIONAL TECHNOLOGY CO., LTD. Address before: 518057 Nanshan District high tech Industrial Park, Guangdong, South Road, science and technology, ZTE building, legal department Patentee before: ZTE Corporation |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110323 Termination date: 20171030 |