WO2012079385A1

WO2012079385A1 - Mobile terminal and video playing method therefor

Info

Publication number: WO2012079385A1
Application number: PCT/CN2011/078772
Authority: WO
Inventors: 王涛; 邵永平; 黄伟; 杨建江
Original assignee: 中兴通讯股份有限公司
Priority date: 2010-12-15
Filing date: 2011-08-23
Publication date: 2012-06-21
Also published as: CN102098511A

Abstract

The present invention provides a mobile terminal and a video playing method therefor. The method comprises the following steps: the mobile terminal establishing a video service connection to a computing entity; the mobile terminal transmitting video data-to-be-decoded to a client software installed on the computing entity, calling via the client software a video decoder of the computing entity to perform video decoding, and receiving a stream of framed data returned by the computing entity. In the mobile terminal and the video playing method therefor provided in the present invention, the video service connection is established between the mobile terminal and the computing entity having an established wireless connection; via a push to the client software of the computing entity, the video decoder of the computing entity is called to perform data decoding; the stream of framed data returned by the computing entity is received and processed; and the video is played via an video player of the mobile terminal. This allows for improved video playing performance of the mobile terminal, and reduced power consumption, without incurring additional user expense, thereby reducing costs.

Description

Method for realizing mobile terminal and video playing thereof

The present invention relates to the field of communications technologies, and in particular, to a mobile terminal and a method for implementing video playback. Background technique

After entering the third generation mobile communication (3G) era, the functions of mobile terminals are becoming more and more abundant, especially the video playback function has gradually become a more commonly used function for mobile terminal users. However, compared with the computer, the computing processing and video decoding capabilities of the mobile terminal are relatively weak, which may cause the user to pause and the image is not smooth when playing video through the mobile terminal.

Therefore, the processing performance of the mobile terminal can be improved by using a higher performance ARM processor and a mobile application processor in the mobile terminal, and the effect of the video playback by the mobile terminal is also improved. However, as the processing performance of mobile terminals is improved, the power consumption will also increase. At the same time, due to the price factor of high-performance processors, the popularity of high-performance processors will take time, so that they occupy a considerable market share. The current situation of weak computing power of low-end mobile terminals and functional mobile terminals has not been effectively solved.

Another method is: through the cloud computing, specifically for the mobile terminal to access the 3G network or the Internet, through the data center, to obtain the powerful computing and storage capabilities provided by the distributed processing. However, the method needs to occupy the bandwidth of the communication network, and the user's tariff is high; and in order to maintain the connection of the network, the radio part of the mobile terminal also needs to consume a large amount of power. Summary of the invention

In view of this, the main purpose of the present invention is to provide a mobile terminal and a method for implementing video playback thereof, which can improve video playback performance of the mobile terminal itself and reduce power consumption. In order to achieve the above object, the technical solution of the present invention is achieved as follows:

A method for implementing video playback of a mobile terminal, where the method includes:

The mobile terminal establishes a video service connection with the computing entity;

The mobile terminal sends the video data to be decoded to the client software installed in the computing entity, and the video decoder of the computing entity is called by the client software to perform data decoding, and receives the frame data stream returned by the computing entity.

Further, before the mobile terminal establishes a video service connection with the computing entity, the method further includes:

The mobile terminal searches for a computing entity by using a short-range wireless communication method;

The mobile terminal sends a wireless connection request to the searched computing entity, and upon receiving the agreed access information returned by the computing entity, establishes a wireless connection with the computing entity.

The mobile terminal establishes a video service connection with the computing entity as:

The mobile terminal pushes the pre-stored client software to the computing entity that has established the wireless connection; after receiving the installed client software information returned by the computing entity, the mobile terminal starts its own transmission adaptation task sub-module, completes and calculates the entity. The establishment of a video service connection.

Further, after the mobile terminal establishes a video service connection with the computing entity, the method further includes:

After receiving the remote video decoding mode selection information input by the user, the mobile terminal enables the remote video decoding mode;

Stop the digital signal processor DSP software task of the mobile terminal, cut off the data communication between the CPU and DSP of the mobile terminal, and put the DSP into a sleep state.

The mobile terminal sends the video data to be decoded to the client software installed in the computing entity, and the video decoder of the computing entity is called by the client software to decode the data as:

The mobile terminal starts its own virtual coprocessor task module and receives the sent by its own CPU. The decoded video data is buffered, and the video data and the local decoding command are encapsulated into a data packet format and sent to the transmission adaptation task sub-module;

After the transmission adaptation task sub-module performs the wireless protocol data format conversion on the received data, the wireless task module sent to the mobile terminal is sent by the wireless task module to the wireless task module of the computing entity;

The wireless task module of the computing entity sends the received data to the client software, and the client software invokes the video decoder of the computing entity to decode the video data.

Further, the method further includes:

When the mobile terminal detects that the video service connection is disconnected, the remote video decoding mode is switched to the local video decoding mode, the virtual coprocessor task module and the transmission adaptation task sub-module are closed, and the DSP of the mobile terminal is awakened, and the DSP is started. Software task.

A mobile terminal includes a wireless task module, a CPU, and a DSP task module, and the mobile terminal further includes: a video service connection module and a virtual coprocessor task module;

a video service connection module, configured to establish a video service connection with a computing entity;

a virtual coprocessor task module, configured to send video data to be decoded to the client software installed in the computing entity by using the wireless task module;

And a wireless task module, configured to receive, by the client software of the computing entity, a frame data stream obtained by decoding a video data by a video decoder of the computing entity.

Further, the wireless task module is specifically configured to search for a computing entity, send a wireless connection request to the searched computing entity, and after receiving the agreed access information returned by the computing entity, establish a wireless with the computing entity. connection.

Further, the video service connection module further includes a transmission adaptation task sub-module; wherein, the video service connection module is specifically configured to push the pre-stored client software to the computing entity that has established the wireless connection, and receive the computing entity After the returned client software information is returned, the transmission adaptation task sub-module is triggered to complete the establishment of the connection with the computing entity video service. Further, the CPU is configured to: after receiving the remote video decoding mode selection information input by the user, enable the remote video decoding mode, stop the DSP software task of the DSP task module, and cut off the CPU of the CPU and the DSP task module. Data communication, and put the DSP into a sleep state.

Further, the virtual coprocessor task module is specifically configured to receive the video data to be decoded sent by the CPU, perform buffer processing, and then package the video data and the decoding command into a data packet format and send the data to the transmission adaptation task submodule. ;

The transmission adaptation task sub-module is specifically configured to perform the wireless protocol data format conversion on the received data, and then send the data to the wireless task module;

The wireless task module is specifically configured to send the received data to a wireless task module of the computing entity.

Further, the CPU is further configured to: when detecting that the video service connection of the video service connection module is disconnected, switch the remote video decoding mode to the local video decoding mode, and close the virtual coprocessor task module and the video service connection module, and Wake up the DSP and start the DSP software task.

The mobile terminal and the video playing implementation method thereof provide a video service connection between a mobile terminal and a computing entity that has established a wireless connection, and the video decoder of the computing entity is called by the client software pushed to the computing entity for decoding, etc. Processing, receiving the frame data stream returned by the computing entity, performing processing, playing through the video player of the mobile terminal, not only improving the video playing performance of the mobile terminal; but also reducing power consumption, requiring no extra cost for the user, saving The cost. DRAWINGS

1 is a schematic flowchart of a method for implementing video playback of a mobile terminal according to the present invention;

2 is a schematic diagram of a processing flow of a specific embodiment of a method for implementing video playback of a mobile terminal according to the present invention;

FIG. 3 is a schematic structural diagram of a mobile terminal of the present invention. The basic idea of the present invention is: establishing a video service connection between the mobile terminal and the computing entity; the mobile terminal transmitting the video data to be decoded to the client software installed in the computing entity, and calling the computing entity through the client software The video decoder performs data decoding and receives a stream of frame data returned by the computing entity.

The present invention will be further described in detail below with reference to the accompanying drawings.

FIG. 1 is a flowchart of a method for implementing video playback of a mobile terminal according to the present invention. As shown in FIG. 1, the method includes the following steps:

Step 101: The mobile terminal establishes a video service connection with the computing entity.

Specifically, the mobile terminal pushes the pre-stored client software to the computing entity through a wireless connection established with the computing entity; the computing entity receives and installs the client software, and returns the installed information to the mobile terminal; After receiving the installed information, the transmission adaptation task sub-module of the video service connection module of the user is started. At this time, the video service connection establishment between the mobile terminal and the computing entity is completed.

Step 102: The mobile terminal sends the video data to be decoded to the client software installed in the computing entity, calls the video decoder of the computing entity to perform data decoding, and receives the frame data stream returned by the computing entity.

Specifically, the mobile terminal encapsulates the video data to be decoded and sends the data to the client software installed in the computing entity, and the video decoder of the computing entity invokes the decoding process of the data by the client software, and receives the frame returned by the computing entity. The data stream is played for playback. The processing of the video data to be decoded by the mobile terminal is: reading the original video data block to be decoded and related parameters, and encapsulating with the local decoding command, and converting the batch to the wireless protocol data packet to the client software and many more.

2 is a diagram showing a process of implementing a video playback method of a mobile terminal according to an embodiment of the present invention. Flow, as shown in FIG. 2, the embodiment includes the following steps:

Step 1: The mobile terminal receives the open short-range wireless connection request input by the user, and activates its short-range wireless connection function;

Specifically, the short-range wireless connection of the mobile terminal may be in various manners such as Bluetooth, WIFI, and wireless USB.

Step 2: The computing entity turns on its own short-range wireless connection;

In this step, the computing entity may calculate a powerful device for a computer or the like; specifically, when the computing entity receives the open proximity wireless connection request input by the user, the computing entity turns on its own short-range wireless connection function.

In addition, it should be understood that the computing entity in this step refers to: a computing entity located within the effective range of the short-range wireless connection of the mobile terminal, and steps 1 and 2 are implemented in an orderly manner.

Steps 3 to 4, the mobile terminal searches for a computing entity in the neighboring area by using a short-range wireless communication manner, and sends a wireless connection request to the computing entity when searching for the computing entity;

Specifically, the mobile terminal searches for a computing entity within the effective range of its own close wireless connection; when searching for a computing entity that also turns on the close wireless connection, a wireless connection request can be sent to the computing entity.

Steps 5-6: The computing entity verifies the received wireless connection request, and when the verification passes, returns the consent access information to the mobile terminal, and the wireless connection between the mobile terminal and the computing entity is completed.

Specifically, in this step, the verification of the wireless connection request by the computing entity further includes: determining, according to the operation status of the mobile terminal, whether to agree to the access request of the mobile terminal, and when not agreeing, returning the disagreement access information to the a mobile terminal; wherein, when the CPU usage of the computing entity is high, and the number of running processes is high, the computing entity returns a disagreement to the mobile terminal; otherwise, when the CPU of the computing entity is in good use, In the case where the number of running processes is not too large, The computing entity returns the consent access information to the mobile terminal.

Step 7, after the wireless connection between the mobile terminal and the computing entity is established, pushing the pre-stored client software to the computing entity;

In this step, the mobile terminal may specifically push the client software to the computing entity in a file format; wherein the client software may be pre-built in the file management area of the mobile terminal and distributed to the user along with the mobile terminal software.

Step 8: Calculate the client software received by the entity installation and operation. After the installation is completed, return the installed information to the mobile terminal. After receiving the installed information, the mobile terminal starts its own transmission adaptation task sub-module. The video service connection between the mobile terminal and the computing entity is established;

In this step, after the computing entity runs, the client software is mainly used to exchange data with the wireless task module of the computing entity, and call the video decoder of the computing entity to execute data decoding commands sent by the mobile terminal;

In addition, when the computing entity detects that the client software pushed by the mobile terminal is installed, it is no longer necessary to install the received client software, directly run the installed client software, and send the installed information to the office. The mobile terminal.

When the computing entity detects that the client software version of the mobile terminal that it has installed is lower than the received client software, the update may be automatically performed. After the update is completed, the installed information is returned to the mobile terminal.

Step 9. After receiving the remote video decoding mode selection information input by the user, the mobile terminal enables the remote video decoding mode.

Specifically, in this step, the video player module of the mobile terminal provides a video decoding mode selection function for the user, including a local video decoding mode and a remote video decoding mode; when the mobile terminal receives the remote video decoding mode selection information, the mobile terminal Enable remote video decoding mode, stop the digital signal processor (DSP) software task, cut off the Data communication between the DSP and the CPU; meanwhile, in order to save power consumption of the mobile terminal, the DSP may be placed in a sleep state.

Step 10~11, the mobile terminal starts its own virtual coprocessor task module, processes the decoded video data, and sends the processed data to the computing entity;

Specifically, after the mobile terminal starts the virtual coprocessor task module, the virtual coprocessor task module receives the video data to be decoded sent by the CPU, and performs buffer processing, and encapsulates the buffered video data and the local decoding command into data. The format of the packet is sent to the transmission adaptation task sub-module; after the transmission adaptation task sub-module converts the received data into a wireless protocol data format, the wireless task module is sent to the mobile terminal, and the wireless task module and the computing entity of the mobile terminal The wireless task module performs wireless data communication and sends the data to the computing entity.

Steps 12-13, the wireless task module of the computing entity sends the received data to the client software, and the client software invokes the local video decoder of the computing entity to decode the video data, and returns the obtained frame data stream to the mobile terminal;

Specifically, after the client software performs data format conversion on the received data, the local video decoder is called to perform actual decoding processing. According to the current decoding setting of the computing entity, the local video decoder finally uses the CPU of the computing entity to perform software decoding. Or using the graphics card of the computing entity for hardware decoding, and returning the decoded frame data stream to the client software, and the client software calling the computing entity's wireless task module returns the frame data stream to the mobile terminal.

Step 14. The mobile terminal processes the received frame data stream and plays it through a local video player.

Specifically, the wireless task module of the mobile terminal sends the frame data stream to the transmission adaptation task sub-module, and the transmission adaptation task sub-module converts the frame data stream of the wireless protocol data format into a data format that can be processed by the virtual coprocessor task module. After that, the converted frame data stream is sent to the virtual coprocessor task module, and after the virtual coprocessor task module buffers and receives the received frame data stream, the final obtained data is provided to the video of the mobile terminal. Player, through The video player calls hardware such as a liquid crystal display (LCD) local to the mobile terminal for playback. In addition, when the CPU of the mobile terminal detects that the video service connection established in step 8 is disconnected, the remote video decoding mode is switched to the local video decoding mode, and the virtual coprocessor task module and the transmission adaptation task sub-module are closed. And waking up the DSP to start the DSP software task; wherein, the disconnection of the video service may be a message that terminates the remote video decoding mode input by the user, or detects that the mobile terminal is not in the service scope of the computing entity, or The computing entity terminates the provision of a remote video decoding service for the mobile terminal.

3 shows a composition of a mobile terminal of the present invention. As shown in FIG. 3, the mobile terminal includes a wireless task module 31, a CPU 32, a DSP task module 33, a video service connection module 34, and a virtual coprocessor task module 35. ; among them,

a wireless task module 31, configured to receive, by the client software of the computing entity, a frame data stream obtained by decoding a video data by a video decoder of a computing entity;

a video service connection module 34, configured to establish a video service connection with the computing entity;

The virtual coprocessor task module 35 is configured to send the video data to be decoded to the client software installed in the computing entity through the wireless task module 31.

Further, the wireless task module 31 is specifically configured to search for a computing entity, send a wireless connection request to the searched computing entity, and establish a wireless connection with the computing entity after receiving the agreed access information returned by the computing entity. .

Further, the video service connection module 34 further includes a transmission adaptation task sub-module 341. The video service connection module 34 is specifically configured to push the pre-stored client software to the computing entity that has established the wireless connection, and receive the After calculating the installed client software information returned by the entity, the transmission adaptation task sub-module 341 is triggered to complete the establishment of the connection with the computing entity video service.

Further, the CPU 32 is configured to: after receiving the remote video decoding mode selection information input by the user, enable the remote video decoding mode, and stop the DSP of the DSP task module 33 of the mobile terminal. The software task, cutting off the data communication between the CPU 32 and the DSP of the DSP task module 33, puts the DSP into a sleep state.

Further, the virtual coprocessor task module 35 is specifically configured to receive the video data to be decoded sent by the CPU 32, and perform buffer processing, and then package the video data and the local decoding command into a data packet format and send the data to the transmission. With task sub-module 341;

The transmission adaptation task sub-module 341 is specifically configured to convert the received data into a wireless protocol data format and send it to the wireless task module 31;

The wireless task module 31 is specifically configured to send the received data to the wireless task module of the computing entity; wherein, the computing entity sends the received data to the client software, and the client software invokes the local video decoder of the computing entity to perform Decoding video data, etc., and returning the obtained frame data stream to the mobile terminal;

Specifically, after the client software performs data format conversion on the received data, the local video decoder is called to perform actual decoding processing. According to the current decoding setting of the computing entity, the local video decoder finally uses the CPU of the computing entity to perform software decoding. Or performing hardware decoding using the graphics card of the computing entity, and returning the decoded frame data stream to the client software, and the client software invokes the wireless task module of the computing entity to return the frame data stream to the mobile terminal;

The wireless task module 31 of the mobile terminal sends the received frame data stream to the transmission adaptation task sub-module 341, and the transmission adaptation task sub-module 341 converts the data in the wireless protocol data format into a virtual coprocessor task module 35. After the data format, the converted frame data stream is sent to the virtual coprocessor task module 35, and the virtual coprocessor task module 35 performs buffer acceleration processing on the received frame data stream, and then provides the final data to the data. The video player of the mobile terminal is played by the video player by calling hardware such as a LCD of the mobile terminal.

Further, the CPU 32 is further configured to: when detecting that the video service connection of the video service connection module 34 is disconnected, switch the remote video decoding mode to the local video decoding mode, and close the virtual coprocessor task module 35 and the video service connection. Module 34, and starts the DSP task module 33, Specifically, to wake up the DSP, start the DSP software task.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Claims

Claim

A method for implementing video playback of a mobile terminal, the method comprising: the mobile terminal establishing a video service connection with a computing entity;

The method according to claim 1, wherein the method further comprises: before the establishing, by the mobile terminal, the video service connection with the computing entity, the method further comprising:

3. The method according to claim 1, wherein the mobile terminal establishes a video service connection with the computing entity as:

The method according to any one of claims 1 to 3, wherein after the mobile terminal establishes a video service connection with the computing entity, the method further includes:

The method according to claim 4, wherein the mobile terminal sends the video data to be decoded to the client software installed in the computing entity, and the video decoder of the computing entity is called by the client software. The data is decoded as: The mobile terminal starts its own virtual coprocessor task module, receives the video data to be decoded sent by its own CPU, performs buffer processing, and encapsulates the video data and the local decoding command into a data packet format and sends the data to the transmission adaptation task sub-module. ;

The method according to claim 5, wherein the method further comprises: when the mobile terminal detects that the video service connection is disconnected, switching the remote video decoding mode to the local video decoding mode, and shutting down its own virtual co-processing The task module and the transmission adaptation task sub-module, and wake up the DSP of the mobile terminal to start the DSP software task.

A mobile terminal, comprising a wireless task module, a CPU, and a DSP task module, wherein the mobile terminal further comprises: a video service connection module and a virtual coprocessor task module;

The mobile terminal according to claim 7, wherein the wireless task module is specifically configured to search for a computing entity, and send a wireless connection request to the searched computing entity, when receiving the consent returned by the computing entity After accessing the information, a wireless connection is established with the computing entity.

The mobile terminal according to claim 7, wherein the video service connection module further comprises a transmission adaptation task sub-module; The video service connection module is configured to: push the pre-stored client software to the computing entity that has established the wireless connection, and trigger the transmission adaptation task sub-module after receiving the installed client software information returned by the computing entity, Complete the establishment of a connection to the computing entity video service.

The mobile terminal according to any one of claims 7 to 9, wherein

a CPU, configured to: after receiving the remote video decoding mode selection information input by the user, enable the remote video decoding mode, stop the DSP software task of the DSP task module, cut off the data communication between the CPU and the DSP of the DSP task module, and The DSP is placed in a sleep state.

The mobile terminal according to claim 10, wherein the virtual coprocessor task module is specifically configured to receive video data to be decoded sent by the CPU, and after buffering, package the video data and the decoding command. The format of the data packet is sent to the transmission adaptation task sub-module;

The mobile terminal according to claim 11, wherein the CPU is further configured to switch the remote video decoding mode to the local video decoding mode when the video service connection of the video service connection module is disconnected. The virtual coprocessor task module and the video service connection module wake up the DSP and start the DSP software task.