WO2016197863A1 - 一种客户端、智能电视系统和相应的数据传输方法 - Google Patents
一种客户端、智能电视系统和相应的数据传输方法 Download PDFInfo
- Publication number
- WO2016197863A1 WO2016197863A1 PCT/CN2016/084600 CN2016084600W WO2016197863A1 WO 2016197863 A1 WO2016197863 A1 WO 2016197863A1 CN 2016084600 W CN2016084600 W CN 2016084600W WO 2016197863 A1 WO2016197863 A1 WO 2016197863A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- service providing
- providing device
- client
- module
- transport stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
- H04N21/25816—Management of client data involving client authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
- H04N21/26216—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving the channel capacity, e.g. network bandwidth
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/26613—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for generating or managing keys in general
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4348—Demultiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
Definitions
- the present application relates to the field of Internet technologies, and in particular, to a client, a smart television system, and a data transmission method.
- the network TV box also called the smart TV box, is a device that connects the TV to the Internet.
- the TV is connected to the Internet through a network TV box to watch online TV programs. Therefore, the "network TV box” can be regarded as a "set top box” for obtaining video programs via the Internet.
- the technical problem to be solved by the embodiments of the present application is to provide a client that solves the waste of resources caused by frequent update of hardware due to the update.
- the embodiment of the present application further provides a data transmission method and a smart television system.
- the present application discloses a client, the client includes: a network module, a custom application module, a decoding module, and a play module; wherein the network module is used to connect to a network; the customized application a module, configured to interact with a service providing device to perform transmission of a user interface corresponding to a transport stream; perform transmission switching of the transport stream and the multimedia data; and perform transmission of the multimedia data by interacting with a network server; the decoding module is configured to parse the The transport stream or the multimedia data; the play module is configured to display a multimedia interface corresponding to a user interface or multimedia data corresponding to the transport stream.
- the customized application module is configured to send a first instruction to the service providing device to pause the push data flow, and request the network server to acquire and play the multimedia data, and implement the transmission of the transport stream to the multimedia data. Switching; and when it is required to stop playing the multimedia data, sending a second instruction to the service providing device, receiving a transport stream fed back by the service providing device, and implementing transmission switching of the multimedia data to the transport stream.
- the client further includes: an input receiving module; the input receiving module is configured to receive an original input signal sent by the external device; and the customized application module is further configured to provide the service according to the original input signal The device feeds back the corresponding input information to control the user interface.
- the customized application module is further configured to map the original input information into an input signal that can be recognized by the service providing device, wherein the input signal includes a standard input signal or key value information of a specified system. Or digital information.
- the customized application module is further configured to: request, to the scheduling server, to allocate a service providing device, establish a connection with the allocated service providing device; and send when the service providing device and/or the connected service providing device are requested to be allocated.
- User data for authentication is further configured to: request, to the scheduling server, to allocate a service providing device, establish a connection with the allocated service providing device; and send when the service providing device and/or the connected service providing device are requested to be allocated.
- the playing module is further configured to monitor, by using a port, a transport stream that is pushed by the service providing device, and determine that the service providing device appears when the transport stream sent by the service providing device is interrupted during the monitoring of the interaction.
- An abnormal state the abnormal state of the service providing device is sent to the custom application module; the customized application module is further configured to report an abnormal state of the service providing device to the management server.
- the playing module is further configured to: when playing the parsed transport stream, detecting an image frame of the transport stream, and discarding the image frame when detecting the image frame abnormality.
- the client further includes: an operating system module; the operating system module is configured to provide an operating system to support operation of other modules, where the other modules include: a network module, a customized application module, and a decoding Module, playback module and input receiver module.
- the other modules include: a network module, a customized application module, and a decoding Module, playback module and input receiver module.
- the embodiment of the present application further discloses a smart television system, comprising: at least one client, at least one server and at least one service providing device as described in the application embodiment; wherein the server is configured to allocate to the client The service providing device; the client is disposed in the smart TV, and the service providing device is disposed on the network side, and is configured to provide an Internet service for the connected client through the network.
- the system further includes at least one user data information storage device; the at least one user data information storage device includes: at least one user partition; wherein the at least one user partition is respectively configured to store different client correspondences User data.
- the service providing device includes: a network set top box; the Internet service includes at least one of the following: a live television, an audio and video service, a web service, and a game service.
- the embodiment of the present application further discloses a data transmission method, including: receiving a user boundary transmitted by a service providing device Corresponding transport stream, or network server transmitting multimedia data; parsing the transport stream to display a corresponding user interface, or parsing the multimedia data to display corresponding multimedia content; and performing transport of transport stream and multimedia data Switch.
- the performing the transport switching of the transport stream and the multimedia data includes: transmitting a transport to the multimedia data, the transport switching includes the following steps: sending the first instruction to the service providing device to pause the push data flow And requesting the network server to acquire the playing multimedia data; receiving the multimedia data fed back by the network server; and parsing the multimedia data to display the corresponding multimedia content.
- the performing the transmission switching of the transport stream and the multimedia data includes: a transmission switching of the multimedia data to the transport stream, where the transport switching includes the following steps: when the multimedia data needs to be stopped, sending the second instruction to The service providing device receives a transport stream fed back by the service providing device, and parses the transport stream to display a corresponding user interface.
- the method further includes: receiving an original input signal sent by the external device; feeding back corresponding input information to the service providing device according to the original input signal to perform control of the user interface; and receiving the response input sent by the service providing device a transport stream of signals, the transport stream responsive to the input signal being generated after controlling the user interface based on the input information; parsing the transport stream to display a correspondingly controlled user interface.
- the method further includes: mapping the original input information into an input signal that can be recognized by the service providing device, where the input signal includes a specified system Standard input signal or key value information or digital information.
- the method further includes: the customized application module requests the dispatching server to allocate a service providing device to establish a connection with the allocated service providing device; and when the application is to allocate the service providing device and/or connect the allocated service providing device, the customized The application module sends user data to the dispatch server for authentication.
- the method further includes: the playing module listening to the transport stream pushed by the service providing device by using the port; and when the transport stream sent by the service providing device is interrupted during the monitoring of the interaction, the playing module determines the service The device provides an abnormal state, and sends an abnormal state of the service providing device to the customized application module.
- the customized application module reports the abnormal state of the service providing device to the management server.
- the method further includes: the playing module detecting an image frame of the transport stream when playing the parsed transport stream; and discarding the image when detecting the image frame abnormality frame.
- the data transmission method is applied to a smart television system, where the smart television system comprises: at least one client, at least one server, and at least one service providing device; wherein the server is used to provide the client Ending a service providing device; the client is set in a smart TV, and the service providing device is set in The network side is used to provide Internet services for the connected clients through the network.
- the smart television system further includes at least one user data information storage device; the at least one user data information storage device includes: at least one user partition; wherein the at least one user partition is used to store different clients respectively User data corresponding to the end.
- the service providing device includes: a network set top box; the Internet service includes at least one of the following: a live television, an audio and video service, a web service, and a game service.
- the embodiments of the present application include the following advantages:
- the client connects to the network through the network module, and then plays the play stream and the multimedia data through the customized application module, the decoding module, and the play module, where the service providing device pushes the client according to the user interface.
- the transport stream is then parsed and displayed on the client to display the corresponding user interface, and the user interface is pushed through the network, so that the content such as the update can be executed on the service providing device side, and parsed and displayed on the client side to prevent frequent Updating hardware leads to waste of resources.
- the multimedia resources of the client are provided by the network server and are no longer pushed in the form of a transport stream, which saves bandwidth resources while ensuring the playback quality of the multimedia resources.
- FIG. 1 is a structural block diagram of a client embodiment of the present application.
- FIG. 2 is a structural block diagram of another client embodiment of the present application.
- FIG. 3 is a flow chart showing the steps of an embodiment of a data transmission method of the present application.
- FIG. 4 is a flow chart showing the steps of an embodiment of a method for switching a transport stream and multimedia data according to the present application
- FIG. 5 is a flow chart showing the steps of an embodiment of a method for switching a transport stream and multimedia data according to the present application
- FIG. 6 is a flow chart showing the steps of an embodiment of a client input processing method of the present application.
- FIG. 7 is a flow chart showing the steps of an embodiment of an input signal transmission method of a client according to the present application.
- FIG. 8 is a flow chart showing the steps of an embodiment of an input signal transmission method of another client of the present application.
- FIG. 9 is a flow chart of steps of another embodiment of a method for processing an abnormal state of a client according to the present application.
- FIG. 10 is a schematic diagram of a client interaction embodiment of the present application.
- FIG. 11 is a structural block diagram of another embodiment of a smart television system of the present application.
- the client connects to the network through the network module, and then plays the play stream and the multimedia data through the customized application module, the decoding module, and the play module, where the service providing device pushes the client according to the user interface.
- the transport stream is then parsed into a corresponding user interface for display on the client, and the user interface is pushed through the network, so that the content such as the update can be executed on the service providing device side, and parsed and displayed on the client side to prevent Frequently updating hardware leads to waste of resources.
- the multimedia resources of the client are provided by the network server and are no longer pushed in the form of a transport stream, which saves bandwidth resources while ensuring the playback quality of the multimedia resources.
- FIG. 1 a block diagram of a client embodiment of the present application is shown, which may specifically include the following modules: a network module 102 , a custom application module 104 , a decoding module 106 , and a play module 108 .
- the network module 102 is configured to connect to the network.
- the customized application module 104 is configured to interact with the service providing device to perform transmission of the user interface corresponding to the transport stream; perform transmission switching of the transport stream and the multimedia data; and interact with the network server to perform the multimedia data transmission.
- the decoding module 106 is configured to parse the transport stream or the multimedia data.
- the playing module 108 is configured to display a multimedia interface corresponding to a user interface or multimedia data corresponding to the transport stream.
- the client connects to the network through the network module, and then plays the play stream and the multimedia data through the customized application module, the decoding module, and the play module, where the service providing device pushes the client according to the corresponding transmission of the user interface.
- the flow is then parsed into a corresponding user interface for display on the client, and the user interface is pushed through the network, so that the content such as the update can be executed on the service providing device side, and parsed and displayed on the client side to prevent frequent Updating hardware leads to waste of resources.
- the multimedia resources of the client are provided by the content distribution server and are no longer pushed in the form of a transport stream, which ensures the playback quality of the multimedia resources while saving bandwidth resources.
- FIG. 2 a structural block diagram of another client embodiment of the present application is shown, which may specifically include the following modules: a network module 202, a custom application module 204, a decoding module 206, a play module 208, an input receiving module 210, and an operating system. Module 212.
- the network module 202 is configured to connect to the network.
- the customized application module 204 is configured to receive a transport stream generated by the service providing device according to the user interface cache code, send the transport stream to the decoding module, obtain the multimedia data fed back by the network server, and send the acquired multimedia data to the The decoding module; and performing reception switching of the transport stream and the multimedia data.
- the decoding module 206 is configured to parse the transport stream or the multimedia data, and send the parsed transport stream or multimedia data to a play module.
- the playing module 208 is configured to display a corresponding user interface according to the parsed transport stream, or display corresponding multimedia content according to the parsed multimedia data.
- Step 302 Receive a transport stream corresponding to a user interface transmitted by the service providing device, or send a multimedia data by the network server.
- Step 304 Parse the transport stream to display a corresponding user interface, or parse the multimedia data to display corresponding multimedia content.
- Step 306 performing transmission switching of the transport stream and the multimedia data.
- the customized application module is configured to send a first instruction to the service providing device to pause a push data stream, and request the network server to acquire and play multimedia data, implement a transmission switch of the transport stream to the multimedia data, and stop And when the multimedia data is played, sending a second instruction to the service providing device, receiving a transport stream fed back by the service providing device, and implementing transmission switching of the multimedia data to the transport stream.
- the input receiving module is configured to receive an original input signal sent by the external device, and the customized application module is further configured to feed back the corresponding input information to the service providing device according to the original input signal to perform control of the user interface.
- the custom application module is further configured to map the original input information into an input signal that can be recognized by the service providing device, wherein the input signal includes a standard input signal or key value information or digital information of a specified system.
- the input receiving module 210 is configured to receive an original input signal sent by an external device, and send the original input signal to the custom application module.
- the custom application module 204 is further configured to perform the original input signal.
- the mapping process obtains an input signal, performs encryption processing on the input signal, transmits the encrypted input signal to the service providing device, and receives response information sent by the service providing device in response to the input signal, wherein The response information includes a user interface corresponding transport stream responsive to the input signal.
- the operating system module 212 is configured to provide an operating system to support operation of other modules, where The other modules include: a network module 202, a custom application module 204, a decoding module 206, a play module 208, and an input receiving module 210.
- the operating system module provides a lightweight intelligent operating system, which can only support the above modules, so the hardware requirements of the terminal where the client is located are low.
- the customized application module is further configured to request the dispatching server to allocate a service providing device, establish a connection with the allocated service providing device, and apply for assigning the service providing device and/or the connected allocated service.
- the custom application module requests the dispatching server to allocate the service providing device to establish a connection with the assigned service providing device; and when applying to allocate the service providing device and/or connect the assigned service providing device, the customized application module sends the user data to the Schedule the server for authentication.
- the custom application module can establish an encrypted connection when establishing a connection with the service providing device. After the client starts, the custom application module will request the server to allocate a service providing device for it, and then the custom application module will establish a connection with the assigned service providing device, such as starting the SSL Socket Client and establishing a TCP long connection with the SSL Socket Server of the service providing device.
- the SSL Socket Client is a client application used by the client to transmit an encrypted input signal to the service providing device.
- the SSL Socket Server is a server application that the service provides to receive encrypted input signals.
- the client block and the service providing device can maintain the connection using the heartbeat, and the client automatically reconnects after detecting that it is disconnected from the service providing device, wherein the data transmission is encrypted using SSL.
- the custom application module 204 includes: switching from the transport stream to the multimedia data and switching back from the multimedia data to the transport stream when performing the reception switching of the transport stream and the multimedia data.
- the service providing device and the client provide network data services for the smart television terminal, wherein the service providing device is also called a cloud terminal, and is a hardware terminal disposed on the network side, and is required by the service providing device to provide network services.
- a variety of data, a presentation form of the client may be an APP (Application) installed on the smart TV terminal, and the client decodes and displays the data provided by the network.
- Each service providing device and the client may not have a unique correspondence, but temporarily allocate a service providing device to the client when the client requests the network server provided by the service providing device, and after the distribution, the service providing device and the client After the connection is established, the service providing device provides data services for the client during the connection.
- the step 306 performs the transmission switching of the transport stream and the multimedia data, including: transmitting the transport stream to the multimedia data, the transport switching includes the following steps: sending the first instruction to the service providing device to pause the push data stream And requesting the network server to acquire the playing multimedia data; receiving the multimedia data fed back by the network server; and parsing the multimedia data to display the corresponding multimedia content.
- the customized application module is configured to send a multimedia play request to the service providing device, and receive the service. Providing the multimedia playback information fed back by the device; transmitting and transmitting the first instruction to the service providing device, requesting the content distribution server to acquire the playing multimedia data, acquiring the multimedia data fed back by the content distribution server, and transmitting the acquired multimedia data to the
- the decoding module is described, so that the decoding module parses the multimedia data, and the playing module switches to display the multimedia content corresponding to the parsed multimedia data.
- FIG. 4 a flow chart of steps of a method for switching a transport stream and multimedia data according to the present application is shown. Specifically, the method may include the following steps:
- Step 402 The customized application module receives the transport stream generated by the service providing device according to the user interface cache code, and sends the transport stream to the decoding module.
- Step 404 The decoding module parses the transport stream, and sends the parsed transport stream to the play module.
- Step 406 The playing module displays a corresponding user interface according to the parsed transport stream.
- Step 408 The customized application module sends a multimedia play information request to the service providing device to obtain multimedia play information.
- Step 410 The customized application module sends a first instruction to the service providing device and requests the content distribution server to acquire the playing multimedia data.
- Step 412 The customized application module sends the acquired multimedia data to the decoding module.
- Step 414 The decoding module parses the multimedia data, and sends the parsed multimedia data to the playing module.
- Step 416 The playing module switches to display the corresponding multimedia content according to the parsed multimedia data.
- the cache data of the user interface is stored on the service providing device side, and the data is provided by the service providing device after the client connects with the service providing device to display the corresponding UI interface on the client side.
- the service providing device encodes the user interface buffer and generates a transport stream (TS) to send to the client.
- TS transport stream
- the customized application module of the client After receiving the TS stream, the customized application module of the client sends the TS stream to the decoding module for parsing, and then generates corresponding parsing data and sends it to the playing module for playing to display the corresponding user interface.
- the user interface displayed on the client side is capable of serving various network services of the user, for example, the user interface may include various menu options or icons, such as: high-definition video, ultra-clear television, Software downloads, games, life services (such as payment, shopping, etc.), so that the client users can watch HD movies and TVs, play somatosensory games, popular large 3D games, online shopping, pay for water and electricity costs on TV for free. And so on. After the user selects an icon or menu of a certain function, the user can continue to enter the corresponding UI interface to perform operations, such as local or network resources when playing HD video.
- various menu options or icons such as: high-definition video, ultra-clear television, Software downloads, games, life services (such as payment, shopping, etc.), so that the client users can watch HD movies and TVs, play somatosensory games, popular large 3D games, online shopping, pay for water and electricity costs on TV for free. And so on.
- the user can continue to enter the corresponding UI interface
- the customized application module can send a multimedia play request to the service providing device.
- the service providing device may not directly provide the multimedia data played by the client, but feed back the corresponding multimedia playback information to the client.
- the customized application module After obtaining the multimedia playing information, the customized application module obtains the playing address from the multimedia playing information, and requests the network server, such as a Content Delivery Network (CDN) server, to acquire and play the multimedia data, and simultaneously sends and transmits the first instruction to the service providing device. Pushing the transport stream by the service provisioning device. Then, the multimedia data fed back by the CDN server is received, and the multimedia data is sent to the decoding module for parsing, and the corresponding player is switched to play the multimedia resource by playing the TS stream. That is, the first instruction is used to identify that the multimedia data is currently ready to be played, and the push delivery stream may be suspended.
- CDN Content Delivery Network
- the step 306 performs the transmission switching of the transport stream and the multimedia data, and further includes: a multimedia data to transport stream switching, where the transport switching includes the following steps: sending a second command when the multimedia data needs to be stopped to be played Providing a device to the service; receiving a transport stream fed back by the service providing device; parsing the transport stream to display a corresponding user interface.
- the customized application module is configured to: when a need to stop playing the multimedia data, generate a second instruction sent to the service providing device; receive a third instruction that is sent by the service providing device according to the second instruction, and corresponding Transport stream. And transmitting the transport stream to the decoding module, the decoding module parses the transport stream, and sends the parsed transport stream to the play module, and the play module switches back to display the corresponding according to the parsed transport stream.
- FIG. 5 a flow chart of steps of a method for switching a transport stream and multimedia data according to the present application is shown. Specifically, the method may include the following steps:
- Step 502 The customized application module generates a second instruction to send to the service providing device when it is required to stop playing the multimedia data.
- Step 504 The customized application module receives a third instruction that is sent by the service providing device according to the second instruction, and a corresponding transport stream.
- Step 506 The customized application module sends the transport stream to the decoding module.
- Step 508 The decoding module parses the transport stream, and sends the parsed transport stream to a play mode. Piece.
- Step 510 The playing module switches back to display the corresponding user interface according to the parsed transport stream.
- the client can switch from the playing of the multimedia data to the playing of the UI interface, and then stop parsing the multimedia data and stop playing the player.
- the client needs to perform a TS stream restart action, so the custom application module triggers the generation of a second instruction, and the second instruction is used to notify the server to resume pushing the TS stream, so that the second instruction can be sent to the service providing device.
- the service providing device prepares the TS stream according to the second instruction, and the TS stream can receive the TS stream that is paused before the multimedia data is played, that is, the service providing device resumes the pushed TS stream according to the record recovery, and generates the third stream after the TS stream is prepared.
- the instruction such as a ready command, is used to inform the client that the TS stream is ready, and then push the TS stream.
- the TS stream can also push the TS stream of the UI main interface, which can be determined according to actual needs.
- the customized application module stops determining that the TS preparation is completed according to the third instruction, and sends the received TS stream to the decoding module for parsing, and then the playback module switches back to display the corresponding UI interface.
- the UI interface displayed by the client is pushed by the service providing device through the TS stream, and the multimedia resource is directly played and played from the CDN server of the network, and the foregoing steps are implemented between the client to play the TS stream and the multimedia data. Seamless switching enables the UI interface before and after multimedia data playback to maintain continuity without affecting user perception.
- the data transmission of the service providing device is performed through the IP network, there is a corresponding requirement for the bandwidth of the network, for example, when the average bandwidth of the operator's private network is 4M and other lower bandwidth.
- the bit rate of the stream is determined by certain requirements.
- the source specifications of multimedia resources such as movies and TV dramas are relatively large, such as high-definition, 1080P or even blue light.
- Such high-definition video sources cannot achieve a code rate within 4M under the existing coding compression technology.
- the loss of the HD chip source will be larger with the streaming solution.
- the multimedia data for multimedia resources such as high-definition video is directly obtained from the network, and is not transmitted by using the TS stream.
- the user data needs to be saved in the process of playing the multimedia resource.
- the service providing device may be logged in by using the account mode, and each account corresponds to the user.
- the storage area ensures that users can enjoy the synchronization of the account and data of the multimedia data cutting service.
- the dynamic frame rate of the UI interface played by the client is not high, so the code rate of the corresponding UI cache after compression is controllable, so the streaming interface is used for the UI interface to provide device-side push, the client End display; for multimedia resources with high user demand, such as video resources, games, etc., use the CDN mode of the Internet to play, so to achieve seamless display of UI interface playback and multimedia data playback, to achieve a good user sensory experience.
- the user can control through the external device of the remote controller, such as selecting a certain function and entering the next level interface, and the UI interface is displayed based on the transport stream of the service providing device. Therefore, the control response to the UI interface is also performed by the service providing device.
- the step of controlling the user interface in the client includes: receiving an original input signal sent by the external device; and feeding back the corresponding input information to the service providing device according to the original input signal to perform control of the user interface; Receiving a transport stream sent by the service providing device in response to the input signal, the transport stream responsive to the input signal being generated after controlling the user interface based on the input information; parsing the transport stream to display a correspondingly controlled user interface.
- the method further includes: mapping the original input information into an input signal that can be recognized by the service providing device, wherein the input signal includes a standard input of a specified system Signal or key value information or digital information.
- the input receiving module is configured to receive an original input signal sent by an external device, and send the original input signal to the customized application module.
- the customized application module is further configured to perform mapping processing on the original input signal. Obtaining an input signal, performing encryption processing on the input signal, transmitting the encrypted input signal to the service providing device; and receiving response information sent by the service providing device in response to the input signal, wherein the response information A user interface corresponding to the input signal is included in the transport stream.
- FIG. 6 a flow chart of steps of an embodiment of a client input processing method of the present application is shown, which may specifically include the following steps:
- Step 602 The customized application module receives the transport stream generated by the service providing device according to the user interface cache code, and sends the transport stream to the decoding module.
- Step 604 The decoding module parses the transport stream, and sends the parsed transport stream to the play module.
- Step 606 The playing module displays a corresponding user interface according to the parsed transport stream.
- Step 608 The input receiving module receives an original input signal sent by the external device, and sends the original input signal to the customized application module.
- Step 610 The custom application module performs mapping processing on the original input signal to obtain an input signal, and then performs encryption processing on the input signal, and sends the encrypted input signal to the service providing device.
- Step 612 The customized application module receives the response information sent by the service providing device in response to the input signal, and sends the transport stream in the response information to the decoding module.
- Step 614 The decoding module parses the transport stream, and sends the parsed transport stream to a play mode. Piece.
- Step 616 The playing module displays a user interface responsive to the input signal according to the parsed transport stream.
- the UI cache stored in the service providing device includes various contents displayed on the client, such as a main UI interface, various APPs displayed in the UI interface, and a corresponding UI interface after the APP is opened, that is, The client locally displays only the main UI interface and does not store the installed APP.
- the user installs the APP in the client, and the user sends an installation instruction to an APP in the UI interface displayed by the client through the external device, and the corresponding input receiving module receives the original input signal, and the customized application module
- the original input signal is subjected to mapping processing to obtain an input signal, and then the input signal is encrypted, and the encrypted input signal is sent to the service providing device, and the service providing device acquires the data of the APP and installs and records the corresponding data on the service providing device.
- the APP information is transmitted to the client, and the TS stream corresponding to the UI interface is sent to the client as a response message, and the customized application module of the client receives the response information sent by the service providing device in response to the input signal, and the response is
- the TS stream in the information is sent to the decoding module for parsing, and the play module displays a UI interface responsive to the input signal according to the parsed transport stream.
- the input receiving module sends the original input signal to the custom application module for processing and then sends the message to the service providing device, and the service providing device obtains the UI corresponding to the startup and enters the APP.
- the cache generation TS stream is sent to the client as response information, and the service providing device also sends a UI buffer corresponding to the TS stream corresponding to the control data sent by the client, and the client displays the UI interface in response to the user control.
- the service providing device can purchase the paid resources such as games and videos in advance for each client in the system, so that the user can locally select the above resources for installation, viewing, and the like. Therefore, the service providing device uses the TS stream to push the UI interface, the client only parses and displays, and the control data for the user through the external device is also forwarded to the service providing device, and the service providing device adjusts the UI interface to feed back the TS stream in response to the control.
- the original signal received by the client may be subjected to mapping processing to obtain an input signal that can be recognized by the service providing device.
- the type of the input signal that is mapped may be various, such as a standard input signal of a specified system, such as digital information.
- the custom application module is configured to map the original input signal to a standard input signal of a specified system when detecting that the original input signal does not belong to a standard input signal of a specified system.
- FIG. 7 a flow chart of steps of an embodiment of an input signal transmission method of a client of the present application is shown.
- Step 702 The input receiving module receives an original input signal sent by the external device, and sends the original input signal to the custom application module.
- Step 704 the custom application module detects whether the original input signal belongs to a standard input signal of a specified system.
- the designated system is an operating system used by the service providing device
- the standard input signal of the designated system is an input signal recognizable by the operating system of the service providing device, such as a Linux standard input signal.
- step 608 is performed.
- step 606 is performed.
- Step 706 the custom application module maps the original input signal to a standard input signal of a specified system.
- Step 708 the custom application module binarizes the standard input signal of the specified system to obtain a binary input signal.
- Step 710 The custom application module performs symmetric encryption or asymmetric encryption on the binary input signal to obtain an encrypted input signal.
- Step 712 the custom application module sends the encrypted input signal to the service providing device.
- the custom application module binarizes the standard input signal of the specified system, that is, converts the standard input signal into binary information to obtain a binary input signal.
- the binary input signal is then encrypted, wherein symmetric encryption or asymmetric encryption is performed according to the encryption method determined when the SSL encryption connection is established, thereby obtaining an encrypted input signal.
- the encrypted input signal is then sent to the service providing device, and the service providing device responds with a corresponding response signal to the response. If the client uses the SSL Socket Client to binarize the input signal and encrypt it, it is passed to the SSL Socket Server of the service provider.
- Step 714 The customized application module receives the response information sent by the service providing device in response to the input signal, and sends the transport stream in the response information to the decoding module.
- Step 716 The decoding module parses the transport stream, and sends the parsed transport stream to the play module.
- Step 718 The playing module displays a user interface responsive to the input signal according to the parsed transport stream.
- the client parses the transport stream fed back by the service providing device through the player, and displays a user interface responsive to the input signal, such as entering a UI interface corresponding to the selected function, and displaying a UI interface for successfully installing the APP.
- the input signal mapped to the Linux input signal is transmitted to the service providing device, and the portability is good.
- the service providing device uses the virtual input device technology to directly write the input signal into the device, simulate the hardware input signal, and can simulate all the input devices that are known. Such as touch screen, keyboard, remote control, mouse, etc., support a variety of virtual devices, and good scalability.
- the client and the service providing device use SSL to encrypt the transmission data, ensure the reliability of the data transmission, solve the problem that the input signal is easily hijacked by malicious persons, leak the user password, and the like, and the security is high.
- the customized application module is configured to detect an operating system; when belonging to the first operating system, determine a key value corresponding to the original signal, and obtain the according to the key value mapping table.
- the key value information corresponding to the key value when belonging to the second operating system, obtaining the key value information according to the button response by intercepting the key response of the original input signal; and mapping the key value information into digital information As an input signal.
- FIG. 8 a flow chart of steps of an embodiment of an input signal transmission method of another client of the present application is shown.
- the client transmission key value information is mapped into digital information as an input signal to the service providing device.
- Step 802 The input receiving module receives an original input signal sent by the external device, and sends the original input signal to the customized application module.
- Step 804 the customized application module detects the operating system.
- the client resolution service provides the TS stream displayed by the device to display the UI interface, and can receive the original input signal sent by the user through the external device, and detect the operating system (OS) of the client, when the client is the first operation.
- OS operating system
- step 806 is performed; when the client is the second operating system, step 808 is performed.
- the user sends an infrared key value signal through the infrared remote controller, and the client obtains the infrared signal and determines its own OS type, assuming that the first operating system is linux and the second operating system is android.
- the operating system may also be limited to the IOS and the like.
- Step 806 the custom application module determines a key value corresponding to the original signal, and obtains key value information corresponding to the key value according to the key value mapping table.
- Map can map keys to objects of values.
- Step 808 The customized application module acquires corresponding key value information according to the button response by monitoring a button response for acquiring the original input signal.
- the start button monitor button responds to obtain the button event, and then obtains the key value information corresponding to the button event.
- Step 810 the custom application module maps the key value information into digital information as an input signal.
- Step 812 the customized application module performs symmetric encryption or asymmetric encryption on the key value information to obtain an addition. Dense input signal.
- Step 814 the customized application module sends the encrypted input signal to the service providing device.
- the custom application module maps the key value information into digital information as an input signal, and then symmetrically encrypts or asymmetrically encrypts the key value information to obtain an encrypted input signal.
- the key value information is converted into digital information according to a preset protocol, and then the digital information is encrypted into a ciphertext according to an encryption algorithm, such as encryption by a Data Encryption Standard (DES) method, to obtain an encrypted input signal.
- DES Data Encryption Standard
- the encrypted input signal is then sent to the service providing device.
- the encrypted input signal is sent to the service providing device through the IP network using the SSL Socket Client.
- Step 816 The customized application module receives the response information sent by the service providing device in response to the input signal, and sends the transport stream in the response information to the decoding module.
- Step 818 the decoding module parses the transport stream, and sends the parsed transport stream to the play module.
- Step 820 The playing module displays a user interface responsive to the input signal according to the parsed transport stream.
- the current UI interface of the client and the control of the interface content are all run on the client's local operating system, but the cloud-based response control of the operating system is not implemented, and for the button control of the UI, a remote controller is usually used locally. Control the implementation of a terminal device.
- the operating system is clouded by using a powerful background server, and the operating system clouding refers to that the UI corresponding to the operating system of the client is located in the service providing device of the cloud, so the control of the UI interface, such as the installation of the APP, is performed. It is implemented on the service provider side, and the client is only used for display. Since the service providing device implements an operating system and corresponding control, it involves input control such as remote key operation between various types of clients and service providing devices.
- the embodiment can be compatible with the transmission of input signals such as button reporting between a plurality of existing different types of clients and service providing devices, and maximizes the key map (maps the keys to the value object) by a custom protocol. Reduce transmission bandwidth, and use double-key algorithm encryption and SSL certificate authentication.
- the playing module is further configured to monitor, by using a port, a transport stream that is pushed by the service providing device, and determine, when the transport stream sent by the service providing device is interrupted during the monitoring, to determine The service providing device is in an abnormal state, and sends an abnormal state of the service providing device to the customized application module.
- the customized application module is further configured to report an abnormal state of the service providing device to the scheduling server.
- the custom application module is also used to perform an abnormal state reconnection.
- FIG. 9 a flow chart of steps of another embodiment of a method for processing an abnormal state of a client according to the present application is shown.
- Step 902 The playing module monitors the transport stream pushed by the service providing device through the port.
- Step 904 when the transport stream sent by the service providing device is interrupted during the interaction, the playing module determines that the service providing device has an abnormal state, and sends an abnormal state of the service providing device to the customized application. Module.
- Step 906 the custom application module performs an abnormal state reconnection process.
- Step 908 The customized application module reports the abnormal status of the service providing device to the management server.
- the playing module listens to the transport stream pushed by the service providing device through the port, and can monitor whether the TS stream sent by the service providing device is interrupted during the interaction, when the service providing device The transmitted TS stream is interrupted, and it is confirmed that the status of the service providing device is abnormal.
- the abnormal status of the service providing device may be caused by power failure or network disconnection of the service providing device.
- the playing module sends an abnormal state of the service providing device to the customized application module.
- the custom application module may start a timer to start timing when the connection between the client and the service providing device is disconnected due to an abnormal state of the service providing device, and then try to reconnect with the service providing device whose status is abnormal, and During the connection process, it is detected whether the timing time reaches the reconnection threshold.
- the reconnection threshold is successful with the service providing device, indicating that the service providing device status has returned to normal, and the TS stream can be continuously pushed, the customized application module correspondingly resumes receiving the TS stream from the service providing device.
- the customized application module may report the service providing device of the previous connection service providing device to the management server in the system. The status is abnormal, so that the system can detect the abnormal cause of the service providing device and process it. Then, the customized application module re-applies to the dispatching server to allocate a service providing device, establishes a connection with the redistributed service providing device, and then pushes the TS stream for the redistributed service providing device, the customized application module Recovery receives a TS stream from the reassigned service providing device.
- the playing module is further configured to: when playing the parsed transport stream, detecting an image frame of the transport stream, and discarding the image frame when detecting the image frame abnormality .
- the playback module detects the image frame of the transport stream when playing the parsed transport stream.
- the TS stream is 25 frames per second, and each frame is 100 KB. If an image frame is 90 KB, the data portion of the image frame is lost. That is, the image frame is detected to be abnormal, and the image frame can be discarded at this time.
- the image frame anomaly may include various abnormal conditions, such as the occurrence of the above data loss problem, which may cause the frame image to appear a screen problem. Thereby, the automatic detection of the flower screen and the execution of the discarding process are implemented by the play module.
- this embodiment also discloses a smart television system.
- the smart television system includes: at least one client, at least one server, and at least one service providing device as described in the above embodiments; wherein the server is configured to allocate a service providing device to the client; the client Set in the smart TV, the service providing device is disposed on the network side for providing an Internet service for the connected client through the network.
- the at least one user data information storage device includes: at least one user partition; wherein the at least one user partition is respectively configured to store user data corresponding to different clients.
- the service providing device includes: a network set top box; the internet service includes at least one of the following: a live television, an audio and video service, a web service, and a game service.
- the client can perform at least the following services: 1. receiving the input signal of the user, sending the input signal to the service providing device to complete the interaction between the two parties; 2. analyzing the service to provide the TS stream of the device and displaying it; 3. the user of the network security Authentication. Therefore, the client can support the above basic core functions: 1. It can perform network communication (cable/ip); 2. It can analyze the data transmission stream of the cloud and output it; 3. Support external device (such as remote control) input; 4. Support the user authentication mechanism of the system; 5. Support remote CDN video request and playback.
- the client interacts with each device and the CDN server outside the system in the smart television system as shown in FIG.
- the custom application module of the client may schedule the server interaction application to allocate the service providing device and perform the authentication process; the custom application module and the management server exchange and report the status abnormal event; the customized application module and the service providing device interact to establish a connection, and obtain the TS flow from the service providing device. And multimedia information, and sending the input signal to the service providing device for response; the custom application module acquires the multimedia data from the CDN server.
- custom app module includes: 1) encryption and mapping of key values sent to the service providing device; 2) application service provider and user authentication mechanism between the support server; 3) TS stream and The logical function implementation of the multimedia data stream cutting; 4) TS stream receiving function; 5) CDN data source application and reception.
- the client's input receiving module (IR Receive module) is acquired from the external input device and sent to the custom application module.
- the client's decoding module has the function of decoding TS stream and CDN video stream.
- the client's network module (Ethernet/WiFi) is supported by the device network function.
- the media player of the client is a TS stream and a CDN video stream player.
- the player provides a device scheme TS stream custom player for the service, and the main optimization function: newly added RTSP port monitoring function and automatic detection flower Screen drop frame function.
- the client's operating system module (Smart os) is a lightweight, intelligent operating system that can support only the above major modules.
- the interface UI, the video, the game, and the like are all in the cloud, and the client receives the cloud data decoding display through the network.
- the way in which cloud data is transmitted to the client is divided into UI streaming (TS stream) and URL (multimedia data) switching.
- the client, the service providing device, and the like discussed in the above embodiments may employ the following smart television system.
- the smart television system can include: a client, a dispatch server, and a service providing device.
- the client is a terminal that can use the APP application provided by the service providing device, such as a set top box, a smart mobile terminal, a PAD (Portable Android Device tablet), a smart TV with a decoding function, and the like.
- the service providing device may be multiple, and is set as a server in the cloud to remotely provide services for the client.
- the scheduling server may select one of the plurality of service providing devices in the cloud to allocate to the client according to the set allocation policy.
- the service providing device may be set in the cloud as a hardware device
- the software (application) may be installed in the service providing device
- the service providing device may be a user of various applications in the cloud.
- the user interface (UI) is compression-encoded.
- the client needs basic decoding capability to display the user interface of the application to the user, and implement operations on various applications.
- the software (application) is no longer installed in the set top box, but is installed in the service providing device, and the user is provided through the service providing device. Provide services. Since the software is no longer required to be installed in the set top box, the set top box can no longer be set up separately.
- the smart mobile terminal (or a smart TV with decoding function) can be directly connected to the service providing device, and the user does not need to be separate.
- the purchase/setting of the set-top box saves the user's cost; at the same time, the intelligent mobile terminal (or the smart TV with decoding function) directly interacts with the service providing device, thereby improving the interaction efficiency, reducing the maintenance steps of the set-top box, and reducing the pair. The occupation of resources.
- the scheduling server may refer to a server, or may refer to a server group composed of multiple servers equivalent to the scheduling server function.
- FIG. 11 an architectural diagram of a smart television system of the present application is shown.
- the smart television system may specifically include: at least one device server (such as the device server 1101 shown in FIG. 11), at least one scheduling server (such as the scheduling server 1102 shown in FIG. 11), and at least one client. End (client 1103 as shown in Figure 1).
- each The device server includes at least one service providing device (such as the service providing device 1104 in the device server 1101 shown in FIG. 11).
- the smart television system may further include: at least one management server (such as the management server 1105 shown in FIG. 11) and at least one user data information storage device (such as the user data information storage device 1106 shown in FIG. 11). ).
- the user data information storage device is configured to store user data information, one user may correspond to a dedicated user data information storage device, and multiple users may share the same user data information storage device. This is not a limitation.
- the user data information storage device may be a physical device, a logical device, or a combination of physical and logical devices.
- the user data information storage device may include at least one user partition (such as the user partition 1107 shown in FIG. 11), and each user partition correspondingly stores user data information of one user.
- the client 1103 may be a hardware device as described above, such as a set top box, a smart mobile terminal, a PAD, a smart TV with a decoding function, and the like.
- the client 1103 may also be in the form of a smart TV terminal, which may be presented in the form of an APP (Application) loaded in the smart TV terminal.
- the smart TV terminal herein may specifically include: a set top box and a mobile terminal. , smart TV, etc.
- the client 1103 can be used to play the user interface parsed by the transport stream (TS) sent by the service providing device 1104, and play multimedia data (such as video signals, audio signals, etc.) acquired from other network servers.
- TS transport stream
- multimedia data such as video signals, audio signals, etc.
- the client 1103 can be used to listen to an input message generated by a user through an input device such as a remote controller, and transmit the input message to the service providing device 1104 or the dispatch server 1102.
- the user interface displayed by the client 1103 is pushed by the service providing device 1104, the client 1103 only parses and displays, and the input message controlled by the client 1103 to the user interface is also forwarded to the service providing device 1104. It adjusts the user interface accordingly.
- the service providing device 1104 is located at the network side, and each of the service providing devices may specifically include: a software module carried by the hardware board and the hardware board. It should be noted that, in this embodiment, various types of applications may be directly installed in the service providing device, and the user may perform the application in the service providing device 1104 through the user interface corresponding to the application displayed by the client 1103. In the operation, it is no longer necessary to separately install the application in the client 1103, so that the technician can perform unified maintenance on the smart television system, thereby reducing the workload and improving the maintenance efficiency.
- the user partition 1107 is located on the network side.
- each user has a user partition, and user data information of each user is saved under the corresponding user partition.
- each user partition has a unique address information, and the address information may indicate a specific address of the corresponding user partition, and the address information may be quickly checked through the address information. Find the user partition and complete the call of the user data information.
- the dispatch server 1102 (or the management server 1105) can perform maintenance only on address information (small data amount) without maintaining the entire user data information (large amount of data), reducing the maintained data. The quantity reduces the resource occupation, improves the system running speed, and the data information is easy to find.
- the scheduling server 1102 is located on the network side, and is mainly configured to allocate an idle, good-quality service providing device 1104 to the client 1103 according to the input message sent by the client 1103; at the same time, the user partition corresponding to the user ID can be mounted to The assigned service providing device 1104, that is, each user partition can correspond to a unique user ID, such as user partition A corresponding to user A, etc., such that user A is at client 1103 with the last assigned, After the service providing device with the number 001 is disconnected, even if the service providing device numbered 002 is connected next time, the user A can still use the user partition A, and can use data such as the previous history;
- the management server 1105 is located on the network side and can be used to manage all the service providing devices.
- the management may include: status reporting, heartbeat management, setting attributes, obtaining attributes, network wake-up, soft restart, hard restart, etc.; visible, management
- the server 1105 can be used as a remote server to implement network wake-up of the service providing device in the wide area network by using the technical solution of the present application.
- the service providing device may also be referred to as a cloud box or an OTT set-top box, and has high-quality service capability, and can provide various functions such as high-definition video and free games for the user, wherein OTT is Over The Top, which means Provide various application services to users through the Internet.
- the service providing device with the OTT function is integrated into the device server, and the function of the service providing device is transmitted to the ordinary set top box, the smart TV and the like through the network through the video streaming technology, so that the OTT can be used without upgrading the hardware. High-end features.
- the various functions in the service providing device with high-quality service capability can be transmitted to the client installed in the ordinary low-end set-top box or the smart TV through the streaming mode, and the client displays the UI interface corresponding to the TS stream, wherein the service Features that provide devices include, but are not limited to, games, apps, movies, TV shows, education, video chat, karaoke, and more.
- the system requirements for the ordinary set-top box or smart TV for installing the client are low.
- the ordinary set-top box is required to have the ability to play the RTSP 720P video stream, and, for example, the ordinary set-top box needs to have the capability of accessing the IP network, thereby installing the client. After the end, you can upload key values and other controls.
- each piece of service providing device in the device server has strong service capabilities, including but not limited to: strong processing capability, strong graphics computing capability, large memory, and low power consumption. You can run large games and applications on the market today, playing 1080P and 2K movies.
- Ordinary set-top boxes tend to be older. First, they are not smart OTT set-top boxes, and secondly their performance is better than Weak, not enough to run large games and applications, customers often need to upgrade or replace the updated set-top box to meet this part of the entertainment needs. Therefore, the service providing device can solve the above problem. Large-scale games and applications are run in the cloud device server, and then transmitted to the client installed in the ordinary set-top box through RTSP video streaming, which achieves the purpose of high-end entertainment using low-end set-top boxes, and can enhance the services of ordinary set-top boxes. ability.
- the client described in the above embodiments can be applied to the smart television system based on the one shown in FIG.
- any system or server that requires a similar resource allocation can implement the resource allocation scheme of the present application by referring to the embodiments of the present application, and is not limited to the application scenario in the foregoing architecture.
- the resource allocation scheme can also be applied to a remote control system (e.g., a distance learning system) to a terminal.
- embodiments of the embodiments of the present application can be provided as a method, apparatus, or computer program product. Therefore, the embodiments of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Moreover, embodiments of the present application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
- computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
- the computer device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
- the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
- RAM random access memory
- ROM read only memory
- Memory is an example of a computer readable medium.
- Computer readable media includes both permanent and non-persistent, removable and non-removable media.
- Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data.
- Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic cassette tape, magnetic tape storage or other magnetic storage device or any other non-transmission medium available Stores information that can be accessed by the computing device.
- computer readable media does not include non-persistent computer readable media, such as modulated data signals and carrier waves.
- Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG.
- These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal device to produce a machine such that instructions are executed by a processor of a computer or other programmable data processing terminal device
- Means are provided for implementing the functions specified in one or more of the flow or in one or more blocks of the flow chart.
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the instruction device implements the functions specified in one or more blocks of the flowchart or in a flow or block of the flowchart.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Graphics (AREA)
- General Health & Medical Sciences (AREA)
- Cardiology (AREA)
- Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请实施例提供了一种客户端、智能电视系统和相应的数据传输方法,由于更新而导致频繁更新硬件而造成的资源浪费。所述的客户端包括:网络模块、定制应用模块、解码模块和播放模块,其中,其中,由服务提供设备为客户端推送依据用户界面缓存编码生成的传送流,然后在客户端解析成相应的用户界面进行显示,通过网络实现对用户界面的推送,对于更新等内容在服务提供设备侧执行即可,而在客户端侧进行解析和显示,防止由于频繁更新硬件而导致资源的浪费。并且,对于客户端的多媒体资源,由内容分发服务器提供而不再采用传送流的形式推送,在节省带宽资源的同时保证了多媒体资源的播放质量。
Description
本申请要求2015年06月11日递交的申请号为201510319784.9、发明名称为“一种客户端、智能电视系统和相应的数据传输方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及互联网技术领域,特别是涉及一种客户端、一种智能电视系统和一种数据传输方法。
网络电视盒,也叫智能电视盒,是一个连接电视机与互联网的设备。电视机通过网络电视盒连接互联网,收看网络电视节目。因此,“网络电视盒”可以看成是一个通过互联网获得视频节目的“机顶盒”。
随着智能操作系统的越来越普及化,智能盒子也逐渐走进了千家万户,游戏,音乐,视频,设备互联等新的内容和技术给用户带来了越来越好的客厅娱乐体验,但是随着IT硬件和互联网行业的快速迭代的节奏,盒子的硬件升级周期也很频繁。用户想要及时体验到最新的技术所带来的乐趣就必须频繁购买更换新的智能盒子,造成了资源的浪费。
发明内容
本申请实施例所要解决的技术问题是提供一种客户端,解决由于更新而导致频繁更新硬件而造成的资源浪费。
相应的,本申请实施例还提供了一种数据传输方法和一种智能电视系统。
为了解决上述问题,本申请公开了一种客户端,所述的客户端包括:网络模块、定制应用模块、解码模块和播放模块;其中,所述网络模块,用于连接网络;所述定制应用模块,用于与服务提供设备交互进行用户界面对应传送流的传输;执行传送流和多媒体数据的传输切换;以及与网络服务器交互进行所述多媒体数据的传输;所述解码模块,用于解析所述传送流或所述多媒体数据;所述播放模块,用于显示传送流对应的用户界面或多媒体数据对应的多媒体内容。
可选的,所述定制应用模块,用于向所述服务提供设备发送第一指令以暂停推送数据流,并向所述网络服务器请求获取播放多媒体数据,实现传送流到多媒体数据的传输
切换;以及在需要停止播放所述多媒体数据时,发送第二指令给所述服务提供设备,接收所述服务提供设备反馈的传送流,实现多媒体数据到传送流的传输切换。
可选的,所述的客户端还包括:输入接收模块;所述输入接收模块,用于接收外置设备发送的原始输入信号;所述定制应用模块,还用于依据原始输入信号向服务提供设备反馈对应的输入信息以进行用户界面的控制。
可选的,所述定制应用模块,还用于将所述原始输入信息映射成能够被所述服务提供设备识别的输入信号,其中,所述输入信号包括指定系统的标准输入信号或键值信息或数字信息。
可选的,所述定制应用模块,还用于向调度服务器请求分配服务提供设备,与分配的服务提供设备建立连接;以及在申请分配服务提供设备和/或连接分配的服务提供设备时,发送用户数据以进行鉴权。
可选的,所述播放模块,还用于通过端口对服务提供设备推送的传送流进行监听,在监听到所述交互过程中服务提供设备发送的传送流中断时,确定所述服务提供设备出现异常状态,将所述服务提供设备的异常状态发送给所述定制应用模块;所述定制应用模块,还用于将服务提供设备的异常状态上报给管理服务器。
可选的,所述播放模块,还用于在播放解析的传送流时,对传送流的图像帧进行检测,当检测到所述图像帧异常时,丢弃所述图像帧。
可选的,所述的客户端还包括:操作系统模块;所述操作系统模块,用于提供操作系统以支持其他模块的运行,其中,所述其他模块包括:网络模块、定制应用模块、解码模块、播放模块和输入接收模块。
本申请实施例还公开了一种智能电视系统,包括:至少一个如申请实施例所述的客户端、至少一个服务器和至少一个服务提供设备;其中,所述服务器用于向所述客户端分配服务提供设备;所述客户端设置在智能电视中,所述服务提供设备设置在网络侧,用于通过网络为建立连接的客户端提供互联网服务。
可选的,所述的系统还包括至少一个用户数据信息存储设备;所述至少一个用户数据信息存储设备包括:至少一个用户分区;其中,所述至少一个用户分区分别用于存储不同客户端对应的用户数据。
可选的,所述服务提供设备包括:网络机顶盒;所述互联网服务,包括如下中的至少一个:电视直播、音视频服务、网页服务、游戏服务。
本申请实施例还公开了一种数据传输方法,包括:接收服务提供设备传输的用户界
面对应的传送流,或网络服务器传输多媒体数据;对所述传送流进行解析显示相应的用户界面,或对所述多媒体数据进行解析显示相应的多媒体内容;以及执行传送流和多媒体数据的传输切换。
可选的,所述执行传送流和多媒体数据的传输切换,包括:传送流到多媒体数据的传输切换,所述传输切换包括如下步骤:向所述服务提供设备发送第一指令以暂停推送数据流,并向所述网络服务器请求获取播放多媒体数据;接收所述网络服务器反馈的多媒体数据;对所述多媒体数据进行解析显示相应的多媒体内容。
可选的,所述执行传送流和多媒体数据的传输切换,包括:多媒体数据到传送流的传输切换,所述传输切换包括如下步骤:在需要停止播放所述多媒体数据时,发送第二指令给所述服务提供设备;接收所述服务提供设备反馈的传送流;对所述传送流进行解析显示相应的用户界面。
可选的,还包括:接收外置设备发送的原始输入信号;依据所述原始输入信号向服务提供设备反馈对应的输入信息以进行用户界面的控制;接收所述服务提供设备发送的响应于输入信号的传送流,所述响应于输入信号的传送流为基于所述输入信息控制用户界面后生成的;对所述传送流进行解析显示相应控制的用户界面。
可选的,所述接收外置设备发送的原始输入信号之后,还包括:将所述原始输入信息映射成能够被所述服务提供设备识别的输入信号,其中,所述输入信号包括指定系统的标准输入信号或键值信息或数字信息。
可选的,还包括:所述定制应用模块向调度服务器请求分配服务提供设备,与分配的服务提供设备建立连接;在申请分配服务提供设备和/或连接分配的服务提供设备时,所述定制应用模块发送用户数据给所述调度服务器以进行鉴权。
可选的,还包括:所述播放模块通过端口对服务提供设备推送的传送流进行监听;在监听到所述交互过程中服务提供设备发送的传送流中断时,所述播放模块确定所述服务提供设备出现异常状态,将所述服务提供设备的异常状态发送给所述定制应用模块;所述定制应用模块将服务提供设备的异常状态上报给管理服务器。
可选的,所述的方法还包括:所述播放模块在播放解析的传送流时,对传送流的图像帧进行检测;当检测到所述图像帧异常时,所述播放模块丢弃所述图像帧。
可选的,所述的数据传输方法应用于智能电视系统中,所述智能电视系统包括:至少一个客户端、至少一个服务器、至少一个服务提供设备;其中,所述服务器用于向所述客户端分配服务提供设备;所述客户端设置在智能电视中,所述服务提供设备设置在
网络侧,用于通过网络为建立连接的客户端提供互联网服务。
可选的,所述智能电视系统,还包括至少一个用户数据信息存储设备;所述至少一个用户数据信息存储设备包括:至少一个用户分区;其中,所述至少一个用户分区分别用于存储不同客户端对应的用户数据。
可选的,所述服务提供设备包括:网络机顶盒;所述互联网服务,包括如下中的至少一个:电视直播、音视频服务、网页服务、游戏服务。
与现有技术相比,本申请实施例包括以下优点:
在本申请实施例中,客户端通过网络模块连接网络,然后通过定制应用模块、解码模块和播放模块实现对传送流和多媒体数据的播放,其中,由服务提供设备为客户端推送依据用户界面对应的传送流,然后在客户端解析显示相应的用户界面,通过网络实现对用户界面的推送,从而对于更新等内容在服务提供设备侧执行即可,在客户端侧进行解析和显示,防止由于频繁更新硬件而导致资源的浪费。并且,对于客户端的多媒体资源,由网络服务器提供而不再采用传送流的形式推送,在节省带宽资源的同时保证了多媒体资源的播放质量。
图1是本申请一种客户端实施例的结构框图;
图2是本申请另一种客户端实施例的结构框图;
图3是本申请的一种数据传输方法实施例的步骤流程图。
图4是本申请的一种传送流和多媒体数据的切换方法实施例的步骤流程图;
图5是本申请的一种传送流和多媒体数据的切换方法实施例的步骤流程图;
图6是本申请的一种客户端输入处理方法实施例的步骤流程图;
图7是本申请的一种客户端的输入信号传输方法实施例的步骤流程图;
图8是本申请的另一种客户端的输入信号传输方法实施例的步骤流程图;
图9是本申请的另一种客户端针对异常状态的处理方法实施例的步骤流程图;
图10是本申请的一种客户端交互实施例的示意图;
图11是本申请的另一种智能电视系统实施例的结构框图。
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施
方式对本申请作进一步详细的说明。
本申请实施例的核心构思之一在于,提出一种客户端,由于更新而导致频繁更新硬件而造成的资源浪费。本申请实施例中,客户端通过网络模块连接网络,然后通过定制应用模块、解码模块和播放模块实现对传送流和多媒体数据的播放,其中,由服务提供设备为客户端推送依据用户界面对应的传送流,然后在客户端解析成相应的用户界面进行显示,通过网络实现对用户界面的推送,从而对于更新等内容在服务提供设备侧执行即可,在客户端侧进行解析和显示,防止由于频繁更新硬件而导致资源的浪费。并且,对于客户端的多媒体资源,由网络服务器提供而不再采用传送流的形式推送,在节省带宽资源的同时保证了多媒体资源的播放质量。
实施例一
参照图1,示出了本申请一种客户端实施例的结构框图,具体可以包括如下模块:网络模块102、定制应用模块104、解码模块106和播放模块108。
其中,网络模块102,用于连接网络。
所述定制应用模块104,用于与服务提供设备交互进行用户界面对应传送流的传输;执行传送流和多媒体数据的传输切换;以及与网络服务器交互进行所述多媒体数据的传输。
所述解码模块106,用于解析所述传送流或所述多媒体数据。
所述播放模块108,用于显示传送流对应的用户界面或多媒体数据对应的多媒体内容。
本实施例中,客户端通过网络模块连接网络,然后通过定制应用模块、解码模块和播放模块实现对传送流和多媒体数据的播放,其中,由服务提供设备为客户端推送依据用户界面对应的传送流,然后在客户端解析成相应的用户界面进行显示,通过网络实现对用户界面的推送,从而对于更新等内容在服务提供设备侧执行即可,在客户端侧进行解析和显示,防止由于频繁更新硬件而导致资源的浪费。并且,对于客户端的多媒体资源,由内容分发服务器提供而不再采用传送流的形式推送,在节省带宽资源的同时保证了多媒体资源的播放质量。
实施例二
参照图2,示出了本申请另一种客户端实施例的结构框图,具体可以包括如下模块:网络模块202、定制应用模块204、解码模块206、播放模块208、输入接收模块210和操作系统模块212。
其中,网络模块202,用于连接网络。
所述定制应用模块204,用于接收服务提供设备推送的依据用户界面缓存编码生成的传送流,将所述传送流发送给解码模块;获取网络服务器反馈的多媒体数据,将获取的多媒体数据发送给所述解码模块;以及执行传送流和多媒体数据的接收切换。
所述解码模块206,用于解析所述传送流或所述多媒体数据,并将解析后的传送流或多媒体数据发送给播放模块。
所述播放模块208,用于依据所述解析后的传送流显示相应的用户界面;或依据所述解析后的多媒体数据显示相应的多媒体内容。
基于上述客户端,智能电视系统客户端侧的数据传输方法如图3所示:
步骤302,接收服务提供设备传输的用户界面对应的传送流,或网络服务器传输多媒体数据。
步骤304,对所述传送流进行解析显示相应的用户界面,或对所述多媒体数据进行解析显示相应的多媒体内容。
步骤306,执行传送流和多媒体数据的传输切换。
从而在客户端中实现传送流和多媒体数据之间的传输切换。
所述定制应用模块,用于向所述服务提供设备发送第一指令以暂停推送数据流,并向所述网络服务器请求获取播放多媒体数据,实现传送流到多媒体数据的传输切换;以及在需要停止播放所述多媒体数据时,发送第二指令给所述服务提供设备,接收所述服务提供设备反馈的传送流,实现多媒体数据到传送流的传输切换。
所述输入接收模块,用于接收外置设备发送的原始输入信号;所述定制应用模块,还用于依据原始输入信号向服务提供设备反馈对应的输入信息以进行用户界面的控制。
所述定制应用模块,还用于将所述原始输入信息映射成能够被所述服务提供设备识别的输入信号,其中,所述输入信号包括指定系统的标准输入信号或键值信息或数字信息。
所述输入接收模块210,用于接收外置设备发送的原始输入信号,将所述原始输入信号发送给所述定制应用模块;所述定制应用模块204,还用于对所述原始输入信号进行映射处理得到输入信号,再对所述输入信号进行加密处理,将加密的输入信号发送给所述服务提供设备;以及接收所述服务提供设备发送的响应于输入信号的响应信息,其中,所述响应信息包括响应于输入信号的用户界面对应传送流。
所述操作系统模块212,用于提供操作系统以支持其他模块的运行,其中,所述其
他模块包括:网络模块202、定制应用模块204、解码模块206、播放模块208和输入接收模块210。所述操作系统模块提供轻量级的智能操作系统,可以仅支持上述模块运行即可,因此对客户端所在终端的硬件要求较低。
本申请一个可选实施例中,所述定制应用模块,还用于向调度服务器请求分配服务提供设备,与分配的服务提供设备建立连接;以及在申请分配服务提供设备和/或连接分配的服务提供设备时,发送用户数据以进行鉴权。即定制应用模块向调度服务器请求分配服务提供设备,与分配的服务提供设备建立连接;在申请分配服务提供设备和/或连接分配的服务提供设备时,所述定制应用模块发送用户数据给所述调度服务器以进行鉴权。
其中,定制应用模块在与服务提供设备建立连接时可以建立加密连接。客户端启动后定制应用模块会请求服务器为其分配服务提供设备,而后定制应用模块会与分配的服务提供设备建立连接,如启动SSL Socket Client,与服务提供设备的SSL Socket Server建立TCP长连接。其中,SSL Socket Client为客户端用来向服务提供设备传输加密输入信号的客户端应用。SSL Socket Server为服务提供设备用来接收加密输入信号的服务器应用。客户端块和服务提供设备可以使用心跳维持连接,客户端检测到与服务提供设备断连后会自动重连,其中数据传输使用SSL加密。
本申请一个可选实施例中,所述定制应用模块204在执行传送流和多媒体数据的接收切换时,包括:从传送流到多媒体数据的切换以及从多媒体数据切换回传送流。
本实施例中,采用服务提供设备和客户端为智能电视终端提供网络数据服务,其中,服务提供设备也称云终端,是设置在网络侧的硬件终端,由服务提供设备提供网络服务所需的各种数据,客户端的一种呈现形式可以是安装于智能电视终端的APP(应用程序,Application),客户端对网络提供的数据进行解码并显示。其中,每个服务提供设备和客户端可以不具有唯一的对应关系,而是在客户端请求由服务提供设备提供网络服务器时为客户端临时分配一个服务提供设备,在分配后服务提供设备与客户端建立连接后,在连接期间服务提供设备为该客户端提供数据服务。
1、从传送流到多媒体数据的切换。
其中,步骤306所述执行传送流和多媒体数据的传输切换,包括:传送流到多媒体数据的传输切换,所述传输切换包括如下步骤:向所述服务提供设备发送第一指令以暂停推送数据流,并向所述网络服务器请求获取播放多媒体数据;接收所述网络服务器反馈的多媒体数据;对所述多媒体数据进行解析显示相应的多媒体内容。
其中,所述定制应用模块,用于发送多媒体播放请求给所述服务提供设备,接收服
务提供设备反馈的多媒体播放信息;向所述服务提供设备发送传送第一指令并向所述内容分发服务器请求获取播放多媒体数据,获取内容分发服务器反馈的多媒体数据,将获取的多媒体数据发送给所述解码模块,从而解码模块解析多媒体数据,播放模块切换成显示解析的多媒体数据对应多媒体内容。
参照图4,示出了本申请的一种传送流和多媒体数据的切换方法实施例的步骤流程图,具体可以包括如下步骤:
步骤402,定制应用模块接收服务提供设备推送的依据用户界面缓存编码生成的传送流,将所述传送流发送给解码模块。
步骤404,所述解码模块对所述传送流进行解析,将解析后的传送流发送给播放模块。
步骤406,所述播放模块依据所述解析后的传送流显示相应的用户界面。
步骤408,所述定制应用模块发送多媒体播放信息请求给所述服务提供设备,以获取多媒体播放信息。
步骤410,所述定制应用模块向所述服务提供设备发送传送第一指令并向所述内容分发服务器请求获取播放多媒体数据。
步骤412,所述定制应用模块将获取的多媒体数据发送给所述解码模块。
步骤414,所述解码模块对所述多媒体数据进行解析,将解析后的多媒体数据发送给播放模块。
步骤416,所述播放模块依据所述解析后的多媒体数据切换成显示相应的多媒体内容。
本实施例中,在服务提供设备侧存储用户界面(User Interface,UI)的缓存数据,在客户端与服务提供设备连接后由服务提供设备提供数据以在客户端侧显示相应的UI界面,因此服务提供设备会将用户界面缓存进行编码后生成传送流(Transport Stream,TS)发送给客户端。客户端的定制应用模块在接收到TS流后会将该TS流发送给解码模块进行解析,而后生成相应的解析数据发送给播放模块进行播放从而显示相应的用户界面。
本申请实施例中,客户端侧所显示的用户界面是能够为用户各种网络服务,例如在用户界面上可以包括各种菜单选项或图标等服务功能,例如包括:高清视频,超清电视、软件下载、游戏、生活服务(如缴费、购物等)等,从而通过该客户端用户可在电视上免费观看高清电影电视、玩体感游戏、热门大型3D游戏、网络购物、支付水电煤费用
等等功能。在用户选择某一功能的图标或菜单后,可以继续进入相应的UI界面执行操作,例如播放高清视频时可以选择本地或网络资源等。
用户使用客户端时可能需要播放多媒体资源,如播放音、视频数据等,特别是数据量大、清晰度要求高的视频资源,此时定制应用模块可以发送多媒体播放请求给服务提供设备。本实施例中服务提供设备可以不直接提供客户端播放的多媒体数据,而是将相应的多媒体播放信息反馈给客户端。
定制应用模块获取多媒体播放信息后,从该多媒体播放信息中获取播放地址,向网络服务器,如内容分发(Content Delivery Network,CDN)服务器请求获取播放多媒体数据,同时向服务提供设备发送传送第一指令以暂停服务提供设备对所述传送流的推送。然后,接收CDN服务器反馈的多媒体数据,将多媒体数据发送给解码模块进行解析,相应播放器由对TS流的播放切换成对多媒体资源的播放。即所述第一指令用于标识当前准备播放多媒体数据,可以暂停推送传送流。
2、从多媒体数据切换回传送流。
其中,步骤306所述执行传送流和多媒体数据的传输切换,还包括:多媒体数据到传送流的传输切换,所述传输切换包括如下步骤:在需要停止播放所述多媒体数据时,发送第二指令给所述服务提供设备;接收所述服务提供设备反馈的传送流;对所述传送流进行解析显示相应的用户界面。
所述定制应用模块,用于在需要停止播放所述多媒体数据时,生成第二指令发送给所述服务提供设备;接收所述服务提供设备依据所述第二指令反馈的第三指令以及相应的传送流。再将所述传送流发送给所述解码模块,由解码模块对所述传送流进行解析,将解析后的传送流发送给播放模块,播放模块依据所述解析后的传送流切换回显示相应的用户界面。
参照图5,示出了本申请的一种传送流和多媒体数据的切换方法实施例的步骤流程图,具体可以包括如下步骤:
步骤502,所述定制应用模块在需要停止播放所述多媒体数据时,生成第二指令发送给所述服务提供设备。
步骤504,所述定制应用模块接收所述服务提供设备依据所述第二指令反馈的第三指令以及相应的传送流。
步骤506,所述定制应用模块将所述传送流发送给所述解码模块。
步骤508,所述解码模块对所述传送流进行解析,将解析后的传送流发送给播放模
块。
步骤510,所述播放模块依据所述解析后的传送流切换回显示相应的用户界面。
当定制应用模块确定对多媒体资源播放完毕或者用户指示停止播放多媒体资源时,客户端可以从多媒体数据的播放切换回UI界面的播放,则在停止对多媒体数据的解析并停止采用播放器播放所述多媒体数据时,客户端需要执行TS流重启(restart)动作,因此定制应用模块触发生成第二指令,第二指令用于通知服务器恢复推送TS流,因此可以将第二指令发送给服务提供设备。服务提供设备依据该第二指令准备TS流,该TS流可以承接在播放多媒体数据前暂停推送的TS流,即服务提供设备依据记录恢复暂停推送的TS流,在TS流准备完成后生成第三指令,如完成(ready)指令,该第三指令用于告知客户端TS流准备完毕,而后继续推送TS流,当然该TS流也可以推送UI主界面的TS流,可以依据实际需求确定。定制应用模块依据该第三指令停止确定TS准备完毕,并将接收到的TS流发送给解码模块进行解析,再由播放模块切换回显示相应的UI界面。
本实施例客户端显示的UI界面由服务提供设备通过TS流推送,而多媒体资源从网络的CDN服务器中直接获取播放,通过上述步骤实现了客户端对TS流播放和对多媒体数据播放之间的无缝切换,使得多媒体数据播放前后的UI界面可以保持连续性,不会对用户感知产生影响。
本实施例中,由于服务提供设备的数据的传输是通过IP网络进行的,因此对于网络的带宽会有相应的要求,例如,当运行商的专网平均带宽为4M等较低带宽时对TS流的码率由一定的要求。但是,电影、电视剧等多媒体资源的片源规格比较大,如规格为高清、1080P甚至蓝光等,像这种高清视频片源在现有编码压缩技术下是无法达到4M以内的码率,即若在4M网络带宽环境下用流化方案对高清片源的损耗会比较大。
因此本实施例中,针对高清视频等多媒体资源的多媒体数据直接从网络中获取,而不采用TS流方式传输。由于在播放多媒体资源时可以从第三方的CDN服务器上获取,因此上述切换等过程中需要涉及到用户数据的保存,本实施例中,可以采用账号模式登陆服务提供设备,每个账户对应着用户存储区,保证用户享受多媒体数据切流服务的账号和数据的同步。
本实施例中,客户端所播放UI界面的动态帧率并不高,因此其对应UI缓存在压缩后的码率是可控的,因此对于UI界面采用流化的服务提供设备端推送,客户端显示;而对于用户需求较高的多媒体资源如影视资源、游戏等,采用互联网的CDN方式播放,因此要实现UI界面播放和多媒体数据播放的无缝切流显示,达到良好的用户感官体验。
针对客户端所显示的UI界面,用户可以通过遥控器的外置设备进行控制,如选择某个功能,进入下一级界面等,而由于UI界面是基于服务提供设备的传送流解析显示的,因此对UI界面的控制响应也由服务提供设备执行。
本实施例中,对客户端中用户界面的控制方法的步骤包括:接收外置设备发送的原始输入信号;依据所述原始输入信号向服务提供设备反馈对应的输入信息以进行用户界面的控制;接收所述服务提供设备发送的响应于输入信号的传送流,所述响应于输入信号的传送流为基于所述输入信息控制用户界面后生成的;对所述传送流进行解析显示相应控制的用户界面。
其中,所述接收外置设备发送的原始输入信号之后,还包括:将所述原始输入信息映射成能够被所述服务提供设备识别的输入信号,其中,所述输入信号包括指定系统的标准输入信号或键值信息或数字信息。
所述输入接收模块,用于接收外置设备发送的原始输入信号,将所述原始输入信号发送给所述定制应用模块;所述定制应用模块,还用于对所述原始输入信号进行映射处理得到输入信号,再对所述输入信号进行加密处理,将加密的输入信号发送给所述服务提供设备;以及接收所述服务提供设备发送的响应于输入信号的响应信息,其中,所述响应信息包括响应于输入信号的用户界面对应传送流。
参照图6,示出了本申请的一种客户端输入处理方法实施例的步骤流程图,具体可以包括如下步骤:
步骤602,定制应用模块接收服务提供设备推送的依据用户界面缓存编码生成的传送流,将所述传送流发送给解码模块。
步骤604,所述解码模块对所述传送流进行解析,将解析后的传送流发送给播放模块。
步骤606,所述播放模块依据所述解析后的传送流显示相应的用户界面。
步骤608,输入接收模块接收外置设备发送的原始输入信号,将所述原始输入信号发送给所述定制应用模块。
步骤610,所述定制应用模块对所述原始输入信号进行映射处理得到输入信号,再对所述输入信号进行加密处理,将加密的输入信号发送给所述服务提供设备。
步骤612,所述定制应用模块接收所述服务提供设备发送的响应于输入信号的响应信息,将所述响应信息中的传送流发送给所述解码模块。
步骤614,所述解码模块对所述传送流进行解析,将解析后的传送流发送给播放模
块。
步骤616,所述播放模块依据所述解析后的传送流显示响应于输入信号的用户界面。
本实施例中,服务提供设备中存储的UI缓存包括在客户端上显示的各种内容,如主UI界面,UI界面中所显示的各种APP、以及APP开启后相应的UI界面等,即客户端本地仅显示而并不存储主UI界面,也不存储安装的APP等内容。
以用户在客户端中安装APP为例,用户通过外置设备发出对客户端显示的UI界面中的某一APP的安装指令,对应输入接收模块接收原始输入信号,所述定制应用模块对所述原始输入信号进行映射处理得到输入信号,再对所述输入信号进行加密处理,将加密的输入信号发送给所述服务提供设备,服务提供设备获取该APP的数据在服务提供设备端安装并记录相应的APP信息,并传送安装过程以及安装完毕对应UI界面的TS流作为响应信息发送给客户端,客户端的定制应用模块接收所述服务提供设备发送的响应于输入信号的响应信息,将所述响应信息中的TS流发送给所述解码模块进行解析,播放模块依据所述解析后的传送流显示响应于输入信号的UI界面。从而看似在客户端中安装APP的过程实质上是在服务提供设备中完成的,而客户端仅显示了服务提供设备推送的流化方式的UI界面。
又如用户通过外置设备选择开启已安装的某一游戏APP后,输入接收模块将原始输入信号发送给定制应用模块处理后发送给服务提供设备后,服务提供设备会获取启动进入APP相应的UI缓存生成TS流作为响应信息发送给客户端,后续对于客户端发送的各种控制数据,服务提供设备也会发送响应控制数据的UI缓存对应TS流,客户端显示响应于用户控制的UI界面。
因而,服务提供设备可以预先购买游戏、视频等付费资源供系统中各客户端使用,从而用户可以客户端本地免费选择上述资源进行安装、观看等。从而通过服务提供设备采用TS流推送UI界面,客户端仅解析并显示,对于用户通过外置设备的控制数据也要转发给服务提供设备,由服务提供设备响应该控制调整UI界面反馈TS流。
对于客户端接收的原始信号可以通过映射处理得到能够被服务提供设备识别的输入信号,其中,映射得到的输入信号的类型可以有多种,如指定系统的标准输入信号,又如数字信息等。
1、对于标准输入信号的传输
本申请一个可选实施例中,定制应用模块,用于当检测到所述原始输入信号不属于指定系统的标准输入信号时,将所述原始输入信号映射成指定系统的标准输入信号。
参照图7,示出了本申请的一种客户端的输入信号传输方法实施例的步骤流程图。
步骤702,输入接收模块接收外置设备发送的原始输入信号,将所述原始输入信号发送给所述定制应用模块。
步骤704,定制应用模块检测所述原始输入信号是否属于指定系统的标准输入信号。
其中,该指定系统为服务提供设备所采用的操作系统,则指定系统的标准输入信号即为服务提供设备的操作系统能够识别的输入信号,如为Linux标准输入信号等。
若是,即该原始信号属于指定系统的标准输入信号,执行步骤608。
若否,即该原始信号不属于指定系统的标准输入信号,执行步骤606。
步骤706,所述定制应用模块将所述原始输入信号映射成指定系统的标准输入信号。
步骤708,所述定制应用模块将所述指定系统的标准输入信号进行二进制化处理,得到二进制的输入信号。
步骤710,所述定制应用模块将所述二进制的输入信号进行对称加密或非对称加密,得到加密的输入信号。
步骤712,所述定制应用模块将加密的输入信号发送给所述服务提供设备。
所述定制应用模块将所述指定系统的标准输入信号进行二进制化处理,即将该标准输入信号转换成二进制信息得到二进制的输入信号。再对该二进制的输入信号进行加密处理,其中按照SSL加密连接建立时确定的加密方式进行对称加密或非对称加密,从而得到加密的输入信号。然后将该加密的输入信号发送给服务提供设备,时服务提供设备对其响应反馈对应的响应信号。如客户端采用SSL Socket Client将输入信号进行二进制化后加密,传递给服务提供设备的SSL Socket Server。
步骤714,所述定制应用模块接收所述服务提供设备发送的响应于输入信号的响应信息,将所述响应信息中的传送流发送给所述解码模块。
步骤716,所述解码模块对所述传送流进行解析,将解析后的传送流发送给播放模块。
步骤718,所述播放模块依据所述解析后的传送流显示响应于输入信号的用户界面。
客户端通过播放器对服务提供设备反馈的传送流进行解析,显示响应于所述输入信号的用户界面,如进入选择的功能对应UI界面,又如显示安装APP成功的UI界面等。
而本申请实施例中,首先无论客户端采用何种平台,将输入信号映射为Linux的输入信号传递至服务提供设备即可,可移植性较好。其次服务提供设备使用虚拟输入设备技术,直接将输入信号写入设备中,模拟硬件输入信号,可以模拟已知的所有输入设备,
如触摸屏、键盘、遥控器、鼠标等,支持虚拟设备种类多,可扩展性较好。再次,客户端和服务提供设备间使用SSL对传输数据进行加密,保证数据传输的可靠性,解决了输入信号容易被恶意劫持,泄露用户密码等问题,安全性较高。再次,在使用字符串传输信号时,以“128”为例,使用字符串需要3个字节,而本申请采用二进制传输信号需要1个字节,大大提高传输效率,即使在网络状况不佳的情况下也能正常工作。
2、对于数字信息的传输
本申请另一个可选实施例中,所述定制应用模块,用于对操作系统进行检测;当属于第一操作系统时,确定所述原始信号对应的键值,按照键值映射表获取所述键值对应的键值信息;当属于第二操作系统时,通过监听获取所述原始输入信号的按键响应,依据所述按键响应获取对应的键值信息;将所述键值信息映射成数字信息作为输入信号。
参照图8,示出了本申请的另一种客户端的输入信号传输方法实施例的步骤流程图。以客户端传输键值信息映射成数字信息作为输入信号给服务提供设备为例。
步骤802,输入接收模块接收外置设备发送的原始输入信号,将所述原始输入信号发送给所述定制应用模块。
步骤804,所述定制应用模块对操作系统进行检测。
客户端解析服务提供设备传输的TS流显示UI界面后,可以接收用户通过外置设备发出的原始输入信号,并对客户端的操作系统(Operating System,OS)进行检测,当客户端为第一操作系统时,执行步骤806;当客户端为第二操作系统时,执行步骤808。
例如,用户通过红外遥控器发出红外键值信号,客户端获取红外信号并判断自身OS类型,假设第一操作系统为linux,第二操作系统为android。当然操作系统还可以为IOS等本申请实施例对此不作限定。
步骤806,所述定制应用模块确定所述原始信号对应的键值,按照键值映射表获取所述键值对应的键值信息。
如将红外键值与map表进行比较,确定红外键值代表的含义,即将红外键值Map成对应事件。其中,Map可以将键映射到值的对象。
步骤808,所述定制应用模块通过监听获取所述原始输入信号的按键响应,依据所述按键响应获取对应的键值信息。
如启动按键监听按键响应获取按键事件,然后获取该按键事件对应的键值信息。
步骤810,定制应用模块将所述键值信息映射成数字信息作为输入信号。
步骤812,所述定制应用模块将所述键值信息进行对称加密或非对称加密,得到加
密的输入信号。
步骤814,所述定制应用模块将加密的输入信号发送给服务提供设备。
所述定制应用模块将上述键值信息映射成数字信息作为输入信号,然后对键值信息进行对称加密或非对称加密,得到加密的输入信号。例如,将键值信息按照预设协议Map成数字信息,然后将数字信息按照加密算法加密成密文,如通过数据加密标准(Data Encryption Standard,DES)方式进行加密,得到加密的输入信号。然后将加密的输入信号发送给所述服务提供设备。如,将加密的输入信号通过IP网络采用SSL Socket Client发送给服务提供设备。
步骤816,所述定制应用模块接收所述服务提供设备发送的响应于输入信号的响应信息,将所述响应信息中的传送流发送给所述解码模块。
步骤818,所述解码模块对所述传送流进行解析,将解析后的传送流发送给播放模块。
步骤820,所述播放模块依据所述解析后的传送流显示响应于输入信号的用户界面。
当前客户端的UI界面以及对界面内容的控制均是在客户端本地的操作系统上运行,而没有实现对操作系统的云端化响应控制,而且对于UI的按键控制,通常也是在本地采用一个遥控器控制一种终端设备的实现方式。
本实施例采用强大的后台服务器将操作系统云端化,该操作系统云端化指的是客户端所显示的UI对应操作系统位于云端的服务提供设备中,因此对于UI界面的控制如APP的安装均是在服务提供设备侧实现的,而客户端仅用于显示。由于是服务提供设备实现操作系统及相应的控制,因此涉及到各种类型客户端和服务提供设备之间的远程按键操作等输入控制。本实施例可以兼容多种现有的不同类型的客户端和服务提供设备之间的按键上报等输入信号的传输,并且通过自定义协议将按键map(将键映射到值的对象)后最大限度的减少传输带宽,并且采用键值算法加密和SSL证书认证双重安全保障。
本申请另一个可选实施例中,所述播放模块,还用于通过端口对服务提供设备推送的传送流进行监听,在监听到所述交互过程中服务提供设备发送的传送流中断时,确定所述服务提供设备出现异常状态,将所述服务提供设备的异常状态发送给所述定制应用模块;所述定制应用模块,还用于将服务提供设备的异常状态上报给调度服务器。该定制应用模块还用于执行异常状态重连。
参照图9,示出了本申请的另一种客户端针对异常状态的处理方法实施例的步骤流程图。
步骤902,所述播放模块通过端口对服务提供设备推送的传送流进行监听。
步骤904,在监听到所述交互过程中服务提供设备发送的传送流中断时,所述播放模块确定所述服务提供设备出现异常状态,将所述服务提供设备的异常状态发送给所述定制应用模块。
步骤906,所述定制应用模块执行异常状态重连处理。
步骤908,所述定制应用模块将服务提供设备的异常状态上报给管理服务器。
在客户端与服务提供设备的交互过程中,播放模块通过端口对服务提供设备推送的传送流进行监听,可以监听到所述交互过程中服务提供设备发送的TS流是否出现中断,当服务提供设备发送的TS流出现中断,确认为服务提供设备状态异常,服务提供设备状态异常可能是由于服务提供设备掉电、断网等原因引起的。所述播放模块将所述服务提供设备的异常状态发送给所述定制应用模块。
在由于服务提供设备状态异常而导致客户端和服务提供设备的连接断开时,所述定制应用模块可以启动计时器开始计时,而后尝试重新与该状态出现异常的服务提供设备建立连接,并在连接过程中检测计时时间是否达到重连阈值。当重连阈值内与所述服务提供设备重连成功,表征该服务提供设备状态已恢复正常,可以继续推送TS流则所述定制应用模块对应恢复从所述服务提供设备处接收TS流。当超过重连阈值与所述服务提供设备重连失败,为了防止无限重连影响客户端中场使用,该所述定制应用模块可以向系统中的管理服务器上报之前连接服务提供设备的服务提供设备状态异常,使得系统可以检测该服务提供设备的异常原因并进行处理。然后所述定制应用模块再向该调度服务器重新申请分配一个服务提供设备,与该重新分配的服务提供设备建立连接,而后由该重新分配的服务提供设备为其推送TS流,所述定制应用模块恢复从所述重新分配的服务提供设备处接收TS流。
本申请另一个可选实施例中,所述播放模块,还用于在播放解析的传送流时,对传送流的图像帧进行检测,当检测到所述图像帧异常时,丢弃所述图像帧。所述播放模块在播放解析的传送流时,对传送流的图像帧进行检测,例如TS流为每秒25帧,每帧100KB,若某一图像帧为90KB则说明该图像帧部分数据丢失,即检测到所述图像帧异常,此时可以丢弃所述图像帧。其中图像帧异常可以包括各种异常情况,如出现上述数据丢失问题,可能导致该帧图像出现花屏问题。从而通过播放模块实现对花屏的自动检测以及执行丢弃处理。
实施例三
在上述实施例的基础上,本实施例还公开了一种智能电视系统。
该智能电视系统,包括:至少一个如上述实施例所述的客户端、至少一个服务器和至少一个服务提供设备;其中,所述服务器用于向所述客户端分配服务提供设备;所述客户端设置在智能电视中,所述服务提供设备设置在网络侧,用于通过网络为建立连接的客户端提供互联网服务。
所述还包括至少一个用户数据信息存储设备;所述至少一个用户数据信息存储设备包括:至少一个用户分区;其中,所述至少一个用户分区分别用于存储不同客户端对应的用户数据。
所述服务提供设备包括:网络机顶盒;所述互联网服务,包括如下中的至少一个:电视直播、音视频服务、网页服务、游戏服务。
该客户端至少可以执行以下业务:1.接收用户的输入信号,将输入信号发送到服务提供设备端以完成双方的交互;2.解析服务提供设备端TS流并显示;3.网络安全的用户鉴权。因此,客户端可以支持以上几种基本核心功能:1.可以进行网络通信(cable/ip);2.可以解析云端的数据传输流并输出;3.支持外置设备(如遥控器)输入;4.支持系统的用户鉴权机制;5.支持远程CDN视频请求和播放。
从而智能电视系统中客户端与各设备以及系统外部的CDN服务器交互如图10所示。
客户端的定制应用模块可以调度服务器交互申请分配服务提供设备以及执行鉴权处理;定制应用模块和管理服务器交互上报状态异常事件;定制应用模块和服务提供设备交互建立连接,从服务提供设备获取TS流和多媒体信息,以及将输入信号发送给服务提供设备进行响应;定制应用模块从CDN服务器获取多媒体数据。
即定制应用模块(定制app模块)的功能包括:1)加密和映射按键键值发送给服务提供设备;2)支持和服务器之间的申请服务提供设备和用户鉴权机制;3)TS流和多媒体数据切流的逻辑功能实现;4)TS流接收功能;5)CDN数据源的申请和接收。
客户端的输入接收模块(IR Receive模块)从外置输入设备中获取并发送给定制应用模块。
客户端的解码模块(Decoder模块)具有解码TS流和CDN视频流功能。
客户端的网络模块(Ethernet/WiFi)为设备网络功能支持。
客户端的播放模块(Media player)为TS流和CDN视频流播放器,该播放器为服务提供设备方案TS流定制播放器,主要优化功能:新增RTSP端口监听功能和自动检测花
屏丢帧功能。
客户端的操作系统模块(Smart os)为轻量级的智能操作系统,可以仅支持以上几大模块。
上述各实施例所涉及的智能电视系统中,采用的是界面UI,影视,游戏等内容都在云端,客户端是通过网络接收云端数据解码显示。其中云端数据传输到客户端的途径分为UI流化(TS流)和URL化(多媒体数据)切换使用。
上述各实施例所论述的客户端以及服务提供设备等,可以采用如下的智能电视系统。该智能电视系统可以包括:客户端、调度服务器和服务提供设备。其中,客户端是一种可以使用服务提供设备提供的APP应用程序的终端,如,机顶盒、智能移动终端、PAD(Portable Android Device平板电脑)、具有解码功能的智能电视等。所述服务提供设备可以是多个,作为服务端设置在云端,远程为所述客户端提供服务。调度服务器在接收到客户端申请服务提供设备的请求之后,可以根据设定分配策略从云端的多个服务提供设备中选择一个服务提供设备分配给所述客户端。
这里需要说明的是,在本申请的方案中,服务提供设备可以作为硬件设备设置在云端,软件(应用程序)可以安装在服务提供设备中,服务提供设备可以在云端将各类应用程序的用户界面(User Interface,UI)进行压缩编码,客户端需要有基本解码能力即可向用户展现应用程序的用户界面,实现对各类应用程序的操作。换而言之,与传统的智能电视系统所不同的是,在本申请的方案中,软件(应用程序)不再安装在机顶盒中,而是安装在服务提供设备中,通过服务提供设备为用户提供服务。由于不再需要将软件安装在机顶盒中,故可以不再单独设置机顶盒。例如,若所述客户端为智能移动终端、或具有解码功能的智能电视时,则可以直接将智能移动终端(或具有解码功能的智能电视)与所述服务提供设备进行连接,用户不需要单独购买/设置机顶盒,节约了用户成本;同时,智能移动终端(或具有解码功能的智能电视)与所述服务提供设备直接进行交互,提高了交互效率,减少了对机顶盒的维护步骤,降低了对资源的占用。当然,对有现有的具有解码能力的机顶盒本申请的方案也仍然适用。进一步地,所述调度服务器可以是指一个服务器,也可以是指等同于所述调度服务器功能的多个服务器组成的服务器群组。
本申请中,一种优选的智能电视系统的架构如图11所示,参照图11,示出了本申请的一种智能电视系统的架构图。在本实施例中,所述智能电视系统具体可以包括:至少一个设备服务器(如图11所示的设备服务器1101)、至少一个调度服务器(如图11所示的调度服务器1102)和至少一个客户端(如图1所示的客户端1103)。其中,每个
设备服务器中包括至少一个服务提供设备(如图11所示的设备服务器1101中的服务提供设备1104)。
此外,优选地,所述智能电视系统还可以包括:至少一个管理服务器(如图11所示的管理服务器1105)和至少一个用户数据信息存储设备(如图11所示的用户数据信息存储设备1106)。需要说明的是,所述用户数据信息存储设备用于存储用户数据信息,一个用户可以对应一个专用的用户数据信息存储设备,多个用户也可以共有同一个用户数据信息存储设备,本实施例对此不作限制。其中,所述用户数据信息存储设备可以是物理设备,也可以是逻辑设备,还可以是物理和逻辑相结合的设备。例如,所述用户数据信息存储设备中可以包括至少一个用户分区(如图11所示的用户分区1107),每个用户分区对应存储一个用户的用户数据信息。
在本实施例中,客户端1103可以是如上所述的硬件设备,如,机顶盒、智能移动终端、PAD、具有解码功能的智能电视等。优选地,所述客户端1103也可以是位于智能电视终端侧,其可以呈现为智能电视终端中装载的APP(应用程序,Application)的形式,这里的智能电视终端具体可以包括:机顶盒、移动终端、智能电视机等。一方面,客户端1103可用于播放服务提供设备1104发送的传送流(Transport Stream,TS)所解析出的用户界面,以及播放从其他网络服务器中获取的多媒体数据(如视频信号、音频信号等);另一方面,客户端1103可用于监听用户通过遥控器等输入装置产生的输入消息,并将该输入消息发送给服务提供设备1104或者调度服务器1102。从而客户端1103所显示的用户界面由服务提供设备1104推送,客户端1103仅解析并显示,且客户端1103所接收的用户对用户界面控制的输入消息,也会转发给服务提供设备1104以使其据此调整用户界面。
服务提供设备1104位于网络侧,其中,每个服务提供设备具体可以包括:硬件板卡和硬件板卡所承载的软件模块。需要说明的是,在本实施例中,各类应用程序可以直接安装在服务提供设备中,用户可以通过客户端1103展现的应用程序对应的用户界面,对服务提供设备1104中的应用程序进行各项操作,不再需要在客户端1103中单独安装应用程序,便于技术人员对所述智能电视系统进行统一维护,减少了工作量,提高了维护效率。
用户分区1107位于网络侧,一般地,每个用户对应有一个用户分区,各个用户的用户数据信息被保存在对应的用户分区下。进一步地,每个用户分区具有唯一一个地址信息,所述地址信息可以指示对应的用户分区的具体地址,通过所述地址信息可以快速查
找到用户分区,完成用户数据信息的调用。换而言之,调度服务器1102(或,管理服务器1105)可以仅对地址信息(数据量较小)进行维护,而不用对整个用户数据信息(数据量较大)进行维护,降低了维护的数据量,减少了资源占用,提高了系统运行速度,且,数据信息便于查找。
调度服务器1102位于网络侧,主要用于依据客户端1103发送的输入消息,分配一个空闲的、状态良好的服务提供设备1104与客户端1103对接;同时,可以将用户ID对应的用户分区挂载到所分配的服务提供设备1104上,也即,每个用户分区可以与唯一的用户ID相对应,如用户分区A对应用户A等等,这样,用户A在客户端1103在与上次分配的、编号为001的服务提供设备断开连接后,即使下次连接的是编号为002的服务提供设备,用户A仍然可以使用用户分区A,并且可以使用之前的历史记录等数据;
管理服务器1105位于网络侧,可用于对所有的服务提供设备进行管理,所述管理具体可以包括:状态上报、心跳管理、设置属性、获取属性、网络唤醒、软重启、硬重启等;可见,管理服务器1105可以作为远程服务器,采用本申请的技术方案在广域网实现对服务提供设备的网络唤醒。
本申请实施例中,服务提供设备也可以称为云盒或OTT机顶盒,具有优质的服务能力,能够为用户提供各种功能如高清视频、免费游戏等,其中,OTT即Over The Top,是指通过互联网向用户提供各种应用服务。将具有OTT功能的服务提供设备集成为设备服务器,通过视频流化技术,将服务提供设备的功能通过网络传输到普通机顶盒、智能电视等设备上,使其可以在不升级硬件的情况下使用OTT的高端功能。
可以将具有优质服务能力的服务提供设备中的各种功能,通过流化方式传输给安装于普通低端机顶盒或智能电视中的客户端上,客户端显示TS流对应的UI界面,其中,服务提供设备的功能包括但不限于:游戏、应用、电影、电视剧、教育、视频聊天、K歌等。
其中,对于安装客户端的普通机顶盒或智能电视的系统要求较低,例如,要求普通机顶盒具备播放RTSP 720P视频流的能力,又如,要求普通机顶盒需要具备访问IP网络的能力,从而在安装了客户端后可以上传键值等进行控制。
本实施例中,设备服务器中的每一片服务提供设备,具备较强的服务能力,这些服务能力包括但不限于:较强的处理能力、较强的图形计算能力、大内存、低功耗。可以运行目前市面上的大型游戏和应用,播放1080P以及2K的电影等。
而普通的机顶盒往往较为陈旧,首先其并非是智能的OTT机顶盒,其次其性能也比
较弱,不足以运行大型游戏和应用,客户往往需要升级或者替换更新的机顶盒才能满足这部分的娱乐需求。因此,服务提供设备能够解决上述问题。大型的游戏和应用都在云端的设备服务器中运行,再通过RTSP视频流传输给普通的机顶盒中安装的客户端进行播放,达到了使用低端机顶盒进行高端娱乐的目的,能够增强普通机顶盒的服务能力。
上述各实施例所述的客户端可以应用于基于图11中所示的智能电视系统中。但本领域技术人员应当明了,任意需要类似资源分配的系统或服务器,均可参照本申请实施例实现本申请的资源分配方案,而不仅限于上述架构下的应用场景。例如,所述资源分配方案还可以应用于对终端的远程控制系统(如,远程教学系统)等。
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请实施例并不受所描述的动作顺序的限制,因为依据本申请实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本申请实施例所必须的。
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。
本领域内的技术人员应明白,本申请实施例的实施例可提供为方法、装置、或计算机程序产品。因此,本申请实施例可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
在一个典型的配置中,所述计算机设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。内存可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用
于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括非持续性的电脑可读媒体(transitory media),如调制的数据信号和载波。
本申请实施例是参照根据本申请实施例的方法、终端设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理终端设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上,使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请实施例的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请实施例范围的所有变更和修改。
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。
以上对本申请所提供的一种客户端、一种智能电视系统和一种数据传输方法,进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施
例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。
Claims (22)
- 一种客户端,其特征在于,所述的客户端包括:网络模块、定制应用模块、解码模块和播放模块;其中,所述网络模块,用于连接网络;所述定制应用模块,用于与服务提供设备交互进行用户界面对应传送流的传输;执行传送流和多媒体数据的传输切换;以及与网络服务器交互进行所述多媒体数据的传输;所述解码模块,用于解析所述传送流或所述多媒体数据;所述播放模块,用于显示传送流对应的用户界面或多媒体数据对应的多媒体内容。
- 根据权利要求1所述的客户端,其特征在于,所述定制应用模块,用于向所述服务提供设备发送第一指令以暂停推送数据流,并向所述网络服务器请求获取播放多媒体数据,实现传送流到多媒体数据的传输切换;以及在需要停止播放所述多媒体数据时,发送第二指令给所述服务提供设备,接收所述服务提供设备反馈的传送流,实现多媒体数据到传送流的传输切换。
- 根据权利要求1所述的客户端,其特征在于,所述的客户端还包括:输入接收模块;所述输入接收模块,用于接收外置设备发送的原始输入信号;所述定制应用模块,还用于依据原始输入信号向服务提供设备反馈对应的输入信息以进行用户界面的控制。
- 根据权利要求3所述的客户端,其特征在于,所述定制应用模块,还用于将所述原始输入信息映射成能够被所述服务提供设备识别的输入信号,其中,所述输入信号包括指定系统的标准输入信号或键值信息或数字信息。
- 根据权利要求1所述的客户端,其特征在于,所述定制应用模块,还用于向调度服务器请求分配服务提供设备,与分配的服务提供设备建立连接;以及在申请分配服务提供设备和/或连接分配的服务提供设备时,发送用户数据以进行鉴权。
- 根据权利要求1所述的客户端,其特征在于,所述播放模块,还用于通过端口对服务提供设备推送的传送流进行监听,在监听到所述交互过程中服务提供设备发送的传送流中断时,确定所述服务提供设备出现异常状 态,将所述服务提供设备的异常状态发送给所述定制应用模块;定制应用模块,还用于将服务提供设备的异常状态上报给管理服务器。
- 根据权利要求1所述的客户端,其特征在于,所述播放模块,还用于在播放解析的传送流时,对传送流的图像帧进行检测,当检测到所述图像帧异常时,丢弃所述图像帧。
- 根据权利要求1所述的客户端,其特征在于,所述的客户端还包括:操作系统模块;所述操作系统模块,用于提供操作系统以支持其他模块的运行,其中,所述其他模块包括:网络模块、定制应用模块、解码模块、播放模块和输入接收模块。
- 一种智能电视系统,其特征在于,包括:至少一个如上述权利要求1-8任一所述的客户端、至少一个服务器和至少一个服务提供设备;其中,所述服务器用于向所述客户端分配服务提供设备;所述客户端设置在智能电视中,所述服务提供设备设置在网络侧,用于通过网络为建立连接的客户端提供互联网服务。
- 根据权利要求9所述的智能电视系统,其特征在于,还包括至少一个用户数据信息存储设备;所述至少一个用户数据信息存储设备包括:至少一个用户分区;其中,所述至少一个用户分区分别用于存储不同客户端对应的用户数据。
- 根据权利要求9所述的智能电视系统,其特征在于,所述服务提供设备包括:网络机顶盒;所述互联网服务,包括如下中的至少一个:电视直播、音视频服务、网页服务、游戏服务。
- 一种数据传输方法,其特征在于,所述的方法包括:接收服务提供设备传输的用户界面对应的传送流,或网络服务器传输多媒体数据;对所述传送流进行解析显示相应的用户界面,或对所述多媒体数据进行解析显示相应的多媒体内容;以及执行传送流和多媒体数据的传输切换。
- 根据权利要求12所述的方法,其特征在于,所述执行传送流和多媒体数据的传输切换,包括:传送流到多媒体数据的传输切换,所述传输切换包括如下步骤:向所述服务提供设备发送第一指令以暂停推送数据流,并向所述网络服务器请求获取播放多媒体数据;接收所述网络服务器反馈的多媒体数据;对所述多媒体数据进行解析显示相应的多媒体内容。
- 根据权利要求12所述的方法,其特征在于,所述执行传送流和多媒体数据的传输切换,包括:多媒体数据到传送流的传输切换,所述传输切换包括如下步骤:在需要停止播放所述多媒体数据时,发送第二指令给服务提供设备;接收所述服务提供设备反馈的传送流;对所述传送流进行解析显示相应的用户界面。
- 根据权利要求12所述的方法,其特征在于,还包括:接收外置设备发送的原始输入信号;依据所述原始输入信号向服务提供设备反馈对应的输入信息以进行用户界面的控制;接收所述服务提供设备发送的响应于输入信号的传送流,所述响应于输入信号的传送流为基于所述输入信息控制用户界面后生成的;对所述传送流进行解析显示相应控制的用户界面。
- 根据权利要求15所述的方法,其特征在于,所述接收外置设备发送的原始输入信号之后,还包括:将所述原始输入信息映射成能够被所述服务提供设备识别的输入信号,其中,所述输入信号包括指定系统的标准输入信号或键值信息或数字信息。
- 根据权利要求12所述的方法,其特征在于,所述的方法还包括:所述定制应用模块向调度服务器请求分配服务提供设备,与分配的服务提供设备建立连接;在申请分配服务提供设备和/或连接分配的服务提供设备时,所述定制应用模块发送用户数据给所述调度服务器以进行鉴权。
- 根据权利要求12所述的方法,其特征在于,所述的方法还包括:所述播放模块通过端口对服务提供设备推送的传送流进行监听;在监听到所述交互过程中服务提供设备发送的传送流中断时,所述播放模块确定所述服务提供设备出现异常状态,将所述服务提供设备的异常状态发送给所述定制应用模块;所述定制应用模块将服务提供设备的异常状态上报给管理服务器。
- 根据权利要求12所述的方法,其特征在于,所述的方法还包括:所述播放模块在播放解析的传送流时,对传送流的图像帧进行检测;当检测到所述图像帧异常时,所述播放模块丢弃所述图像帧。
- 根据权利要求12-19中任意一项权利要求所述的方法,其特征在于,所述的数据传输方法应用于智能电视系统中,所述智能电视系统包括:至少一个客户端、至少一个服务器、至少一个服务提供设备;其中,所述服务器用于向所述客户端分配服务提供设备;所述客户端设置在智能电视中,所述服务提供设备设置在网络侧,用于通过网络为建立连接的客户端提供互联网服务。
- 根据权利要求20所述的方法,其特征在于,所述智能电视系统,还包括至少一个用户数据信息存储设备;所述至少一个用户数据信息存储设备包括:至少一个用户分区;其中,所述至少一个用户分区分别用于存储不同客户端对应的用户数据。
- 根据权利要求20所述的方法,其特征在于,所述服务提供设备包括:网络机顶盒;所述互联网服务,包括如下中的至少一个:电视直播、音视频服务、网页服务、游戏服务。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510319784.9A CN106302365B (zh) | 2015-06-11 | 2015-06-11 | 一种客户端、智能电视系统和相应的数据传输方法 |
| CN201510319784.9 | 2015-06-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016197863A1 true WO2016197863A1 (zh) | 2016-12-15 |
Family
ID=57502905
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/084600 Ceased WO2016197863A1 (zh) | 2015-06-11 | 2016-06-03 | 一种客户端、智能电视系统和相应的数据传输方法 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106302365B (zh) |
| WO (1) | WO2016197863A1 (zh) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108874348A (zh) * | 2018-07-10 | 2018-11-23 | 众安信息技术服务有限公司 | 一种资源播控系统及方法 |
| CN111198682A (zh) * | 2018-11-19 | 2020-05-26 | 上海宜奇信息科技有限公司 | 一种电视游戏类应用软件开发引擎和实现方法 |
| CN112786179A (zh) * | 2019-11-01 | 2021-05-11 | 科美诊断技术股份有限公司 | 一种运行数据的上传方法及装置 |
| CN112994818A (zh) * | 2019-12-18 | 2021-06-18 | 海信视像科技股份有限公司 | 一种时间同步方法及显示设备 |
| CN113015019A (zh) * | 2021-03-09 | 2021-06-22 | 北京百度网讯科技有限公司 | 数据处理方法、装置和系统 |
| CN113595976A (zh) * | 2021-06-15 | 2021-11-02 | 阿里巴巴新加坡控股有限公司 | 多媒体播放方法、云服务器、系统及存储介质 |
| CN115190335A (zh) * | 2022-04-08 | 2022-10-14 | 特斯联科技集团有限公司 | 物联网家庭互动方法、系统、电子设备及存储介质 |
| WO2023173838A1 (zh) * | 2022-03-18 | 2023-09-21 | 腾讯科技(深圳)有限公司 | 一种虚拟场景加载方法、装置、设备、计算机可读存储介质及计算机程序产品 |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107493494A (zh) * | 2017-07-13 | 2017-12-19 | 安徽声讯信息技术有限公司 | 智能ott盒子语音控制系统 |
| CN112492392B (zh) * | 2020-11-18 | 2022-04-22 | 四川长虹电器股份有限公司 | 解决智能电视开机大量访问服务器的方法及装置 |
| CN115220858A (zh) * | 2021-04-19 | 2022-10-21 | 阿里巴巴新加坡控股有限公司 | 一种通信方法、系统、设备及存储介质 |
| CN117097939A (zh) * | 2023-08-04 | 2023-11-21 | 中山亿联智能科技有限公司 | 一种在云服务器上实现stb云子系统的方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101120334A (zh) * | 2005-01-05 | 2008-02-06 | Divx公司 | 交互式多信道数据分发系统 |
| CN103269453A (zh) * | 2013-05-29 | 2013-08-28 | 河南有线电视网络集团有限公司 | 机顶盒用户界面更新方法、前端装置、机顶盒和系统 |
| CN103856784A (zh) * | 2012-12-03 | 2014-06-11 | 联想(北京)有限公司 | 数据发送、接收方法以及电子设备 |
| WO2014145921A1 (en) * | 2013-03-15 | 2014-09-18 | Activevideo Networks, Inc. | A multiple-mode system and method for providing user selectable video content |
-
2015
- 2015-06-11 CN CN201510319784.9A patent/CN106302365B/zh active Active
-
2016
- 2016-06-03 WO PCT/CN2016/084600 patent/WO2016197863A1/zh not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101120334A (zh) * | 2005-01-05 | 2008-02-06 | Divx公司 | 交互式多信道数据分发系统 |
| CN103856784A (zh) * | 2012-12-03 | 2014-06-11 | 联想(北京)有限公司 | 数据发送、接收方法以及电子设备 |
| WO2014145921A1 (en) * | 2013-03-15 | 2014-09-18 | Activevideo Networks, Inc. | A multiple-mode system and method for providing user selectable video content |
| CN103269453A (zh) * | 2013-05-29 | 2013-08-28 | 河南有线电视网络集团有限公司 | 机顶盒用户界面更新方法、前端装置、机顶盒和系统 |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108874348A (zh) * | 2018-07-10 | 2018-11-23 | 众安信息技术服务有限公司 | 一种资源播控系统及方法 |
| CN108874348B (zh) * | 2018-07-10 | 2023-10-27 | 众安信息技术服务有限公司 | 一种资源播控系统及方法 |
| CN111198682A (zh) * | 2018-11-19 | 2020-05-26 | 上海宜奇信息科技有限公司 | 一种电视游戏类应用软件开发引擎和实现方法 |
| CN111198682B (zh) * | 2018-11-19 | 2023-06-09 | 上海宜奇信息科技有限公司 | 一种电视游戏类应用软件开发引擎和实现方法 |
| CN112786179A (zh) * | 2019-11-01 | 2021-05-11 | 科美诊断技术股份有限公司 | 一种运行数据的上传方法及装置 |
| CN112994818A (zh) * | 2019-12-18 | 2021-06-18 | 海信视像科技股份有限公司 | 一种时间同步方法及显示设备 |
| CN112994818B (zh) * | 2019-12-18 | 2022-12-16 | 海信视像科技股份有限公司 | 一种时间同步方法及显示设备 |
| CN113015019A (zh) * | 2021-03-09 | 2021-06-22 | 北京百度网讯科技有限公司 | 数据处理方法、装置和系统 |
| CN113595976A (zh) * | 2021-06-15 | 2021-11-02 | 阿里巴巴新加坡控股有限公司 | 多媒体播放方法、云服务器、系统及存储介质 |
| WO2023173838A1 (zh) * | 2022-03-18 | 2023-09-21 | 腾讯科技(深圳)有限公司 | 一种虚拟场景加载方法、装置、设备、计算机可读存储介质及计算机程序产品 |
| US11980812B2 (en) | 2022-03-18 | 2024-05-14 | Tencent Technology (Shenzhen) Company Limited | Cloud gaming by streaming video data on playback device |
| US12303780B2 (en) * | 2022-03-18 | 2025-05-20 | Tencent Technology (Shenzhen) Company Limited | Pulling streaming data by a playback device from a cloud device |
| CN115190335A (zh) * | 2022-04-08 | 2022-10-14 | 特斯联科技集团有限公司 | 物联网家庭互动方法、系统、电子设备及存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106302365A (zh) | 2017-01-04 |
| CN106302365B (zh) | 2019-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016197863A1 (zh) | 一种客户端、智能电视系统和相应的数据传输方法 | |
| CN106302366B (zh) | 一种数据传输方法、装置和智能电视系统 | |
| WO2016197864A1 (zh) | 连接状态检测方法、装置和智能电视系统 | |
| CN105308673B (zh) | 用于管理hdmi源的输出的方法、系统和介质 | |
| CN106303674B (zh) | 数据传输方法、装置和智能电视系统 | |
| CN102802048B (zh) | 一种多屏互动系统和方法 | |
| CN106454472B (zh) | 多屏互动的方法及系统 | |
| CN106301865B (zh) | 应用于服务提供设备的数据处理方法和设备 | |
| US10749852B2 (en) | Systems and methods for connecting private devices to public devices according to connection parameters | |
| WO2016197876A1 (zh) | 远程控制方法、远程服务器、管理设备和终端 | |
| WO2016197866A1 (zh) | 网络唤醒方法、远程服务器和网络交换设备 | |
| CN102460407A (zh) | 虚拟桌面服务 | |
| CN108136259B (zh) | 用于流式传输和用于再现应用的方法和电信网络 | |
| KR20150070243A (ko) | 스트리밍 디지털 콘텐츠의 재생을 관리하기 위한 시스템 및 방법 | |
| WO2017075956A1 (zh) | 内容投射方法及移动终端 | |
| CN103067776A (zh) | 节目推送方法、系统及智能显示设备、云端服务器 | |
| WO2017124860A1 (zh) | 分布式无线多屏虚拟机服务系统 | |
| US20200037025A1 (en) | Systems and methods for sharing devices that provide content & interactive television services | |
| CN112055227B (zh) | 云游戏交互方法、系统、装置、存储介质与电子设备 | |
| KR20150067351A (ko) | 스트리밍 디지털 콘텐츠의 재생을 관리하기 위한 시스템 및 방법 | |
| CN104394127A (zh) | 一种多媒体分享方法、设备和系统 | |
| WO2015077983A1 (zh) | 在家庭网络中播放媒体的装置和方法 | |
| US10079728B2 (en) | System and method for discovery of devices on a network | |
| WO2016202202A1 (zh) | 设备连接的方法和装置、以及智能电视系统 | |
| CN106658066A (zh) | 多机顶盒带宽分配方法及装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16806761 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16806761 Country of ref document: EP Kind code of ref document: A1 |