CN116795444A - Display equipment, interactive application running device and method - Google Patents

Abstract

The application discloses a display device, an interactive application running device and a method, comprising the following steps: receiving a media asset playing instruction sent by a user; responding to a media asset playing instruction, and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, wherein the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application; judging whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a prestored file for starting the interactive application; and if the display equipment contains the resource file, starting the interactive application according to the resource file. The technical scheme provided by the application can solve the problems that the starting speed of the interactive application is low and the data transmission of the interactive application and the media application is complicated in the existing bidirectional communication process of the interactive application and the media application.

Description

Display equipment, interactive application running device and method

Technical Field

The present application relates to the field of display devices, and in particular, to a display device, an interactive application running apparatus and a method.

Background

The display device can run the interactive application through the browser so that the interactive application interacts with the media asset application, and the function of acquiring relevant user settings or adjusting relevant parameters of the display device is executed through the interactive application.

The existing interactive application source is usually broadcast or broadband, and because the broadcast has the characteristic of being sent once at intervals, and the interactive application can be started after the resource file is acquired from the broadcast, the starting time of the interactive application has uncertainty, and after the interactive application is started, the interactive data is required to be transmitted to the media application of the application layer through the application layer and the user space and then transmitted to the hardware layer and the framework layer through the user space.

Therefore, the starting speed of the existing interactive application is low, and the data transmission of the interactive application and the media resource application is complex.

Disclosure of Invention

The application provides display equipment, an interactive application running device and a method, which can solve the problems that in the existing bidirectional communication process of an interactive application and a media resource application, the starting speed of the interactive application is low and the data transmission of the interactive application and the media resource application is complicated.

In a first aspect, the present application shows a display device comprising: a display; a controller configured to: receiving a media asset playing instruction sent by a user; responding to a media asset playing instruction, and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, wherein the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application; judging whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a prestored file for starting the interactive application; and if the display equipment contains the resource file, starting the interactive application according to the resource file. By adopting the method and the device, the display equipment can start the interactive application according to the pre-stored resource file, so that the starting efficiency of the interactive application is improved.

In some embodiments, the controller is further configured to: when an interactive application is started, a first client is established in the interactive application; connecting a first client with a server; so that the server generates a first handle and a first parameter; the control server side sends first interaction data to the first client side according to the first handle and the first parameter; the first interactive data is data sent by the media resource application to the interactive application. By adopting the embodiment, the display device establishes the first client in the interactive application after the interactive application is started, so that the first client and the server directly perform data transmission, layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

In some embodiments, the controller is further configured to: when the media resource application is started, a second client is established in the media resource application; connecting the second client with the server so that the server generates a second handle and a second parameter; the control server side sends second interaction data to the second client side according to the second handle and the second parameter; the second interactive data is data sent by the interactive application to the media application. By adopting the embodiment, after the media resource application is started, the display equipment establishes the second client in the media resource application, so that the second client and the server directly perform data transmission, further, the data transmission between the second client and the first client is realized, the layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

In a second aspect, the present application also shows an interactive application running device, including: the receiving module is used for receiving a media asset playing instruction sent by a user; the management module is used for responding to the media asset playing instruction and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, wherein the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application; the judging module judges whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a prestored file for starting the interactive application; and the starting module is used for starting the interactive application according to the resource file when the display equipment contains the resource file. By adopting the method and the device, the display equipment can start the interactive application according to the pre-stored resource file, so that the starting efficiency of the interactive application is improved.

In some embodiments, the apparatus further comprises: the analysis module is used for receiving a first callback function registered by the management module to the analysis module when the display device is electrified, and the first callback function is used for sending the first information to the management module after analyzing the first information when the management module acquires the first information of the media asset. By adopting the embodiment, the display device automatically returns after the interaction data is analyzed in a mode of registering the callback function, so that the layer-by-layer calling of the interaction data is avoided, and the communication flow is simplified.

In some embodiments, the apparatus further comprises: and the cache module is used for registering a second callback function to the analysis module when the display equipment is electrified, and the second callback function is used for sending the resource file back to the cache module after the resource file is analyzed by the analysis module when the display equipment contains the resource file of the interactive application. By adopting the embodiment, the display device realizes automatic return after interaction data analysis by registering the callback function, avoids layer-by-layer calling of the interaction data, and simplifies the communication flow.

In some embodiments, the apparatus further comprises: the first establishing module is used for establishing a first client in the interactive application when the interactive application is started; the first connection module is used for connecting the first client with the server; so that the server generates a first handle and a first parameter; the first sending module is used for controlling the server to send first interaction data to the first client according to the first handle and the first parameter; the first interactive data is data sent by the media resource application to the interactive application. By adopting the embodiment, after the display equipment starts the interactive application, the first client is established in the interactive application, so that the first client and the server directly perform data transmission, layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

In some embodiments, the apparatus further comprises: the second establishing module is used for establishing a second client in the media resource application when the media resource application is started; the second connection module is used for connecting the second client with the server so as to enable the server to generate a second handle and a second parameter; the second sending module is used for controlling the server to send second interaction data to the second client according to the second handle and the second parameter; the second interactive data is data sent by the interactive application to the media application. By adopting the embodiment, after the media resource application is started, the display equipment establishes the second client in the media resource application, so that the second client and the server directly perform data transmission, further, the data transmission between the second client and the first client is realized, the layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

In a third aspect, the present application further shows an interactive application running method, including: receiving a media asset playing instruction sent by a user; responding to a media asset playing instruction, and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, wherein the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application; judging whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a prestored file for starting the interactive application; and if the display equipment contains the resource file, starting the interactive application according to the resource file. By adopting the method and the device, the display equipment can start the interactive application according to the pre-stored resource file, so that the starting efficiency of the interactive application is improved.

In some embodiments, further comprising: when an interactive application is started, a first client is established in the interactive application; connecting a first client with a server; so that the server generates a first handle and a first parameter; the control server side sends first interaction data to the first client side according to the first handle and the first parameter; the first interactive data is data sent by the media resource application to the interactive application. By adopting the embodiment, the display device establishes the first client in the interactive application after the interactive application is started, so that the first client and the server directly perform data transmission, layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

The technical scheme can solve the problems that in the existing bidirectional communication process of the interactive application and the media resource application, the starting speed of the interactive application is low and the data transmission of the interactive application and the media resource application is complex.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 illustrates a schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments;

fig. 2 shows a block diagram of a configuration of a control device 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration block diagram of a display device 200 according to some embodiments;

FIG. 5 illustrates an interactive application usage scenario diagram according to some embodiments;

FIG. 6 illustrates an interactive application start-up flow diagram in accordance with some embodiments;

FIG. 7 illustrates a schematic diagram of a data transfer flow for an interactive application and a media application in accordance with some embodiments;

FIG. 8 illustrates a display device configuration flow diagram in accordance with some embodiments;

FIG. 9 illustrates a schematic diagram of a data transmission flow in accordance with some embodiments;

FIG. 10 illustrates a schematic diagram of an interactive application running apparatus in accordance with some embodiments.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

The following first explains the technical terms related to the embodiments of the present application.

1. ATSC 3.0 is the television broadcast ATSC latest digital television standard created by the Advanced Television Systems Committee (ATSC). ATSC 3.0 contains about 20 standards that cover various aspects of the system and allow broadcasters to provide customized, dynamic experiences including dynamic advertisement placement, personalized graphics, and secondary screen application synchronization.

2. Hypertext markup language (Hyper Text Markup Language, HTML), is a markup language that includes a series of tags by which document formats on a network can be unified, making discrete network resources connected as a logical entity.

3. The hypertext markup language portal page location description (HTML Entry pages Location Description, HELD) is a descriptive text composed of HTML commands that can be used to describe words, graphics, animations, sounds, forms, links, etc.

4. Web Socket is a protocol that performs full duplex communication over a single TCP connection. The Web Socket facilitates data exchange between the client and the server, and allows the server to actively push data to the client. In the Web Socket API, the browser and the server only need to complete one handshake, and a persistent connection can be created between the two and bidirectional data transmission can be performed.

The display device shown in the present application supports running of interactive applications under the ATSC 3.0 architecture, but the technical solution shown in the present application includes, but is not limited to, running interactive applications only under the architecture.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving image signals from the controller output, for displaying video content, image content, and a menu manipulation interface, and for manipulating a UI interface by a user.

In some embodiments, the display 260 may be a liquid crystal display, an OLED display, a projection device, and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

In some embodiments, the user interface may be configured to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, etc., according to a standard codec protocol of an input signal, and may obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

As shown in fig. 4, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

FIG. 5 illustrates an interactive application usage scenario diagram. As shown in fig. 5, a user runs an interactive application through a browser in a display device, and in the running process of the interactive application, the user can interact with a media resource application through the interactive application, so that the interactive application executes to acquire relevant user settings, such as closed caption settings and parental lock settings; or adjust display device related parameters such as setting volume parameters, screen zoom parameters, etc. of the display device.

Since the interactive application is running in a browser, the interactive application itself is in the form of a web page, the source of which may be broadcast or broadband. When the source of the interactive application is broadcasting, the display equipment stores the interactive application in a local storage in html and css file format; when the source of the interactive application is broadband, the display device runs the interactive application through a uniform resource locator (Uniform Resource Locator, URL).

It should be noted that, in the process that the interactive application interacts with the media resource application to make the interactive application execute to obtain the relevant user setting or adjust the relevant parameters of the display device, the interactive application needs to establish a communication channel with the media resource application to realize two-way communication between the two.

Fig. 6 illustrates an interactive application start-up flow diagram. As shown in fig. 6, in the process of starting the interactive application, the display device needs to acquire the HELD information first, acquire the resource file of the interactive application according to the HELD information request, and start the interactive application according to the resource file after acquiring the resource file. However, in the process that the display device requests to acquire the resource file of the interactive application according to the HELD information, if the interactive application is derived from a broadcast, and since the broadcast has a characteristic of being transmitted once at intervals, the time when the display device requests to acquire the resource file of the interactive application has uncertainty, which results in affecting the starting speed of the interactive application.

Fig. 7 illustrates a schematic diagram of a data transmission flow between an interactive application and a media application. As shown in fig. 7, after the interactive application is started, the interactive application performs two-way communication with the media application, data parameters in the interactive application are firstly transmitted to an interactive application engine through a Web socket protocol of a user space, and then transmitted to a frame layer through a HAL interface definition language (HAL Interface Definition Language, HIDL) of a hardware layer by the interactive application engine; and calling an interface of the jar packet at the framework layer to transmit the data in the interactive application to the media resource application. In the process of data transmission between the interactive application and the media application, the data is transferred to the user space through the application layer after being called layer by layer, then transferred to the hardware layer and the framework layer through the user space, and finally transferred back to the application layer, and the transmission process is complex.

It should be noted that, in the process of data transmission between the interactive application and the media resource application, when the media resource application switches the media resource, the display device will clear the resource file of the interactive application corresponding to the previous media resource, receive the new HELD information, re-request to obtain the resource file of the interactive application according to the new HELD information, and wait for the successful downloading of the resource file of the interactive application, and start the interactive application according to the newly downloaded resource file, so that the starting speed of the interactive application is slow in the process of switching the media resource.

In order to solve the problems of slow starting speed of the interactive application and complicated data transmission of the interactive application and the media resource application in the prior two-way communication process of the interactive application and the media resource application, the application discloses display equipment, which comprises: a display; a controller configured to perform steps S801 to S804 shown in fig. 8;

step S801, a media playing instruction sent by a user is received.

In some embodiments, the display device may receive a media playing instruction sent by a user through a control device or an intelligent device, or may receive a media playing instruction sent by a user through a module configured inside the display device and acquiring a voice instruction, or may receive a media playing instruction sent by a user through a voice control device set outside the display device.

Step S802, responding to a media asset playing instruction, and acquiring first information of media assets; the first information comprises a first identifier and a second identifier, wherein the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the media resource application is an application for playing media resources, and the interactive application is an application for setting the media resource application.

In some embodiments, the first information is interactive application start information, which is included in the HELD, and specifically includes: a first identifier and a second identifier; the first identifier may be an application identifier (Appcontextld), and the second identifier may be an interactive application portal page uniform resource locator (EntryPageUrl). Each media asset corresponds to first information, taking the media asset as a first video, taking Y-utube as an example of media asset application for playing the first video, wherein the first identifier can be used for identifying an interactive application capable of interacting with Y-utube, and the interactive application can be used for hiding subtitles of the media asset in Y-utube and adjusting the volume of the media asset.

It should be noted that, although each media asset corresponds to a first information, the content of the first information corresponding to different media assets is the same, taking the media asset application as y×utubes as an example, in y×utubes, the first video is switched to the second video, because the interactive application corresponding to y×utubes is not changed, although in the process of switching the first video to the second video, the first information corresponding to the first video is switched to the first information corresponding to the second video, the content of the first information is not changed, and the first identifier is still used for identifying the interactive application capable of interacting with y×utubes, and the second identifier is still used for identifying the address of the interactive application.

Step S803, judging whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a pre-stored file for starting the interactive application.

As can be seen from the above embodiments, in the process of switching the first information corresponding to the first video to the first information corresponding to the second video, the content of the first information is not changed, so the content of the resource file of the interactive application corresponding to the first video and the content of the resource file of the interactive application corresponding to the second video, which are obtained according to the first information, are not changed. Therefore, in the process of switching the first video into the second video, if the resource file of the interactive application corresponding to the first video is deleted and then re-downloaded into the resource file of the interactive application corresponding to the second video, the starting speed of the interactive application is slow.

When the interactive application and the media resource application perform bidirectional communication for the first time, the display device downloads the resource file of the interactive application from the broadcast or URL, and starts the interactive application according to the resource file of the interactive application, and the resource file of the interactive application is stored while the interactive application is started.

It should be noted that, the file format of the resource file of the interactive application is an NRT file, and the display device downloads the resource file of the interactive application according to the broadcast or URL, and stores the resource file to the local in the NRT file format.

Each interactive application corresponds to the unique first identifier and the unique second identifier, and the display device may store resource files of multiple interactive applications, so when the display device acquires the first identifier and the second identifier, the display device traverses the data in the local storage, judges whether the resource files of the interactive applications corresponding to the first identifier and the second identifier are included, and if so, executes step S804.

In step S804, if the display device contains a resource file, the interactive application is started according to the resource file.

In some embodiments, if the display device does not contain a resource file, the resource file is re-downloaded to launch the interactive application in accordance with the resource file. It should be noted that, when a user runs any interactive application for the first time, the display device needs to acquire the resource file of the interactive application from the broadcast or the network, and cannot acquire the resource file of the interactive application from the local storage of the display device, or even if the interactive application is not running in the display device for the first time, the display device performs actions such as memory cleaning, hardware upgrading or software updating during the period of time between running again and running for the first time too long, so that the pre-stored resource file is lost, and in such a case, the display device needs to re-download the resource file to start the interactive application according to the resource file.

In some embodiments, the controller is further configured to: when an interactive application is started, a first client is established in the interactive application; connecting a first client with a server; so that the server generates a first handle and a first parameter; the control server side sends first interaction data to the first client side according to the first handle and the first parameter; the first interactive data is data sent by the media resource application to the interactive application.

The first client is a Web socket client established according to a Web socket protocol, the server is a Web socket server established according to the Web socket protocol, and the display equipment is connected with the server by establishing the first client, so that transmission of interaction data in a hardware layer and a framework layer is reduced, and interaction flow is simplified.

The specific data transmission mode of the first client and the server is that data is transmitted through a first Handle and a first parameter, and it should be noted that the Handle (Handle) is an identifier for identifying an object or an item, and may be used for describing a window, a file, etc. and is used for recording a change of data, when an address of the data changes, that is, the Handle records. The handle may be in the form of a certificate, an object, or a real pointer. For example, the first parameter in the embodiment of the present application may be ws: /(localhost): 9001/interactive; wherein, ws: /(localhost): 9001 is used to indicate that the first client is connected to the local port 9001 (i.e. the server), and interactive indicates that the first client is from an interactive application.

In some embodiments, the controller is further configured to: when the media resource application is started, a second client is established in the media resource application; connecting the second client with the server so that the server generates a second handle and a second parameter; the control server side sends second interaction data to the second client side according to the second handle and the second parameter; the second interactive data is data sent by the interactive application to the media resource application.

The specific data transmission manner of the second client and the server is that data transmission is performed through the second handle and the second data, and by way of example, the media asset application is a live TV (live TV), and the second parameter may be ws: /(localhost): 9001/liveTV; wherein, ws: /(localhost): 9001 is used to indicate that the second client is connected to the local port 9001 (i.e., the server), and liveTV indicates that the second client is from a media asset application.

Fig. 9 is a schematic diagram illustrating a data transmission flow according to an embodiment of the present application. As shown in fig. 9, the first client establishes a bidirectional communication connection with the server, and the second client establishes a bidirectional communication connection with the server, so that the first client establishes a bidirectional communication connection with the second client, and the first client and the second client directly complete data transmission in the user space without data layer-by-layer calling, thereby simplifying the communication flow.

According to the display equipment disclosed by the application, the default starting mode of the interactive application (namely, the interactive application is started each time to download the resource file of the interactive application) is changed into the quick starting mode (namely, the analyzed resource file of the interactive application is stored so as to be called again), so that the starting speed of the interactive application is accelerated, and meanwhile, the communication flow between the interactive application and the media application is simplified by establishing the two-way communication among the first client, the server and the second client in the user space.

In the embodiments provided by the present application described above, the embodiments provided by the present application are described in terms of the display device itself and the interaction of the display device with the user. It will be appreciated that the display device, in order to achieve the above-described functions, includes corresponding hardware structures and/or software modules that perform the respective functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

Based on the above embodiments, the present application also shows an interactive application running device, and fig. 10 schematically shows an interactive application running device according to an embodiment of the present application. As shown in fig. 10, the apparatus includes:

the receiving module is used for receiving a media asset playing instruction sent by a user; the management module is used for responding to the media asset playing instruction and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, wherein the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application; the judging module judges whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a prestored file for starting the interactive application; and the starting module is used for starting the interactive application according to the resource file when the display equipment contains the resource file.

It should be noted that, in the media asset playing process, the management module acquires the first information from the broadcast or the network, so as to acquire the resource file according to the first information and further start the interactive application. The management module is used for managing the life cycle of the interactive application, including determining what interactive application is started and determining when to open and close the interactive application. When the first video is played by the media asset, the user can open the interactive application for closed caption setting through the management module, in specific implementation, the user can open the interactive application through the browser, request first information of the interactive application through the network, acquire a resource file according to the first information, and further determine starting time of the interactive application.

In some embodiments, the apparatus further comprises: the analysis module is used for receiving a first callback function registered by the management module to the analysis module when the display device is electrified, and the first callback function is used for sending the first information to the management module after analyzing the first information when the management module acquires the first information of the media asset. By adopting the embodiment, the display device automatically returns after the interaction data is analyzed in a mode of registering the callback function, so that the layer-by-layer calling of the interaction data is avoided, and the communication flow is simplified.

For example, after the management module obtains the first information from the network, the management module cannot directly obtain the corresponding resource file according to the first information, but needs to parse the first information to obtain the corresponding resource file according to the parsed first information, so that the management module sends the first information to the parsing module after obtaining the first information.

It should be noted that, the callback function is a function transferred as a parameter, so that the user can transfer the function pointer to be called as a parameter to a function, so that the function can flexibly use different methods when processing similar events.

In some embodiments, the apparatus further comprises:

and the cache module is used for registering a second callback function to the analysis module when the display equipment is electrified, and the second callback function is used for sending the resource file back to the cache module after the resource file is analyzed by the analysis module when the display equipment contains the resource file of the interactive application. By adopting the embodiment, the display device realizes automatic return after interaction data analysis by registering the callback function, avoids layer-by-layer calling of the interaction data, and simplifies the communication flow.

The resource file can be pre-stored in the cache module, and the resource file can be a parsed resource file or an unresolved resource file. When the management module obtains the analyzed first information, the management module can judge whether the cache module contains the resource file corresponding to the first information through the judging module according to the analyzed first information, and if the corresponding resource file is the analyzed resource file, the management module can directly send the analyzed resource file to the starting module to start the application. If the corresponding resource file is an unresolved resource file, the cache module may trigger the second callback function when the management module obtains the first information after resolution, so as to send the unresolved resource file to the resolution module for resolution, and send the unresolved resource file back to the cache module through the second callback function.

For example, when the first identifier (App context) included in the first information is App1, the second identifier (i.e., entry Page Url) is index. Html, the App context st included in the pre-stored resource file in the cache module is App1, app2, and Entry Page Url is index. Html, the cache module includes the resource file corresponding to the first information.

In some embodiments, the apparatus further comprises: the first establishing module is used for establishing a first client in the interactive application when the interactive application is started; the first connection module is used for connecting the first client with the server; so that the server generates a first handle and a first parameter; the first sending module is used for controlling the server to send first interaction data to the first client according to the first handle and the first parameter; the first interactive data is data sent by the media resource application to the interactive application. By adopting the embodiment, after the display equipment starts the interactive application, the first client is established in the interactive application, so that the first client and the server directly perform data transmission, layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

In some embodiments, the apparatus further comprises: the second establishing module is used for establishing a second client in the media resource application when the media resource application is started; the second connection module is used for connecting the second client with the server so as to enable the server to generate a second handle and a second parameter; the second sending module is used for controlling the server to send second interaction data to the second client according to the second handle and the second parameter; the second interactive data is data sent by the interactive application to the media application. By adopting the embodiment, after the media resource application is started, the display equipment establishes the second client in the media resource application, so that the second client and the server directly perform data transmission, further, the data transmission between the second client and the first client is realized, the layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

According to the interactive application running device, the default starting mode of the interactive application (namely, the interactive application is started each time to download the resource file of the interactive application) is changed into the quick starting mode (namely, the analyzed resource file of the interactive application is stored so as to be called again), so that the starting speed of the interactive application is accelerated, and meanwhile, the communication flow between the interactive application and the media application is simplified by establishing the two-way communication among the first client, the server and the second client in the user space.

Based on the above embodiment, the present application further provides an interactive application running method, including:

receiving a media asset playing instruction sent by a user; responding to a media asset playing instruction, and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, wherein the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application; judging whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a prestored file for starting the interactive application; and if the display equipment contains the resource file, starting the interactive application according to the resource file. By adopting the method and the device, the display equipment can start the interactive application according to the pre-stored resource file, so that the starting efficiency of the interactive application is improved.

In some embodiments, further comprising: when an interactive application is started, a first client is established in the interactive application; connecting a first client with a server; so that the server generates a first handle and a first parameter; the control server side sends first interaction data to the first client side according to the first handle and the first parameter; the first interactive data is data sent by the media resource application to the interactive application. By adopting the embodiment, the display device establishes the first client in the interactive application after the interactive application is started, so that the first client and the server directly perform data transmission, layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

In some embodiments, further comprising: when the media resource application is started, a second client is established in the media resource application; connecting the second client with the server so that the server generates a second handle and a second parameter; the control server side sends second interaction data to the second client side according to the second handle and the second parameter; the second interactive data is data sent by the interactive application to the media application. By adopting the embodiment, after the media resource application is started, the display equipment establishes the second client in the media resource application, so that the second client and the server directly perform data transmission, further, the data transmission between the second client and the first client is realized, the layer-by-layer calling of interactive data is avoided, and the bidirectional communication flow between the interactive application and the media resource application is simplified.

According to the interactive application running method, the default starting mode of the interactive application (namely, the interactive application is started each time to download the resource file of the interactive application again) is changed into the quick starting mode (namely, the analyzed resource file of the interactive application is stored so as to be called again), so that the starting speed of the interactive application is accelerated, and meanwhile, the communication flow between the interactive application and the media application is simplified by establishing the two-way communication among the first client, the server and the second client in the user space.

It should be understood that, the specific implementation manner of each step in the above interactive application running method may refer to the foregoing display device embodiment, which is not described herein. According to the embodiment, the technical scheme can solve the problems that in the existing bidirectional communication process of the interactive application and the media application, the starting speed of the interactive application is low and the data transmission of the interactive application and the media application is complicated.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, characterized by comprising:

a display;

a controller configured to:

receiving a media asset playing instruction sent by a user;

responding to the media asset playing instruction, and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, and the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application;

judging whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a pre-stored file for starting the interactive application;

And if the display equipment contains the resource file, starting the interactive application according to the resource file.

2. The display device of claim 1, wherein the controller is further configured to:

when the interactive application is started, a first client is established in the interactive application;

connecting the first client with a server; so that the server generates a first handle and a first parameter;

controlling the server to send first interaction data to the first client according to the first handle and the first parameter; the first interaction data is data sent by the media resource application to the interaction application.

3. The display device of claim 2, wherein the controller is further configured to:

when the media resource application is started, a second client is established in the media resource application;

connecting the second client with a server so that the server generates a second handle and a second parameter;

controlling the server to send second interaction data to the second client according to the second handle and the second parameter; the second interaction data is data sent by the interaction application to the media resource application.

4. An interactive application execution apparatus, the apparatus comprising:

the receiving module is used for receiving a media asset playing instruction sent by a user;

the management module is used for responding to the media asset playing instruction and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, and the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application;

the judging module judges whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a pre-stored file for starting the interactive application;

and the starting module is used for starting the interactive application according to the resource file when the display equipment contains the resource file.

5. The interactive application execution apparatus of claim 4, wherein the apparatus further comprises:

the analysis module is used for receiving a first callback function registered by the management module to the analysis module when the display device is electrified, and the first callback function is used for sending the first information to the management module after analysis when the management module obtains the first information of the media asset.

6. The interactive application execution apparatus of claim 5, wherein the apparatus further comprises:

and the cache module is used for registering a second callback function to the analysis module when the display equipment is electrified, and the second callback function is used for sending the resource file back to the cache module after the resource file is analyzed by the analysis module when the display equipment contains the resource file of the interactive application.

7. The interactive application execution apparatus of claim 5, wherein the apparatus further comprises:

the first establishing module is used for establishing a first client in the interactive application when the interactive application is started;

the first connection module is used for connecting the first client side with the server side; so that the server generates a first handle and a first parameter;

the first sending module is used for controlling the server to send first interaction data to the first client according to the first handle and the first parameter; the first interaction data is data sent by the media resource application to the interaction application.

8. The interactive application execution apparatus of claim 7, wherein the apparatus further comprises:

The second establishing module is used for establishing a second client in the media resource application when the media resource application is started;

the second connection module is used for connecting the second client with the server so that the server generates a second handle and a second parameter;

the second sending module is used for controlling the server to send second interaction data to the second client according to the second handle and the second parameter; the second interaction data is data sent by the interaction application to the media resource application.

9. An interactive application running method, comprising:

receiving a media asset playing instruction sent by a user;

responding to the media asset playing instruction, and acquiring first information of the media asset; the first information comprises a first identifier and a second identifier, and the first identifier is used for identifying an interactive application which interacts with the media resource application; the second identifier is used for identifying the address of the interactive application; the interactive application is used for setting the media resource application;

judging whether the display equipment contains the resource file of the interactive application according to the first identifier and the second identifier; the resource file is a pre-stored file for starting the interactive application;

And if the display equipment contains the resource file, starting the interactive application according to the resource file.

10. The interactive application execution method according to claim 9, further comprising:

when the interactive application is started, a first client is established in the interactive application;

connecting the first client with a server; so that the server generates a first handle and a first parameter;

controlling the server to send first interaction data to the first client according to the first handle and the first parameter; the first interaction data is data sent by the media resource application to the interaction application.