CN117812312A

CN117812312A - Display equipment and multi-application control method

Info

Publication number: CN117812312A
Application number: CN202311588957.8A
Authority: CN
Inventors: 马华柱; 王小伟; 赵忠民
Original assignee: Vidaa Netherlands International Holdings BV
Current assignee: Vidaa Netherlands International Holdings BV
Priority date: 2023-11-27
Filing date: 2023-11-27
Publication date: 2024-04-02

Abstract

Some embodiments of the present application provide a display device and a multi-application control method, where the method may monitor an operation instruction of a second application in a state where a first application and the second application are simultaneously running, and respond to a target operation instruction of the second application to obtain update data generated by the target operation instruction. And inquiring application objects of the second application in a plurality of rendering processes according to the address information and the application numbers by calling application proxy parameters associated with the second application, and synchronously transmitting the update data to all the application objects. The application proxy parameter is a parameter which is synchronously created when the second application is created and recorded with address information and application numbers of the application. By introducing application proxy parameters, hbbTV application can be managed from the source, the problem of abnormal call caused by mismatching of application information when multiple applications of a browser run is solved, accurate control over multiple application scenes is realized, and stability of the multiple application scenes is improved.

Description

Display equipment and multi-application control method

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and a multi-application control method.

Background

The display device is an intelligent device capable of presenting a user interface and supporting user interaction. Taking intelligent electricity as an example, the intelligent television is based on the Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, and is a television product integrating multiple functions of video, entertainment, data and the like, and the intelligent television is used for meeting the diversified and personalized requirements of users.

Hybrid Broadcast/Broadband TV (HbbTV), which is a display device compatible with digital video broadcasting (Digital Video Broadcasting, DVB), provides a signaling, transmission and presentation mechanism for enhanced and interactive television services. A display device such as a hybrid broadcast broadband television can present display content through a HbbTV application that can perform interactions based on an HTML/JavaScript browser environment and present the display content. HbbTV applications can run in different types of terminal equipment, such as integrated digital televisions, set-top boxes and personal video recorders (Personal Video Recorder, PVR) and the like, which incorporate HbbTV receiving functionality.

Because the bottom HbbTV mode cannot monitor the running condition of the upper application, when the upper application creates a new application in a new tag page mode, a new rendering process is created, and the new application exists in the original rendering process and the new rendering process at the same time. When the HbbTV mode sends information, the information is only dispatched to one application because of two identical application objects, so that the application information in two rendering processes is not matched, an abnormality occurs when the information is called, and the problems that a key cannot respond or an application program crashes and the like occur.

Disclosure of Invention

The application provides display equipment and a multi-application control method, which are used for solving the problem of abnormal call caused by mismatching of application information in multi-application operation.

In one aspect, some embodiments of the present application provide a display device, including: a display and a controller. Wherein the display is configured to display a user interface; the controller is configured to perform the following program steps:

in a state of running a first application and a second application simultaneously, monitoring an operation instruction of the second application, wherein the second application is an application created through the first application; an application object of the second application is included in a first rendering process of the first application; the second rendering process of the second application also comprises an application object of the second application;

responding to a target operation instruction of the second application, acquiring update data generated by the target operation instruction, wherein the target operation instruction is an operation instruction capable of generating the update data;

invoking application proxy parameters associated with the second application, wherein the application proxy parameters are parameters synchronously created when the second application is created; the application proxy parameter is recorded with address information of an application and an application number;

And inquiring the application object of the second application according to the address information and the application number, and synchronously transmitting the update data to the application object of the second application.

In some embodiments, the application objects of the second application include a first object and a second object; the controller is further configured to:

adding a first object of a second application in a first rendering process of the first application in response to a creation instruction for creating the second application by the first application;

creating a second rendering process of the second application, and adding a second object of the second application in the second rendering process, wherein the second object and the first object have the same address information;

synchronously creating application proxy parameters associated with the second application;

and recording the address information of the second application through the application proxy parameter.

In some embodiments, the controller performing synchronization creates the application proxy parameter associated with the second application is further configured to:

detecting the first object in the first rendering process according to the address information, and detecting the second object in the second rendering process;

Setting a first application number for the first object and a second application number for the second object;

and recording the first application number and the second application number in the application proxy parameter.

In some embodiments, the controller is further configured to:

monitoring state update events of the first object and the second object;

if a state update event of the first object is monitored, acquiring update information of the first object, and synchronizing the update information with the second object;

if a state update event of the second object is monitored, acquiring update information of the second object, and synchronizing the update information to the first object.

In some embodiments, the controller is further configured to:

receiving a creation instruction for creating the second application through the first application, wherein the creation instruction is generated by the first application to load the second application by analyzing a live AIT table through a background process; or the creation instruction is generated by calling an application creation interface to create a second application for the first application.

In some embodiments, the controller performs the sending of the update data to the application object of the second application synchronously, and is further configured to:

Responding to the address updating instruction of the second application, and acquiring address updating data;

acquiring initial address information in the application proxy parameters;

positioning an application object of the second application according to the initial address information;

and synchronously modifying the address information of the application object of the second application according to the address updating data.

In some embodiments, the controller is further configured to:

responding to a process destroying instruction, and acquiring a target process acted by the process destroying instruction, wherein the target process is a first rendering process or a second rendering process;

if the target process is a first rendering process, destroying the second rendering process and synchronously destroying the application proxy parameters of the second application;

if the target process is a second rendering process, destroying an application object of the second application in the first rendering process, and synchronously destroying application proxy parameters of the second rendering process and the second application.

In some embodiments, the controller is further configured to:

responding to an exit instruction for exiting the second application, and acquiring address information of the second application through the application proxy parameter;

Destroying application objects of the second application in the second rendering process and the first rendering process according to the address information of the second application;

destroying the application proxy parameters of the second application.

In some embodiments, the controller is further configured to:

periodically reading a first operation parameter of an application object in the first rendering process and a second operation parameter of the application object in the second rendering process through the application proxy parameter;

comparing the first operation parameter and the second operation parameter in the same reading period;

if the first operation parameter is inconsistent with the second operation parameter, acquiring the latest update time of the first operation parameter and the second operation parameter;

and modifying the first operation parameter or the second operation parameter according to the latest update time.

On the other hand, some embodiments of the present application further provide a multi-application control method, which is applied to the display device, and the multi-application control method includes:

As can be seen from the above technical solutions, some embodiments of the present application provide a display device and a multi-application control method, where the method may monitor an operation instruction of a second application in a state where a first application and the second application are running simultaneously, and obtain update data generated by the target operation instruction in response to the target operation instruction of the second application. And inquiring application objects of the second application in a plurality of rendering processes according to the address information and the application numbers by calling application proxy parameters associated with the second application, and synchronously transmitting the update data to all the application objects. The application proxy parameter is a parameter which is synchronously created when the second application is created and recorded with address information and application numbers of the application. By introducing application proxy parameters, hbbTV application can be managed from the source, the problem of abnormal call caused by mismatching of application information when multiple applications of a browser run is solved, accurate control over multiple application scenes is realized, and stability of the multiple application scenes is improved.

Drawings

In order to more clearly illustrate some embodiments of the present application or technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of an operation scenario of a display device according to some embodiments of the present application;

FIG. 2 is a block diagram of a hardware configuration of a display device provided in some embodiments of the present application;

FIG. 3 is a block diagram of a hardware configuration of a control device provided in some embodiments of the present application;

fig. 4 is a schematic diagram of software configuration in a display device according to some embodiments of the present application;

FIG. 5 is a schematic illustration of an application lifecycle provided in some embodiments of the present application;

FIG. 6 is a schematic view of an HbbTV application management structure provided by some embodiments of the present application;

FIG. 7 is a flow chart of creating an application B provided in some embodiments of the present application;

fig. 8 is a schematic diagram of a multi-application operation flow of a display device according to some embodiments of the present application;

FIG. 9 is a schematic diagram of a process for creating application proxy parameters according to some embodiments of the present application;

FIG. 10 is a schematic diagram of application proxy parameters provided in some embodiments of the present application;

FIG. 11 is a schematic diagram of a synchronous update flow provided in some embodiments of the present application;

FIG. 12 is a schematic flow chart of a destroy rendering process according to some embodiments of the present application;

FIG. 13 is a schematic illustration of an exit application flow provided in some embodiments of the present application;

FIG. 14 is a flow chart of updating operating parameters provided in some embodiments of the present application;

fig. 15 is a schematic diagram of an application management structure based on an application agent according to some embodiments of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of some embodiments of the present application more clear, the technical solutions of some embodiments of the present application will be clearly and completely described below with reference to specific embodiments of the present application and corresponding drawings. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terms in some embodiments of the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the implementation of some embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control device 100.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The audio/video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display device 200 is also in data communication with the server 400 via a variety of communication means. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks.

The display apparatus 200 may additionally provide a smart network television function of a computer support function, including, but not limited to, a network television, a smart television, an Internet Protocol Television (IPTV), etc., in addition to the broadcast receiving television function.

Fig. 2 is a block diagram of a hardware configuration of the display device 200 of fig. 1 provided in some embodiments of the present application.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, communicator 220 is a component for communicating with external devices or servers 400 according to various communication protocol types.

In some embodiments, the controller 250 includes a processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, first to nth interfaces for input/output, and the controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI).

In some embodiments, user interface 280 is an interface that may be used to receive control inputs.

Fig. 3 is a block diagram of a hardware configuration of the control device in fig. 1 according to some embodiments of the present application. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface, a memory, and a power supply.

The control device 100 is configured to control the display device 200, and can receive an input operation instruction of a user, and convert the operation instruction into an instruction recognizable and responsive to the display device 200, functioning as an interaction between the user and the display device 200.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications for controlling the display apparatus 200 according to user's needs.

In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similarly to the control device 100 after installing an application that manipulates the display device 200.

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication collaboration among the internal components and the external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of a WiFi chip 131, a bluetooth module 132, an NFC module 133, and other near field communication modules.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, keys 144, and other input interfaces.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140. The control device 100 is provided with a communication interface 130 such as: the WiFi, bluetooth, NFC, etc. modules may send the user input instruction to the display device 200 through a WiFi protocol, or a bluetooth protocol, or an NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 may store various control signal instructions input by a user.

A power supply 180 for providing operating power support for the various elements of the control device 100 under the control of the controller.

Fig. 4 is a schematic software configuration diagram of the display device in fig. 1 provided in some embodiments of the present application, and in some embodiments, the system of the display device 200 may be divided into three layers, namely, an application layer, a middleware layer, and a hardware layer from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, etc., and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the display device 200 application layer contains at least one application, such as: live television applications, video on demand applications, media center applications, application centers, etc. Different applications are used to implement different functions, and by running different applications in the display device 200, different programs may be executed to implement different functions. For example, a corresponding play screen may be displayed in the display device 200 by the live television application or the video on demand application described above.

In some embodiments, the live television application may provide live television, broadcast television, through different signal sources. For example, a live television application may provide television signals using inputs from cable television, radio broadcast, satellite services, or other types of live television services. And, the live television application may display the asset screen of the live television signal on the display device 200.

In some embodiments, the video on demand application may provide video from different storage sources. Unlike live television applications, video-on-demand provides media asset data from some storage sources. For example, video-on-demand may come from a server side of cloud storage or from a local hard disk storage containing stored video programs, etc.

The display device 200 provided in the above embodiment may connect a physical signal source and the internet to receive broadcast signals and internet data to obtain media data or perform remote interaction. In some embodiments, the display device 200 is capable of implementing a convergence of broadcast and broadband networks based on hybrid broadcast broadband television technology (Hybrid Broadcast Broadband TV, hbbTV), i.e. based on DVB (digital video broadcasting) and IP (internet protocol) technology. The HbbTV can enable the display apparatus 200 to simultaneously receive a broadcast signal and internet data by embedding the internet data in a television signal. A user may access internet services and applications through the display device 200 while watching television programs.

The HbbTV-based display device 200 may have the characteristics of interactivity, personalization, richness, and seamless fusion. I.e. HbbTV can provide strong interactivity, and a user can watch a television program and perform interactive operations, such as voting, commenting, sharing, etc., through a remote controller or a smart phone, etc. HbbTV also allows a user to customize television program listings to personal preferences, and the user can select programs, applications, and services of interest to himself. HbbTV can provide rich internet applications and services such as video on demand, online gaming, social networking, etc., and users can enjoy a diversified entertainment experience. HbbTV can also realize the seamless integration of broadcast television and broadband network, and the user can smoothly switch to Internet application when watching television program, need not interrupt current viewing experience.

HbbTV can be applied to the content display fields of home entertainment, online education, public service, commercial advertisement and the like. For example, hbbTV may serve as a home entertainment center and a user may enjoy various internet applications and services while watching television programs, such as watching online movies, playing network games, video chat with friends, and so forth. HbbTV can also be used as an online education platform, and students can watch online courses, participate in interactive learning, submit homework and the like through a television. HbbTV can also provide public service information such as weather forecast, traffic information, government notices and the like, and a user can know relevant information in time conveniently. HbbTV can also be used as a commercial advertising platform, and advertisers can put accurate advertisements through HbbTV, so that advertising effect and user participation are improved.

The HbbTV function may be implemented by an HbbTV application, i.e. an HbbTV application may be installed in the display device 200. The HbbTV application may be executed and presented to the user in the context of a hypertext markup language (Hyper Text Markup Language, HTML) or Java language (Java Script) browser.

In some embodiments, the display device 200 may launch the HbbTV application first, then load the application interface, and parse and render the interface elements, presenting the final interface by executing JavaScript code. For example, the user may select and launch the HbbTV application in the application list of the display device 200 through a remote control or terminal device that is associated with the display device 200. After the HbbTV application is started, the display device 200 will load the user interface of the application via a network connection. This includes loading HTML, cascading style sheets (Cascading Style Sheets, CSS) and JavaScript files, and defining the appearance and function of the application through the loaded files. The browser will parse the loaded HTML and CSS files and render the various elements of the application interface. This includes text, images, buttons, menus, etc. At the same time, javaScript code will be executed to provide dynamic functionality and interactivity. Including responding to user input, updating interface elements, communicating with a backend server, etc. After the parsing, rendering and execution of the HTML, CSS and JavaScript are completed, the display device 200 may display a final application interface through the display 260, and the user may interact with the application through a remote controller or other devices, to implement interactive functions and services.

As shown in fig. 5, according to the interaction requirement of the HbbTV application with the user, the life cycle of the HbbTV application includes: a startup phase, a run phase, a pause phase, a resume phase, and a shut down phase. Wherein the start-up phase is a phase in which the application starts to start up when the user selects to open the HbbTV application. During the startup phase, the application program will load the required resources and data and initialize. The run phase is the phase entered after the HbbTV application has been successfully started. During the run phase, the application will present content according to user operations and inputs and respond to user interactions. The pause phase is a phase that the application enters when the user leaves the HbbTV application or switches to another application. During the pause phase, the application program pauses operation and saves the current state and data. The resume phase is a phase in which when the user returns to the HbbTV application, the application resumes from a suspended state and continues with a previous running state. During the recovery phase, the application will reload the previously saved state and data. The shutdown phase is a phase that the application enters when the user selects to shutdown the HbbTV application. During the shutdown phase, the application program releases the resources and performs a cleaning operation.

In some embodiments, the HbbTV Application can employ a singleton Mode, i.e., as shown in FIG. 6, each time the Application is launched, the HbbTV Mode (Mode) module of the display device 200 parses the Application information table (Application Information Table, AIT) from the bottom layer, sends Uniform resource locator (Uniform Resource Locator, URL) information to the browser, and creates an Application (Application) object. The HbbTV Mode is loaded by a browser, and only one application object is added correspondingly. The application information table is a table defined in the HbbTV standard, and is used for describing and distributing information related to the HbbTV application. The AIT table may contain the name, version, icon, rights requirements of the application, and other metadata associated with the application. This information can be used to discover, install and manage applications on the HbbTV device.

For example, when the user selects an interactive function related to HbbTV, hbbTV Mode obtains Application information by parsing an AIT table in a code stream at the bottom layer, sends a URL address to a browser, and creates an Application object. After receiving the URL information, the browser starts to request and load resources, and creates a rendering (Render) process. In the process of downloading the resource, the browser creates an application object in the Render process, and renders and displays the application object after the loading of the resource is finished.

In some embodiments, as shown in FIG. 7, the display device 200 may start, run, adjust, and shut down one HbbTV application based on another HbbTV application. For example, after the first application a is created in the above manner, the display device 200 may create a new application B object based on the application a through a new tab (new tab) or the like, where the application B object has a separate rendering process, i.e., render B. In the original Render A process, the application object generated in the mode generates a corresponding application B object, namely two objects with the same URL in two rendering processes, and the two objects have an association relation with the application B.

It can be seen that the multiple applications generated by a single HbbTV application through new tab and the like can meet the requirements of the operator application (Operator Application, opApp) and other scenes. However, in the OpApp scenario, since the lower HbbTV Mode cannot monitor the state of the upper application, when the upper application creates a new application by means of new table, a new Render process is created, and the new application exists in both the original Render process and the new Render process. When the display device 200 sends information through HbbTV Mode, the information is only dispatched to one of the applications due to the two identical Application objects, which causes the Application information in the two Render processes to be mismatched. When the call is made, the exception occurs, so that the problems of key failure response or application program crash and the like occur.

In order to alleviate the problem of abnormal call caused by mismatching of application information, some embodiments of the present application provide a display device 200, including: a display 260 and a controller 250. Wherein the display 260 is configured to display a user interface. As shown in fig. 8, the controller 250 is configured to perform the following program steps:

s100: and monitoring an operation instruction of the second application in a state of running the first application and the second application simultaneously.

The display device 200 can be controlled or displayed by a user to simultaneously run a plurality of applications during interface presentation and user interaction based on HbbTV functions. In the embodiment of the present application, the multi-application operation state of the display apparatus 200 is represented by the state in which the first application and the second application are simultaneously operated. Obviously, in the embodiment of the present application, the multi-application running state indicated by running the first application and the second application simultaneously is not limited to running two applications simultaneously, but may be used to indicate that two or more applications run simultaneously.

Wherein the second application is an application created by the first application; an application object of the second application is included in a first rendering process of the first application; and the second rendering process of the second application also comprises an application object of the second application. In some embodiments, as shown in fig. 9, to create a second application, the display device 200 may receive a creation instruction to create the second application through the first application. The creation instruction is generated by the first application to load a second application by analyzing the live AIT table through a background process; or the creation instruction is generated by calling an application creation interface to create a second application for the first application. For example, when the first Application makes a page jump through the Application creation interface (Create Application API), a new rendering process, i.e., render B, is created, and an Application object, i.e., application object B, is created, and at the same time, a corresponding Application object B is created in the original rendering process (render a), where both objects have the same URL address.

When running a plurality of applications simultaneously, the display apparatus 200 may monitor an operation instruction of each application to determine whether an operation of updating data occurs to each application. The display device 200 may monitor the type of the operation instruction, the acting object of the operation instruction, and the specific operation content of the operation instruction, and determine whether data synchronization is required according to the monitored content. For example, when the user controls the second application to perform the interface skip, since the second application needs to skip to a new page, the URL address corresponding to the second application may change, and at this time, the display device 200 may monitor the operation instruction for interface skip. And because the interface jump operation changes the URL address of the second application, data synchronization is required.

S200: and responding to the target operation instruction of the second application, and acquiring update data generated by the target operation instruction.

Wherein the target operation instruction is an operation instruction capable of generating the update data. To determine whether the operation instruction is capable of generating the update data, in some embodiments, the display apparatus 200 may construct an operation instruction information table in which all the operation instructions supported by the display apparatus 200 may be recorded, and set a flag value to the operation instruction to determine whether the operation instruction is capable of generating the update data by the flag value.

For example, each operation instruction supported by the display apparatus 200 may set a flag value Data updates according to whether update Data is generated, when the flag value is a first value, i.e., data updates=1 indicates that the operation instruction may generate update Data; when the flag value is the second value, i.e., data updates=0, it indicates that the operation instruction cannot generate update Data. After the display device 200 listens to the operation instruction, it may be determined whether the operation instruction is a target operation instruction by a flag value in the operation instruction information table. I.e., when Data updates=1, the operation instruction is determined to be the target operation instruction.

In some embodiments, the display device 200 may further record the data parameters of the second application in real time before executing the received operation instruction, to form the historical data parameters. And executing the received operation instruction, detecting various data parameters of the second application after executing the operation instruction, and determining that the current operation instruction can generate updated data when the detected data parameters are inconsistent with the recorded historical data parameters after executing the operation instruction, namely, the operation instruction is the target operation instruction.

Upon determining that the operation instruction is the target operation instruction, the display apparatus 200 may acquire update data generated by the target operation instruction. For example, the target operation instruction is an operation instruction generated when the user controls the second application to perform interface jump, and the operation instruction is the target operation instruction because the operation instruction can change the URL address corresponding to the second application. At this time, the display apparatus 200 may record the URL address of the second application after the interface skip as the update data in response to the operation instruction for the interface skip.

S300: and calling the application proxy parameter associated with the second application.

The application proxy parameters are parameters synchronously created when the second application is created. As shown in fig. 9, to create the application proxy parameters, in some embodiments, the application objects of the second application include a first object and a second object. The display apparatus 200 may add a first object of a second application in a first rendering process of the first application in response to a creation instruction to create the second application through the first application. And creating a second rendering process of the second application, and adding a second object of the second application in the second rendering process. Wherein the second object has the same address information as the first object. The display apparatus 200 may also synchronously create an application proxy parameter associated with the second application and record address information of the second application through the application proxy parameter while adding the first object and the second object.

For example, when a new Application B appears in the Application a object call Create Application API, an Application proxy (Application Agent) object is synchronously created in the browser kernel at the browser (browser) end, and information of the new Application object B is recorded. The Application B object is created by the Application a object, so there is one Application B object corresponding to the B object in the Render B process in the Render a process, and both have the same URL address, and Application Agent can record the URL address.

As shown in FIG. 10, a Application Agent parameter is added to the Browser, and has an association relationship with the Application object in the Render process, so that url information of Application can be recorded. Meanwhile, in order to prevent Application Agent management failure caused by the same URL application, the application proxy parameter may be recorded with an application number (app_id) in addition to address information of the application. Wherein the application number is used to prevent the occurrence of the same URL application from causing Application Agent management failure, enabling the display apparatus 200 to achieve accurate management through Application Agent.

S400: and inquiring the application object of the second application according to the address information and the application number, and synchronously transmitting the update data to the application object of the second application.

After invoking the application proxy parameter associated with the second application, the display device 200 may read the address information in the application proxy parameter, determine the second application according to the address information, and read the application number in the application proxy parameter, so as to accurately locate the application object in the first rendering process and the second rendering process according to the application number.

For example, after calling the Application Agent variable of Application B, the display device 200 may read the URL address of Application B from the Application Agent variable and query the Application object of Application B in render A and render B according to the read URL address. Since Application B is an Application created by Application A, there are Application objects of Application B in both the render A process and the render B process. At this time, the Application objects in the render a process and the render B process may be distinguished by the Application number app_id, that is, the Application object of Application B in the render a process is app_id=00; the Application object of Application B in the render B process is app_id=01.

When the application number can create the application proxy parameter, the setting of the application object in the current rendering process is detected. That is, in some embodiments, the display apparatus 200 detects the first object in the first rendering process and the second object in the second rendering process according to the address information when synchronously creating the application proxy parameter associated with the second application, sets a first application number for the first object, sets a second application number for the second object, and records the first application number and the second application number in the application proxy parameter.

The display apparatus 200 may set the application number according to the number of rendering processes and the number of application objects of the second application existing in the rendering processes. For example, the display apparatus 200 may set an initial number, i.e., app_id=00, for each Application, and when Application objects of the Application B exist in the render a process and the render B process, the number of current Application objects is 2, and thus the Application number of Application objects of Application B in the render a process may be controlled to be maintained at app_id=00, while the Application number of Application objects of Application B in the render B process is modified to app_id=01.

After querying the application object of the second application, the display device 200 may perform update data synchronization according to the queried application object, that is, send the update data synchronization to the application object of the second application in the first rendering process, and the application object of the second application in the second rendering process.

Taking address information update as an example, when the display device 200 synchronously sends the update data to the application object of the second application, the display device may respond to an address update instruction of the second application to obtain address update data, obtain initial address information in the application proxy parameter, locate the application object of the second application according to the initial address information, and synchronously modify the address information of the application object of the second application according to the address update data.

For example, when the user performs the interface skip operation for Application B, the display device 200 may receive an address update instruction of the first Application during the process of performing the interface skip operation, where the address update instruction may include a specific skip target of the interface skip operation, so that the display device 200 may obtain address update data, that is, URL address URL2 of the interface after skipping, by analyzing the address update instruction. At this time, the display apparatus 200 may read initial address information, i.e., URL address URL1 before the interface jump, from the Application Agent variable of Application B. And querying Application objects of Application B in the render A process and the render B process, namely Application B object 1 and Application B object according to the URL1. And synchronizing the updated address information URL2 to Application B object 1 and Application B object to enable the address information of the application objects in the two rendering processes to be kept matched.

Because the target operation instruction executed on the second application may directly act on the application object in one of the rendering processes, so that the corresponding application object completes data update, as shown in fig. 11, in some embodiments, the update data synchronization is sent to the application object of the second application, and the update data synchronization may be executed only for the application object in the other rendering process. That is, the display apparatus 200 may monitor the status update events of the first object and the second object, acquire update information of the first object if the status update event of the first object is monitored, and synchronize the update information with the second object. If a state update event of the second object is monitored, acquiring update information of the second object, and synchronizing the update information to the first object.

For example, when the user executes the interface skip operation through the Application interface of Application B, the Application B changes the URL address of Application B to URL2 of the skip interface when executing the interface skip, and at this time, since the user is the interface skip operation directly executed on the Application B interface, the display device 200 may modify the URL address of the Application object in the rendering process of render B, while the Application object in the render a process is not modified with the URL address, and is still URL1 of the original interface. At this time, the display apparatus 200 may perform data synchronization on the application object in the render a process to update the URL address of the application object in the render a process to URL2 of the jump interface.

Similarly, when the user controls Application B to execute the interface skip operation through the Application interface of Application a, the display device 200 will modify the URL address of the Application object to URL2 in the rendering process of render a, and the Application object in render B process is still URL1 of the original interface without modifying the URL address. At this time, the display apparatus 200 may perform data synchronization on the application object in the render B process to update the URL address of the application object in the render B process to URL2 of the jump interface.

As can be seen, for the queried application object, the display device 200 may synchronize the update data to the queried application object, so that the application objects of the second application in the first rendering process and the second rendering process are kept in data synchronization or information matching with the application object of the second application in the second rendering process, so that when the display device 200 invokes the application object of the second application again, the display device 200 may respond normally, and the problem of system crash is alleviated.

In the above embodiment, the display device 200 may manage the data synchronization process of the running stage in the application lifecycle according to the application proxy parameter, so that the application object related information of the same application in the multiple rendering processes is kept matched and consistent. In some embodiments, the display device 200 may also manage other phases in the application lifecycle based on the application proxy parameters. The lifecycle of the application includes a startup phase, a running phase, a pause phase, a resume phase, and a shutdown phase. That is, the display device 200 may maintain application proxy parameters based on different phases of the application lifecycle and manage the corresponding phases based on the application proxy parameters.

In some embodiments, for the startup phase, the display device 200 may synchronously create application proxy parameters of the started application when the application is started, and may set address information, application numbers, and other contents in the application proxy parameters, so as to establish an association relationship between the application proxy parameters and application objects in each rendering process.

In some embodiments, for the pause phase and the resume phase, since the current application is not closed when leaving the HbbTv application or switching to other applications, and when returning to or switching from other applications, and the application is still likely to respond to an operation event or a system event to change information during leaving the application, returning to the application, switching to the application, the display device 200 may also manage the pause phase and the resume phase based on the application proxy parameters in the manner described in the above embodiments during the pause phase.

For the shutdown phase, the application proxy parameters may be destroyed in synchronization with the destruction process of the shutdown process or process of the application. Since the closing of the display device 200 to the application includes various forms of closing, i.e., process destruction, application closing, etc. And different management modes can be executed according to the operation event which specifically triggers the closing event in different closing modes. In some embodiments, the destroying of the rendering process may include two forms of normal destroying of the Render process and abnormal destroying of the Render process, wherein the normal destroying of the Render process may be triggered by exiting the application using an Exit button of the remote controller; abnormal destruction of the Render process may be triggered by a browser active destruction process, such as window.

For the rendering process destruction process, the display device 200 may obtain a target process acted by the process destruction instruction in response to the process destruction instruction. The target process acted by the process destroying instruction can be determined to be a first rendering process or a second rendering process according to the mode of inputting the process destroying instruction.

For example, in a state that the display device 200 displays the Application interface of Application B, by pressing the exit key on the remote controller, the user inputs the process destroying instruction, and the display device 200 may acquire that the target process acted by the process destroying instruction is render B. When the user inputs a process destroying instruction for destroying Application B by means of voice interaction or background cleaning while the display device 200 displays the Application interface state of Application a, the display device 200 may acquire that the target process acted by the process destroying instruction is render a.

As shown in fig. 12, after the target process is acquired, the display device 200 may destroy the target process or other rendering process and the application object in the target process or other rendering process based on the target process, and destroy the application proxy parameter corresponding to the application. If the target process is a first rendering process, destroying the second rendering process and synchronously destroying the application proxy parameters of the second application. If the target process is a second rendering process, destroying an application object of the second application in the first rendering process, and synchronously destroying application proxy parameters of the second rendering process and the second application.

For example, when the destroyed Render process is the original_pid process of Application Agent, that is, the Render B process actually existing in Application B, the display device 200 may destroy the Render B process first, and destroy the Application object of Application B in another Render a process. When the Application B Application object in the render A process is destroyed, the Application Agent parameter is destroyed at the same time. Similarly, when the destroyed Render process is not the original_pid process of Application Agent, but is instead the Render a process of Application a, the display device 200 may destroy the Render B after directly destroying the Render a process, while destroying Application Agent parameters.

As shown in fig. 13, in some embodiments, for an application exit procedure, the display apparatus 200 may obtain address information of the second application through the application proxy parameter in response to an exit instruction for exiting the second application. And destroying application objects of the second application in the second rendering process and the first rendering process according to the address information of the second application, and destroying application proxy parameters of the second application.

For example, when an Application uses the HbbTV specification interface to perform Application destruction, the display device 200 may acquire an exit instruction for exiting Application B, and acquire address information URL B of Application B through Application Agent parameters. And determining rendering processes of the Application object, namely render A and render B, according to the address information URL B of the Application B. The display device 200 may directly destroy the render B process, destroy the Application object of Application B in render a, and close Application B. While closing Application B, the display device 200 also needs to synchronously destroy Application Agent parameters of Application B, so as to implement management of Application B closing stage.

In some embodiments, the display device 200 may actively synchronize application object data in multiple rendering processes according to a set synchronization period, that is, as shown in fig. 14, the display device 200 may periodically read, by using the application proxy parameter, a first running parameter of an application object in the first rendering process and a second running parameter of an application object in the second rendering process. And comparing the first operation parameter with the second operation parameter in the same reading period. And if the first operation parameter is inconsistent with the second operation parameter, acquiring the latest update time of the first operation parameter and the second operation parameter, and modifying the first operation parameter or the second operation parameter according to the latest update time.

For example, the display apparatus 200 may read the operation parameters B1 and B2 of Application B in the render a process every 30 min. And after reading parameters B1 and B2, comparing each parameter item in the operation parameters to determine whether parameters B1 and B2 agree. If parameters B1 and B2 are not identical, the display device 200 may obtain the inconsistent parameter items, as well as the latest update times of parameters B1 and B2, T1 and T2. If T1 is later than T2, display device 200 may update parameters B2 according to parameters B1 to reconcile parameters B2 with parameters B1. Similarly, if T1 is earlier than T2, display device 200 may update parameters B1 according to parameters B2 to reconcile parameters B1 with parameters B2.

As can be seen from the above technical solution, the display device 200 provided in the foregoing embodiment may store the currently running Application information in Application Agent, selectively monitor the Application information by each Render process, notify the Render process monitoring the Application of information when a change occurs in an Application, and notify the HbbTV Mode to update the Application information correspondingly. Information synchronization can be ensured through Application Agent, and application lifecycle management is achieved.

Based on the display device 200, some embodiments of the present application further provide a multi-application control method applied to the display device 200, where the multi-application control method includes the following steps:

s100: in a state of running a first application and a second application simultaneously, monitoring an operation instruction of the second application, wherein the second application is an application created through the first application; an application object of the second application is included in a first rendering process of the first application; the second rendering process of the second application also comprises an application object of the second application;

s200: responding to a target operation instruction of the second application, acquiring update data generated by the target operation instruction, wherein the target operation instruction is an operation instruction capable of generating the update data;

S300: invoking application proxy parameters associated with the second application, wherein the application proxy parameters are parameters synchronously created when the second application is created; the application proxy parameter is recorded with address information of an application and an application number;

For example, as shown in fig. 15, based on the multi-Application control method, the display device 200 may synchronously create a Application Agent object at the browser end when the Application a object calls Create Application API and a new Application B appears, and record the information of the new Application object B. The Application B object is created through the Application A object, and one Application B object corresponding to the Application B object in the Render A process exists in the Render A process, and the Application B object have the same URL. When the Application B object in any process has URL update, another process can be found through the original_URL of Application Agent, and the URL information and the like of the Application B object are notified to synchronously modify the Application. When the Render process is normally destroyed by destructing, or is abnormally destroyed such as by kill, the Application object corresponding to another process can be found and destroyed by the app_url of Application Agent. And enabling Application objects in the Render process to synchronously change, keeping the Application information of the HbbTV Mode of the bottom layer and the Application information of the upper layer to be the same, and realizing the management of the life cycle.

The same and similar parts of the embodiments in this specification are referred to each other, and are not described herein.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied essentially or in parts contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method of the embodiments or some parts of the embodiments of the present invention.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display configured to display a user interface;

A controller configured to:

2. The display device of claim 1, wherein the application objects of the second application include a first object and a second object; the controller is further configured to:

3. The display device of claim 2, wherein the controller performing synchronization to create the second application-associated application proxy parameter is further configured to:

4. The display device of claim 2, wherein the controller is further configured to:

Monitoring state update events of the first object and the second object;

5. The display device of claim 2, wherein the controller is further configured to:

6. The display device of claim 1, wherein the controller executing the application object that synchronously sends the update data to the second application is further configured to:

acquiring initial address information in the application proxy parameters;

7. The display device of claim 1, wherein the controller is further configured to:

8. The display device of claim 1, wherein the controller is further configured to:

Destroying the application proxy parameters of the second application.

9. The display device of claim 1, wherein the controller is further configured to:

10. A multi-application control method applied to the display device according to any one of claims 1 to 9, the multi-application control method comprising: