CN113676782B - Display equipment and interaction method for coexisting multiple applications - Google Patents
Display equipment and interaction method for coexisting multiple applications Download PDFInfo
- Publication number
- CN113676782B CN113676782B CN202110959249.5A CN202110959249A CN113676782B CN 113676782 B CN113676782 B CN 113676782B CN 202110959249 A CN202110959249 A CN 202110959249A CN 113676782 B CN113676782 B CN 113676782B
- Authority
- CN
- China
- Prior art keywords
- application
- user operation
- user
- window
- browser window
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000003993 interaction Effects 0.000 title claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 34
- 230000008569 process Effects 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 16
- 238000010586 diagram Methods 0.000 description 15
- 238000006243 chemical reaction Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
Abstract
The application provides a display device and an interaction method when multiple applications coexist, wherein the display device comprises a display; a controller configured to: receiving a first user operation input by a user; when a first application is started, transmitting a first user operation to a first browser window for showing the first application, and distributing the first user operation to the first application or a second application for processing by the first browser window, wherein the first browser window is configured as a father window for showing a second browser window of the second application; and when the first application is not started, transmitting the first user operation to an application displayed in the foreground of the display for processing. According to the method and the device for controlling the application, the user operation is distributed through the first browser window of the first application, so that the application running in the background can also receive the user operation, the user does not need to adjust the application to the foreground to display and then control the application, the user operation is simplified, and the user experience is improved.
Description
Technical Field
The application relates to the technical field of display equipment, in particular to a display equipment and an interaction method for coexistence of multiple applications.
Background
At present, a plurality of applications can be installed on the intelligent television, and after one application is opened by a user, the application can be set to run in the background, and then other applications can be continuously opened. For example, after a user opens a music application, the music application may be played in the background, and then an album application may be continuously opened to view the pictures stored on the smart tv. In the related art, if a user wants to control an application, the user needs to tune the currently displayed application to a background operation, and then tune the application to be controlled to a foreground for display, and when the application to be controlled is displayed in the foreground, the user can control the application. However, this would make it cumbersome for the user to control the application running in the background and the user experience is poor.
Disclosure of Invention
In order to solve the technical problem of complicated application switching, the application provides display equipment and an interaction method for coexisting multiple applications.
In a first aspect, the present application provides a display device comprising:
a display for presenting a user interface;
a controller coupled to the display, the controller configured to:
receiving a first user operation input by a user;
when a first application is started, transmitting the first user operation to a first browser window for showing the first application, and distributing the first user operation to the first application or a second application for processing by the first browser window, wherein the first browser window is configured as a father window for showing a second browser window of the second application;
and when the first application is not started, transmitting the first user operation to an application displayed in the foreground of the display for processing.
In some embodiments, communicating the first user operation to a first browser window for exposing the first application includes:
the first user operation is transmitted to a first browser window for displaying the first application through a web engine.
In some embodiments, communicating the first user operation to a first browser window for exposing the first application includes:
the first user operation is transmitted to a first browser window for displaying the first application through a web engine.
In some embodiments, assigning, by the first browser window, the first user operation to a first application or a second application for processing includes:
and distributing the first user operation to the first application or the second application for processing according to a preset distribution rule by the first browser window.
In some embodiments, the preset allocation rules include:
if the first user operation is a triggering operation of a first key, the second user operation is a user operation belonging to the first application, wherein the first key is a key to which only the first application can respond;
if the first user operation is a triggering operation of a second key, the second user operation is a user operation belonging to the second application, wherein the second key is a key to which only the second application can respond;
and if the first user operation is the triggering operation of a third key, the second user operation is the user operation of the first application or the second application currently displayed on the foreground of the display, wherein the third key is a key to which the first application and the second application can both respond.
In a second aspect, the present application provides a display device comprising:
a controller in communication with the display, wherein the controller is controlled to:
receiving a second user operation for starting a first application;
when a second application is started, responding to the second user operation, starting the first application, setting the first browser window as a parent window and setting the second browser window as a child window of the parent window in the starting process of the first application, wherein the child window is configured to process only the first user operation distributed by the parent window;
and when the second application is not started, responding to the second user operation, starting the first application, and setting the second browser window as a child window of the first browser window through a connection command after the second application is started.
In a third aspect, the present application provides an interaction method when multiple applications coexist, where the method includes:
receiving a first user operation input by a user;
when a first application is started, transmitting the first user operation to a first browser window for showing the first application, and distributing the first user operation to the first application or a second application for processing by the first browser window, wherein the first browser window is configured as a father window for showing a second browser window of the second application;
and when the first application is not started, transmitting the first user operation to the application displayed in the foreground for processing.
The interaction method for the display equipment and the multi-application coexistence has the advantages that:
according to the embodiment of the application, the browser window of one application window is set as the parent window, the browser windows of other applications are set as the child windows, and the parent window is configured to distribute user operations, so that after receiving the user operations, the display device can distribute the user operations to the corresponding applications through the parent window, and therefore a user can control the applications which want to be controlled without adjusting the applications to be displayed in the foreground, the control flow of the applications is simplified, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
A schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments is schematically shown in fig. 1;
a hardware configuration block diagram of the control apparatus 100 according to some embodiments is exemplarily shown in fig. 2;
a hardware configuration block diagram of a display device 200 according to some embodiments is exemplarily shown in fig. 3;
a software configuration schematic of a display device 200 according to some embodiments is schematically shown in fig. 4;
a user operation process schematic according to some embodiments is schematically shown in fig. 5, according to some embodiments;
a flow diagram of an interaction method when multiple applications coexist according to some embodiments is schematically shown in fig. 6;
a flow diagram of a first application launch method according to some embodiments is shown schematically in fig. 7;
a schematic diagram of a second application entry hint interface according to some embodiments is shown schematically in fig. 8;
a schematic diagram of a media asset presentation interface of a second application according to some embodiments is shown schematically in fig. 9;
a schematic diagram of a media asset details page according to some embodiments is shown schematically in fig. 10;
a schematic diagram of a media asset presentation interface of a second application according to some embodiments is shown schematically in fig. 11;
a schematic diagram of a media asset details page according to some embodiments is illustrated in fig. 12.
Detailed Description
In order to facilitate the technical solution of the application, some concepts related to the present application will be described below first.
For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.
It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.
The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.
In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.
In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.
Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.
In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.
In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.
In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving image signals from the controller output, for displaying video content, image content, and a menu manipulation interface, and for manipulating a UI interface by a user.
In some embodiments, the display 260 may be a liquid crystal display, an OLED display, a projection device, and a projection screen.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.
In some embodiments, the user interface may be configured to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).
In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.
In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.
In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.
A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.
In some embodiments, a graphics processor is used to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments, the video processor is configured to receive an external video signal, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, etc., according to a standard codec protocol of an input signal, and may obtain a signal that is displayed or played on the directly displayable device 200.
In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.
In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.
In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.
The system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again.
The application program is compiled into machine code after being started to form a process.
The system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again.
The application program is compiled into machine code after being started to form a process.
As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.
The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; and Native applications (Native APPs).
The application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).
Native applications (Native APPs) may support online or offline, message pushing, or local resource access.
The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.
The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.
The hardware or software architecture in some embodiments may be based on the description in the foregoing embodiments, and in some embodiments may be based on other similar hardware or software architectures, which may implement the technical solutions of the present application.
In some embodiments, the display device may directly enter the display interface of the signal source selected last time after being started, or the signal source selection interface, where the signal source may be a preset video on demand program, or may be at least one of an HDMI interface, a live tv interface, etc., and after the user selects a different signal source, the display may display the content obtained from the different signal source.
In some embodiments, multiple applications may be running simultaneously on the display device, and if a user wants to operate one application, the user may call that application to the foreground for display. However, in some display devices, such as smart televisions, the manner in which the user exchanges applications to the foreground is cumbersome and the user experience is poor.
In order to solve the problem of user interaction when a plurality of applications run simultaneously, the embodiment of the application provides display equipment and a multi-application interaction method. Referring to fig. 5, a schematic diagram of a user operation process according to some embodiments is shown.
In some embodiments, the applications of the application layer may include an OpAPP application and an HbbTV application. Both the OpAPP application and the HbbTV application are applications developed based on Browser. Accordingly, the application framework may include an OpAPP application window and an HbbTV application window.
In fig. 5, the OpAPP application window is a browser window for displaying an interface of the OpAPP application, and the HbbTV application window is a browser window for displaying an interface of the HbbTV application.
In some embodiments, the OpAPP application and the HbbTV application are both provided with a portal for a television channel, where the portal may be an icon control representing the television channel, and after the user triggers the icon control, the display device may jump to the television channel corresponding to the icon control. The OpAPP application and the HbbTV application can be further provided with an Internet video entry, the Internet video entry can also be provided with an icon control, and after a user triggers the icon control, the display equipment can jump to a playing interface or a detail interface of the Internet video corresponding to the icon control.
The application interaction method when a plurality of applications run on the display device is introduced by taking the OpAPP application and the HbbTV application as examples, and in practical implementation, the application interaction method can also be applied to scenes where other applications run simultaneously. Among the applications running simultaneously, one of the applications may be called a first application, the other applications are a second application, a third application, and … …, and a browser window of the first application or the first application may allocate the user operation to a certain application. In fig. 5, the first application is an OpAPP application and the second application is an HbbTV application.
As shown in fig. 5, in some embodiments, the system components of the middleware layer include an op app application window Operator (operating component) and an HbbTV application Operator.
As shown in fig. 5, in some embodiments, at the middleware layer, the opap application window and the HbbTV application window may be made dependent by an attach command, making the HbbTV application window a child window of the opap application window. After the affiliation is established, the user operation can be transmitted to the OpAPP window of the application layer through the middleware layer, the OpAPP window judges the user operation, if the user operation is judged to be specific to the OpAPP, the user operation is sent to the HbbTV application window, the HbbTV application window in the HbbTV application window processes the user operation, and otherwise, the OpAPP application processes the user operation.
In some embodiments, when the OpAPP application is started, according to that the HbbTV application is started, the browser window of the HbbTV application is set as a child window of the browser window of the OpAPP application directly in the starting process of the OpAPP application.
To further illustrate the method by which the display device handles interactions between multiple applications and users, FIG. 6 illustrates a flow diagram of an interaction method when multiple applications coexist according to some embodiments.
As shown in fig. 6, the interaction method when multiple applications coexist may include the following steps:
step S110: a first user operation input by a user is received.
In some embodiments, the first user operation may be any operation on the display device. For example, adjusting volume, switching television channels, etc. When the user inputs the first user operation, the display device may start the first application and the second application, or may start only the first application or the second application, or may not start both the first application and the second application.
Step S120: when a first application is started, the first user operation is transferred to a first browser window for showing the first application, and the first browser window distributes the first user operation to the first application or a second application for processing, wherein the first browser window is configured as a father window for showing a second browser window of the second application.
In some embodiments, after the user inputs the first user operation, the display device may detect whether the currently running application includes the first application, and if so, indicate that the first application has been started, at this time, the display device may transfer the first user operation to the first browser window, that is, display the browser window of the first application, and the first browser window allocates the first user operation to the first application or the second application for processing.
Step S130: and when the first application is not started, transmitting the first user operation to an application displayed in the foreground of the display for processing.
In some embodiments, after the user inputs the first user operation, the display device may detect whether the currently running application includes the first application, and if not, indicate that the first application is not started, at this time, the display device may transmit the first user operation to the application displayed in the foreground of the display for processing.
When receiving the user operation, the display device can firstly judge whether the first application is started, if so, the browser window of the first application determines which application is allocated with the user operation for processing, and if not, the display device allocates the user operation to the application running in the foreground for processing according to a conventional user operation processing method.
In order to enable allocation of user operations to a browser window of a first application after the first application is started, an embodiment of the present application provides a method for starting the first application, see fig. 7, where the method may include the following steps:
step S210: a second user operation to launch the first application is received.
In some embodiments, after the user installs the OpAPP application on the display device, the application presentation interface of the display device may present an application icon of the OpAPP application, and the user may click on the application icon at the application presentation interface to launch the OpAPP application.
In some embodiments, the display device is configured to obtain channel information for a television channel from an operator of the television channel upon entering the television channel. If the display device analyzes the media information of the OpAPP from the channel information, a floating layer can be generated above the playing interface of the television channel, and the method for entering the OpAPP is displayed on the floating layer. For example, the method for entering the OpAPP application may be pressing a preset key of the remote controller, and the floating layer may display that the preset key is pressed to enter the OpAPP application. The user can press a preset key of the remote controller according to the prompt of the floating layer, so that the OpAPP application is started.
In some embodiments, the display device may launch the op app application after receiving the user's operation to launch the op app application. When the display device starts the OpAPP application, it may detect whether the HbbTV application is started first, and according to whether the HbbTV application is started or not, the start of the OpAPP application may be divided into two cases, step S220 is a case where the HbbTV application is started, and step S230 is a case where the HbbTV application is not started.
Step S220: and when a second application is started, responding to the second user operation, starting the first application, setting the first browser window as a parent window and setting the second browser window as a child window of the parent window in the starting process of the first application, wherein the child window is configured to process only the first user operation distributed by the parent window.
In some embodiments, if the HbbTV application has been launched, the OpAPP application may be launched by a first launch command, setting the HbbTV application window to a child of the OpAPP application window. The first start command may be StartOpApp (…, hbbTVWindow), where … is a parameter that is necessary for starting an App application but is not a concern for the present solution, and HbbTVWindow is a sub-Window of the HbbTV application set to optppwindow.
Step S230: and when the second application is not started, responding to the second user operation, starting the first application, and setting the second browser window as a child window of the first browser window through a connection command after the second application is started.
In some embodiments, if the HbbTV application is not started, the OpAPP application may be started first by the second start command, and after the HbbTV application is started, the HbbTV application window is set to be a child window of the OpAPP application window. The second start command may be StartOpApp (…) and the connect command may be attach (OpAppWindow, hbbTVWindow). The Attach command is a child window whose second parameter is set to the first parameter.
After the processing, the OpAPP completes the startup, and if the display equipment receives the user operation after the OpAPP is started, the user operation can be transmitted to the OpAPP window through the webpage engine.
In some embodiments, the user operation is allocated according to a preset allocation rule when the OpAPP is applied to the window.
In some embodiments, the preset allocation rules may be determined according to the actual situation. Illustratively, one preset allocation rule is: if the user operation is an operation which can only be responded by a specific application currently running, transmitting the user operation to the specific application for processing; if the user operation is an operation which can be responded by a plurality of currently running applications, and the application running in the foreground can respond to the user operation, the user operation is transmitted to the application displayed in the foreground for processing; if the user operation is an operation which can be responded by a plurality of currently running applications and the application running in the foreground can not respond to the user operation, an application selection interface is generated and displayed, a plurality of application controls supporting the user operation are displayed on the application selection interface, and if the user selects one application control, the user operation is transmitted to the application corresponding to the application control selected by the user for processing.
According to the allocation rule, if the second user operation is a triggering operation of a first key, the second user operation is a user operation belonging to the OpAPP, wherein the first key is a key to which only the OpAPP can respond; if the second user operation is a triggering operation of a second key, the second user operation is a user operation belonging to the HbbTV application, wherein the second key is a key to which only the HbbTV application can respond; and if the second user operation is the triggering operation of a third key, the second user operation is the user operation belonging to the OpAPP or HbbTV application currently displayed on the foreground of the display, wherein the third key is a key to which the OpAPP and the HbbTV application can respond.
In some embodiments, if the display device communicates user operation to an application that is not running in the foreground, the display device may be configured to tune the application to the foreground running or continue to keep it running in the background.
The method for interaction when the multiple applications coexist is further described below in connection with the interaction process between the user and the display device.
In some embodiments, after a user activates the display device, the display device obtains a channel identification of a television channel last viewed by the user, which may be stored in a preset path of the display device. After the display device acquires the channel identifier, the display device may acquire channel information of the channel identifier from a server of the television channel. The channel information contains the video code stream of the media information which needs to be played currently. The channel information of the partial channel or each channel may or may not include a second application identifier, where the second application identifier is an application identifier of the second application.
In some embodiments, after the display device is started, when the user switches the current interface to the interface of one television channel, the display device obtains channel information of the television channel selected by the user from a server of the television channel.
In some embodiments, the channel information may further include a media asset identifier associated with the second application identifier.
In some embodiments, after the display device obtains the channel information of the television channel last watched by the user, the display device obtains the video code stream from the channel information, parses the video code stream, and plays the video code stream.
In some embodiments, if the display device obtains the second application identifier from the channel information and the second application identifier is associated with the media asset identifier, a floating layer is generated, and a method for entering the second application is displayed on the floating layer, for example, "press a red key to enter the second application", where the red key is a key on the remote controller.
Referring to fig. 8, after entering a television channel, the display device may display a floating layer prompting to enter a second application on the playing interface of the television channel.
In some embodiments, when the display device displays the interface shown in fig. 8, after the user presses the red key of the remote controller according to the prompt of the floating layer in fig. 8, the display device may obtain the media asset identifiers associated with the second application identifier in the channel information, and obtain the media asset data corresponding to the media asset identifiers from the server of the second application.
In some embodiments, after the display device obtains the media data corresponding to the media identifiers, a media control corresponding to each media identifier may be generated, and each media control may display a media poster. And then generating a new floating layer containing the media resource control over the current interface. Referring to fig. 9, a floating layer may be located at the issue of the current interface, and the media assets corresponding to the media asset control on the floating layer may include media asset 1, media asset 2, media asset 3, media asset 4, and media asset 5.
In some embodiments, if the user clicks a media asset control, such as the media asset control corresponding to media asset 3 in fig. 9, the display device may stop playing the video stream of the television channel, start a second application window, and display the media asset detail interface shown in fig. 10 in the second application window. Referring to fig. 10, a poster control of the media asset 3 and a title bar of a second application may be displayed at the media asset detail interface, and the title bar of the second application may include a plurality of title controls, such as "user", "search", "homepage", "collection" and "set", which may also be displayed with icons. In fig. 10, if the user clicks on the poster control, the play interface of the media asset 3 may be entered.
In some embodiments, the detail interface that displays the floating layer of the media asset control and the media asset may also be in other styles. As shown in fig. 11, if the user presses a red key of the remote controller at the interface shown in fig. 8, the display device may generate a floating layer at one side of the current interface. If the user clicks one of the media resource controls on the floating layer, the user can enter the media resource detail interface shown in fig. 12, and as shown in fig. 12, the media resource controls of other media resources can be displayed on the media resource detail interface for the user to select.
In some embodiments, the display device launches the second application after the user presses the red key of the remote control in fig. 8. After the second application is started, if the user wants to enter the first application, the user can press a homepage key of the remote controller to enter the homepage of the display device, click on an icon of the first application on the homepage of the display device, and start the first application, and at the moment, the second application still runs in the background and does not exit. The display device may set the browser window of the second application as a child window of the browser window of the first application according to the second application having been started, so as to implement distribution of user operations through the first application.
As can be seen from the foregoing embodiments, in the embodiments of the present application, by setting a browser window of an application window as a parent window, setting browser windows of other applications as child windows, and configuring the parent window to distribute user operations, after receiving the user operations, the display device may distribute the user operations to corresponding applications by the parent window, so that a user does not need to tune an application to be controlled to a foreground for display, and may also control the application, thereby simplifying a control flow of the application, and improving user experience.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.
Claims (5)
1. A display device, characterized by comprising:
a display;
a controller in communication with the display, wherein the controller is controlled to:
receiving a first user operation input by a user;
when a first application is started, transmitting the first user operation to a first browser window for displaying the first application, and distributing the first user operation to the first application or a second application for processing by the first browser window according to a preset distribution rule, wherein the first browser window is configured as a father window for displaying a second browser window of the second application, and the preset distribution rule comprises: if the first user operation is an operation which can only be responded by the specific application running currently, the first user operation is transmitted to the specific application for processing; if the first user operation is an operation which can be responded by a plurality of currently operated applications, and the application operated by the foreground can respond to the first user operation, the first user operation is transmitted to the application operated by the foreground for processing; if the first user operation is an operation which can be responded by a plurality of currently operated applications, and the application operated by a foreground cannot respond to the first user operation, an application selection interface is generated and displayed, a plurality of application controls corresponding to the currently operated applications supporting the first user operation are displayed on the application selection interface, and if a user selects one of the application controls, the first user operation is transmitted to the application corresponding to the application control selected by the user for processing.
2. The display device of claim 1, wherein the manner of starting the first application comprises:
receiving a second user operation for starting the first application;
when a second application is started, responding to the second user operation, starting the first application, setting the first browser window as a parent window and setting the second browser window as a child window of the parent window in the starting process of the first application, wherein the child window is configured to process only the first user operation distributed by the parent window;
and when the second application is not started, responding to the second user operation, starting the first application, and setting the second browser window as a child window of the first browser window through a connection command after the second application is started.
3. The display device of claim 1, wherein communicating the first user operation to a first browser window for exposing the first application comprises:
the first user operation is transmitted to a first browser window for displaying the first application through a web engine.
4. An interaction method when multiple applications coexist, comprising:
receiving a first user operation input by a user;
when a first application is started, transmitting the first user operation to a first browser window for displaying the first application, and distributing the first user operation to the first application or a second application for processing by the first browser window according to a preset distribution rule, wherein the first browser window is configured as a father window for displaying a second browser window of the second application, and the preset distribution rule comprises: if the first user operation is an operation which can only be responded by the specific application running currently, the first user operation is transmitted to the specific application for processing; if the first user operation is an operation which can be responded by a plurality of currently operated applications, and the application operated by the foreground can respond to the first user operation, the first user operation is transmitted to the application operated by the foreground for processing; if the first user operation is an operation which can be responded by a plurality of currently operated applications, and the application operated by a foreground cannot respond to the first user operation, an application selection interface is generated and displayed, a plurality of application controls corresponding to the currently operated applications supporting the first user operation are displayed on the application selection interface, and if a user selects one of the application controls, the first user operation is transmitted to the application corresponding to the application control selected by the user for processing.
5. The method for interaction in coexistence of multiple applications according to claim 4, wherein the starting manner of the first application comprises:
receiving a second user operation for starting the first application;
when a second application is started, responding to the second user operation, starting the first application, setting the first browser window as a parent window and setting the second browser window as a child window of the parent window in the starting process of the first application, wherein the child window is configured to process only the first user operation distributed by the parent window;
and when the second application is not started, responding to the second user operation, starting the first application, and setting the second browser window as a child window of the first browser window through a connection command after the second application is started.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110959249.5A CN113676782B (en) | 2021-08-20 | 2021-08-20 | Display equipment and interaction method for coexisting multiple applications |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110959249.5A CN113676782B (en) | 2021-08-20 | 2021-08-20 | Display equipment and interaction method for coexisting multiple applications |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113676782A CN113676782A (en) | 2021-11-19 |
| CN113676782B true CN113676782B (en) | 2024-02-23 |
Family
ID=78544279
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110959249.5A Active CN113676782B (en) | 2021-08-20 | 2021-08-20 | Display equipment and interaction method for coexisting multiple applications |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113676782B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6683629B1 (en) * | 2000-08-03 | 2004-01-27 | Neoplanet, Inc. | Method in a computer system for embedding a child window in a parent window |
| CN108491127A (en) * | 2018-03-12 | 2018-09-04 | 广东欧珀移动通信有限公司 | Interface of input method display methods, device, terminal and storage medium |
| US11036344B1 (en) * | 2016-09-13 | 2021-06-15 | Parallels International Gmbh | Managing application windows of applications from different servers within a same browser window on a user device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102010051028A1 (en) * | 2010-11-11 | 2012-06-06 | Heidelberger Druckmaschinen Ag | Machine operation with browser |
-
2021
- 2021-08-20 CN CN202110959249.5A patent/CN113676782B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6683629B1 (en) * | 2000-08-03 | 2004-01-27 | Neoplanet, Inc. | Method in a computer system for embedding a child window in a parent window |
| US11036344B1 (en) * | 2016-09-13 | 2021-06-15 | Parallels International Gmbh | Managing application windows of applications from different servers within a same browser window on a user device |
| CN108491127A (en) * | 2018-03-12 | 2018-09-04 | 广东欧珀移动通信有限公司 | Interface of input method display methods, device, terminal and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113676782A (en) | 2021-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111447498B (en) | Awakening method of display equipment and display equipment | |
| CN112672195A (en) | Remote controller key setting method and display equipment | |
| CN112653906B (en) | Video hot spot playing method on display equipment and display equipment | |
| CN111343492B (en) | Display method and display device of browser in different layers | |
| CN112887778A (en) | Switching method of video resource playing modes on display equipment and display equipment | |
| CN113794914B (en) | Display equipment and method for configuring startup navigation | |
| CN112584229B (en) | Method for switching channels of display equipment and display equipment | |
| CN113490024A (en) | Control device key setting method and display equipment | |
| CN113163258A (en) | Channel switching method and display device | |
| CN113301405A (en) | Display device and display control method of virtual keyboard | |
| CN111641856A (en) | Prompt message display method for guiding user operation in display equipment and display equipment | |
| CN113064691B (en) | Display method and display equipment for starting user interface | |
| CN112911371B (en) | Dual-channel video resource playing method and display equipment | |
| CN113676782B (en) | Display equipment and interaction method for coexisting multiple applications | |
| CN113014979A (en) | Content display method and display equipment | |
| CN113064534A (en) | Display method and display equipment of user interface | |
| CN113014977A (en) | Display device and volume display method | |
| CN113132809A (en) | Channel switching method, channel program playing method and display equipment | |
| CN112882780A (en) | Setting page display method and display device | |
| CN111479144A (en) | Display device and application interaction method | |
| CN113490041B (en) | Voice function switching method and display device | |
| CN113784222B (en) | Interaction method of application and digital television program and display equipment | |
| WO2022174751A1 (en) | Display method and display device | |
| CN113490013B (en) | Server and data request method | |
| CN113490021B (en) | User interface display method and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20221014 Address after: 83 Intekte Street, Devon, Netherlands Applicant after: VIDAA (Netherlands) International Holdings Ltd. Address before: 266100 Songling Road, Laoshan District, Qingdao, Shandong Province, No. 399 Applicant before: QINGDAO HISENSE MEDIA NETWORKS Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |