CN112073762A

CN112073762A - Information acquisition method based on multi-system display equipment and multi-system display equipment

Info

Publication number: CN112073762A
Application number: CN201910636965.2A
Authority: CN
Inventors: 魏文; 董鹏
Original assignee: Qingdao Hisense Media Network Technology Co Ltd
Current assignee: Qingdao Jukanyun Technology Co ltd
Priority date: 2019-06-10
Filing date: 2019-07-15
Publication date: 2020-12-11
Anticipated expiration: 2039-07-15
Also published as: CN112073762B

Abstract

The application discloses an information acquisition method based on multi-system display equipment and the multi-system display equipment. In the application, the multi-system display device comprises a first system and a second system, wherein the second system is configured to be capable of being connected with a local area network, and the first system is configured to be connected with the local area network through the second system. When a first application in a first system needs to acquire information from a mobile terminal which is in the same local area network with a second system, information transmission is carried out through a first middleware in the first system and a second middleware in the second system, and the second application in the second system is triggered to acquire the information from the mobile terminal through the local area network, and the information is transmitted to the first system through information transmission mechanisms of the middleware in the two systems, so that the process that the first application acquires the information from the mobile terminal is realized.

Description

Information acquisition method based on multi-system display equipment and multi-system display equipment

The present application claims priority of chinese patent application with the title "information acquisition method based on multi-system display device and multi-system display device" filed by chinese patent office on 10/6/2019 with application number 201910497375.6, the entire contents of which are incorporated by reference in the present disclosure.

Technical Field

The present application relates to display technologies, and in particular, to an information acquisition method based on a multi-system display device and a multi-system display device.

Background

Currently, since a display device can provide a user with a play picture such as audio, video, picture, and the like, it is receiving a wide attention of the user. With the development of big data and artificial intelligence, the functional requirements of users on display devices are increasing day by day. In order to realize more functions and ensure the operation performance, a multi-system display device, such as a dual-system display device (or called dual-chip display device), is currently available. The multi-system display device supports a plurality of systems, and different systems can carry different applications or services.

The multi-system display device can comprise a main system and at least one auxiliary system, wherein the main system can directly communicate with the mobile terminal in the local area network, and the auxiliary system cannot directly communicate with the mobile terminal in the local area network due to the fact that the network segment in which the auxiliary system is located is different from the network segment of the local area network in which the main system is located. Therefore, the application installed in the secondary system cannot acquire information from the mobile terminal in the local area network.

Therefore, it is urgently needed to implement communication between the auxiliary system and the mobile terminal in the local area network for the multi-system display device, and particularly to be able to obtain information from the mobile terminal in the local area network.

Disclosure of Invention

The embodiment of the application provides an information acquisition method based on multi-system display equipment and the multi-system display equipment.

In a first aspect, an information obtaining method based on a multi-system display device is provided, where the multi-system display device is a display device including at least a first system and a second system, the second system is configured to be connectable to a local area network, the first system is configured to be connected to the local area network through the second system, the first system includes a first application and a first middleware, and the second system includes a second application and a second middleware, and the method includes:

the first middleware sends a second request to the second middleware in response to a first request of the first application; the first request is sent by the first application in response to a first operation of a user, wherein the first operation of the user is used for requesting to acquire target information applied to the first application from a mobile terminal, and the mobile terminal and the second system are in the same local area network;

and the second middleware responds to the second request and requests the second application to provide a communication interface for the mobile terminal to directly send target information applied to the first application to the display equipment.

In one possible implementation manner, the method further includes: the second middleware sends the target information obtained based on the communication interface to the first middleware; and the first middleware sends the target information to the first application.

In one possible implementation manner, the second middleware, in response to the second request, requests the second application to provide a communication interface to the mobile terminal, including: the second middleware calls the second application in response to the second request; the second application responds to the calling of the second middleware and displays the loading address identification information of the webpage on the display screen of the display equipment; or the second application responds to the call of the second middleware and calls a webpage loading module in the first system, and the webpage loading module responds to the call of the second application and displays the loading address identification information of the webpage on the display screen of the display equipment. The loading address identification information of the webpage is used by the mobile terminal for loading the corresponding webpage from the display device, and the webpage is used by the mobile terminal for directly sending target information applied to the first application to the display device.

Optionally, an information editing function is embedded in the webpage and used for editing the obtained target information.

Optionally, the loading address identification information of the web page is a pattern identification code.

Optionally, correspondence information between the first application and the second application is saved in the second application; the method further comprises the following steps: and after receiving the target information sent by the mobile terminal based on the communication interface, the second application sends the target information to the second middleware according to the corresponding relation information.

In a possible implementation manner, the first request and the second request respectively carry indication information, the second middleware further sends the indication information to the second application, and the indication information is used for indicating that target information acquired by the request is information applied to the first application in the first system;

the second middleware sends the target information obtained based on the communication interface to the first middleware, and comprises:

the second application sends the target information sent by the mobile terminal based on the communication interface to the second middleware according to the indication information;

and the second middleware sends the target information to the first middleware according to the indication information.

In a possible implementation manner, the first application is located in an application layer of the first system, the first middleware is a framework layer of the first system, the second application is located in an application layer of the second system, and the second middleware is a framework layer of the second system.

In one possible implementation, the target information is a user avatar used by the first application.

In a second aspect, an information obtaining method based on a multi-system smart television is provided, where the multi-system smart television at least includes a first Android system running on a first chip and a second Android system running on a second chip, where the second Android system is configured to be able to connect to a local area network, the first Android system is configured to connect to the local area network through the second Android system, the first Android system includes a first framework layer and a first application located in the first Android system application layer, the second Android system includes a second framework layer and a second application located in the second Android system application layer, and the method includes:

the first application responds to the received operation of the user to generate first request information; the first request information represents that the first application requests to obtain target information applied to the first application from a mobile terminal, wherein the mobile terminal and the second Android system are in the same local area network;

the first framework layer sends second request information to the second framework layer in response to first request information of the first application;

and the second framework layer responds to the second request information and requests the second application to provide a WebSocket communication interface for the mobile terminal, and the WebSocket communication interface is used for the mobile terminal to directly send the target information to the smart television.

Optionally, the method further comprises: the second framework layer sends target information received based on the WebSocket communication interface to the first framework layer; and the first framework layer sends the target information to the first application.

In a third aspect, an information obtaining method based on a multi-system display device is provided, where the multi-system display device is a display device including at least a first system and a second system, the second system is configured to be connectable to a local area network, the first system is configured to be connected to the local area network through the second system, the first system includes a first application and a first middleware, and the second system includes a second application and a second middleware, and the method includes:

the second middleware receives a second request sent by the first middleware; wherein the second request is sent by the first middleware in response to a first request of the first application, the first request is sent by the first application in response to a first operation of a user, the first operation of the user is used for requesting to acquire target information applied to the first application from a mobile terminal, and the mobile terminal and the second system are in the same local area network;

Optionally, the method further comprises: the second middleware sends the target information obtained based on the communication interface to the first middleware so as to enable the first middleware to send the target information to the first application.

In a fourth aspect, an information obtaining method based on a multi-system display device is provided, where the multi-system display device is a display device including at least a first system and a second system, the second system is configured to be connectable to a local area network, the first system is configured to be connected to the local area network through the second system, the first system includes a first application and a first middleware, and the second system includes a second application and a second middleware, and the method includes:

the first middleware sends a second request to the second middleware in response to a first request of the first application; the first request is sent by the first application in response to a first operation of a user, and the first operation of the user is used for requesting to acquire target information applied to the first application from a mobile terminal;

the first middleware receives target information which is sent by the second middleware and applied to the first application, wherein the target information is obtained by the second middleware in response to the second request, the second application is requested to provide a communication interface to the mobile terminal, and the communication interface is obtained from the mobile terminal, and the mobile terminal and the second system are in the same local area network;

and the first middleware sends the target information to the first application.

In a fifth aspect, there is provided a multi-system display device comprising: the system comprises a first system and a second system, wherein the second system is configured to be capable of connecting with a local area network, the first system is configured to be connected with the local area network through the second system, the first system comprises a first application and a first middleware, and the second system comprises a second application and a second middleware;

the first middleware is used for responding to a first request of the first application and sending a second request to the second middleware; the first request is sent by the first application in response to a first operation of a user, wherein the first operation of the user is used for requesting to acquire target information applied to the first application from a mobile terminal, and the mobile terminal and the second system are in the same local area network;

the second middleware is configured to request, in response to the second request, the second application to provide a communication interface to the mobile terminal, where the communication interface is configured to send, by the mobile terminal, target information applied to the first application directly to the display device.

Optionally, the second middleware is further configured to: sending the target information obtained based on the communication interface to the first middleware; the first middleware is further configured to send the target information to the first application.

In a sixth aspect, there is provided a multi-system display device comprising: the device comprises a first memory, a second memory, a first controller and a second controller, wherein a communication interface exists between the first controller and the second controller, the second controller is configured to be capable of being connected with a local area network, and the first controller is configured to be connected with the local area network through the second controller;

the first memory and the second memory to store computer instructions;

the first controller, configured to execute the computer instructions stored in the first memory, performs: sending a second request to the second controller in response to the first request of the first application; the first request is sent by the first application in response to a first operation of a user, the first operation of the user is used for requesting to acquire target information applied to the first application from a mobile terminal, and the mobile terminal and the second controller are in the same local area network;

the second controller is used for operating the computer instructions stored by the second memory and executing: and responding to the second request, requesting the second application to provide a communication interface for the mobile terminal to directly send target information applied to the first application to the display equipment.

Optionally, the second controller is further configured to send target information obtained based on the communication interface to the first controller; the first controller is further configured to execute the computer instructions stored in the first memory to perform: and sending the target information to the first application.

In the foregoing embodiment of the application, in the multi-system display device, the second system is configured to be capable of connecting to a local area network, and the first system is configured to connect to the local area network through the second system, in this case, when a first application in the first system needs to acquire information from a mobile terminal in the same local area network as the second system, information transmission may be performed through a first middleware in the first system and a second middleware in the second system, and the second application in the second system is triggered to acquire information from the mobile terminal through the local area network, so that a process that the first application acquires information from the mobile terminal is achieved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment;

fig. 2 is a block diagram exemplarily showing a hardware configuration of the control apparatus 100 according to the embodiment;

fig. 3 is a block diagram exemplarily showing a hardware configuration of the display device 200 according to the embodiment;

a block diagram of the hardware architecture of the display device 200 according to fig. 3 is exemplarily shown in fig. 4;

fig. 5 is a diagram exemplarily showing a functional configuration of the display device 200 according to the embodiment;

fig. 6a schematically shows a software configuration in the display device 200 according to an embodiment;

fig. 6b schematically shows a configuration of an application in the display device 200 according to an embodiment;

fig. 7 schematically illustrates a user interface in the display device 200 according to an embodiment;

fig. 8 is a diagram exemplarily illustrating information acquisition by the display device 200 according to the embodiment;

a schematic diagram of user avatar upload to display device 200 in accordance with an embodiment is illustrated in fig. 9.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

For a single system display device, only one main system is included, and when an application loaded on the main system needs to acquire information from a mobile terminal, the processing procedure is as follows: the application generates a two-dimensional code by calling a webserver service module so as to display the display equipment, the mobile terminal obtains a page loading address on a network side server by scanning the two-dimensional code for identification, and obtains a page from the network side server for loading, the mobile terminal selects information required by the application based on the page and sends the information to the server, and the server can synchronize the information to the application in the display equipment.

In the process, the mobile terminal interacts with the network side server, so that on one hand, the information sending efficiency depends on the network performance, and under the condition of poor network performance, the display equipment cannot obtain the information sent by the mobile terminal in time; on the other hand, the mobile terminal carries out Javascript signature and information transmission by calling a server background interface, and a signature algorithm possibly has the risk of being leaked and the signature security problem.

In order to solve the above problem, the mobile terminal may interact with the display device through the local area network when the display device and the mobile terminal are in the same local area network. However, for the multi-system display device, if the application in the auxiliary system needs to obtain information from the mobile terminal, since the network segment in which the auxiliary system is located is different from the network segment in which the main system is located, it is not able to directly communicate with the mobile terminal in the local network, so that the application in the auxiliary system cannot directly obtain information from the mobile terminal in the local network.

In view of the above aspects, to overcome the above drawbacks, the present application discloses an information interaction scheme based on a multi-system display device, which is used to implement an interaction function with a mobile terminal in a local area network by means of a main system to obtain information provided by the mobile terminal when an application in a secondary system needs to obtain information from the mobile terminal in the local area network.

The concept to which the present application relates will be first explained below with reference to the drawings. It should be noted that the following descriptions of the concepts are only for the purpose of facilitating understanding of the contents of the present application, and do not represent limitations on the scope of the present application.

The term "module," as used in various embodiments of the present application, may refer to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in the embodiments of the present application refers to a component of an electronic device (such as the display device disclosed in the present application) that is capable of wirelessly controlling the electronic device, typically over a short distance. The component may be connected to the electronic device by using at least one of infrared, Radio Frequency (RF) signal, bluetooth, and other communication methods, and may also include functional modules such as WiFi, wireless Universal Serial Bus (USB), bluetooth, and motion sensor. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" used in the embodiments of the present application refers to a user behavior used to express an intended idea, action, purpose or result through a change in hand shape or an action such as hand movement.

The term "hardware system" used in the embodiments of the present application may refer to a physical component having computing, controlling, storing, inputting and outputting functions, which is formed by a mechanical, optical, electrical and magnetic device such as an Integrated Circuit (IC), a Printed Circuit Board (PCB) and the like. In various embodiments of the present application, a hardware system may also be referred to as a motherboard (or chip).

The term "middleware" (middleware) used in the embodiments of the present application is an independent system software or service program, and a multisystem architecture can implement resource sharing or information transfer between different systems by using the software. Middleware is software that connects two independent systems. Connected systems, even if they have different interfaces, can still exchange information with each other through middleware.

Fig. 1 schematically shows an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user can operate the display apparatus 200 through the control devices (100A, 100B).

The control device may be a remote controller 100A, which can communicate with the display device 200 through an infrared protocol communication, a bluetooth protocol communication, a ZigBee (ZigBee) protocol communication, or other short-range communication, and is used to control the display device 200 in a wireless or other wired manner. The user may input a user instruction through a key on a remote controller, a voice input, a control panel input, etc., to control the display apparatus 200. Such as: the user may input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right movement keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement a function of controlling the display device 200.

The control device may also be an intelligent device, such as a mobile terminal 100B, a tablet computer, a notebook computer, and the like, which may communicate with the display device 200 through a Local Area Network (LAN), a Wide Area Network (WAN), a Wireless Local Area Network (WLAN), or other networks, and implement control of the display device 200 through an application program corresponding to the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application may provide various controls to the user through an intuitive User Interface (UI) on a screen associated with the smart device.

For example, the mobile terminal 100B and the display device 200 may each have a software application installed thereon, so that connection communication between the two can be realized through a network communication protocol, and the purpose of one-to-one control operation and data communication can be further realized. Such as: a control instruction protocol can be established between the mobile terminal 100B and the display device 200, a remote control keyboard is synchronized to the mobile terminal 100B, and the function of controlling the display device 200 is realized by controlling a user interface on the mobile terminal 100B; the audio and video content displayed on the mobile terminal 100B may also be transmitted to the display device 200, so as to implement a synchronous display function.

As shown in fig. 1, the display apparatus 200 may also perform data communication with the server 300 through various communication means. In various embodiments of the present application, the display device 200 may be allowed to be communicatively coupled to the server 300 via a local area network, a wireless local area network, or other network. The server 300 may provide various contents and interactions to the display apparatus 200.

Illustratively, the display device 200 receives software program updates, or accesses a remotely stored digital media library by sending and receiving information, and Electronic Program Guide (EPG) interactions. The servers 300 may be a group or groups, and may be one or more types of servers. Other web service contents such as a video on demand and an advertisement service are provided through the server 300.

The display device 200 may be, in one aspect, a liquid crystal display, an Organic Light Emitting Diode (OLED) display, or a projection display device; on the other hand, the display device may be a smart television or a display system consisting of a display and a set-top box. The specific display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function. Examples include: network televisions, smart televisions, Internet Protocol Televisions (IPTV), and the like. In some embodiments, the display device may not have a broadcast receiving television function.

As shown in fig. 1, a camera may be connected or disposed on the display device 200, and is used to present a picture taken by the camera on a display interface of the display device or other display devices, so as to implement an interactive chat between users. Specifically, the picture shot by the camera can be displayed on the display device in a full screen mode, a half screen mode or any optional area.

Fig. 2 is a block diagram illustrating a configuration of a control apparatus 100 according to an exemplary embodiment, and the control apparatus 100 may be a remote controller 100A or a mobile terminal 100B. As shown in fig. 2, the control device 100 includes a controller 110, a communicator 130, a user input/output interface 140, a memory 190, and a power supply 180.

The control apparatus 100 is configured to control the display device 200, and to receive an input operation instruction from a user, and convert the operation instruction into an instruction recognizable and responsive by the display device 200, and to mediate interaction between the user and the display device 200. Such as: the user operates the channel up/down key on the control device 100, and the display device 200 responds to the channel up/down operation.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display device 200 according to user demands.

In some embodiments, as shown in fig. 1, the mobile terminal 100B or other intelligent electronic device may function similar to the control apparatus 100 after installing an application for manipulating the display device 200. Such as: the user may implement the functions of controlling the physical keys of the apparatus 100 by installing applications, various function keys or virtual buttons of a graphical user interface available on the mobile terminal 100B or other intelligent electronic devices.

The controller 110 includes a processor 112, a RAM113 and a ROM114, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the internal components for communication and coordination and external and internal data processing functions.

The communicator 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communicator 130 may include at least one of a WiFi module 131, a bluetooth module 132, a Near Field Communication (NFC) module 133, and the like.

A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touch pad 142, a sensor 143, a key 144, and the like. Such as: the user can realize a user instruction input function through actions such as voice, touch, gesture, pressing, and the like, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the instruction signal to the display device 200.

The output interface includes an interface that transmits the received user instruction to the display apparatus 200. In some embodiments, it may be an infrared interface or a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. The following steps are repeated: when the rf signal interface is used, a user input command needs to be converted into a digital signal, and then the digital signal is modulated according to the rf control signal modulation protocol and then transmitted to the display device 200 through the rf transmitting terminal.

In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The communicator 130 is configured in the control device 100, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 100 under the control of the controller 110. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the components of the control device 100 under the control of the controller 110. A battery and associated control circuitry.

Fig. 3 exemplarily shows a hardware configuration block diagram of a hardware system in the display apparatus 200 according to an exemplary embodiment.

When a dual hardware system architecture is adopted, the mechanism relationship of the hardware system can be shown in fig. 3. For convenience of description, one hardware system in the dual hardware system architecture is hereinafter referred to as a first hardware system or a system, a-chip, and the other hardware system is hereinafter referred to as a second hardware system or N-system, N-chip. The chip A comprises a controller of the chip A and various modules connected with the controller of the chip A through various interfaces, and the chip N comprises a controller of the chip N and various modules connected with the controller of the chip N through various interfaces. The chip a and the chip N may each have a relatively independent operating system, and the operating system of the chip a and the operating system of the chip N may communicate with each other through a communication protocol, such as an Android system (Android), and a frame layer of the operating system of the chip a and a frame layer of the operating system of the chip N may communicate to perform transmission of commands and data, so that two independent subsystems but correlated with each other exist in the display device 200.

In the embodiment of the present application, the operating system on the a chip is referred to as a first system or a first operating system, and the operating system on the N chip is referred to as a second system or a second operating system.

As shown in fig. 3, the a chip and the N chip may be connected, communicated and powered through a plurality of different types of interfaces. The interface type of the interface between the a chip and the N chip may include a general-purpose input/output (GPIO) interface, a USB interface, a high-definition multimedia interface (HDMI), a universal asynchronous receiver/transmitter (UART) interface, and the like. One or more of these interfaces may be used for communication or power transfer between the a-chip and the N-chip. For example, as shown in fig. 3, in the dual hardware system architecture, the N chip may be powered by an external power source (power), and the a chip may not be powered by the external power source but by the N chip.

In addition to the interface for connecting with the N chip, the a chip may further include an interface for connecting other devices or components, such as a Mobile Industry Processor Interface (MIPI) interface for connecting a camera (camera) shown in fig. 3, a bluetooth interface, and the like.

Similarly, in addition to the interface for connecting with the N chip, the N chip may further include an VBY interface for connecting a display screen timer register (TCON), an i2S interface for connecting a power Amplifier (AMP) and a speaker (speaker); and an IR/Key interface, a USB interface, a WiFi interface, a bluetooth interface, an HDMI interface, a Tuner interface, and the like.

The dual hardware system architecture of the present application is further described below with reference to fig. 4. It should be noted that fig. 4 is only an exemplary illustration of the dual hardware system architecture of the present application, and does not represent a limitation of the present application. In actual practice, both hardware systems may contain more or less hardware or interfaces as desired.

A block diagram of the hardware architecture of the display device 200 according to fig. 3 is exemplarily shown in fig. 4. As shown in fig. 4, the hardware system of the display device 200 may include an a chip and an N chip, and a module connected to the a chip or the N chip through various interfaces.

The N-chip may include a tuner demodulator 220, a communicator 230, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, an audio processor 260-2, a display 280, an audio output interface 272, and a power supply. The N-chip may also include more or fewer modules in other embodiments.

The tuning demodulator 220 is configured to receive broadcast television signals in a wired or wireless manner, and perform modulation and demodulation processing such as amplification, mixing, resonance, and the like, so as to demodulate, from a plurality of wireless or wired broadcast television signals, an audio/video signal carried in a frequency of a television channel selected by a user, and additional information (e.g., an EPG data signal). Depending on the broadcast system of the television signal, the signal source of the tuner 220 may be various, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; according to different modulation types, the modulation mode of the signal can be a digital modulation mode or an analog modulation mode; and depending on the type of television signal being received, tuner demodulator 220 may demodulate analog and/or digital signals.

The tuner demodulator 220 is also operative to respond to the user-selected television channel frequency and the television signals carried thereby, as selected by the user and as controlled by the controller 210.

In other exemplary embodiments, the tuner/demodulator 220 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio/video signals after modulation and demodulation, and the television audio/video signals are input into the display device 200 through the external device interface 250.

The communicator 230 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 230 may include a WiFi module 231, a bluetooth communication protocol module 232, a wired ethernet communication protocol module 233, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module.

The display apparatus 200 may establish a connection of a control signal and a data signal with an external control apparatus or a content providing apparatus through the communicator 230. For example, the communicator 230 may receive a control signal of the remote controller 100A according to the control of the controller.

The external device interface 250 is a component for providing data transmission between the N-chip controller 210 and the a-chip and other external devices. The external device interface may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired and/or wireless manner, and may receive data such as a video signal (e.g., moving image), an audio signal (e.g., music), additional information (e.g., EPG), etc. of the external apparatus.

The external device interface 250 may include: a High Definition Multimedia Interface (HDMI) terminal 251, a Composite Video Blanking Sync (CVBS) terminal 252, an analog or digital component terminal 253, a Universal Serial Bus (USB) terminal 254, a red, green, blue (RGB) terminal (not shown), and the like. The number and type of external device interfaces are not limited by this application.

The controller 210 controls the operation of the display device 200 and responds to the user's operation by running various software control programs (e.g., an operating system and/or various application programs) stored on the memory 290.

As shown in FIG. 4, the controller 210 includes a read only memory ROM213, a random access memory RAM214, a graphics processor 216, a CPU processor 212, communication interfaces (218-1, 218-2, … …, 218-n), and a communication bus. The RAM213 and the ROM214, the graphic processor 216, the CPU processor 212, and the communication interface 218 are connected via a bus.

A ROM213 for storing instructions for various system boots. If the display device 200 is powered on upon receipt of the power-on signal, the CPU processor 212 executes a system boot instruction in the ROM and copies the operating system stored in the memory 290 to the RAM214 to start running the boot operating system. After the start of the operating system is completed, the CPU processor 212 copies the various application programs in the memory 290 to the RAM214 and then starts running and starting the various application programs.

A graphics processor 216 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

A CPU processor 212 for executing operating system and application program instructions stored in memory 290. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor 212 may include a plurality of processors. The plurality of processors may include a main processor and a plurality of or a sub-processor. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. A plurality of or one sub-processor for performing an operation in a standby mode or the like.

The communication interfaces may include a first interface 218-1 through an nth interface 218-n. These interfaces may be network interfaces that are connected to external devices via a network.

The controller 210 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to an icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 200 or a voice command corresponding to a voice spoken by the user.

The memory 290 includes a memory for storing various software modules for driving and controlling the display apparatus 200. Such as: various software modules stored in memory 290, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like.

The basic module is a bottom layer software module for signal communication between hardware in the display device 200 and sending processing and control signals to an upper layer module. The detection module is a management module used for collecting various information from various sensors or user input interfaces, and performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 280 to display image content, and may be used to play information such as multimedia image content and UI interface. The communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing data communication between the browsing servers. The service module is a module for providing various services and various application programs.

Meanwhile, the memory 290 is also used to store visual effect maps and the like for receiving external data and user data, images of respective items in various user interfaces, and a focus object.

A user input interface for transmitting an input signal of a user to the controller 210 or transmitting a signal output from the controller to the user. For example, the control device (e.g., a mobile terminal or a remote controller) may send an input signal, such as a power switch signal, a channel selection signal, a volume adjustment signal, etc., input by a user to the user input interface, and then the input signal is forwarded to the controller by the user input interface; alternatively, the control device may receive an output signal such as audio, video, or data output from the user input interface via the controller, and display the received output signal or output the received output signal in audio or vibration form.

In some embodiments, a user may enter a user command on a Graphical User Interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The video processor 260-1 is configured to receive a video signal, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a video signal that is directly displayed or played on the display 280.

Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if an MPEG-2 format signal is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like.

And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert a frame rate of an input video, such as a 24Hz, 25Hz, 30Hz, or 60Hz video, into a 60Hz, 120Hz, or 240Hz frame rate, where the input frame rate may be related to a source video stream, and the output frame rate may be related to an update rate of a display. The input is realized in a common format by using a frame insertion mode.

And a display formatting module for converting the signal output by the frame rate conversion module into a signal conforming to a display format of a display, such as converting the format of the signal output by the frame rate conversion module to output an RGB data signal.

And a display 280 for receiving the image signal input from the video processor 260-1 and displaying the video content and image and the menu manipulation interface. The display 280 includes a display component for presenting a picture and a driving component for driving the display of an image. The video content may be displayed from the video in the broadcast signal received by the tuner/demodulator 220, or from the video content input from the communicator or the external device interface. The display 280 simultaneously displays a user manipulation interface UI generated in the display apparatus 200 and used to control the display apparatus 200.

And, a driving component for driving the display according to the type of the display 280. Alternatively, in case the display 280 is a projection display, it may also comprise a projection device and a projection screen.

The audio processor 260-2 is configured to receive an audio signal, and perform decompression and decoding according to a standard codec protocol of the input signal, and perform audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker 272.

An audio output interface 270 for receiving the audio signal output by the audio processor 260-2 under the control of the controller 210, wherein the audio output interface may include a speaker 272 or an external sound output terminal 274 for outputting to a generating device of an external device, such as: external sound terminal or earphone output terminal.

In other exemplary embodiments, video processor 260-1 may comprise one or more chip components. The audio processor 260-2 may also include one or more chips.

And, in other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or may be integrated in one or more chips with the controller 210.

And a power supply for supplying power supply support to the display apparatus 200 from the power input from the external power source under the control of the controller 210. The power supply may include a built-in power supply circuit installed inside the display apparatus 200, or may be a power supply installed outside the display apparatus 200, such as a power supply interface for providing an external power supply in the display apparatus 200.

Similar to the N-chip, as shown in fig. 4, the a-chip may include a controller 310, a communicator 330, a detector 340, and a memory 390. A user input interface, a video processor, an audio processor, a display, an audio output interface may also be included in some embodiments. In some embodiments, there may also be a power supply that independently powers the A-chip.

The communicator 330 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communicator 330 may include a WiFi module 331, a bluetooth communication protocol module 332, a wired ethernet communication protocol module 333, and other network communication protocol modules such as an infrared communication protocol module or a near field communication protocol module.

The communicator 330 of the a-chip and the communicator 230 of the N-chip also interact with each other. For example, the WiFi module 231 within the N-chip hardware system is used to connect to an external network, generate network communication with an external server, and the like. The WiFi module 331 in the a-chip hardware system is used to connect to the N-chip WiFi module 231 without making a direct connection with an external network or the like, and the a-chip is connected to an external network through the N-chip. Therefore, for the user, a display device as in the above embodiment displays a WiFi account to the outside.

The detector 340 is a component of the display device a chip for collecting signals of an external environment or interacting with the outside. The detector 340 may include a light receiver 342, a sensor for collecting the intensity of ambient light, which may be used to adapt to display parameter changes, etc.; the system may further include an image collector 341, such as a camera, a video camera, etc., which may be configured to collect external environment scenes, collect attributes of the user or interact gestures with the user, adaptively change display parameters, and identify user gestures, so as to implement a function of interaction with the user.

An external device interface 350, which provides a component for data transmission between the controller 310 and the N-chip or other external devices. The external device interface may be connected with an external apparatus such as a set-top box, a game device, a notebook computer, etc. in a wired and/or wireless manner.

The controller 310 controls the operation of the display device 200 and responds to the user's operation by running various software control programs stored on the memory 390 (e.g., using installed third party applications, etc.), and interacting with the N-chip.

As shown in FIG. 4, the controller 310 includes a read only memory ROM313, a random access memory RAM314, a graphics processor 316, a CPU processor 312, communication interfaces (318-2, … …, 318-n), and a communication bus. The ROM313 and the RAM314, the graphic processor 316, the CPU processor 312, and the communication interface 318 are connected via a bus.

A ROM313 for storing instructions for various system boots. CPU processor 312 executes system boot instructions in ROM and copies the operating system stored in memory 390 to RAM314 to begin running the boot operating system. After the start of the operating system is completed, the CPU processor 312 copies various application programs in the memory 390 to the RAM314 and then starts running and starting various application programs.

The CPU processor 312 is used for executing the operating system and application program instructions stored in the memory 390, communicating with the N chip, transmitting and interacting signals, data, instructions, etc., and executing various application programs, data and contents according to various interaction instructions received from the outside, so as to finally display and play various audio and video contents.

The communication interfaces may include a first interface 318-1 through an nth interface 318-n. These interfaces may be network interfaces connected to external devices via a network, or may be network interfaces connected to the N-chip via a network.

The controller 310 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

A graphics processor 316 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the operator and displaying the rendered result on the display 280.

Both the A-chip graphics processor 316 and the N-chip graphics processor 216 are capable of generating various graphics objects. In distinction, if application 1 is installed on the a-chip and application 2 is installed on the N-chip, the a-chip graphics processor 316 generates a graphics object when a user performs a command input by the user in application 1 at the interface of application 1. When a user makes a command input by the user in the interface of the application 2 and within the application 2, a graphic object is generated by the graphic processor 216 of the N chip.

Fig. 5 is a diagram schematically illustrating a functional configuration of a display device according to an exemplary embodiment.

As shown in fig. 5, the memory 390 of the a-chip and the memory 290 of the N-chip are used to store an operating system, an application program, contents, user data, and the like, respectively, and perform system operations for driving the display device 200 and various operations in response to a user under the control of the controller 310 of the a-chip and the controller 210 of the N-chip. The A-chip memory 390 and the N-chip memory 290 may include volatile and/or non-volatile memory.

The memory 290 is specifically configured to store an operating program for driving the controller 210 in the display device 200, and store various applications installed in the display device 200, various applications downloaded by a user from an external device, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and internal data of various supported applications. The memory 290 is used to store system software such as an Operating System (OS) kernel, middleware, and applications, and to store input video data and audio data, and other user data.

The memory 290 is specifically used for storing drivers and related data such as the video processor 260-1 and the audio processor 260-2, the display 280, the communication interface 230, the tuner demodulator 220, the input/output interface, and the like.

In some embodiments, memory 290 may store software and/or programs, software programs for representing an Operating System (OS) including, for example: a kernel, middleware, an Application Programming Interface (API), and/or an application program. For example, the kernel may control or manage system resources, or functions implemented by other programs (e.g., the middleware, APIs, or applications), and the kernel may provide interfaces to allow the middleware and APIs, or applications, to access the controller to implement controlling or managing system resources.

The memory 290, for example, includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907 (including voice recognition modules 2907-2, key command recognition modules 2907-3), a communication control module 2908, a light receiving module, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module, and the like. The controller 210 performs functions such as: the system comprises a broadcast television signal receiving and demodulating function, a television channel selection control function, a volume selection control function, an image control function, a display control function, an audio control function, an external instruction identification function, a communication control function, an optical signal receiving function, an electric power control function, a software control platform supporting various functions, a browser function and other various functions.

The memory 390 includes a memory storing various software modules for driving and controlling the display apparatus 200. Such as: various software modules stored in memory 390, including: the system comprises a basic module, a detection module, a communication module, a display control module, a browser module, various service modules and the like. Since the functions of the memory 390 and the memory 290 are similar, reference may be made to the memory 290 for relevant points, and thus, detailed description thereof is omitted here.

Illustratively, the memory 390 includes an image control module 3904, an audio control module 32906, an external instruction recognition module 3907 (including a pattern recognition module 3907-1), a communication control module 3908, a light receiving module 3909, an operating system 3911, and other application programs 3912, a browser module, and the like. The controller 310 performs functions such as: the system comprises an image control function, a display control function, an audio control function, an external instruction identification function, a communication control function, an optical signal receiving function, an electric power control function, a software control platform supporting various functions, a browser function and other various functions.

Differently, the external instruction recognition module 2907 of the N-chip and the external instruction recognition module 3907 of the a-chip can recognize different instructions.

Illustratively, since the image receiving device such as a camera is connected with the a-chip, the external instruction recognition module 3907 of the a-chip may include an image recognition module 3907-1, a graphic database is stored in the image recognition module 3907-1, and when the camera receives an external graphic instruction, the camera corresponds to the instruction in the graphic database to perform instruction control on the display device. Since the voice receiving device and the remote controller are connected to the N-chip, the external command recognition module 2907 of the N-chip may include a voice recognition module 2907-2, a voice database is stored in the graphic recognition module 2907-2, and when the voice receiving device receives an external voice command or the like, the voice receiving device and the like perform a corresponding relationship with a command in the voice database to perform command control on the display device. Similarly, a control device 100 such as a remote controller is connected to the N-chip, and a key command recognition module performs command interaction with the control device 100.

A block diagram of a configuration of a software system in a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 6 a.

For an N-chip, as shown in fig. 6a, the operating system 2911, includes executing operating software for handling various basic system services and for performing hardware related tasks.

In some embodiments, portions of the operating system kernel may contain a series of software to manage the display device hardware resources and provide services to other programs or software code.

In other embodiments, portions of the operating system kernel may include one or more device drivers, which may be a set of software code in the operating system that assists in operating or controlling the devices or hardware associated with the display device. The drivers may contain code that operates the video, audio, and/or other multimedia components. Examples include a display, a camera, Flash, WiFi, and audio drivers.

The accessibility module 2911-1 is configured to modify or access the application program to achieve accessibility and operability of the application program for displaying content.

A communication module 2911-2 for connection to other peripherals via associated communication interfaces and a communication network.

The user interface module 2911-3 is configured to provide an object for displaying a user interface, so that each application program can access the object, and user operability can be achieved.

Control applications 2911-4 for controlling process management, including runtime applications and the like.

The event transmission system 2914 may be implemented within the operating system 2911 or within the application 2912. In some embodiments, an aspect is implemented within the operating system 2911 and concurrently in the application programs 2912 for listening for various user input events, and will implement one or more sets of predefined operations in response to various events referring to the recognition of various types of events or sub-events.

The event monitoring module 2914-1 is configured to monitor an event or a sub-event input by the user input interface.

The event identification module 2914-1 is configured to input definitions of various types of events for various user input interfaces, identify various events or sub-events, and transmit the same to a process for executing one or more corresponding sets of processes.

The event or sub-event refers to an input detected by one or more sensors in the display device 200 and an input of an external control device (e.g., the control apparatus 100). Such as: the method comprises the following steps of inputting various sub-events through voice, inputting a gesture sub-event through gesture recognition, inputting a remote control key command of a control device and the like. Illustratively, the one or more sub-events in the remote control include a variety of forms including, but not limited to, one or a combination of key presses up/down/left/right/, ok keys, key presses, and the like. And non-physical key operations such as move, hold, release, etc.

The interface layout management module 2913, directly or indirectly receiving the input events or sub-events from the event transmission system 2914, monitors the input events or sub-events, and updates the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the size, position, and level of the container, which are related to the layout of the interface.

Since the functions of the operating system 3911 of the a chip are similar to those of the operating system 2911 of the N chip, reference may be made to the operating system 2911 for relevant points, and details are not repeated here.

As shown in fig. 6b, the application layer of the display device contains various applications that can be executed at the display device 200.

The N-chip application layer 2912 may include, but is not limited to, one or more applications such as: a video-on-demand application, an application center, a game application, and the like. The application layer 3912 of the a-chip may include, but is not limited to, one or more applications such as: live television applications, media center applications, and the like. It should be noted that what applications are respectively contained in the a chip and the N chip is determined according to an operating system and other designs, and the application does not need to specifically limit and divide the applications contained in the a chip and the N chip.

The live television application program can provide live television through different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of the cloud storage, from a local hard disk storage containing stored video programs.

The media center application program can provide various applications for playing multimedia contents. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

The application program center can provide and store various application programs. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on a display device. The application center may obtain these applications from different sources, store them in local storage, and then be operable on the display device 200.

In some embodiments, the operating system includes a base layer portion, which may include a kernel and a hardware interface layer, a core portion including a framework layer and a core class library, and an application portion including an application layer.

A schematic diagram of a user interface in a display device 200 according to an exemplary embodiment is illustrated in fig. 7. As shown in fig. 7, the user interface includes a plurality of view display areas, illustratively, a first view display area 201 and a play screen 202, wherein the play screen includes a layout of one or more different items. And a selector in the user interface indicating that the item is selected, the position of the selector being movable by user input to change the selection of a different item.

It should be noted that the multiple view display areas may present display screens of different hierarchies. For example, a first view display area may present video chat project content and a second view display area may present application layer project content (e.g., web page video, VOD presentations, application screens, etc.).

Optionally, the different view display areas are presented with different priorities, and the display priorities of the view display areas are different among the view display areas with different priorities. If the priority of the system layer is higher than that of the application layer, when the user uses the acquisition selector and picture switching in the application layer, the picture display of the view display area of the system layer is not blocked; and when the size and the position of the view display area of the application layer are changed according to the selection of the user, the size and the position of the view display area of the system layer are not influenced.

The display frames of the same hierarchy can also be presented, at this time, the selector can switch between the first view display area and the second view display area, and when the size and the position of the first view display area are changed, the size and the position of the second view display area can be changed along with the change.

Since the a-chip and the N-chip may have independent operating systems installed therein, there are two independent but interrelated subsystems in the display device 200. For example, Android and various APPs may be independently installed on each of the a chip and the N chip, so that each chip may implement a certain function, and the a chip and the N chip cooperatively implement a certain function, for example, an application on the a chip performs information interaction with a mobile terminal in a local area network by means of the N chip, and particularly, directly obtains information from the mobile terminal in the local area network.

The following embodiments of the present application are described by taking a display device as an example, where the display device includes a first system (i.e., an operating system on an a-chip) and a second system (i.e., an operating system on an N-chip), and may also be applied to a display device including two or more systems (chips).

In an embodiment of the application, the second system is configured to be connectable to a local area network, and the first system is configured to be connectable to the local area network via the second system. Taking the display device architecture shown in fig. 4 as an example, the second system (operating system on N chip) may be configured to connect to a local area network through a WiFi module in a communicator connected to the N chip, so as to implement information interaction with a mobile terminal in the local area network. The first system and the second system can perform information transfer and interaction through the middleware, for example, the first system can receive information obtained by the second system from a mobile terminal in a local area network through the first middleware from a second middleware of the second system.

The mobile terminal has a function of connecting to a local area network, and can communicate with the display device through the local area network, for example, a web page can be obtained from the display device for loading, and information is sent to the display device. For example, the mobile terminal includes, but is not limited to, a mobile phone, a palm top computer, a wearable device, and the like.

In this embodiment of the present application, a memory of a chip where the first system is located stores a first operating system program, a first application program, and a first middleware, so that after the a chip loads these contents from the memory, an application layer of the first system on the a chip includes the first application, a bottom layer is a first operating system kernel, and a framework layer (framework) between the application layer and the bottom layer is the first middleware. The memory of the N chip stores a second operating system program, a second application program and a second middleware, so that after the N chip loads the contents from the memory, the application layer of the second system on the N chip includes the second application, the bottom layer is a second operating system kernel, and the framework layer between the application layer and the bottom layer is the second middleware. Of course, the first system may include other applications besides the first application, and the second system may include other applications besides the second application, which is not limited in this application.

In some embodiments, the first system is a main system, the display screen of the display device is driven by the first system to display, and the content to be displayed on the display screen in the second system is displayed through the first system. In some embodiments, the second system is a main system, the display screen of the display device is driven by the second system to display, and the content required to be displayed on the display screen in the first system is displayed through the second system.

Optionally, the first system and the second system may be the same, for example, both the first system and the second system are Android systems, and the first system and the second system may also be different.

Based on the display device, in a case that the mobile terminal and the display device are located in the same local area network (for example, in a case that the mobile terminal is connected to the display device through the WiFi module in the first system), a process of acquiring information from the mobile terminal by an application in the second system may be as shown in fig. 8.

As shown in fig. 8, at 801, after receiving a first operation of a user, which is used for requesting to acquire target information applied to a first application from a mobile terminal, the first application in the first system sends a first request to a middleware in the first system. The first operation of the user can generate a first information acquisition request to be sent to the first application. In 802, the first middleware sends a second request to the second middleware in response to a first request of the first application; at 803, the second middleware requests the second application to provide a communication interface for the mobile terminal to directly transmit target information applied to the first application to the display device, in response to the second request; at 804, the second application receives the target information sent by the mobile terminal in the same local area network based on the communication interface.

Optionally, the above process may further include the following steps: at 805, the second application sends the target information to a second middleware; at 806, the second middleware sends the target information to the first middleware; at 807, the first middleware sends the target information to the first application.

Optionally, the first application in the display device may perform setting or other processing on the target information after obtaining the target information. Further, the display device may upload the target information to the server side at an appropriate timing. Wherein the suitable timing may be a set time period, such as a night idle period.

It should be noted that the information interaction process in the above flow may be implemented by using a calling method, or may also be implemented by using a message transmission mechanism or other information interaction mechanisms, which is not limited in this embodiment of the present application. For example, in 802, the first middleware may call the second middleware by using a Remote Procedure Call (RPC) mode, so as to transfer the request information (or the event information) to the second middleware; at 806; and after obtaining the target information, the second middleware sends the target information to the first middleware by calling back the first middleware. For another example, in 803, the second middleware causes the second application to provide the communication interface to the mobile terminal by calling the second application.

Optionally, the first application may have a function of interacting with a user, for example, a user interface may be provided, and an operation instruction sent by the user is received through the user interface and responded. For example, the first application may be a social-type application or a system user setup application that may provide a user setup interface and allow a user to select a user avatar setting function option on the user setup interface via a remote control to set a user avatar. As another example, the first application may be a payment-type application that may provide a user fingerprint input interface and allow a user to select a user fingerprint input option on the user setup interface via a remote control to obtain a user fingerprint. Accordingly, in some embodiments, in 801, after the user selects a corresponding function option on the user interface provided by the first application (for example, the user avatar sets the function option described above), since the function option needs to obtain corresponding information from the mobile terminal, and the first system to which the first application belongs cannot directly interact with the mobile terminal in the same lan as the second system, the first application sends a first request to the first middleware, so that the first middleware performs information interaction with the second middleware, so as to obtain target information from the mobile terminal in the same lan as the second system by means of the second system.

In some embodiments, the target information may include picture information and/or text information.

Alternatively, since the second middleware cannot directly call the communication interface, the second middleware needs to call the communication interface through the second application. After the second application is triggered (e.g., invoked by the second middleware or receiving a request sent by the second middleware), the mobile terminal may be provided with a communication interface (e.g., a websocket communication interface) through which the mobile terminal may send target information applied to the first application to the display device.

The communication interface can be called by the mobile terminal, so that the mobile terminal sends information to the display device according to the communication interface. In a specific implementation, the second application may enable the mobile terminal to identify a webpage loading address and load a corresponding webpage by loading identification information to an address of the webpage displayed on the mobile terminal (for example, the webpage loading address identification information is displayed on a display screen of the display device), where the webpage includes a function of sending information to the display device based on a communication interface provided by the display device, and therefore the mobile terminal may send information to the display device based on the webpage and according to the communication interface.

Specifically, the second application may call the web page loading module to obtain address identification information of a web page used for acquiring the target information, and display the address identification information of the web page through a display screen of the display device, so that the mobile terminal in the same local area network as the display device may obtain a loading address of the web page through the address identification information of the web page, and load a corresponding web page from the display device, and send the requested information to the display device based on the web page. In specific implementation, the web page loading module may be an H5 service module, and H5 is an HTML5 short, that is, a fifth edition hypertext markup language (HTML).

In the embodiment of the application, the webpage loading address provided by the webpage loading address module is an address of a display device end, the webpage is stored in the display device, and correspondingly, the mobile terminal obtains and loads the webpage from the display device according to the webpage loading address identification information. In a specific implementation, the code of the web page may be embedded in a system installation package (such as an APK) of the display device. Because the mobile terminal and the display device are located in the same local area network, the mobile terminal can obtain the webpage from the display device through the local area network for loading, compared with the case that the mobile terminal obtains the webpage from the server through the cellular network for loading, the real-time transmission can be realized through the local area network for transmission, and the reliability of the transmission can be improved, for example, the successful webpage loading is ensured.

Furthermore, a communication interface can be provided on the display device side by using Java code or other methods, and a web page provided by the display device includes a function for interacting with the display device based on the communication interface, so that the mobile terminal calls the communication interface through the web page to upload information to the display device. Optionally, the communication interface may use a signature encryption algorithm to secure the information transfer. Because the communication interface is provided by the display device, the mobile terminal calls the interface through the local area network and transmits the related information based on the signature encryption algorithm, compared with the case that the mobile terminal loads a webpage from a server side through a cellular network and uploads the information, the risk that the signature encryption algorithm is leaked can be avoided, and the safety is improved.

Optionally, the address identification information of the web page may be a graphic identification code, such as a two-dimensional code, or may be identification information in other forms, which is not limited in the embodiment of the present application. Taking the two-dimensional code as an example, the two-dimensional code may include information such as a web page loading address and a port number, and the mobile terminal may obtain the information such as the web page loading address and the port number by scanning the two-dimensional code on the display screen of the display device, and obtain the web page from the display device according to the information obtained by the identification and load the web page.

Optionally, when the second application calls the web page loading module, the second application may send the relevant description information of the target information required by the first application to the web page loading module, so that the web page loading module generates the address identification information of the web page for acquiring the target information.

The related description information of the target information required by the first application is used for identifying the target information, and may specifically include an identifier, a type, and the like of the target information. For example, if the target information required by the first application is the user avatar, the related description information is the object type ID for representing the user avatar.

Optionally, in this embodiment of the application, different types of target information are acquired using different webpages, that is, the different types of target information correspond to different webpage loading addresses, for example, a user avatar corresponds to a webpage loading address 1, that is, a webpage loaded according to the webpage loading address 1 is used to implement a user avatar acquisition function, and a user fingerprint corresponds to a webpage address 2, that is, a webpage loaded according to the webpage loading address 2 is used to implement an user fingerprint acquisition function. In this way, the webpage loading module can provide the corresponding webpage and the loading address of the webpage for the user according to the relevant description information of the target information required by the first application, so as to achieve the acquisition of the corresponding target information.

In other embodiments, different types of target information may also correspond to the same webpage loading address, and the webpage loading module may dynamically generate a webpage for acquiring the target information according to the related description information of the target information required by the first application, and provide the user with identification information of the loading address of the webpage. For example, when the target information is a user avatar, the web page loading module dynamically generates a web page 1 for acquiring the user avatar, and when the target information is a user fingerprint, the web page loading module dynamically generates a web page 2 for acquiring the user fingerprint, where the web page loading addresses of the web page 1 and the web page 2 are the same.

Optionally, the web page loading module may be located at the application layer as an application, or may be located at the framework layer as a service. As an example, the web page loading module may be an H5 service module, and the H5 service module may provide a websocket communication interface, so that the mobile terminal and the display device may interact based on the communication interface, which may include: the display device displays the two-dimensional code containing the webpage loading address, the terminal loads the corresponding webpage from the display device by scanning the two-dimensional code, and sends information to the display device based on the webpage.

In some embodiments, the web page loading module may be other functional modules that may provide a bidirectional communication interface for the display device and the mobile terminal.

Optionally, the second application may be launched when triggered by the second middleware. Further, the second application may be closed after the second middleware obtains the target information and sends it to the first middleware.

The optional second application may be called by the second middleware after receiving the request sent by the first middleware, the second application receives the target information uploaded by the user through the websocket communication interface, and determines whether to transmit the target information to the second middleware according to the stored record, and the second application may be closed after the second middleware obtains the target information and sends the target information to the first middleware.

Optionally, the second application is not visible to the user, i.e. the second application does not provide a user interface for interacting with the user.

Optionally, in some embodiments, the application layer of the second system includes a second application and a web page address loading module, and accordingly, in 803, the second application calls the web page loading module in response to the call of the second system, and the web page loading module provides the loading address identification information of the web page to the mobile terminal in response to the call of the second application. In other embodiments, the second application has the function of the web page loading module, and the web page loading module may be an embedded module of an application. Accordingly, in 803, the second application provides the loading address identification information of the web page to the mobile terminal in response to the call of the second system.

In some embodiments, the loading address identifying information of the web page is presented on a display screen of a display device.

Optionally, in some embodiments of the present application, an information editing function is embedded in a webpage provided by the display device for the mobile terminal, and may be used to edit the obtained target information. Taking the user avatar as an example, the webpage loaded by the mobile terminal from the display device includes a function for editing (such as zooming, clipping, etc.) the user avatar, so that the user edits the avatar, and the user experience is improved.

Optionally, in some embodiments of the present application, a first request sent by a first application to a first middleware and a second request sent by the first middleware to a second middleware respectively carry indication information, and the second middleware further sends the indication information to a second application, where the indication information is used to indicate that target information acquired by the request is information applied to the first application in the first system, so that the second application can determine, according to the indication information, that the acquired target information belongs to the first system, and therefore send the target information to the second middleware, and send the target information to the first middleware through the second middleware. Accordingly, in 806, the second middleware sends the target information obtained based on the web page to the first middleware according to the indication information.

Optionally, in other embodiments of the present application, a correspondence relationship between the second application and the first application is maintained. Therefore, when the second application is triggered to display the loading address identification information of the webpage, the mobile terminal loads the corresponding webpage, and after the target information sent by the mobile terminal based on the webpage is obtained, the target information can be determined to belong to the first application in the first system according to the corresponding relation, so that the target information is sent to the second middleware, and the target information is sent to the first middleware through the second middleware.

In order to more clearly understand the embodiment of the present application, a specific implementation process of the embodiment of the present application is described below by taking an intelligent television and a flow for setting a user avatar in the intelligent television as an example.

As shown in fig. 9, the system architecture of the smart television includes an Android system 1 (an operating system on an a chip) and an Android system 2 (an operating system on an N chip), where the application 1 is a main application installed on the Android system 1, and the application 2 is an auxiliary application installed on the Android system 2. Information can be transferred between the system 1 and the system 2 through a framework layer frame (middleware) to enable the display device to open the webserver service.

Taking the uploading of the avatar picture as an example, the application 1 provides a user interface including a "user avatar setting" function option. At 901-902, after a user clicks the function option on the application 1 through a key of a remote controller, the application 1 sends a broadcast (for example, an SILO broadcast) to a framework layer frame 1 in the Android system 1. In the process, a key event of the remote controller is captured by a kernel of the Android system 1 and is sent to the application 1 through a framework layer frame 1 in the Android system 1, so that the application 1 responds to the key event and sends an SILO broadcast to the framework layer frame 1.

At 903, the framework layer frame 1 calls the framework layer frame 2 in the Android system 2 through network RPC to transfer the event information for obtaining the avatar of the user to the framework layer frame 2.

At 904, after the framework layer frame 2 in the Android system 2 receives the event transferred by the Android system 1, the application 2 on the Android system 2 is called through a startActivity method provided by the Android system 2. Wherein the application 2 can be started through the startActivity method. Application 2 starts the H5 service module of the present application to present a two-dimensional code containing identification information of the load address of the web page. At this time, the H5 service is in the same lan as the mobile terminal.

At 905, the mobile terminal scans the two-dimensional code and then obtains a web page from the display device for loading, selects a picture stored on the mobile terminal as a user avatar through a function provided by the web page or obtains the user avatar by shooting, clicks an "upload" function option in the web page, and uploads the user avatar to an H5 service module corresponding to application 2 through a communication interface (e.g., a websocket communication interface) provided by the smart television. In the process, the information sent by the mobile terminal is sent to the H5 service module in the application 2 through the kernel of the Android system 2 and the framework layer 2.

At 906, application 2 passes the user avatar to framework layer frame 2 in Android system 2 via SILO broadcast.

In some embodiments, the application 2 transfers the user avatar to the framework layer frame 2 in the Android system 2 through a pre-stored mapping relationship, where the mapping relationship is used to represent that the event information for obtaining the user avatar is sent to the application 2 by that application.

At 907, the framework layer frame 2 in Android system 2 passes the user avatar to framework layer frame 1 in Android system 1 through a network RPC call.

At 908, the framework layer frame 1 in Android system 1 sends the user avatar to application 1 through SILO broadcast. Finally, the function of uploading the local area network head portrait of the application on the system 1 (the operating system on the A chip) on the dual-system (dual-chip) display equipment is realized.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary one or more examples, it is to be understood that each aspect of the disclosure can be utilized independently and separately from other aspects of the disclosure to provide a complete disclosure.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. An information acquisition method based on a multi-system display device, wherein the multi-system display device is a display device including at least a first system and a second system, the second system is configured to be connectable to a local area network, the first system is configured to be connected to the local area network through the second system, the first system includes a first application and a first middleware, the second system includes a second application and a second middleware, and the method includes:

2. The method of claim 1, wherein the method further comprises:

the second middleware sends the target information obtained based on the communication interface to the first middleware;

and the first middleware sends the target information to the first application.

3. The method of claim 1, wherein the second middleware, in response to the second request, requests the second application to provide a communication interface to the mobile terminal, comprising:

the second middleware calls the second application in response to the second request;

the second application responds to the calling of the second middleware and displays the loading address identification information of the webpage on the display screen of the display equipment; or the second application responds to the call of the second middleware and calls a webpage loading module in the first system, and the webpage loading module responds to the call of the second application and displays the loading address identification information of the webpage on the display screen of the display equipment;

the loading address identification information of the webpage is used by the mobile terminal for loading the corresponding webpage from the display device, and the webpage is used by the mobile terminal for directly sending target information applied to the first application to the display device.

4. The method of claim 3, wherein the web page is embedded with an information editing function for editing the obtained target information.

5. The method of claim 3, wherein the load address identifying information of the web page is a pattern identification code.

6. The method according to claim 1, wherein correspondence information between the first application and the second application is saved in the second application;

the method further comprises the following steps:

and after receiving the target information sent by the mobile terminal based on the communication interface, the second application sends the target information to the second middleware according to the corresponding relation information.

7. The method of claim 2, wherein the first request and the second request respectively carry indication information, and the second middleware further sends the indication information to the second application, where the indication information is used to indicate that target information requested to be obtained is information applied to a first application in the first system;

8. The method of claim 1, wherein the first application is located at an application layer of the first system, the first middleware is a framework layer of the first system, the second application is located at an application layer of the second system, and the second middleware is a framework layer of the second system.

9. The method of any of claims 1-8, wherein the target information is a user avatar used by the first application.

10. An information obtaining method based on a multi-system smart television is characterized in that the multi-system smart television at least comprises a first Android system running on a first chip and a second Android system running on a second chip, wherein the second Android system is configured to be capable of being connected with a local area network, the first Android system is configured to be connected with the local area network through the second Android system, the first Android system comprises a first framework layer and a first application located in the first Android system application layer, the second Android system comprises a second framework layer and a second application located in the second Android system application layer, and the method comprises the following steps:

11. A multi-system display device, comprising: the system comprises a first system and a second system, wherein the second system is configured to be capable of connecting with a local area network, the first system is configured to be connected with the local area network through the second system, the first system comprises a first application and a first middleware, and the second system comprises a second application and a second middleware;