WO2022206392A1 - 应用唤醒方法、显示设备、移动终端及服务器 - Google Patents

应用唤醒方法、显示设备、移动终端及服务器 Download PDF

Info

Publication number
WO2022206392A1
WO2022206392A1 PCT/CN2022/081249 CN2022081249W WO2022206392A1 WO 2022206392 A1 WO2022206392 A1 WO 2022206392A1 CN 2022081249 W CN2022081249 W CN 2022081249W WO 2022206392 A1 WO2022206392 A1 WO 2022206392A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
instruction
wake
state
target application
Prior art date
Application number
PCT/CN2022/081249
Other languages
English (en)
French (fr)
Inventor
王光强
邱若强
Original Assignee
聚好看科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 聚好看科技股份有限公司 filed Critical 聚好看科技股份有限公司
Priority to CN202280017569.1A priority Critical patent/CN117501700A/zh
Publication of WO2022206392A1 publication Critical patent/WO2022206392A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4825End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • an online list of display devices is displayed, wherein the display device controls in the online list are marked as one of an on state, a standby state or an off state, the on state representing the corresponding display device
  • the main processor provided with the operating system is in the activated state
  • the standby state represents the state in which the main processor of the corresponding display device is in the non-activated state but the sub-processor is in the activated state
  • the corresponding display device is in the activated state.
  • the main processor is in the inactive state and the sub-processor is in the inactive state;
  • FIG. 10 shows a signaling diagram of an application wake-up method of a display device according to some embodiments
  • FIG. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG. 1 , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control device 100 .
  • the communication interface 130 is used for external communication, including at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
  • display device 200 includes tuner 210, communicator 220, detector 230, external device interface 240, controller 250, display 260, audio output interface 270, memory, power supply, user interface at least one.
  • communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.
  • the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver.
  • the display device 200 may establish transmission and reception of control signals and data signals with the control apparatus 100 or the server 400 through the communicator 220.
  • the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait.
  • a CPU processor may include a main processor and a sub-processor.
  • the main processor and sub-processor can be packaged in one chip or separately.
  • the embodiment shown in FIG. 3B is an embodiment in which the main processor and the sub-processor are packaged separately.
  • the sub-processor is connected to the communicator at one end and to the main processor at the other end.
  • the sub-processor obtains an instruction from the server through the communicator, and wakes up the main processor according to the instruction.
  • the communicator may be connected to both the main processor and the sub-processor.
  • the user may input user commands on a graphical user interface (GUI) displayed on the display 260, and the user interface receives the user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and the user interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the system of the display device may include a kernel (Kernel), a command parser (shell), a file system and an application program.
  • kernel Kernel
  • shell command parser
  • file system an application program.
  • the kernel, shell, and file system make up the basic operating system structures that allow users to manage files, run programs, and use the system.
  • the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC).
  • IPC inter-process communication
  • the shell and user applications are loaded.
  • An application is compiled into machine code after startup, forming a process.
  • the application framework layer in the embodiment of the present application includes managers (Managers), content providers (Content Provider), etc., wherein the manager includes at least one of the following modules: an activity manager (Activity Manager) uses Interacts with all activities running in the system; Location Manager is used to provide system services or applications with access to system location services; Package Manager is used to retrieve files currently installed on the device Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers on the user interface and desktop widgets.
  • an activity manager uses Interacts with all activities running in the system
  • Location Manager is used to provide system services or applications with access to system location services
  • Package Manager is used to retrieve files currently installed on the device Various information related to the application package
  • Notification Manager Notification Manager
  • Window Manager Window Manager
  • the activity manager is used to manage the life cycle of the various applications and general navigation rollback functions, such as controlling the exit, opening, rollback, etc. of the application.
  • the window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (such as reducing the display window, shaking display, distorting display, etc.), etc.
  • the display device can directly enter a preset VOD program interface after startup.
  • the VOD program interface can be as shown in FIG. 5 , including at least a navigation bar 510 and a content display area located below the navigation bar 510 , the content displayed in the content display area will change with the selected control in the navigation bar.
  • the program in the application layer can be integrated in the video-on-demand program to be displayed through a control in the navigation bar, or it can be further displayed after the application control in the navigation bar is selected.
  • the display device after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video-on-demand program, and can also be an HDMI interface, a live TV interface At least one of etc., after the user selects different signal sources, the display can display the content obtained from the different signal sources.
  • the TV device has a first module that is permanently connected to the server, and a second module that is in a standby state. After the first module receives a remote wake-up command, the second module is activated to realize power-on wake-up.
  • standby means that the display device is in a power supply state, but the second module corresponding to the desktop system is not running, and the backlight is in an off state.
  • the desktop system is a signal source of the display device, and the signal source of the display device can also include HDMI, AV, DTV and other signal sources.
  • the signal source of the display device may include any combination of JUUI desktop system, HDMI, AV, and DTV.
  • the main chip (main processor) of the display device is in the startup state.
  • the low-power chip (subprocessor) is not activated.
  • the main chip of the display device continuously reports the status information of the display device to the server. Specifically, the heartbeat data is uploaded, and the server determines that the display device is in a powered-on state according to the heartbeat data uploaded by the main chip.
  • the main chip is an implementation form of the main processor
  • the low-power chip is an implementation form of the sub-processor.
  • the main processor and sub-processor may be packaged in the same chip.
  • the main chip of the display device is in an off state, and before entering the inactive state, the main chip triggers the low power consumption chip to enter the active state.
  • the low-power chip continuously uploads heartbeat data to the server, and the server determines that the display device is in a standby state according to the heartbeat data uploaded by the low-power chip.
  • the server generates an online list of display devices according to device status information reported by at least one display device.
  • the low-power chip is a chip that still works after the main chip is turned off when the display device is in standby.
  • the computing power and power consumption of a chip are strongly related, and a low-power chip can only be used to implement wake-up related functions.
  • the status information of the display device can be continuously reported to the server under the premise of saving energy.
  • the main chip may be a SOC chip (System-on-a-Chip, system-on-chip), and the low-power chip may be a DSP (Digital Signal Processing, digital signal processing technology) chip or an ARM CORTEX-M4 ( Embedded processor developed by the British ARM company).
  • SOC chip System-on-a-Chip, system-on-chip
  • DSP Digital Signal Processing, digital signal processing technology
  • ARM CORTEX-M4 Embedded processor developed by the British ARM company
  • the sub-processor autonomously sends the first heartbeat data to the server when the main processor is not working, and sends the heartbeat data of the main processor to the server as the second heartbeat data when the main processor is working, and this When the first heartbeat data is not sent.
  • target applications such as Xiaojujia application (audio and video communication application), Juhaohao application (audio audiovisual application), remote control application, etc.
  • Xiaojujia application audio and video communication application
  • Juhaohao application audio audiovisual application
  • remote control application etc.
  • target applications such as Xiaojujia application (audio and video communication application), Juhaohao application (audio audiovisual application), remote control application, etc.
  • a page data request ie, a status query request
  • the server feeds back the display device online list to the mobile terminal according to the page data request.
  • the target application is an application executed within the operating desktop system.
  • the desktop system is a system program or a preset desktop application of the TV itself as one of the signal sources.
  • the signal source When it is a desktop system, the system program will be executed on the machine, and the target application is a program installed in the application layer, which can be opened, installed, uninstalled, updated, etc. at least one through the program management interface in the desktop system. If you only start the default desktop system of the TV and do not start the target application, there will be no threads to execute the target application later.
  • the premise of starting the target application is that the system program has the conditions to start other applications in the system program.
  • the low-power chip when the display device B is in standby, continuously reports the status information of the display device A to the server through the Internet, and the reported data can carry a label representing the standby of the display device. Chip-consuming label. Through this tag, the server can determine that the display device B is in the standby state.
  • the display device D continuously reports the status information of the display device A to the server through the low-power chip regardless of whether the display device is turned on or in standby.
  • the label of the device being powered on may be a label of the working state of the main chip determined by communicating with the main chip.
  • the server generates an online list of display devices according to the status information reported by each display device, and feeds back the online list of display devices to the mobile terminal.
  • the display device online list is displayed on the target application page of the mobile terminal.
  • a schematic diagram of a user interface of a mobile terminal is shown in FIG. 7 . If the display device A is in the online state (power-on state), the online state indicator will be displayed. If the display device B is in the standby state, the standby state indicator is displayed. If it is displayed that the device C is in an offline state (off state), a shutdown state indicator is displayed, or an offline status indicator is displayed.
  • the online list of display devices may include all display devices that have been authorized to be accessed by the current account, that is, including display devices in the above three states.
  • the display device online list can also only contain display devices that are online and standby.
  • the display device online list can also contain only display devices that are in the standby state. Therefore, on the one hand, page resources are saved, and on the other hand, it is convenient for the user to select a display device that can be woken up remotely.
  • a wake-up command can be sent to the display device through the mobile terminal to wake up the display device, without the need to send short-range communication with other devices that can be remotely controlled in the same space as the TV, such as smart speakers (exemplarily, infrared communication) to wake up the television.
  • smart speakers exemplarily, infrared communication
  • the status information reported by the display device to the server is in the form of a heartbeat data packet.
  • the display device periodically sends heartbeat data packets to the server, and the server determines that the display device is in an online state or a standby state. If the server does not receive the heartbeat data packet sent by the display device after a preset time threshold, for example, more than one minute, it is determined that the display device is in an offline state.
  • the server feeds back the updated online list of display devices to the mobile terminal, and the mobile terminal changes the status identifier of the display device to the offline status identifier on the user interface. In this case, the user may suddenly unplug the power cord of the display device, causing the display device to enter the offline state from the standby state.
  • the user after viewing the online list of display devices on the target application interface of the mobile terminal, the user can select the display device to be connected.
  • the mobile terminal generates a connection request according to the user's selection, and sends the connection request to the server.
  • the generated connection request carries the device information of the selected display device.
  • the communicator of the display device receives and sends the first wake-up command to the host chip.
  • the main chip starts the target application in response to the identification of the target application in the first wake-up command.
  • the first wake-up instruction when the display device is in a powered-on state, may be an instruction to activate the target application.
  • a second connection request is sent to the server.
  • the second connection request carries the device information of the display device.
  • the server searches for the corresponding display device according to the device information.
  • the server further generates a second wake-up instruction according to the device state of the display device, and sends the second wake-up instruction to the corresponding display device. Since the display device is in the standby state, the second wake-up instruction is not only used to start the target application, but also used to control the display device to enter the power-on state from the standby state.
  • the processor of the display device firstly controls the display device to enter the power-on state from the standby state according to the second wake-up command, and then controls the target application to start according to the second control wake-up command.
  • the first connection request and the second connection request may be the same, and exemplarily includes device ID information of the display device, but does not include device status information of the display device. Since the server stores the device status information of each display device, when the server receives the connection request, it can search for the device status information corresponding to the device ID information in the stored device status information according to the device ID information. For example, the first connection request carries the device ID information of the display device A.
  • the server After the server receives the first connection request, according to the device ID information of the display device A, it finds that the device state information of the display device A is the power-on state.
  • the server may generate a corresponding first wake-up instruction for the power-on state according to the device state information.
  • the server When the device state of A is the standby state, the server may generate a corresponding second wake-up instruction for the standby state according to the device state information.
  • the device state information may include one of a power-on state identifier and a standby state identifier.
  • the first connection request and the second connection request in the embodiments of the present application may also be different. information and/or device status information.
  • the server obtains the connection request, it does not need to search for the corresponding device status information according to the device ID information.
  • the second connection request carries the device state information of the display device B as the standby state, and the server may generate a corresponding second wake-up instruction for the standby state according to the device state information.
  • the first connection request and the second connection request may be different.
  • the first connection request also includes information for representing only the startup The first string of the target application.
  • the second request includes a second character string representing that the target application needs to be turned on and started.
  • the second wake-up instruction may include a power-on instruction and a first wake-up instruction (target application startup instruction).
  • the processor controls the display device to enter the power-on state from the standby state (ie, starts the software system) according to the power-on instruction, and then controls the target application to start according to the target application instruction.
  • the main chip of the display device if the display device selected by the user on the target application interface of the mobile terminal is turned on, the main chip of the display device is turned on.
  • the server directly sends the first wake-up command to the main chip, and the first wake-up command is the target application startup command.
  • the main chip controls the target application to start according to the target application start instruction.
  • the connection request (the first connection request and/or the second connection request) further includes a session request identifier, and the session request identifier is used for the server to establish the display device ID and mobile Session connection between terminal IDs.
  • the state of the display device in the list displayed on the mobile terminal may be marked as one of an online state (first state), a standby state (second state), and an off state (third state).
  • the first processor is activated in the online state of the display device, the first processor is not activated in the standby state, and neither the first processor nor the second processor is activated in the shutdown state.
  • the mobile terminal receives the operation instruction input by the user, determines the state of the display device, and sends a connection request that does not include the state of the display device to the server when the display device is in the on or standby state, and when the display device is in the off state to display a message indicating that the connection is not possible.
  • the server after receiving the connection request, when the connection request does not carry the display device state identifier, the server queries the state of the display device according to the display device ID in the connection request, and the state of the display device is stored in the server according to the display device ID.
  • the relationship between the display device ID and the display state is established by the heartbeat connection.
  • the server determines the state of the display device according to the display device state identifier carried in the connection request.
  • the server generates a wake-up instruction according to the ID of the display device and the state of the display device, and when the state of the display device is in the standby state, generates a wake-up instruction including a power-on instruction and an instruction to start the target application, and the state of the display device is In the power-on state, a wake-up command including a start target application command but not a power-on command is generated. And send the generated wake-up command to a display device.
  • the server feeds back a message that the display device cannot respond to the mobile terminal.
  • the server determines whether to create a virtual session room according to the session request identifier and the state of the display device.
  • a virtual room is created for the session between the display device and the mobile terminal according to the display device identification and the mobile terminal identification, and a waiting instruction is fed back to the mobile terminal, so that the mobile terminal responds with the Waiting to display the session waiting interface.
  • the server when the state of the display device is the off state, the server does not create a virtual room according to the display device identification and the mobile terminal identification session, and feeds back a prompt message that the display device cannot be accessed to the mobile terminal.
  • the non-access prompt message may be different from the non-response message, or may be the same.
  • the server after the server creates the session virtual room, it sends an instruction to access the session to the display device, so that the display device joins the audio and video session.
  • the instruction to access the session is delivered to the mobile terminal as a part of the wake-up instruction, and the mobile terminal receives and caches the instruction to access the session.
  • the preset audio and video communication application After the preset audio and video communication application is started, it is the preset audio and video communication application. Respond to the instruction to join the session to join the session, or display prompt information.
  • the instruction to access the session is not issued to the mobile terminal together with the wake-up instruction.
  • the display device After the display device starts the preset audio and video communication application, it sends to the server an identifier indicating that the application has been started, and receives a response from the server with all Describes an instruction characterizing the application to initiate a completed access session with the identity feedback.
  • the server may not set up a virtual room, but only reserve an access port with the mobile terminal and the display device.
  • the display device uploads the audio and video data to the designated port, and the server corresponds the audio and video data uploaded by the display device to the unique identifier of the display device.
  • Storage the mobile terminal polls the specified window according to the unique identifier of the display device and obtains the uploaded impression data.
  • the server sends a wake-up instruction to the display device after setting the virtual session room, where the wake-up instruction further includes a room identifier of the virtual session room.
  • the display device After the display device starts the target application, it joins the virtual session room according to the room identifier to establish an audio and video session.
  • the main chip of the display device is in the inactive state, and the low-power consumption chip is in the active state.
  • the server sends a second wake-up command to the display device, and the communicator of the display device receives and sends the second wake-up command to the low-power chip, wherein the second wake-up command includes a boot command and a target application boot command.
  • the low-power chip firstly controls the main chip to enter the activated state from the unbooted state according to the booting command, and simultaneously caches the target application booting command. After the main chip enters the starting state from the unstarted state, the state result is fed back to the low-power chip.
  • the low-power chip After receiving the state result of the main chip as the startup state, the low-power chip sends the target application startup instruction in the second wake-up instruction to the main chip. Finally, the main chip controls the target application to start according to the target application start instruction. It should be noted that, after the process of sending the target application start-up command to the main chip is completed, the low-power chip can maintain the start-up state. In order to reduce resource occupation, after receiving the target application open command, the main chip can send a shutdown command to the low-power chip, so that the low-power chip can enter the non-activated state from the activated state according to the shutdown command.
  • the low-power chip can send a level signal to a designated interface/pin of the main chip in response to the power-on command to wake up the startup of the main chip.
  • the low-power chip can also cache the session request instruction, and can send the target application start instruction and the cached session request instruction to the main chip after the main chip is started, and the main frequency chip first responds to the target application start instruction to start The target application, after the target application is started, causes the target application to respond to the session request instruction.
  • the session request instruction may also be sent to the main chip after receiving the message that the target application has been started up fed back by the main chip, so that the main chip controls the target application to respond to the session request instruction.
  • the target application opening instruction further carries peer invitation information corresponding to the mobile terminal. After the target application is opened, the peer invitation information is received, and the peer invitation information is parsed, so as to establish a connection between the target application of the mobile terminal and the target application of the display device.
  • a reminder message is displayed on the display of the display device, and the reminder message is used to make the display device remind the user whether to accept the session request.
  • the display device feeds back a rejection sign to the server, so that the server feeds back to the mobile terminal a message that the display device does not join the audio and video session, and after receiving the operation instruction received by the user, the display device Feedback the identity of the consent to the server to establish a session connection.
  • the target application of the display device automatically responds with the session request instruction to automatically establish the session connection.
  • the server when the server receives a connection request including a session request identifier, the server performs session authentication to determine whether a session can be automatically established according to the unique identifier of the display device and the unique identifier of the mobile terminal.
  • the server In the relationship between the server side and the storage, the mobile terminal Only when the unique identifier is authorized by the unique identifier of the display device, the virtual session room is established, and the subsequent process is performed. If not authorized, the virtual room is not established, and information is fed back to the mobile terminal to remind the mobile terminal that the display device is not authorized.
  • secondary authentication may be performed for the unique identifier of the display device and the unique identifier of the mobile terminal to determine whether a session can be automatically established.
  • a router is provided between the display device and the server.
  • Device information includes the IP address of the display device, the router port number used by the display device, and the MAC address of the display device.
  • the server sends a wake-up packet (which can be a Magic Packet unicast packet) to the corresponding router according to the IP address of the display device and the router port number contained in the connection request.
  • the router After the router receives the wake-up data packet, it identifies the wake-up data packet as a directed broadcast packet.
  • the router broadcasts this broadcast packet to all ports, and the broadcast packet contains the MAC address of the display device.
  • the target application of the display device is awakened.
  • the display devices of other MAC addresses connected to the router directly abandon the data packet.
  • the target application is the Xiaoju Home application
  • the display device that needs to be connected is selected on the Xiaoju Home application of the mobile terminal.
  • the selected display device can directly start Xiaoju. application at home, and establish a connection with the mobile terminal through the Xiaojujiajia application.
  • the home environment can also be monitored using the camera of the display device.
  • the interface shown in FIG. 7 can be displayed.
  • the display devices A-C will be marked with their own power-on states for intuitive display to the user.
  • the user selects the display device B in the user interface of the mobile terminal shown in Fig. 7, and in response to the user's instruction to select the control instruction of the display device B, the user interface shown in Fig. 7 enters the user interface shown in Fig. 8.
  • the user interface shown in FIG. 8 includes a monitoring screen and setting controls of the Xiaojujiajia application. At this time, the connection between the mobile terminal and the display device B has not yet been established, and the monitoring screen shown in FIG.
  • connection request is sent to the server in response to the control instruction of the user instructing to select the "go home and see” control.
  • the connection request carries the device information of the display device B.
  • the server generates a connection instruction (second wake-up instruction) according to the device information of the display device B. Since the display device B is in a standby state, the server first sends a connection instruction to the low-power consumption chip of the display device B.
  • the low-power chip parses the boot command and the target application boot command from the connection command.
  • the low-power chip first sends a power-on command to the main chip, which triggers the main chip to enter the startup state from the unstarted state.
  • the target application opening instruction is an instruction to open the Xiaoju Home application.
  • the main chip executes the business logic of opening the Xiaoju home application.
  • the target application opening instruction also includes peer invitation information sent by the mobile terminal.
  • the main chip sends the service instruction to the Xiaoju Home application, and the Xiaoju Home application parses the peer invitation information from the service instruction.
  • the peer invitation information may include device information of the mobile terminal. According to the peer invitation information, a communication connection is established between the mobile terminal and the display device B through the Xiaoju Home application.
  • the display device B After the mobile terminal establishes a communication connection with the display device B, the display device B sends the picture captured by the camera in real time to the mobile terminal. As shown in FIG. 9 , the real-time picture captured by the camera of the display device B can be viewed through the mobile terminal, so as to realize the function of remote monitoring.
  • the server if the display device A is selected, the server generates a start connection instruction (first wake-up instruction) according to the device information of the display device A. Since the display device A is in a power-on state, the server directly sends the connection instruction to the main chip of the display device A. The main chip parses out the target application opening instruction, and executes the business logic of opening the Xiaojujia application in response to the target application opening instruction.
  • the server if the display device A is selected, the server generates a start connection instruction (first wake-up instruction) according to the device information of the display device A. Since the display device A is turned on, the server directly sends the connection instruction to the low-power chip, and the low-power chip forwards the connection instruction to the main chip of the display device A.
  • the main chip parses out the target application opening instruction, and executes the business logic of opening the Xiaojujia application in response to the target application opening instruction.
  • the server if the display device A is selected, the server generates a start connection instruction (first wake-up instruction) according to the device information of the display device A. Since the display device A is turned on, the server directly sends the connection command to the low-power chip, and the low-power chip parses the target application start command, and sends the target application start command to the main chip of the display device A. The main chip executes the business logic of opening the Xiaojujia application in response to the target application opening instruction.
  • the server includes a service system and an AIOT (Artificial Intelligence Internet of Things) system, and the low-power chip and the main chip report and display device status information to the AIOT system.
  • AIOT Artificial Intelligence Internet of Things
  • the AIOT system sends the status information to the business system, and the business system encapsulates the status information and generates an online list of display devices.
  • the mobile terminal directly obtains the relevant information of the online list of the display device from the service system.
  • the server when the mobile terminal sends the same connection request when the display device is in a standby or power-on state, the server generates and sends an instruction to start the target application according to the unique identifier of the display device in the received connection request, wherein the start The instruction of the target application is used to control the main processor to start the preset application, the communicator of the display device receives the instruction to start the target application, and when the main processor starts, sends the instruction to start the target application to the The main processor, the main processor starts the target application in response to the instruction to start the target application, and when the main processor is not started, the communicator sends the instruction to start the target application to the sub-processor, the sub-processor The processor generates a startup instruction according to the instruction for starting the target application, and caches the instruction for starting the target application, and the subprocessor sends the startup instruction and the instruction for starting the target application to the main processor simultaneously or sequentially to start the main processor. processor, and make the activated main processor launch the target application.
  • the instruction to start the target application may be a call request including information such as the unique identifier of the mobile terminal, virtual room information, and a session request instruction.
  • starting the main processor means that the main processor loads an operating system (for example, any one of an Android operating system, an Apple operating system, a Hongmeng operating system, and the like).
  • the working state of the main processor refers to the running state of the operating system in the main chip.
  • Launching the target application refers to launching an application in the operating system of the main processor.
  • the embodiments of the present application provide an application wake-up method of a display device, such as a signaling diagram of the application wake-up method of a display device as shown in FIG. 10 , the method includes the following steps:
  • Step 1 The user opens the user interface of the target application on the mobile terminal, and selects a display device in the user interface of the target application.
  • the mobile terminal receives a control instruction for selecting a display device input by a user.
  • Step 2 In response to the control instruction, the mobile terminal generates a first connection request when the display device is in the power-on state, wherein the device state of the display device pointed to by the first connection request is the power-on state.
  • the mobile terminal sends the first connection request to the server, and the server generates the first wake-up instruction according to the first connection request, and sends the first wake-up instruction to the corresponding display device.
  • the processor of the display device controls the target application to start according to the first wake-up instruction.
  • Step 4 When the display device is in the standby state, generate a second connection request, wherein the device state of the display device pointed to by the second connection request is the standby state.
  • the mobile terminal sends the second connection request to the server, and the server generates a second wake-up instruction according to the second connection request, and sends the second wake-up instruction to the corresponding display device.
  • the processor of the display device controls the display device to enter the power-on state from the standby state according to the second wake-up instruction, it controls the target application to start according to the second wake-up instruction.
  • an online list of display devices is displayed on the target application user interface of the mobile terminal.
  • the display device online list is a list generated by the server according to the status information reported by at least one display device.
  • the embodiment of the present application provides another method for waking up an application of a display device.
  • the display device is connected to the network through the main chip when it is turned on, and is connected to the network through the low-power chip when it is in standby.
  • FIG. 11 a signaling diagram of an application wake-up method of a display device is shown, and the method includes the following steps:
  • Step 1 When the display device is in a powered-on state, the main chip is in an activated state, the low-power consumption chip is in an inactive state, and the main chip continues to report device status information (upload heartbeat data) to the server.
  • the main chip When the display device enters the standby state from the power-on state, the main chip enters the non-starting state from the activated state. Before the main chip enters the non-activated state from the activated state, the low-power consumption chip is triggered to enter the activated state from the non-activated state.
  • the low-power chip continuously reports device status information to the server.
  • the server generates an online list of display devices according to device status information reported by at least one display device.
  • the mobile terminal may be replaced by a display device, and the display device may be replaced by a mobile terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephone Function (AREA)
  • Power Sources (AREA)

Abstract

本申请实施例提供一种显示设备的应用唤醒方法、显示设备、移动终端及服务器,方法包括:如果显示设备处于开机状态,显示设备从服务器接收第一唤醒指令,其中第一唤醒指令为根据第一连接请求生成的指令。显示设备处理器根据第一唤醒指令控制目标应用开启。如果显示设备处于开机状态,显示设备从服务器接收第二唤醒指令,其中第二唤醒指令为根据第二连接请求生成的指令。显示设备的处理器根据第二唤醒指令控制显示设备从待机状态进入开机状态之后,再根据第二唤醒指令控制目标应用开启。

Description

应用唤醒方法、显示设备、移动终端及服务器
相关申请的交叉引用
本申请要求在2021年03月30日提交、申请号为202110342826.6的中国专利申请、在2021年05月27日提交、申请号为202110586578.X的中国专利申请、以及在2021年05月27日提交、申请号为202110583580.1的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示设备技术,尤其涉及一种应用唤醒方法、显示设备、移动终端及服务器。
背景技术
相关技术中的电视通常设置有按键和遥控接收组件,电视通过接收用户的按键操作,或者通过遥控接收组件接收遥控器的开机按键键值来控制电视的启动,电视启动后一般直接进入预定好的系统程序中。
发明内容
本申请实施例提供一种移动终端,包括:通信接口,所述通信接口用于所述处理器和服务器的通信;处理器,所述处理器用于:
响应与接收到的操作,显示显示设备的在线列表,其中,所述在线列表中的显示设备控件被标记为开机状态,待机状态或关机状态中的一种,所述开机状态表征对应的显示设备的设置有操作系统的主处理器处于启动状态的状态,所述待机状态表征对应的显示设备的所述主处理器处于未启动状态但子处理器处于启动状态的状态,所述应的显示设备的所述主处理器处于未启动状态且子处理器处于未启动状态的状态;
接收对所述在线列表中的第一显示设备控件的操作;
在所述第一显示设备控件被标记为开机状态或待机状态时,发送连接请求给所述服务器,其中,所述连接请求包含对应所述第一显示设备控件的第一显示设备的第一显示设备标识,所述连接请求被用于启动所述第一显示设备中的目标应用,并通过所述目标应用建立通话连接;
在所述第一显示设备控件被标记为关机键状态时,显示表征所述第一显示设备不可连接的提示信息。
本申请实施例提供一种服务器,包括存储器和处理器,所述处理器用于:
接收移动终端发送的连接请求,其中,所述连接请求中包含对应所述第一显示设备控件的第一显示设备的第一显示设备标识;
响应与所述连接请求,建立虚拟会话房间,并反馈表征等待接通的消息给所述移动终端;
发送唤醒指令给所述第一显示设备,其中所述唤醒指令包括对应所述虚拟会话房间的房间标识,所述唤醒指令用于使所述第一显示设备启动目标应用,并使所述第一显示设备中的所述目标应用根据所述房间标识建立会话连接。
本申请实施例提供一种显示设备,包括:
显示器;
通信器,所述通信器用于:接收唤醒指令,在所述显示设备的主处理器处于启动状态时,将所述唤醒指令发送给所述主处理器,在所述显示设备的主处理器处于未启动状态且所述子处理器处于启动状态时,将所述唤醒指令发送给所述子处理器,其中,所述唤醒指令包括启动目标应用的指令;
所述主处理器,所述主处理器被配置为:在接收到所述唤醒指令后,启动对应所述启动目标应用的指令的目标应用;
所述子处理器,所述子处理器被配置为:在接收到所述唤醒指令后,控制所述主处理器启动,并将所述启动目标应用的指令发送给所述主处理器。
本申请实施例提供一种应用唤醒方法,所述方法包括:
接收移动终端发送的连接请求,其中,所述连接请求中包含对应所述第一显示设备控件的第一显示设备的第一显示设备标识;
在确定所述第一显示设备为开机状态时,发送第一唤醒指令给所述第一显示设备,其中,所述第一唤醒指令包括启动目标应用的指令,所述启动目标应用的指令用于使所述第一显示设备中的主处理器启动目标应用;
在确定所述第一显示设备为待机状态时,发送第二唤醒指令给所述第一显示设备,其中,所述第二唤醒指令包括开机指令、启动目标应用的指令,所述开机指令用于使所述第一显示设备中的子处理器控制所述第一显示设备中的主处理器启动,所述启动目标应用的指令用于使所述第一显示设备中的主处理器启动目标应用。
附图说明
图1示出了根据一些实施例的显示设备的使用场景;
图2示出了根据一些实施例的控制装置的硬件配置框图;
图3A示出了根据一些实施例的显示设备的硬件配置框图;
图3B示出了根据一些实施例的显示设备的硬件配置框图;
图4示出了根据一些实施例的显示设备中软件配置图;
图5示出了根据一些实施例的显示设备中应用程序的图标控件界面显示图;
图6示出了根据一些实施例的显示设备的远程唤醒系统示意图;
图7示出了根据一些实施例中移动终端中的用户界面示意图;
图8示出了根据一些实施例中又一种移动终端中的用户界面示意图;
图9示出了根据一些实施例中又一种移动终端中的用户界面示意图;
图10示出了根据一些实施例的显示设备的应用唤醒方法信令图;
图11示出了根据一些实施例的又一种显示设备的应用唤醒方法信令图。
具体实施方式
为使本申请的目的和实施方式更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施方式进行清楚、完整地描述,显然,描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体,而不必然意味着限定特定的顺序或先后次序, 除非另外注明。应该理解这样使用的用语在适当情况下可以互换。
图1为根据实施例中显示设备的使用场景的示意图。如图1所示,显示设备200还与服务器400进行数据通信,用户可通过智能设备300或控制装置100操作显示设备200。
在一些实施例中,控制装置100可以是遥控器,遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信,及其他短距离通信方式中的至少一种,通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等至少一种输入用户指令,来控制显示设备200。
在一些实施例中,智能设备300可以包括移动终端300A、平板电脑、计算机、笔记本电脑,AR/VR设备等中的任意一种。
在一些实施例中,也可以使用智能设备300以控制显示设备200。例如,使用在智能设备上运行的应用程序控制显示设备200。
在一些实施例中,也可以使用智能设备300和显示设备进行数据的通信。
在一些实施例中,显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制,例如,可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制,也可以通过显示设备200设备外部设置的语音控制装置来接收用户的语音指令控制。
在一些实施例中,一个步骤执行主体执行的软件步骤可以随需求迁移到与之进行数据通信的另一步骤执行主体上进行执行。示例性的,服务器执行的软件步骤可以随需求迁移到与之数据通信的显示设备上执行,反之亦然。
图2示例性示出了根据示例性实施例中控制装置100的配置框图。如图2所示,控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起用用户与显示设备200之间交互中介作用。
在一些实施例中,通信接口130用于和外部通信,包含WIFI芯片,蓝牙模块,NFC或可替代模块中的至少一种。
在一些实施例中,用户输入/输出接口140包含麦克风,触摸板,传感器,按键或可替代模块中的至少一种。
图3A示出了根据示例性实施例中显示设备200的硬件配置框图。
在一些实施例中,显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户接口中的至少一种。
在一些实施例中,显示器260包括用于呈现画面的显示屏组件,以及驱动图像显示的驱动组件,用于接收源自控制器输出的图像信号,进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。
在一些实施例中,显示器260可为液晶显示器、OLED显示器、以及投影显示器中的至少一种,还可以为一种投影装置和投影屏幕。
在一些实施例中,通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如:通信器可以包括Wifi模块,蓝牙模块,有线以太网模块等其他网络通信协议芯片或近场通信协议芯片,以及红外接收器中的至少一种。显示设备 200可以通过通信器220与控制装置100或服务器400建立控制信号和数据信号的发送和接收。
在一些实施例中,检测器230用于采集外部环境或与外部交互的信号。例如,检测器230包括光接收器,用于采集环境光线强度的传感器;或者,检测器230包括图像采集器,如摄像头,可以用于采集外部环境场景、用户的属性或用户交互手势,再或者,检测器230包括声音采集器,如麦克风等,用于接收外部声音。
在一些实施例中,外部装置接口240可以包括但不限于如下:高清多媒体接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。
在一些实施例中,控制器250和调谐解调器210可以位于不同的分体设备中,即调谐解调器210也可在控制器250所在的主体设备的外置设备中,如外置机顶盒等。
在一些实施例中,控制器250,通过存储在存储器上中各种软件控制程序,来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器260上显示UI对象的用户命令,控制器250便可以执行与由用户命令选择的对象有关的操作。
CPU处理器。用于执行存储在存储器中操作系统和应用程序指令,以及根据接收外部输入的各种交互指令,来执行各种应用程序、数据和内容,以便最终显示和播放各种音视频内容。CPU处理器,可以包括多个处理器。
在一些实施例中,CPU处理器可以包括一个主处理器和一个子处理器。主处理器和子处理器可以封装在一个芯片中,也可以单独封装。如图3B所示的实施例,为主处理器和子处理器单独封装的实施例。在单独封装的实施例中,子处理器一端与通信器连接,一端与主处理器连接。显示设备被配置为待机状态时,子处理器通过通信器从服务器获取指令,并根据该指令唤醒主处理器。
在一些实施例中,通信器可以同时和主处理器和子处理器连接。
在一些实施例中,用户可在显示器260上显示的图形用户界面(GUI)输入用户命令,则用户接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户接口通过传感器识别出声音或手势,来接收用户输入命令。
在一些实施例中,用户接口280,为可用于接收输入的接口(如:显示设备本体上的实体按键,或其他等)。
在一些实施例中,显示设备的系统可以包括内核(Kernel)、命令解析器(shell)、文件系统和应用程序。内核、shell和文件系统一起组成了基本的操作系统结构,它们让用户可以管理文件、运行程序并使用系统。上电后,内核启动,激活内核空间,抽象硬件、初始化硬件参数等,运行并维护虚拟内存、调度器、信号及进程间通信(IPC)。内核启动后,再加载Shell和用户应用程序。应用程序在启动后被编译成机器码,形成一个进程。
参见图4,在一些实施例中,将系统分为四层,从上至下分别为应用程序(Applications)层(简称“应用层”),应用程序框架(Application Framework)层(简称“框架层”),安卓运行时(Android runtime)和系统库层(简称“系统运行库层”),以及内 核层。
如图4所示,本申请实施例中应用程序框架层包括管理器(Managers),内容提供者(Content Provider)等,其中管理器包括以下模块中的至少一个:活动管理器(Activity Manager)用与和系统中正在运行的所有活动进行交互;位置管理器(Location Manager)用于给系统服务或应用提供了系统位置服务的访问;文件包管理器(Package Manager)用于检索当前安装在设备上的应用程序包相关的各种信息;通知管理器(Notification Manager)用于控制通知消息的显示和清除;窗口管理器(Window Manager)用于管理用户界面上的括图标、窗口、工具栏、壁纸和桌面部件。
在一些实施例中,活动管理器用于管理各个应用程序的生命周期以及通常的导航回退功能,比如控制应用程序的退出、打开、后退等。窗口管理器用于管理所有的窗口程序,比如获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕,控制显示窗口变化(例如将显示窗口缩小显示、抖动显示、扭曲变形显示等)等。
在一些实施例中,系统运行库层为上层即框架层提供支撑,当框架层被使用时,安卓操作系统会运行系统运行库层中包含的C/C++库以实现框架层要实现的功能。
在一些实施例中,内核层是硬件和软件之间的层。如图4所示,内核层至少包含以下驱动中的至少一种:音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器,温度传感器,压力传感器等)、以及电源驱动等。
在一些实施例中,显示设备启动后可以直接进入预置的视频点播程序的界面,视频点播程序的界面可以如图5中所示,至少包括导航栏510和位于导航栏510下方的内容显示区,内容显示区中显示的内容会随导航栏中被选中控件的变化而变化。应用程序层中的程序可以被集成在视频点播程序中通过导航栏的一个控件进行展示,也可以在导航栏中的应用控件被选中后进行进一步显示。
在一些实施例中,显示设备启动后可以直接进入上次选择的信号源的显示界面,或者信号源选择界面,其中信号源可以是预置的视频点播程序,还可以是HDMI接口,直播电视接口等中的至少一种,用户选择不同的信号源后,显示器可以显示从不同信号源获得的内容。
在一些实施例中,用户可以通过遥控器,远场语音等在近距离内唤醒显示设备。在一些实施,例中用户和显示设备具有一定距离,无法通过遥控器或远场语音进行显示设备的唤醒,因此可以为显示设备配备远程唤醒功能。在一些实施例中,远程唤醒是由网卡配合其他软硬件,通过给处于待唤醒状态(休眠状态/待机状态)的显示设备发送特定的数据包,以使待唤醒的显示设备从待唤醒状态进入启动状态的过程。
相关的唤醒功能中,电视设备具备一个和服务器长连的第一模块,以及处于待机状态的第二模块,第一模块在接收到远程唤醒指令后,使第二模块启动以实现开机唤醒。
在一些实施例中,相关技术中的唤醒包括,第二模块重新启动系统,以使系统呈现默认首页。在一些实施例中,第二模块根据缓存的STR数据启动,以使系统呈现待机前的页面。
在一些实施例中,待机是指显示设备处于供电状态,但是桌面系统对应的第二模块未运行,且背光处于关闭状态。桌面系统是显示设备的一个信号源,显示设备的信 号源还可以包括HDMI,AV,DTV等信号源。示例性的,显示设备的信号源可以包括:JUUI桌面系统,HDMI,AV,DTV中的任意组合。
然而,目前的远程唤醒仅能实现远程唤醒处于待机状态的智能电视使其启动默认/预存的信号源,不能够直接远程唤醒智能电视上的应用,用户需要等待显示设备启动上述信号源后,用户再次通过远程控制指令,来使启动后的设备启动指令对应的应用。造成用户的使用体验较差。
考虑上述问题,如图6所示,本申请提供一种远程唤醒系统,该远程唤醒系统包括至少一个显示设备200、服务器400以及至少一个移动终端300A(图中只示出一个移动终端)。
基于上述远程唤醒系统,远程唤醒的具体过程为:
如果用户开启系统中的某一显示设备(可以是通过遥控器以普通模式开启显示设备)后,显示设备的主芯片(主处理器)为启动状态。低功耗芯片(子处理器)为未启动状态。在此种状态下,该显示设备的主芯片持续向服务器上报该显示设备的状态信息。具体的,上传心跳数据,服务器根据主芯片上传的心跳数据,确定显示设备处于开机状态。在一些实施例中,主芯片是主处理器的一种实现形态,低功耗芯片是子处理器的一种实现形态。在一些实施例中,主处理器和子处理器可以封装在同一芯片中。
如果用户关闭系统中的某一显示设备(可以是通过遥控器关闭显示设备,使得显示设备处于待机状态)后。显示设备的主芯片为关闭未启动状态,主芯片在进入未启动状态之前,触发低功耗芯片进入启动状态。在此种状态下,低功耗芯片持续向服务器上传心跳数据,服务器根据低功耗芯片上传的心跳数据,确定显示设备处于待机状态。服务器根据至少一个显示设备上报的设备状态信息,生成显示设备在线列表。
在一些实施例中,低功耗芯片是显示设备待机时,主芯片关闭后,仍然工作的芯片。芯片的计算能力和功耗是强相关的,低功耗芯片可以是仅仅用于实现唤醒相关功能。通过设置低功耗芯片,在节能的前提下仍然能持续的向服务器上报显示设备的状态信息。
在一些实施例中,主芯片可以为SOC芯片(System-on-a-Chip,系统级芯片),低功耗芯片可以为DSP(Digital Signal Processing,数字信号处理技术)芯片或者ARM CORTEX-M4(英国ARM公司开发的嵌入式处理器)。
在一些实施例中的,低功耗芯片可以是集成在主芯片上的,也可以是和主芯片为分离状态,本申请实施例不作限定。
在一些实施例中,主处理器中具有和通信器进行通信的功能单元,因此可以在主处理器启动时可以关闭子处理器。通信器在主处理器启动的时候将信号传递给主处理器,在子处理器启动的时候将信号传递给子处理器。主处理器和子处理器在工作时,向服务器发送不同的心跳数据,以使得服务器确认显示设备处于开机状态还是待机状态。在一些实施例中,不同的心跳数据,可以是心跳数据的特征不同,还可以是心跳数据携带有不同的表征标识。
在一些实施例中,主处理器不包含和通信器进行通信的功能单元,此时在处理器启动时需要维持子处理器的开启。主处理器的通信必须要经过子处理器才能从通信器发出,信号的接收也要通过子处理器。
在一些实施例中,子处理器可以根据主处理器的开关状态发送不同的心跳数据。
在一些实施例中,子处理器在主处理器不工作时,自主向服务器发送第一心跳数据,在主处理器工作时,将主处理器的心跳数据作为第二心跳数据发送给服务器且此时不发送第一心跳数据。
在一些实施例中,在移动终端上安装有目标应用,例如小聚在家应用(音视频通信应用)、聚好看应用(影音视听应用)、远程控制应用等。以音视频通信应用为例,用户在移动终端上打开目标应用后,向服务器发送页面数据请求(即状态查询请求),服务器根据该页面数据请求向移动终端反馈显示设备在线列表。
需要说明的是,移动终端的目标应用是指安装在移动终端上的目标应用的移动终端版本,显示设备的目标应用时只安装在显示设备上的目标应用的显示设备版本。示例性的,手机端安装的聚好看应用和电视端安装的聚好看应用是聚好看应用为不同终端制作的不同的版本。
在一些实施例中,目标应用是在操作桌面系统内执行的应用,示例性的,桌面系统是电视本身的作为信号源之一的系统程序或预置桌面应用,只要用户启动电视,在信号源为桌面系统时,系统程序便会在机器上执行,目标应用是一个安装在应用层的程序,可以通过桌面系统中的程序管理界面进行打开,安装,卸载,更新等中的至少一个。如果仅启动电视默认的桌面系统不启动目标应用,后来便不会有线程来执行目标应用,启动目标应用的前提是系统程序以具备启动系统程序内的其他应用的条件,对于芯片来讲,芯片的启动过程就是加载系统程序的过程。桌面系统之所以随开机启动,是因为桌面程序时显示设备的信号源的一种。示例新的,桌面系统可以是LINUX系统或Android系统本身,其作为一个信号源。也可以是在LINUX系统或Android系统上预置的定制化应用,示例性的、聚好看桌面应用作为一个信号源。目标应用是一个通过桌面系统中的程序管理界面进行打开/安装/卸载/更新一个应用,示例性的,小聚在家应用。
在一些实施例中,移动终端通过打开该目标应用,用户可以查看显示设备在线列表。该在线列表中至少包括一个显示设备的控件。该显示设备在线列表中包含已经授权给当前账号(当前移动终端登录目标应用的账号)可以访问的显示设备(实现建立关联关系的显示设备)。在显示设备在线列表中,根据不同显示设备的状态,呈现对应的状态标识。在一些实施例中,展示显示设备在线列表之前,服务器需要进行授权的鉴定过程。
在一些实施例中,显示设备A为开机时主芯片通过联网持续向服务器上报显示设备A的状态信息,在上报的数据中,可以携带表征显示设备开机的标签,示例性的、主芯片的标签。通过该标签,服务器可以判断显示设备A为开机状态。
在一些实施例中,显示设备B为待机时低功耗芯片通过联网持续向服务器上报显示设备A的状态信息,在上报的数据中,可以携带表征显示设备待机的标签,示例性的、低功耗芯片的标签。通过该标签,服务器可以判断显示设备B为待机状态。
在一些实施例中,显示设备C为关机状态(完全断电状态),因此服务器不能接收到显示设备C上报的状态信息,服务器可以判断显示设备C为关机状态。
在一些实施例中,显示设备D,为无论开机或待机均通过低功耗芯片持续向服务器上报显示设备A的状态信息,在上报的数据中,可以携带包含表征显示设备待机的 标签或者表征显示设备开机的标签,示例性的,可以是通过和主芯片通信确定的主芯片工作状态的标签。
服务器根据各个显示设备上报的状态信息,生成显示设备在线列表,并将显示设备在线列表反馈至移动终端。同时在移动终端的目标应用页面上显示显示设备在线列表。如图7所示的移动终端的用户界面示意图。显示设备A为在线状态(开机状态),则显示在线状态标识。显示设备B为待机状态,则显示待机状态标识。显示设备C为离线状态(关机状态),则显示关机状态标识,或者显示离线状态标识。
显示设备在线列表可以包含所有已经授权给当前账号可以访问的显示设备,即包含处于上述三种状态中的显示设备。显示设备在线列表也可以只包含处于在线状态和待机状态的显示设备。显示设备在线列表还可以只包含处于待机状态的显示设备。从而一方面节省页面资源,另一方面方便用户选取可以远程唤醒的显示设备。
在一些实施例中,只有显示设备可以联网时,才能通过移动终端发送唤醒指令给显示设备进行唤醒,而不必借助智能音箱等其他和电视处于同一空间的可近距离遥控的其他设备发送近距离通信(示例性的,红外通信)的指令给电视进行唤醒。
在一些实施例中,显示设备向服务器上报的状态信息为心跳数据包的形式。显示设备周期性向服务器发送心跳数据包,服务器才判断该显示设备为在线状态或者待机状态。如果超过预设时间阈值,例如超过一分钟,服务器未接收到显示设备发送的心跳数据包,则判断显示设备为离线状态。服务器将更新的显示设备在线列表反馈至移动终端,移动终端在用户界面上将该显示设备的状态标识更改为离线状态标识。这种情况可能是用户突然拔掉显示设备的电源线,使得显示设备从待机状态进入离线状态。
在一些实施例中,用户在移动终端的目标应用界面上查看到显示设备在线列表后,可以选择需要连接的显示设备。移动终端根据用户的选择,生成连接请求,并将该连接请求发送至服务器。生成的连接请求携带被选择的显示设备的设备信息。
在一些实施例中,响应与用户的选中操作如果用户在移动终端的目标应用界面上选择的显示设备处于开机状态,则向服务器发送第一连接请求。第一连接请求携带有该显示设备的设备信息。服务器接收到第一连接请求后,根据设备信息查找到对应的显示设备。服务器进一步根据该显示设备的设备状态生成第一唤醒指令,并将第一唤醒指令发送至对应的显示设备。由于该显示设备处于开机状态,由于第一唤醒指令仅用于开启目标应用。最后,显示设备的处理器根据第一唤醒指令控制目标应用开启。
在一些实施例中,显示设备的通信器接收并向主芯片发送该第一唤醒指令。主芯片响应与第一唤醒指令中的目标应用的标识,开启目标应用。
在一些实施例中,在显示设备处于开机状态时,第一唤醒指令可以为目标应用开启指令。
在一些实施例中,响应与用户的选中操作,如果用户在移动终端的目标应用界面上选择的显示设备处于待机状态,则向服务器发送第二连接请求。第二连接请求携带有该显示设备的设备信息。服务器接收到第二连接请求后,根据设备信息查找到对应的显示设备。服务器进一步根据该显示设备的设备状态生成唤醒第二指令,并将第二唤醒指令发送至对应的显示设备。由于该显示设备处于待机状态,则第二唤醒指令不仅用于开启目标应用,还用于控制器显示设备从待机状态进入开机状态。显示设备的处理器首先根据第二唤醒指令控制显示设备从待机状态进入开机状态,之后再根据第 二控制唤醒指令控制目标应用开启。在一些实施例中,第一连接请求和第二连接请求中可以相同,示例性的包括显示设备的设备ID信息,但不包括显示设备的设备状态信息。由于服务器中存储有各个显示设备的设备状态信息,当服务器接收到连接请求后,可以根据设备ID信息,在存储的设备状态信息中查找与设备ID信息对应的设备状态信息。例如,第一连接请求携带有显示设备A的设备ID信息。服务器接收到第一连接请求后,根据显示设备A的设备ID信息,查找到显示设备A的设备状态信息为开机状态。服务器可根据设备状态信息为开机状态生成对应的第一唤醒指令。在A的设备状态为待机状态时,服务器可根据设备状态信息为待机状态生成对应的第二唤醒指令。在一些实施例中,所述设备状态信息可以包括开机状态标识、待机状态标识中的一种。
在一些实施例中,由于移动终端可以从服务器获取到各个显示设备的设备状态信息,本申请实施例中的第一连接请求和第二连接请求中也可以不相同,示例性的,包括显示设备信息和/或设备状态信息。服务器在获取到连接请求后,不需要再根据设备ID信息查找对应的设备状态信息。例如,第二连接请求携带有显示设备B的设备状态信息为待机状态,服务器可根据设备状态信息为待机状态生成对应的第二唤醒指令。
在一些实施例中,第一连接请求和第二连接请求可以不相同,示例性的,虽然都包括显示设备的设备信息和/或目标应用标识,但第一连接请求还包含用于表征仅启动目标应用的第一字符串。第二请求则包含用于表征需要开机并启动目标应用的第二字符串。
在一些实施例中,在显示设备处于待机状态时,第二唤醒指令可以包括开机指令和第一唤醒指令(目标应用开启指令)。处理器根据开机指令控制显示设备从待机状态进入开机状态(也即启动软件系统),之后再根据目标应用指令控制目标应用开启。
在一些实施例中,如果用户在移动终端的目标应用界面上选择的显示设备处于开机状态,显示设备的主芯片处于启动状态。服务器直接向主芯片发送第一唤醒指令,第一唤醒指令为目标应用开启指令。主芯片根据目标应用开启指令控制目标应用开启。
在一些实施例中,在目标应用是音视频通信应用时,连接请求(第一连接请求和/或第二连接请求)中还包含会话请求标识,会话请求标识用于是服务器建立显示设备ID和移动终端ID之间的会话连接。
在一些实施例中,移动终端上展示的列表中显示设备的状态可以被标记为在线状态(第一状态)、待机状态(第二状态)、关机状态(第三状态)中的一种。显示设备在线状态下第一处理器启动,待机状态下第一处理器未启动,关机状态下第一处理器和第二处理器均未启动。
在一些实施例中,移动终端接收用户输入的操作指令,并判断显示设备的状态,在显示设备为开机或待机状态时发送不包含显示设备状态的连接请求给服务器,在显示设备为关机状态时,显示不可连接的提示信息。
在一些实施例中,服务器在接受到连接请求后,在连接请求不携带显示设备状态标识时,根据连接请求中的显示设备ID,查询显示设备的状态,显示设备的状态存储在服务器根据显示设备的心跳连接建立起来的显示设备ID和显示状态之间的关系中。
在一些实施例中,服务器在接受到连接请求后,根据连接请求中携带的显示设备状态标识确定显示设备的状态。
在一些实施例中,服务器根据显示设备的ID和显示设备的状态生成唤醒指令,在显示设备的状态为待机状态时,生成包含开机指令和启动目标应用指令的唤醒指令,在显示设备的状态为开机状态时,生成包含启动目标应用指令不包含开机指令的唤醒指令。并将生成的唤醒指令发送个显示设备。
在一些实施例中,服务器在显示设备的状态为关机状态时,向移动终端反馈显示设备无法响应的消息。
在一些实施例中,在目标应用是音视频应用的时候,服务器根据会话请求标识和显示设备的状态确定是否创建虚拟会话房间。
在一些实施例中,在显示设备为开机或待机状态时,根据显示设备标识和移动终端标识为显示设备和移动终端的会话创建虚拟房间,并向移动终端反馈等待指令,以使移动终端响应与等待进行显示会话等待界面。
在一些实施例中,服务器在显示设备的状态为关机状态时,不根据显示设备标识和移动终端标识会话创建虚拟房间,并向移动终端反馈显示设备无法接入的提示消息。在一些实施例中,无非接入的提示消息可以和无法响应的消息不同,也可以相同。
在一些实施例中,在服务器创建会话虚拟房间后,发送接入会话的指令给显示设备,以使显示设备加入音视频会话。
在一些实施例中,接入会话的指令作为唤醒指令的一部分下发给移动终端,移动终端接收并缓存接入会话的指令,在预设音视频通信应用启动后,是预设音视频通信应用响应所述接入会话的指令以加入会话,或者显示提示信息。
在一些实施例中,接入会话的指令不和唤醒指令一起下发给移动终端,在显示设备启动预设音视频通信应用后,向服务器发送表征应用启动完成的标识,并接收服务器响应与所述表征应用启动完成的标识反馈的接入会话的指令。
后续建立会话连接后的会话过程和关闭过程可以参照申请人之前申请的专利。
在一些实施例中,服务器可以不设置虚拟房间,仅和移动终端和显示设备预定访问端口,显示设备将音像数据上传到指定端口,服务器,将显示设备上传的音像数据和显示设备的唯一标识对应存放,移动终端根据显示设备唯一标识轮询指定窗口并获取上传的印象数据。
在一些实施例中,服务器设置虚拟会话房间后向所述显示设备发送唤醒指令,所述唤醒指令中还包含虚拟会话房间的房间标识。显示设备启动目标应用后根据房间标识加入虚拟会话房间以建立音视频会话。
在一些实施例中,如果用户在移动终端的目标应用界面上选择的显示设备处于待机状态,显示设备的主芯片处于未启动状态,而低功耗芯片处于启动状态。服务器向显示设备发送第二唤醒指令,显示设备的通信器接收并向低功耗芯片发送该第二唤醒指令,其中,第二唤醒指令中包括开机指令和目标应用开启指令。低功耗芯片首先根据开机指令控制主芯片从未启动状态进入启动状态同时缓存目标应用开启指令。主芯片在从未启动状态进入启动状态后,将状态结果反馈至低功耗芯片。低功耗芯片接收到主芯片的状态结果为启动状态后,将第二唤醒指令中的目标应用开启指令再发送至主芯片。最后主芯片根据目标应用开启指令控制目标应用开启。需要说明的是,在完成将目标应用开启指令发送至主芯片的进程后,低功耗芯片可以维持启动状态。而为了减少资源占用,主芯片在接收到目标应用开启指令后,可以向低功耗芯片发送关闭 指令,以使低功耗芯片根据关闭指令从启动状态进入未启动状态。
在一些实施例中,低功耗芯片内可以响应开机指令向主芯片的指定接口/引脚发送电平信号以唤醒主芯片的启动。
在一些实施例中,低功耗芯片还可以缓存会话请求指令,可以在主芯片启动后,将目标应用开启指令和缓存会话请求指令一起发送给主芯片,主频片先响应目标应用开启指令启动目标应用,在目标应用启动完成后,在使目标应用响应会话请求指令。在一些实施例中,还可以在接收主芯片反馈的目标应用启动完成的消息后,将会话请求指令发送给主芯片,以使主芯片控制目标应用响应会话请求指令。
在一些实施例中,目标应用开启指令还携带与移动终端对应的对端邀请信息。目标应用打开后,接收该对端邀请信息,并解析该对端邀请信息,从而实现移动终端的目标应用和显示设备的目标应用建立连接。
在一些实施例中,目标应用启动后,响应与会话请求指令,在显示设备的显示器上显示提醒信息,所述提醒信息用于使显示设备提醒用户是否接受会话请求,在接收到用户不接收的操作指令后,显示设备反馈拒绝的标识给服务器,以使所述服务器向所述移动终端反馈所述显示设备不加入所述音视频会话的消息,在接收到用户接收的操作指令后,显示设备反馈同意的标识给服务器,以建立会话连接。
在一些实施例中,显示设备的目标应用响应与会话请求指令自动响应以自动建立会话连接。
在一些实施例中,服务器在接收到包含会话请求标识的连接请求时,根据显示设备唯一标识和移动终端唯一标识进行是否可自动建立会话的会话鉴权,在服务器侧的与存储的关系中移动终端唯一标识被该显示设备唯一标识授权时,才建立虚拟会话房间,并执行后续流程。如果未被授权,则不建立虚拟房间,并反馈信息给移动终端以提醒所述移动终端未得到显示设备授权。
在一些实施例中,显示设备喜爱启动目标应用后,可以针对显示设备唯一标识和移动终端唯一标识进行是否可自动建立会话的进行二次鉴权。
在一些实施例中,显示设备和服务器之间设置有路由器。设备信息包括显示设备的IP地址、显示设备使用的路由器端口号以及显示设备的MAC地址。服务器根据连接请求中包含的显示设备的IP地址和路由器端口号,向对应的路由器发送唤醒数据包(可以是Magic Packet单播包)。路由器接收到唤醒数据包后,将该唤醒数据包识别成定向广播包。路由器将这个广播包向所有端口广播,而广播包中包含显示设备的MAC地址。与该MAC地址对应的显示设备接收到广播包后,显示设备的目标应用即被唤醒。而该路由器连接的其他MAC地址的显示设备接收到该广播包后,直接将该数据包遗弃。
示例性的,目标应用为小聚在家应用,在移动终端的小聚在家应用上选择需要建立连接的显示设备,被选择的显示设备接收到小聚在家应用的开启指令后,可直接开启小聚在家应用,并通过小聚在家应用与该移动终端建立连接。还可利用显示设备的摄像头对家庭环境进行监控。
用户在启动显示设备列表页面后可以展示如图7所示的界面,在图7所示的界面中显示设备A-C会被标记自身的开机状态,以直观的显示给用户。
用户在图7所示移动终端用户界面中选择显示设备B,响应于用户指示选择显示设 备B的控制指令,从图7所示的用户界面进入图8所示的用户界面。图8所示的用户界面包括小聚在家应用的监控画面和设置控件。此时移动终端和显示设备B还未建立连接,图8所示的监控画面中显示有“回家看看”控件,用于确认与显示设备B建立连接。
当用户选择“回家看看”控件时,响应于用户指示选择“回家看看”控件的控制指令,向服务器发送连接请求。该连接请求携带有显示设备B的设备信息。服务器根据显示设备B的设备信息,生成连接指令(第二唤醒指令)。由于显示设备B处于待机状态,服务器首先将连接指令发送至显示设备B的低功耗芯片。低功耗芯片从连接指令中解析开机指令和目标应用开启指令。低功耗芯片首先将开机指令发送至主芯片,触发主芯片从未启动状态进入启动状态。
主芯片启动进入聚好看桌面系统后,将启动结果反馈至低功耗芯片,低功耗芯片分局解析出的目标应用开启指令继续向主芯片发送目标应用开启指令。此时目标应用开启指令为开启小聚在家应用的指令。主芯片接收到开启小聚在家应用的指令后,执行打开小聚在家应用的业务逻辑。目标应用开启指令中还包括移动终端发送的对端邀请信息。主芯片将业务指令发送至小聚在家应用,小聚在家应用从业务指令中解析出该对端邀请信息。对端邀请信息可以包括移动终端的设备信息。根据对端邀请信息,通过小聚在家应用,移动终端与显示设备B之间建立通信连接。
移动终端与显示设备B建立通信连接后,显示设备B将摄像头实时拍摄的画面发送至移动终端。如图9所示,可通过移动终端查看显示设备B的摄像头实时拍摄的画面,实现远程监控的功能。
在一些实施例中,如果选择的显示设备A,服务器根据显示设备A的设备信息,生成启动连接指令(第一唤醒指令)。由于显示设备A处于开机状态,服务器直接将连接指令发送至显示设备A的主芯片。主芯片解析出目标应用开启指令,并响应与目标应用开启指令执行打开小聚在家应用的业务逻辑。
在一些实施例中,如果选择的显示设备A,服务器根据显示设备A的设备信息,生成启动连接指令(第一唤醒指令)。由于显示设备A处于开机状态,服务器直接将连接指令发送至低功耗芯片,低功耗芯片将连接指令转发给显示设备A的主芯片。主芯片解析出目标应用开启指令,并响应与目标应用开启指令执行打开小聚在家应用的业务逻辑。
在一些实施例中,如果选择的显示设备A,服务器根据显示设备A的设备信息,生成启动连接指令(第一唤醒指令)。由于显示设备A处于开机状态,服务器直接将连接指令发送至低功耗芯片,低功耗芯片解析出目标应用开启指令,将目标应用开启指令发给显示设备A的主芯片。主芯片并响应与目标应用开启指令执行打开小聚在家应用的业务逻辑。
在一些实施例中,服务器包括业务系统和AIOT(人工智能物联网)系统,低功耗芯片和主芯片向AIOT系统上报显示设备状态信息。AIOT系统将状态信息发送至业务系统,业务系统将状态信息封装后,生成显示设备在线列表。移动终端则直接从业务系统获取显示设备在线列表的相关信息。在一些实施例中,在移动终端在显示设备为待机或开机状态下发送相同的连接请求时,服务器根据接收到的连接请求中的显示设备的唯一标识生成并发送启动目标应用的指令,其中启动目标应用的指令用于控制主 处理器启动预设的应用,显示设备的通信器接收启动目标应用的指令,并在所述主处理器启动时,将所述启动目标应用的指令发送给所述主处理器,所述主处理器响应与启动目标应用的指令,启动目标应用,在所述主处理器未启动时,所述通信器将启动目标应用的指令发送给子处理器,所述子处理器根据启动目标应用的指令生成启动指令,并缓存启动目标应用的指令,所述子处理器将所述启动指令和启动目标应用的指令同时或先后发送给主处理器,以启动所述主处理器,并使启动后的主处理器启动目标应用。
在一些实施例中,启动目标应用的指令可以是包含移动终端唯一标识,虚拟房间信息等信息,会话请求指令的通话请求。
在一些实施例中,主处理器启动是指主处理器进行操作系统(例如安卓操作系统、苹果操作系统、鸿蒙操作系统等中的任意一种)的加载。主处理器的工作状态是指主芯片中操作系统运行的状态。启动目标应用是指启动主处理器的操作系统中的一个应用。
基于上述实施例,本申请实施例提供一种显示设备的应用唤醒方法,如图10所示的显示设备的应用唤醒方法的信令图,所述方法包括以下步骤:
步骤一、用户在移动终端上打开目标应用用户界面,并在目标应用用户界面中选择显示设备。移动终端接收用户输入的选择显示设备的控制指令。
步骤二、移动终端响应于该控制指令,在显示设备处于开机状态时,生成第一连接请求,其中第一连接请求指向的显示设备的设备状态为开机状态。移动终端将第一连接请求发送至服务器,服务器根据第一连接请求生成第一唤醒指令,并将第一唤醒指令发送至对应的显示设备。显示设备的处理器根据第一唤醒指令控制目标应用开启。
步骤四、在显示设备处于待机状态时,生成第二连接请求,其中第二连接请求指向的显示设备的设备状态为待机状态。移动终端将第二连接请求发送至服务器,服务器根据第二连接请求生成第二唤醒指令,并将第二唤醒指令发送至对应的显示设备。显示设备的处理器根据第二唤醒指令控制显示设备从待机状态进入开机状态之后,再根据第二唤醒指令控制目标应用开启。
在上述方法实施例中,移动终端的目标应用用户界面上显示有显示设备在线列表。显示设备在线列表为服务器根据至少一个显示设备上报的状态信息生成的列表。用户在移动终端上打开目标应用用户界面后,移动终端向服务器发送与目标应用相关的页面数据请求,服务器根据页面数据请求向移动终端反馈显示设备在线列表。
本申请实施例提供又一种显示设备的应用唤醒方法,显示设备在开机时通过主芯片联网,在待机时通过低功耗芯片联网,
如图11所示的显示设备的应用唤醒方法的信令图,所述方法包括以下步骤:
步骤一、显示设备处于开机状态时,主芯片处于启动状态,低功耗芯片处于未启动状态,主芯片持续向服务器上报设备状态信息(上传心跳数据)。当显示设备从开机状态进入待机状态,主芯片从启动状态进入未启动状态。主芯片从启动状态进入未启动状态之前,触发低功耗芯片从未启动状态进入启动状态。低功耗芯片持续向服务器上报设备状态信息。服务器根据至少一个显示设备上报的设备状态信息生成显示设备在线列表。
步骤二、用户打开移动终端上的目标应用,例如小聚在家应用。移动终端响应于 用户的操作,向服务器发送页面数据请求。服务器根据页面数据请求向移动终端反馈显示设备在线列表。移动终端接收显示设备在线列表后,在用户界面上展示显示设备在线列表(步骤一和步骤二在图11中未示出)。
步骤三、移动终端接收用户输入的选择显示设备的控制指令。移动终端响应于该控制指令,如果被选择的显示设备处于开机状态时,生成第一连接请求,其中第一连接请求指向的显示设备的设备状态为开机状态。移动终端将第一连接请求发送至服务器,服务器根据第一连接请求生成第一唤醒指令,并将第一唤醒指令发送至对应的显示设备。服务器将第一唤醒指令发送至被选择的待唤醒显示设备的主芯片。主芯片根据第一唤醒指令(即目标应用开启指令)控制目标应用开启。
步骤四、如果被选择的显示设备处于待机状态,服务器根据连接请求生成第二唤醒指令,其中第二唤醒指令包括开机指令和第一唤醒指令。服务器将开机指令和第一唤醒指令发送至被选择的待唤醒显示设备的低功耗芯片。
低功耗芯片首先根据开机指令,触发主芯片启动。主芯片启动后,向低功耗芯片反馈启动结果。低功耗芯片接收到启动结果后,继续向主芯片发送第一唤醒指令。该第一唤醒指令与小聚在家应用相关。主芯片根据该第一唤醒指令,执行打开小聚在家应用的逻辑,同时第一唤醒指令携带的对端邀请信息发送至小聚在家应用。小聚在家应用打开后,根据对端邀请信息与移动终端建立通信连接。
移动终端与显示设备建立通信连接后,显示设备将摄像头实时拍摄的画面发送至移动终端。如图9所示,可通过移动终端查看显示设备B的摄像头实时拍摄的画面,实现远程监控的功能。
在一些实施例中,显示设备开机或待机时,移动终端生成的请求相同,服务器根据该请求和显示设备的不同状态生成不同的唤醒指令。
在一些实施例中,移动终端可以被显示设备替换,显示设备也可以被移动终端替换。
本申请各个实施例之间相同或相似的内容可相互参照,相关实施例不再赘述。
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的各种不同的变形的实施方式。

Claims (11)

  1. 一种移动终端,包括:
    通信接口,所述通信接口用于所述处理器和服务器的通信;
    处理器,所述处理器用于:
    响应与接收到的操作,显示显示设备的在线列表,其中,所述在线列表中的显示设备控件被标记为开机状态,待机状态或关机状态中的一种,所述开机状态表征对应的显示设备的设置有操作系统的主处理器处于启动状态的状态,所述待机状态表征对应的显示设备的所述主处理器处于未启动状态但子处理器处于启动状态的状态,所述应的显示设备的所述主处理器处于未启动状态且子处理器处于未启动状态的状态;
    接收对所述在线列表中的第一显示设备控件的操作;
    在所述第一显示设备控件被标记为开机状态或待机状态时,发送连接请求给所述服务器,其中,所述连接请求包含对应所述第一显示设备控件的第一显示设备的第一显示设备标识,所述连接请求被用于启动所述第一显示设备中的目标应用,并通过所述目标应用建立通话连接;
    在所述第一显示设备控件被标记为关机键状态时,显示表征所述第一显示设备不可连接的提示信息。
  2. 根据权利要求1所述的移动终端,所述在所述第一显示设备控件被标记为开机状态或待机状态时,发送连接请求包括:
    在所述第一显示设备控件被标记为开机状态时,发送第一连接请求给服务器,其中,所述连接请求除包含第一显示设备标识外还包括开机状态标识;
    在所述第一显示设备控件被标记为待机状态时,发送第二连接请求给服务器,其中,所述连接请求除包含第一显示设备标识外还包括待机状态标识。
  3. 一种服务器,包括存储器和处理器,所述处理器用于:
    接收移动终端发送的连接请求,其中,所述连接请求中包含对应所述第一显示设备控件的第一显示设备的第一显示设备标识;
    响应与所述连接请求,建立虚拟会话房间,并反馈表征等待接通的消息给所述移动终端;
    发送唤醒指令给所述第一显示设备,其中所述唤醒指令包括对应所述虚拟会话房间的房间标识,所述唤醒指令用于使所述第一显示设备启动目标应用,并使所述第一显示设备中的所述目标应用根据所述房间标识建立会话连接。
  4. 根据权利要求3所述的服务器,所述发送唤醒指令给所述第一显示设备包括:
    在确定所述第一显示设备为开机状态时,发送第一唤醒指令给所述第一显示设备,其中,所述第一唤醒指令包括启动目标应用的指令和对应所述虚拟会话房间的房间标识,所述启动目标应用的指令用于使所述第一显示设备中的主处理器启动目标应用,所述目标应用用于在启动后根据所述房间标识建立会话连接;
    在确定所述第一显示设备为待机状态时,发送第二唤醒指令给所述第一显示设备,其中,所述第二唤醒指令包括开机指令、启动目标应用的指令和对应所述虚拟会话房间的房间标识,所述开机指令用于使所述第一显示设备中的子处理器控制所述第一显示设备中的主处理器启动,所述启动目标应用的指令用于使所述第一显示设备中的主处理器启动目标应用,所述目标应用用于在启动后根据所述房间标识建立会话连接。
  5. 根据权利要求4所述的服务器,
    所述处理器根据预设关系和所述连接请求中的第一显示设备标识,确定所述显示设备状态,其中,所述预设关系是根据显示设备和服务器的心跳连接确定的显示设备标识和显示设备状态的映射关系。
  6. 根据权利要求4所述的服务器,所述连接请求除包含第一显示设备标识外还包括开机状态标识或待机状态标识;
    所述处理器在所述连接请求中的包含开机状态标识时,确定所述显示设备为开机状态;
    所述处理器在所述连接请求中的包含待机状态标识时,确定所述显示设备为待机状态。
  7. 一种显示设备,包括:
    显示器;
    通信器,所述通信器用于:接收唤醒指令,在所述显示设备的主处理器处于启动状态时,将所述唤醒指令发送给所述主处理器,在所述显示设备的主处理器处于未启动状态且所述子处理器处于启动状态时,将所述唤醒指令发送给所述子处理器,其中,所述唤醒指令包括启动目标应用的指令;
    所述主处理器,所述主处理器被配置为:在接收到所述唤醒指令后,启动对应所述启动目标应用的指令的目标应用;
    所述子处理器,所述子处理器被配置为:在接收到所述唤醒指令后,控制所述主处理器启动,并将所述启动目标应用的指令发送给所述主处理器。
  8. 根据权利要求7所述的显示设备,所述控制所述主处理器启动包括:
    响应与接收到的唤醒指令,生成开机指令;
    根据所述开机指令控制所述主处理器启动。
  9. 根据权利要求7所述的显示设备,所述唤醒指令包括接收第一唤醒指令和接收第二唤醒指令,其中,所述第一唤醒指令包括所述启动目标应用的指令,不包括开机指令,所述第二唤醒指令包括所述启动目标应用的指令和开机指令;
    将所述唤醒指令发送给所述主处理器包括:将所述第一唤醒指令发送给所述主处理器;
    将所述唤醒指令发送给所述子处理器包括:将所述第二唤醒指令发送给所述子处理器;
    所述控制所述主处理器启动包括:根据所述第二唤醒指令中的开机指令控制所述主处理器启动。
  10. 根据权利要求7所述的显示设备,所述
    所述唤醒指令还包括:对应所述虚拟会话房间的房间标识;
    所述主处理器还被配置为:响应与从所述通信器接收到的所述虚拟会话房间的房间标识或从所述子处理器接收到的所述虚拟会话房间的房间标识,在所述目标应用启动后,控制所述目标应用根据所述虚拟会话房间的房间标识建立会话连接。
  11. 一种应用唤醒方法,所述方法包括:
    接收移动终端发送的连接请求,其中,所述连接请求中包含对应所述第一显示设备控件的第一显示设备的第一显示设备标识;
    在确定所述第一显示设备为开机状态时,发送第一唤醒指令给所述第一显示设备,其中,所述第一唤醒指令包括启动目标应用的指令,所述启动目标应用的指令用于使所述第 一显示设备中的主处理器启动目标应用;
    在确定所述第一显示设备为待机状态时,发送第二唤醒指令给所述第一显示设备,其中,所述第二唤醒指令包括开机指令、启动目标应用的指令,所述开机指令用于使所述第一显示设备中的子处理器控制所述第一显示设备中的主处理器启动,所述启动目标应用的指令用于使所述第一显示设备中的主处理器启动目标应用。
PCT/CN2022/081249 2021-03-30 2022-03-16 应用唤醒方法、显示设备、移动终端及服务器 WO2022206392A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202280017569.1A CN117501700A (zh) 2021-03-30 2022-03-16 应用唤醒方法、显示设备、移动终端及服务器

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202110342826 2021-03-30
CN202110342826.6 2021-03-30
CN202110583580.1 2021-05-27
CN202110586578.X 2021-05-27
CN202110586578.XA CN115150644B (zh) 2021-03-30 2021-05-27 显示设备的应用唤醒方法、显示设备、移动终端及服务器
CN202110583580.1A CN115150643A (zh) 2021-03-30 2021-05-27 应用唤醒方法、显示设备、移动终端及服务器

Publications (1)

Publication Number Publication Date
WO2022206392A1 true WO2022206392A1 (zh) 2022-10-06

Family

ID=83405174

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/081249 WO2022206392A1 (zh) 2021-03-30 2022-03-16 应用唤醒方法、显示设备、移动终端及服务器

Country Status (2)

Country Link
CN (3) CN115150643A (zh)
WO (1) WO2022206392A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115883925A (zh) * 2022-11-17 2023-03-31 深圳创维-Rgb电子有限公司 显示设备待机方法、电子设备及可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262681A1 (en) * 2009-04-13 2010-10-14 Avermedia Technologies, Inc. Remote wake-up method, host to be remotely awaked, and wake-up management server
US20150074432A1 (en) * 2013-09-06 2015-03-12 Dell Products, L.P. Wake on application
WO2016107251A1 (zh) * 2014-12-30 2016-07-07 深圳Tcl数字技术有限公司 基于wlan直连的自动唤醒智能终端的方法及装置
US20190281547A1 (en) * 2018-03-09 2019-09-12 Samsung Electronics Co., Ltd. Display device and control method thereof
CN111314372A (zh) * 2020-03-04 2020-06-19 海信视像科技股份有限公司 一种显示设备唤醒的方法、控制终端、服务器及显示设备
CN111726661A (zh) * 2019-03-21 2020-09-29 海信视像科技股份有限公司 节目推送播放方法、显示设备、移动终端及系统

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9063731B2 (en) * 2012-08-27 2015-06-23 Samsung Electronics Co., Ltd. Ultra low power apparatus and method to wake up a main processor
CN109426525B (zh) * 2017-08-18 2020-12-08 华为技术有限公司 一种针对计算机的睡眠状态唤醒的方法及装置
CN108810630A (zh) * 2018-06-13 2018-11-13 康佳集团股份有限公司 一种智能电视待机启动方法、智能电视及存储介质
CN109981299B (zh) * 2019-03-05 2021-06-01 青岛海信传媒网络技术有限公司 唤醒方法和装置
CN110022495B (zh) * 2019-03-28 2021-07-23 海信视像科技股份有限公司 一种移动终端向显示设备推送媒体文件的方法及显示设备
CN111935518B (zh) * 2020-08-13 2022-02-25 青岛海信传媒网络技术有限公司 一种视频投屏方法及显示设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100262681A1 (en) * 2009-04-13 2010-10-14 Avermedia Technologies, Inc. Remote wake-up method, host to be remotely awaked, and wake-up management server
US20150074432A1 (en) * 2013-09-06 2015-03-12 Dell Products, L.P. Wake on application
WO2016107251A1 (zh) * 2014-12-30 2016-07-07 深圳Tcl数字技术有限公司 基于wlan直连的自动唤醒智能终端的方法及装置
US20190281547A1 (en) * 2018-03-09 2019-09-12 Samsung Electronics Co., Ltd. Display device and control method thereof
CN111726661A (zh) * 2019-03-21 2020-09-29 海信视像科技股份有限公司 节目推送播放方法、显示设备、移动终端及系统
CN111314372A (zh) * 2020-03-04 2020-06-19 海信视像科技股份有限公司 一种显示设备唤醒的方法、控制终端、服务器及显示设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115883925A (zh) * 2022-11-17 2023-03-31 深圳创维-Rgb电子有限公司 显示设备待机方法、电子设备及可读存储介质

Also Published As

Publication number Publication date
CN115150644B (zh) 2023-10-24
CN115150643A (zh) 2022-10-04
CN117501700A (zh) 2024-02-02
CN115150644A (zh) 2022-10-04

Similar Documents

Publication Publication Date Title
WO2021109422A1 (zh) 待机控制方法及显示设备
CN111935518B (zh) 一种视频投屏方法及显示设备
WO2021164177A1 (zh) 播放媒体资源的方法、显示设备及移动终端
CN113064645B (zh) 一种开机界面控制方法及显示设备
CN111314372A (zh) 一种显示设备唤醒的方法、控制终端、服务器及显示设备
CN112165642A (zh) 一种显示设备
WO2022206392A1 (zh) 应用唤醒方法、显示设备、移动终端及服务器
CN113784200A (zh) 通信终端、显示设备及投屏连接方法
CN114302201A (zh) 一种音箱模式下自动开关屏的方法及智能终端、显示设备
CN112632160A (zh) 智能设备、以及智能设备登录方法
CN113342415B (zh) 一种定时任务执行方法及显示设备
WO2024098974A1 (zh) 一种显示设备及外接设备的控制方法
CN113630656A (zh) 显示设备、终端设备及通信连接方法
CN112584210B (zh) 显示设备、视频录制方法及录制文件展示方法
CN113542878B (zh) 一种基于人脸识别与手势检测的唤醒方法及显示设备
CN112492393A (zh) 一种mic开关关联节能模式的实现方法及显示设备
CN114286320A (zh) 一种显示设备、移动终端及蓝牙连接方法
CN114258047B (zh) 网络唤醒方法、装置、显示设备和存储介质
CN114630163B (zh) 显示设备及快速开机方法
WO2022193732A1 (zh) 一种音频输出通道的切换控制方法及显示设备
US20230119233A1 (en) Display apparatus, video recording method, and recorded file display method
CN114040341B (zh) 一种蓝牙广播包上报处理方法及显示设备
CN115022690B (zh) 一种码值切换方法及显示设备
US20230319227A1 (en) Switching method for audio output channel, and display apparatus
CN114466114A (zh) 一种显示设备及其运行方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22778575

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280017569.1

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22778575

Country of ref document: EP

Kind code of ref document: A1