CN114489532B - Terminal equipment and method for linking terminal equipment and display equipment - Google Patents

Terminal equipment and method for linking terminal equipment and display equipment Download PDF

Info

Publication number
CN114489532B
CN114489532B CN202011264282.8A CN202011264282A CN114489532B CN 114489532 B CN114489532 B CN 114489532B CN 202011264282 A CN202011264282 A CN 202011264282A CN 114489532 B CN114489532 B CN 114489532B
Authority
CN
China
Prior art keywords
display device
display
supported
control
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011264282.8A
Other languages
Chinese (zh)
Other versions
CN114489532A (en
Inventor
姜明辉
高斯太
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juhaokan Technology Co Ltd
Original Assignee
Juhaokan Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Juhaokan Technology Co Ltd filed Critical Juhaokan Technology Co Ltd
Priority to CN202011264282.8A priority Critical patent/CN114489532B/en
Priority to PCT/CN2021/117795 priority patent/WO2022100261A1/en
Priority to CN202180068316.2A priority patent/CN116368807A/en
Publication of CN114489532A publication Critical patent/CN114489532A/en
Application granted granted Critical
Publication of CN114489532B publication Critical patent/CN114489532B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1415Digital output to display device ; Cooperation and interconnection of the display device with other functional units with means for detecting differences between the image stored in the host and the images displayed on the displays

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application provides a terminal device and a method for linking the terminal device with a display device, wherein the terminal device comprises a terminal display and a terminal controller, and the terminal controller is configured to: responding to a connection display device instruction input by a user, and establishing connection with a display device; sending a query request to query parameter information of the display device, wherein the parameter information is used for representing supported and/or unsupported functions of the display device; receiving parameter information of the display equipment; and controlling the terminal display not to display a second operation control when the operation control is displayed according to the parameter information of the display equipment, wherein the operation control is used for controlling the display equipment, and the second operation control is an operation control corresponding to a function which is not supported by the display equipment. The application improves the probability of successful linkage between the display equipment and the terminal equipment.

Description

Terminal equipment and method for linking terminal equipment and display equipment
Technical Field
The application relates to the technical field of display, in particular to terminal equipment and a method for linking the terminal equipment with display equipment.
Background
The remote controller is a traditional control device of the display equipment of the television, besides the television, a plurality of household appliances such as an air conditioner, a fan and the like also support remote controller control, a plurality of remote controllers possibly control different household appliances in a user's home respectively, the storage and the distinction of the plurality of remote controllers bring inconvenience to the life of the user, and in order to improve the convenience of household appliance control, part of televisions support mobile phones to carry out linkage control on the television.
In the related art, a user may install an application program for controlling a television on a mobile phone, where the application program may display a plurality of operation controls for controlling the television, and the user may click on the operation controls on the mobile phone to perform coordinated control on the television. However, different televisions have a lot of differences in hardware and software, and correspondingly, the coordinated control functions supported by different televisions are also different, for example, some televisions support a mobile phone to open a camera of the television, some televisions do not have a camera, and a user clicks an operation control for opening the camera function on an application program for controlling the television, so that the function of opening the camera may not be realized, and the use experience of the user is affected.
Disclosure of Invention
In order to solve the technical problems, the application provides terminal equipment and a method for linking the terminal equipment with display equipment.
In a first aspect, the present application provides a terminal device, comprising:
a terminal display;
a terminal controller connected to the terminal display, the terminal controller configured to:
responding to a connection display device instruction input by a user, and establishing connection with a display device;
sending a query request to query parameter information of the display device, wherein the parameter information is used for representing supported and/or unsupported functions of the display device;
receiving parameter information of the display equipment;
and controlling the terminal display not to display a second operation control when the operation control is displayed according to the parameter information of the display equipment, wherein the operation control is used for controlling the display equipment, and the second operation control is an operation control corresponding to a function which is not supported by the display equipment. In a second aspect, an embodiment of the present application provides a method for linking a terminal device with a display device, where the method is used for the display device, and the method includes:
establishing connection with terminal equipment;
receiving a query request from the terminal equipment;
and responding to the query request, sending parameter information of the display equipment to the terminal equipment, and enabling the terminal equipment to display a corresponding operation control according to the parameter information, wherein the operation control is used for controlling the display equipment.
In a third aspect, an embodiment of the present application provides a method for linking a terminal device with a display device, where the method is used for the terminal device, and the method includes:
responding to a connection display device instruction input by a user, and establishing connection with a display device;
sending a query request to the display device to query parameter information of the display device, wherein the parameter information is used for representing functions supported and/or not supported by the display device;
and according to the parameter information of the display equipment, controlling the terminal display not to display a second operation control when the operation control is displayed, wherein the operation control is used for controlling the display equipment, and the second operation control is an operation control corresponding to a function which is not supported by the display equipment.
In a fourth aspect, an embodiment of the present application provides a method for linking a terminal device with a display device, where the method is used for the terminal device, and the method includes:
receiving an instruction of starting a mobile phone end linkage application by a user, displaying a home page of the mobile phone end linkage application, wherein the mobile phone end linkage application is used for controlling the display equipment;
establishing a connection with a display device;
sending an acquisition request to a server to acquire version information of a television end linkage application of the display equipment;
Receiving an operation instruction input by a user for switching a display preset interface;
and determining an operation control displayed in the preset interface according to the version information of the television end linkage application, wherein when the first function is not supported according to the version information of the television end linkage application, the operation control corresponding to the first function is not displayed in the preset interface.
The terminal equipment and the method for linking the terminal equipment and the display equipment have the beneficial effects that:
according to the embodiment of the application, the terminal equipment acquires the parameter information of the display equipment, and controls the operation control of the display equipment according to the parameter information, so that different operation controls can be displayed according to different parameter information, the operation control displayed by the terminal equipment can accord with the version supporting capability corresponding to the parameter information of the display equipment, the probability of successful linkage of the terminal equipment and the display equipment is improved, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
A schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments is schematically shown in fig. 1;
a hardware configuration block diagram of a display device 200 according to some embodiments is exemplarily shown in fig. 2;
a hardware configuration block diagram of the control apparatus 100 according to some embodiments is exemplarily shown in fig. 3;
a schematic diagram of the software configuration in a display device 200 according to some embodiments is exemplarily shown in fig. 4;
an icon control interface display schematic of an application in a display device 200 according to some embodiments is illustrated in fig. 5;
a flow diagram of a method for terminal device to display device linkage of a terminal device according to some embodiments is illustrated in fig. 6A;
a flow diagram of a method for terminal device to display device linkage of a terminal device according to some embodiments is illustrated in fig. 6B;
a flow diagram of a method for a terminal device of a display device to link with the display device according to some embodiments is shown schematically in fig. 7;
a schematic of interactions between a cell phone, television and server according to some embodiments is shown schematically in fig. 8;
a schematic diagram of a device list interface on a terminal device according to some embodiments is shown schematically in fig. 9A;
A schematic diagram of a device list interface on a terminal device according to some embodiments is shown schematically in fig. 9B;
a schematic diagram of a home interface of a first APP on a terminal device according to some embodiments is shown schematically in fig. 9C;
a schematic diagram of a device control interface according to some embodiments is shown schematically in fig. 10A;
FIG. 10B illustrates a schematic diagram of yet another device control interface, in accordance with some embodiments;
a schematic diagram of a device name editing interface according to some embodiments is shown schematically in fig. 11;
a schematic diagram of a screenshot success prompt interface according to some embodiments is shown schematically in fig. 12;
a schematic diagram of a screenshot sharing interface according to some embodiments is shown schematically in fig. 13;
a schematic diagram of a television picture refresh interface according to some embodiments is shown schematically in fig. 14;
a schematic diagram of a screen capture failure interface according to some embodiments is shown schematically in fig. 15;
a schematic diagram of a screen capture failure interface according to some embodiments is shown schematically in fig. 16;
a schematic diagram of a manipulation option correspondence interface according to some embodiments is shown schematically in fig. 17;
a schematic diagram of a voice option correspondence interface according to some embodiments is shown schematically in fig. 18;
A schematic diagram of a voice option correspondence interface according to some embodiments is shown schematically in fig. 19;
a schematic diagram of a recommendation options correspondence interface according to some embodiments is shown schematically in fig. 20;
a schematic diagram of a function bar interface according to some embodiments is shown schematically in fig. 21.
Detailed Description
For the purposes of making the objects, embodiments and advantages of the present application more apparent, an exemplary embodiment of the present application will be described more fully hereinafter with reference to the accompanying drawings in which exemplary embodiments of the application are shown, it being understood that the exemplary embodiments described are merely some, but not all, of the examples of the application.
Based on the exemplary embodiments described herein, all other embodiments that may be obtained by one of ordinary skill in the art without making any inventive effort are within the scope of the appended claims. Furthermore, while the present disclosure has been described in terms of an exemplary embodiment or embodiments, it should be understood that each aspect of the disclosure can be practiced separately from the other aspects.
It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.
The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated (Unless otherwise indicated). It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.
Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" as used in this disclosure refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the function associated with that element.
The term "remote control" as used herein refers to a component of an electronic device (such as a display device as disclosed herein) that can be controlled wirelessly, typically over a relatively short distance. Typically, the electronic device is connected to the electronic device using infrared and/or Radio Frequency (RF) signals and/or bluetooth, and may also include functional modules such as WiFi, wireless USB, bluetooth, motion sensors, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in a general remote control device with a touch screen user interface.
The term "gesture" as used herein refers to a user behavior by which a user expresses an intended idea, action, purpose, and/or result through a change in hand shape or movement of a hand, etc.
A schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment is exemplarily shown in fig. 1. As shown in fig. 1, a user may operate the display apparatus 200 through the mobile terminal 300 and the control device 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, etc., and the display device 200 is controlled by a wireless or other wired mode. The wireless mode can be direct connection or non-direct connection, and can be routed or not routed. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc. Such as: the user can input corresponding control instructions through volume up-down keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, on-off keys, etc. on the remote controller to realize the functions of the control display device 200.
In some embodiments, mobile terminals, tablet computers, notebook computers, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device. The application program, by configuration, can provide various controls to the user in an intuitive User Interface (UI) on a screen associated with the smart device.
In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. Such as: it is possible to implement a control command protocol established between the mobile terminal 300 and the display device 200, synchronize a remote control keyboard to the mobile terminal 300, and implement a function of controlling the display device 200 by controlling a user interface on the mobile terminal 300. The audio/video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.
As also shown in fig. 1, the display device 200 is also in data communication with the server 400 via a variety of communication means. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. By way of example, display device 200 receives software program updates, or accesses a remotely stored digital media library by sending and receiving information, as well as Electronic Program Guide (EPG) interactions. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers. Other web service content such as video on demand and advertising services are provided through the server 400.
The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limited, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.
The display apparatus 200 may additionally provide a smart network television function of a computer support function, including, but not limited to, a network television, a smart television, an Internet Protocol Television (IPTV), etc., in addition to the broadcast receiving television function.
A hardware configuration block diagram of the display device 200 according to an exemplary embodiment is illustrated in fig. 2.
In some embodiments, at least one of the controller 250, the modem 210, the communicator 220, the detector 230, the input/output interface 255, the display 275, the audio output interface 285, the memory 260, the power supply 290, the user interface 265, and the external device interface 240 is included in the display apparatus 200.
In some embodiments, the display 275 is configured to receive image signals from the first processor output, and to display video content and images and components of the menu manipulation interface.
In some embodiments, display 275 includes a display screen assembly for presenting pictures, and a drive assembly for driving the display of images.
In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from the network server side transmitted from the network communication protocol may be displayed.
In some embodiments, the display 275 is used to present a user-manipulated UI interface generated in the display device 200 and used to control the display device 200.
In some embodiments, depending on the type of display 275, a drive assembly for driving the display is also included.
In some embodiments, display 275 is a projection display and may further include a projection device and a projection screen.
In some embodiments, communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi chip, a bluetooth communication protocol chip, a wired ethernet communication protocol chip, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver.
In some embodiments, the display apparatus 200 may establish control signal and data signal transmission and reception between the communicator 220 and the external control device 100 or the content providing apparatus.
In some embodiments, the user interface 265 may be used to receive infrared control signals from the control device 100 (e.g., an infrared remote control, etc.).
In some embodiments, the detector 230 is a signal that the display device 200 uses to capture or interact with the external environment.
In some embodiments, the detector 230 may further include an image collector, such as a camera, a video camera, etc., which may be used to collect external environmental scenes, collect attributes of a user or interact with a user, adaptively change display parameters, and recognize a user gesture to realize an interaction function with the user.
In some embodiments, the detector 230 may also be a sound collector or the like, such as a microphone, that may be used to receive the user's sound. Illustratively, a voice signal including a control instruction for a user to control the display apparatus 200, or an acquisition environmental sound is used to recognize an environmental scene type so that the display apparatus 200 can adapt to environmental noise.
In some embodiments, as shown in fig. 2, the input/output interface 255 is configured to enable data transfer between the controller 250 and external other devices or other controllers 250. Such as receiving video signal data and audio signal data of an external device, command instruction data, or the like.
In some embodiments, external device interface 240 may include, but is not limited to, the following: any one or more interfaces of a high definition multimedia interface HDMI interface, an analog or data high definition component input interface, a composite video input interface, a USB input interface, an RGB port, and the like can be used. The plurality of interfaces may form a composite input/output interface.
In some embodiments, as shown in fig. 2, the modem 210 is configured to receive the broadcast television signal by a wired or wireless receiving manner, and may perform modulation and demodulation processes such as amplification, mixing, and resonance, and demodulate the audio/video signal from a plurality of wireless or wired broadcast television signals, where the audio/video signal may include a television audio/video signal carried in a television channel frequency selected by a user, and an EPG data signal.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 may control the overall operation of the display apparatus 200. For example: in response to receiving a user command to select to display a UI object on the display 275, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon. The user command for selecting the UI object may be an input command through various input means (e.g., mouse, keyboard, touch pad, etc.) connected to the display device 200 or a voice command corresponding to a voice uttered by the user.
As shown in fig. 2, the controller 250 includes at least one of a random access Memory 251 (Random Access Memory, RAM), a Read-Only Memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a graphics processor (Graphics Processing Unit, GPU), a central processing unit 254 (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication Bus 256 (Bus), which connects the respective components.
In some embodiments, CPU processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents.
In some exemplary embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include one main processor and one or more sub-processors. A main processor for performing some operations of the display apparatus 200 in the pre-power-up mode and/or displaying a picture in the normal mode. One or more sub-processors for one operation in a standby mode or the like.
In some embodiments, the graphics processor 253 is configured to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The device comprises an arithmetic unit, wherein the arithmetic unit is used for receiving various interaction instructions input by a user to carry out operation and displaying various objects according to display attributes. And a renderer for rendering the various objects obtained by the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments, video processor 270 is configured to receive external video signals, perform video processing such as decompression, decoding, scaling, noise reduction, frame conversion, resolution conversion, image composition, etc., according to standard codec protocols for input signals, and may result in signals that are displayed or played on directly displayable device 200.
In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image compositing module, a frame conversion module, a display formatting module, and the like.
In some embodiments, the audio output, under the control of the controller 250, receives sound signals output by the audio processor 280, such as: the speaker 286, and an external sound output terminal that can be output to a sound emitting device of an external device, other than the speaker carried by the display device 200 itself, such as: external sound interface or earphone interface, etc. can also include the close range communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.
In some embodiments, a user inputs a user command through the control apparatus 100 or the mobile terminal 300, the user input interface is then responsive to the user input through the controller 250, and the display device 200 is then responsive to the user input.
In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
Fig. 3 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface, a memory, and a power supply.
The control apparatus 100 is configured to control the display device 200, and to receive an input operation instruction of a user, and to convert the operation instruction into an instruction recognizable and responsive to the display device 200, and to function as an interaction between the user and the display device 200. Such as: the user responds to the channel addition and subtraction operation by operating the channel addition and subtraction key on the control apparatus 100.
In some embodiments, the control apparatus 100 may be a smart device. Such as: the control apparatus 100 may install various applications for controlling the display device 200 according to user's needs.
In some embodiments, as shown in fig. 1, a mobile terminal 300 or other intelligent electronic device may function similarly to the control apparatus 100 after installing an application for manipulating the display device 200. Such as: the user may implement the functions of the physical keys of the control apparatus 100 by installing various function keys or virtual buttons of a graphical user interface available on the mobile terminal 300 or other intelligent electronic device.
The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation and operation of the control device 100, as well as the communication collaboration among the internal components and the external and internal data processing functions.
The communication interface 130 enables communication of control signals and data signals with the display device 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a bluetooth module 132, an NFC module 133, and other near field communication modules.
A user input/output interface 140, wherein the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, keys 144, and other input interfaces. Such as: the user can implement a user instruction input function through actions such as voice, touch, gesture, press, and the like, and the input interface converts a received analog signal into a digital signal and converts the digital signal into a corresponding instruction signal, and sends the corresponding instruction signal to the display device 200.
The output interface includes an interface that transmits the received user instruction to the display device 200. In some embodiments, an infrared interface may be used, as well as a radio frequency interface. Such as: when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to an infrared control protocol, and the infrared control signal is sent to the display device 200 through the infrared sending module. And the following steps: when the radio frequency signal interface is used, the user input instruction is converted into a digital signal, and then the digital signal is modulated according to a radio frequency control signal modulation protocol and then transmitted to the display device 200 through the radio frequency transmission terminal.
In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may send the user input instruction to the display device 200 through a WiFi protocol, or a bluetooth protocol, or an NFC protocol code.
In some embodiments, the system may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.
Referring to FIG. 4, in some embodiments, the system is divided into four layers, from top to bottom, an application layer (referred to as an "application layer"), an application framework layer (Application Framework layer) (referred to as a "framework layer"), a An Zhuoyun row (Android run) and a system library layer (referred to as a "system runtime layer"), and a kernel layer, respectively.
In some embodiments, as shown in fig. 5, the application layer contains at least one icon control that the application can display in the display, such as: a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control, and the like.
The hardware or software architecture in some embodiments may be based on the description in the foregoing embodiments, and in some embodiments may be based on other similar hardware or software architectures, so long as the technical solution of the present application may be implemented.
In some embodiments, the user may control the display device, such as increasing or decreasing volume, pausing/starting playback, etc., through the terminal device, which may include a cell phone, and the display device may include a television. The user may install an application on the terminal device through which the display device is controlled. However, there may be some differences between functions supported by different display devices, and when a user clicks an operation control for controlling the display device on an application program of the terminal device, if the display device does not support the function corresponding to the operation control, the user experience will be poor.
To solve the above technical problems, embodiments of the present application provide a method for a terminal device to link with a display device, which is used for the terminal device and the display device respectively, where in some embodiments, the display device includes a display and a controller, the terminal device also includes a display and a controller, for convenience of distinction, the display of the terminal device may be referred to as a terminal display, and the controller of the terminal device may be referred to as a terminal controller. The terminal device can display an operation control for controlling the display device on the terminal display, the terminal controller generates a control signal for the display device according to a trigger instruction of the operation control, and the controller of the display device responds according to the control signal, for example, the display of the display device is controlled to display a picture with a function corresponding to the control signal.
In some embodiments, the linkage method for the terminal device may refer to fig. 6A, including steps S101-S103.
Step S101: and responding to a connection display device instruction input by a user, and establishing connection with the display device.
In some embodiments, a user may install a mobile phone end linkage application on the terminal device to control the terminal device to interact with the display device, where the mobile phone end linkage application may be referred to as a first APP, and after the user starts and logs in the first APP, an interface of the first APP may display a connection control, and after the user triggers the connection control, the first APP may display multiple connection methods for the user to select. In some embodiments, each connection method may display an operation control, the user clicks a different operation control, and the terminal device will acquire and display a display device connectable under the connection method; in some embodiments, the terminal device may also concurrently obtain connectable display devices under different connection methods, and correspondingly display each connection method and the connectable display device on the same interface, so that a user may view through the sliding interface; in some embodiments, the terminal device may not display the connection method, and only display the obtained connectable display device, so as to reduce user operations, and further, if there is a repeated display device in different connection methods, the repeated display device may be removed.
In some embodiments, a method of connection between a terminal device and a display device may be a network connection. If the terminal equipment is in the local area network, the APP can automatically acquire the display equipment in the local area network, a user clicks one display equipment to generate a connection request, the terminal equipment sends the connection request to the display equipment, and the display equipment establishes connection with the terminal equipment according to the connection request. In some embodiments, the connection established by the display device with the terminal device may be a point-to-point connection.
In some embodiments, a method of connecting a terminal device to a display device may be a same account connection. If the terminal equipment is not in the local area network, for example, when the terminal equipment is surfing the internet through the data flow of the sim card, the user cannot check the display equipment in the local area network on the terminal equipment because the terminal equipment is not in the local area network, at the moment, the terminal equipment can send a query request to the server to query equipment information of the display equipment with the same account number as the terminal equipment, after the equipment information of the display equipment is acquired, the display equipment is displayed, after the user clicks the display equipment, a connection request is generated, the terminal equipment sends the connection request to the server, and connection is established with the display equipment according to the equipment through the server. In some embodiments, the device information may include a name, a MAC address, a power on status, and a login account number of the display device.
In some embodiments, a method of connection between a terminal device and a display device may be a scan code connection. For example, an APP, which may be referred to as a second APP, may be provided on the display device to control the interaction of the display device with the terminal device. After the user opens the second APP on the display device, a two-dimensional code can be generated on an interface of the second APP, after the user selects code scanning connection on the terminal device, the terminal device can scan the two-dimensional code, so that the terminal device can acquire the device information of the display device, a connection request is sent to the display device through a server according to the device information of the display device, and the display device establishes connection with the terminal device according to the connection request.
In some embodiments, the operation of establishing a connection with the display device may be automatically performed by the user after the user opens a preset interface, or operates a preset control, or the first APP is started. The preset interface may be an interface of the first APP, for example, a "my" interface, and the preset control may be a connection control displayed by the first APP. In some embodiments, the terminal device automatically discovers a display device in the local area network, automatically connects the display device according to the historical connection information when the display device is a device which is already connected, and displays prompt information to remind a user whether to connect the display device when the display device is a newly discovered device (the historical connection information does not exist).
Step S102: and sending a query request to the display device to query parameter information of the display device, wherein the parameter information is used for representing functions supported and/or not supported by the display device.
In some embodiments, in step S101, the display device connected to the terminal device is a device that has not been connected before, and to obtain version capability data of the display device, the terminal device may send a query request to the display device to obtain parameter information of the display device. After receiving the inquiry request of the terminal device, the display device can send the parameter information of the display device to the terminal device.
In some embodiments, in step S101, the display device connected to the terminal device is a device connected before, the terminal device already stores version capability data of the display device, and the method may directly jump to step S103 without sending a query request to the display device, and display the corresponding operation control on the terminal display according to the version capability data.
In some embodiments, after the terminal device establishes a connection with the display device, a query request may be sent to the display device. In some embodiments, the parameter information of the display device may include version capability data of the display device.
In some embodiments, the version capability data of the display device may include functions supported and/or unsupported by the display device, such as an identification of whether a first function is supported, an identification of whether a second function is supported, an identification of whether a third function is supported, and so forth. The terminal device may not load the identifier corresponding to the function not supported by the display device when loading the interface. The first function, the second function and the third function are all linkage functions, namely functions which can be controlled by a mobile phone on a television, such as a screen throwing function, a screen capturing function, a shutdown function and the like. In some embodiments, the display device may store own version capability data, update the own version capability data from the server after each startup, and return parameter information including the version capability data to the display device after receiving a query request of the terminal device; in some embodiments, the display device may also directly query the server for its latest version capability data after receiving the query request from the terminal device, and then return the parameter information containing the version capability data to the display device.
In some embodiments, the parameter information of the display device may be used to characterize the functions supported and/or not supported by the software version, and may specifically include software version information of the display device and license plate information of the display device, and there may be mapping relationships between the software version information and version capability data of the display device, and between the license plate information and version capability data of the display device, where these mapping relationships may be stored in the server, and may also be stored in the terminal device and/or the display device. When the mapping relations exist in the display device, the display device can inquire the mapping relations according to the inquiry request to obtain version capacity data of the display device and send the version capacity data to the terminal device; when the mapping relations exist in the terminal equipment, the terminal equipment can query the mapping relations after receiving the parameter information of the display equipment to obtain version capacity data of the display equipment; when these mappings exist in the server, the terminal device may acquire these mappings from the server, or the display device acquires these mappings from the server and then returns to the terminal device.
In some embodiments, the software version information may include a version number and photographing information.
Step S103: and according to the parameter information of the display equipment, controlling the terminal display not to display a second operation control when the operation control is displayed, wherein the operation control is used for controlling the display equipment, and the second operation control is an operation control corresponding to a function which is not supported by the display equipment.
In some embodiments, when the parameter information sent by the display device includes version capability data, or the parameter information sent by the display device does not include version capability data but includes software version information of the display device and license plate information of the display device, but the terminal device itself stores a mapping relationship of the version capability data, the terminal device may obtain the version capability data of the display device according to the parameter information sent by the display device, and the terminal device may determine a function icon that may be loaded according to the version capability data of the display device, where the function icon may be configured as an operation control capable of responding to a touch operation by a user.
In some embodiments, after the terminal device obtains the version capability data of the display device, the terminal device may also screen the function icons determined according to the version capability data of the display device according to its own native function, such as hardware supporting capability, so as to improve the probability of successfully executing the linkage function after the function icons are triggered. For example, the terminal device may store a mapping relationship between the operation control and hardware of the terminal device, and of course, the mapping relationship may also be stored in the server, and the terminal device may also obtain the mapping relationship from the server. After the terminal equipment obtains the version capability data of the display equipment, the corresponding identifiers of functions supported by the display equipment can be obtained according to the version capability data, a list of operation controls to be displayed is obtained according to the identifiers, whether the corresponding hardware exists in the terminal equipment or not and whether the hardware works normally is detected according to the mapping relation between the operation controls and the hardware of the terminal equipment, if the hardware does not exist or works abnormally, error reporting is carried out, the operation controls corresponding to the error reporting hardware are deleted from the list of the operation controls to be displayed, and when all the hardware corresponding to the list of the operation controls to be displayed is detected, the rest operation controls in the list of the operation controls to be displayed can be loaded. In some embodiments, when the parameter information sent by the display device does not include version capability data, but includes software version information and license plate information of the display device, the terminal device may query the server for version capability data corresponding to the parameter information, further obtain a linkage function supported by the display device, determine a displayable operation control according to the linkage function supported by the display device, and then load the displayable operation control in the local page resource according to the determined result. For example, the version capability data of the display device may include an identification of whether the first function is supported, an identification of whether the second function is supported, an identification of whether the third function is supported, and so on. When the terminal equipment loads the interface, the identifiers corresponding to the functions which are not supported by the display equipment are not loaded, only the identifiers corresponding to the functions supported by the display equipment are loaded, and then the operation controls corresponding to the functions supported by the display equipment are further loaded, wherein the operation controls corresponding to the functions supported by the display equipment can be called as first operation controls.
In some embodiments, when the parameter information sent to the terminal device by the display device includes version capability data, or the terminal device locally stores version capability data corresponding to different version information and license plates, the terminal device may still acquire the version capability data of the display device from the server, so as to correct the version capability data.
In some embodiments, the terminal device determines functions/supported functions not supported by the display device according to the mapping relationship between the self-stored software version information and the supported hardware functions stored in the terminal device.
In some embodiments, the page data includes basic page data and controllable page data, the basic page data is data for displaying general page content, the controllable page data can be selected according to functions supported by the display device, the terminal device can filter the controllable page data in the local page data according to functions not supported by the display device, and the filtered controllable page data and the filtered basic page data are displayed on the page.
In some embodiments, the terminal device may send the functions that are not supported by the display device/the functions that are supported by the display device to the server along with the page request, where the server filters the controllable page data in the preset page data, and sends the filtered controllable page data and the base page data to the terminal device to display the page for displaying.
In some embodiments, the terminal device may send the software version information directly to the server, which makes a determination of functions/supported functions not supported by the display device.
In some embodiments, the page data may be divided into different versions of page data, where the different versions of page data directly correspond to different key versions without distinguishing between the underlying data and the controllable page data.
In some embodiments, the linkage method for the terminal device may refer to fig. 6B, including steps S111-S115.
Step S111: and receiving an instruction of starting the mobile phone end linkage application by a user, displaying a home page of the mobile phone end linkage application, wherein the mobile phone end linkage application is used for controlling the display equipment.
In some embodiments, the cell-phone-side linkage application may be a first APP.
Step S112: a connection is established with the display device.
In some embodiments, the terminal device may receive an instruction input by a user to connect to a display device in the local area network, and establish a connection with the display device in the local area network in response to the instruction to connect to the display device in the local area network.
In some embodiments, the terminal device may receive an instruction input by a user to connect to a display device of the same account; and responding to an instruction of connecting the display equipment with the same account number, and establishing connection with the display equipment with the same account number through a server.
In some embodiments, the terminal device may establish a connection with a display device in the local area network in response to the instruction to start the mobile phone end linkage application.
Step S113: and sending a query request to a server to acquire version information of the television end linkage application of the display equipment.
In some embodiments, the television-side linkage application may be a second APP.
Step S114: and receiving an operation instruction input by a user for switching the display preset interface.
In some embodiments, the preset interface may be a "my" interface of the first APP.
Step S115: and determining an operation control displayed in the preset interface according to the version information of the television end linkage application, wherein when the first function is not supported according to the version information of the television end linkage application, the operation control corresponding to the first function is not displayed in the preset interface.
In some embodiments, the linkage method for a display device, see fig. 7, includes steps S201-S203.
Step S201: and establishing connection with the terminal equipment.
In some embodiments, the display device may automatically connect to the local area network after being started, and then send a broadcast within the local area network, so that other devices within the local area network, such as the terminal device, can identify the display device, send a connection request to the display device, and the display device establishes a connection with the terminal device according to the connection request.
In some embodiments, the display device receives a connection request of the terminal device sent by the server, and establishes a connection with the terminal device through the server according to the connection request.
In some embodiments, the networked display device may operate networked without active broadcasting, or only broadcasting when accessed, with subsequent active broadcasting no longer being sustained. After the terminal equipment starts the first APP, the terminal equipment actively transmits a broadcast or sends a request to a server according to the operation of a user, and then establishes the same-network connection or the same-account connection.
Step S202: and receiving a query request from the terminal equipment.
In some embodiments, the terminal device and the display device are located within the same local area network, and the display device may receive the query request from the terminal device over the local area network.
In some embodiments, the terminal device and the display device are not connected to the same local area network, and the display device may receive the query request from the terminal device through the server.
In some embodiments, the terminal device and the display device are not connected to the same lan, the display device may not receive the query request from the terminal device, and the server may directly determine the parameter information of the corresponding display device according to the information (such as account information) in the query request of the terminal device and a preset database, where the preset database may be a database storing the parameter information.
Step S203: and responding to the query request, sending parameter information of the display equipment to the terminal equipment, and enabling the terminal equipment to display a corresponding operation control according to the parameter information, wherein the operation control is used for controlling the display equipment.
In some embodiments, the display device may determine parameter information of the display device according to receiving the query request of the terminal device, and send the parameter information of the display device to the terminal device.
In some embodiments, the display device may send the parameter information of the display device to the terminal device via an in-network transmission via a local area network.
In some embodiments, the display device may send parameter information of the display device to the server, and the server sends the parameter information to the terminal device.
In some embodiments, the parameter information of the display device may include at least one of version information of an installed application on the display device and license plate information of the display device, where there may be a plurality of installed applications on the display device, but some applications may not support linkage with the terminal device, such as live tv, game applications, some applications support linkage with the terminal device, such as nas, a small-focus home, a home message board, and hi-drop, and the display device may send only the license plate information of the display device and the parameter information of the installed application that can interact with the terminal device to the terminal device.
In some embodiments, the display device, after installing or updating an application, uploads software version information for the application to the server. After receiving the inquiry request of the terminal equipment, the display equipment acquires license plate information and software version information of the installed application from the server.
In some embodiments, the controller of the display device may directly obtain and locally store software version information of an installed application on the display device and license plate information of the display device, and when a version of an installed application is updated, the display device updates the stored software version information. After receiving the inquiry request of the terminal equipment, the display equipment combines the locally stored software version information and license plate information into parameter information and sends the parameter information to the terminal equipment.
To further illustrate the process of linking between terminal devices of a display device, fig. 8 shows a schematic diagram of interactions between a cell phone, a television, and a server according to some embodiments.
In some embodiments, the mobile phone may be connected to a television, an intelligent camera, and other devices through a mobile phone end linkage application, for example, the television may be provided with a television end linkage application for controlling the interaction between the television and the mobile phone, that is, a second APP, where after the television is started and networked, the second APP may automatically obtain software version information of each application installed on the television and license plate information of the television from a server, and locally store the software version information and license plate information.
After the television is started and networked, the television also transmits a broadcast in the accessed local area network, and if the mobile phone is also in the local area network, the broadcast can be received by the mobile phone.
In some embodiments, the first APP may be a 'sea credit, watch' APP installed at the handset end, and the second APP is a content providing APP 'watch' pre-installed at the television end or installed by the user.
In some embodiments, a user may select, by switching signal sources, content from different sources for display in numerous input modes, such as live APP, HDMI interface input, live interface input, and the like.
In some embodiments, an APP (first APP) for controlling interaction between a television and the mobile phone may be installed on the mobile phone, after a user starts and logs in the first APP, an interface of the first APP may display a connection control, after the user triggers the connection control, the first APP may send a query request including an account number currently logged in the first APP to a server, and the server queries the television logged in the account number according to the query request and returns device information of the television to the mobile phone. In some embodiments, the first APP may also be configured to automatically query the server for device information of the television that is logged into the account upon startup; in some embodiments, the first APP may be further configured to receive a broadcast of a television within the local area network in response to triggering of the connection control or automatically upon initiation, according to the handset being within the local area network.
In some embodiments, if the mobile phone is not connected to any device through the first APP, after the first APP obtains a device that logs in to the same account as the mobile phone and/or a device that is in the same local area network as the mobile phone, the first APP may generate a device discovery page to display the obtained devices, and the user may click on a device, such as a television, on the discovery page, and send a connection request to the television, so as to establish a connection with the television. After the first APP is connected with the television, the parameter information can be acquired from a second APP of the television, and the second APP returns the parameter information to the mobile phone. The first APP obtains version information of the application supporting linkage of the television and license plate information of the television according to the parameter information, and obtains version capacity data of the television from the server according to the information. After the server returns the version capability data to the mobile phone, the first APP may add the television to the device list. In some embodiments, the first APP may further check whether the own capability data supports all control functions shown in the version capability data of the television, and configure an operation control to be displayed according to the control functions supported by both the capability data of the mobile phone and the version capability data of the television. For example, in some embodiments, after a user clicks a television in the device list, the first APP supports video call and infrared remote control of the mobile phone according to the version capability data of the television, the capability data of the mobile phone supports infrared remote control and the home message board, but does not support video call (for example, damage to a camera of the mobile phone results in a failure to make a video call), and then the mobile phone may display an operation control of the infrared remote control, and not display an operation control of the video call and an operation control of the home message board. In some embodiments, after the first APP verifies the capability data of the mobile phone, the device control interface shown in fig. 10 may be entered, and the operation control may be displayed on the interface.
In some embodiments, if the handset connects some devices through the first APP, the first APP may request the server to update the version capability data of these devices each time the user activates the first APP, and the first APP may display the list of devices as shown in fig. 9A when the user clicks the connection control within the first APP. Referring to fig. 9A, the status of each device may be displayed within a list of devices, such as: the status of the device may also include that the device is offline, where connection refers to connection with a cell phone, as shown in fig. 9B.
The user can select a device in the device list, which is in a state of 'device online unconnected', so that the mobile phone is connected with the device. In some embodiments, the first APP may be connected to only one device at the same time, the user may switch the first APP to connect to a different device, and when the user switches the connected device, the first APP may refresh the device control interface according to the version capability data of the device after the switching.
In some embodiments, different devices are connected through different device controls, and when a user selects a control or an entry control at a preset position of the control, the display of the current interface is reversed, and the display of the device control interface is performed, for example, see fig. 10A.
In some embodiments, the portal control may be a child control in the device control.
In some embodiments, as shown in fig. 9C, the default interface after the first APP is started may also be a recommended interface, and the user enters the function of the device control interface to display the terminal by selecting a preset control, for example, by selecting a "my" control to switch to the interface shown in fig. 10B.
Referring to fig. 10A, a television screen may be displayed on the upper portion of the device control interface, a function bar may be displayed on the bottom portion of the device control interface, and a content display area may be provided between the function bar and the display screen, where some television information, message notification, and operation controls may be displayed in the content display area. The function bar may present the following function options: "function", "manipulation", "speech" and "recommendation".
In some embodiments, the user may switch different controls in "function," "manipulation," "voice," and "recommendation" to change the display of the content presentation area, and when the function control is selected, the function presentation interface is displayed. In some embodiments, the function presentation interface is a default display interface after selecting the device to view.
In some embodiments, a controller in the terminal device receives an instruction input by a user for displaying the function display interface, and loads a function icon in a content display area of the function display interface according to APP version information displayed by a foreground in the connected display device.
In some embodiments, the instruction for displaying the function presentation interface may be an operation of selecting a certain device in the device list interface by the user, or an operation of selecting a preset function control.
In some embodiments, the instruction for displaying the function presentation interface may be an operation by which the user switches the device to which the terminal device is connected.
In some embodiments, for the same terminal device, the connection with the display device may be initiated by the terminal device after user selection by selecting the connected device at the list interface.
In some embodiments, the user switches the connected display devices by switching the network connection device control or the account connection device control.
In some embodiments, the terminal device is configured such that there is only one link for transmitting control instructions with the display device at the same time, due to the uniqueness of the need to control user operation, i.e. to avoid that the same control instructions are sent to different display devices.
In some embodiments, the user inputs an operation instruction for switching the connected device, the terminal device may disconnect from the display device before switching, and the display device after switching may establish a connection, for example, when the user selects one display device, a connection option may pop up after long pressing, and touch the connection option may implement inputting an operation instruction for switching the connected device, and when the terminal device is not connected to any one display device, the user may connect to one display device in the above manner.
In some embodiments, there may be multiple display devices communicatively coupled to the display device, but the user-selected device is determined to be the current display device and the other display devices are candidate display devices. The communication connection with the current display device is configured to be active and control instructions are sent by the terminal device to the current display device. The connections of the other candidate display devices and the terminal device are configured to be inactive. After the connection is switched, the active state of the communication connection between the display device before the switching and the display device after the switching is changed.
In some embodiments, the interface is displayed according to the parameter information refreshing function of the display device after switching, and if the display device before switching supports the "home message board" function, and the display device after switching does not support the "home message board" function, the "home message board" control is not displayed in the function display interface according to the parameter information refreshing function of the display device after switching. If the display equipment before switching does not support the video call function, the display equipment after switching supports the video call function, and a home message board control is added to the function display interface after refreshing according to the parameter information of the display equipment after switching. In some embodiments, a refreshing screen control can be displayed on the television picture displayed on the device control interface except the content display area, and the user clicks the refreshing screen control to manually refresh the television picture displayed on the mobile phone to be consistent with the latest picture of the television, so that the user can conveniently view the current display content of the connected television.
In some embodiments, the television information displayed in the content display area includes a television name, a device model, and license plate information, where in some embodiments, if the mobile phone does not obtain the television name, or the device model, or the license plate information, a "-" may be displayed at a location where the television name, or the device model, or the license plate information is displayed, indicating that the acquisition of the television information fails.
In some embodiments, an edit control may be displayed near the television name, the user clicking on the edit control, the television name modification window and input method keyboard shown in fig. 11 may be popped up, the cursor may be positioned into the input box, the user may modify the television name in the television name modification window using the input method keyboard, and in some embodiments, the television name may default to an upper limit of 20 words.
In some embodiments, a screen capture control may be displayed near the television name, and the user clicks on the screen capture control, and the mobile phone may capture the screen displayed by the television.
In some embodiments, the prompt and sharing control shown in FIG. 12 may be popped up after the screenshot is successful, an exemplary prompt such as "the screenshot has been saved to album".
In some embodiments, the user clicks the share control, the share window shown in FIG. 13 may be popped up, and the popped up prompt and share control may disappear after 4S defaults.
In some embodiments, after the user clicks on the screen capture control, the handset may refresh the television screen first, as shown in fig. 14, and during the refresh, may prompt that the screen is being refreshed at the television screen location of the device control interface.
In some embodiments, if the television and the mobile phone are connected in the same network, that is, the television and the mobile phone are in the same local area network, the mobile phone may preferentially use the same-network screen capturing function to obtain the screen capturing, if the mobile phone and the television are connected in a cross-network manner, for example, the mobile phone uses a data network, and the television uses a WIFI network, the same-network screen capturing function may be used to obtain the screen capturing, where the same-network screen capturing function may include directly obtaining, by the mobile phone, display screen data of the television in a point-to-point connection manner, and the cross-network screen capturing function may include obtaining, by the mobile phone, display screen data of the television through a server. If the television screen refreshing fails, as shown in fig. 15, the mobile phone can prompt the screen capturing failure and jump links, and the jump links can be underlined to display the following contents: "why every screen acquisition fails, point me knows", the user clicks the jump link, and then can enter the interface shown in fig. 16, in which the function bar under the content presentation area can select the "voice" option, so that the explanation information is displayed in the form of dialog box on the interface corresponding to the option, and the explanation information can include the reason of the screen capturing failure. In some embodiments, the reasons for the failed screen capture include that the television model does not support screen capture.
In some embodiments, the message notification presented by the content presentation area may present member-related information, e.g., a prompt for about to expire 7 days before the member expires, an expiration prompt within 3 days of the member expiration, and the user clicking on the message notification may jump to the member purchase page. In some embodiments, if the television does not log in to the account, a message notification corresponding to the member-related information may not be displayed. The operator of the television may configure the specific content of the message notification and the jump links of the message notification specifically.
In some embodiments, the content presentation area may also present some operational activities, such as the seven day activity shown in fig. 10A, for which the operator of the television may configure the content specifically.
In some embodiments, the content display area may display different content according to different currently selected function options in the function bar, where the function option selected by default in the function bar may be "function", and the user may click on another function option to cause the content display area to display different content.
In some embodiments, when the currently selected function option of the function bar is "function", the content presentation area may present the operation control obtained in step S103 of fig. 6A. In fig. 10A, the operation controls presented in the content presentation area include: video screen, music screen, photo screen, file screen, audio input density, application management, video call and home message board, and the functions corresponding to the operation controls are all functions supported by the mobile phone and the television of the example. If any one of the mobile phone and the television does not support a function, such as a home message board function, according to the scheme shown in fig. 6A-8, the operation control of the home message board will not be displayed in the content display area, so that the problem that the mobile phone or the television cannot realize the function and brings bad user experience to the user when the user clicks the operation control is avoided.
In some embodiments, when the currently selected function option in the function bar is "control", the content display area may display a remote controller interface as shown in fig. 17, where the remote controller interface may display a plurality of remote control keys, and the user may click on the remote control keys to make the mobile phone simulate a remote controller to control the television, such as turning off, adjusting volume, and so on. In some embodiments, the function of the analog remote controller does not require the mobile phone to support the infrared function, for example, the mobile phone can transmit a control signal to the television through bluetooth or WIFI, and according to the schemes shown in fig. 6A-8, if the mobile phone does not support the infrared function, after receiving a trigger signal of a remote control key of the interface from a user, the mobile phone can convert the signal into a control signal that can be identified by the television, so as to realize remote control to the television.
In some embodiments, when the currently selected function option of the function bar is "voice," the content presentation area may present a dialog interface as shown in fig. 18, which may present keyboard input controls, voice input controls, shortcut function controls, and dialog records. The left side of the dialogue record can be an input record of a user, and the right side of the dialogue record can be a response record of the mobile phone; the keyboard input control can be displayed as a keyboard shape, and after a user clicks the keyboard input control, as shown in fig. 19, the input text information can be input by the keyboard of the input method; the voice input control may be displayed as "hold talk" and the user holding the voice input control may input voice information; the shortcut function controls may include the following: "turn off television", "return to home", "mute", and "turn on kiwi". The mobile phone can respond to the voice information or text information input by the user or the click signal of the shortcut function control, so as to correspondingly control the television.
In some embodiments, when the currently selected function option in the function bar is "recommended", the mobile phone may request the server for recommended content to be displayed, and display the recommended interface shown in fig. 20 according to the recommended content issued by the server. Referring to fig. 20, the recommended content displayed by the recommended interface may be recommended media assets issued by the server according to license plate information of the television, for example, the server may issue some media assets on the warrior platform, such as "7 months carefully chosen collection of clips", "yulan winning works", to the mobile phone according to license plate information of the television; according to the Hua-Ding platform supporting installation of the "kiwi" application, the installation advertisement of the application is issued to the mobile phone, so that the mobile phone displays the installation advertisement, and in some embodiments, the installation advertisement can display an installation control, and a user clicks the installation control to install the application on a television.
In some embodiments, the function bar may present a plurality of function options according to the operator's configuration, and one default function bar may be to present the following function options: "function", "manipulation", "speech" and "recommendation". Referring to fig. 21, the function bar may also be configured to present 5 function options in a single row, or more function options in multiple rows. In some embodiments, the arrangement of the function options of the function bar is determined according to the number of function options, for example, if 6 function options need to be presented, two rows may be presented, each row presenting 3 function options; if 7 function options need to be displayed, two rows can be displayed, one row displays 3 function options, and the other row displays 4 function options; if 8 function options need to be displayed, two rows can be displayed, and each row displays 4 function options; if 9 function options need to be displayed, two rows can be displayed, one row displays 4 function options, and the other row displays 5 function options; if 10 function options need to be presented, two rows of 5 function options can be presented each.
As can be seen from the foregoing embodiments, the terminal device in the embodiments of the present application obtains the parameter information of the display device, and displays and controls the operation control of the display device according to the parameter information, so that according to different parameter information, different operation controls can be displayed, so that the operation control displayed by the terminal device can conform to the version support capability corresponding to the parameter information of the display device, thereby improving the probability of successful linkage between the terminal device and the display device, and improving the user experience.
Since the foregoing embodiments are all described in other modes by reference to the above, the same parts are provided between different embodiments, and the same and similar parts are provided between the embodiments in the present specification. And will not be described in detail herein.
It should be noted that in this specification, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a circuit structure, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such circuit structure, article, or apparatus. Without further limitation, the statement "comprises" or "comprising" a … … "does not exclude the presence of other identical elements in a circuit structure, article or apparatus that comprises the element.
Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure of the application herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims. The above embodiments of the present application do not limit the scope of the present application.

Claims (8)

1. A terminal device, comprising:
a terminal display;
a terminal controller connected to the terminal display, the terminal controller configured to:
responding to a connection display device instruction input by a user, establishing connection with a display device to control the display device through a device control interface by using the terminal device;
when the display equipment is first display equipment, before displaying the equipment control interface, sending a query request to the first display equipment for establishing connection so as to query first parameter information of the first display equipment, wherein the first parameter information is used for determining the identification of functions supported by the first display equipment and/or the identification of functions not supported by the first display equipment;
Receiving first parameter information of the first display device;
inquiring version capability data corresponding to the software version information and license plate information from a server according to the first parameter information of the first display device, wherein the version capability data comprises identifiers of functions supported by the first display device and/or identifiers of functions not supported by the first display device;
obtaining a first list of operation controls to be displayed corresponding to the first display device according to the identification of the functions supported by the first display device and/or the identification of the functions not supported by the first display device, wherein the first list comprises a first operation control and does not comprise a second operation control, the first operation control is a control corresponding to the identification of the functions supported by the first display device, and the second operation control is a control corresponding to the identification of the functions not supported by the first display device;
according to the first list of the operation controls to be displayed, controlling the terminal display to display the first operation control in the equipment control interface and not display the second operation control, wherein the first operation control and the second operation control are used for controlling different functions of the display equipment;
When the display device is a second display device, before displaying the device control interface, sending a query request to the second display device for establishing connection so as to query second parameter information of the second display device, wherein the second parameter information is used for determining an identifier of a function supported by the second display device and/or an identifier of a function not supported by the second display device, and the second parameter information is different from the first parameter information;
obtaining a second list of operation controls to be displayed corresponding to the second display device according to the identification of the functions supported by the second display device and/or the identification of the functions not supported by the second display device, wherein the second list is different from the first list;
and controlling the terminal display to display the control corresponding to the identifier of the function supported by the second display device in the device control interface according to the second list of the operation controls to be displayed, and not displaying the control corresponding to the identifier of the function not supported by the second display device.
2. The terminal device of claim 1, wherein the establishing a connection with the display device comprises:
Inquiring a display device which logs in the same account number as the terminal device from a server;
and establishing connection with a display device logging in the same account through the server.
3. The terminal device of claim 1, wherein the establishing a connection with the display device comprises:
acquiring a broadcast signal of at least one display device in a local area network where a terminal device is located;
and establishing connection with a display device transmitting the broadcast signal.
4. The terminal device of claim 1, wherein the controlling the terminal display to display the first operation control in the device control interface according to the first list of operation controls to be displayed comprises:
according to the local function of the terminal equipment, screening the first operation control supported by the local function from a first list of operation controls to be displayed so as to filter the first operation control not supported by the local function;
and controlling the terminal display to display the screened first operation control in the equipment control interface.
5. A method for linking a terminal device and a display device, for the terminal device, comprising:
Responding to a connection display device instruction input by a user, establishing connection with a display device to control the display device through a device control interface by using the terminal device;
when the display equipment is first display equipment, before displaying the equipment control interface, sending a query request to the first display equipment for establishing connection so as to query first parameter information of the first display equipment, wherein the first parameter information is used for determining the identification of functions supported by the first display equipment and/or the identification of functions not supported by the display equipment;
receiving first parameter information of the first display device;
inquiring version capability data corresponding to the software version information and license plate information from a server according to the parameter information of the first display device, wherein the version capability data comprises identifiers of functions supported by the first display device and/or identifiers of functions not supported by the first display device;
obtaining a first list of operation controls to be displayed corresponding to the first display device according to the identification of the functions supported by the first display device and/or the identification of the functions not supported by the first display device, wherein the first list comprises a first operation control and does not comprise a second operation control, the first operation control is a control corresponding to the identification of the functions supported by the first display device, and the second operation control is a control corresponding to the identification of the functions not supported by the first display device;
According to the first list of the operation controls to be displayed, controlling the terminal equipment to display the first operation control in the equipment control interface and not display the second operation control, wherein the first operation control and the second operation control are used for controlling different functions of the display equipment;
when the display device is a second display device, before displaying the device control interface, sending a query request to the second display device for establishing connection so as to query second parameter information of the second display device, wherein the second parameter information is used for determining an identifier of a function supported by the second display device and/or an identifier of a function not supported by the second display device, and the second parameter information is different from the first parameter information;
obtaining a second list of operation controls to be displayed corresponding to the second display device according to the identification of the functions supported by the second display device and/or the identification of the functions not supported by the second display device, wherein the second list is different from the first list;
and controlling the terminal equipment to display the control corresponding to the identifier of the function supported by the second display equipment in the equipment control interface according to the second list of the operation controls to be displayed, and not displaying the control corresponding to the identifier of the function not supported by the second display equipment.
6. A method for linking a terminal device and a display device, for the terminal device, comprising:
receiving an instruction of starting a mobile phone end linkage application by a user, displaying a home page of the mobile phone end linkage application, wherein the mobile phone end linkage application is used for controlling the display equipment;
establishing connection with a display device to control the display device through a device control interface using the terminal device;
when the display equipment is first display equipment, before displaying the equipment control interface, sending an acquisition request to a server to acquire version information of a television end linkage application of the first display equipment;
receiving an operation instruction input by a user for switching a display preset interface;
inquiring first version capability data of the first display device from a server according to version information of the television end linkage application, wherein the first version capability data comprises identifiers of functions supported by the first display device and/or identifiers of functions not supported by the first display device, and a first list of operation controls to be displayed corresponding to the first display device in the preset interface is obtained according to the identifiers of the functions supported by the first display device and/or the identifiers of the functions not supported by the first display device, the first list comprises a first operation control and does not comprise a second operation control, the first operation control is a control corresponding to the identifiers of the functions supported by the first display device, the second operation control is a control corresponding to the identifiers of the functions not supported by the first display device, the first operation control is displayed in the preset interface, and the second operation control is not displayed, wherein the first operation control and the second operation control are used for controlling different functions of the first display device;
And when the display device is a second display device, before displaying the device control interface, inquiring second version capability data of the second display device from a server, wherein the second version capability data comprises identifiers of functions supported by the second display device and/or identifiers of functions not supported by the second display device, the second version capability data is different from the first version capability data, a second list of operation controls to be displayed corresponding to the second display device in the preset interface is obtained according to the identifiers of the functions supported by the second display device and/or the identifiers of the functions not supported by the second display device, the second list is different from the first list, the terminal device is controlled to display the controls corresponding to the identifiers of the functions supported by the second display device in the device control interface according to the second list of operation controls to be displayed, and the controls corresponding to the identifiers of the functions not supported by the second display device are not displayed.
7. The method for linking a terminal device and a display device according to claim 6, wherein the establishing a connection with the display device comprises:
Receiving an instruction input by a user for connecting display equipment in the local area network;
responding to an instruction for connecting display equipment in a local area network, and establishing connection with the display equipment in the local area network;
or receiving an instruction input by a user for connecting display equipment with the same account;
and responding to an instruction of connecting the display equipment with the same account number, and establishing connection with the display equipment with the same account number through a server.
8. The method for linking a terminal device and a display device according to claim 7, wherein the establishing a connection with the display device comprises:
and responding to the instruction for starting the mobile phone end linkage application, and establishing connection with display equipment in the local area network.
CN202011264282.8A 2020-11-12 2020-11-12 Terminal equipment and method for linking terminal equipment and display equipment Active CN114489532B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202011264282.8A CN114489532B (en) 2020-11-12 2020-11-12 Terminal equipment and method for linking terminal equipment and display equipment
PCT/CN2021/117795 WO2022100261A1 (en) 2020-11-12 2021-09-10 Mobile terminal, server, display device, and control method for remote timed shutdown
CN202180068316.2A CN116368807A (en) 2020-11-12 2021-09-10 Mobile terminal, server, display device and control method for remote timing shutdown

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011264282.8A CN114489532B (en) 2020-11-12 2020-11-12 Terminal equipment and method for linking terminal equipment and display equipment

Publications (2)

Publication Number Publication Date
CN114489532A CN114489532A (en) 2022-05-13
CN114489532B true CN114489532B (en) 2023-11-10

Family

ID=81491002

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011264282.8A Active CN114489532B (en) 2020-11-12 2020-11-12 Terminal equipment and method for linking terminal equipment and display equipment

Country Status (1)

Country Link
CN (1) CN114489532B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297845A (en) * 2013-04-26 2013-09-11 东莞宇龙通信科技有限公司 Method and son-machine for realizing media playing
CN104519410A (en) * 2014-11-25 2015-04-15 四川长虹电器股份有限公司 Method and system for dynamically displaying intelligent terminal user interface
CN105978766A (en) * 2016-05-13 2016-09-28 京东方科技集团股份有限公司 Device, system and method for operating electric appliance through employing mobile terminal
CN106354542A (en) * 2016-08-27 2017-01-25 乐视控股(北京)有限公司 Method and device for generating application
WO2019036942A1 (en) * 2017-08-23 2019-02-28 华为技术有限公司 Display method and device
CN110139139A (en) * 2018-02-02 2019-08-16 华为技术有限公司 A kind of method for processing business, terminal, server and Related product
CN110381195A (en) * 2019-06-05 2019-10-25 华为技术有限公司 A kind of throwing screen display methods and electronic equipment
CN110928511A (en) * 2019-11-13 2020-03-27 讯飞幻境(北京)科技有限公司 Screen projection method and device and electronic equipment
CN111182614A (en) * 2020-01-08 2020-05-19 华为技术有限公司 Method and device for establishing network connection and electronic equipment
CN111246299A (en) * 2020-01-07 2020-06-05 聚好看科技股份有限公司 Communication terminal and application management method
CN111510898A (en) * 2020-04-16 2020-08-07 深圳创维数字技术有限公司 Miracast-based mirror image connection method, electronic product and storage medium
CN111726664A (en) * 2020-06-11 2020-09-29 海信视像科技股份有限公司 Method for controlling function operation of display device through mobile terminal and display device
CN111741372A (en) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 Screen projection method for video call, display device and terminal device
CN111787377A (en) * 2020-08-19 2020-10-16 青岛海信传媒网络技术有限公司 Display device and screen projection method

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297845A (en) * 2013-04-26 2013-09-11 东莞宇龙通信科技有限公司 Method and son-machine for realizing media playing
CN104519410A (en) * 2014-11-25 2015-04-15 四川长虹电器股份有限公司 Method and system for dynamically displaying intelligent terminal user interface
CN105978766A (en) * 2016-05-13 2016-09-28 京东方科技集团股份有限公司 Device, system and method for operating electric appliance through employing mobile terminal
CN106354542A (en) * 2016-08-27 2017-01-25 乐视控股(北京)有限公司 Method and device for generating application
WO2019036942A1 (en) * 2017-08-23 2019-02-28 华为技术有限公司 Display method and device
CN110139139A (en) * 2018-02-02 2019-08-16 华为技术有限公司 A kind of method for processing business, terminal, server and Related product
CN110381195A (en) * 2019-06-05 2019-10-25 华为技术有限公司 A kind of throwing screen display methods and electronic equipment
CN110928511A (en) * 2019-11-13 2020-03-27 讯飞幻境(北京)科技有限公司 Screen projection method and device and electronic equipment
CN111246299A (en) * 2020-01-07 2020-06-05 聚好看科技股份有限公司 Communication terminal and application management method
CN111182614A (en) * 2020-01-08 2020-05-19 华为技术有限公司 Method and device for establishing network connection and electronic equipment
CN111510898A (en) * 2020-04-16 2020-08-07 深圳创维数字技术有限公司 Miracast-based mirror image connection method, electronic product and storage medium
CN111726664A (en) * 2020-06-11 2020-09-29 海信视像科技股份有限公司 Method for controlling function operation of display device through mobile terminal and display device
CN111741372A (en) * 2020-07-08 2020-10-02 聚好看科技股份有限公司 Screen projection method for video call, display device and terminal device
CN111787377A (en) * 2020-08-19 2020-10-16 青岛海信传媒网络技术有限公司 Display device and screen projection method

Also Published As

Publication number Publication date
CN114489532A (en) 2022-05-13

Similar Documents

Publication Publication Date Title
CN111741372B (en) Screen projection method for video call, display device and terminal device
CN111050199B (en) Display device and scheduling method of Bluetooth communication resources of display device
CN111343489B (en) Display device and method for playing music in terminal
CN111752518A (en) Screen projection method of display equipment and display equipment
CN111405331B (en) Bluetooth Mesh device state updating method and display device
CN111208969A (en) Selection control method of sound output equipment and display equipment
CN112272417B (en) double-Bluetooth sound box reconnection method and display device
CN112073664B (en) Video call method and display device
CN112165642B (en) Display device
CN111277884A (en) Video playing method and device
WO2020248627A1 (en) Video call method and display device
CN112073762B (en) Information acquisition method based on multi-system display equipment and multi-system display equipment
CN112135180A (en) Content display method and display equipment
CN111343495A (en) Display device and method for playing music in terminal
CN112565740A (en) Fault diagnosis method, terminal device and display device
CN110958483A (en) Account synchronization method, device and system
CN112351334B (en) File transmission progress display method and display equipment
CN112040276B (en) Video progress synchronization method, display device and refrigeration device
CN112040535B (en) Wifi processing method and display device
CN116235522A (en) Display method and display device
CN111385631B (en) Display device, communication method and storage medium
CN112017415A (en) Recommendation method of virtual remote controller, display device and mobile terminal
CN111885665A (en) Wireless network connection control method and display device
CN114489532B (en) Terminal equipment and method for linking terminal equipment and display equipment
CN111263223A (en) Media volume adjusting method and display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant