CN115223521B

CN115223521B - Display equipment and relay equipment display method

Info

Publication number: CN115223521B
Application number: CN202210821610.2A
Authority: CN
Inventors: 卢可敬; 刘晨; 李金昆
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-07-12
Filing date: 2022-07-12
Publication date: 2024-04-30
Anticipated expiration: 2042-07-12
Also published as: CN115223521A

Abstract

The application discloses a display device and a relay device display method, wherein a display of the display device is used for displaying content, and a controller is configured to: responding to relay operation of a user, and acquiring an area identifier of first candidate relay equipment which supports first relay capability and is online, wherein the first relay capability is matched with the relay operation; determining a plurality of partitions of a first interface displayed by a display, wherein each partition in the plurality of partitions is used for displaying controls corresponding to candidate relay equipment, and each partition is determined according to the distance between the controls corresponding to the display equipment; and determining one of a plurality of partitions for displaying the control corresponding to the first candidate relay equipment according to the area identification of the display equipment, the area identification of the first candidate relay equipment and the plurality of partitions, and controlling the display to display the control corresponding to the first candidate relay equipment in the partition. The scheme of the application can enable the user to conveniently select the target relay equipment when the relay operation is performed.

Description

Display equipment and relay equipment display method

Technical Field

The application relates to the technical field of display, in particular to display equipment and a relay equipment display method.

Background

In some scenarios, for example, in a home, there are usually a plurality of terminal devices, such as smart televisions, refrigerator smart screens, smart speakers, etc., which can communicate with each other, and also can communicate with terminal devices outside the scenario based on a wide area network. Each terminal device may present content to a user, including but not limited to music, video, conversation, text, pictures, etc., that enable sharing and playback of content between devices, referred to as relay devices.

At present, the number of intelligent relay devices in a household is continuously increased, the linkage among the relay devices is also increased, and when a user uses a certain function, all the devices in the household can be displayed indiscriminately for the user to select, and the devices are mainly arranged in a general mode such as a list. However, the user cannot accurately distinguish the target devices to be linked based on the device list arranged in the general manner, and on the other hand, the arrangement manner without distinction among multiple devices also causes more complicated selection operation of the user.

Therefore, how to promote the operation convenience of the user when distinguishing the linked target devices in the relay device list is worth researching.

Disclosure of Invention

The application provides a display device and a relay device display method, which can enable a user to conveniently select target relay devices when relay operation is performed.

In a first aspect, some embodiments of the present application disclose a display apparatus, including:

A display for displaying content;

a communicator for communicating with an external device;

a controller in communication with the display, the controller configured to:

Responding to relay operation of a user, and acquiring an area identifier of first candidate relay equipment which supports first relay capability and is online, wherein the first relay capability is matched with the relay operation;

determining a plurality of partitions of a first interface displayed by the display, wherein each partition of the plurality of partitions is used for displaying controls corresponding to candidate relay equipment, and each partition is determined according to the distance between the controls corresponding to the display equipment;

and determining one of the multiple partitions for displaying the control corresponding to the first candidate relay equipment according to the area identification of the display equipment, the area identification of the first candidate relay equipment and the multiple partitions, and controlling the display to display the control corresponding to the first candidate relay equipment in the partition.

In a second aspect, some embodiments of the present application disclose a relay apparatus displaying method, the method comprising:

The method comprises the steps that a controller of a display device responds to relay operation of a user, and a region identifier of first candidate relay devices which support first relay capability and are online is obtained, wherein the first relay capability is matched with the relay operation;

The controller determines a plurality of partitions of a first interface displayed by a display of the display device, wherein each partition of the plurality of partitions is used for displaying controls corresponding to candidate relay devices, and each partition is determined according to the distance between the controls corresponding to the display device;

The controller determines one of the multiple partitions for displaying the control corresponding to the first candidate relay device according to the area identification of the display device, the area identification of the first candidate relay device and the multiple partitions, and controls the display to display the control corresponding to the first candidate relay device in the partition.

Compared with the prior art, the application has the beneficial effects that:

After a user triggers relay operation, the method acquires the area identification of the candidate relay equipment which supports the first relay capability and is in an on-line state, and then determines a plurality of partitions of a first interface displayed by the display, wherein each partition of the plurality of partitions is used for displaying a control corresponding to the candidate relay equipment, and each partition is determined according to the distance between the controls corresponding to the display equipment. Since each of the plurality of partitions is determined based on a distance between the partition and the control corresponding to the display device, the distance between each partition and the control corresponding to the display device is far or near. Because the area identifier of the display device 200 and the area identifier of the candidate relay device have the same or different relations, the relation characteristics of the candidate relay device and the area where the display device 200 is positioned and the relation characteristics of different subareas and the corresponding control of the display device are corresponding. Therefore, according to the area identifier of the display device 200, the area identifiers of the candidate relay devices and the plurality of partitions, the partition of the control corresponding to the candidate relay device can be accurately and orderly determined, and the control corresponding to the first candidate relay device is displayed on the partition. Based on the regional space dimension characteristics of the candidate relay devices and the plane dimension characteristics of the first interface, the candidate relay devices can be orderly arranged on the first interface, so that when a user selects a target relay device from a plurality of candidate relay devices, the operation path when the user selects the relay device is reduced to the greatest extent, and the convenience and experience of using the relay function by the user are improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application as claimed.

Drawings

In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

A schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments is schematically shown in fig. 1;

a hardware configuration block diagram of the control apparatus 100 according to some embodiments is exemplarily shown in fig. 2;

A hardware configuration block diagram of a display device 200 according to some embodiments is exemplarily shown in fig. 3;

FIG. 4 illustrates a software configuration block diagram of a common relay assembly, according to an exemplary embodiment;

A flow diagram of a relay apparatus presentation method according to some embodiments is schematically shown in fig. 5;

FIG. 6 is a schematic diagram of an example of multiple partitions provided in accordance with some embodiments of the application;

FIG. 7 is a schematic diagram of another example of multiple partitions provided in accordance with some embodiments of the application;

FIG. 8 is a schematic diagram of an example control distribution provided in accordance with some embodiments of the application;

FIG. 9 is a schematic diagram of an exemplary partition provided in accordance with some embodiments of the application;

FIG. 10 is a schematic illustration of an example control position change provided in accordance with some embodiments of the application;

Fig. 11 is a diagram illustrating an example relay device control presentation effect provided in accordance with some embodiments of the present application.

Detailed Description

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the terminal device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, the terminal device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the terminal device.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the terminal device 300, for example, the voice instruction control of the user may be directly received through a module for acquiring a voice instruction configured inside the display device 200, or the voice instruction control of the user may be received through a voice control device provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving image signals from the controller output, for displaying video content, image content, and a menu manipulation interface, and for manipulating a UI interface by a user.

In some embodiments, the display 260 may be a liquid crystal display, an OLED display, a projection device, and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

In some embodiments, the user interface may be configured to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone or the like, for receiving external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

And the CPU processor is used for executing the operating system and application program instructions stored in the memory and executing various application programs, data and contents according to various interaction instructions received from the outside so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, etc., according to a standard codec protocol of an input signal, and may obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And an image synthesis module, such as an image synthesizer, for performing superposition mixing processing on the graphic generator and the video image after the scaling processing according to the GUI signal input by the user or generated by the graphic generator, so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received frame rate into a video output signal and changing the video output signal to be in accordance with a display format, such as outputting RGB data signals.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the audio signal according to a standard codec protocol of an input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

In some embodiments, the system is divided into four layers, from top to bottom, an application layer (abbreviated as "application layer"), an application framework layer (Application Framework) layer (abbreviated as "framework layer"), a An Zhuoyun line layer (Android runtime) and a system library layer (abbreviated as "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

In some embodiments, the common relay component and the at least one content application are configured in an operating system of the terminal device. The content application refers to an application program that can provide content or present content, such as a camera application, a picture resource application, a picture viewing application, a video call application, a video play application, an audio call application, an audio resource application, a map application, a reading application, and the like. The content includes pictures, audio (including call audio, audio files, and live audio streams), video (including call video, video files, live video streams), text, geographic location information, navigation information, and the like. The content presentation includes displaying pictures, geographical location information or navigation information and text, playing video files, video call pictures and live broadcasting room pictures, playing audio files, call sounds and live broadcasting room sounds, etc. The public relay assembly is used for pushing the content presented by any one content application to the external terminal equipment so as to continuously broadcast on the external terminal equipment; and the content playing device is also used for receiving the content pushed by the public relay component on the external terminal equipment and the playing information thereof and continuously playing the content through the content with the capability of playing the content.

In some embodiments, any one of the content applications may push content to other terminal devices that may establish a communication connection through a common relay component, thereby eliminating the need to configure push content functionality on each of the content applications. Any one content application can receive the pushing of other terminal equipment to a certain content through the public relay assembly so as to continuously broadcast the content, and therefore the function of receiving the pushing of the content does not need to be configured on each content application. In the content pushing, receiving and continuing process, the common relay component on the pushing end device (receiving end device) is responsible for communicating with the common relay component on the receiving end device (pushing end device) so as to complete the content pushing, receiving and continuing process.

For convenience of explanation, the process of pushing, receiving and continuing the content, which is performed by the pushing end device and the receiving end device in cooperation, will be referred to as a relay process. The pushing end device is the terminal device which initiates the content pushing, and the receiving end device is the content pushing target, or is the terminal device which receives the content and relays the pushing end device to continue playing the content. Based on the data flow direction, the relationship between the pushing end device and the receiving end device may be described as that the pushing end device pushes a certain content to the receiving end device, and the receiving end device plays the content pushed by the pushing end device in a relay manner. It should be understood that, the terminal device according to the present application may be at least used as a receiving end device to relay and play the content pushed by other terminal devices, such as the smart speaker device to relay and play the song pushed by the mobile phone. The terminal equipment can be used as receiving end equipment and pushing content outwards, for example, a mobile phone pushes current songs to an intelligent sound box for continuous playing, and the mobile phone receives video programs pushed by an intelligent television for continuous playing.

Fig. 4 illustrates a software configuration block diagram of a common relay assembly, according to an exemplary embodiment. As shown in fig. 4, the common relay assembly includes an interaction hub module, a state management module, an interface display module, a protocol processing module, and a logic control module.

The interaction center module is used for carrying out interaction on the content application on the local terminal equipment. The interaction center module is internally provided with an SDK (software development kit) for calling each application program, and each application program interacts with the interaction center module by calling the SDK. For example, when a user triggers an operation for transferring the current content to a designated terminal device for playback in the content application, the content application notifies the interactive hub module to send by calling the aforementioned SDK so that the public relay component responds to the operation of the user. For another example, the interaction center module feeds back various status information in the content pushing process to the corresponding content application program.

The state management module is used for managing various state information generated in the process of interacting with other terminal equipment, such as state information representing success or failure of pushing, state information representing abnormal conditions, various notification messages and the like. The management includes, but is not limited to, classification information, discrimination information to make a corresponding process according to the discrimination result, information forwarding, and the like.

And the interface display module is used for displaying interface elements related to the relay flow, such as window objects, tabs, state information prompt boxes and various operable buttons in the user interface.

And the protocol processing module is used for selecting a protocol channel through which the terminal equipment interacts with other terminal equipment according to a preset rule, for example, selecting one of a local area network protocol channel and a wide area network protocol channel, so that the terminal equipment interacts information with other terminal equipment through the channel selected by the protocol processing module.

And the logic processing module is used for executing various logic controls involved in the relay flow, such as logic control under a certain working mode and logic control under the condition of multi-equipment interaction.

In some embodiments, the individual functional modules of the common relay component are deployed at the application layer. In other embodiments, the various functional modules of the common relay component may be deployed across layers, e.g., the interactive hub module and the interface presentation module may be deployed at the application layer, while other modules are deployed at other layers. The present application is not limited thereto. It should be noted that, to implement the content relay capability described above, the common relay component may include more or fewer modules, and is not limited to the software composition and architecture shown in fig. 4. Based on the functions of the public relay assembly according to the embodiment of the application, other components and architectures are designed to belong to the protection scope of the application.

In some embodiments, when a terminal device presents a certain content, relevant information of the content can be pushed to the terminal device appointed by the user in response to the control of the user, so that the terminal device appointed by the user can continue playing the content according to the relevant information of the content. For convenience of explanation, in the following embodiments, a terminal device that initiates content pushing is referred to as a pushing end device, and a terminal device that accepts content pushing and relay continuation is referred to as a receiving end device. It should be noted that the pushing device and the receiving device may be display devices having both an image display function and an audio output function, such as a television, a smart phone, a tablet computer, a refrigerator smart screen, or devices having only an audio output function and not having an image display function, such as a speaker device, a radio, and the like.

The terminal device can realize the functions through the built-in public relay assembly. Various implementations of the technical solution of the present application will be described in detail below by taking display-type devices and multimedia content as examples.

In some embodiments, after the display device is turned on and started, the public relay component is started, and then the call of any content application can be accepted.

In some embodiments, after a common relay component is started, the relay capabilities of all content applications in the system are scanned according to an operating system standard interface. Relay capability, as the name implies, refers to the ability of an application to render content, such as the type of content that can be rendered, the manner in which the rendering is performed, and the like. Taking a media application as an example, the content presentation capability may be the capability of playing a video file, including various parameters of a playable video file, and the like. When receiving the request of pushing content from the pushing end device, the receiving end device continues to play the content through the application program with the relay capability conforming to the content. For example, if the relay content is a video, the receiving end device needs to continue playing the video through the video playing application thereon; if the relay content is text, the receiving device may continue to display the text via a text application (e.g., notepad) thereon.

In some embodiments, the relay capability may have different levels, such as primary capability, secondary capability. From the practical functional considerations of the content application, the actual relay capability of the content application may be described by a single level of relay capability or a combination of levels of capabilities. It should be appreciated that the relay capabilities of each application may be customized according to its actual functionality. The data form and the data content of the capacity are not limited in the embodiment of the application. However, it should be noted that the relay capability applied to the terminal device determines what content can be played by the terminal device in a relay manner. That is, the relay capability applied at the terminal device determines the capability of the terminal device to relay other device content. For example, when an application that plays a certain content in a relay manner is not available on a certain terminal device, the terminal device cannot play the content in a relay manner, and thus cannot become a target receiving end device of the content.

In some embodiments, after the public relay component scans the relay capability of each application program, the relay capability data may be registered in a local area network protocol component of the terminal device, so that the local area network protocol component knows the relay capability of each content application program, where the local area network protocol component refers to a functional component for responding to the interaction information of an external device based on an instruction, a request, and the like sent by the local area network protocol channel. For example, when the first terminal device receives a capability query message sent by a second terminal device in the same local area network based on a local area network protocol channel, the relay capability of each application program pre-registered by the common relay component is fed back to the second terminal device, or a response is made to the capability query message, such as a response supporting a certain relay capability or not supporting a certain relay capability. Thus, the second terminal device can know the relay capability of the first terminal device and judge whether the first terminal device can be used as a receiving end device of a certain content according to the relay capability.

In other embodiments, after the public relay component scans the relay capability of each application, the relay capability data may be uploaded to the cloud server, so that the cloud server may query the relay capability of each application on the specified terminal device. For example, when the cloud server receives a query request sent by the first terminal device and used for querying the relay capability of the second terminal device, the relay capability data uploaded in advance by the second terminal device can be returned to the first terminal device in response to the query request. Therefore, the first terminal device can know the relay capability of the second terminal device through the cloud server, and judge whether the second terminal device can be used as a receiving terminal device of certain content according to the relay capability.

In other embodiments, after the common relay component scans the relay capability of each application, the relay capability data may be stored in a locally stored designated path, so that the local area network protocol component, the bluetooth protocol component, etc. may acquire the relay capability data in the designated path.

In some embodiments, the common relay component may select one or more of the foregoing manners according to a communication policy with other terminal devices to save the relay capability data of the local terminal device, where the communication policy refers to a communication channel, such as a lan protocol channel or a wan protocol channel, on which communication with other terminal devices is based. For example, if the terminal device is limited to communicating with other devices of the lan content based on the lan protocol channel, the common relay component may choose to register the relay capability data into the lan protocol component; if the terminal device can also communicate with a device outside the local area network based on the wide area network protocol channel, the public relay assembly can select to upload relay capability data to the cloud server so that other devices can know the relay capability of the terminal device through the cloud server.

In some embodiments, when the terminal device presents a certain content presented by a certain content application, the public relay component may search for a terminal device matching with the relay capability according to the relay capability of the content application, to obtain a device information list, where the device information list is the device information of the optional receiving end device. The user specifies the target pushing end device based on the device information list, and the public relay component can communicate with the target pushing end device based on a certain communication protocol channel to request the target pushing end device to relay and play the content. And the public relay component on the target pushing end equipment responds to the content, the content application with the relay capability is started, and the content is continuously played through the content application with the relay capability.

Notably, in a more specific implementation of the above embodiments, the content application on the push-end device needs to interact with the common relay component in response to user operations. The common relay component performs certain operations in response to the interaction information sent by the content application. In addition, since the common relay module has a function of presenting an interface object independent of the content application, a user can directly interact with the common relay module through the interface object provided by the common relay module to directly control the common relay module to perform certain operations. In other words, in a more specific implementation of the above-described embodiments, the common relay component on the push end device may perform certain operations in response to user input.

The hardware or software architecture in some embodiments may be based on the description in the foregoing embodiments, and in some embodiments may be based on other similar hardware or software architectures, so long as the technical solution of the present application may be implemented.

Based on the display device 200 described above, the user can acquire a relay device list through the display device 200. However, in the current terminal devices, since the number of terminal devices is continuously increased in the home, and the linkage between the terminal devices for relay is also increasing. When the user uses the relay capability manually, all the devices supporting the relay are displayed for the user to select, and are mainly arranged in a general mode such as a list at present. However, the indistinguishable arrangement manner makes it impossible for the user to accurately distinguish the target devices intended for the function relay, and the mixed arrangement among multiple devices also results in complicated operation of selecting the target devices by the user, and the operation path is long, so that the experience of the user is poor.

In order to solve the above-mentioned problems, some embodiments of the present application provide a display device and a relay device displaying method. In the following, the candidate relay apparatuses for relay will be referred to as candidate relay apparatuses, and the user may select a target relay apparatus from among a plurality of candidate relay apparatuses to perform a relay operation with the display apparatus 200.

The following describes the process of relay apparatus presentation provided by some embodiments of the present application with reference to the accompanying drawings.

A flow diagram of a relay apparatus presentation method according to some embodiments is schematically shown in fig. 5. The present application provides in some embodiments a display device 200 comprising a display 260, a communicator 220, and a controller 250, the controller 250 communicatively coupled to the display 260, the communicator 220 for communicating with an external device, the controller 250 configured to perform the process illustrated by the relay device in fig. 5. The process demonstrated by the relay apparatus in connection with fig. 5 is as follows:

s310, the controller 250 obtains the area identifier of the first candidate relay device in response to the relay operation of the user.

The first candidate relay equipment is equipment which supports first relay capability and is in an online state, and the first relay capability is matched with the relay operation.

The display device 200 is a terminal device that initiates content pushing, and the relay device is a terminal device that receives content and continues playing the content by the relay pushing terminal device. The relay capability refers to a function of pushing, receiving and continuing playing of a certain content, which is executed by the pushing end device (or receiving end device) based on the cooperation of the common relay component and the receiving end device (or pushing end device). For example, pushing, receiving and continuing playing of picture content or pushing, receiving and continuing playing of audio content is performed.

For example, when a user views a television episode on the display device 200 (living room television), the user should go to a kitchen to cook, and the kitchen refrigerator has a smart screen to support the relay capability of playing video. The display device 200 may push the video content to the refrigerator smart screen for continued play in response to a relay operation of the user regarding the play of the video relay. Thus, the user can continue watching the television episode through the intelligent screen of the refrigerator while cooking. For another example, a user listens to a song on a bedroom television, and needs to go to a living room, and the living room has a sound box to support the relay capability of playing audio. The user can push the song to the living room loudspeaker box for continuous playing through relay operation on the bedroom television.

In connection with the above example, the matching of the first relay capability and the relay operation means that the content of the user performing the relay operation is matched with the relay capability supported by the device, for example, the user performs the relay operation of video playing, and then both devices capable of performing the relay operation should support the relay capability of performing video playing.

It should be understood that the area identifier may be an identifier of an area within a home range, or may be an identifier of an area within another range that is customized according to needs.

In one example, a user may edit a home area identification of a device according to the home area in which the device is located when binding the terminal device to a server or when the server views device information. For example, the home zone identification under the user account is determined by the type of human primary activity, including kitchen, living room, bathroom, home lying. The user can edit the home zone identification of the television in the bedroom as the bedroom and edit the home zone identification of the television in the living room as the living room.

In one example, the manner of obtaining the region identification of the first candidate relay device includes:

The relay service module of the display device 200 transmits first request information to the server, the first request information including an identification of the display device and the first relay capability name, the first request information being used to acquire an identification of at least one candidate relay device that supports the first relay capability and is online. The display device 200 receives an identification of the at least one candidate relay device from the server, the at least one candidate relay device including the first candidate relay device. The display device 200 determines the area identification of the first candidate relay device based on the identification of the first candidate relay device.

The server determines a cloud device list according to the terminal device bound to the cloud by the user, wherein the content of the cloud device list comprises the identification of the device, the area identification of the device, the device name, whether the device supports relay and the relay capability. The server determines a cloud device list under the bound user account according to the identifier of the display device 200 of the first request information, and then determines a first relay capability device list supporting the first relay capability currently on line from the cloud device list according to the name of the first relay capability of the first request information, wherein devices in the first relay capability device list do not include the display device 200. The server sends the first relay capability device list to the display device 200, where the first relay capability device list includes the identification of the at least one candidate relay device, and may further include information in other columns in table one.

In the above manner, the display device 200 transmits the first request information to the server, where the first request information includes the identification of the display device 200 and the first relaying capability name, so that the server determines the identification of the candidate device supporting the relaying capability under the user account according to the identification of the display device 200 and the first relaying capability name, and transmits the first request information to the display device 200, thereby enabling the display device 200 to determine the location of the first candidate relaying device according to the identification of the candidate relaying device.

For example, the content of the cloud device list is as follows:

List one

As shown in table one, if the device does not support relay, its relay capability is defaulted to "none". If the user does not edit the area identifier of the device of the identifier 4 in the server, the area identifier is defaulted to be a keyword such as "custom name" which indicates that the area identifier name is abnormal.

The content of the first relay capability list determined by the server is shown in the following table two, the first relay capability is a playing video, and the server determines candidate relay devices available for the current relay scene according to the first relay capability:

Watch II

Identification of devices	Device name	Whether or not the device supports relay	Relay capability
				Sign 1	Television set	Is that	Playing video
Sign 2	Refrigerator with a refrigerator body	Is that	Playing video
				Sign 4	Television set	Is that	Playing video

As shown in table two, the identification of the device supporting the relay capability of playing video includes identification 1, identification 2, and identification 4.

Illustratively, the identification of the device is determined based on the device number and a media access Control (MEDIA ACCESS Control, MAC) address of the device.

For example, the identification is the factory serial number + MAC address of the device.

Illustratively, the display device 200 initiates an AI-intelligent internet of things controlled background service that obtains the device number and MAC address of the device through the display device 200 interface, and then generates the identification of the device (device number + MAC address) from the device number and MAC address.

In one example, determining the region identification of the first candidate relay device comprises:

The display device 200 sends relay device request information to the server, where the relay device request information includes an identifier of the display device and user account information bound by the display device, where the relay device request information is used to obtain relay device information matched with a relay capability of the display device under the user account, where the relay device information includes an identifier and an area identifier of at least one relay device, and may further include other information such as a device name, a relay capability, and the at least one relay device includes the first candidate relay device. The display device 200 receives the relay device information from the server and then determines a first association relationship for associating the identification of the device in the at least one relay device with the area identification of the device according to the relay device information.

When the display device 200 subsequently determines the area identifier of the first candidate relay device, the area identifier of the first candidate relay device is determined according to the first association relationship and the identifier of the first candidate relay device. If the name of the area identifier of the first candidate relay device is normal, the area identifier of the first candidate relay device in the first association relationship can be directly used in the subsequent operation. The method can rapidly acquire the area identification of the first candidate relay equipment.

The name of the area identifier of the first candidate relay device is normally that the user edits the area identifier of the first candidate relay device on the server, for example, the area identifier is edited into a living room, a bedroom, a kitchen and the like. In contrast, the abnormal name of the area identifier of the first candidate relay device means that the user does not edit the area identifier of the first candidate relay device on the server, and the server sets the area identifier of the first candidate relay device as a default value. The display device 200 cannot obtain the correct area identifier of the first candidate relay device according to the default value.

Illustratively, the user account information includes information for identifying the user, such as an account name, an account password, etc. registered by the user at the server.

The server receives the request information of the relay device, determines other devices supporting the relay, which are bound under the user account, according to the user account information bound by the display device, then determines all the relay capabilities supported by the devices according to the identification of the display device, then determines the relay capabilities of the devices supporting the relay, and if the relay capability of the device supporting the relay belongs to one of all the relay capabilities supported by the display device, determines the device as the relay device in the relay device information. The server determines relay device information from the identification of the relay devices and other information such as the area identification, and transmits the relay device information to the display 200.

Illustratively, the display device 200 periodically transmits third request information to the server, the third request information including an identification of the display device 200 and an internet protocol (Internet Protocol, IP) address of the wide area network, the third request information indicating that the display device 200 is in an online state. After receiving the third request message, the server obtains the identifier and the IP address of the device therein and determines that the display device 200 is in an on-line state. If the server does not receive the third request message for a certain period of time, it will be determined that the display device 200 is in an offline state. By the method, the server can monitor the communication connection state of all devices under the user account.

The server determines, for example, an identity of the device whose communication connection state is changed in the above manner, wherein the presence state change indicates that the device is changed from the presence state to the off-line state, and the off-line state change indicates that the device is changed from the off-line state to the on-line state, and then determines the first notification information based on the identity. The server transmits the first notification information to devices other than the communication connection state changing device. The display device 200 receives the first notification information from the server, and if the first notification information includes an identification of the device whose offline state is changed, re-transmits relay device request information to the server. The display device 200 receives the new relay device information transmitted from the server and updates the original relay device information stored locally according to the new relay device information. If the first notification information includes an identification of the device whose presence status has changed, the display device 200 deletes the relevant information of the device whose presence status has changed from the locally stored relay device information.

In the above manner, the server can monitor the communication connection state of all devices under the same user, and if the communication connection state is changed, notify all devices under the user, so that the device supporting relay can synchronously refresh the locally stored relay device information, so that the area identification of the device can be accurately determined according to the latest relay device information.

In one example, in the information of the relay device, there is information of a device with an abnormal name of the area identifier, and the display device 200 cannot use the area identifier with the abnormal name in the subsequent operation, so the display device 200 determines an area identifier abnormal device list according to the devices with the abnormal names of the area identifiers, and if the area identifier abnormal device list includes the first candidate relay device, the manner in which the display device 200 obtains the area identifier of the first candidate relay device further includes:

The display device 200 sends second request information to the device in the local area network to which the display device belongs in a broadcast or multicast mode, where the second request information includes an address of the local area network to which the display device is connected, and the second request information is used to obtain an identifier and a local name of the device in the local area network. The display device 200 then receives an identification and a local name from a device accessing the local area network, the device accessing the local area network including the first candidate relay device. Since the display device 200 may receive the identities and the local names of the devices sent by the plurality of devices, it is further required to determine whether the device is a device in the locally stored area identity abnormal device list according to the identities of the devices. After determining that the first candidate relay equipment is equipment with abnormal names of the area identifications, determining the area identifications of the first candidate relay equipment according to the local names of the first candidate relay equipment.

In the above manner, for the device with abnormal name of the area identifier, the display device 200 requests the local names of other devices through the local network, and further determines the corresponding area identifier by identifying the area identifier information in the local names.

For example, if the user does not edit the area identifier of the first candidate relay device on the server, and the server does not store the default value of the area identifier of the first candidate relay device, the relay device information sent to the display device by the server does not have the area identifier of the first candidate relay device, and in the first association relationship, the name of the area identifier of the first candidate relay device is an abnormal value, which also belongs to one of the abnormal name cases of the area identifier.

Illustratively, the second request information is transmitted in a data packet contained in a transmission control protocol (Transmission Control Protocol, TCP)/user datagram protocol (User Datagram Protocol, UDP) format.

For example, the first candidate relay device is a device corresponding to the identifier 4 in the table one, and the area identifier thereof is a default "custom name", so that the area identifier of the first candidate relay device needs to be determined according to the local name of the first candidate relay device.

Further, the display device 200 may obtain and determine all the area identifiers under the user account of the first candidate relay device in the server, and then determine whether the area identifiers of the first candidate relay device belong to all the area identifiers under the user account stored in the server. If the first candidate relay device belongs to the local relay device, the area identification in the local name is directly determined to be used as the area identification of the first candidate relay device. If not, the first candidate relay device is identified as a non-regional device. Or the local name of the device does not have the area identification information, and the first candidate relay device is identified as the device without the area.

Illustratively, the manner in which the first candidate relay device determines and transmits the identity and the native name of the device includes:

After the first candidate relay equipment receives the second request information, the identification of the first candidate relay equipment is obtained, and then the corresponding value of the local name is filtered in the whole machine storage information through the whole machine interface so as to obtain the local name. The first candidate relay device determines second response information according to the identification and the local name thereof, and sends the second response information to the display device 200 in the second request information in a unicast manner according to the local area network IP address thereof. The second response information is illustratively contained in a data packet of TCP/UDP.

For example, the local name of the first candidate relay device is "living room television", and after identifying "television", the location included in the local name is further identified as "living room".

S320, the display apparatus 200 determines a plurality of partitions of the first interface displayed by the display.

Each partition of the plurality of partitions is used for displaying controls corresponding to candidate relay equipment, wherein each partition is determined according to the distance between the controls corresponding to the display equipment. The distance between a partition and a control is related to all pixels that the partition includes on the display screen and all pixels that the control includes on the display screen.

The priority of each partition is determined according to the distance between the partition and the control corresponding to the display device, and the smaller the distance between the partition and the control corresponding to the display device is, the higher the priority of the partition is. The plurality of partitions comprise a first partition, the distance between the first partition and a control corresponding to the display device is smaller than a first threshold, the plurality of partitions comprise a second partition, and the distance between the second partition and the control corresponding to the display device is larger than the distance between the first partition and the control corresponding to the display device. The priority of the first partition is higher than the second partition, and the priority of the first partition may be changed by setting a first threshold, for example, by setting the first threshold such that the priority of the first partition is highest. Further, the plurality of partitions further includes a third partition, and a distance between the third partition and a control corresponding to the display device is greater than a distance between the second partition and a control corresponding to the display device. The third partition has a lower priority than the second partition.

For example, the plurality of partitions are circular rings of different sizes centered about corresponding controls of the display device 200, as shown in FIG. 6. Presentation of the partitions on the display screen the application is not limited and for example the plurality of partitions may also be arranged as shown in fig. 7.

S330, the display device 200 determines a partition for displaying the control corresponding to the first candidate relay device, and displays the control.

Specifically, the display device 200 determines one of the multiple partitions for displaying the control corresponding to the first candidate relay device according to the area identifier of the display device, the area identifier of the first candidate relay device, and the multiple partitions, and controls the display to display the control corresponding to the first candidate relay device in the partition.

In one example, the display device 200 determines whether the area identifier of the display device is the same as the area identifier of the first candidate relay device, and if so, determines that the partition in which the control corresponding to the first candidate relay device is located is the first partition.

For example, as shown in fig. 8, the display device 200 is a sound box in a living room, the user wants to turn off the sound box to continue listening to the song on the television in the living room, the television in the living room is a first candidate relay device, the control a corresponding to the television in the living room is located in the first partition, and the user can drag the control a to the control corresponding to the display device 200 to complete the relay operation, so that the user can continue listening to the song on the television in the living room.

In the above manner, if the area identifier of the display device is the same as the area identifier of the first candidate relay device, it indicates that the display device 200 and the first candidate relay device are in the same area, and the first candidate relay device is more likely to be the target relay device of the user. And displaying the corresponding control of the first candidate relay equipment in a first partition with higher priority, so that a user can conveniently select the first candidate relay equipment as a relay target equipment, and the experience of the user is further improved.

In one example, if the area identifier of the display device is different from the area identifier of the first candidate relay device, or the first candidate relay device is a device without an area, the display device 200 determines that the partition where the control corresponding to the first candidate relay device is located is the second partition, or

The display device 200 further determines whether the device type of the display device is the same as the device type of the first candidate relay device, if so, determines that the partition where the control corresponding to the first candidate relay device is located is the second partition, and if not, determines that the partition where the control corresponding to the first candidate relay device is located is the third partition.

Illustratively, the device types are distinguished according to the main functions of the device, such as a television, a cellular phone, a notebook computer, a refrigerator, etc.

In the case that the area identifier of the display device 200 is different from the area identifier of the first candidate relay device, the method determines the partition where the corresponding control of the first candidate relay device is located based on whether the device type of the first candidate relay device is the same as the device type of the display device 200, so that the ordering of the corresponding control arrangement of the candidate relay device in the first interface is further improved.

In one example, if the display device 200 is identified as a device without a region, since it cannot be further determined whether the region identification between the display device 200 and the candidate relay device is the same, it may be specified that the control corresponding to the candidate relay device is not displayed in the first partition, and then, based on whether the device type of the candidate relay device is the same as the device type of the display device 200, if so, it is determined that the partition in which the control corresponding to the candidate relay device is located is the second partition, and if not, it is determined that the partition in which the control corresponding to the first candidate relay device is located is the third partition.

Of course, if the control corresponding to the candidate relay device may be displayed in the first partition, it may also be determined that the partition where the control corresponding to the candidate relay device is located is the first partition based on whether the device type of the candidate relay device is the same as the device type of the display device 200, and if not, it is determined that the partition where the control corresponding to the candidate relay device is located is the second partition.

In one example, when a control corresponding to a plurality of candidate relay devices is displayed in one partition, the display device 200 divides the first partition into a plurality of sub-partitions according to the number of candidate relay devices displayed in the first partition, then determines a priority of each sub-partition in the plurality of sub-partitions, and then determines a device type of the fourth candidate relay device. If the equipment type of the fourth candidate relay equipment is the same as the equipment type of the display equipment, determining that the control corresponding to the fourth candidate relay equipment is in the sub-partition with the priority meeting the first preset condition.

Illustratively, the display device 200 divides the first partition into a plurality of sub-partitions according to the number of candidate relay devices shown in the first partition, and then distributes the sub-partitions to the first partition according to the habit of the user in a clockwise direction or a counterclockwise direction in the look and feel of the user. Then defining the first sub-partition with highest priority in the direction according to the clockwise direction or the anticlockwise direction, and setting other sub-partitions along the direction, wherein the corresponding priorities of the other sub-partitions are lower and lower. If the equipment type of the fourth candidate relay equipment is the same as the equipment type of the display equipment, determining that the control corresponding to the fourth candidate relay equipment is in the first sub-partition, and if the control corresponding to the fourth candidate relay equipment is different from the first sub-partition, determining that the control corresponding to the fourth candidate relay equipment is in other sub-partitions except the first sub-partition.

For example, as shown in fig. 9, the plurality of sub-partitions are arranged in the first partition in a counterclockwise direction in the user's look and feel, and the first sub-partition has a higher priority than the second sub-partition, and the second sub-partition has a higher priority than the third sub-partition.

Because the same relay function among the relay devices with the same device type is more, the device type of the candidate relay device is the same as the display device 200 as a high-priority device, and the device type of the candidate relay device is different from the display device 200 as a low-priority device under the condition that the plurality of candidate relay devices are in the first partition. And then, according to the habit of dragging the relay equipment by the user, the arrangement mode of the sub-partitions is set, and the control corresponding to the high-priority equipment is displayed in the sub-partition which is more convenient for the user to operate, so that the operation path of the user in dragging the relay equipment is further reduced.

In one example, the first partition is further used for displaying a control corresponding to the second candidate relay device, and the second partition is further used for displaying a control corresponding to the third candidate relay device, so as to avoid the problem that the second candidate relay device is likely to be touched to change the candidate relay device or cause other adverse effects in the process of dragging the control corresponding to the third candidate relay device to the control corresponding to the display device 200, the problem is simply referred to as a dragging conflict problem of the control corresponding to the candidate relay device in different partitions, and the application further provides the following scheme:

The display device 200 determines a first connection between the control corresponding to the second candidate relay device and the control corresponding to the display device, and then determines a second connection between the control corresponding to the third candidate relay device and the control corresponding to the display device. And if the angle between the first connecting line and the second connecting line is smaller than or equal to a second threshold value, the position of the control corresponding to the third candidate relay equipment displayed in the second partition is redetermined according to the first connecting line and the second connecting line, so that the angle between the first connecting line and the second connecting line is larger than the second threshold value.

The second threshold is a criterion for judging whether the second candidate relay equipment and the third candidate relay equipment have the dragging conflict problem, the second threshold can be set according to actual needs, and since the angle between the first connection and the second connection is two, namely the angle alpha and the angle (360-alpha), the application can only consider the angle alpha, namely the second threshold is further limited to be smaller than 90 degrees.

The connection mode between the two controls can be determined according to actual needs, for example, respective focuses of the two controls are determined, and then a line segment between the two focuses is used as a connection line between the two controls.

For example, if the angle between the first connecting line and the second connecting line is 0 degrees, the third candidate relay device corresponding control and the second candidate relay device corresponding control are located on the same horizontal line, and when the third candidate relay device corresponding control is dragged to the position of the second candidate relay device corresponding control, the two candidate relay device corresponding controls may be simultaneously dragged, or the third candidate relay device cannot be continuously dragged and returns to the original position, and the dragging candidate relay device is inaccurate due to dragging of the second candidate relay device.

As shown in fig. 8, the control a is a control corresponding to the second candidate relay device, the control B is a control corresponding to the third candidate relay device, the connection line on the control a is a first connection line, and the connection line on the control B is a second connection line. The angle between the first wire and the second wire is θ.

In view of the above, in order to avoid the candidate relay equipment corresponding control on the inner ring corresponding to the candidate relay equipment corresponding control when dragging the candidate relay equipment corresponding control on the first interface to the display equipment 200 corresponding control to realize relay operation, the present application adopts a scheme that the angle between the first connecting line and the second connecting line is greater than the second threshold, so that the above problem can be avoided, and the fluency of dragging the candidate relay equipment is improved.

In one example, re-determining the position of the control corresponding to the third candidate relay device in the second partition such that the angle between the first link and the second link is greater than the second threshold includes:

Determining a sub-partition where a control corresponding to a third candidate relay device is located, determining a moving path of the control corresponding to the third candidate relay device, and moving the control corresponding to the third candidate relay device on the moving path until an angle between the first connecting line and the second connecting line is larger than the second threshold value.

As shown in fig. 10, the moving path extends to two directions with the control B corresponding to the third candidate relay device as the origin, moves the control corresponding to the third candidate relay device to one of the directions, and if the end of the moving path in the direction cannot make the angle between the first connection line and the second connection line larger than the second threshold value, moves the control corresponding to the third candidate relay device to the other direction until the angle between the first connection line and the second connection line is larger than the second threshold value. And if the end of the moving path in the direction can not enable the angle between the first connecting line and the second connecting line to be larger than the second threshold value, displaying the control corresponding to the third candidate relay equipment in the middle of the sub-partition. The final relay apparatus display effect diagram is shown in fig. 11.

By adopting the mode, the position of the control can be quickly and effectively adjusted until the angle between the first connecting line and the second connecting line is larger than the fourth threshold value by setting the adjustment direction of the position of the control in the sub-partition.

As can be seen from the foregoing embodiments, after a user triggers a relay operation, the present application obtains an area identifier of a candidate relay device that supports the first relay capability and is in an online state, and then determines a plurality of partitions of a first interface displayed by the display, where each partition of the plurality of partitions is used to display a control corresponding to the candidate relay device, and each partition is determined according to a distance between the controls corresponding to the display device. Since each of the plurality of partitions is determined based on a distance between the partition and the control corresponding to the display device, the distance between each partition and the control corresponding to the display device is far or near. Because the area identifier of the display device 200 and the area identifier of the candidate relay device have the same or different relations, the relation characteristics of the candidate relay device and the area where the display device 200 is positioned and the relation characteristics of different subareas and the corresponding control of the display device are corresponding. Therefore, according to the area identifier of the display device 200, the area identifiers of the candidate relay devices and the plurality of partitions, the partition of the control corresponding to the candidate relay device can be accurately and orderly determined, and the control corresponding to the first candidate relay device is displayed on the partition.

Based on the same inventive concept as the display device, some embodiments of the present application further provide a relay device displaying method, including:

The controller 250 of the display device 200 obtains an area identifier of a first candidate relay device which supports a first relay capability and is online in response to a relay operation of a user, wherein the first relay capability is matched with the relay operation;

The controller 250 determines a plurality of partitions of a first interface displayed by a display of the display device, each partition of the plurality of partitions being configured to display controls corresponding to candidate relay devices, wherein each partition is determined according to a distance between controls corresponding to the display device;

The controller 250 determines one of the multiple partitions for displaying the control corresponding to the first candidate relay device according to the area identifier of the display device, the area identifier of the first candidate relay device, and the multiple partitions, and controls the display 260 to display the control corresponding to the first candidate relay device in the one partition.

Since the foregoing embodiments are all described in other modes by reference to the above, the same parts are provided between different embodiments, and the same and similar parts are provided between the embodiments in the present specification. And will not be described in detail herein.

It should be noted that in this specification, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a circuit structure, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such circuit structure, article, or apparatus. Without further limitation, the statement "comprises" or "comprising" a … … "does not exclude that an additional identical element is present in a circuit structure, article or apparatus that comprises the element.

Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure of the application herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

The above embodiments of the present application do not limit the scope of the present application.

Claims

1. A display device, the display device comprising:

A display for displaying content;

a communicator for communicating with an external device;

a controller in communication with the display, the controller configured to:

Determining a plurality of partitions of a first interface displayed by the display, wherein each partition of the plurality of partitions is used for displaying controls corresponding to candidate relay equipment, each partition is determined according to the distance between the controls corresponding to the display equipment, the plurality of partitions comprise the first partition, and the distance between the first partition and the controls corresponding to the display equipment is smaller than a first threshold;

determining one of the multiple partitions for displaying the control corresponding to the first candidate relay equipment according to the area identification of the display equipment, the area identification of the first candidate relay equipment and the multiple partitions, and determining whether the area identification of the display equipment is identical to the area identification of the first candidate relay equipment; if the control is the same, determining the partition where the control corresponding to the first candidate relay equipment is located as the first partition; and controlling the display to display a control corresponding to the first candidate relay equipment in the partition;

The first partition is further configured to present a control corresponding to a fourth candidate relay device, the controller being further configured to:

dividing a plurality of sub-partitions into a first partition according to the number of candidate relay devices displayed in the first partition;

Determining a priority of each sub-partition of the plurality of sub-partitions;

determining a device type of the fourth candidate relay device;

if the equipment type of the fourth candidate relay equipment is the same as the equipment type of the display equipment, determining that the control corresponding to the fourth candidate relay equipment is in the sub-partition with the priority meeting the first preset condition.

2. The display device of claim 1, wherein the plurality of partitions includes a second partition, a distance between the second partition and a control corresponding to the display device is greater than a distance between the first partition and a control corresponding to the display device, and the determining a partition in which a control corresponding to the first candidate relay device is located is further configured to, if a region identification of the display device is not the same as a region identification of the first candidate relay device:

determining whether the device type of the display device and the device type of the first candidate relay device are the same;

And if the first candidate relay equipment is the same, determining the partition where the control corresponding to the first candidate relay equipment is located as the second partition.

3. The display device of claim 2, wherein the controller is further configured to:

determining a control corresponding to the second candidate relay equipment displayed in the first partition;

Determining a control corresponding to the third candidate relay equipment displayed in the second partition;

determining a first connecting line between a control corresponding to the second candidate relay equipment and a control corresponding to the display equipment;

determining a second connecting line between a control corresponding to the third candidate relay equipment and a control corresponding to the display equipment;

And if the angle between the first connecting line and the second connecting line is smaller than or equal to a second threshold value, the position of the control corresponding to the third candidate relay equipment displayed in the second partition is redetermined according to the first connecting line and the second connecting line, so that the angle between the first connecting line and the second connecting line is larger than the second threshold value.

4. The display device of claim 1, wherein the obtaining the area identification of the first candidate relay device that supports the first relay capability and is online is further configured to:

transmitting first request information to a server, wherein the first request information comprises an identifier of the display device and the first relay capability name, and the first request information is used for acquiring an identifier of at least one candidate relay device which supports the first relay capability and is online;

Receiving an identification of the at least one candidate relay device from the server, the at least one candidate relay device including the first candidate relay device;

and determining the area identification of the first candidate relay equipment according to the identification of the first candidate relay equipment.

5. The display device of claim 4, wherein the determining the area identity of the first candidate relay device from the identity of the first candidate relay device is further configured to:

Transmitting relay equipment request information to the server, wherein the relay equipment request information comprises an identifier of the display equipment and user account information bound by the display equipment, the relay equipment request information is used for acquiring relay equipment information matched with the relay capability of the display equipment under the user account, the relay equipment information comprises an identifier and an area identifier of at least one relay equipment, and the at least one relay equipment comprises the first candidate relay equipment;

receiving the relay equipment information from a server;

Determining a first association relation according to the relay equipment information, wherein the first association relation is used for associating the identifier of the at least one relay equipment with the region identifier;

And determining the area identification of the first candidate relay equipment according to the first association relation and the identification of the first candidate relay equipment, wherein the name of the area identification of the first candidate relay equipment is normal.

6. The display device of claim 5, wherein if the name of the area identifier of the first candidate relay device is abnormal, the controller is further configured to:

Sending second request information, wherein the second request information comprises an address of a local area network accessed by the display equipment, and the second request information is used for acquiring an identifier and a local name of equipment in the local area network;

Receiving an identification and a local name from a device accessing the local area network, wherein the device accessing the local area network comprises the first candidate relay device;

Determining equipment with abnormal names of locally stored area identifiers according to the identifiers of the first candidate relay equipment;

And determining the area identification of the first candidate relay equipment according to the local name of the first candidate relay equipment.

7. The display device of claim 6, wherein the controller is further configured to:

Determining all area identifiers under the user account in the server;

determining whether the area identifiers of the first candidate relay equipment belong to all the area identifiers under the user account stored on a server;

if not, the first candidate relay device is identified as a non-regional device.

8. A method of relay apparatus display, the method comprising:

The controller determines a plurality of partitions of a first interface displayed by a display of the display device, each partition of the plurality of partitions is used for displaying controls corresponding to candidate relay devices, wherein each partition is determined according to a distance between the controls corresponding to the display device, the plurality of partitions comprise first partitions, and the distance between the first partition and the controls corresponding to the display device is smaller than a first threshold;

The controller determines one of the multiple partitions for displaying the control corresponding to the first candidate relay device according to the area identification of the display device, the area identification of the first candidate relay device and the multiple partitions, and determines whether the area identification of the display device is identical to the area identification of the first candidate relay device; if the control is the same, determining the partition where the control corresponding to the first candidate relay equipment is located as the first partition; and controlling the display to display a control corresponding to the first candidate relay equipment in the partition;

determining a device type of the fourth candidate relay device;