CN115223521A

CN115223521A - Display device and relay device display method

Info

Publication number: CN115223521A
Application number: CN202210821610.2A
Authority: CN
Inventors: 卢可敬; 刘晨; 李金昆
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-07-12
Filing date: 2022-07-12
Publication date: 2022-10-21
Anticipated expiration: 2042-07-12
Also published as: CN115223521B

Abstract

The application discloses a display device and a relay device display method, wherein a display of the display device is used for displaying content, and a controller is configured to: responding to relay operation of a user, and acquiring an area identifier of a first candidate relay device which supports a first relay capacity and is online, wherein the first relay capacity is matched with the relay operation; determining a plurality of partitions of a first interface displayed by a display, wherein each partition in the plurality of partitions is used for displaying a control corresponding to the candidate relay device, and each partition is determined according to the distance between the controls corresponding to the display device; and determining one partition of a plurality of partitions for displaying the control corresponding to the first candidate relay device according to the area identifier of the display device, the area identifier of the first candidate relay device and the plurality of partitions, and controlling a display to display the control corresponding to the first candidate relay device in the partition. According to the scheme, the user can conveniently select the target relay equipment when carrying out relay operation.

Description

Display device and relay device display method

Technical Field

The application relates to the technical field of display, in particular to a display device and a relay device display method.

Background

In some scenes, for example, in a home, a plurality of terminal devices, such as a smart television, a smart screen of a refrigerator, a smart speaker, and the like, are generally present, and these terminal devices may communicate with each other and may communicate with terminal devices outside the scene based on a wide area network. Each terminal device may present content to a user, including but not limited to music, video, calls, text, pictures, etc., which enable sharing and playback of content among devices, referred to as relay devices.

At present, the number of intelligent relay devices in a family is increased continuously, linkage among the relay devices is increased more and more, when a user uses a certain function, all the devices in the family can be displayed indiscriminately to be selected by the user, and the devices are mainly arranged in a list and other general ways. However, the user cannot accurately distinguish the target devices to be linked based on the device list arranged in the general manner, and on the other hand, the arrangement manner in which the devices are not distinguished causes the selection operation of the user to be more complicated.

Therefore, how to improve the operation convenience of the user in distinguishing the linked target devices in the relay device list is worth researching.

Disclosure of Invention

The application provides a display device and a relay device display method, which can enable a user to conveniently select a target relay device when carrying out relay operation.

In a first aspect, some embodiments of the present application disclose a display apparatus, including:

a display for displaying content;

a communicator for communicating with an external device;

a controller communicatively coupled with the display, the controller configured to:

responding to relay operation of a user, and acquiring an area identifier of a first candidate relay device which supports a first relay capability and is online, wherein the first relay capability is matched with the relay operation;

determining a plurality of partitions of a first interface displayed by the display, wherein each partition is used for displaying a control corresponding to a candidate relay device, and each partition is determined according to a distance between the controls corresponding to the display device;

and determining one of the plurality of partitions for displaying the control corresponding to the first candidate relay device according to the area identifier of the display device, the area identifier of the first candidate relay device and the plurality of partitions, and controlling the display to display the control corresponding to the first candidate relay device in the partition.

In a second aspect, some embodiments of the present application disclose a method for displaying a relay device, the method including:

the method comprises the steps that a controller of a display device responds to relay operation of a user, and obtains an area identifier of a first candidate relay device which supports a first relay capacity and is on-line, wherein the first relay capacity is matched with the relay operation;

the controller determines a plurality of partitions of a first interface displayed by a display of the display device, wherein each partition is used for displaying a control corresponding to a candidate relay device, and each partition is determined according to a distance between the controls corresponding to the display device;

the controller determines one of the plurality of partitions for displaying the control corresponding to the first candidate relay device according to the area identifier of the display device, the area identifier of the first candidate relay device and the plurality of partitions, and controls the display to display the control corresponding to the first candidate relay device in the partition.

Compared with the prior art, the beneficial effects of this application do:

according to the method and the device, after a user triggers relay operation, area identification of candidate relay equipment which supports the first relay capacity and is in an online state is obtained, then a plurality of partitions of a first interface displayed by a display are determined, each partition in the plurality of partitions is used for displaying a control corresponding to the candidate relay equipment, and each partition is determined according to the distance between the partitions corresponding to the display equipment. Because each partition in the plurality of partitions is determined according to the distance between the partition and the control corresponding to the display device, the distance from each partition to the control corresponding to the display device is far or near. Since the area id of the display device 200 and the area id of the candidate relay device have the same or different relationship, the relationship between the candidate relay device and the area of the display device 200 and the relationship between the different partitions and the corresponding controls of the display device are corresponding to each other. Therefore, according to the area identifier of the display device 200, the area identifier of the candidate relay device, and the plurality of partitions, the partition corresponding to the control of the candidate relay device can be accurately and orderly determined, and the control corresponding to the first candidate relay device is displayed on the partition. Based on the regional space dimension characteristics of the candidate relay devices and the plane dimension characteristics of the first interface, the candidate relay devices can be orderly arranged on the first interface, so that when a user selects a target relay device from a plurality of candidate relay devices, the operation path of the user selecting the relay device is reduced to the greatest extent, and the convenience and experience of the user using the relay function are improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic diagram illustrating an operational scenario between a display device and a control apparatus according to some embodiments;

a block diagram of the hardware configuration of the control device 100 according to some embodiments is illustrated in fig. 2;

a block diagram of a hardware configuration of a display device 200 according to some embodiments is illustrated in fig. 3;

FIG. 4 illustrates a block diagram of a software configuration of a common relay component in accordance with an exemplary embodiment;

fig. 5 is a flow diagram illustrating a relay device display method according to some embodiments;

FIG. 6 is a schematic diagram of an example of multiple partitions provided herein according to some embodiments;

FIG. 7 is a schematic illustration of yet another example of a plurality of partitions provided herein according to some embodiments;

FIG. 8 is a schematic diagram of an example control distribution provided herein according to some embodiments;

FIG. 9 is a schematic illustration of an example partition provided herein according to some embodiments;

FIG. 10 is a schematic diagram of an example change in position of a control provided by the present application in accordance with some embodiments;

fig. 11 is a diagram illustrating an example of a relay device control presentation effect according to some embodiments of the present disclosure.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the foregoing drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily intended to limit the order or sequence in which they are presented unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, the user may operate the display device 200 through the terminal device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200.

In some embodiments, the terminal device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the terminal device.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the terminal device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.

In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.

In some embodiments the controller comprises a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, performing display of video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

In some embodiments, the display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the external control apparatus 100 or the server 400 through the communicator 220.

In some embodiments, the user interface may be configured to receive control signals for controlling the apparatus 100 (e.g., an infrared remote control, etc.).

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.

In some embodiments, the controller includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphic Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.

And the CPU is used for executing the operating system and the application program instructions stored in the memory and executing various application programs, data and contents according to various interaction instructions for receiving external input so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.

In some embodiments, a graphics processor for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer which renders various objects obtained based on the arithmetic unit, and the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

In some embodiments, the video processor includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.

In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A common presentation form of a User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the system of the display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC). And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.

In some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

In some embodiments, a common relay component and at least one content application are configured in an operating system of the terminal device. A content application refers to an application that can provide content or render content, such as a camera application, a picture resource application, a picture viewing application, a video call application, a video playing application, an audio call application, an audio resource application, a mapping application, a reading application, and so forth. The content includes pictures, audio (including call audio, audio files, and live audio streams), video (including call video, video files, and live video streams), text, geographical location information, navigation information, and the like. Presenting content includes displaying pictures, geographical location information or navigation information and text, playing video files, video call pictures and live room pictures, playing audio files, call sounds and live room sounds, etc. The public relay component is used for pushing the content presented by any one content application to the external terminal equipment so as to continue playing on the external terminal equipment; and the server is also used for receiving the content and the playing information thereof pushed by the public relay assembly on the external terminal equipment and continuing playing the content through the content with the capability of playing the content.

In some embodiments, any one content application can push content to other terminal devices capable of establishing communication connection through the common relay component, so that the function of pushing the content does not need to be configured on each content application. Any one content application can receive the push of other terminal equipment to a certain content through the public relay assembly so as to continue playing the content, so that the function of receiving the push of the content does not need to be configured on each content application. In the foregoing content pushing, receiving and resuming process, the public relay component on the pushing end device (receiving end device) is responsible for communicating with the public relay component on the receiving end device (pushing end device) to complete the foregoing content pushing, receiving and resuming process.

For convenience of description, the above-mentioned processes of pushing, receiving and resuming the content cooperatively executed by the pushing end device and the receiving end device are referred to as a relay process. The push terminal device is a terminal device that initiates content push, and the receiving terminal device is a content push target, or a terminal device that receives content and subsequently plays the content. Based on the data flow direction, the relationship between the push end device and the receiving end device may be described as that the push end device pushes a certain content to the receiving end device, and the receiving end device performs relay playing on the content pushed by the push end device. It should be understood that the terminal device related to the present application may at least serve as a receiving terminal device, and relay play content pushed by other terminal devices, such as a song pushed by a mobile phone via an intelligent sound box device. The terminal equipment can serve as receiving end equipment, and meanwhile can serve as pushing end equipment to push contents outwards, if the current song is pushed to the smart sound box by the mobile phone to continue playing, the video program pushed by the smart television is received by the mobile phone to continue playing.

FIG. 4 illustrates a block diagram of a software configuration of a common relay component according to an exemplary embodiment. As shown in fig. 4, the common relay component includes an interaction hub module, a status management module, an interface display module, a protocol processing module, and a logic control module.

The interaction center module is used for interacting content application on the home terminal equipment. And the interaction center module is internally provided with an SDK for each application program to call, and each application program interacts with the interaction center module by calling the SDK. For example, when the user triggers an operation for transferring the current content to a specified terminal device for continuous playing in the content application, the content application notifies the interaction hub module to send by calling the SDK, so that the common relay component responds to the operation of the user. For another example, the interaction center module feeds back various types of state information in the content pushing process to the corresponding content application program.

And the state management module is used for managing various types of state information generated in the interaction process with other terminal equipment, such as state information representing the success or failure of pushing, state information representing abnormal conditions, various types of notification messages and the like. Management includes, but is not limited to, classification information, discrimination information to perform corresponding processing according to the discrimination result, information forwarding, and the like.

And the interface display module is used for displaying interface elements related to the relay flow in the user interface, such as window objects, tabs, status information prompt boxes and various operable buttons.

The protocol processing module is used for selecting a protocol channel through which interaction with other terminal equipment is carried out according to a preset rule, for example, selecting one of a local area network protocol channel and a wide area network protocol channel, so that the terminal equipment carries out information interaction with other terminal equipment through the channel selected by the protocol processing module.

And the logic processing module is used for executing various logic controls involved in the relay flow, such as logic control in a certain working mode and logic control under the condition of multi-device interaction.

In some embodiments, the functional modules of the common relay component are deployed at the application layer. In other embodiments, the functional modules of the common relay component may be deployed across layers, for example, the interaction hub module and the interface display module are deployed at an application layer, and the other modules are deployed at other layers. This is not a limitation of the present application. It should be noted that, to implement the content relay capability, the common relay component may include more or fewer modules, and is not limited to the software components and architecture shown in fig. 4. Based on the functions of the common relay component related to the embodiment of the present application, components of other compositions and architectures are all within the protection scope of the present application.

In some embodiments, when a terminal device presents a certain content, the relevant information of the content can be pushed to a terminal device designated by a user in response to a user control, so that the terminal device designated by the user continues to play the content according to the relevant information of the content. For convenience of description, in the following embodiments, a terminal device that initiates content push is referred to as a push end device, and a terminal device that accepts content push and relays the content push is referred to as a receiving end device. It should be noted that the push end device and the receiving end device may be display devices having both an image display function and an audio output function, such as a television, a smart phone, a tablet computer, a smart screen of a refrigerator, or devices having only an audio output function but no image display function, such as a sound box device and a radio.

The terminal equipment can realize the functions through the built-in public relay assembly. Various implementation modes of the technical solution of the present application will be described in detail below by taking display devices and multimedia content as examples.

In some embodiments, after the display device is started, the common relay component is started, and the call of any content application can be received.

In some embodiments, after the common relay component is started, the relay capabilities of all content applications in the system are scanned according to the standard interface of the operating system. The relay capability, as the name implies, refers to the capability of the application program to present the content, such as the type of the content that can be presented, the presentation manner, and the like. Taking a media application as an example, the content presentation capability may be the capability of playing a video file, including various parameters of the playable video file. For the receiving end device, when it receives the request of the pushing end device to push the content, the application program conforming to the content through the relay capability continues to play the content. Exemplarily, if the relay content is a video, the receiving end device needs to continue playing the video through a video playing application thereon; if the relay content is a text, the receiving device needs to continue to display the text through a text application (such as a notepad) on the receiving device.

In some embodiments, the relay capabilities may have different levels, such as primary capabilities, secondary capabilities. In view of the actual functionality of the content application, the true relay capability of the content application may be described by one level of relay capability or a combination of multiple levels of capability. It should be understood that the relay capabilities of each application may be customized according to its actual functionality. The embodiment of the present application does not limit the data form of the relay capability and the data content thereof. It should be noted that the relay capability applied on the terminal device determines which contents the terminal device can relay to play. That is, the relay capability applied on a terminal device determines the ability of the terminal device to relay other device content. For example, when a certain terminal device does not have an application for playing a certain content in a relay manner, the terminal device cannot play the content in the relay manner, and thus cannot become a target receiving device of the content.

In some embodiments, after the common relay component scans the relay capabilities of the respective applications, the relay capability data may be registered in a local area network protocol component of the terminal device, so that the local area network protocol component knows the relay capability of each content application, where the local area network protocol component refers to a functional component for responding to an instruction, a request, and other interactive information sent by an external device based on a local area network protocol channel. For example, when a first terminal device receives a capability query message sent by a second terminal device in the same lan based on a lan protocol channel, the relay capabilities of the application programs registered in advance by the common relay component are fed back to the second terminal device, or a response is made to the capability query message, such as a response that a certain relay capability is supported or a certain relay capability is not supported. Therefore, the second terminal device can know the relay capability of the first terminal device, and determine whether the first terminal device can be used as a receiving terminal device of certain content according to the relay capability.

In other embodiments, after the public relay component scans the relay capabilities of each application program, the relay capability data may be uploaded to the cloud server, so that the cloud server may query the relay capabilities of each application program on the designated terminal device. For example, when the cloud server receives an inquiry request sent by the first terminal device and used for inquiring the relay capability of the second terminal device, the relay capability data uploaded by the second terminal device in advance may be returned to the first terminal device in response to the inquiry request. Therefore, the first terminal device can know the relay capability of the second terminal device through the cloud server, and whether the second terminal device can be used as a receiving terminal device of a certain content or not is judged according to the relay capability.

In other embodiments, after the common relay component scans the relay capabilities of each application program, the relay capability data may be stored in a locally stored designated path, so that the local area network protocol component, the bluetooth protocol component, and the like may obtain the relay capability data in the designated path.

In some embodiments, the common relay component may select one or more of the above manners according to a communication policy with other terminal devices to store the relay capability data of the local terminal device, where the communication policy refers to a communication channel, such as a lan protocol channel or a wan protocol channel, on which the communication with other terminal devices is based. For example, if the terminal device is limited to communicate with other devices of the lan content based on the lan protocol channel, the common relay component may choose to register the relay capability data in the lan protocol component; if the terminal equipment can also communicate with equipment outside the local area network based on the WAN protocol channel, the public relay assembly can upload relay capacity data to the cloud server so that other equipment can know the relay capacity of the terminal equipment through the cloud server.

In some embodiments, when the terminal device presents a certain content presented by a certain content application, the common relay component may search, according to the relay capability of the content application, the terminal device matching the relay capability to obtain a device information list, where the device information list is device information of the optional receiving end device. The user designates the target push terminal device based on the device information list, and the public relay component can communicate with the target push terminal device based on a certain communication protocol channel to request the target push terminal device to relay and play the content. And the public relay assembly on the target pushing end equipment responds to the request, starts the content application with the relay capability and continues to play the content through the content application with the relay capability.

It is noted that in a more specific implementation of the above embodiment, the content application on the push-side device needs to interact with the common relay component in response to a user operation. The common relay component may perform certain operations in response to the interaction information from the content application. In addition, because the common relay assembly has a function of presenting an interface object independent of the content application, the user can directly interact with the common relay assembly through the interface object provided by the common relay assembly to directly control the common relay assembly to perform certain operations. In other words, in a more specific implementation of the above-described embodiments, the common relay component on the push-side device may perform certain operations in response to user input.

The hardware or software architecture in some embodiments may be based on the description in the above embodiments, and in some embodiments, may be based on other similar hardware or software architectures, and may implement the technical solution of the present application.

Based on the display device 200, the user may obtain the relay device list through the display device 200. However, in the current terminal devices, since the number of terminal devices in a home is increasing, and the number of links for relay between the terminal devices is also increasing. When the user uses the relay capability manually, all devices supporting the relay are shown to be selected by the user, and at present, the devices are mainly arranged in a general mode such as a list. However, the indiscriminate arrangement way prevents the user from accurately distinguishing the target devices which are intended to be used for function relay, and the mixed arrangement among multiple devices also causes the user to have complicated operation of selecting the target devices, and the operation path is long, so that the user experience is poor.

In order to solve the above problem, some embodiments of the present application provide a display device and a relay device display method. In the following scheme, the candidate devices for relay are referred to as candidate relay devices, and the user may select a target relay device from the candidate relay devices to perform a relay operation with the display device 200.

The following describes a procedure of relay device display provided in some embodiments of the present application with reference to the accompanying drawings.

A flowchart of a relay device presentation method according to some embodiments is illustrated in fig. 5. The present application provides, in some embodiments, a display device 200, the display device 200 including a display 260, a communicator 220, and a controller 250, the controller 250 communicatively coupled to the display 260, the communicator 220 configured to communicate with an external device, the controller 250 configured to perform the process illustrated by the relay device in fig. 5. The procedure shown in connection with fig. 5 for the relay device is as follows:

s310, the controller 250 obtains the area identifier of the first candidate relay device in response to the relay operation of the user.

The first candidate relay device is a device which supports a first relay capability and is in an online state, and the first relay capability is matched with the relay operation.

The display device 200 is a terminal device that initiates content push, and the relay device is a terminal device that receives content and continues to play content. The relay capability refers to a function of pushing, receiving and continuing playing a certain content, which is executed by the pushing end device (or the receiving end device) based on the cooperation of the common relay component and the receiving end device (or the pushing end device). For example, the push, reception, and playback of picture content or the push, reception, and playback of audio content are performed.

For example, when a user watches a certain television episode on the display device 200 (a living room television), the user wants to go to a kitchen to cook, and a refrigerator in the kitchen has an intelligent screen and supports the relay capability of playing videos. The display device 200 may push the video content to the smart screen of the refrigerator to continue playing in response to a relay operation of the user regarding the relay of playing the video. Therefore, the user can cook and continue to watch the television episode through the intelligent screen of the refrigerator. For another example, a user may want to go to a living room while listening to a song on a bedroom television, and the living room has a sound box to support the relay capability of playing audio. Then the user can push the song to the sound box in the living room to continue playing through relay operation on the bedroom television.

With reference to the above example, the first relay capability is matched with the relay operation, that is, the content of the relay operation performed by the user is matched with the relay capability supported by the device, for example, if the user performs the relay operation of video playing, then both devices capable of performing the relay operation should support the relay capability of video playing.

It should be understood that the zone identifier may be an identifier of a home-wide zone, or may be an identifier of another range of zones customized as desired.

In one example, the user may edit the home zone identification of the device according to the home zone in which the device is located when binding the terminal device to the server or when the server views the device information. For example, the home zone identification under the user account is determined by the type of human primary activity, including kitchen, living room, bathroom, home bed. The user can edit the home zone identifier of the television in the bedroom into the bedroom and the home zone identifier of the television in the living room into the living room.

In one example, the manner of obtaining the area identification of the first candidate relay device includes:

the relay service module of the display device 200 sends first request information to a server, where the first request information includes an identifier of the display device and a name of the first relay capability, and the first request information is used to obtain an identifier of at least one candidate relay device that supports the first relay capability and is online. The display device 200 receives an identification of the at least one candidate relay device from the server, the at least one candidate relay device including the first candidate relay device. The display device 200 determines the area identifier of the first candidate relay device according to the identifier of the first candidate relay device.

Exemplarily, the server determines a cloud device list according to a terminal device bound to the cloud by a user, where the content of the cloud device list includes a device identifier, a device area identifier, a device name, whether the device supports relay, and relay capability. The server determines a cloud device list under a user account bound by the server according to the identifier of the display device 200 of the first request message, and then determines a first relay capability device list which is currently online and supports the first relay capability from the cloud device list according to the name of the first relay capability of the first request message, wherein devices in the first relay capability device list do not include the display device 200. The server sends the first relay capability device list to the display device 200, where the first relay capability device list includes the identifier of the at least one candidate relay device and may also include information in other columns in the first table.

In the foregoing manner, the display device 200 sends the first request information to the server, where the first request information includes the identifier of the display device 200 and the first relay capability name, so that the server determines, according to the identifier of the display device 200 and the first relay function name, the identifier of a candidate device supporting the relay capability in the same user account, and sends the identifier to the display device 200, so that the display device 200 can determine the location of the first candidate relay device according to the identifier of the candidate relay device.

For example, the contents of the cloud device list are shown in the following table one:

watch 1

As shown in table one, if the device does not support relay, the relay capability is default to "none". If the user does not edit the area identifier of the device of the identifier 4 in the server, the area identifier is defaulted to be other keywords such as a self-defined name and the like which represent that the area identifier name is abnormal.

The content of the first relay capacity list determined by the server is shown in the following table two, the first relay capacity is a playing video, and the server determines candidate relay devices which can be used in the current relay scene according to the first relay capacity:

watch two

Identification of a device	Device name	Whether a device supports a relay	Relay capacity
				Identification 1	Television receiver	Is that	Playing video
Identification 2	Refrigerator	Is that	Playing video
				Sign 4	Television receiver	Is that	Playing video

As shown in table two, the identifiers of the devices that support the relay capability of playing the video include identifier 1, identifier 2, and identifier 4.

Illustratively, the identification of a device is determined from the device number and the Media Access Control (MAC) address of the device.

For example, the identification is factory serial number + MAC address of the device.

Illustratively, the display device 200 starts a background service for AI intelligent internet of things control, which obtains the device number and MAC address of the device through the display device 200 interface, and then generates the identifier (device number + MAC address) of the device according to the device number and MAC address.

In one example, the manner of determining the area identification of the first candidate relay device includes:

the display device 200 sends relay device request information to the server, where the relay device request information includes an identifier of the display device and user account information bound to the display device, the relay device request information is used to acquire relay device information under the user account and matching with the relay capability of the display device, the relay device information includes an identifier and an area identifier of at least one relay device, and may also include other information such as a device name and relay capability, and the at least one relay device includes the first candidate relay device. The display device 200 receives the relay device information from the server, and then determines a first association relationship according to the relay device information, where the first association relationship is used to associate the identifier of the device in the at least one relay device with the area identifier of the device.

When the display device 200 subsequently determines the area identifier of the first candidate relay device, the area identifier of the first candidate relay device is determined according to the first association relationship and the identifier of the first candidate relay device. If the name of the area identifier of the first candidate relay device is normal, the area identifier of the first candidate relay device in the first association relationship may be directly used in subsequent operations. The method can quickly acquire the area identification of the first candidate relay equipment.

The normal name of the area identifier of the first candidate relay device means that the user edits the area identifier of the first candidate relay device on the server, for example, the area identifier is edited as "living room", "bedroom", "kitchen", and the like. In contrast, the fact that the name of the area identifier of the first candidate relay device is abnormal means that the user does not edit the area identifier of the first candidate relay device on the server, and the server sets the area identifier of the first candidate relay device to be a default value. The display device 200 cannot obtain the correct area identifier of the first candidate relay device according to the default value.

Illustratively, the user account information includes an account name, an account password, and the like registered by the user at the server for identifying the user.

Exemplarily, after receiving the relay device request information, the server determines other relay-supporting devices bound under the user account according to the user account information bound by the display device, then determines all relay capabilities supported by the display device according to the identifier of the display device, then determines the relay capabilities of the respective relay-supporting devices, and if the relay capabilities of the relay-supporting devices belong to one of all the relay capabilities supported by the display device, determines the device as the relay device in the relay device information. The server determines the information of the relay devices according to the identifiers of the relay devices, the area identifiers and other information, and sends the information to the display 200.

Illustratively, the display apparatus 200 periodically transmits third request information to the server, the third request information including an identification of the display apparatus 200 and an Internet Protocol (IP) address of a wide area network, the third request information indicating that the display apparatus 200 is in an online state. After receiving the third request message, the server obtains the identifier and the IP address of the device therein and determines that the display device 200 is in the online state. If the server does not receive the third request message for a certain period of time, it will determine that the display apparatus 200 is in an offline state. Through the method, the server can monitor the communication connection states of all the devices under the user account.

Illustratively, the server determines an identification of the device whose communication connection status changes in the above manner, wherein the presence status change indicates that the device changes from the presence status to the offline status, and the offline status change indicates that the device changes from the offline status to the presence status, and then determines the first notification information according to the identification. The server transmits the first notification information to a device other than the communication connection state change device. The display device 200 receives the first notification information from the server, and re-sends the relay device request information to the server if the first notification information includes the identifier of the device whose offline state is changed. The display device 200 receives the new relay device information sent by the server, and updates the original relay device information stored locally according to the new relay device information. If the first notification information includes the identifier of the device whose online status is changed, the display device 200 deletes the relevant information of the device whose online status is changed from the locally stored relay device information.

In the above manner, the server can monitor the communication connection status of all devices under the same user, and notify all devices under the user if the communication connection status changes, so that the device supporting relay can synchronously refresh the locally stored information of the relay device, so as to accurately determine the area identifier of the device according to the latest information of the relay device subsequently.

In an example, the information of the device with the abnormal name of the area identifier exists in the information of the relay device, and the display device 200 cannot use the area identifier with the abnormal name in the subsequent operation, so that the display device 200 determines an abnormal area identifier device list according to the device with the abnormal name of the area identifier, and if the abnormal area identifier device list includes the first candidate relay device, the manner that the display device 200 acquires the area identifier of the first candidate relay device further includes:

the display device 200 sends second request information to the devices in the local area network to which the display device belongs in a broadcast or multicast manner, where the second request information includes an address of the local area network to which the display device is connected, and the second request information is used to obtain an identifier and a local name of the device in the local area network. The display device 200 then receives the identification and the local name from the devices accessing the local area network, including the first candidate relay device. Since the display device 200 may receive the device identifiers and the local names transmitted by the multiple devices, it is further determined whether the device identifies the devices in the abnormal device list for the locally stored area according to the device identifiers. After determining that the first candidate relay device is a device with an abnormal area identifier name, determining the area identifier of the first candidate relay device according to the local name of the first candidate relay device.

In the above manner, for a device with an abnormal name of an area identifier, the display device 200 requests the local name of another device through the local area network, and further identifies the area identifier corresponding to the local name by identifying the area identifier information in the local name.

For example, if the user does not edit the area identifier of the first candidate relay device on the server, and the server does not store the default value of the area identifier of the first candidate relay device, the relay device information sent by the server to the display device does not have the area identifier of the first candidate relay device, and in the first association relationship, the name of the area identifier of the first candidate relay device is an abnormal value, which is also one of the abnormal cases of the names of the area identifiers.

Illustratively, the second request message is transmitted in a packet in a Transmission Control Protocol (TCP)/User Datagram Protocol (UDP) format.

For example, the first candidate relay device is a device corresponding to the identifier 4 in the first table, and the area identifier is a default value "self-defined name", so that the area identifier of the first candidate relay device needs to be determined according to the local name of the first candidate relay device.

Further, the display device 200 may obtain and determine all area identifiers under the user account of the first candidate relay device in the server from the server, and then determine whether the area identifier of the first candidate relay device belongs to all area identifiers under the user account stored in the server. And if the first candidate relay device belongs to the first candidate relay device, directly determining that the area identifier in the local name is used as the area identifier of the first candidate relay device. And if not, identifying the first candidate relay device as a device without the area. Or, the local name of the device does not have the area identification information, and the first candidate relay device is identified as the device without the area.

Illustratively, the manner in which the first candidate relay device determines and transmits the identifier of the first candidate relay device and the local name of the first candidate relay device includes:

and after receiving the second request information, the first candidate relay device acquires the identifier of the second candidate relay device, and then filters the corresponding value of the local name in the complete machine storage information through the complete machine interface to acquire the local name. The first candidate relay device determines second response information according to the identifier and the local name of the first candidate relay device, and sends the second response information to the first candidate relay device in a unicast mode according to the local area network IP address of the display device 200 in the second request information. Illustratively, the second response information is contained in a packet of TCP/UDP.

For example, if the first candidate relay device has a local name of "living room tv", the first candidate relay device further identifies the location included in the local name as "living room" after identifying "tv".

S320, the display device 200 determines a plurality of partitions of the first interface displayed by the display.

Each partition in the plurality of partitions is used for displaying a control corresponding to a candidate relay device, wherein each partition is determined according to a distance between the control corresponding to the display device. The distance between a partition and a widget is related to all pixel points included by the partition on the display screen and all pixel points included by the widget on the display screen.

Illustratively, the priority of each partition is determined according to the distance between the partition and the control corresponding to the display device, and the smaller the distance between the partition and the control corresponding to the display device is, the higher the priority of the partition is. The plurality of partitions comprise a first partition, the distance between the first partition and the control corresponding to the display device is smaller than a first threshold, the plurality of partitions comprise a second partition, and the distance between the second partition and the control corresponding to the display device is larger than the distance between the first partition and the control corresponding to the display device. The first partition has a higher priority than the second partition, and the priority of the first partition may be changed by setting a first threshold, for example by setting the first threshold so that the priority of the first partition is highest. Further, the plurality of partitions further include a third partition, and a distance between the third partition and the control corresponding to the display device is greater than a distance between the second partition and the control corresponding to the display device. The third partition is lower priority than the second partition.

For example, the plurality of partitions are circular rings of different sizes centered around the corresponding control of the display device 200, as shown in fig. 6. The display form of the partitions on the display screen is not limited in this application, for example, the plurality of partitions may also be configured as shown in fig. 7.

And S330, the display device 200 determines a partition for displaying the widget corresponding to the first candidate relay device, and displays the widget.

Specifically, the display device 200 determines, according to the area identifier of the display device, the area identifier of the first candidate relay device, and the plurality of partitions, one of the plurality of partitions for displaying the control corresponding to the first candidate relay device, and controls the display to display the control corresponding to the first candidate relay device in the partition.

In an example, the display device 200 determines whether the area identifier of the display device is the same as the area identifier of the first candidate relay device, and if so, determines that the partition where the control corresponding to the first candidate relay device is located is the first partition.

For example, as shown in fig. 8, the display device 200 is a sound box in a living room, a user wants to turn off the sound box to continue listening to songs on a television in the living room, the television in the living room is a first candidate relay device, a control a corresponding to the television in the living room is located in a first partition, and the user can drag the control a to a control corresponding to the display device 200 to complete relay operation, so that the user can continue listening to songs on the television in the living room.

In the foregoing manner, if the area identifier of the display device is the same as the area identifier of the first candidate relay device, it indicates that the display device 200 and the first candidate relay device are in the same area, and then the first candidate relay device has a high possibility of becoming the target relay device of the user. The control corresponding to the first candidate relay device is displayed in the first partition with higher priority, so that the first candidate relay device can be conveniently selected by a user to serve as the relay target device, and the experience of the user is further improved.

In an example, if the area identifier of the display device is not the same as the area identifier of the first candidate relay device, or the first candidate relay device is a device without an area, the display device 200 determines that the partition where the control corresponding to the first candidate relay device is located is the second partition, or,

the display device 200 further determines whether the device type of the display device is the same as the device type of the first candidate relay device, if so, determines that the partition where the control corresponding to the first candidate relay device is located is the second partition, and if not, determines that the partition where the control corresponding to the first candidate relay device is located is the third partition.

Illustratively, the device types are distinguished according to the main functions of the devices, such as the device types are a television, a mobile phone, a notebook computer, a refrigerator, and the like.

Under the condition that the area identifier of the display device 200 is different from the area identifier of the first candidate relay device, the method and the device determine the partition where the control corresponding to the first candidate relay device is located based on whether the device type of the first candidate relay device is the same as the device type of the display device 200, and further improve the ordering of the control corresponding to the candidate relay device in the first interface.

In an example, if the display device 200 is identified as a device without a region, since it cannot be further determined whether the region identifiers between the display device 200 and the candidate relay devices are the same, it may be specified that the control corresponding to the candidate relay device is not displayed in the first partition, and then, based on whether the device type of the candidate relay device is the same as the device type of the display device 200, if so, the partition in which the control corresponding to the candidate relay device is located is determined as the second partition, and if not, the partition in which the control corresponding to the first candidate relay device is located is determined as the third partition.

Of course, if the control corresponding to the candidate relay device may be displayed in the first partition, it may also be determined that the partition in which the control corresponding to the candidate relay device is located is the first partition based on whether the device type of the candidate relay device is the same as the device type of the display device 200, and if not, it is determined that the partition in which the control corresponding to the candidate relay device is located is the second partition.

In one example, when a partition is used to display controls corresponding to a plurality of candidate relay devices, the display device 200 may divide the first partition into a plurality of sub-partitions according to the number of candidate relay devices displayed in the first partition, then determine the priority of each sub-partition of the plurality of sub-partitions, and then determine the device type of the fourth candidate relay device. And if the device type of the fourth candidate relay device is the same as the device type of the display device, determining that the control corresponding to the fourth candidate relay device is in the sub-partition with the priority meeting the first preset condition.

Illustratively, the display device 200 divides the first partition into a plurality of sub-partitions based on the number of candidate relay devices presented in the first partition, and then distributes the sub-partitions to the first partition according to the habit of the user in a clockwise or counterclockwise direction in the look and feel of the user. And then defining a first sub-partition with the highest priority in the direction according to the clockwise direction or the counterclockwise direction, and arranging other sub-partitions along the direction, wherein the corresponding priorities of the other sub-partitions are lower and lower. And if the device type of the fourth candidate relay device is the same as the device type of the display device, determining that the control corresponding to the fourth candidate relay device is in the first sub-partition, and if the device type of the fourth candidate relay device is different from the device type of the display device, determining that the control corresponding to the fourth candidate relay device is in other sub-partitions except the first sub-partition.

For example, as shown in fig. 9, a plurality of sub-partitions are distributed in a first sub-partition in a counterclockwise direction in the user's view, the first sub-partition has a higher priority than a second sub-partition, and the second sub-partition has a higher priority than a third sub-partition.

Since the same relay functions are more among the relay devices with the same device type, under the condition that the plurality of candidate relay devices are in the first partition, the device type of the candidate relay device is the same as that of the display device 200 and is used as a high-priority device, and the device type of the candidate relay device is different from that of the display device 200 and is used as a low-priority device. And then, the arrangement mode of the sub-partitions is set according to the habit of dragging the relay equipment by the user, and the control corresponding to the high-priority equipment is displayed in the sub-partitions which are more convenient for the user to operate, so that the operation path of the user in dragging the relay equipment is further reduced.

In an example, the first partition is further configured to display a control corresponding to a second candidate relay device, and the second partition is further configured to display a control corresponding to a third candidate relay device, so as to avoid a problem that the second candidate relay device may be touched to change the candidate relay device or cause other adverse effects if the control corresponding to the third candidate relay device is dragged to the control corresponding to the display device 200, where the problem is simply referred to as a dragging collision problem of the controls corresponding to the candidate relay devices in different partitions, the application further provides the following scheme:

the display device 200 determines a first connection between the control corresponding to the second candidate relay device and the control corresponding to the display device, and then determines a second connection between the control corresponding to the third candidate relay device and the control corresponding to the display device. If the angle between the first connection line and the second connection line is smaller than or equal to a second threshold, re-determining the position of the control corresponding to the third candidate relay device displayed in the second partition according to the first connection line and the second connection line, so that the angle between the first connection line and the second connection line is larger than the second threshold.

The second threshold is a criterion for judging whether the second candidate relay device and the third candidate relay device have the dragging conflict problem, the second threshold can be set according to actual needs, and because two angles between the first contact and the second connection line are included, namely the angle α and the angle (360- α), the application can only consider the angle α, namely further limit the second threshold to be smaller than 90 °.

The connection mode between the two controls can be determined according to actual needs, for example, respective focuses of the two controls are determined, and then a line segment between the two focuses is used as a connection line between the two controls.

For example, if the angle between the first connection line and the second connection line is 0 degree, the corresponding control of the third candidate relay device and the corresponding control of the second candidate relay device are on the same horizontal line, and when the corresponding control of the third candidate relay device is dragged to the position of the corresponding control of the second candidate relay device, the corresponding controls of the two candidate relay devices may be dragged at the same time, or the third candidate relay device may not be dragged continuously and return to the original position, and the second candidate relay device is dragged, which may cause an inaccuracy in dragging of the candidate relay devices.

As shown in fig. 8, the control a is a control corresponding to the second candidate relay device, the control B is a control corresponding to the third candidate relay device, the connection line on the control a is a first connection line, and the connection line on the control B is a second connection line. The angle between the first and second links is θ.

In view of the above problems, in order to avoid the candidate relay device corresponding control on the inner ring corresponding to the candidate relay device corresponding control when the candidate relay device corresponding control is dragged to the display device 200 corresponding control on the first interface to implement the relay operation, the present application adopts a scheme that the angle between the first connection line and the second connection line is greater than the second threshold value, which can avoid the above problems and improve the smoothness of dragging the candidate relay device.

In one example, the manner of re-determining the location in the second partition where the control corresponding to the third candidate relay device is shown, such that the angle between the first connection and the second connection is greater than the second threshold, includes:

determining a sub-partition where a control corresponding to a third candidate relay device is located, determining a moving path of the control corresponding to the third candidate relay device, and moving the control corresponding to the third candidate relay device on the moving path until an angle between the first connection line and the second connection line is greater than the second threshold value.

As shown in fig. 10, the moving path extends towards two sides with the control B corresponding to the third candidate relay device as an origin, the control corresponding to the third candidate relay device is moved towards one of the directions, and if the moving path cannot make the angle between the first connection line and the second connection line greater than the second threshold value at the end of the moving path in the direction, the control corresponding to the third candidate relay device is moved towards the other direction until the angle between the first connection line and the second connection line is greater than the second threshold value. And if the angle between the first connection line and the second connection line cannot be larger than the second threshold value all the time when the moving path is at the end of the moving path in the direction, displaying a control corresponding to a third candidate relay device in the middle of the sub-partition. The final relay device display effect diagram is shown in fig. 11.

By adopting the mode, the position of the control can be quickly and effectively adjusted until the angle between the first connecting line and the second connecting line is larger than the fourth threshold value by setting the adjusting direction of the position of the control in the sub-partition.

According to the embodiment, after a user triggers the relay operation, the area identifier of the candidate relay device which supports the first relay capability and is in the online state is acquired, then a plurality of partitions of a first interface displayed by the display are determined, each partition of the plurality of partitions is used for displaying a control corresponding to the candidate relay device, and each partition is determined according to the distance between the controls corresponding to the display device. Because each partition in the plurality of partitions is determined according to the distance between the partition and the control corresponding to the display device, the distance from each partition to the control corresponding to the display device is far or near. Since the area id of the display device 200 and the area id of the candidate relay device have the same or different relationships, the relationship characteristic between the candidate relay device and the area where the display device 200 is located corresponds to the relationship characteristic between the different partitions and the corresponding controls of the display device. Therefore, according to the area identifier of the display device 200, the area identifier of the candidate relay device, and the plurality of partitions, the partitions corresponding to the control of the candidate relay device can be accurately and orderly determined, and the control corresponding to the first candidate relay device is displayed on the partitions.

Based on the same inventive concept as the display device, some embodiments of the present application further provide a relay device display method, including:

the controller 250 of the display device 200 acquires an area identifier of a first candidate relay device that supports a first relay capability and is online in response to a relay operation of a user, the first relay capability matching the relay operation;

the controller 250 determines a plurality of partitions of a first interface displayed by a display of the display device, wherein each partition is used for displaying a control corresponding to a candidate relay device, and each partition is determined according to a distance between the controls corresponding to the display device;

the controller 250 determines, according to the area identifier of the display device, the area identifier of the first candidate relay device, and the plurality of partitions, one of the plurality of partitions for displaying the control corresponding to the first candidate relay device, and controls the display 260 to display the control corresponding to the first candidate relay device in the partition.

Since the above embodiments are all described by referring to and combining with other embodiments, the same portions are provided between different embodiments, and the same and similar portions between the various embodiments in this specification may be referred to each other. And will not be described in detail herein.

It is noted that, in this specification, relational terms such as "first" and "second," and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a circuit structure, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such circuit structure, article, or apparatus. Without further limitation, the statement "comprises a" \8230; "8230;" defines an element and does not exclude the presence of additional like elements in circuit structures, articles, or devices comprising the element.

Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.

The above embodiments of the present application do not limit the scope of the present application.

Claims

1. A display device, characterized in that the display device comprises:

a display for displaying content;

a communicator for communicating with an external device;

a controller in communicative connection with the display, the controller configured to:

2. The display device according to claim 1, wherein the plurality of partitions includes a first partition, a distance between the first partition and a control corresponding to the display device is smaller than a first threshold, and the partition in which the control corresponding to the first candidate relay device is located is determined according to the area identifier of the display device, the area identifier of the first candidate relay device, and the plurality of partitions, and is further configured to:

determining whether the area identification of the display device is the same as the area identification of the first candidate relay device;

and if the first candidate relay device and the second candidate relay device are the same, determining the partition where the control corresponding to the first candidate relay device is located as the first partition.

3. The display device according to claim 2, wherein the plurality of partitions includes a second partition, a distance between the second partition and the control corresponding to the display device is greater than a distance between the first partition and the control corresponding to the display device, and if the area identifier of the display device is different from the area identifier of the first candidate relay device, the determining the partition where the control corresponding to the first candidate relay device is located is further configured to:

determining whether the device type of the display device and the device type of the first candidate relay device are the same;

and if the first candidate relay device and the second candidate relay device are the same, determining the partition where the control corresponding to the first candidate relay device is located as the second partition.

4. The display device according to claim 3, wherein the controller is further configured to:

determining a control corresponding to a second candidate relay device displayed in the first partition;

determining a control corresponding to a third candidate relay device displayed in the second partition;

determining a first connection line between a control corresponding to the second candidate relay device and a control corresponding to the display device;

determining a second connection line between the control corresponding to the third candidate relay device and the control corresponding to the display device;

if the angle between the first connection line and the second connection line is smaller than or equal to a second threshold, re-determining the position of the control corresponding to the third candidate relay device displayed in the second partition according to the first connection line and the second connection line, so that the angle between the first connection line and the second connection line is larger than the second threshold.

5. The display device of claim 2, wherein the first partition is further configured to present a control corresponding to a fourth candidate relay device, and wherein the controller is further configured to:

dividing the first partition into a plurality of sub-partitions according to the number of candidate relay devices shown in the first partition;

determining a priority for each of the plurality of sub-partitions;

determining a device type of the fourth candidate relay device;

and if the device type of the fourth candidate relay device is the same as the device type of the display device, determining that the control corresponding to the fourth candidate relay device is in a sub-partition with the priority meeting a first preset condition.

6. The display device of claim 1, wherein the obtaining of the area identification of the first candidate relay device that supports the first relay capability and is online is further configured to:

sending first request information to a server, wherein the first request information comprises an identifier of the display device and the first relay capability name, and the first request information is used for acquiring the identifier of at least one candidate relay device which supports the first relay capability and is online;

receiving an identification of the at least one candidate relay device from the server, the at least one candidate relay device including the first candidate relay device;

and determining the area identification of the first candidate relay equipment according to the identification of the first candidate relay equipment.

7. The display device as recited in claim 6, wherein the determining an identification of the area of the first candidate relay device as a function of the identification of the first candidate relay device is further configured to:

sending relay device request information to the server, wherein the relay device request information comprises an identifier of the display device and user account information bound to the display device, the relay device request information is used for acquiring relay device information matched with the relay capability of the display device under the user account, the relay device information comprises an identifier and an area identifier of at least one relay device, and the at least one relay device comprises the first candidate relay device;

receiving the relay equipment information from a server;

determining a first association relation according to the relay device information, wherein the first association relation is used for associating the identifier of the at least one relay device with the area identifier;

and determining the area identifier of the first candidate relay device according to the first association relation and the identifier of the first candidate relay device, wherein the name of the area identifier of the first candidate relay device is normal.

8. The display device as recited in claim 7, wherein if the name of the zone identifier of the first candidate relay device is abnormal, the controller is further configured to:

sending second request information, wherein the second request information comprises an address of a local area network accessed by the display equipment, and the second request information is used for acquiring an identifier and a local name of equipment in the local area network;

receiving an identifier and a local name from a device accessing the local area network, wherein the device accessing the local area network comprises the first candidate relay device;

determining the first candidate relay equipment as the equipment with abnormal name of the local storage area identification according to the identification of the first candidate relay equipment;

and determining the area identification of the first candidate relay device according to the local name of the first candidate relay device.

9. The display device of claim 8, wherein the controller is further configured to:

determining all area identifications under the user account in the server;

determining whether the area identifier of the first candidate relay device belongs to all area identifiers stored in a server under the user account;

and if not, identifying the first candidate relay device as a device without the area.

10. A relay device display method is characterized by comprising the following steps:

the controller determines a plurality of partitions of a first interface displayed by a display of the display device, wherein each partition is used for displaying a control corresponding to the candidate relay device, and each partition is determined according to a distance between the control corresponding to the display device;