WO2023121049A1

WO2023121049A1 - Electronic apparatus and controlling method thereof

Info

Publication number: WO2023121049A1
Application number: PCT/KR2022/019501
Authority: WO
Inventors: 이정섭; 김재익; 모나지르 후세인엠디; 어호진
Original assignee: 삼성전자주식회사
Priority date: 2021-12-22
Filing date: 2022-12-02
Publication date: 2023-06-29

Abstract

The present electronic apparatus comprises a display; a communication interface for communicating with a sink device; and a processor that, if connected to the sink device through the communication interface, receives source device information of a source device connected to the sink device, from the sink device through the communication interface, and controls the display to display the source device information.

Description

Electronic device and its control method

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device receiving content from a source device when a source device is connected to a sink device communicating with the electronic device, and a control method thereof.

A source device providing content may be connected to a sink device, and the sink device may be connected to an electronic device in turn. The source device-sink device-electronic device may be connected in series, and the source device may not be directly connected to the electronic device.

An electronic device may perform communication by adding a protocol only to directly connected devices. However, it may be difficult for a source device not directly connected to an electronic device to perform communication.

When the source device is not directly connected to the electronic device, it is difficult to directly transfer information related to the source device to the electronic device, and it is difficult for the electronic device to control the source device.

Even in the sink device, there was no protocol for transmitting information related to the source device to the electronic device, and the connection with the source device was not separately checked.

Since the electronic device cannot know whether the source device is connected to the sink device, when the source device is not connected to the sink device, the electronic device outputs a blank screen. Here, the user cannot know that the reason why the blank screen is output is that the source device is not connected.

The present disclosure is designed to improve the above problems, and an object of the present disclosure is to provide an electronic device for receiving source device information related to a source device connected to a sink device and displaying source device information and a control method thereof.

When the electronic device according to the present embodiment for achieving the above object is connected to the sink device through a display, a communication interface for communicating with the sink device, and the communication interface, source device information of a source device connected to the sink device is displayed as and a processor for receiving information from the sink device through a communication interface and controlling the display to display the source device information.

Meanwhile, the processor identifies whether the sink device is connected to the source device based on the connection information received from the sink device through the communication interface, and if the sink device is identified as being connected to the source device, the communication When the source device information is received from the sink device through an interface and it is identified that the sink device is not connected to the source device, the display is configured to display a first UI corresponding to the fact that there is no source device connected to the sink device. You can control it.

Meanwhile, the source device information may include at least one of source device identification information, manufacturer information, source device type information, supported codec information, supported resolution information, or content information provided by the source device.

Meanwhile, the electronic device further includes an input/output interface, and when the processor is connected to the sink device through the input/output interface, the processor controls the display to display a second UI corresponding to selection of the source device, and When a user input corresponding to the selection of the source device is received through UI 2, the display may be controlled to display a third UI corresponding to being able to receive content from the source device.

Meanwhile, when a user input corresponding to a request for one of a plurality of contents provided by the source device is received after the third UI is displayed, the processor requests the contents corresponding to the user input through the communication interface. transmits a control command to the sink device, receives a content image corresponding to the control command from the sink device through the communication interface, and controls the display to display the received content image; Content audio corresponding to a control command for requesting content may be output from the sink device.

Meanwhile, the electronic device further includes an input/output interface, and if the processor is not connected to the sink device through the input/output interface, display a fourth UI corresponding to connecting the electronic device and the sink device with an HDMI cable. The display can be controlled.

Meanwhile, when connected to the sink device through the input/output interface after the fourth UI is displayed, the processor may control the display to display a second UI corresponding to the selection of the source device.

Meanwhile, the processor may receive sink device information of the sink device through the communication interface and control the display to display the sink device information and the source device information.

Meanwhile, the electronic device further includes an input/output interface and a speaker, and if the processor is not connected to the sink device through the input/output interface, the processor receives a data packet including the source device information and audio information through the communication interface. and output the audio information included in the received data packet through the speaker.

Meanwhile, when the sink device is disconnected from the source device while the sink device is connected to the source device, the processor displays a fifth UI corresponding to the release of the sink device and the source device. Control a display, and if the sink device is identified as being connected to the source device in a state where the sink device is not connected to the source device, display a sixth UI corresponding to the connection between the sink device and the source device. The display can be controlled.

In the control method of an electronic device including a communication interface communicating with a sink device according to the present embodiment, when connected to the sink device through the communication interface, source device information of a source device connected to the sink device is transmitted through the communication interface. Receiving from the sink device and displaying the source device information.

Meanwhile, the control method includes identifying whether the sink device is connected to the source device based on connection information received from the sink device through the communication interface, if the sink device is identified as being connected to the source device, Receiving the source device information from the sink device through the communication interface, and displaying a first UI corresponding to the fact that there is no source device connected to the sink device when it is identified that the sink device is not connected to the source device Further steps may be included.

Meanwhile, the control method may include displaying a second UI corresponding to the selection of the source device when connected to the sink device through the input/output interface of the electronic device and responding to the selection of the source device through the second UI. The method may further include displaying a third UI corresponding to being able to receive content from the source device when a user input to do so is received.

Meanwhile, when a user input corresponding to a request for one of a plurality of contents provided by the source device is received after the third UI is displayed, the control method transmits the contents corresponding to the user input through the communication interface. The method may further include transmitting a request control command to the sink device, receiving a content image corresponding to the control command from the sink device through the communication interface, and displaying the received content image. and content audio corresponding to a control command for requesting the content may be output from the sink device.

Meanwhile, the control method may further include displaying a fourth UI corresponding to connecting the electronic device and the sink device with an HDMI cable when the sink device is not connected through the input/output interface of the electronic device. .

Meanwhile, the control method may further include displaying a second UI corresponding to the selection of the source device when connected to the sink device through the input/output interface after the fourth UI is displayed.

Meanwhile, the control method may further include receiving sink device information of the sink device through the communication interface and displaying the sink device information and the source device information.

Meanwhile, the control method may include receiving a data packet including the source device information and audio information through the communication interface when it is not connected to the sink device through the input/output interface of the electronic device, and the speaker of the electronic device. The method may further include outputting the audio information included in the received data packet.

Meanwhile, in the control method, when the sink device is disconnected from the source device while the sink device is connected to the source device, displaying a fifth UI corresponding to the release of the sink device and the source device and displaying a sixth UI corresponding to the connection between the sink device and the source device when the sink device is identified as being connected to the source device while the sink device is not connected to the source device. can include

1 is a diagram for explaining a system including an electronic device, a sink device, and a source device.

2 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.

FIG. 3 is a block diagram for explaining a specific configuration of the electronic device of FIG. 1 .

4 is a diagram for explaining an operation of an electronic device that outputs source device information.

5 is a diagram for explaining an operation of outputting a first UI corresponding to the absence of a source device connected to a sink device.

6 is a flowchart illustrating an operation of outputting a second UI corresponding to selection of a source device and a third UI corresponding to being able to receive content from the source device according to an embodiment.

7 is an operation of outputting a second UI corresponding to selection of a source device and a third UI corresponding to being able to receive content from the source device and connecting the electronic device and the sink device with an HDMI cable according to another embodiment. It is a flowchart for explaining an operation of outputting a corresponding fourth UI.

8 is a diagram for explaining an operation of outputting a second UI corresponding to selection of a source device.

9 is a diagram for explaining an operation of outputting a third UI corresponding to being able to receive content from a source device.

10 is a diagram for explaining an operation of outputting audio information from a sink device and outputting image information from an electronic device.

11 is a diagram for explaining an operation of outputting a fourth UI corresponding to connecting an electronic device and a sink device with an HDMI cable.

12 is a flowchart for explaining an operation of outputting a fifth UI and a sixth UI output according to a connection state between a sink device and a source device.

13 is a diagram for explaining an operation of outputting a fifth UI corresponding to release of a sink device and a source device.

14 is a diagram for explaining an operation of outputting a sixth UI corresponding to a connection between a sink device and a source device.

15 is a flowchart for explaining an operation of identifying whether a sink device and a source device are connected or not and an operation of outputting source device information.

16 is a diagram for explaining connection information and device information.

17 is a diagram for explaining a system including an electronic device, a sink device, and a source device.

18 is a diagram for explaining how an electronic device and a sink device transmit information using a Consumer Electronics Control (CEC) method.

19 is a diagram for explaining an operation of an electronic device requesting information from a sink device.

20 is a diagram for explaining an operation of a sink device in an embodiment in which a sink device and an electronic device are connected through HDMI.

21 is a flowchart for explaining an operation of an electronic device in an embodiment in which a sink device and an electronic device are connected through HDMI.

22 is a flowchart for explaining an operation of a sink device in an embodiment in which a sink device and an electronic device are not connected through HDMI.

23 is a flowchart for explaining operations of a sink device and a source device in an embodiment in which the sink device and the electronic device are not connected through HDMI.

24 is a flowchart for explaining an operation of an electronic device in an embodiment in which a sink device and an electronic device are not connected through HDMI.

25 is a flowchart for explaining an operation of a sink device requesting audio information in an embodiment in which a sink device and an electronic device are not connected through HDMI.

26 is a flowchart illustrating an operation of an electronic device outputting audio information in an embodiment in which a sink device and an electronic device are not connected through HDMI.

27 is a diagram for explaining an operation of a sink device requesting and transmitting audio information in an embodiment in which a sink device and an electronic device are not connected through HDMI.

28 is a diagram for explaining an operation of an electronic device outputting audio information in an embodiment in which a sink device and an electronic device are not connected through HDMI.

29 is a diagram for explaining a data packet transmitted from a sink device to an electronic device.

30 is a diagram for explaining a control method of an electronic device according to an embodiment.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

The terms used in the embodiments of the present disclosure have been selected from general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but they may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technologies, and the like. . In addition, in a specific case, there is also a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the disclosure. Therefore, terms used in the present disclosure should be defined based on the meaning of the term and the general content of the present disclosure, not simply the name of the term.

In this specification, expressions such as “has,” “can have,” “includes,” or “can include” indicate the existence of a corresponding feature (eg, numerical value, function, operation, or component such as a part). , which does not preclude the existence of additional features.

The expression at least one of A and/or B should be understood to denote either "A" or "B" or "A and B".

Expressions such as "first," "second," "first," or "second," as used herein, may modify various components regardless of order and/or importance, and may refer to one component It is used only to distinguish it from other components and does not limit the corresponding components.

A component (e.g., a first component) is "(operatively or communicatively) coupled with/to" another component (e.g., a second component); When referred to as "connected to", it should be understood that an element may be directly connected to another element, or may be connected through another element (eg, a third element).

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "comprise" or "consist of" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other It should be understood that the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof is not precluded.

In the present disclosure, a “module” or “unit” performs at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software. In addition, a plurality of "modules" or a plurality of "units" are integrated into at least one module and implemented by at least one processor (not shown), except for "modules" or "units" that need to be implemented with specific hardware. It can be.

In this specification, the term user may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using an electronic device.

Hereinafter, an embodiment of the present disclosure will be described in more detail with reference to the accompanying drawings.

1 is a diagram for explaining a system including an electronic device 100, a sink device 200, and a source device 300.

Referring to FIG. 1 , a system 1000 includes an electronic device 100, a sink device 200, and a source device 300. Here, the electronic device 100 may mean a device that outputs content. Here, the content may include an image, and the electronic device 100 may mean a device that outputs an image. Also, the electronic device 100 may be a display device including a display. Here, the electronic device 100 may be connected to the sink device 200. Specifically, the electronic device 100 may communicate with the sink device 200 based on at least one of a wired communication module and a wireless communication module. Here, the wired communication module may include HDMI (or HDMI-ARC). Here, the wireless communication module may include at least one of a Bluetooth module (BT module) and a Wi-Fi module (WIFI module).

Here, the sink device 200 may mean a device that transmits content to the electronic device 100 . Here, the sink device 200 may receive content provided by the source device 300 and transmit the received content to the electronic device 100 . Here, the sink device 200 may output some of the information included in the content in addition to a function of simply delivering the content. For example, when the sink device 200 is implemented as a sound bar, the sink device 200 may output audio information (or audio signal, audio data, or audio packet) included in the received content. In addition, the sink device 200 may identify a device connected to the sink device 200. Specifically, the sink device 200 may identify how it is connected to the electronic device 100 and how it is connected to the source device 300 . The sink device 200 may identify whether it is connected to the electronic device 100 through HDMI, Bluetooth, or Wi-Fi. In addition, the sink device 200 may be connected to the source device 300. Specifically, the sink device 200 may communicate with the source device 300 based on at least one of a wired communication module and a wireless communication module. The sink device 200 can identify whether it is connected to the source device 300 through HDMI, Bluetooth, or Wi-Fi.

Here, the source device 300 may mean a device that provides content. The source device 300 may receive content from an external server and transmit the received content to the sink device 200 .

The electronic device 100, the sink device 200, and the source device 300 may be implemented as various devices, and the electronic device 100, the sink device 200, and the source device 300 interact with each other through various communication methods. can be connected

According to an embodiment, the electronic device 100 may be a TV, the sink device 200 may be a sound bar, and the source device 300 may be a set-top box. In addition, the electronic device 100 and the sink device 200 may be connected through Bluetooth or Wi-Fi. And, the sink device 200 and the source device 300 may be connected through HDMI. When the source device 300 transmits content received (or already stored) from an external server to the sink device 200, the sink device 200 outputs audio information included in the received content, and Content may be transmitted to the electronic device 100 . And, the electronic device 100 may output image information included in the received content. Here, operations performed by the electronic device 100 may be different depending on whether the electronic device 100 and the sink device 200 are connected through HDMI. Meanwhile, the content may include a plurality of continuous image information (eg, video) and audio information corresponding to the plurality of continuous image information.

2 is a block diagram illustrating an electronic device 100 according to an embodiment of the present disclosure.

Referring to FIG. 2 , the electronic device 100 may include a display 110 , a communication interface 120 and a processor 130 .

The electronic device 100 according to various embodiments of the present specification may include, for example, at least one of a smart phone, a tablet PC, a mobile phone, a desktop PC, a laptop PC, a PDA, and a portable multimedia player (PMP). . In some embodiments, the electronic device 100 may include, for example, at least one of a television, a digital video disk (DVD) player, and a media box (eg, Samsung HomeSyncTM, Apple TVTM, or Google TVTM).

The display 110 may be implemented with various types of displays such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, and a plasma display panel (PDP). The display 110 may also include a driving circuit, a backlight unit, and the like, which may be implemented in the form of an a-si TFT, a low temperature poly silicon (LTPS) TFT, or an organic TFT (OTFT). Meanwhile, the display 110 may be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, and the like. Also, according to an embodiment of the present disclosure, the display 110 may include a bezel housing the display panel as well as a display panel that outputs an image. In particular, according to an embodiment of the present disclosure, the bezel may include a touch sensor (not shown) for detecting user interaction.

The communication interface 120 is a component that performs communication with various types of external devices according to various types of communication methods. The communication interface 120 may include a wireless communication module or a wired communication module. Here, each communication module may be implemented in the form of at least one hardware chip.

The wireless communication module may be a module that wirelessly communicates with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

The Wi-Fi module and the Bluetooth module may perform communication using the Wi-Fi method and the Bluetooth method, respectively. In the case of using a Wi-Fi module or a Bluetooth module, various types of connection information such as an SSID and a session key are first transmitted and received, and various types of information can be transmitted and received after a communication connection is established using the same.

The infrared communication module performs communication according to infrared data association (IrDA) technology for wirelessly transmitting data over a short distance using infrared rays between visible light and millimeter waves.

In addition to the above-mentioned communication method, other communication modules include Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), LTE Advanced (LTE-A), 4th Generation (4G), and 5G (5th Generation) may include at least one communication chip that performs communication according to various wireless communication standards.

The wired communication module may be a module that communicates with an external device by wire. For example, the wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a pair cable, a coaxial cable, an HDMI cable, a USB, an optical fiber cable, or an Ultra Wide-Band (UWB) module.

The processor 130 may perform overall control operations of the electronic device 100 . Specifically, the processor 130 functions to control the overall operation of the electronic device 100 .

The processor 130 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, it is not limited thereto, and the central processing unit ( central processing unit (CPU)), micro controller unit (MCU), micro processing unit (MPU), controller, application processor (AP), graphics-processing unit (GPU) or communication processor (CP)), and ARM processors, or may be defined in terms of the corresponding terms.In addition, the processor 130 is a System on Chip (SoC) with a built-in processing algorithm, or a large scale integration (LSI). The processor 130 may perform various functions by executing computer executable instructions stored in the memory 140. there is.

The electronic device 100 may include a communication interface 120 that communicates with the sink device 200 using at least one of the display 110, a wireless communication module, and a wired communication module.

When the processor 130 is connected to the sink device 200 through the communication interface 120, the source device information of the source device 300 connected to the sink device 200 is transferred to the sink device 200 through the communication interface 120. can be received from Also, the processor 130 may control the display 110 to display source device information.

Here, the wireless communication module may include at least one of a Bluetooth module or a Wi-Fi module. The processor 130 may transmit and receive information with the sink device 200 using a wireless communication module included in the communication interface 120 .

Here, the processor 130 may identify whether or not it is connected to the sink device 200 through the communication interface 120 . Specifically, the processor 130 may determine whether the sink device 200 and the electronic device 100 are in a wirelessly connectable state. And, if the electronic device 100 is in a state where it can be wirelessly connected to the sink device 200, the processor 130 can receive source device information from the sink device 200.

Here, the source device information may mean information related to the source device 300 that is not directly connected to the electronic device 100 but directly connected to the sink device 200. Here, the source device 300 may mean a device that provides content to the sink device 200 . Here, content may refer to data including at least one of text information, image information, and audio information.

Here, the processor 130 may receive source device information from the sink device 200 and store the received source device information in the memory 140 of the electronic device 100 . And, the processor 130 may display the received source device information on the display 110 .

Here, when the source device information is displayed on the display 110, the user can easily recognize the source device 300 that is currently connected to the sink device 200 and supplies content.

Meanwhile, the processor 130 may display source device information on the display 110 when a predetermined event is identified. Here, the preset event is an event in which the source device 300 is connected to the sink device 200 from a state in which the source device 300 is not connected to the sink device 200 or a plurality of events in the sink device 200. It may include an event that the source device is connected to.

Here, an event in which the source device 300 is changed from a state in which the source device 300 is not connected to the sink device 200 to a state in which the source device 300 is connected to the sink device 200 is sent to the electronic device 100 through the sink device 200. A newly recognized event by the source device 300, which has never provided content, or an event recognized again by the source device 300, which has already provided content to the electronic device 100 through the sink device 200 at least once can include

Here, the processor 130 may determine whether to display the source device information based on identification of a preset event. Under normal circumstances, source device information does not need to be displayed on the electronic device 100, but when the disconnected source device 300 is reconnected or a new source device 300 is recognized, source device information is displayed to the user there is a need to do In addition, the processor 130 may display source device information even when a plurality of source devices are recognized. This is because there is a need to display information related to each of a plurality of source devices to allow the user to select one source device from which content is supplied.

Meanwhile, the processor 130 may identify whether the sink device 200 is connected to the source device 300 based on connection information received from the sink device 200 through the communication interface 120. In addition, when the sink device 200 is identified as being connected to the source device 300, the processor 130 may receive source device information from the sink device 200 through the communication interface 120. In addition, if the processor 130 identifies that the sink device 200 is not connected to the source device 300, the first UI (or sink device) corresponding to the absence of the source device 300 connected to the sink device 200 The display 110 may be controlled to display a first UI indicating that there is no source device 300 connected to 200 .

Here, the processor 130 may receive connection information from the sink device 200. Here, the connection information may include a connection state between the sink device 200 and the source device 300. The connection information may mean information indicating whether the source device 300 is connected to the sink device 200. Here, the connection information may include a General-Purpose Input/Output (GPIO) value. A detailed description related to the connection information is described in a table 1610 of FIG. 16 .

Here, the processor 130 may identify whether the source device 300 is currently connected to the sink device 200 based on the connection information.

When it is identified that the source device 300 is connected to the sink device 200 based on the connection information, the processor 130 may identify whether source device information has been received from the sink device 200.

When the source device 300 is identified as being connected to the sink device 200 and source device information is received from the sink device 200, the processor 130 may determine whether to display the source device information on the display 110. . Also, the processor 130 may display source device information on the display 110 based on a preset event.

When it is identified that the source device 300 is connected to the sink device 200 and source device information is not received from the sink device 200, the processor 130 may request source device information from the sink device 200. Specifically, the processor 130 may generate a control signal requesting source device information and control the communication interface 120 to transmit the generated control signal to the sink device 200 . The sink device 200 may transmit source device information to the electronic device 100 in response to a source device information request (a control signal requesting source device information) received from the electronic device 100 .

Meanwhile, when it is identified that the source device 300 is not connected to the sink device 200 based on the connection information, the processor 130 displays a first UI (or source device) corresponding to the source device 300 not being recognized. A first UI indicating that 300 is not recognized may be displayed on the display 110 .

Here, the first UI may include information for notifying the user that the source device 300 to receive current content is not recognized. If a blank screen is displayed in a state where the source device 300 is not recognized, or only a guide message indicating that there is no connected device is displayed, the user determines whether the connection between the electronic device 100 and the sink device 200 has failed or the sink device 200 It may be difficult to know whether the connection between the source device 300 and the source device 300 has failed. Accordingly, the processor 130 may generate a first UI for notifying that the source device 300 is not recognized, and output the generated first UI.

Also, some users may not understand how the source device 300 should be connected to the sink device 200. Accordingly, the processor 130 may generate a first UI for notifying that the source device 300 to be connected to the sink device 200 is not recognized, and output the generated first UI.

The user can easily recognize through the first UI that there is a problem that the source device 300 is not connected, and that the source device 300 needs to be connected to the sink device 200. there is. Here, detailed descriptions related to the first UI are described in FIGS. 4 and 5 .

Meanwhile, the source device information may include at least one of source device identification information, manufacturer information, source device type information, supported codec information, supported resolution information, or content information provided by the source device 300 .

Here, the source device information may mean information related to the source device 300. The source device identification information may include information capable of specifying the source device 300, such as a model name. Manufacturer information may include a company that produced the source device 300 . The source device type information may include information (eg, a game device, a set-top box, a cloud server, etc.) indicating which function the source device provides. Supported codec information may refer to codec information related to content provided by the source device 300 . Supported resolution information may mean resolution information related to content provided by the source device 300 . Here, the content information provided by the source device 300 may mean predetermined content information, and a description related thereto is described in content information stored in a sixth region of FIG. 16 .

Here, the source device information may include additional information according to various embodiments in addition to the above information. A detailed description related to the source device information is described in the table 1620 of FIG. 16 .

Meanwhile, the electronic device 100 may further include an input/output interface 160, and when the processor 130 is connected to the sink device 200 through the input/output interface 160, a function corresponding to selection of the source device 300 is provided. The display 110 may be controlled to display the second UI (or the second UI for selecting the source device 300). In addition, the processor 130 receives content from the source device 300 when a user input corresponding to selection of the source device 300 (or a user input for selecting the source device 300) is received through the second UI. The display 110 may be controlled to display a third UI corresponding to being available (or a third UI indicating that content may be received from the source device 300).

Here, the processor 130 may identify whether the sink device 200 is connected to the electronic device 100 through the communication interface 120 or the input/output interface 160 .

According to an embodiment, connection of the sink device 200 to the electronic device 100 through the communication interface 120 may mean a state of being connected through a wireless communication method (eg, Bluetooth or Wi-Fi).

According to another embodiment, connection of the sink device 200 to the electronic device 100 through the input/output interface 160 may mean a state in which the sink device 200 is connected through a wired communication method (eg, HDMI). Here, HDMI may mean not only general HDMI, but also HDMI-ARC (Audio Return Channel) or HDMI-eARC (Enhanced Audio Return Channel).

According to another embodiment, the sink device 200 may be connected to the electronic device 100 through the communication interface 120 and simultaneously connected through the input/output interface 160 . That is, the sink device 200 and the electronic device 100 may be connected using both a wireless communication method and a wired communication method.

Here, the processor 130 may identify whether the electronic device 100 is connected to the sink device 200 through the input/output interface 160 . For example, the processor 130 may identify whether the electronic device 100 and the sink device 200 are connected through HDMI. If the electronic device 100 and the sink device 200 are connected through the input/output interface 160, the processor 130 identifies that the electronic device 100 can output content transmitted from the sink device 200. can do. Accordingly, the processor 130 may display the second UI corresponding to the selection of the source device 300 on the display 110 . Here, the second UI may be a guide UI for finally selecting the source device 300 providing content. A detailed description related to the second UI will be described in FIG. 8 .

The processor 130 may receive a user input corresponding to selection of the source device 300 after the second UI is displayed on the display 110 . When a user input corresponding to selection of the source device 300 is received, the processor 130 may display a third UI on the source device 300 . Here, the third UI may include a UI related to a content providing operation. The third UI may include information related to content in the source device 300 selected by the user. A detailed description related to the third UI will be described in FIG. 9 .

On the other hand, when the processor 130 receives a user input corresponding to a request for one of the plurality of contents provided by the source device 300 after the third UI is displayed (or a user input requesting one content), A control command for requesting content corresponding to a user input may be transmitted to the sink device through a communication interface. Also, the processor 130 may receive a content image corresponding to a control command from a sink device through a communication interface. Also, the processor 130 may control the display 110 to display the received content image. Here, content audio corresponding to a control command for requesting content may be output from the sink device 200 .

Here, the processor 130 may receive a user input (or a user input for selecting one content) corresponding to selection of at least one content from among a plurality of content that can be provided by the source device 300 . Here, the processor 130 may generate a control command (or control signal) for requesting content corresponding to the user input. And, the processor 130 may transmit the generated control command to the sink device 200 . Here, the processor 130 may transmit a control command to the sink device 200 through the communication interface 120 . That is, the processor 130 may transmit a control command to the sink device 200 using a wireless communication method.

The sink device 200 may receive a control command from the electronic device 100. And, the sink device 200 may transmit the received control command to the source device 300.

The source device 300 may receive a control command from the sink device 200. Also, the source device 300 may identify content corresponding to the control command based on the received control command. And, the source device 300 may transmit the identified content to the sink device 200.

The sink device 200 may receive content corresponding to a control command from the source device 300 . And, the sink device 200 may obtain audio information based on content corresponding to the control command. And, the sink device 200 may output audio information.

According to an embodiment, the sink device 200 may obtain image information from content corresponding to a control command. And, the sink device 200 may transmit image information to the electronic device 100 through the input/output interface 160 . For example, the sink device 200 may transmit image information to the electronic device 100 through HDMI.

According to another embodiment, the sink device 200 may transmit content corresponding to a control command to the electronic device 100 . The processor 130 may obtain image information from content received from the sink device 200 . And, the processor 130 may display the received image information on the display 110 .

An operation of outputting audio information from the sink device 200 and outputting image information from the electronic device 100 will be additionally described in FIG. 10 .

Meanwhile, the electronic device 100 further includes an input/output interface 160, and if the processor 130 is not connected to the sink device 200 through the input/output interface 160, the electronic device 100 and the sink device 200 The display 110 can be controlled to display a fourth UI (or a fourth UI for guiding the connection of the electronic device 100 and the sink device 200 with an HDMI cable) corresponding to the connection of ) with an HDMI cable. .

Here, the processor 130 may identify whether the electronic device 100 and the sink device 200 are connected through the input/output interface 160 . For example, the processor 130 may identify whether the electronic device 100 and the sink device 200 are connected through an HDMI cable. Since the sink device 200 can transmit image information (or content including image information) to the electronic device 100 only when the electronic device 100 and the sink device 200 are connected with an HDMI cable, the electronic device 100 ) and the sink device 200 need to be connected with an HDMI cable.

Accordingly, when the electronic device 100 and the sink device 200 are not connected through an HDMI cable, the processor 130 cannot normally receive content. Accordingly, when the electronic device 100 and the sink device 200 are not connected by an HDMI cable, the processor 130 generates a fourth UI for guiding the electronic device 100 and the sink device 200 to be connected by an HDMI cable. It can be displayed on the display 110. Here, the fourth UI may refer to a UI for guiding a user to directly connect the electronic device 100 and the sink device 200 with an HDMI cable. A detailed description related to the fourth UI will be described in FIG. 11 .

Meanwhile, when the processor 130 is connected to the sink device 200 through the input/output interface 160 after the fourth UI is displayed, the processor 130 sets the display 110 to display the second UI corresponding to the selection of the source device 300. You can control it.

Here, the processor 130 may identify whether or not the electronic device 100 and the sink device 200 are connected through the input/output interface 160 at predetermined intervals after the fourth UI is displayed. For example, the processor 130 may identify whether the electronic device 100 and the sink device 200 are connected through an HDMI cable.

If the electronic device 100 and the sink device 200 are connected through the input/output interface 160 after the fourth UI is displayed, the processor 130 displays the second UI corresponding to the selection of the source device 300 (110). ) can be displayed.

Meanwhile, the processor 130 may receive sink device information of the sink device 200 through the communication interface 120 and control the display 110 to display sink device information and source device information.

Here, the processor 130 may additionally receive sink device information in addition to source device information. Here, the sink device information may mean information related to the sink device 200. The processor 130 may display source device information and sink device information together on the display 110 . The processor 130 may combine source device information and sink device information into one piece of text information. For example, the processor 130 may generate “sink device information” with “source device information” as one piece of text information. A detailed description related to this will be described through the second UI 820 of FIG. 8 .

When source device information and sink device information are displayed together, the user can clearly distinguish the sink device 200 and the source device 300.

Meanwhile, the electronic device 100 further includes an input/output interface 160 and a speaker 170, and if the processor 130 is not connected to the sink device 200 through the input/output interface 160, the communication interface 120 A data packet including source device information and audio information may be received through and audio information included in the data packet received through the speaker 170 may be output.

Here, the processor 130 may receive a data packet from the sink device 200 through the communication interface 120 . Here, the data packet may mean information in which source device information and audio information are packed.

Here, the audio information may refer to audio information included in content provided by the source device 300. Since the electronic device 100 and the sink device 200 are not connected through HDMI, the sink device 200 cannot transmit (high quality) image information to the electronic device 100 . Accordingly, the sink device 200 may transmit audio information to the electronic device 100 separately from image information without outputting audio information on its own.

When it is identified that the electronic device 100 and the sink device 200 are not connected through the input/output interface 160, the processor 130 receives a data packet in which source device information and audio information are combined from the sink device 200. can do.

Specifically, if the sink device 200 is not connected to the electronic device 100 through an HDMI cable, it may generate a data packet in which source device information and audio information are packed in the electronic device 100. The sink device 200 may extract audio information from content received from the source device 300. In addition, the sink device 200 may generate a data packet by packing the source device information received from the source device 300 and the extracted audio information. And, the sink device 200 may transmit the generated data packet to the electronic device 100.

Here, the processor 130 may extract source device information and audio information from the data packet received from the sink device 200. Also, the processor 130 may display the source device 300 on the display 110 and output audio information through the speaker 170 . A detailed description related to this will be described in FIGS. 24 and 25 .

If the electronic device 100 and the sink device 200 are connected through the input/output interface 160, the processor 130 may stop outputting audio information through the speaker 170. When the electronic device 100 and the sink device 200 are connected through the input/output interface 160, the electronic device 100 can normally output image information included in the content, so that the electronic device 100 is not the sink device 100. This is because the device 200 only needs to output audio information included in the content. Accordingly, when the normal connection between the electronic device 100 and the sink device 200 is completed, the processor 130 does not need to output audio information through the speaker 170 any longer.

Meanwhile, the processor 130, when the sink device 200 is disconnected from the source device 300 while the sink device 200 is connected to the source device 300, the sink device 200 and the source device ( 300) to control the display 110 to display a fifth UI (or a fifth UI for notifying that the sink device 200 has disconnected from the source device 300) corresponding to the release, and the sink device 200 If the sink device 200 is identified as being connected to the source device 300 while not connected to the source device 300, the sixth UI corresponding to the connection between the sink device 200 and the source device 300 ( Alternatively, the sink device 200 may control the display 110 to display a sixth UI for notifying that the source device 300 is connected.

Detailed descriptions related to the fifth UI and the sixth UI are described in FIGS. 12 to 14 .

Meanwhile, the electronic device 100 may receive information related to the source device 300 through the sink device 200 despite not being directly connected to the source device 300 . And, the electronic device 100 may provide the received information related to the source device 300 to the user. The user can easily recognize whether the source device 300 is currently connected or whether connection of the source device 300 is required based on information related to the source device 300 provided by the electronic device 100. .

Meanwhile, the electronic device 100 may output information related to whether the input/output interface 160 is connected to the electronic device 100 and the sink device 200 . If necessary, the electronic device 100 may guide the user to directly connect the electronic device 100 and the sink device 200 with an HDMI cable. Users can easily figure out the connection settings.

Meanwhile, in the above, only a simple configuration constituting the electronic device 100 has been shown and described, but various configurations may be additionally provided during implementation. This will be described below with reference to FIG. 3 .

FIG. 3 is a block diagram for explaining a specific configuration of the electronic device 100 of FIG. 2 .

Referring to FIG. 3 , the electronic device 100 includes a display 110, a communication interface 120, a processor 130, a memory 140, a manipulation interface 150, an input/output interface 160, a speaker 170, and A microphone 180 may be included.

Meanwhile, among the operations of the display 110, the communication interface 120, and the processor 130, duplicate descriptions of the same operations as those described above will be omitted.

The memory 140 is implemented as an internal memory such as a ROM (eg, electrically erasable programmable read-only memory (EEPROM)) or RAM included in the processor 130, or It may be implemented as a separate memory. In this case, the memory 140 may be implemented in the form of a memory embedded in the electronic device 100 or in the form of a removable memory in the electronic device 100 depending on the purpose of storing data. For example, data for driving the electronic device 100 is stored in a memory embedded in the electronic device 100, and data for an extended function of the electronic device 100 is detachable from the electronic device 100. It can be stored in available memory.

On the other hand, in the case of memory embedded in the electronic device 100, volatile memory (eg, DRAM (dynamic RAM), SRAM (static RAM), SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (non-volatile memory) ( Examples: OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (such as NAND flash or NOR flash, etc.) ), a hard drive, or a solid state drive (SSD), in the case of a memory that is implemented as at least one and is detachable from the electronic device 100, a memory card (eg, a compact flash (CF), SD ( secure digital), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to the USB port (e.g. USB memory) and the like.

The manipulation interface 150 may be implemented as a device such as a button, a touch pad, a mouse, or a keyboard, or may be implemented as a touch screen capable of simultaneously performing the above-described display function and manipulation input function. Here, the buttons may be various types of buttons such as mechanical buttons, touch pads, wheels, etc. formed on an arbitrary area such as the front, side, or rear surface of the main body of the electronic device 100 .

The input/output interface 160 includes HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, It may be any one of an RGB port, a D-subminiature (D-SUB), and a Digital Visual Interface (DVI). The input/output interface 160 may input/output at least one of audio and video signals. Depending on the implementation example, the input/output interface 160 may include a port for inputting/outputting only audio signals and a port for inputting/outputting only video signals as separate ports, or may be implemented as a single port for inputting/outputting both audio signals and video signals. Meanwhile, the electronic device 100 may transmit at least one of audio and video signals to an external device (eg, an external display device or an external speaker) through the input/output interface 160 . Specifically, an output port included in the input/output interface 160 may be connected to an external device, and the electronic device 100 may transmit at least one of audio and video signals to the external device through the output port.

Here, the input/output interface 160 may be connected to the communication interface 120 . The input/output interface 160 may transmit information received from an external device to a communication interface or transmit information received through the communication interface 120 to an external device.

The speaker 170 may be a component that outputs not only various kinds of audio data, but also various notification sounds or voice messages.

The microphone 180 is a component for receiving a user's voice or other sounds and converting them into audio data. The microphone 180 may receive a user's voice in an activated state. For example, the microphone 180 may be formed integrally with the electronic device 100 in an upper, front, or side direction. The microphone 180 includes a microphone for collecting analog user voice, an amplifier circuit for amplifying the collected user voice, an A/D conversion circuit for sampling the amplified user voice and converting it into a digital signal, and a noise component from the converted digital signal. It may include various configurations such as a filter circuit that removes .

There may be various embodiments in which the electronic device 100 performs an operation corresponding to a user voice signal received through the microphone 180 .

For example, the electronic device 100 may control the display 110 based on a user voice signal received through the microphone 180 . For example, when a user voice signal for displaying content A is received, the electronic device 100 may control the display 110 to display content A.

As another example, the electronic device 100 may control an external display device connected to the electronic device 100 based on a user voice signal received through the microphone 180 . Specifically, the electronic device 100 may generate a control signal for controlling the external display device so that an operation corresponding to a user voice signal is performed in the external display device, and transmit the generated control signal to the external display device. Here, the electronic device 100 may store a remote control application for controlling the external display device. And, the electronic device 100 may transmit the generated control signal to an external display device using at least one communication method among Bluetooth, Wi-Fi, and infrared. For example, when a user voice signal for displaying content A is received, the electronic device 100 may transmit a control signal for controlling content A to be displayed on the external display device to the external display device. Here, the electronic device 100 may refer to various terminal devices capable of installing remote control applications such as a smart phone and an AI speaker.

As another example, the electronic device 100 may use a remote control device to control an external display device connected to the electronic device 100 based on a user voice signal received through the microphone 180 . Specifically, the electronic device 100 may transmit a control signal for controlling the external display device to the remote control device so that an operation corresponding to a user voice signal is performed in the external display device. And, the remote control device may transmit the control signal received from the electronic device 100 to the external display device. For example, when a user voice signal for displaying content A is received, the electronic device 100 transmits a control signal for controlling content A to be displayed on an external display device to the remote control device, and the remote control device receives the signal. The control signal may be transmitted to an external display device.

Meanwhile, regarding whether or not the display 110 is included, the electronic device 100 may be implemented in various embodiments.

According to an embodiment, the electronic device 100 may include the display 110. Specifically, the electronic device 100 may directly display the acquired image (or image information) or content on the display 110 .

Meanwhile, according to another embodiment, the electronic device 100 may not include the display 110. The electronic device 100 may be connected to an external display device and may transmit images or contents stored in the electronic device 100 to the external display device. Specifically, the electronic device 100 may transmit the image or content to the external display device together with a control signal for controlling the display of the image or content on the external display device. Here, the external display device may be connected to the electronic device 100 through the communication interface 120 or the input/output interface 160 . For example, the electronic device 100 may not include a display like a set top box (STB). Also, the electronic device 100 may include only a small display capable of displaying simple information such as text information. Here, the electronic device 100 may transmit images or content to an external display device wired or wirelessly through the communication interface 120 or to an external display device through the input/output interface 160 .

Meanwhile, implementation methods of the communication interface 120 may vary. The electronic device 100 may communicate with an external server using a first communication module included in the communication interface 120 . Also, the electronic device 100 may communicate with a remote control device corresponding to the electronic device 100 by using a second communication module included in the communication interface 120 .

According to an embodiment, the first communication module and the second communication module may be different. For example, a first communication module used by the electronic device 100 to communicate with an external server may be an Ethernet module or a Wi-Fi module, and a second communication module used by the electronic device 100 to communicate with a remote control device is It may be a Bluetooth module.

According to another embodiment, the first communication module and the second communication module may be the same. For example, a first communication module used by the electronic device 100 to communicate with an external server may be a Wi-Fi module, and a second communication module used by the electronic device 100 to communicate with a remote control device may also be a Wi-Fi module. can

However, these are just some examples, and the electronic device 100 may use various communication modules when communicating with an external device or an external server.

4 is a diagram for explaining the operation of the electronic device 100 outputting source device information.

Referring to FIG. 4 , the electronic device 100 may receive connection information from the sink device 200 (S405). Here, the connection information may mean information indicating whether the source device 300 is connected to the sink device 200. Here, the electronic device 100 may identify whether the sink device 200 and the source device 300 are connected based on the connection information (S410). If it is identified that no source device is connected to the sink device 200 (S410-N), the electronic device 100 may output a first UI corresponding to the absence of a source device connected to the sink device 200. (S415). The user can know that the source device is not currently connected to the sink device 200 through the output first UI. Here, the first UI will be described in detail with reference to FIG. 5 .

When it is identified that the source device 300 is connected to the sink device 200 (S410-Y), the electronic device 100 receives source device information of the source device 300 connected to the sink device 200 from the sink device 200. can be received (S420). And, the electronic device 100 may output the received source device information (S425).

5 is a diagram for explaining an operation of outputting a first UI corresponding to the absence of the source device 300 connected to the sink device 200.

Referring to FIG. 5 , it is assumed that the sink device 200 is not connected to the source device 300. Here, the sink device 200 may generate connection information based on a state in which it is not connected to the source device 300. And, the sink device 200 may transmit the generated connection information to the electronic device 100. Here, the electronic device 100 may identify that there is no source device connected to the sink device 200 based on connection information received from the sink device 200 . And, the electronic device 100 may output a first UI 510 corresponding to the fact that there is no source device connected to the sink device 200 . Here, the first UI 510 includes image information 511 corresponding to the absence of a source device connected to the sink device 200, text information 512 corresponding to the absence of a source device connected to the sink device 200, or source device 200. At least one of text information 513 for guiding connection of the device 300 to the sink device 200 may be included.

According to another embodiment, the text information 512 and the text information 513 may be implemented as image information or audio information. The electronic device 100 may output information corresponding to the absence of a source device connected to the sink device 200 as an image or audio.

6 is a flowchart illustrating an operation of outputting a second UI corresponding to selection of a source device 300 and a third UI corresponding to being able to receive content from the source device 300 according to an embodiment. .

Referring to FIG. 6 , steps S605 , S610 , S615 , and S620 may correspond to steps S405 , S410 , S415 , and S420 of FIG. 4 , so duplicate descriptions are omitted.

After receiving the source device information (S620), the electronic device 100 may output a second UI corresponding to the selection of the source device 300 (S625). Here, the second UI may include a guide screen corresponding to the user's selection of a source device to be provided with content. The electronic device 100 may receive source device information from the sink device 200 and may output a second UI corresponding to the user's selection of a specific source device based on the received source device information. The second UI is specifically described in FIG. 8 .

Meanwhile, when a user input corresponding to selection of the source device 300 is received through the second UI, the electronic device 100 outputs a third UI corresponding to being able to receive content from the source device 300. It can (S630). Here, the third UI may include a guide screen corresponding to selection of content that can be viewed by the user. The third UI is specifically described in FIG. 9 .

Meanwhile, in order to perform steps S625 and S630, the electronic device 100 may perform an additional determination operation. A description related to this will be described in FIG. 7 .

7 illustrates an operation of outputting a second UI corresponding to selection of the source device 300 and a third UI corresponding to being able to receive content from the source device 300 and the electronic device 100 according to another embodiment. And it is a flowchart for explaining an operation of outputting a fourth UI corresponding to connecting the sink device 200 with an HDMI cable.

Referring to FIG. 7 , steps S705 , S710 , S715 , and S720 may correspond to steps S405 , S410 , S415 , and S420 of FIG. 4 , so duplicate descriptions are omitted.

After receiving the source device information (S720), the electronic device 100 may identify whether the sink device 200 and the electronic device 100 are connected through HDMI (S725). Here, HDMI may mean HDMI-ARC (Audio Return Channel) or HDMI-eARC (Enhanced Audio Return Channel).

When the electronic device 100 is connected to the sink device 200 through HDMI (S725-Y), the electronic device 100 may output a second UI corresponding to the selection of the source device 300 (S730). . Further, when the electronic device 100 receives a user input corresponding to selection of the source device 300 through the second UI, the electronic device 100 corresponds to being able to receive content from the source device 300. A third UI may be output (S735). Meanwhile, since descriptions related to the second UI and the third UI are described in FIG. 6 , redundant descriptions are omitted.

If the electronic device 100 is not connected to the sink device 200 through HDMI (S725-N), the electronic device 100 provides a control system corresponding to connecting the electronic device 100 and the sink device 200 with an HDMI cable. 4 UIs can be output (S740). Here, the fourth UI needs to connect the electronic device 100 and the sink device 200 with an HDMI cable and may include a screen for guiding the user to connect the HDMI cable. Here, the fourth UI is described in FIG. 11 .

Meanwhile, various embodiments may exist in relation to the subject of the operation of determining whether the electronic device 100, the sink device 200, and the source device 300 are connected.

According to an embodiment, an operation of determining whether the source device 300 is connected to the sink device 200 and an operation of determining whether the electronic device 100 and the sink device 200 are connected through HDMI. may be performed by the electronic device 100. A description related to this has been described in the operation of the processor 130 and FIG. 7 described above.

According to another embodiment, an operation of determining whether the source device 300 is connected to the sink device 200 and an operation of determining whether the electronic device 100 and the sink device 200 are connected through HDMI. can be performed on an external server. Here, the electronic device 100 only performs an operation of receiving connection information and source device information from the sink device 200 and an operation of displaying a UI, and an operation of determining whether or not there is a connection between devices is actually performed by an external server. It can be. The electronic device 100 may transmit information necessary for the determination to the external server so that the external server can determine whether the devices are connected. The electronic device 100 may transmit connection information received from the sink device 200 and information indicating whether or not HDMI connection is established to an external server. Here, an operation of determining a UI corresponding to each situation may also be performed in an external server. Accordingly, the external server may determine a UI to be displayed on the electronic device 100 and transmit the determined UI to the electronic device 100 . The electronic device 100 may display a UI received from an external server.

According to another embodiment, an operation of determining whether the source device 300 is connected to the sink device 200 is performed by an external server, and the electronic device 100 and the sink device 200 are connected through HDMI. An operation of determining whether or not the electronic device 100 is configured may be performed. The electronic device 100 may transmit connection information received from the sink device 200 to an external server. In addition, the external server may determine whether the source device 300 is connected to the sink device 200 based on the connection information received from the electronic device 100 . The external server may obtain a connection status result and transmit the obtained result to the electronic device 100 . The electronic device 100 may perform an operation corresponding to a result obtained from an external server (a result of whether the source device 300 is connected to the sink device 200).

8 is a diagram for explaining an operation of outputting a second UI corresponding to selection of the source device 300.

Referring to FIG. 8 , it is assumed that the sink device 200 and the source device 300 are connected, and the electronic device 100 and the sink device 200 are connected. For example, the sink device 200 and the source device 300 are connected via HDMI, and the electronic device 100 and the sink device 200 may be connected using at least one of HDMI, Bluetooth, or Wi-Fi.

Here, the electronic device 100 may receive source device information from the sink device 200 . And, the electronic device 100 may output source device information. Here, the electronic device 100 may output second

UIs

810 and 820 corresponding to the selection of the source device.

Here, the second UI 810 includes at least one of text information 811 requesting selection of a source device to be connected or a list 812 including at least one source device information capable of supplying content to the electronic device 100. can do.

According to an embodiment, the electronic device 100 may output source device information of at least one source device capable of supplying content to the electronic device 100 . For example, if it is identified that one source device can supply content to the electronic device 100, the electronic device 100 can output source device information related to the one source device. Also, if it is identified that a plurality of source devices can supply content to the electronic device 100, the electronic device 100 can output source device information related to the plurality of source devices. The user can always select a specific source device regardless of the content that can be provided.

According to another embodiment, the electronic device 100 may identify the number of source devices that supply content to the electronic device 100 . And, only when the number of source devices supplying content to the electronic device 100 is two or more, the electronic device 100 may output source device information. For example, if it is identified that one source device can supply content to the electronic device 100, the electronic device 100 does not output separate source device information and directly provides content (or content) from one source device. Request UI) can be output. Also, if it is identified that a plurality of source devices can supply content to the electronic device 100, the electronic device 100 can output source device information related to the plurality of source devices. When there is only one source device capable of receiving content, the user can directly request or receive content from one source device without a separate input.

Meanwhile, the second UI 820 includes text information 821 for guiding selection of a source device to be connected or

text information

822, 823, 824) may include at least one.

Here, the

text information

822, 823, 824 is the identification information of the sink device 200 (A-soundbar, B-soundbar, A-router) or the source device 300 identification information (A-STB, B -STB, C-could) may include at least one.

Meanwhile, if identification information of the source device is not clearly recognized, the electronic device 100 may simply replace the source device with an “external device” and output the same. For example, the electronic device 100 may output “A-sound bar” with “external device” instead of text information 822 .

FIG. 9 is a diagram for explaining an operation of outputting a third UI corresponding to content being able to be received from the source device 300. Referring to FIG.

Referring to FIG. 9 , when the electronic device 100 receives a user input corresponding to selection of the source device 300 through the

second UIs

810 and 820 of FIG. 8 , the electronic device 100 is the source device ( 300), a third UI 910 corresponding to being able to receive content may be output. Here, the third UI 910 may be created based on content information stored in the sixth area of FIG. 16 .

Here, the third UI 910 includes text information 911 notifying the source device (A-STB) selected according to a user input, text information 912 guiding content selection from the selected source device (A-STB), or It may include at least one of content selection UIs 913 that can be provided by the source device (A-STB).

When the user selects one piece of content through the UI 913, the electronic device 100 may receive the selected content from the source device 300 through the sink device 200. A specific operation related to this is described in FIG. 10 .

10 is a diagram for explaining an operation of outputting audio information from the sink device 200 and outputting image information from the electronic device 100 .

Referring to FIG. 10 , when a user input corresponding to content selection is received through the third UI 910 of FIG. 9 , the electronic device 100 receives a user input from the source device 300 through the sink device 200. Content corresponding to can be received. It is assumed that the “NEWS” item is selected in the third UI 910 of FIG. 9 .

The electronic device 100 may transmit a user input for selecting the “NEWS” item to the sink device 200. And, the sink device 200 may request the electronic device 100 for content related to the “NEWS” item. In addition, the source device 300 may transmit content corresponding to a user input to the sink device 200 in response to a request received from the sink device 200 .

And, the sink device 200 may receive content corresponding to the user input received from the source device 300 . Here, the sink device 200 may output information included in the received content. For example, if the sink device 200 is a sound bar, the sink device 200 may output audio information included in content. And, the sink device 200 may transmit content corresponding to the user input to the electronic device 100 .

And, the electronic device 100 may output image information 1010 included in the received content.

Meanwhile, according to an implementation example, if the sink device 200 is a sound bar, only image information included in content may be transmitted to the electronic device 100 after the sound bar outputs audio information.

11 is a diagram for explaining an operation of outputting a fourth UI corresponding to connecting the electronic device 100 and the sink device 200 with an HDMI cable.

Referring to FIG. 11 , if the electronic device 100 and the sink device 200 are not connected through HDMI, the electronic device 100 may output a fourth UI 1110. Here, the fourth UI 1110 is image information 1111 for notifying that the electronic device 100 and the sink device 200 are not connected via HDMI, and the electronic device 100 and the sink device 200 are connected via HDMI. It may include at least one of text information 1112 for notifying that it is not connected, or text information 1113 for guiding connection of the electronic device 100 and the sink device 200 through HDMI.

The user can easily recognize that the sink device 200 and the electronic device 100 need to be connected through HDMI through the fourth UI 1110 .

12 is a flowchart for explaining an operation of outputting a fifth UI and a sixth UI output according to the connection state of the sink device 200 and the source device 300.

Referring to FIG. 12 , steps S1205 and S1210 may correspond to steps S405 and S410 of FIG. 4 , and duplicate descriptions are omitted.

If the sink device 200 is identified as being connected to the source device 300 (S1210-Y), the electronic device 100 may re-receive connection information from the sink device 200 every preset period (S1221 ). And, the electronic device 100 can identify whether the sink device 200 and the source device 300 are connected (S1222).

When it is identified that the sink device 200 and the source device 300 are connected (S1222-Y), the electronic device 100 re-receives connection information from the sink device 200 every predetermined period (S1221) And an operation of identifying whether the sink device 200 and the source device 300 are connected (S1222) may be repeatedly performed.

When it is identified that the sink device 200 and the source device 300 are not connected (S1222-N), the electronic device 100 displays a fifth UI for notifying that the sink device 200 is disconnected from the source device. It can be output (S1223). Here, when it is identified that the sink device 200 is changed from a state in which the sink device 200 is connected to the source device 300 to a state in which the sink device 200 is not connected to the source device 300, the electronic device 100 outputs a fifth UI. can do. Here, the fifth UI may be information for notifying a change in connection state (connection->disconnection) between the sink device 200 and the source device 300. The fifth UI is specifically described in FIG. 13 .

If the sink device 200 is identified as not connected to the source device 300 (S1210-N), the electronic device 100 may re-receive connection information from the sink device 200 at predetermined intervals ( S1231). And, the electronic device 100 can identify whether the sink device 200 and the source device 300 are connected (S1232).

When it is identified that the sink device 200 and the source device 300 are not connected (S1232-N), the electronic device 100 re-receives connection information from the sink device 200 every predetermined period (S1231 ) and identifying whether the sink device 200 and the source device 300 are connected (S1232) may be repeatedly performed.

When it is identified that the sink device 200 and the source device 300 are connected (S1232-Y), the electronic device 100 may output a sixth UI corresponding to the connection between the sink device 200 and the source device. Yes (S1233). Here, when it is identified that the sink device 200 is changed from a state in which the sink device 200 is not connected to the source device 300 to a state in which the sink device 200 is connected to the source device 300, the electronic device 100 outputs a sixth UI. can do. Here, the sixth UI may be information for notifying a change in connection state (disconnection->connection) between the sink device 200 and the source device 300. The sixth UI is specifically described in FIG. 14 .

Meanwhile, a preset cycle (first cycle) for re-receiving connection information in step S1221 and a preset cycle (second cycle) for re-receiving connection information in step S1231 may be different. In step S1221, since connection information is re-received while the sink device 200 and the source device 300 are already connected, it is likely that the sink device 200 and the source device 300 will continue to be connected under normal circumstances. However, since the sink device 200 and the source device 300 re-receive connection information in a disconnected state in step S1231, there is a possibility of reconnection at any time. Therefore, the preset cycle (first cycle) for re-receiving connection information in step S1221 may be longer than the preset cycle (second cycle) for re-receiving connection information in step S1231. That is, in a state in which the sink device 200 is not connected to the source device 300, the electronic device 100 re-receives connection information more often than in a state in which the sink device 200 is connected to the source device 300, It is possible to identify whether the sink device 200 and the source device 300 are connected.

Meanwhile, according to an implementation example, a preset cycle (first cycle) for re-receiving connection information in step S1221 and a preset cycle (second cycle) for re-receiving connection information in step S1231 may be the same. For example, the preset period may be 500 ms.

13 is a diagram for explaining an operation of outputting a fifth UI corresponding to release of the sink device 200 and the source device 300.

Referring to FIG. 13 , when the sink device 200 and the source device 300 change from a connected state to a disconnected state, the electronic device 100 performs a fifth The UI 1310 may be output. Here, the fifth UI 1310 includes image information 1311 for notifying a state in which the sink device 200 and the source device 300 are disconnected, and the sink device 200 and the source device 300 are disconnected. It may include at least one of text information 1312 for notifying the status and text information 1313 for guiding connection of the source device 300 to the sink device 200.

14 is a diagram for explaining an operation of outputting a sixth UI corresponding to the connection between the sink device 200 and the source device 300.

Referring to FIG. 14 , when the sink device 200 and the source device 300 change from a disconnected state to a connected state, the electronic device 100 displays a sixth A UI 1410 may be output. Here, the sixth UI 1410 includes image information 1411 for notifying the connected state of the sink device 200 and the source device 300, and text for notifying the connected state of the sink device 200 and the source device 300. It may include at least one of information 1412 and text information 1413 for guiding selection of the source device 300 .

15 is a flowchart for explaining an operation of identifying whether a sink device 200 and a source device 300 are connected or not and an operation of outputting source device information.

Referring to FIG. 15, the sink device 200 may identify whether or not it is connected to the source device 300 at each preset period (S1505). For example, the electronic device 100 may acquire a General-Purpose Input/Output (GPIO) value to identify whether or not it is connected to the source device 300. If the GPIO value is identified as a preset first value, the sink device 200 may identify that it is not connected to the source device 300. In addition, when the GPIO value is identified as a preset second value, the sink device 200 may be identified as being connected to the source device 300.

Here, the sink device 200 may identify whether the connection state with the source device 300 has changed (S1510). The connection state with the source device 300 may mean a state in which the sink device 200 and the source device 300 are connected to each other or a state in which the sink device 200 and the source device 300 are disconnected from each other. there is. For example, the sink device 200 may identify whether a connection state is changed based on whether a GPIO value is changed. For example, when the GPIO value is changed from a preset second value to a preset first value, the sink device 200 may identify that the connection with the source device 300 has been released. In addition, when the GPIO value is changed from the preset first value to the preset second value, the sink device 200 may be identified as being connected to the source device 300.

If the connection state between the sink device 200 and the source device 300 does not change (S1510-N), the sink device 200 performs an operation (S1505) of identifying whether or not it is connected to the source device 300 every preset period. can be repeated

When the connection state between the sink device 200 and the source device 300 changes (S1510-Y), the sink device 200 may generate connection information (S1515). Here, the connection information may mean information indicating whether the sink device 200 and the source device 300 are connected. Here, the connection information may mean a GPIO value. And, the sink device 200 may transmit the generated connection information to the electronic device 100 (S1520).

The electronic device 100 may receive connection information from the sink device 200. Then, the electronic device 100 can identify whether or not there is a connection between the sink device 200 and the source device 300 based on the received connection information (S1525).

If the source device 300 is identified as not connected to the sink device 200 (S1525-N), connection information may be repeatedly received from the sink device 200.

If the source device 300 is identified as being connected to the sink device 200 (S1525-Y), the electronic device 100 may request source device information corresponding to the source device 300 from the sink device 200 ( S1526). That is, the electronic device 100 may transmit a source device information request to the sink device 200 . For example, the electronic device 100 may transmit a control signal requesting source device information to the sink device 200 .

The sink device 200 may receive a source device information request from the electronic device 100 . And, the sink device 200 can identify whether source device information is requested (S1530). For example, the source device information request may mean a control signal that calls an application programming interface (API) for reading source device information.

If the source device information request is not identified (S1530-N), the sink device 200 may repeat an operation (S1505) of identifying whether or not it is connected to the source device 300 every preset period.

If the request for source device information is identified (S1530-Y), the sink device 200 may request source device information from the source device 300 (S1535). That is, the sink device 200 may transmit a source device information request to the source device 300.

The source device 300 may receive a source device information request from the sink device 200. In addition, the source device 300 may transmit source device information to the sink device 200 in response to the source device information request (S1540).

The sink device 200 may receive source device information from the source device 300. And, the sink device 200 can identify whether the source device information is recognized (S1545).

If the source device information is not recognized (S1545-N), the sink device 200 may repeat the operation of identifying whether or not it is connected to the source device 300 (S1505) every preset period.

When the source device information is recognized (S1545 Y), the sink device 200 may transmit the received source device information to the electronic device 100 (S1550).

The electronic device 100 may receive source device information from the sink device 200 . And, the electronic device 100 may output source device information (S1555).

16 is a diagram for explaining connection information and device information.

Referring to FIG. 16 , the sink device 200 or the source device 300 may store connection information and source device information.

Meanwhile, the table 1610 may be a table defining connection information.

If the connection information is a preset first value (“0”), the connection information may mean a state in which no source device is connected to the sink device 200.

If the connection information is a preset second value ("1"), the connection information may indicate a state in which the source device is connected to the first HDMI port of the sink device 200.

If the connection information is a preset third value ("2"), the connection information may mean a state in which the source device is connected to the second HDMI port of the sink device 200.

If the connection information is a preset fourth value ("3"), the connection information indicates that the first source device is connected to the first HDMI port of the sink device 200 and the second source device is connected to the second HDMI port of the sink device 200. This may indicate a state in which the device is connected.

Meanwhile, the table 1620 may be a table defining device information. The device information may include at least one of device identification information, manufacturer information, device type information, supported codec information, supported resolution information, or additional information. Here, device information may be stored in data packets. Here, the data packet may refer to a data unit in which a packing operation is performed. In the data packet, device identification information may be stored in the first area, manufacturer information may be stored in the second area, device type information may be stored in the third area, and supported codec information may be stored in the fourth area. Supported resolution information may be stored in the fifth area, content information may be stored in the sixth area, and additional information may be stored in the seventh area. Here, the content information stored in the sixth area may mean information corresponding to at least one of a predetermined broadcasting channel, a predetermined content, and a predetermined application. For example, the content information may include a thumbnail image (or text information) corresponding to at least one of a predetermined broadcasting channel, predetermined content, and a predetermined application.

Here, the device identification information may mean a model name for specifying a device. Here, the device type information may mean information indicating the type of device. For example, the device type information may be set-top box, cloud, game device, and the like.

17 is a diagram for explaining a system including an electronic device 100, a sink device 200, and a source device 300.

Referring to FIG. 17 , the electronic device 100 may include at least one of a main System on Chip (SoC) 141, a High Definition Multimedia Interface (HDMI) 161, and a BT/WIFI module 121.

Here, the main SoC 141 may include at least one of a Consumer Electronics Control (CEC) app 142, a User Interface (UI) app 143, and a Wireless app 144.

Here, the CEC app 142 may transmit and receive information to and from the HDMI 161. In addition, the wireless app 144 may transmit and receive information with the BT/WIFI module 121. In addition, the HDMI 161 of the electronic device 100 may transmit and receive information with the HDMI 261 of the sink device 200 . In addition, the HDMI 161 of the electronic device 100 may transmit and receive information with the CEC app 242 of the sink device 200. In addition, the BT/WIFI module 121 of the electronic device 100 may transmit/receive information with the BT/WIFI module 221 of the sink device 200.

The sink device 200 may include at least one of a main SoC 241, an HDMI 261, and a BT/WIFI module 221.

Here, the main SoC 241 may include at least one of a CEC app 242, an HDMI driver 243, and a Wireless app 244.

Here, the HDMI driver 243 may identify connection information indicating whether or not it is connected to the source device 300 and generate an identification result. In addition, the HDMI driver 243 may obtain a request for source device information and content information that can be provided by the source device 300 from the source device 300 . In addition, the HDMI driver 243 may transmit a request for the acquired content information to at least one of the CEC app 242 and the Wireless app 244.

Here, the CEC app 242 may identify whether the HDMI 261 is connected to another device (wired connection). If the HDMI 261 is identified as being connected to the electronic device 100, the CEC app 242 may transmit data or control commands to the electronic device 100, and data or control from the electronic device 100. commands can be received. In addition, the CEC app 242 may transmit a control command to the HDMI driver 243 and obtain specific information from the HDMI driver 243.

Here, the wireless app 244 may identify whether the sink device 200 is wirelessly connected to another device. If the sink device 200 is identified as being wirelessly connected to the electronic device 100, the wireless app 244 may transmit data or a control command to the electronic device 100, and from the electronic device 100 It can receive data or control commands. In addition, the Wireless app 244 may transmit a control command to at least one of the HDMI driver 243 and the CEC app 242, and obtain specific information from at least one of the HDMI driver 243 and the CEC app 242. can

Here, the HDMI 261 may include at least one of a GPIO pin 262 and a register 263. Here, the GPIO pin 262 can be used to determine whether the sink device 200 and the source device 300 are connected via HDMI. A description of GPIO values related to this is described in FIG. 16 . Here, the register 263 may store and transmit information transmitted from the source device 300 .

Here, the GPIO pin 262 or register 263 may transmit and receive information to and from the HDMI driver 243. Also, the HDMI 261 may transmit and receive information to and from the main SoC 241 . In addition, the wireless app 244 may transmit and receive information with the BT/WIFI module 221. In addition, the HDMI 261 of the sink device 200 can transmit and receive information with the HDMI 361 of the source device 300.

The source device 300 may include at least one of the main SoC 341 and the HDMI 361.

Here, the HDMI 361 may transmit and receive information to and from the main SoC 341 .

The sink device 200 can identify whether or not it is connected to the source device 300 based on the connection between the HDMI 361 of the source device 300 and the HDMI 261 of the sink device 200. Specifically, the sink device 200 may identify whether or not it is connected to the source device 300 based on a value obtained from the GPIO pin 262. According to the implementation example, the sink device 200 simply transmits the value obtained from the GPIO pin 262 to the electronic device 100 without determining whether the sink device 200 is directly connected, and the electronic device 100 transmits the value obtained from the GPIO pin 262 to the GPIO pin 262. Based on the obtained value, it may be determined whether the source device 300 is connected to the sink device 200.

The source device 300 may transmit source device information to the HDMI 261 of the sink device 200 through the HDMI 361. Here, the register 263 included in the HDMI 261 may store source device information and transmit it to the HDMI driver 243. The HDMI driver 243 may transmit source device information to the electronic device 100 using the HDMI 261 or the BT/WIFI module 221.

Meanwhile, although not shown in FIG. 17 , the main Soc 141 of the electronic device 100 and the main Soc 341 of the source device 300 may also include an HDMI driver. Functions related to this are the same as or similar to the HDMI driver 243 of the sink device 200, so redundant descriptions are omitted.

18 is a diagram for explaining how the electronic device 100 and the sink device 200 transmit information using a Consumer Electronics Control (CEC) method.

Referring to FIG. 18 , the electronic device 100 may include a main System on Chip (SoC) 141 . Here, the main SoC 141 may include at least one of a Consumer Electronics Control (CEC) app 142, a User Interface (UI) app 143, and a Wireless app 144. The CEC app 142 may be used in a data transmission operation through a wired method, and the Wireless app 144 may be used in a data transmission operation through a wireless method.

Here, the CEC app 142 may transmit/receive information with a user interface (UI) app 143. Here, the main SoC 141 may transmit and receive information to and from the main SoC 245 of the sink device 200 .

The sink device 200 may include at least one of the main SoC 245 and the connection information generation module 246. Here, the main SoC 245 may mean a processing module that performs a processing operation. Here, the connection information generation module 246 may mean a module that generates connection information. For example, the connection information generation module 246 of the sink device 200 may generate connection information and transmit it to the main SoC 245, and the main SoC 245 may transmit the connection information back to the main SoC 245 of the electronic device 100. may be transmitted to the SoC 141.

Here, the main SoC 245 may identify a source device connected to the sink device 200. In addition, connection information may be obtained based on whether the source device is connected to the sink device 200. Specifically, the main SoC 245 may transmit information on whether or not the connection is present to the connection information generation module 246, and the connection information generation module 246 may generate connection information corresponding to whether or not the connection is present. The connection information generation module 246 may transmit the generated connection information to the main SoC 245 , and the main SoC 245 may transmit the connection information to the main SoC 141 of the electronic device 100 .

Meanwhile, the connection information generating module 246 may mean an HDMI driver.

19 is a diagram for explaining an operation of the electronic device 100 requesting information from the sink device 200.

Referring to FIG. 19 , the electronic device 100 may include at least one of a UI app 143, a request message generating module 147, and a main SoC 145.

Here, the UI app 143 may output a UI to the user and receive a user input through the output UI.

Here, the request message generation module 147 may refer to a module that generates a request message to the sink device 200 or the source device 300 based on a user input. The electronic device 100 may obtain a message requesting specific information using the request message generating module 147 .

Here, the UI app 143 may transmit and receive information with the request message generating module 147 . In addition, the request message generation module 147 may transmit and receive information to and from the main SoC 145 . In addition, the main SoC 145 of the electronic device 100 may transmit and receive information with the main SoC 245 of the sink device 200 .

Meanwhile, the sink device 200 may include at least one of the main SoC 245 and the request message generation module 247. Here, the main SoC 245 may mean a processing module that performs a processing operation. Here, the request message generation module 247 may refer to a module that generates a message requesting specific information or a specific operation from the electronic device 100 or the source device 300 . For example, the main SoC 245 may obtain a message requesting source device information from the source device 300 using the request message generating module 247 . In addition, the main SoC 245 may transmit a message requesting source device information to the main SoC 345 of the source device 300 . The main SoC 345 of the source device 300 may transmit source device information to the main SoC 245 of the sink device 200 in response to the message.

Meanwhile, in the data transmission operation through the wired method, at least one of HDMI, CEC app, or HDMI driver may be used in each of the electronic device 100 and the sink device 200, and in the data transmission operation through the wireless method, the electronic device ( 100) and at least one of a BT/WIFI module or a wireless app may be used in each of the sink device 200. Redundant description of each component related to this will be omitted.

20 is a flowchart for explaining the operation of the sink device 200 in an embodiment in which the sink device 200 and the electronic device 100 are connected via HDMI.

Referring to FIG. 20, the sink device 200 and the source device 300 are connected via HDMI (S2005). The HDMI driver 243 of the sink device 200 may generate connection information (S2010). And, the HDMI driver 243 may transmit connection information to the CEC app 242 (S2015). And, the CEC app 242 can identify that the electronic device 100 and the sink device 200 are connected through HDMI (S2020). And, the CEC app 242 may request source device information from the HDMI driver 243 (S2025). In addition, the HDMI driver 243 may request source device information from the source device 300 (S2030).

The source device 300 may transmit source device information to the HDMI driver 243 in response to the source device information request received from the sink device 200 (S2035). The HDMI driver 243 may transmit connection information and source device information to the electronic device 100 through HDMI (S2040).

The electronic device 100 may output source device information received from the sink device 200 (S2045).

21 is a flowchart for explaining the operation of the electronic device 100 in an embodiment in which the sink device 200 and the electronic device 100 are connected through HDMI.

Referring to FIG. 21, the sink device 200 and the source device 300 are connected via HDMI (S2105). The HDMI driver 243 of the sink device 200 may generate connection information (S2110). And, the sink device 200 may identify that the electronic device 100 and the sink device 200 are connected through HDMI (S2115). Here, the HDMI driver 243 may request source device information from the source device 300 (S2120). Since the operation of the sink device 200 may correspond to the operation of the sink device 200 of FIG. 20, some redundant descriptions are omitted.

The source device 300 may transmit source device information to the HDMI driver 243 of the sink device 200 in response to a request from the sink device 200 (S2125).

The HDMI driver 243 may transmit connection information and source device information to the HDMI 161 of the electronic device 100 (S2130).

The HDMI 161 of the electronic device 100 may transmit connection information and source device information received from the sink device 200 to the CEC app 142 of the electronic device 100 (S2135). And, the CEC app 142 may transmit source device information to the display 110 (S2140). And, the display 110 may output source device information (S2145).

22 is a diagram for explaining the operation of the sink device 200 in an embodiment in which the sink device 200 and the electronic device 100 are not connected via HDMI.

Referring to FIG. 22, the sink device 200 and the source device 300 are connected via HDMI (S2205). The HDMI driver 243 of the sink device 200 may generate connection information (S2210). And, the HDMI driver 243 may transmit connection information to the CEC app 242 (S2215). In addition, the CEC app 242 may identify that the electronic device 100 and the sink device 200 are not connected through HDMI (S2220). Here, the CEC app 242 may request wireless connection confirmation from the Wireless app 244 (S2225). Here, the Wireless app 244 may request wireless connection confirmation from the BT/WIFI module 221 (S2230).

Here, the sink device 200 and the electronic device 100 are wirelessly connected (S2235). Here, the BT/WIFI module 221 may transmit a wireless connection response to the Wireless app 244 (S2240). Here, the Wireless app 244 may transmit a wireless connection response to the CEC app 242 (S2245).

Here, the CEC app 242 may request source device information from the HDMI driver 243 (S2250). In addition, the HDMI driver 243 may request source device information from the source device 300 (S2255).

Here, the source device 300 may transmit source device information to the HDMI driver 243 in response to the request (S2260). Here, the HDMI driver 243 may transmit source device information to the CEC app 242 (S2265). Here, the CEC app 242 may transmit connection information and source device information to the Wireless app 244 (S2270). Here, the Wireless app 244 may pack data including source device information and connection information (S2275). Then, the Wireless app 244 may transmit the packed data to the BT/WIFI module 221 (S2280). Here, the BT/WIFI module 221 may transmit packed data to the electronic device 100 (S2285).

Then, the electronic device 100 may obtain source device information from the packed data and output the acquired source device information (S2290).

23 is a flowchart for explaining operations of the sink device 200 and the source device 300 in an embodiment in which the sink device 200 and the electronic device 100 are not connected via HDMI.

Referring to FIG. 23, the sink device 200 and the source device 300 are connected via HDMI (S2305). The HDMI driver 243 of the sink device 200 may generate connection information (S2310). And, the sink device 200 may identify that the electronic device 100 and the sink device 200 are not connected through HDMI (S2315). Here, the HDMI driver 243 may request source device information from the source device 300 (S2320).

The source device 300 may transmit source device information to the HDMI driver 243 of the sink device 200 in response to a request from the sink device 200 (S2325).

The HDMI driver 243 may transmit connection information and source device information to the BT/WIFI module 221 (S2330). Here, the BT/WIFI module 221 may transmit packed data (including connection information and source device information) to the BT/WIFI module 121 of the electronic device 100 (S2335). Since the operation of the sink device 200 may correspond to the operation of the sink device 200 of FIG. 22, some redundant descriptions are omitted.

24 is a flowchart for explaining the operation of the electronic device 100 in an embodiment in which the sink device 200 and the electronic device 100 are not connected through HDMI.

Referring to FIG. 24, the BT/WIFI module 121 may transmit packed data to the Wireless app 144 (S2440). Here, the Wireless app 144 may request the CEC app 142 to identify whether the sink device 200 and the electronic device 100 are not connected through HDMI (S2445). Here, the CEC app 142 may transmit an unconnected response to the Wireless app 144 (S2450). Here, the wireless app 144 may generate a fourth UI corresponding to connecting the electronic device 100 and the sink device 200 with an HDMI cable (S2455). Here, the Wireless app 144 may unpack data (S2460). Here, the wireless app 144 may obtain source device information based on the unpacked data and transmit the source device information and the fourth UI to the display 110 (S2465). Here, the display 110 may output source device information and a fourth UI (S2470).

25 is a flowchart for explaining an operation of the sink device 200 requesting audio information in an embodiment in which the sink device 200 and the electronic device 100 are not connected via HDMI.

25, steps S2505, S2510, S2515, S2520, S2525, S2530, S2535, S2540, and S2545 correspond to steps S2205, S2210, S2215, S2220, S2225, S2230, S2235, S2240, and S2245 of FIG. can correspond to As such, redundant explanations are omitted.

Here, the CEC app 242 may request source device information and audio information from the HDMI driver 243 (S2550). In addition, the HDMI driver 243 may request source device information and contents from the source device 300 (S2555).

26 is a flowchart for explaining an operation of the electronic device 100 outputting audio information in an embodiment in which the sink device 200 and the electronic device 100 are not connected through HDMI.

Referring to FIG. 26, the source device 300 may transmit source device information and content to the HDMI driver 243 in response to a request (S2660).

Here, the HDMI driver 243 may extract audio information based on the content received from the source device 300 (S2661). Here, the audio information may refer to audio information included in content provided by the source device 300. Since the electronic device 100 and the sink device 200 are not connected through HDMI, the sink device 200 cannot transmit (high quality) image information (or images) to the electronic device 100. Accordingly, the sink device 200 may not output audio information on its own according to a specific embodiment, and may transmit audio information to the electronic device 100 separately from image information (or images).

Here, the HDMI driver 243 may transmit source device information and audio information to the CEC app 242 (S2665). Here, the CEC app 242 may transmit connection information, source device information, and audio information to the Wireless app 244 (S2670). Here, the Wireless app 244 may pack data including source device information, connection information, and audio information (S2675). Then, the Wireless app 244 may transmit the packed data to the BT/WIFI module 241 (S2680). Here, the BT/WIFI module 241 may transmit packed data to the electronic device 100 (S2685).

Then, the electronic device 100 may obtain source device information and audio information from the packed data, and output the acquired source device information and audio information (S2690).

Meanwhile, if the sink device 200 and the electronic device 100 are not connected through HDMI, the sink device 200 may first check whether Bluetooth communication is possible. If Bluetooth communication is possible, the sink device 200 may transmit information to the electronic device 100 using Bluetooth communication. If Bluetooth communication is impossible, the sink device 200 may check whether Wi-Fi communication is possible. If Wi-Fi communication is possible, the sink device 200 may transmit information to the electronic device 100 using Wi-Fi communication.

27 is a diagram for explaining an operation of the sink device 200 requesting and transmitting audio information in an embodiment in which the sink device 200 and the electronic device 100 are not connected via HDMI.

Referring to FIG. 27, the sink device 200 and the source device 300 are connected via HDMI (S2705). The HDMI driver 243 of the sink device 200 may generate connection information (S2710). And, the sink device 200 may identify that the electronic device 100 and the sink device 200 are not connected through HDMI (S2715). Here, the HDMI driver 243 may request source device information and content from the source device 300 (S2720).

The source device 300 may transmit source device information and contents to the HDMI driver 243 of the sink device 200 in response to a request from the sink device 200 (S2725).

The HDMI driver 243 may extract audio information from the content received from the source device 300 (S2729). And, the HDMI driver 243 may transmit connection information, source device information, and audio information to the BT/WIFI module 221 (S2730). Here, the BT/WIFI module 221 may transmit packed data (including connection information, source device information, and audio information) to the BT/WIFI module 121 of the electronic device 100 (S2735). Since the operation of the sink device 200 may correspond to the operation of the sink device 200 of FIG. 23, some redundant descriptions are omitted.

28 is a diagram for explaining an operation of the electronic device 100 outputting audio information in an embodiment in which the sink device 200 and the electronic device 100 are not connected through HDMI.

Referring to FIG. 28, the BT/WIFI module 121 may transmit packed data to the Wireless app 144 (S2840). Here, the Wireless app 144 may request the CEC app 142 to identify whether the sink device 200 and the electronic device 100 are not connected through HDMI (S2845). Specifically, the electronic device 100 can identify whether it is connected to the sink device 200 through HDMI by checking the hot plug pin. Meanwhile, step S2845 may be an operation of reconfirming whether the sink device 200 and the electronic device 100 are connected via HDMI. This is because, in step S2820 of FIG. 25 , it is possible to check whether the sink device 200 is already connected to the electronic device 100 through HDMI. Accuracy can be improved through double rechecking.

Here, the CEC app 142 may transmit an unconnected response to the Wireless app 144 (S2850). Here, the wireless app 144 may generate a fourth UI corresponding to connecting the electronic device 100 and the sink device 200 with an HDMI cable (S2855). Here, the Wireless app 144 may unpack data (S2860). Here, the wireless app 144 may obtain source device information based on the unpacked data and transmit the source device information and the fourth UI to the display 110 (S2865). Here, the display 110 may output source device information and a fourth UI (S2870). Here, the wireless app 144 may acquire audio information based on the unpacked data and transmit the audio information to the speaker 170 (S2875). Here, the speaker 170 may output audio information (S2880).

29 is a diagram for explaining a data packet transmitted from the sink device 200 to the electronic device 100.

Referring to FIG. 29 , a data packet 2610 may be divided into a plurality of regions. A header may be stored in area 2611, connection information may be stored in area 2612, the beginning of device information may be stored in area 2613-1, and the completion of device information The part can be stored in the area 2613-n, the header of audio data can be stored in the area 2614, summary information of the audio data can be stored in the area 2615, and the beginning of the audio data This area 2616-1 can be stored, the complete part of audio data can be stored in area 2616-n, the audio data checksum can be stored in area 2617, The entire checksum may be stored in area 2618.

30 is a diagram for explaining a control method of the electronic device 100 according to an embodiment.

Referring to FIG. 30 , a control method of an electronic device 100 including a communication interface 120 communicating with a sink device 200 using at least one of a wireless communication module and a wired communication module is a communication interface 120 ), receiving the source device information of the source device 300 connected to the sink device 200 from the sink device 200 through the communication interface 120 (S2705) and the source device 200. and displaying device information (S2710).

Meanwhile, the control method identifies whether the sink device 200 is connected to the source device 300 based on connection information received from the sink device 200 through the communication interface 120, and the sink device 200 When it is identified as being connected to the source device 300, receiving source device information from the sink device 200 through the communication interface 120 and when the sink device 200 is identified as not connected to the source device 300 , displaying a first UI corresponding to the absence of the source device 300 connected to the sink device 200.

Meanwhile, the source device information may include at least one of source device 300 identification information, manufacturer information, source device 300 type information, supported codec information, supported resolution information, or content information provided by the source device 300. .

Meanwhile, the control method includes displaying a second UI corresponding to the selection of the source device 300 when connected to the sink device 200 through the input/output interface 160 of the electronic device 100 and through the second UI. When a user input corresponding to selection of the source device 300 is received, the method may further include displaying a third UI corresponding to being able to receive content from the source device 300 .

Meanwhile, in the control method, when a user input corresponding to a request for one of a plurality of contents provided by the source device 300 is received after the third UI is displayed, the content corresponding to the user input is received through the communication interface 120. Transmitting a control command to request a control command to the sink device 200, receiving a content image corresponding to the control command from the sink device 200 through the communication interface 120, and displaying the received content image. may further include, and content audio corresponding to a control command for requesting content may be output from the sink device 200 .

Meanwhile, if the control method is not connected to the sink device 200 through the input/output interface 160 of the electronic device 100, the fourth UI corresponds to connecting the electronic device 100 and the sink device 200 with an HDMI cable. A step of displaying may be further included.

Meanwhile, the control method may further include displaying a second UI corresponding to selection of the source device 300 when connected to the sink device 200 through the input/output interface 160 after the fourth UI is displayed. .

Meanwhile, the control method may further include receiving sink device information of the sink device 200 through the communication interface 120 and displaying sink device information and source device information.

Meanwhile, the control method includes receiving a data packet including source device information and audio information through the communication interface 120 when the electronic device 100 is not connected to the sink device 200 through the input/output interface 160. and outputting audio information included in the data packet received through the speaker 170 of the electronic device 100.

Meanwhile, in the control method, when the sink device 200 is disconnected from the source device 300 while the sink device 200 is connected to the source device 300, the sink device 200 and the source device 300 When the sink device 200 is identified as being connected to the source device 300 in a state where the fifth UI corresponding to the release of and the sink device 200 is not connected to the source device 300, the sink device 200 and displaying a sixth UI corresponding to the connection of the source device 300 may be further included.

Meanwhile, the method of controlling an electronic device as shown in FIG. 27 may be executed on an electronic device having the configuration of FIG. 2 or 3 and may also be executed on an electronic device having other configurations.

Meanwhile, the methods according to various embodiments of the present disclosure described above may be implemented in the form of an application that can be installed in an existing electronic device.

In addition, the methods according to various embodiments of the present disclosure described above may be implemented only by upgrading software or hardware of an existing electronic device.

In addition, various embodiments of the present disclosure described above may be performed through an embedded server included in an electronic device or an external server of at least one of an electronic device and a display device.

Meanwhile, according to an exemplary embodiment of the present disclosure, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage media (eg, a computer). can A device is a device capable of calling a stored command from a storage medium and operating according to the called command, and may include an electronic device according to the disclosed embodiments. When a command is executed by a processor, the processor may perform a function corresponding to the command directly or by using other components under the control of the processor. An instruction may include code generated or executed by a compiler or interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium does not contain a signal and is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

Also, according to an embodiment of the present disclosure, the method according to the various embodiments described above may be included in a computer program product and provided. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)) or online through an application store (eg Play Store™). In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

In addition, each of the components (eg, modules or programs) according to various embodiments described above may be composed of a single object or a plurality of entities, and some sub-components among the aforementioned sub-components may be omitted, or other sub-components may be used. Components may be further included in various embodiments. Alternatively or additionally, some components (eg, modules or programs) may be integrated into one entity and perform the same or similar functions performed by each corresponding component prior to integration. According to various embodiments, operations performed by modules, programs, or other components may be executed sequentially, in parallel, repetitively, or heuristically, or at least some operations may be executed in a different order, may be omitted, or other operations may be added. can

Although the preferred embodiments of the present disclosure have been shown and described above, the present disclosure is not limited to the specific embodiments described above, and is common in the technical field belonging to the present disclosure without departing from the gist of the present disclosure claimed in the claims. Of course, various modifications and implementations are possible by those with knowledge of, and these modifications should not be individually understood from the technical spirit or perspective of the present disclosure.

Claims

In electronic devices,

display;

a communication interface that communicates with the sink device; and

When connected to the sink device through the communication interface, receive source device information of a source device connected to the sink device from the sink device through the communication interface;

An electronic device comprising: a processor controlling the display to display the source device information.
According to claim 1,

the processor,

Identifying whether the sink device is connected to the source device based on connection information received from the sink device through the communication interface;

When the sink device is identified as being connected to the source device, receiving the source device information from the sink device through the communication interface;

If it is identified that the sink device is not connected to the source device, controlling the display to display a first UI corresponding to the fact that there is no source device connected to the sink device.
According to claim 1,

The source device information,

An electronic device that includes at least one of source device identification information, manufacturer information, source device type information, supported codec information, supported resolution information, or content information provided by a source device.
According to claim 1,

The electronic device,

It further includes an input/output interface;

the processor,

When connected to the sink device through the input/output interface, controlling the display to display a second UI corresponding to the selection of the source device;

Controlling the display to display a third UI corresponding to being able to receive content from the source device when a user input corresponding to selection of the source device is received through the second UI.
According to claim 4,

the processor,

When a user input corresponding to a request for one of the plurality of contents provided by the source device is received after the third UI is displayed, a control command for requesting the contents corresponding to the user input is transmitted through the communication interface. transmit to the sink device,

Receiving a content image corresponding to the control command from the sink device through the communication interface;

Control the display to display the received content image;

Content audio corresponding to a control command for requesting the content is output from the sink device.
According to claim 1,

The electronic device,

It further includes an input/output interface;

the processor,

When not connected to the sink device through the input/output interface, controlling the display to display a fourth UI corresponding to connecting the electronic device and the sink device with an HDMI cable.
According to claim 6,

the processor,

Controlling the display to display a second UI corresponding to the selection of the source device when connected to the sink device through the input/output interface after the fourth UI is displayed.
According to claim 1,

the processor,

Receiving sink device information of the sink device through the communication interface;

An electronic device that controls the display to display the sink device information and the source device information.
According to claim 1,

The electronic device,

input/output interface; and

Further comprising a speaker;

the processor,

When not connected to the sink device through the input/output interface, receive a data packet including the source device information and audio information through the communication interface,

An electronic device that outputs the audio information included in the received data packet through the speaker.
According to claim 1,

the processor,

When the sink device is disconnected from the source device while the sink device is connected to the source device, controlling the display to display a fifth UI corresponding to disconnection of the sink device and the source device;

Controlling the display to display a sixth UI corresponding to the connection between the sink device and the source device when the sink device is identified as being connected to the source device while the sink device is not connected to the source device , electronic devices.
A control method of an electronic device including a communication interface communicating with a sink device,

receiving source device information of a source device connected to the sink device from the sink device through the communication interface when connected to the sink device through the communication interface; and

A control method comprising: displaying the source device information.
According to claim 11,

The control method,

identifying whether the sink device is connected to the source device based on connection information received from the sink device through the communication interface;

If the sink device is identified as being connected to the source device, receiving the source device information from the sink device through the communication interface; and

If the sink device is identified as not connected to the source device, displaying a first UI corresponding to the fact that there is no source device connected to the sink device; further comprising a control method.
According to claim 11,

The source device information,

A control method comprising at least one of source device identification information, manufacturer information, source device type information, supported codec information, supported resolution information, or content information provided by a source device.
According to claim 11,

The control method,

displaying a second UI corresponding to selection of the source device when connected to the sink device through the input/output interface of the electronic device; and

When a user input corresponding to the selection of the source device is received through the second UI, displaying a third UI corresponding to being able to receive content from the source device; further comprising, the control method.
According to claim 14,

The control method,

When a user input corresponding to a request for one of the plurality of contents provided by the source device is received after the third UI is displayed, a control command for requesting the contents corresponding to the user input is transmitted through the communication interface. transmitting to the sink device;

receiving a content image corresponding to the control command from the sink device through the communication interface; and

Further comprising; displaying the received content image;

Content audio corresponding to a control command for requesting the content is output from the sink device.