KR20160029552A - Electronic device, and method for operating the same - Google Patents

Abstract

According to an embodiment of the present invention, an operation method of an electronic device comprises the followings steps: being connected with a first electronic device via a network; performing a capability negotiation with the first electronic device; transmitting content data in a format based on the capability negotiation to the first electronic device; transmitting control image data including one or more control menu buttons to the first electronic device; receiving user input information with respect to the control image data from the first electronic device; and performing a control function corresponding to the user input information. Accordingly, user convenience can be improved by easily and conveniently controlling other devices with one device while electronic devices share content.

Description

ELECTRONIC DEVICE, AND METHOD FOR OPERATING THE SAME

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic apparatus such as a portable terminal and an image display apparatus and a method of operating the same. More particularly, the present invention relates to an electronic apparatus And an operation method thereof.

A portable terminal is a portable device having one or more functions capable of performing voice and video communication, capable of inputting and outputting information, and storing data, while being portable. As the functions of such portable terminals are diversified, they have complicated functions such as photographing and photographing of movies, playback of music files or video files, reception of games, broadcasting, wireless Internet, and transmission / reception of messages. multimedia player). In order to realize a complicated function, a mobile terminal implemented in the form of a multimedia device is being applied variously in terms of hardware and software.

The video display device is a device having a function of displaying an image that the user can view. The user can view the broadcast through the video display device. A video display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, broadcasting is changing from analog broadcasting to digital broadcasting worldwide. Digital broadcasting refers to broadcasting in which digital video and audio signals are transmitted. Compared to analog broadcasting, digital broadcasting is strong against external noise and has a small data loss, is advantageous for error correction, has a high resolution, and provides a clear screen. Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.

In recent years, network technologies have been developed in which various electronic devices are connected to each other to enjoy convenient, safe and economical living services at home and outside.

In addition, the electronic devices can be connected to each other using wired or wireless communication, and the user can copy or move contents between connected electronic devices, output the same content screen to a plurality of electronic devices, or store contents It is possible to output the content to the screen of another device.

It is an object of the present invention to provide an electronic device and an operation method thereof that can easily and conveniently control screens of a plurality of connected electronic devices, thereby improving the usability of the user.

According to another aspect of the present invention, there is provided a method of operating an electronic device, the method comprising: connecting to a first electronic device via a network; performing capability negotiation with a first electronic device; Transmitting content data in a format based on the function negotiation to an electronic device, transmitting control image data including one or more control menu buttons to the first electronic device, transmitting control image data from the first electronic device to the control image data Receiving user input information for the user input device and performing a control function corresponding to the user input information.

According to an aspect of the present invention, there is provided a method of operating an electronic device, the method comprising: connecting to a second electronic device via a network; performing capability negotiation with a second electronic device; Receiving content data from an electronic device in a format based on the function negotiation; receiving control image data from the second electronic device, the control image data including one or more control menu buttons; Displaying the control image including the control menu button, receiving the user input for the control image, and transmitting user input information for the control image data to the second electronic device.

According to the present invention, electronic devices can easily and conveniently control other devices with one device while sharing contents, thereby improving the usability of the user.

1 is a diagram illustrating an example of electronic devices connectable to a wired / wireless network according to an embodiment of the present invention.
2 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
3 is an internal block diagram of the control unit of FIG.
4 is a block diagram of a portable terminal according to an embodiment of the present invention.
5 is a flowchart showing an embodiment of an operation method of an electronic device capable of controlling another electronic device according to the related art.
6 is a flowchart showing an embodiment of an operation method of an electronic device according to the present invention.
7 is a flowchart showing an embodiment of a method of operating an electronic device according to the present invention.
FIGS. 8 to 16 are views for explaining various embodiments of an operation method of an electronic device according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a diagram illustrating an example of electronic devices connectable to a wired / wireless network according to an embodiment of the present invention.

The electronic apparatuses of Fig. 1 are illustrative, and the present invention is not limited thereto. Referring to FIG. 1, electronic devices 100a, 100b, 300, 400, and 400 such as TVs 100a and 100b, a tablet PC 300, a notebook 400, and a smartphone 500 according to an embodiment of the present invention, 500a, and 500b can transmit or receive data to and from each other via a wired / wireless communication network, and can share data.

In addition, the electronic devices according to the present invention can share and output contents with other electronic devices at 1: 1, share contents with a plurality of electronic devices at 1: N or N: N, .

Meanwhile, the electronic devices according to the embodiment of the present invention may be directly connected to each other or may be connected via a predetermined server.

1, the TV 100a and 100b are exemplified as typical examples of the image display apparatus, and the smart phone 500 is exemplified as a typical example of the portable terminal, the present invention is not limited thereto.

In addition to the TVs 100a and 100b, which are representative image display devices, and a monitor, an electric device including a display, such as a tablet PC 300, a notebook computer 400, a smart phone 500a and 500b, Which corresponds to the image display apparatus 100 in this specification.

The tablet PC 300, the notebook 400, the smart phones 500a and 500b, the mobile phone, and the PDA can be portable, and thus can correspond to the portable terminal 500 of the present invention.

2 is an internal block diagram of an image display apparatus 100 according to an embodiment of the present invention.

2, an image display apparatus 100 according to an exemplary embodiment of the present invention includes a broadcast receiving unit 105, a network interface unit 130, an external device interface unit 130, a storage unit 140, An interface unit 150, a control unit 170, a display 180, and an audio output unit 185.

The image display apparatus 100 according to an exemplary embodiment of the present invention may further include an NFC module 125, a sensor unit (not shown), a camera (not shown), and the like, as needed.

The broadcast receiving unit 105 may include a tuner unit 110 and a demodulation unit 120. [ The broadcast receiving unit 105 may include a tuner unit 110 and a demodulator unit 120 so that the network interface unit 130 may not be included in the broadcast receiving unit 105. Alternatively, The tuner unit 110 and the demodulation unit 120 are not included.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by the user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner unit 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit 110 can be directly input to the controller 170.

The tuner unit 110 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among the RF broadcast signals received through the antenna in the present invention, and sequentially selects RF broadcast signals of the intermediate frequency signal, baseband image, . ≪ / RTI >

On the other hand, the tuner unit 110 can include a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner that simultaneously receives broadcast signals of a plurality of channels is also possible.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 130 can transmit or receive data with the connected external device 190. [ To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer , And may perform an input / output operation with an external device.

The A / V input / output unit can receive video and audio signals from an external device. Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices.

The network interface unit 135 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. For example, the network interface unit 135 can receive, via the network, content or data provided by the Internet or a content provider or a network operator.

On the other hand, the network interface unit 135 can perform data communication with neighboring electronic devices in the vicinity of the video display device 100. At this time, the network interface unit 135 may receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like.

Meanwhile, the image display apparatus 100 may include an NFC module 125 so as to perform NFC communication with other electronic devices such as the portable terminal 500.

On the other hand, through the NFC module 125, it is also possible to receive device information, network information, and the like of other electronic devices. Thereafter, based on the other electronic device information, the electronic device can be network-connected.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporarily storing video, audio, or data signals input to the external device interface unit 130. [ In addition, the storage unit 140 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

Although the storage unit 140 of FIG. 2 is provided separately from the control unit 170, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

(Not shown), such as a power key, a channel key, a volume key, and a set value, from the remote control apparatus 200, (Not shown) that senses a user's gesture to the control unit 170 or transmits a signal from the control unit 170 to the control unit 170 It is possible to transmit it to the sensor unit (not shown).

According to the embodiment of the present invention, the user input interface unit 150 can receive personal information from the remote control device 200. [ Further, in addition to the personal information, it is possible to further receive the web server information being connected by the personal information.

For example, when the portable terminal 500 and the remote control device 200 approach each other within a predetermined distance to perform near field communication (NFC), the remote control device 200 transmits the personal data stored in the portable terminal 500 Information can be received. The remote control device 200 can transmit personal information to the video display device 100 in accordance with an IR method, an RF method, or the like. At this time, the user input interface unit 150 transmits the received personal information to the control unit 170. [

Meanwhile, the personal information at this time may include personal ID information, password information, personal e-mail information, and the like for the portable terminal 500. Alternatively, the personal information may include personal ID information, password information, personal e-mail information, and the like for the video display device 100. [ Alternatively, the personal information may be personal ID information or password information that can be commonly used in various electronic devices including the portable terminal 500. Alternatively, the personal information may be personal ID information, password information, etc., to a predetermined web server stored in the portable terminal 500 in advance. Alternatively, the personal information may be personal ID information, password information, etc., to a predetermined web server that can be used in the video display device 100 including the portable terminal 500 and the like. Alternatively, the personal information may be personal ID information, password information, etc. for the server connected to the video display device 100. [

That is, the personal information may be information necessary for logging into the predetermined account for the electronic device or service.

On the other hand, the user input interface unit 150 receives, from the adjacent electronic apparatuses in the vicinity of the video display apparatus 100, apparatus information of other electronic apparatuses, , Frequency information, code information, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner unit 110 or the demodulation unit 120 or the external device interface unit 130 so as to output the video or audio output Signals can be generated and output.

The video signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the video signal. Also, the image signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

The audio signal processed by the control unit 170 may be output to the audio output unit 185 as an audio signal. The audio signal processed by the controller 170 may be input to the external output device through the external device interface unit 130. [

Although not shown in FIG. 2, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the control unit 170 may control the tuner unit 110 to control the tuning of the RF broadcast corresponding to the channel selected by the user or the previously stored channel.

In addition, the controller 170 may control the image display apparatus 100 according to a user command or an internal program input through the user input interface unit 150.

Meanwhile, the control unit 170 may control the display 180 to display an image. At this time, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate a 3D object for a predetermined object among the images displayed on the display 180, and display the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

On the other hand, the control unit 170 can recognize the position of the user based on the image photographed from the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the display 180 corresponding to the user position can be grasped.

On the other hand, according to the embodiment of the present invention, the control unit 170 can control to perform log-in based on the personal information received from the remote control device 200. [ At this time, the login may be a login of the video display apparatus 100 itself, a login to a server connected to the video display apparatus 100, or a login to a predetermined web server subscribed by personal information.

For example, when the user logs in the image display apparatus 100 itself by the personal ID information and the password information received from the remote control apparatus 200, the control unit 170 displays the personal screen set for each user account (180). When there is an image being watched, the control unit 170 can control to display a personal setting screen together with the image being watched. Alternatively, it is also possible to switch the scene being watched and display it on the personal setting screen.

As another example, when logging in to a server connected to the video display apparatus 100, the control unit 170 can control to display the server connection screen received from the server on the display 180. [ Specifically, it may be an app server screen. When there is an image being watched, the control unit 170 can control to display a server connection screen together with the image being watched. Alternatively, it is also possible to switch the scene being watched and display it on the server connection screen.

In a case where the received personal information is personal information on other electronic devices, specifically, predetermined web servers being accessed by the portable terminal 500, the control unit 170 controls the video display device 100 to display the corresponding web servers And controls the display 180 to display a screen for the connected web server. The web servers at this time may be web servers providing social network services. When there is an image being watched, the control unit 170 can control to display a screen for the connected web server together with the image being watched. Alternatively, it is also possible to perform control such that the video being watched is switched and displayed on the screen of the connected web server.

The control unit 170 controls the power supply unit (not shown) to turn on the power of the video display device 100 when the power of the video display device 100 is turned off in the state that the personal information is received . That is, when personal information is received in the user input interface unit 150 in the standby mode, the controller 170 switches to a wake up mode and supplies power to the respective modules or units, The supply unit can be controlled.

The control unit 170 receives the device information and setting information of the adjacent electronic devices in the vicinity of the video display device 100 received from the network interception unit 135 or the user input interface unit 150, Based on the personal information from the remote control device 200, on the basis of the controllable channel information, the frequency information or the code information, and judges whether or not each electronic device is connected and displays an object indicating that the other electronic device is logged in (180).

Alternatively, the control unit 170 may control the remote controller 200 (or the remote controller 200) based on the device information, the setting information, the channel information, the frequency information, or the code information of the other electronic equipment, ), The device information, the setting information, the channel information, the frequency information, or the code information.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 130 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be stream-decoded together with a decoded image and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display 180 using the input thumbnail image.

At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the display 180, or in a full viewing mode displayed in most areas of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts a video signal, a data signal, an OSD signal, a control signal processed by the control unit 170, a video signal, a data signal, a control signal, and the like received from the external device interface unit 130, .

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or the like, and may also be capable of a 3D display.

 Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives the signal processed by the control unit 170 and outputs it as a voice.

A photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. On the other hand, the photographing unit (not shown) may be embedded in the image display device 100 on the upper side of the display 180 or may be disposed separately. The image information photographed by the photographing unit (not shown) may be input to the control unit 170.

The control unit 170 can detect the gesture of the user based on each of the images photographed from the photographing unit (not shown) or the signals sensed from the sensor unit (not shown) or a combination thereof.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control device 200 may be a Bluetooth (Radio Frequency) communication system, an infrared (IR) communication system, an ultra wideband (UWB) system, a ZigBee system, Can be used.

Also, the remote control apparatus 200 can receive the video, audio, or data signal output from the user input interface unit 150. Further, the remote control device 200 can display or output audio on the remote control device 200 based on the received video, audio, or data signal.

On the other hand, the remote control device 200 according to the embodiment of the present invention can receive personal information by a near field communication with a predetermined electronic device. The personal information may be personal ID information or password information that can be used in the portable terminal 500, the video display device 200, or an electronic device, as described above. Personal information at this time may be different for each device, but in the embodiment of the present invention, one integrated personal ID and a password will be mainly described.

On the other hand, the remote control device 200 can transmit the received personal information to the video display device 100. [ The communication method at this time can be an IR method or an RF method.

In the embodiment of the present invention, the remote control device 200 mainly describes a space remote control capable of displaying a pointer corresponding to the movement of the user. That is, the remote control device 200 can transmit personal information and the like to the video display device 100 using the RF method.

On the other hand, the remote control apparatus 200 may further receive the web server information or the like being connected by the personal information in addition to the personal information. For example, the mobile terminal 500 may receive web server information about a social network service that is logged in. This web server information is also transmitted to the image display apparatus 100.

On the other hand, it is also possible to receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like from adjacent electronic devices in the vicinity of the video display device 100. Based on such other electronic device information, a channel, frequency, or code can be assigned to the electronic device to perform remote control.

Meanwhile, the video display device 100 may be a digital broadcast receiver capable of receiving a fixed or mobile digital broadcast.

Meanwhile, a block diagram of the image display apparatus 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

2, the video display apparatus 100 does not include the tuner unit 110 and the demodulation unit 120 shown in FIG. 2, but may be connected to the network interface unit 130 or the external device interface unit 135 to play back the video content.

3 is an internal block diagram of the control unit of FIG.

The control unit 170 includes a demultiplexing unit 310, an image processing unit 320, a processor 330, an OSD generating unit 340, a mixer 345, A frame rate conversion unit 350, and a formatter 360. [0031] A voice processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 130.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display 180.

The video decoder 325 can include a decoder of various standards.

The processor 330 may control the overall operation in the image display apparatus 100 or in the control unit 170. [ For example, the processor 330 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a previously stored channel.

In addition, the processor 330 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150. [

In addition, the processor 330 may perform data transfer control with the network interface unit 135 or the external device interface unit 130.

The processor 330 may control operations of the demultiplexing unit 310, the image processing unit 320, the OSD generating unit 340, and the like in the controller 170.

The OSD generation unit 340 generates an OSD signal according to a user input or by itself. For example, based on a user input signal, a signal for displaying various information in a graphic or text form on the screen of the display 180 can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon. In addition, the generated OSD signal may include a 2D object or a 3D object.

The OSD generating unit 340 can generate a pointer that can be displayed on the display based on the pointing signal input from the remote control device 200. [ In particular, such a pointer may be generated by a pointing signal processing unit, and the OSD generating unit 240 may include such a pointing signal processing unit (not shown). Of course, a pointing signal processing unit (not shown) may be provided separately from the OSD generating unit 240.

On the other hand, in the embodiment of the present invention, the OSD generating unit 340 can generate or configure a set personal screen when the image display apparatus 100 itself is logged in. Alternatively, when logging in to the connected server, the OSD generating unit 340 may generate or configure at least a part of the server connection screen so that the server connection screen received from the server is displayed on the display 180. [ Alternatively, the OSD generating unit 340 may generate or configure at least a part of the web server connection screen based on the web server information being accessed by the personal information.

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the decoded video signal processed by the image processor 320. At this time, the OSD signal and the decoded video signal may include at least one of a 2D signal and a 3D signal. The mixed video signal is supplied to a frame rate converter 350.

A frame rate converter (FRC) 350 can convert the frame rate of an input image. On the other hand, the frame rate converter 350 can output the frame rate without conversion.

The formatter 360 receives the mixed signal from the mixer 345, that is, the OSD signal and the decoded video signal, and changes the format of the signal to be suitable for the display 180 and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

On the other hand, the formatter 360 can separate the 2D video signal and the 3D video signal for 3D video display. It is also possible to change the format of the 3D video signal or convert the 2D video signal to the 3D video signal.

On the other hand, the audio processing unit (not shown) in the control unit 170 can perform the audio processing of the demultiplexed audio signal. To this end, the voice processing unit (not shown) may include various decoders.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

3, the signals from the OSD generating unit 340 and the image processing unit 320 are mixed in the mixer 345 and then 3D processed in the formatter 360. However, the present invention is not limited to this, May be located behind the formatter.

Meanwhile, the block diagram of the controller 170 shown in FIG. 3 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170, but may be separately provided.

4 is a block diagram of a portable terminal according to an embodiment of the present invention.

The portable terminal described in the present specification may be used in various applications such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a camera, tablet computers, e-book terminals, and the like.

4 is a block diagram of a portable terminal according to an embodiment of the present invention. Referring to FIG. 4, a mobile terminal according to an embodiment of the present invention will be described in terms of components according to functions.

4, the portable terminal 500 includes a wireless communication unit 510, an audio / video (A / V) input unit 520, a user input unit 530, a sensing unit 540, an output unit 550, A control unit 560, an interface unit 570, a control unit 580, and a power supply unit 590. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 510 may include a broadcast receiving module 511, a mobile communication module 513, a wireless Internet module 515, a short distance communication module 517, and a GPS module 519.

The broadcast receiving module 511 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 513. Broadcast-related information can exist in various forms.

The broadcast receiving module 511 receives a broadcast signal using various broadcasting systems. In particular, the broadcast receiving module 511 receives a broadcast signal using a digital multimedia broadcasting-terrestrial (DMB-T), a digital multimedia broadcasting- ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 511 may be configured to be suitable for all broadcasting systems that provide broadcast signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 511 may be stored in the memory 560.

The mobile communication module 513 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 515 is a module for wireless Internet access, and the wireless Internet module 515 can be built in or externally mounted in the mobile terminal 500. [ WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 517 is a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and Near Field Communication (NFC) may be used as the short distance communication technology.

A GPS (Global Position System) module 519 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 520 is for inputting an audio signal or a video signal, and may include a camera 521 and a microphone 523. The camera 521 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display 551. [

The image frame processed by the camera 521 may be stored in the memory 560 or transmitted to the outside via the wireless communication unit 510. [ More than two cameras 521 may be provided according to the configuration of the terminal.

The microphone 523 receives an external audio signal by a microphone in an audio reception mode, for example, a communication mode, a recording mode, or a voice recognition mode, and processes the audio signal as electrical voice data. The processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 513 and output when the voice data is in the call mode. The microphone 123 may use various noise reduction algorithms for eliminating noise generated in receiving an external audio signal.

On the other hand, the plurality of microphones 523 may be arranged at different positions. The audio signal received at each microphone can be processed as an audio signal by the control unit 580 or the like.

The user input unit 530 generates key input data that the user inputs for controlling the operation of the terminal. The user input unit 530 may include a key pad, a dome switch, and a touch pad (static / static) capable of receiving commands or information by a user's pressing or touching operation. The user input unit 530 may be a jog wheel for rotating a key, a jog type or a joystick, or a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display 551 described later, it can be called a touch screen.

The sensing unit 540 senses the current state of the portable terminal 500 such as the open / close state of the portable terminal 500, the position of the portable terminal 500, Thereby generating a sensing signal. For example, when the portable terminal 500 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to the power supply of the power supply unit 590, whether or not the interface unit 570 is coupled to an external device, and the like can be handled.

The sensing unit 540 may include a proximity sensor 541, a pressure sensor 543, a motion sensor 545, and the like. The proximity sensor 541 can detect the presence of an object approaching the portable terminal 500 or an object existing near the portable terminal 500 without mechanical contact. The proximity sensor 541 can detect a nearby object by using the change of the alternating magnetic field or the change of the static magnetic field, or the rate of change of the capacitance. The proximity sensor 541 may be equipped with two or more sensors according to the configuration.

The pressure sensor 543 can detect whether the pressure is applied to the portable terminal 500, the magnitude of the pressure, and the like. The pressure sensor 543 may be installed in a portion of the portable terminal 500 where pressure is required to be detected according to the use environment. If the pressure sensor 543 is installed on the display 551, a touch input via the display 551 and a pressure touch with a larger pressure than the touch input, in accordance with the signal outputted from the pressure sensor 543, Input can be identified. In addition, the magnitude of the pressure applied to the display 551 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 543.

The motion sensor 545 senses the position or movement of the mobile terminal 500 using an acceleration sensor, a gyro sensor, or the like. The acceleration sensor, which can be used in the motion sensor 545, is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology.

The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various types. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 550 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 550 may include a display 551, an audio output module 553, an alarm unit 555, and a haptic module 557.

The display 551 displays and outputs information processed in the portable terminal 500. [ For example, when the portable terminal 500 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 500 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display 551 and the touch pad have a mutual layer structure to constitute a touch screen, the display 551 may be used as an input device capable of inputting information by a user's touch in addition to the output device .

If the display 551 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside, and can be connected to an internal bus of the portable terminal 500. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 580 so that the controller 580 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display 551 may be composed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is retained even after the power is turned off, and the battery life of the portable terminal 500 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display 551 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). Also, there may be two or more displays 551 depending on the implementation of the portable terminal 500. For example, the portable terminal 500 may be provided with an external display (not shown) and an internal display (not shown) at the same time.

The sound output module 553 outputs audio data received from the wireless communication unit 510 or stored in the memory 560 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 553 outputs audio signals related to functions performed in the portable terminal 500, for example, call signal reception tones, message reception tones, and the like. The sound output module 553 may include a speaker, a buzzer, and the like.

The alarm unit 555 outputs a signal for notifying the occurrence of an event of the portable terminal 500. Examples of events that occur in the portable terminal 500 include call signal reception, message reception, and key signal input. The alarm unit 555 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 555 can output a signal to notify when a call signal is received or a message is received. When the key signal is input, the alarm unit 555 can output a signal based on the feedback of the key signal input. The user can recognize the occurrence of the event through the signal output from the alarm unit 555. A signal for notifying the occurrence of an event in the portable terminal 500 may also be output through the display 551 or the sound output module 553. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 557 is a vibration effect. When the haptic module 557 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 557 can also be used for a variety of applications, such as an effect of stimulation by a pin arrangement vertically moving with respect to a contact skin surface, an effect of stimulation by air spraying force or suction force through the injection port or suction port, A variety of tactile effects such as an effect of stimulation through the contact of the electrode (eletrode), an effect of stimulation by electrostatic force, and an effect of cold / warm reproduction using a device capable of endothermic or exothermic can be generated. The haptic module 557 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. The haptic module 557 may include two or more haptic modules 557 according to the configuration of the portable terminal 500.

The memory 560 may store a program for processing and controlling the control unit 580 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 560 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM , And a ROM. ≪ / RTI > Also, the portable terminal 500 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 570 serves as an interface with all external devices connected to the portable terminal 500. Examples of the external device connected to the portable terminal 500 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 570 receives data from the external device or receives power from the external device and transmits the data to each component in the portable terminal 500 and allows data in the portable terminal 500 to be transmitted to the external device .

The interface unit 570 may be a path through which power from the cradle connected to the cradle is supplied to the portable terminal 500 when the portable terminal 500 is connected to an external cradle or various command signals input from the cradle by the user And may be a passage to be transmitted to the terminal 500.

The control unit 580 typically controls the operation of the respective units to control the overall operation of the mobile terminal 500. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 580 may include a multimedia playback module 581 for multimedia playback. The multimedia playback module 581 may be configured in hardware in the controller 580 or may be configured in software separately from the controller 580. [ Meanwhile, the control unit 580 may include an application processor (not shown) for driving an application. Or an application processor (not shown) may be provided separately from the control unit 580.

The power supply unit 590 receives external power and internal power under the control of the controller 580 and supplies power necessary for operation of the respective components. The mobile terminal 500 having such a configuration can be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

5 is a flowchart showing an embodiment of an operation method of an electronic device capable of controlling another electronic device according to the related art.

Referring to FIG. 5, first, two electronic devices to share content can be connected (Wi-Fi Direct Connection Setup) through a Wi-Fi direct network proposed by Wi-Fi Alliance (S510) Is a source electronic device that transmits content, and the remaining electronic devices can respond to the role of a sink electronic device that receives and outputs the content.

On the other hand, the source electronic device and the sink electronic device can exchange function information to be supported and perform capability exchange and negotiation (S520)

For example, when content sharing is performed according to the Wi-Fi CERTIFIED Miracast (TM) standard introduced by the Wi-Fi Alliance, when the first Miracast connection is made, Capability Negotiation A video format and an audio format to be transmitted are determined.

The Miracast is a user interface back channel for controlling a source electronic device using a user interface of a sink electronic device during a Miracast connection, UIBC) specification as an option.

For example, when a smart phone is connected to a source electronic device and a TV is connected to a sink electronic device, a sink electronic device is controlled by a control means such as a mouse, a keyboard, and a remote control device connected to the TV You can also control the Source electronics.

In the function negotiation (S520), the capability related to the UIBC can also be determined. In other words, the source electronic device checks the UIBC category such as a mouse and a keyboard supported by the sink electronic device, and then the sink electronic device and the source electronic device The UIBC category that is commonly supported is determined and served.

Thereafter, the sink electronic device transmits the UIBC information according to the user input to the source electronic device (S530), and the source electronic device can perform the corresponding operation.

However, the control information that the sink electronic device can send to the source electronic device is limited to a predetermined one such as vertical scroll, mouse button click, and key input.

6 is a flowchart showing an embodiment of an operation method of an electronic device according to the present invention.

6, an electronic device according to an exemplary embodiment of the present invention may be connected to a first electronic device via a wired / wireless network. (S510) An electronic device according to an exemplary embodiment of the present invention transmits content to another electronic device Or may be connected to external electronic devices via a wired or wireless network for content sharing mode operation, which may receive content from other electronic devices.

An electronic device according to an embodiment of the present invention can request or respond to a network connection to another electronic device based on a command input of a user, for example, a command for executing a corresponding menu or an application, . ≪ / RTI >

Here, the content sharing mode may mean a mode in which an electronic device can transmit content to an external electronic device connected by wire or wirelessly or receive content transmitted from an external electronic device.

In addition, the content sharing mode can use the content reproduced by any one of the plurality of devices connected to the mirroring mode in which connected electronic devices display the same screen, from other devices, and perform other operations in the content sharing state And a dual screen dual play (DSDP) mode.

In addition, the electronic device according to the present invention may be applied to a public multimedia transmission technology such as a Wi-Fi CERTIFIED Miracast (TM), a WiFi Display (WFD), a Wireless Display And can share content according to that specification.

Meanwhile, the data for content sharing may be directly transmitted to external electronic devices via wired or wireless communication according to various communication standards, or may be transmitted to external electronic devices through a separately connected web server.

Meanwhile, an electronic device according to an embodiment of the present invention may be wirelessly connected to the first electronic device through a Wi-Fi Direct Network. A Wi-Fi direct network is a network in which two electronic devices can be peer-to-peer connected via Wi-Fi, and electronic devices connected to a Wi-Fi direct network can grasp resources, capability information, and the like among each other.

Meanwhile, the electronic device according to an embodiment of the present invention may perform capability negotiation with the first electronic device (S620)

In the function negotiation step S620, the electronic device and the first electronic device according to the embodiment of the present invention can determine the video format and the audio format of the contents to be shared and transmitted.

The electronic device according to an embodiment of the present invention determines a video format and an audio format to be transmitted through the function negotiation S620 in operation S620, Audio data, etc. in the format based on the function negotiation with the first electronic device (S630).

The electronic device according to an embodiment of the present invention can transmit control image data including one or more control menu buttons to the first electronic device (S640). In other words, A control event can be generated or data can be transmitted to the counterpart electronic device in advance in the content sharing mode so that the control event can be selected.

Here, the control image data may include a name of the control menu button and position information in the control image of the control menu button.

The electronic device can transmit the control image together with the position information of each menu button. For example, the control names 'Resolution' and 'Media' of each menu button and the position information (xy width hegith) in the control image can be transmitted as follows.

Wfd_uibc_control_image: Resolution 10 10 30 20, Media 10 40 30 20

Also, according to an embodiment, the control image data may further include size information of the control image. That is, in addition to the relative position coordinates of each menu button in the control image, further use of the full size information of the control image can help to grasp the position that the user inputs more quickly.

Also, according to an embodiment, the control image data may include position information of the control image, a name of the control menu button, and position information of the control menu button. The electronic device can transmit the control image together with the position information of the control image, the name of each menu button, and the position information. In this case, the sync electronic device can compare the position input by the user with the position information of the control image and the button position information in the control image in absolute coordinates, thereby discriminating the control command selected by the user.

On the other hand, the first electronic device receiving the control image data can receive a user's input by providing a control UI screen based on the received data. The user can select a command for controlling the electronic device according to an embodiment of the present invention by selecting a control menu button included in the UI screen. Therefore, it is possible to input various control commands without limitation depending on the configuration of the control menu button.

For example, the control image data may include a control menu button corresponding to a control command associated with the content sharing mode, i.e., a control menu button may be configured with control commands frequently used in the content sharing mode .

The control image data may include a control menu button corresponding to a control command determined according to a type of the first electronic device or a type of content shared with the first electronic device. That is, the control menu button can be constituted by control commands optimized in accordance with the type of content being used in the content sharing mode.

On the other hand, the type of content can be discriminated on the basis of the format of data received from the external device or received, extracted from the metadata, or can be determined through various known screen analysis algorithms.

On the other hand, depending on the embodiment, the control image data may be transmitted along with data to be transmitted at the functional negotiation (S620).

Thereafter, the electronic device can receive the user input information for the control image data from the first electronic device (S650), and perform the control function corresponding to the user input information (S660)

Here, the user input information may include a user's input position coordinates for the control image data performed by the first electronic device.

When the user selects a control menu button in the corresponding image in the sink electronic device, coordinates selected by the source electronic device are transmitted. When the source electronic device receives the data, the selected menu button is discriminated, Can be performed.

Alternatively, the first electronic device, which is a sink electronic device, may determine the selected menu button according to the coordinates of the input position of the user with respect to the control image data and directly transmit the determined menu button information to the user input information have,

In this case, the source electronic device can perform an operation corresponding to the received menu button information.

Meanwhile, the user input information may be received as UIBC information through a user interface back channel.

According to an embodiment of the present invention, even in a state of mirroring a source electronic device screen to a sink electronic device using a mirror cast, it is possible to use a source interface using a user interface of a sink electronic device, The UIBC for controlling electronic devices can be expanded without limit.

A source electronic device according to an embodiment of the present invention transmits a control UI image and related data to a sink electronic device.

The source electronic device receives a selection position on the control UI image from which the user has selected an item on the control UI image from the sink electronic device and performs control accordingly.

Therefore, according to the present invention, it is possible to control a source electronic device using a control UI image output from a sink electronic device, thereby enabling a more scalable and convenient source electronic device control

7 is a flowchart showing an embodiment of a method of operating an electronic device according to the present invention. More specifically, a method of operating a sink electronic device that operates in response to the operation of the electronic device described with reference to FIG. 6 as a source electronic device in a content sharing mode is disclosed.

The operation method of the electronic device according to the present invention may be connected to the second electronic device via a wired / wireless network (S710). The electronic device according to an embodiment of the present invention may transmit content to another electronic device, And may be connected to an external electronic device via a wired or wireless network for content sharing mode operation capable of receiving content with the device. Further, the electronic device according to an embodiment of the present invention may be wirelessly connected to the second electronic device through a Wi-Fi Direct Network.

An electronic device according to an embodiment of the present invention can request or respond to a network connection to another electronic device based on a command input of a user, for example, a command for executing a corresponding menu or an application, . ≪ / RTI >

Meanwhile, the electronic device according to an exemplary embodiment of the present invention may perform capability negotiation with the second electronic device (S720). Here, the function negotiation includes a video format of a content to be shared and transmitted, Lt; / RTI >

The electronic device according to an embodiment of the present invention can receive content data including video data, audio data, etc. in a format based on the function negotiation from the second electronic device (S730)

An electronic device according to an embodiment of the present invention may receive control image data including one or more control menu buttons from the second electronic device (S740), and based on the received control image data, A control image including the control menu buttons described above can be displayed (S750)

Here, as described with reference to FIG. 6, the control image data may include the name of the control menu button and the position information in the control image of the control menu button.

Here, the control image data may include a name of the control menu button and position information in the control image of the control menu button. Also, according to an embodiment, the control image data may further include size information of the control image. That is, in addition to the relative position coordinates of each menu button in the control image, further use of the full size information of the control image can help to grasp the position that the user inputs more quickly.

Also, according to an embodiment, the control image data may include position information of the control image, a name of the control menu button, and position information of the control menu button. The electronic device can receive the control image together with the position information of the control image, the name of each menu button, and the position information. In this case, the sync electronic device can compare the position input by the user with the position information of the control image and the button position information in the control image in absolute coordinates, thereby discriminating the control command selected by the user.

On the other hand, the electronic device receiving the control image data provides the control UI screen based on the received data (S740), and can receive the user's input (S750)

The user can select a command for controlling the second electronic device by selecting the control menu button included in the control UI screen. Therefore, it is possible to input various control commands without limitation depending on the configuration of the control menu button.

For example, the control image data may include a control menu button corresponding to a control command associated with the content sharing mode, i.e., a control menu button may be configured with control commands frequently used in the content sharing mode .

The control image data may include a control menu button corresponding to a control command determined according to the type of the second electronic device or the type of content shared with the second electronic device. That is, the control menu button can be constituted by control commands optimized in accordance with the type of content being used in the content sharing mode.

On the other hand, depending on the embodiment, the control image data may be received together with data to be transmitted at the function negotiation (S720).

Thereafter, the electronic device according to the present embodiment may receive the user input for the control image (S760), and transmit the user input information for the control image data to the second electronic device (S770)

The user input information may include a user's input position coordinates for the control image data performed in the electronic device according to an embodiment of the present invention.

When the user selects a control menu button in the image in the sink electronic device (S760), coordinates selected by the source electronic device are transmitted (S770). When the source electronic device receives this data, It is possible to identify the button and perform the corresponding operation.

Alternatively, the sink electronic device may determine the selected menu button according to the coordinates of the input position of the user with respect to the control image data directly performed, and may transmit the determined menu button information to the user input information.

In this case, the source electronic device can perform an operation corresponding to the received menu button information.

Meanwhile, the user input information may be received as UIBC information through a user interface back channel.

According to the present invention, there is no limit to the addition of control menu items, so that the user can control the electronic devices in a more extensible and convenient manner.

Meanwhile, the electronic apparatuses according to the embodiments of the present invention can be network-connected at 1: 1, and can be connected with a plurality of electronic apparatuses to operate in a content sharing mode with a plurality of electronic apparatuses.

Therefore, the electronic apparatus according to the embodiment of the present invention can be connected to the third electronic apparatus via the wired / wireless network even in a state of being connected to the second electronic apparatus.

In this case as well, a function negotiation is performed with the third electronic device, such as a process performed in connection with the second electronic device, and from the third electronic device into a format based on the function negotiation Video and audio data.

Also, control image data including one or more control menu buttons may be received from the third electronic device.

On the other hand, the electronic device that has received the control image data including one or more control menu buttons from the third electronic device may be configured to control the control including the one or more control menu buttons based on the control image data received from the third electronic device Images can be displayed.

Alternatively, in accordance with an embodiment, when receiving an input representing an object representing the connected second electronic device and the third electronic device and selecting an object representing the user's third electronic device, And to display a control image including the one or more control menu buttons based on control image data received from the device.

FIGS. 8 to 16 are views for explaining various embodiments of an operation method of an electronic device according to the present invention. The output screen, the menu screen, and the linking operation of the electronic apparatuses according to the embodiments of the present invention will be described with reference to FIGS. 8 to 16. FIG.

Referring to FIG. 8, a sink electronic device and a source electronic device may be connected to a wired / wireless network for content sharing. For example, a sink electronic device and a source electronic device can be wirelessly connected via a Wi-Fi Direct Network.

Sink electronic devices and source electronic devices can determine features for content sharing and determine functions through capability negotiation.

9 to 11 illustrate that the screen 1005 of the notebook PC 400 is mirrored to the TV 100. [ If you want to change the resolution setting, you have to manually set up the notebook PC (400), which is the source electronic device, as well as the control panel> display> screen resolution (1010).

However, according to an embodiment of the present invention, a control image 900 including a resolution menu button 910 may be transmitted to the TV 100, as shown in FIG.

Further, the source electronic device can transmit the control image together with the position information of each menu button.

For example, the position information (xy width hegith) in the control image of the control name 'Resolution' button 910, the 'Media' button 920 and the control menu button of each menu button is set to 'Wfd_uibc_control_image: Resolution 10 10 30 20, and Media 10 40 30 20 '. Further, width, height information, size information, and the like of the control image can be further transmitted.

Referring to FIG. 9, the control image 900 may have positional information of C2 (50,0), C3 (0,100), and C4 (50,100) with the left upper corner C1 (0,0) as a coordinate reference. The 'Resolution' button 910 also displays a1 (10,10), a2 (40,10), a3 (10,30), a4 (40,30) And the 'Media' button 920 may also be drawn in the control image 900 with the upper left corner C1 (0,0) as the coordinate reference in the same manner.

On the other hand, the TV 100 receives, from the notebook PC 400, content data including video data and audio data in a format based on function negotiation and control image data including one or more control menu buttons can do.

On the other hand, the TV 100 can display the control image 1060 including the one or more control menu buttons 1061 and 1062 as well as the mirroring screen 1055. [

The user can select a menu button for controlling the notebook PC 400 by using the remote control device 200 of the TV 100. [

10, the user indicates to the remote control apparatus 200 to select the 'Resolution' button 1061 by operating the pointer 205 displayed and moved corresponding to the movement of the remote control apparatus 200 .

If there is a user's selection input, the TV 100 can transmit the coordinate information selected by the 'Resolution' button 1061 to the notebook PC 400 as UIBC information.

Accordingly, the notebook PC 400 can display a settable resolution setting window 1010 by confirming that there is a selection input of the 'Resolution' button 1061. In addition, the resolution setting window 1010 may also be mirrored and displayed on the screen of the TV 100.

Thereafter, the user can change the resolution setting using the remote control device 200 again. The resolution will be changed in the notebook PC 400 according to the setting input of the user and reflected on the TV 100 as well.

On the other hand, there has been an inconvenience that the notebook PC 400 must be directly operated to search for and change a folder when playing a specific media file of the notebook PC 400. [

However, according to the present invention, as shown in FIG. 11, the user can select the 'Media' button 1062 without operating the notebook PC 400 directly by operating the remote control device 200 of the TV 100 .

Then, the TV 100 transmits the coordinate information selected by the 'Media' button 1062 to the notebook PC 400 as the UIBC information, and the notebook PC 400, which has determined the selection of the 'Media' button 1062, A list 1020 can be displayed. The user can select and play back the desired media file on the TV 100 again.

On the other hand, the control image data may include a control menu button corresponding to a control command related to the content sharing mode.

For example, in addition to the 'Resolution' button 1061 and the 'Media' button 1062 illustrated in FIGS. 10 and 11, a playback related menu such as play, stop, fast forward and rewind, A setting menu, and the like.

The control image data may include a control menu button corresponding to a control command that is determined according to a type of an electronic device or a type of content to be shared.

FIG. 13 illustrates a case where the smart phone 500 is mirrored to the TV 100. FIG.

In the prior art, since the menu buttons at the bottom of the smartphone 500, for example, the back, home, menu key buttons, etc., are not on the screen, It was impossible.

However, according to the embodiment of the present invention, the control image 1020 including the back button 1221, the home button 1222, and the menu 1223 key buttons in the smart phone 500 as the source electronic device is transmitted to the TV 100 .

Even in this case, the user can operate the pointer 205 to the remote control device 200 of the TV 100 to control the smartphone 500 in the same process as operating the smartphone 500 directly.

For example, when the user selects the home button 1222 key button of the control image 1020 with the remote control device 200, the TV 100 displays the coordinates information And the smartphone 500 may return to the home screen 510.

13 illustrates that the screen 1331 of the notebook PC 400 is mirrored by the TV 100. FIG. More specifically, the notebook PC 400 opens a PPT file and mirrors it to a TV.

When the user selects the mirroring screen 1320 on the TV 100 or moves the pointer to a specific area on the screen, for example, the lower left side of the screen by operating the remote controller 200, the control image 1330 is displayed on the TV screen. Can be displayed.

Meanwhile, the control image 1330 may include a control button corresponding to the current content sharing situation. For example, since the current PPT file is used, the control image 1330 includes a "slide show" button 1331 for starting a slide show, a "resolution change" button 1331 for changing the resolution when the resolution is not correct, Button 1332, a " previous chapter " button 1333 and a " next chapter " button 1334 that can change pages.

Meanwhile, the electronic apparatuses according to the embodiments of the present invention can be network-connected at 1: 1, and can be connected with a plurality of electronic apparatuses to operate in a content sharing mode with a plurality of electronic apparatuses.

14 to 16 illustrate a case where the TV 100 operates in content sharing mode with four portable terminals 1401, 1402, 1403 and 1404 to mirror the portable terminal screens 1411, 1412, 1413 and 1414, Mirroring screens 1451, 1452, 1453, and 1454 are displayed.

15, when the user operates the remote control device 200 to select any one of the mirroring screens 1451, the control image based on the data received from the corresponding portable terminal 1401 (1510) can be displayed.

Meanwhile, the control image 1510 may include menu buttons such as a playback 1511, a stop 1512, and a mute 1513, and the user may select a desired menu button to the remote control device 200 .

Alternatively, when the user selects one of the mirroring screens 1451 by operating the remote control device 200, the data received from the currently connected portable terminals 1401, 1402, 1403, and 1404 Based control images 1510, 1520, 1530, and 1540 can be displayed.

1402, 1403, 1404) when the user operates the remote control device 200 to move the pointer to the area where the mirroring screens 1451, 1452, 1453, 1454 are not displayed, (1510, 1520, 1530, 1540) based on the data received from the control unit 1510. [

As described above, conventionally, only the control defined by the protocol has been previously established between the source electronic device and the sink electronic device. However, according to the present invention, there is no restriction on the control command, and it is easy to expand the control item according to the input means such as various remote control devices and the electronic device Can be.

The present invention is not limited to the configuration and the method of the embodiments described above, but the electronic devices such as the portable terminal, the image display device, and the operation method thereof according to the present invention can be applied to various embodiments All or some of the embodiments may be selectively combined.

Meanwhile, the operating method of the electronic device according to the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the electronic device. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

Wireless communication part: 510
A / V (Audio / Video) input section: 520
User Inputs: 530
Sensing section: 540
Output: 550
Memory: 560
Interface part: 570
Control section: 580
Power supply: 590

Claims (20)

Connecting to the first electronic device via a network;
Performing capability negotiation with the first electronic device;
Transmitting the content data to a format based on the function negotiation with the first electronic device;
Transmitting control image data including one or more control menu buttons to the first electronic device;
Receiving user input information for the control image data from the first electronic device; And
And performing a control function corresponding to the user input information. The method according to claim 1,
Wherein the step of connecting to the first electronic device via the network is wirelessly connected via a Wi-Fi Direct Network. The method according to claim 1,
Wherein the function negotiation includes a determination of a video format and an audio format of the content. The method according to claim 1,
Wherein the control image data includes a name of the control menu button and position information in the control image of the control menu button. 5. The method of claim 4,
Wherein the control image data further includes size information of the control image. The method according to claim 1,
Wherein the control image data includes position information of the control image, a name of the control menu button, and position information of the control menu button. The method according to claim 1,
Wherein the control image data comprises a control menu button corresponding to a control command associated with the content sharing mode. The method according to claim 1,
Wherein the control image data includes a control menu button corresponding to a control command determined according to a type of the first electronic device or a type of content shared with the first electronic device. The method according to claim 1,
Wherein the step of receiving the user input information comprises receiving the user interface back channel information. Connecting to a second electronic device via a network;
Performing capability negotiation with the second electronic device;
Receiving content data from the second electronic device in a format based on the function negotiation;
Receiving control image data from the second electronic device, the control image data including one or more control menu buttons;
Displaying a control image including the one or more control menu buttons based on the received control image data;
Receiving user input for the control image; And
And transmitting user input information for the control image data to the second electronic device. 11. The method of claim 10,
Wherein the step of connecting to the second electronic device via the network is wirelessly connected through a Wi-Fi Direct Network. 11. The method of claim 10,
Wherein the function negotiation includes a determination of a video format and an audio format of the content. 11. The method of claim 10,
Wherein the control image data includes a name of the control menu button and position information in the control image of the control menu button. 14. The method of claim 13,
Wherein the control image data further includes size information of the control image. 11. The method of claim 10,
Wherein the control image data includes position information of the control image, a name of the control menu button, and position information of the control menu button. 11. The method of claim 10,
Wherein the control image data comprises a control menu button corresponding to a control command associated with the content sharing mode. 11. The method of claim 10,
Wherein the control image data includes a control menu button corresponding to a control command determined according to a type of the first electronic device or a type of content shared with the first electronic device. 11. The method of claim 10,
Wherein the step of transmitting the user input information comprises transmitting the user interface back channel information. 11. The method of claim 10,
Connecting to the third electronic device via a network;
Performing capability negotiation with the third electronic device;
Receiving video and audio data from the third electronic device in a format based on the function negotiation;
Receiving control image data from the third electronic device, the control image data including one or more control menu buttons;
And displaying the control image including the one or more control menu buttons based on the control image data received from the third electronic device. 11. The method of claim 10,
Connecting to the third electronic device via a network;
Performing capability negotiation with the third electronic device;
Receiving video and audio data from the third electronic device in a format based on the function negotiation;
Receiving control image data from the third electronic device, the control image data including one or more control menu buttons;
Displaying an object representing the second electronic device and the third electronic device;
Displaying a control image including the one or more control menu buttons based on the control image data received from the third electronic device when receiving an input for selecting an object representing the third electronic device The method comprising:

Images