KR20130019260A - Method for operating a mobile terminal - Google Patents

Abstract

PURPOSE: An operating method of a portable terminal is provided to construct a home network by easily setting the network of an electronic device. CONSTITUTION: A portable terminal displays an object which indicates an electronic device and another object which indicates the portable terminal(S820). The portable terminal receives dragging input to the object which indicates the electronic device(S830). The portable terminal transmits network information to the electronic device(S840). The portable terminal connects to the electronic device based on the network information(S850). [Reference numerals] (AA) Start; (BB) End; (S810) Distance ≤ d ?; (S820) Displaying an object; (S830) Inputting a drag; (S840) Transmitting network information; (S850) Connecting network

Description

Method for operating a mobile terminal

The present invention relates to a portable terminal and a method of operating the same, and more particularly, to a portable terminal and a method of operating the same that can improve user convenience.

Recently, network technologies have been developed in which various electronic devices are connected to each other to enjoy convenient, safe and economical living services at home and at any time. Such a network is configured by connecting electronic devices such as a PC, a TV, a refrigerator, and a portable terminal of a plurality of members, to share or transmit various data.

On the other hand, the portable terminal is a portable device that is portable and has at least one function of inputting and outputting information, performing a voice and video call, and storing a data. As the functions of the mobile terminals are diversified, they are equipped with complex functions such as taking pictures or videos, playing music files or video files, playing games, receiving broadcasts, wireless Internet, and the like. It is implemented in the form.

On the other hand, the portable terminal provides various and convenient user interface environments such as touch input and menu screen for inputting characters by touch input through the screen.

Accordingly, an object of the present invention is to provide a method of operating a portable terminal, which can improve user convenience.

Still another object of the present invention is to provide a method of operating a portable terminal that can easily set network settings of an electronic device and configure a home network.

According to an aspect of the present invention, there is provided a method of operating a mobile terminal, the method comprising: displaying an object representing an electronic device approaching a mobile terminal within a predetermined distance and an object representing the mobile terminal on a display; Receiving a drag input toward an object representing the electronic device, transmitting network information to the electronic device, and network connection with the electronic device based on the network information.

In accordance with another aspect of the present invention, there is provided a method of operating a portable terminal, the method comprising: receiving AP information of a first electronic device having an access point (AP) function, accessing the second electronic device within a predetermined distance; Displaying, on a display, an object representing a second electronic device and an object representing a mobile terminal; receiving a drag input from an object representing the mobile terminal toward an object representing the second electronic device; Transmitting AP information and network connection with the second electronic device based on the AP information.

In accordance with an aspect of the present invention, there is provided a method of operating a mobile terminal, the method comprising: receiving AP information of a first electronic device having an access point (AP) function, based on the AP information; Connecting to the network, approaching the second electronic device within a predetermined distance, displaying an object representing the first electronic device and an object representing the second electronic device on a display, and the second electronic device from the object representing the first electronic device. Receiving a drag input directed to an object representing the device and transmitting AP information to a second electronic device.

According to an embodiment of the present invention, by simply setting up a network of electronic devices using a portable terminal and configuring a home network, a user may manage and utilize contents and information more conveniently and in various ways.

On the other hand, the portable terminal can provide a variety of user interface, it can increase the user convenience.

1 is a diagram illustrating an example of an electronic device capable of short-range communication with a portable terminal according to an embodiment of the present invention.
2 is a block diagram illustrating an image display apparatus according to an embodiment of the present invention.
3 is an internal block diagram of the controller of FIG. 1.
4 is a diagram illustrating a control method of the remote controller of FIG. 2.
Figure 5a is a perspective view of a remote control device according to an embodiment of the present invention, Figure 5b is an internal block diagram of the remote control device.
6 is an internal block diagram of a portable terminal according to an embodiment of the present invention.
7 is a diagram referred to describe near field communication according to an exemplary embodiment of the present invention.
8 is a flowchart illustrating a method of operating a portable terminal according to an embodiment of the present invention.
9 to 11 are diagrams for describing various examples of the operation method of FIG. 8.
12 is a flowchart illustrating a method of operating a portable terminal according to an embodiment of the present invention.
13 to 18 are diagrams for describing various examples of the operation method of FIG. 12.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a diagram illustrating an example of an electronic device capable of short-range communication with a portable terminal according to an embodiment of the present invention.

Referring to the drawings, the portable terminal 500 according to an embodiment of the present invention can transmit or receive data by electronic devices and short-range communication. In particular, data may be transmitted or received by a near field communication (NFC) scheme.

The NFC scheme refers to a contactless short range wireless communication technology using a 13.56 MHz frequency band, and provides interoperability with existing contactless smart card technology and radio recognition technology (RFID).

In order to perform NFC-based short-range communication, the portable terminal 500 according to the embodiment of the present invention is assumed to have an NFC module. The NFC module will be described later with reference to FIG. 7 and the like.

For example, the mobile terminal 500 and the remote control device (not shown) may include an NFC module to enable NFC communication. When the mobile terminal 500 approaches a remote control device (not shown) within a predetermined distance, the mobile terminal 500 or the remote control device (not shown) may be a remote control device (not shown) or the mobile terminal 500. The magnetic field in the direction, and the remote control device (not shown) can receive the personal information from the portable terminal 500 by the magnetic field change.

The mobile terminal 500 may exchange personal information with other electronic devices such as an image display device 200, a refrigerator 300, a network storage device 400, a laundry processing device 600, and an air conditioner 700. In this case, personal information may be transmitted and received in a manner different from that of the NFC method, such as another communication method, for example, an infrared method, an RF method, or the like.

Meanwhile, in the present specification, the personal information may include login information required for a user account.

Meanwhile, in the drawing, as an example of the electronic device, an image display apparatus 200, a refrigerator 300, a network storage device 400, a laundry treatment apparatus 600, and an air conditioner 700 are illustrated. In addition, cooking appliances, home theaters, cameras, game equipment, and the like are also possible.

On the other hand, the image display device 200 may be a TV (TV), a monitor, a notebook, a computer, a tablet PC, etc. capable of broadcast display.

2 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.

2, the image display device 100 according to an embodiment of the present invention is a broadcast receiving unit 105, a network interface unit 130, NFC module 125, an external device interface unit 130, a storage unit 140, a user input interface unit 150, a sensor unit (not shown), a controller 170, a display 180, and an audio output unit 185 may be included.

The broadcast receiving unit 105 may include a tuner unit 110 and a demodulator 120. In addition, if necessary, the broadcast receiving unit 105 may be designed to include the tuner unit 110 and the demodulator unit 120 but not include the network interface unit 130. It is also possible to design so as not to include the tuner unit 110 and the demodulation unit 120 while having.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by a user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner 110 may process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal CVBS / SIF output from the tuner 110 may be directly input to the controller 170.

In addition, the tuner unit 110 may receive a single broadcast RF broadcast signal according to an ATSC (Advanced Television System Committee) scheme or a multiple broadcast RF broadcast signal according to a digital video broadcasting (DVB) scheme.

Meanwhile, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among RF broadcast signals received through an antenna in the present invention, and converts them to intermediate frequency signals or baseband video or audio signals. Can be converted to

On the other hand, the tuner unit 110 may be provided with a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner may be used to receive broadcast signals of multiple channels simultaneously.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. In this case, the stream signal may be a signal multiplexed with a video signal, an audio signal, or a data signal.

The stream signal output from the demodulator 120 may be input to the controller 170. After performing demultiplexing, image / audio signal processing, and the like, the controller 170 outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 130 can transmit or receive data with the connected external device 190. [ To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 may be connected to an external device such as a DVD (Digital Versatile Disk), Blu-ray (Blu ray), a game device, a camera, a camcorder, a computer (laptop), a set top box, or the like by wire / wireless. It may also perform input / output operations with external devices.

The A / V input / output unit may receive a video and audio signal of an external device. The wireless communication unit may perform short range wireless communication with another electronic device.

The network interface unit 135 provides an interface for connecting the image display apparatus 100 to a wired / wireless network including an internet network. For example, the network interface unit 135 may receive content or data provided by the Internet or a content provider or a network operator through a network.

Meanwhile, the network interface unit 135 may perform data communication with an adjacent electronic device around the image display apparatus 100. In this case, the network interface unit 135 may receive device information of another electronic device, channel information that can be remotely controlled by another electronic device, frequency information or code information.

The image display apparatus 100 may include an NFC module 125 to enable NFC communication with other electronic devices such as the mobile terminal 500.

On the other hand, through the NFC module 125, it is also possible to receive device information, network information, and the like of other electronic devices. Then, based on this other electronic device information, it may be networked with the electronic device.

The storage 140 may store a program for processing and controlling each signal in the controller 170, or may store a signal-processed video, audio, or data signal.

In addition, the storage unit 140 may perform a function for temporarily storing an image, audio, or data signal input to the external device interface unit 130. In addition, the storage 140 may store information on a predetermined broadcast channel through a channel storage function such as a channel map.

Although the storage unit 140 of FIG. 2 is provided separately from the control unit 170, the scope of the present invention is not limited thereto. The storage 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

For example, the remote controller 200 transmits / receives a user input signal such as power on / off, channel selection, screen setting, or a local key (not shown) such as a power key, a channel key, a volume key, or a set value. Transmits a user input signal input from the control unit 170, or transmits a user input signal input from the sensor unit (not shown) for sensing the user's gesture to the control unit 170, or the signal from the control unit 170 It can transmit to a sensor unit (not shown).

According to an embodiment of the present invention, the user input interface unit 150 may receive personal information from the remote control apparatus 200. In addition to the personal information, the web server information being connected by the personal information may be further received.

For example, when the portable terminal 500 and the remote control apparatus 200 approach within a predetermined distance to perform Near Field Communication (NFC), the remote control apparatus 200 may store an individual stored in the portable terminal 500. Information can be received. In addition, the remote control apparatus 200 may transmit personal information to the image display apparatus 100 according to an IR scheme or an RF scheme. At this time, the user input interface unit 150 transmits the received personal information to the control unit 170.

Meanwhile, the personal information at this time may include personal ID information, password information, personal email information, and the like for the mobile terminal 500. Alternatively, the personal information may include personal ID information, password information, personal email information, and the like for the image display apparatus 100. Alternatively, the personal information may be personal ID information or password information that can be commonly used in various electronic devices including the mobile terminal 500. Alternatively, the personal information may be personal ID information, password information, or the like from the portable terminal 500 to a predetermined web server stored in advance. Alternatively, the personal information may be personal ID information, password information, etc., to a predetermined web server that can be used in the image display apparatus 100 including the mobile terminal 500. Alternatively, the personal information may be personal ID information, password information, or the like for a server connected to the video display device 100.

That is, the personal information may be information necessary to log in to a predetermined account for the electronic device or the service.

On the other hand, the user input interface unit 150, from the adjacent electronic device around the image display device 100, transmitted from the remote control device 200, device information of other electronic devices, channel information capable of remote control of other electronic devices Frequency information or code information may be received.

The controller 170 may demultiplex the input stream or process the demultiplexed signals through the tuner unit 110, the demodulator 120, or the external device interface unit 130. Signals can be generated and output.

The image signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the image signal. In addition, the image signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

The voice signal processed by the controller 170 may be sound output to the audio output unit 185. In addition, the voice signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

Although not shown in FIG. 2, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG. 3.

In addition, the controller 170 may control overall operations of the image display apparatus 100. For example, the controller 170 may control the tuner 110 to control the tuner 110 to select an RF broadcast corresponding to a channel selected by a user or a pre-stored channel.

In addition, the controller 170 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150.

The controller 170 may control the display 180 to display an image. In this case, the image displayed on the display 180 may be a still image or a video, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate and display a 3D object with respect to a predetermined object in the image displayed on the display 180. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), an EPG (Electronic Program Guide), various menus, widgets, icons, still images, videos, and text.

The controller 170 may recognize a location of a user based on an image photographed by a photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 may be determined. In addition, the x-axis coordinates and the y-axis coordinates in the display 180 corresponding to the user position may be determined.

On the other hand, according to an embodiment of the present invention, the control unit 170 may control to log in based on the personal information received from the remote control device 200. In this case, the login may be a login of the image display apparatus 100 itself, a login to a server connected to the image display apparatus 100, or a login to a predetermined web server subscribed by personal information.

For example, when the user logs in to the video display device 100 by personal ID information and password information received from the remote controller 200, the controller 170 displays a personal screen set for each user account. The control may be displayed at 180. When there is an image being watched, the controller 170 may control to display a personal setting screen together with the image being watched. Alternatively, it is possible to control to change the scene of the video being viewed and to display it on the personal setting screen.

As another example, when logging in to a server connected to the image display apparatus 100, the controller 170 may control to display a server connection screen received from the server on the display 180. Specifically, it may be an app server screen. If there is an image being watched, the controller 170 may control to display a server connection screen together with the image being watched. Alternatively, it is possible to control to switch the video being viewed to the scene and display it on the server connection screen.

As another example, when the received personal information is personal information about predetermined web servers connected to another electronic device, specifically, the mobile terminal 500, the controller 170 may determine that the image display apparatus 100 corresponds to the web servers. The control unit may be controlled to access the screen, and to display the screen of the connected web server on the display 180. In this case, the web servers may be web servers that provide a social network service. When there is an image being watched, the controller 170 may control to display a screen of the connected web server together with the image being watched. Alternatively, it is also possible to control the display of the image being watched to be displayed on the screen of the connected web server.

Meanwhile, the controller 170 may control a power supply unit (not shown) to turn on the image display apparatus 100 when the image display apparatus 100 is turned off while personal information is received. Can be. That is, in the standby mode, when personal information is received from the user input interface unit 150, the controller 170 switches to the wake up mode to supply power to various modules or units. The supply can be controlled.

On the other hand, the control unit 170, the device information of the adjacent electronic device around the image display device 100, received from the network interface unit 135 or the user input interface unit 150, the channel capable of remote control of other electronic devices Based on the personal information from the remote control apparatus 200 based on the information, the frequency information, the code information, or the like, it is determined whether each electronic device or the like is connected, and displays an object indicating that the other electronic device is logged in. You can control it to display.

Alternatively, the controller 170 may control the remote controller 200 based on device information of adjacent electronic devices around the image display device 100, channel information that can be remotely controlled by another electronic device, frequency information, code information, or the like. It may be controlled to transmit the corresponding device information, channel information, frequency information or code information.

On the other hand, although not shown in the figure, it may be further provided with a channel browsing processing unit for generating a thumbnail image corresponding to the channel signal or the external input signal. The channel browsing processor may receive a stream signal TS output from the demodulator 120 or a stream signal output from the external device interface 130, extract a video from the input stream signal, and generate a thumbnail image. Can be. The generated thumbnail image may be stream decoded together with the decoded image and input to the controller 170. The controller 170 may display a thumbnail list including a plurality of thumbnail images on the display 180 by using the input thumbnail image.

In this case, the thumbnail list may be displayed in a simple viewing manner displayed in a partial region while a predetermined image is displayed on the display 180 or in an overall viewing manner displayed in most regions of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts an image signal, a data signal, an OSD signal, a control signal, or an image signal, a data signal, a control signal received from the external device interface unit 130 processed by the controller 170, and generates a driving signal. Create

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or a 3D display.

 The display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives a signal processed by the controller 170 and outputs the audio signal.

A photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. Meanwhile, the photographing unit (not shown) may be embedded in the image display device 100 on the display 180 or disposed separately. The image information photographed by the photographing unit (not shown) may be input to the control unit 170.

The controller 170 may detect a user's gesture based on each of the images captured by the photographing unit (not shown) or the sensed signal from the sensor unit (not shown) or a combination thereof.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. To this end, the remote control device 200 may be a Bluetooth (Radio Frequency) communication system, an infrared (IR) communication system, an ultra wideband (UWB) system, a ZigBee system, Can be used.

In addition, the remote control apparatus 200 may receive an image, audio or data signal output from the user input interface unit 150. In addition, the remote control apparatus 200 may display or output audio from the remote control apparatus 200 based on the received video, audio, or data signal.

On the other hand, the remote control device 200 according to an embodiment of the present invention, can receive personal information by a predetermined electronic device and near field communication. As described above, the personal information may be personal ID information and password information that can be used in the mobile terminal 500, the image display device 200, or an electronic device. At this time, the personal information may be different for each device, but in the embodiment of the present invention, only one integrated personal ID and password will be described.

The remote controller 200 may transmit the received personal information to the video display device 100. The communication method at this time may use an IR method or an RF method.

In an embodiment of the present invention, the remote control apparatus 200 describes a spatial remote controller capable of displaying a pointer corresponding to a user's movement. That is, the remote control apparatus 200 may transmit personal information to the image display apparatus 100 using the RF method.

Meanwhile, the remote control apparatus 200 may further receive web server information, etc. being accessed by the personal information, in addition to the personal information. For example, the mobile terminal 500 may receive web server information about a social network service that is being logged in and accessed. Such web server information is also transmitted to the image display apparatus 100.

Meanwhile, it is also possible to receive device information of another electronic device, channel information remotely controllable by another electronic device, frequency information, code information, and the like from the adjacent electronic device around the image display apparatus 100. Based on such other electronic device information, a remote control may be performed by allocating a channel, a frequency, or a code to the corresponding electronic device.

Meanwhile, the above-described image display apparatus 100 may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasting.

Meanwhile, a block diagram of the image display device 100 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 that is actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

On the other hand, the image display device 100, unlike shown in Figure 2, does not include the tuner 110 and the demodulator 120 shown in Figure 2, the network interface unit 130 or the external device interface unit ( Through 135, image content may be received and played back.

3 is an internal block diagram of the controller of FIG. 2.

Referring to the drawings, the control unit 170 according to an embodiment of the present invention, the demultiplexer 310, the image processor 320, the processor 330, the OSD generator 340, the mixer 345 , Frame rate converter 350, and formatter 360. In addition, the apparatus may further include a voice processor (not shown) and a data processor (not shown).

The demultiplexer 310 demultiplexes an input stream. For example, when an MPEG-2 TS is input, it may be demultiplexed and separated into video, audio, and data signals, respectively. Here, the stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110, the demodulator 120, or the external device interface unit 130.

The image processor 320 may perform image processing of the demultiplexed image signal. To this end, the image processor 320 may include an image decoder 325 and a scaler 335.

The image decoder 325 decodes the demultiplexed video signal, and the scaler 335 performs scaling to output the resolution of the decoded video signal on the display 180.

The video decoder 325 can include a decoder of various standards.

The processor 330 may control overall operations in the image display apparatus 100 or the controller 170. For example, the processor 330 may control the tuner 110 to control tuning of an RF broadcast corresponding to a channel selected by a user or a previously stored channel.

In addition, the processor 330 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150.

In addition, the processor 330 may perform data transmission control with the network interface unit 135 or the external device interface unit 130.

The processor 330 may control operations of the demultiplexing unit 310, the image processing unit 320, the OSD generating unit 340, and the like in the controller 170.

The OSD generator 340 generates an OSD signal according to a user input or itself. For example, a signal for displaying various types of information on a screen of the display 180 as a graphic or text may be generated based on a user input signal. The generated OSD signal may include various data such as a user interface screen, various menu screens, widgets, and icons of the image display apparatus 100. In addition, the generated OSD signal may include a 2D object or a 3D object.

In addition, the OSD generator 340 may generate a pointer that can be displayed on a display based on a pointing signal input from the remote controller 200. In particular, such a pointer may be generated by the pointing signal processor, and the OSD generator 240 may include such a pointing signal processor (not shown). Of course, the pointing signal processor (not shown) may be provided separately without being provided in the OSD generator 240.

Meanwhile, in accordance with an embodiment of the present invention, the OSD generator 340 may generate or configure a set personal screen when a user logs in to the image display apparatus 100 itself. Alternatively, the OSD generator 340 may generate or configure at least a portion of the server access screen to display the server access screen received from the server on the display 180 when logging in to the connected server. Alternatively, the OSD generator 340 may generate or configure at least a part of the web server access screen based on the web server information being accessed by the personal information.

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the decoded image signal processed by the image processor 320. In this case, the OSD signal and the decoded video signal may each include at least one of a 2D signal and a 3D signal. The mixed video signal is provided to the frame rate converter 350.

A frame rate converter (FRC) 350 can convert the frame rate of an input image. On the other hand, the frame rate converter 350 can output the data as it is without additional frame rate conversion.

The formatter 360 receives a mixed signal, that is, an OSD signal and a decoded video signal, from the mixer 345 and changes the format of the signal to be suitable for the display 180. For example, the R, G, B data signals may be output, and the R, G, B data signals may be output as low voltage differential signaling (LVDS) or mini-LVDS.

Meanwhile, the formatter 360 may separate the 2D video signal and the 3D video signal for displaying the 3D video. In addition, the format of the 3D video signal may be changed or the 2D video signal may be converted into a 3D video signal.

The voice processing unit (not shown) in the controller 170 may perform voice processing of the demultiplexed voice signal. To this end, the voice processing unit (not shown) may include various decoders.

Also, the voice processing unit (not shown) in the controller 170 may process a base, a treble, a volume control, and the like.

The data processor (not shown) in the controller 170 may perform data processing of the demultiplexed data signal. For example, when the demultiplexed data signal is an encoded data signal, it may be decoded. The encoded data signal may be EPG (Electronic Progtam Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted in each channel.

In FIG. 3, the signals from the OSD generator 340 and the image processor 320 are mixed in the mixer 345 and then 3D processed in the formatter 360, but the present invention is not limited thereto. May be located after the formatter.

Meanwhile, a block diagram of the controller 170 shown in FIG. 3 is a block diagram for one embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specification of the controller 170 that is actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170, but may be provided separately.

4 is a diagram illustrating a control method of the remote controller of FIG. 1.

As illustrated in FIG. 4A, a pointer 205 corresponding to the remote controller 200 is displayed on the display 180.

The user can move or rotate the remote control device 200 up and down, left and right (Fig. 4 (b)), front and rear (Fig. 4 (c)). The pointer 205 displayed on the display 180 of the image display device corresponds to the movement of the remote controller 200. The remote control apparatus 200 may be referred to as a spatial remote controller because the pointer 205 is moved and displayed according to the movement in the 3D space as shown in the figure.

4B illustrates that when the user moves the remote control apparatus 200 to the left side, the pointer 205 displayed on the display 180 of the image display apparatus also moves to the left side correspondingly.

Information about the movement of the remote control device 200 detected through the sensor of the remote control device 200 is transmitted to the image display device. The image display device may calculate the coordinates of the pointer 205 from the information about the movement of the remote controller 200. The image display device may display the pointer 205 to correspond to the calculated coordinates.

4C illustrates a case in which the user moves the remote control apparatus 200 away from the display 180 while pressing a specific button in the remote control apparatus 200. As a result, the selection area in the display 180 corresponding to the pointer 205 may be zoomed in and enlarged. On the contrary, when the user moves the remote controller 200 to be closer to the display 180, the selection area in the display 180 corresponding to the pointer 205 may be zoomed out and reduced. On the other hand, when the remote control device 200 moves away from the display 180, the selection area is zoomed out, and when the remote control device 200 approaches the display 180, the selection area may be zoomed in.

On the other hand, while pressing a specific button in the remote control device 200 can recognize the up, down, left and right movement. That is, when the remote control device 200 moves away from or near the display 180, the up, down, left and right movements are not recognized, and only the front and back movements can be recognized. In a state where a specific button in the remote controller 200 is not pressed, only the pointer 205 moves according to the up, down, left, and right movements of the remote controller 200.

Meanwhile, the moving speed or the moving direction of the pointer 205 may correspond to the moving speed or the moving direction of the remote control apparatus 200.

Figure 5a is a perspective view of a remote control device according to an embodiment of the present invention, Figure 5b is an internal block diagram of the remote control device.

Referring to FIG. 5A, the spatial remote control 201 according to an embodiment of the present invention may include various input keys or input buttons.

For example, the spatial remote control 201 may include an ok key 291, a menu key 292, a four-way key 293, a channel adjustment key 294, and a volume adjustment key 296. have.

For example, the ok key 291 may be used to select a menu or item, the menu key 292 may be used to display a predetermined menu, and the four-way key 293 may move up or down the pointer or indicator. It can be used to move up, down, left and right, the channel adjustment key 294 can be used to adjust the channel up and down, and the volume adjustment key 296 can be used to adjust the volume up and down.

The spatial remote control 201 may further include a back key 297 and a home key 298. For example, the back key 297 may be used when moving to the previous screen, and the home key 298 may be used when moving to the home screen.

On the other hand, as shown in the figure, the confirmation key 291 may be added with a scroll function. To this end, the confirmation key 291 can be implemented in the form of a wheel key. That is, when the confirmation key 291 is pressed, it is used as a menu or item selection, and when the confirmation key 291 is scrolled up and down, display screen scrolling or list page switching may be performed.

In detail, when an image larger than the size of the display is displayed on the display unit 180, when the confirmation key 291 is scrolled to search for the corresponding image, an image area not currently displayed on the display is displayed on the display. As another example, when the list page is displayed on the display unit 180, when the confirmation key 291 is scrolled, the previous page or the next page of the current page may be displayed.

The scroll function may be provided as a key other than the confirmation key 291.

On the other hand, the four-way key 293, in the circular type, as shown in the upper, lower, left, right keys may be arranged in four directions, respectively. Meanwhile, a touch input to the four-way key 293 may also be possible. For example, when there is a touch operation from an up key to a down key in the four-way key 293, a set function may be input or performed according to the corresponding touch input.

Referring to FIG. 5B, the remote control apparatus 200 includes a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260, and a storage unit 270. It may include a control unit 280.

The wireless communication unit 220 transmits and receives a signal with any one of the image display apparatus according to the embodiments of the present invention described above. Among the image display apparatuses according to the exemplary embodiments of the present invention, one image display apparatus 100 will be described as an example.

In the present embodiment, the remote control apparatus 200 may include an RF module 221 capable of transmitting and receiving signals with the image display apparatus 100 according to the RF communication standard. In addition, the remote control apparatus 200 may include an IR module 223 capable of transmitting and receiving signals with the image display apparatus 100 according to IR communication standards.

In addition, the remote control apparatus 200 may include an NFC module 225 for short-range magnetic field communication with the electronic device.

The remote control device 200 can transmit a signal containing information on the motion and the like of the remote control device 200 to the image display device 100 through the RF module 221.

In addition, the remote control apparatus 200 may receive a signal transmitted from the image display apparatus 100 through the RF module 221. In addition, the remote controller 200 may transmit a command regarding power on / off, channel change, volume change, etc. to the image display device 100 through the IR module 223 as necessary.

On the other hand, according to the present embodiment, the remote control device 200 can receive personal information by a predetermined electronic device and near field communication.

The remote controller 200 may transmit the received personal information to the video display device 100. The communication method at this time may use an IR method or an RF method.

Meanwhile, the remote control apparatus 200 may further receive web server information, etc. being accessed by the personal information, in addition to the personal information. For example, the mobile terminal 500 may receive web server information about a social network service that is being logged in and accessed. Such web server information may also be transmitted to the image display apparatus 100.

Meanwhile, the remote control apparatus 200 may also receive device information of another electronic device, channel information remotely controllable by another electronic device, frequency information, network information or code information. Based on such other electronic device information, a remote control may be performed by allocating a channel, a frequency, or a code to the corresponding electronic device.

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by manipulating the user input unit 230. When the user input unit 230 includes a hard key button, the user may input a command related to the image display apparatus 100 to the remote control apparatus 200 through a push operation of the hard key button. When the user input unit 230 includes a touch screen, the user may input a command related to the image display apparatus 100 to the remote control apparatus 200 by touching a soft key of the touch screen. In addition, the user input unit 230 may include various kinds of input means that a user can operate, such as a scroll key or a jog key, and the present embodiment does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 may sense information about the movement of the remote controller 200.

For example, the gyro sensor 241 may sense information about the operation of the remote control apparatus 200 based on the x, y, and z axes. The acceleration sensor 243 may sense information about a moving speed of the remote controller 200. Meanwhile, a distance measuring sensor may be further provided, whereby the distance with the display 180 may be sensed.

The output unit 250 may output a video or audio signal corresponding to a manipulation of the user input unit 230 or a signal transmitted from the image display apparatus 100. The user may recognize whether the user input unit 230 is manipulated or whether the image display apparatus 100 is controlled through the output unit 250.

For example, the output unit 250 may include a LED module 251 that is turned on when the user input unit 230 is manipulated or a signal is transmitted and received with the image display device 100 through the wireless communication unit 225, and a vibration module generating vibration. 253, a sound output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 may reduce power waste by stopping the power supply when the remote controller 200 does not move for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control apparatus 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for controlling or operating the remote control apparatus 200. If the remote control apparatus 200 transmits and receives a signal wirelessly through the image display apparatus 100 and the RF module 221, the remote control apparatus 200 and the image display apparatus 100 transmit signals through a predetermined frequency band. Send and receive The control unit 280 of the remote control device 200 stores information on a frequency band or the like capable of wirelessly transmitting and receiving signals with the image display device 100 paired with the remote control device 200 in the storage unit 270. Reference may be made.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The controller 280 transmits a signal corresponding to a predetermined key manipulation of the user input unit 230 or a signal corresponding to the movement of the remote controller 200 sensed by the sensor unit 240 through the wireless communication unit 225. 100 can be sent.

The controller 280 may control the received personal information to be transmitted to the video display device 100 through the wireless communication unit 220 by the electronic device and near field communication. In particular, when there is a predetermined key input by the user input unit 230, the controller 280 may control the received personal information to be transmitted to the image display apparatus 100 through the wireless communication unit 220.

In addition, the controller 280 may control the received personal information to be transmitted to other electronic devices other than the image display apparatus 100. At this time, it is possible to use different channels, frequencies or codes corresponding to each electronic device. Such a channel, frequency or code may be based on device information, remotely controllable channel information, frequency information or code information from another electronic device in advance.

6 is an internal block diagram of a portable terminal according to an embodiment of the present invention.

The mobile terminal 500 according to an embodiment of the present invention includes a user interface unit 510, an A / V input unit 520, an NFC module 525, a network interface unit 530, and an external device interface. The unit 535 may include a sensor 540, a storage 550, a controller 560, a display 570, an audio output unit 580, and a power supply unit 590.

Such components may be configured by combining two or more components into one component, or by dividing one or more components into two or more components as necessary when implemented in an actual application.

On the other hand, the portable terminal described herein is a tablet computer (tablet computer), mobile phone, smart phone (smart phone), notebook computer (notebook computer), PDA (Personal Digital Assistants), PMP (Portable Multimedia Player), digital broadcasting terminal , Navigation, and the like.

 On the other hand, the portable terminal described herein is connected to the Internet and a computer with the support of a wired or wireless Internet function, it is also possible to perform functions such as email, web browsing, banking or gaming. In addition, voice and video call functions can be performed, and the call mode can be performed by using an Internet network, a mobile communication network, etc. according to Voice over Internet Protocol (VoIP).

The user input unit 510 generates key input data input by the user for controlling the operation of the portable terminal. The user input unit 510 may be configured of a key pad, a switch, a touch screen (static pressure / capacitance), etc., which may receive a command or information by a user's push or touch operation. In addition, the user input unit 510 may be configured as a jog wheel for rotating a key, a jog method or a manipulation method such as a joystick, or a finger mouse.

The A / V input unit 520 is for inputting an audio signal or a video signal, and may include a camera and a microphone. The camera processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display 570.

The image frame processed by the camera may be stored in the storage unit 550 or transmitted to the outside through the network interface unit 530 or the external device interface unit 535. Two or more cameras may be provided according to the configuration aspect of the terminal.

The microphone receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes it into electrical voice data.

The network interface unit 530 provides an interface for connecting the mobile terminal 500 to a wired / wireless network including an internet network.

The network interface unit 530 may transmit or receive data with another user or another electronic device through the connected network or another network linked to the connected network. In particular, some content data stored in the mobile terminal 500 may be transmitted to a user selected from another user or another electronic device registered in the mobile terminal 500 or the selected electronic device.

Meanwhile, the network interface unit 530 may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through the network, it is possible to send or receive data with the server. In addition, content or data provided by a content provider or a network operator may be received. That is, it can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network. In addition, the update information and the update file of the firmware provided by the network operator can be received. It may also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 530 may select and receive a desired application from among applications that are open to the public through the network.

Meanwhile, the network interface unit 530 may be connected to a mobile communication network and include a mobile communication unit for voice and video call. The mobile communication unit transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text / multimedia message.

In order to perform NFC-based short-range communication, the portable terminal 500 may include an NFC module 525. The NFC module will be described later with reference to FIG. 7 and the like.

In addition, the mobile terminal 500 may receive a signal related to broadcast through a wired or wireless Internet network, and may further include a separate broadcast receiver (not shown) for broadcast reception.

The broadcast receiver may receive at least one of a broadcast signal and broadcast related information from the outside, and may include a tuner, a demodulator, a demultiplexer, a decoder, and the like, for receiving the signal and processing the signal.

The external device interface unit 535 may connect the external device to the portable terminal 500. To this end, the external device interface unit 135 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 535 may be connected to an external device such as a TV, a DVD (Digital Versatile Disk), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), a refrigerator, or the like by wire or wireless. have. The external device interface unit 535 transmits an image, audio or data signal input from the outside through the connected external device to the controller 560 of the portable terminal 500. In addition, the controller 560 may output an image, audio, or data signal processed by the controller 560 to a connected external device. To this end, the external device interface unit 535 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The A / V input / output unit may use a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), and a DVI to input video and audio signals from an external device to the mobile terminal 500. Digital Visual Interface (HDMI) terminal, High Definition Multimedia Interface (HDMI) terminal, RGB terminal, D-SUB terminal and the like.

The wireless communication unit can perform short-range wireless communication with other electronic devices. The mobile terminal 500 may include, for example, Near Field Communication (NFC), Bluetooth (Bluetooth), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, It can be networked with other electronic devices according to various communication standards such as DLNA (Digital Living Network Alliance).

In addition to the external device described above, the external device interface unit 535 serves as an interface with all external devices connected to the portable terminal 500. Examples of the external device connected to the portable terminal 500 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The external device interface unit 535 may receive data from such an external device or receive power and transfer the data to each component inside the mobile terminal 500 so that the data inside the mobile terminal 500 may be transmitted to the external device. Can be.

Meanwhile, the external device interface unit 535 may receive an application or a list of applications in a neighboring external device and transmit the received application or application list to the controller 560 or the storage unit 550.

Meanwhile, the controller 560 transmits a control signal by a user's command or program to another electronic device connected through the network interface unit 530 or the external device interface unit 535 or receives a control signal received from an allowed electronic device. You can perform a command based on that. For example, it is possible to control an image display device, perform a reservation operation using a PC connected to a home network, check the contents of a smart refrigerator, and receive various signals such as a message or a command from a smart phone of a family member. .

The sensor unit 540 generates a sensing signal for controlling the operation of the mobile terminal 500 by detecting the current state of the mobile terminal 500 such as the position, movement, and presence or absence of a user contact.

The sensor unit 540 may include a detection sensor, a pressure sensor, and a motion sensor. The sensor detects the presence or absence of an object approaching the portable terminal 500 or an object present in the vicinity of the portable terminal 500 without mechanical contact. The detection sensor can detect the proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or by using a change rate of capacitance. Two or more detection sensors may be provided according to the configuration aspect.

The pressure sensor may detect whether pressure is applied to the mobile terminal 500 and the magnitude of the pressure. The pressure sensor may be installed at a portion of the portable terminal 500 that requires the detection of pressure according to the use environment. If the pressure sensor is installed in the display 570, a touch input through the display 570 and a pressure touch input to which a greater pressure is applied than the touch input may be identified according to a signal output from the pressure sensor. . In addition, according to the signal output from the pressure sensor, it can also know the magnitude of the pressure applied to the display 570 when the pressure touch input.

The motion sensor detects the position or movement of the portable terminal 500 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used in a motion sensor is an element that converts an acceleration change in one direction into an electrical signal, and a gyro sensor can detect a return direction with respect to an angular velocity and a reference direction, and the operation of the mobile terminal 500 is performed. Information about may be sensed based on the x, y, and z axes. The acceleration sensor may sense information regarding a moving speed of the portable terminal 500 and the like. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The storage unit 550 may store a program, a platform, and an application for each signal processing and control in the controller 560, or may store a signal processed image, audio, or data signal.

Meanwhile, the mobile terminal 500 may provide a user with a content file (video file, still image file, music file, document file, application file, etc.) stored in the storage unit 550.

In addition, the storage unit 550 may perform a function for temporarily storing an image, audio, or data signal input from the external device interface unit 535 or the network interface unit 530.

6 illustrates an embodiment in which the storage unit 550 is provided separately from the control unit 560, the scope of the present invention is not limited thereto. The storage unit 550 may be included in the controller 560.

The controller 560 may control overall operations of the portable terminal 500. For example, the controller 560 may control the portable terminal 500 by a user command or an internal program input through the user interface 510. In particular, it is possible to connect to the network so that the user can download the desired application or application list into the mobile terminal 500.

The controller 560 may output an image or an audio through the display 570 or the audio output unit 580 based on the received signal.

As another example, the controller 560 may be provided from an external device, for example, a camera or a camcorder, input through the external device interface unit 535 according to an external device image playback command received through the user interface unit 510. The video signal or the audio signal may be output through the display 570 or the audio output unit 580.

Meanwhile, the controller 560 may control the display 570 to display the video of the call counterpart and the video of the user according to the user's setting in the video call mode, and to output audio based on the voice signal of the received call counterpart. The output unit 580 may be controlled to output.

In addition, the controller 560 may control to reproduce the content. In this case, the content may be content stored in the mobile terminal 500, received broadcast content, or external input content input from the outside. The content may be at least one of a broadcast image, an external input image, an audio file, a still image, a connected web screen, and a document file.

In addition, the controller 560 may determine whether the touch input corresponds to a character input such as alphabet, number, or symbol based on the pattern of the touch input signal. The controller 560 may check a character corresponding to the trajectory of the touch input based on the database. The database includes Korean, English, Chinese, Japanese, numbers, symbols, and the like, and may be stored in the controller 560 or the storage 550.

The controller 560 may control to install and run an application downloaded from an external network along with various user interfaces. In addition, by selecting a user, an image related to an executed application may be controlled to be displayed on the display 570.

The platform of any one of the mobile terminal 500 according to the embodiments of the present invention may be equipped with OS-based software to perform the various operations described above. The platform may be provided in the form of a program in the control unit or a separate processor, or may be stored in the storage unit.

The platform of any one of the portable terminals according to the embodiments of the present invention may include an OS kernel, a driver on the OS kernel, middleware, a framework, and an application layer. It may include.

The OS kernel may be implemented as a kernel based on various operating systems (OS), such as Unix-based (Linux) and Windows-based. Also, the OS kernel is an open OS kernel and may be general purpose that can be used in other electronic devices.

The display 570 displays an image signal, a data signal processed by the controller 560, or an image signal, a data signal, or the like received from the network interface unit 530 or the external device interface unit 535, respectively. Convert to a signal to generate a drive signal.

The display 570 may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, or the like.

The display 570 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 580 outputs audio data received or stored in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the audio output unit 580 outputs a sound signal related to a function performed in the portable terminal 500, for example, a call signal reception sound and an effect sound. The audio output unit 180 may include a speaker, a buzzer, and the like.

On the other hand, the power supply unit 590 supplies the power throughout the portable terminal 500.

Meanwhile, the portable terminal 500 having the above-described configuration described with reference to FIG. 6 may include a wired / wireless communication system and a satellite-based communication system, and may transmit data through a frame or a packet. It can be configured to be operable in a communication system that is present.

7 is a diagram referred to describe near field communication according to an exemplary embodiment of the present invention.

Referring to the drawings, the portable terminal 500 and the image display apparatus 100 may transmit or receive data by using a near field communication (NFC) method.

To this end, the mobile terminal 500 may include an NFC module 525 including an NFC controller 526 and an antenna 528. In addition, the image display apparatus 100 may include an NFC module 125 including an NFC controller 126 and an antenna 126.

For example, when the user approaches the mobile terminal 500 to the image display apparatus 100 within a predetermined distance, or vice versa, a magnetic field is provided, and the image display apparatus 100 according to the magnetic field change, Information from the mobile terminal 500 can be received.

That is, the information exchange between the mobile terminal 500 and the image display apparatus 100 may be performed in the reader / wrtiter mode, or peer to among the CE (card emulation) mode, reader / writer mode, and peer to peer mode. Can be performed on a peer mode basis.

The personal information and the network information of the portable terminal 500 may be stored in the form of a tag in the NFC module 525 or may be the personal information and the network information stored in a storage unit (not shown) of the portable terminal 500. . In order to transmit such personal information and network information, the controller 560 of the mobile terminal 500 transmits the information to the NFC module 525, and the NFC controller 526 converts the information through the antenna 528. Control to be transmitted.

The antenna of the image display apparatus 100 receives personal information, network information, and the like transmitted from the portable terminal 500, and the received information passes through the NFC control unit 126 of the image display apparatus 100. It is transmitted to the control unit 170 of the (100). The controller 170 of the image display apparatus 100 may control to transmit the corresponding information to another electronic device including the image display apparatus 100 through the network interface unit 135 or the like.

Meanwhile, in addition to the above personal information and network information, web server information logged in from the mobile terminal 500 or web server information logged in from another electronic device may be received.

8 is a flowchart illustrating a method of operating a portable terminal according to an embodiment of the present invention, and FIGS. 9 to 11 are views for explaining various examples of the method of FIG. 8.

According to an embodiment of the present invention, when the electronic devices having the NFC module approach within a predetermined distance, network information such as AP information may be transmitted and received by a near field communication method.

Meanwhile, in the present specification, the AP information may include identifier information (eg, Service Set Identifier (SSID)), encryption key (eg, WEP-KEY), and the like.

Referring to FIG. 9A, in order to perform NFC-based short-range communication, the mobile terminal 500 is a predetermined distance d to another electronic device having an NFC module, for example, the image display apparatus 100. Approach within) (S810)

Meanwhile, in an electronic device having a predetermined size or more, such as the image display apparatus 100, data may be transmitted / received through a near field communication method based on a distance between an NFC module, at least a tag, and an antenna.

The mobile terminal 500 displays the object 920 representing the electronic device approaching within a predetermined distance and the object 910 representing the mobile terminal 500 on the display 570. (S820).

In this case, the electronic device approached by the portable terminal 500 may be switched to a ready state.

Thereafter, a drag input toward the object 920 representing the electronic device is received from the object 910 representing the mobile terminal (S830).

Thereafter, network information including access point (AP) information is transmitted to the electronic device (S840). The transmission of the network information may be performed by a near field communication method.

On the other hand, the network connection with the electronic device based on the network information (S850).

Here, in addition to being able to be networked to the mobile terminal and the electromagnetic period, if the mobile terminal is already connected to another electronic device and the network, the mobile terminal can also be connected to the network between the electronic device and the newly connected electronic device. That is, a plurality of electronic devices can be bundled into a small network.

In a wireless network, the user may have difficulty in initial setting of the wireless network because the user does not need to connect a cable like a wired network, but the user has to input identifier information or perform additional wireless security settings. have.

In addition, in order to connect a newly added electronic device in the wireless network to the same AP, there is an inconvenience that the user must directly set the security settings, such as SSID and encryption key corresponding to the AP.

According to the present invention, the wireless Internet settings of an electronic device such as a mobile terminal can be transmitted to other electronic devices with a simple NFC touch, so that the network settings of other electronic devices can be easily and quickly set.

Accordingly, by touching a device connected to the Internet, for example, a mobile terminal, to another device, wireless Internet setting and connection can be made as easily and intuitively as a wired connection.

It is possible to easily set up a wireless connection and share contents using network information of a mobile terminal at a time without prior knowledge of the wireless connection.

Compared to the network settings of the refrigerator, washing machine, and TV, the mobile terminal not only easily inputs network information but also has an AP function. Accordingly, by touching a TV, a refrigerator washing machine, or the like with a mobile terminal, the network information of the mobile terminal can be transmitted to the devices to automatically connect each device to the network.

Thereafter, at least one of the network-connected devices may use the Internet and content checking function using Wi-Fi Direct, WiFi, DLNA, and the like.

On the other hand, it is possible to intuitively present which electronic devices are connected by connecting through an object, for example, a line related to the connection between devices.

For example, as shown in FIG. 9B, the user connects and displays an object 930 representing a mobile terminal and an object 920 representing a cord by displaying an object 930 representing a cord. You can intuitively check the network connection status.

That is, FIG. 9B illustrates an example in which an object related to connection between devices is represented as a graphic object in the form of a cord.

Thus, it is possible to provide users with the intuitiveness and reliability of analog device connection behavior.

Meanwhile, the method of operating a mobile terminal according to an embodiment of the present invention further includes displaying an object related to the connection between devices, and the drag input indicates the electronic device after touching the object related to the connection between devices. It may be characterized in that the input is dragging to the object.

For example, as shown in (b) of FIG. 9, an object 930 related to device-to-device connection may provide an intuitive user interface for a drag input before the devices display a network connection state.

That is, as shown in FIG. 10, the portable terminal 1010 represents the portable terminal, the object 1020 representing the electronic device, and the object 1030 related to the connection between devices to be connected to or adjacent to the object 1010 representing the portable terminal. Can be displayed. In addition, the guide message 1040 may be further displayed, and when the network connection is completed, the guide message 1040 may be converted to a message indicating that the connection is completed, or a pop-up window may be displayed to inform the completion of the connection.

By touching the object 1030 related to the connection between devices and dragging the object 1020 representing the electronic device, the user can configure the network without proceeding with a separate AP information input procedure.

11 is a diagram illustrating a screen displaying state information of an electronic device connected to the network.

Referring to the drawing, a network manager screen may include devices 1110, 1120, and 1130 to be network connected and state information 1111, 1121, and 1131 of each device. In addition, network information may be further displayed, such as the wireless AP address 1150.

When the mobile terminal and the electronic device having the content are connected to the network, when the connection notification message is checked, the content may be immediately checked.

Alternatively, the method of operating a mobile terminal according to an embodiment of the present invention further includes displaying an item related to an electronic device connected to the network, or further including executing an application related to the electronic device. can do.

That is, when an item or an application related to the electronic device is executed automatically or by a user's selection, it may display the content or the items capable of controlling the electronic device.

On the other hand, if a login is required, the method may further include displaying an input window for inputting login information of the electronic device connected to the network.

Alternatively, the login information of the portable terminal may be transmitted to each electronic device through a near field communication method to log in.

12 is a flowchart illustrating a method of operating a portable terminal according to an embodiment of the present invention, and FIGS. 13 to 18 are diagrams for explaining various examples of the method of FIG. 12.

First, referring to FIG. 12, a portable terminal receives AP information of a first electronic device having an access point (AP) function (S1210). The AP information is transmitted by a near field communication method. Can be.

Referring to FIG. 14, a network connection command may be received by receiving a drag input from the first electronic device toward the portable terminal. Accordingly, the portable terminal can be networked with the first electronic device based on the AP information.

Thereafter, when the mobile terminal approaches the second electronic device different from the first electronic device within a predetermined distance (S1220), the portable terminal displays an object related to the display 570. (S1230)

In the object display step S1230, an object representing the second electronic device and an object representing the portable terminal may be displayed on the display 570.

When the user's drag input is received (S1240), the AP information received from the first electronic device is transmitted to another electronic device based on the drag input (S1250), and the network is connected (S1260).

Referring to FIG. 13, AP information of the NAS 400 is received and copied by touching a portable terminal to a first electronic device, a network storage device (NAS), which is already connected to the Internet.

Here, the NAS is connected to a network and may include one or more storage media.

Subsequently, when the portable terminal 500 is touched on the second electronic device or the image display apparatus 100 which is not connected to the network, as shown in FIG. 13C, the object representing the second electronic device and the portable terminal are connected. The indicated object may be displayed on the display 570. (S1230)

Here, as shown in FIG. 14, the display 570 may further display an object related to the connection between devices, and in the step of receiving a drag input (S1240), the drag input may touch the object related to the connection between devices, and then, the second object may be displayed. It may be an input dragging to an object representing an electronic device.

That is, the input for dragging an object related to the connection between devices may correspond to a command for network connecting the electronic device at the position where the drag input starts and the electronic device at the position where the drag input arrives.

Thereafter, the AP information copied to the portable terminal is transmitted to the second electronic device based on the received drag input (S1250). The AP information may be connected to the second electronic device network based on the AP information.

In addition, the portable terminal may be configured as a home network using the same AP as the first electronic device and the second electronic device.

According to the present invention, by touching a mobile terminal to a NAS or electronic device equipped with a wireless router, the AP of the wireless router is copied and transmitted to the mobile terminal in a short-range wireless communication scheme so that the wireless Internet of the mobile terminal is automatically set to the same AP. . Thereafter, the mobile terminal and the NAS or the touched device may be automatically connected.

When the mobile terminal approaches the electronic device within a predetermined distance or touches the electronic device, the touched electronic device is displayed on the screen, and the electronic device is switched to the ready state. When the user connects with the line provided through the UI, the AP information is transmitted, and the user can be connected to the same wireless network and automatically connected between devices.

Thereafter, as shown in FIG. 15, the status information of the second electronic device connected to the network may be displayed. For example, when the NAS is touched in the list of networked electronic devices, a login screen appears. You can see the contents inside.

In addition, when the portable terminal with wireless Internet is touched on the video display device or the remote control device, the AP information of the portable terminal is transmitted to the video display device so that the wireless Internet of the image display device is automatically set to the same AP, and the cellular phone and the mobile terminal are Can be automatically connected.

In this case, a connection notification pop-up is displayed on the image display device, and when the pop-up is checked, the content in the mobile terminal can be immediately checked, and the connected mobile terminal can be checked in the DLNA.

FIG. 15 is a diagram illustrating a screen displaying status information of electronic devices including a network-connected portable terminal.

Referring to FIG. 15A, objects 1510, 1520, 1530, and 1540 representing electronic devices connected to or connected to a network, and state information 1511, 1521, 1531, and 1541 of each electronic device are illustrated. Can be displayed.

Meanwhile, a menu or content related to the second electronic device connected to the network may be displayed.

Here, if there is an input for one of the objects 1510, 1520, 1530, 1540, or the state information 1511, 1521, 1531, 1541, a menu related to the corresponding electronic device and contents held by the electronic device may be displayed. Can be.

In addition, the software associated with the second electronic device connected to the network may be automatically downloaded, and the software itself may be transmitted to the second electronic device or information for downloading the software may be transmitted.

The electronic device that has received the download information such as software or URL information can install a program for content sharing and network management as shown in FIG. 15B, and can display information 1550 regarding the installation state.

In the case of touching a portable terminal with a wireless internet on the laptop, the AP information of the portable terminal is transmitted to the laptop, and the wireless internet of the laptop is automatically set to the same AP, and the portable terminal and other devices and notebooks connected to the portable terminal Can be connected automatically.

In addition, software required for the electromagnetic period connection (e.g., DMS setting software for DLNA, etc.) can be automatically downloaded and installed and set up, and the contents of the notebook can be checked or controlled directly from the portable terminal.

According to another exemplary embodiment of the present disclosure, in the object display step (S1230), an object representing the first electronic device and an object representing the second electronic device may be displayed on the display 570.

Thereafter, when the drag input toward the object representing the second electronic device is received from the object representing the first electronic device, the portable terminal transmits the AP information to the second electronic device.

That is, as in the embodiment described with reference to FIGS. 12 to 15, the mobile terminal and the second electronic device do not prioritize the network connection, but the present embodiment transmits the AP information for simple AP setting. The electronic device and the first electronic device may prioritize network connection.

The portable terminal may also be networked with the second electronic device based on the AP information. That is, the first and second electronic devices and the mobile terminal may form a network.

Meanwhile, the present embodiment may be applied together with some or all of the embodiments described with reference to FIGS. 12 to 15.

16 illustrates an example of a smart diagnosis screen capable of diagnosing and remotely controlling a state of the refrigerator 300, the TV 100, the cleaner, the air conditioner 700, and the washing machine 600 displayed on the portable terminal 500. To illustrate.

The smart diagnostic screen may be configured to touch or execute a corresponding application on a smart terminal such as a refrigerator 300, a TV 100, a cleaner, an air conditioner 700, a washing machine 600, an oven, a robot cleaner, etc. Can be displayed.

In addition, when an abnormality occurs in a home appliance, when the user touches the portable terminal, it may be directly connected to a diagnosis and service center, and when the household appliance has an error or a malfunction, fault information may be transmitted to the portable terminal and the server. have.

As shown in FIG. 16, the user may check the state information 1610 of the network-connected electronic devices through the portable terminal 500 regardless of the place.

In addition, when one of a plurality of items is selected, detailed information can be displayed.

For example, when the refrigerator 300 is selected, the refrigerator detailed temperature information may display a refrigerator compartment temperature information, a freezer compartment temperature information, an item management item, a device information, and a smart analysis (diagnosis) item.

In this way, while using the mobile terminal 500, while controlling the electronic device, the user's ease of use can be increased.

Meanwhile, when a failure state such as an operation stop or the failure state is included in the state information of the electronic device or when a failure state occurs, as illustrated in FIG. 17, a message 1710 indicating whether there is an error may be displayed.

In addition, when the agent connection menu included in the message 1710 is selected, a video call is automatically connected to the counselor, and quick action may be performed by transmitting the state information of the electronic device to the counselor. In the video call with the counselor, an image 1810 and data of the counselor side may be viewed, and an image 1820 of the user may be displayed. If necessary, the user can display an image of the electronic device or transmit the image to a counselor for more accurate diagnosis.

According to an embodiment of the present invention, by simply setting up a network of electronic devices using a portable terminal and configuring a home network, a user may manage and utilize contents and information more conveniently and in various ways.

On the other hand, the portable terminal can provide a variety of user interface, it can increase the user convenience.

The operation method of the mobile terminal and the image display apparatus according to the present invention is not limited to the configuration and method of the embodiments described as described above, but the embodiments are all of the embodiments so that various modifications can be made. Or some may be selectively combined.

On the other hand, the operating method of the portable terminal and the image display apparatus of the present invention can be embodied as processor readable codes on a processor-readable recording medium included in the portable terminal and the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet. . The processor-readable recording medium can also be distributed over network coupled computer systems so that the processor-readable code is stored and executed in a distributed fashion.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

Displaying an object representing the electronic device approaching the portable terminal within a predetermined distance and an object representing the portable terminal on a display;
Receiving a drag input from an object representing the mobile terminal toward an object representing the electronic device;
Transmitting network information to the electronic device; And
And connecting the network with the electronic device based on the network information. The method of claim 1,
The transmission of the network information is performed by a near field communication method. The method of claim 1,
The network information includes an access point (AP) information. The method of claim 1,
Displaying an object related to a connection between devices;
And the drag input is an input of touching an object related to the connection between devices and dragging the object to the object representing the electronic device. The method of claim 1,
And displaying status information of an electronic device connected to the network. The method of claim 1,
And displaying an item related to an electronic device connected to the network. The method of claim 1,
And displaying an input window for inputting login information of an electronic device connected to the network. The method of claim 1,
Executing an application related to the electronic device. Receiving AP information of a first electronic device having an access point (AP) function;
Approaching the second electronic device within a predetermined distance;
Displaying an object representing the second electronic device and an object representing the portable terminal on a display;
Receiving a drag input from an object representing the mobile terminal toward an object representing the second electronic device;
Transmitting the AP information to the second electronic device; And
Connecting to the second electronic device through a network based on the AP information. 10. The method of claim 9,
The transmission of the AP information is performed by a near field communication method. 10. The method of claim 9,
And connecting the network with the first electronic device based on the AP information. 10. The method of claim 9,
Displaying an object related to a connection between devices;
And the drag input is an input for touching an object related to the connection between devices and dragging the object to the object representing the second electronic device. 10. The method of claim 9,
Downloading software related to a second electronic device connected to the network. 10. The method of claim 9,
And displaying a menu or content related to a second electronic device connected to the network. Receiving AP information of a first electronic device having an access point (AP) function;
Approaching the second electronic device within a predetermined distance;
Displaying an object representing the first electronic device and an object representing the second electronic device on a display;
Receiving a drag input from an object representing the first electronic device to an object representing the second electronic device; And
Transmitting the AP information to the second electronic device. 16. The method of claim 15,
The transmission of the AP information is performed by a near field communication method. 16. The method of claim 15,
And connecting the network with the first electronic device based on the AP information. 16. The method of claim 15,
And connecting the network with the second electronic device based on the AP information. 16. The method of claim 15,
Displaying an object related to a connection between devices;
And the drag input is an input of touching an object related to the connection between devices and dragging the object to the object representing the second electronic device. 16. The method of claim 15,
And displaying status information of the first electronic device and the second electronic device.

Images