KR20120093744A - Method for transmitting and receiving data, display apparatus and mobile terminal thereof - Google Patents

Abstract

PURPOSE: A display apparatus using a data transmission and reception method and portable terminal thereof are provided to enable a user to control data transmission and reception between a display apparatus and a portable terminal by recognizing connection directions. CONSTITUTION: A portable terminal connects to a network for communication(S300). The portable terminal connects to a display apparatus(S310). The touch direction of the portable terminal is recognized(S320). The portable terminal transmits and receives data by connecting to the network(S330). The portable terminal converts transmission and reception functions by recognizing connection directions.

Description

Method for transmitting and receiving data, display apparatus and mobile terminal using the same method

The present invention relates to a method for transmitting and receiving data between a display device and a portable terminal.

A portable terminal is a portable device that is portable and has one or more functions for making voice and video calls, inputting and outputting information, and storing data.

As the functions of the mobile terminals are diversified, they are equipped with complex functions such as taking pictures or videos, playing music files or video files, playing games, receiving broadcasts, wireless Internet, and the like. It is implemented in the form.

An object of the present invention is to provide a user interface capable of efficiently controlling data communication between a display device and a portable terminal.

In accordance with another aspect of the present invention, a data transmission / reception method includes: transmitting and receiving data with a portable terminal in a display device connectable to a wireless network, and establishing a network connection for communication with the portable terminal; And recognizing a contact direction of the portable terminal when the portable terminal contacts the display device. And transmitting / receiving data with the portable terminal using the connected network, wherein the data transmitting / receiving step performs different data transmitting / receiving functions according to a contact direction of the recognized portable terminal.

In addition, the display device according to an embodiment of the present invention transmits and receives data to and from the portable terminal using a wireless network, the sensing unit for recognizing the contact of the portable terminal; A network interface unit for establishing a network connection for communication with the portable terminal and transmitting and receiving data to and from the portable terminal using the connected network when the portable terminal contacts the mobile terminal; And a control unit controlling the network interface unit to perform different data transmission / reception functions according to the direction in which the portable terminal is in contact.

According to an aspect of the present invention, there is provided a portable terminal including a storage unit for transmitting and receiving data to and from a display device using a wireless network and storing contents; A wireless communication unit configured to transmit / receive data with the display device when the front or rear surface of the portable terminal contacts the display device; And a control unit controlling the wireless communication unit to perform different data transmission / reception functions according to a direction in which the display device is in contact with the display device. When the front surface of the portable terminal contacts the screen unit of the display device, Data is transmitted to the display device through the wireless communication unit, and when the rear surface of the portable terminal contacts the screen unit, the data stored in the display device is received through the wireless communication unit.

On the other hand, the data transmission and reception method may be implemented as a computer-readable recording medium recording a program for execution in a computer.

In addition, a program for executing the data transmission / reception method may be stored and installed in the display device or the portable terminal.

According to an embodiment of the present invention, in transmitting and receiving data between the display apparatus and the portable terminal, the user is easily displayed by performing different data transmission / reception functions according to the direction in which the portable terminal contacts the screen of the display apparatus. It is possible to provide an intuitive user interface for controlling data transmission and reception between a device and a portable terminal.

1 is a block diagram showing the configuration of a data transmission and reception system.
2 is a block diagram illustrating a configuration of a display apparatus according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a portable terminal according to an embodiment of the present invention.
4 is a flowchart illustrating a data transmission / reception method according to an embodiment of the present invention.
5 is a diagram illustrating an embodiment of a front and rear shape of a portable terminal.
6 and 7 are diagrams for describing a data transmission / reception function performed when the portable terminal contacts the screen unit of the display device in a front direction.
8 and 9 are diagrams for describing a data transmission / reception function performed when the portable terminal contacts a screen unit of a display device in a rear direction.
10 to 16 illustrate embodiments of a method of transmitting content data stored in a portable terminal to a display device.
17 to 19 illustrate embodiments of a method of transmitting content data stored in a display device to a portable terminal.
20 is a diagram illustrating an embodiment of a method of selecting specific content stored in a display device using a portable terminal.
21 is a diagram illustrating an embodiment of a method of selecting a plurality of contents stored in a display apparatus using a portable terminal.
22 to 30 are diagrams illustrating a first embodiment of a configuration of a display apparatus and a portable terminal for performing a data transmission / reception method according to an embodiment of the present invention.
31 to 34 are views illustrating a second embodiment of a configuration of a display apparatus and a portable terminal for performing a data transmission / reception method according to an embodiment of the present invention.
35 to 41 are diagrams illustrating a third embodiment of a configuration of a display apparatus and a portable terminal for performing a data transmission / reception method according to an embodiment of the present invention.

Hereinafter, a method of transmitting and receiving data, a display apparatus using the same, and a portable terminal according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a configuration of a data transmission / reception system according to an exemplary embodiment of the present invention. The illustrated transmission / reception system may include a display apparatus 100 and a portable terminal 200.

Referring to FIG. 1, the display apparatus 100 may be an image display device such as a TV, a monitor, a notebook computer, a tablet PC, or the like, which may be connected to the portable terminal 200 using a wireless network.

For example, the display apparatus 100 may be a network TV, an Internet Protocol TV (IPTV), or a HBBTV (HBBTV) capable of performing various user-friendly functions as various applications can be freely added or deleted on a general-purpose OS kernel. Broadcast Broadband TV) or smart TV.

On the other hand, the portable terminal 200 is a device that can be connected to the display device 100 using a wireless network to transmit and receive data, and has a small screen portion compared to the display device 100 to carry and move freely in terms of size and weight This may be a possible device.

For example, the mobile terminal 200 may be a mobile phone, a smart phone, a tablet PC, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), an internet phone such as SoIP, navigation, etc. Alternatively, the present invention may be various devices capable of outputting video or audio such as an MP3 player.

The display apparatus 100 and the portable terminal 200 may include a wireless LAN (WiFi), a WiFi direct, a WiFi display, a Bluetooth, a ZigBee, a binary CDMA (binary code division multiple access), a Wibro (Wireless broadband), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), Universal Plug and Play (UPnP) / Digital Living Network Alliance (DLBNA), Ultra wide band (UWB) / Wireless Universal Serial Bus (USB), etc. It can be connected using various wireless communication methods, such as sending and receiving data.

The display apparatus 100 and the portable terminal 200 may share contents by transmitting and receiving data stored in each, using the wireless communication scheme as described above.

The content may be in various forms such as real time broadcasting, movies, music, photos, document files, contents on demand, games, news, video telephony, applications, and the like.

Since the communication method between the display apparatus 100 and the portable terminal 200 for content sharing as described above may use various wireless networks capable of data communication, the communication method is not limited to a specific communication method.

According to an exemplary embodiment of the present invention, when the portable terminal 200 contacts the display apparatus 100, data transmission and reception between the display apparatus 100 and the portable terminal 200 may be performed to share content.

For example, when the user moves the portable terminal 200 toward the display apparatus 100 and physically contacts a portion of the portable terminal 200 to the screen portion of the display apparatus 100, the display apparatus 100 is connected to the display apparatus 100. As the contact between the portable terminals 200 is recognized, content data stored in the display apparatus 100 or the portable terminal 200 may be transmitted to the counterpart device.

Hereinafter, exemplary embodiments of the display apparatus 100 and the portable terminal 200 will be described with reference to FIGS. 2 and 3.

Referring to FIG. 2, the display apparatus 100 includes a signal input and processing unit 110, a network interface unit 120, an external device interface unit 130, an A / V input unit 140, a sensing unit 150, and a controller. 160, a storage unit 170, a display unit 180, an audio output unit 185, and a user interface unit 190 may be included.

The signal input and processing unit 18 receives and processes a signal from the outside and, for example, receives an RF broadcast signal corresponding to a channel selected by a user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through an antenna. You can choose to receive it.

Meanwhile, the network interface unit 120 may provide an interface for connecting the display apparatus 100 to a wired / wireless network, and may transmit / receive data with an external device using various wireless communication methods as described with reference to FIG. 1. Can be.

For example, the network interface unit 120 establishes a wireless network connection with the portable terminal 200 according to a communication standard such as WiFi or Bluetooth, and portable contents data and information for data communication using the connected network. It can transmit and receive with the terminal 200.

In addition, the network interface unit 120 may include an Ethernet terminal for connecting to the Internet, and accesses a web page using the movie, advertisement, game, VOD, and the like provided from a specific content provider or a network provider. Content such as a broadcast signal can be received.

The external device interface unit 130 may connect the external device and the display unit 180 to each other, for example, a DVD (Digital Versatile Disk), Blu-ray (Blu ray), a game device, a camera, a camcorder, a computer (laptop). It may be connected to an external device such as wired or wireless.

The A / V input unit 140 may input a video and audio signal of an external device to the display unit 180, such as a USB terminal, a Composite Video Banking Sync (CVBS) terminal, a component terminal, an S-video terminal (analog), It may include a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

Meanwhile, the A / V input unit 140 may acquire data corresponding to the video or audio of the user, including a camera or a microphone, and the obtained data may be transferred to the controller 160.

The sensing unit 150 uses various sensors such as a touch sensor, a magnetic field sensor, an acceleration sensor, a gyro sensor, a proximity sensor, an ambient light sensor, a colorimeter, or a tag to detect the current state of the display device 100. It can be provided.

For example, the controller 160 detects a contact of the portable terminal 200 for data transmission or reception using a measurement value of a sensor provided in the sensing unit 150, or a position or direction in which the portable terminal 200 is contacted. Etc. can be recognized.

The controller 160 controls the operation of the display apparatus 100 as a whole, and demultiplexes the data stream input through the signal input and processing unit 110, the network interface unit 120, or the external device interface unit 130, The demultiplexed signals may be processed to generate and output a signal for video or audio output.

The storage unit 170 may store a program for processing and controlling each signal in the controller 160, and may store a signal-processed video, audio, or data signal.

In addition, the storage unit 170 performs a function for temporarily storing an image, audio, or data signal input from the external device interface unit 130 or the network interface unit 120, or a predetermined broadcasting channel through a channel storage function. You can also store information about.

The storage unit 170 may store an application or an application list input from the external device interface unit 130 or the network interface unit 120.

The storage unit 170 may be, for example, a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory). Etc.), RAM, and ROM (EEPROM, etc.) may include at least one type of storage medium.

The display apparatus 100 may reproduce and provide content data (eg, a video file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 170 to the user.

The user interface 190 transmits a signal input by the user to the controller 160 or transmits a signal input from the controller 160 to the user.

For example, the user interface 190 may include Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Digital Living Network Alliance. ) Receives and processes a user input signal or control signal such as power on / off, channel selection, and screen setting from the remote controller 195 according to various communication methods such as a communication method, or remotely controls a control signal from the controller 160. Processing to transmit to the controller 195.

The controller 160 may control the display unit 180 to display an image, for example, a broadcast image input through the signal input and processing unit 110 and input through the external device interface unit 130. An external input image, an image input through the network interface unit 120, or an image stored in the storage unit 170 may be displayed on the display unit 180. In this case, the image displayed on the display unit 180 may be a still image or a video, and may be a 2D image or a 3D image.

The display unit 180 may form a screen unit exposed on the front surface of the display apparatus 100 to display an image as described above.

The display unit 180 converts an image signal, a data signal, an OSD signal processed by the controller 160, or an image signal, data signal, etc. received from the external device interface unit 130 into R, G, and B signals, respectively. Generate a signal.

The display unit 180 may display an image using various display methods such as a PDP, an LCD, an OLED, a flexible display, a 3D display, and the like. The display unit 180 may be configured as a touch screen and used as an input device in addition to the output device.

Meanwhile, the audio output unit 185 receives a signal processed by the controller 160, for example, a stereo signal, a 3.1 channel signal, or a 5.1 channel signal, and outputs the voice.

In the above, an embodiment of a configuration of a display apparatus according to an exemplary embodiment of the present invention has been described with reference to FIG. 2. However, the present invention is not limited thereto, and the components shown in FIG. Can be integrated, added or omitted.

3 is a block diagram showing the configuration of a portable terminal according to an embodiment of the present invention, the portable terminal 200 is a wireless communication unit 210, A / V input unit 220, the user input unit 230, The sensing unit 240, an output unit 250, a memory 260, an interface unit 270, a control unit 280, and a power supply unit 290 may be included.

Referring to FIG. 3, the wireless communication unit 210 may include components for wireless communication between the mobile terminal 200 and a wireless communication system or wireless communication between the mobile terminal 200 and a network in which the mobile terminal 200 is located. have.

The wireless communication unit 210 may include a broadcast receiving module 211, a mobile communication module 212, a wireless internet module 213, a short range communication module 214, a location information module 215, and the like.

According to an embodiment of the present invention, the wireless communication unit 210 may transmit and receive data with an external device using various wireless communication methods as described with reference to FIG. 1.

For example, the wireless communication unit 210 establishes a wireless network connection with the display apparatus 100 according to a communication standard such as WiFi or Bluetooth, and displays content data and information for data communication using the connected network. Can transmit and receive with (100).

The broadcast receiving module 211 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel.

The mobile communication module 212 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless internet module 213 refers to a module for wireless internet access, and the wireless internet module 213 may be internal or external.

The short range communication module 214 may be a module for short range communication, and may use Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, or the like.

In addition, the location information module 215 is a module for checking or obtaining the location of the portable terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites.

The A / V input unit 220 is for inputting an audio signal or a video signal, and may include a camera 221 and a microphone 222. The camera 221 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 251.

The image frame processed by the camera 221 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 210. Two or more cameras 221 may be provided according to the configuration aspect of the terminal.

The microphone 222 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data.

The user input unit 230 generates input data for the user to control the operation of the terminal, and for this purpose, a keypad, a dome switch, a touch screen (static pressure / capacitance), a jog wheel, a jog switch, and the like. Can be configured.

The sensing unit 240 uses various sensors such as a touch sensor, a magnetic field sensor, an acceleration sensor, a gyro sensor, a proximity sensor, an ambient light sensor, a colorimeter, or a tag to detect the current state of the portable terminal 200. It can be provided.

For example, the sensing unit 240 may detect a contact with the display apparatus 100 or recognize a position or a direction in which the portable terminal 200 is contacted using the sensor as described above.

The interface unit 270 serves as an interface with all external devices connected to the portable terminal 200. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

In addition, the output unit 250 is for outputting an audio signal or a video signal, and may include a display unit 251, a sound output module 252, an alarm unit 253, and the like.

The display unit 251 displays and outputs information processed by the portable terminal 200. For example, when the mobile terminal is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to a call is displayed, and when a video call mode or a shooting mode is displayed, a recorded or / and received image, a UI, or a GUI is displayed. can do.

The sound output module 252 outputs audio data received from the wireless communication unit 210 or stored in the memory 260 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like.

The memory 260 may store a program for processing and controlling the controller 280, and input / output content data (eg, a video file, a still image file, a music file, a document file, an application file, etc.). You can also perform a function for temporary storage of).

The controller 280 typically controls the overall operation of the portable terminal. For example, voice communication, data communication, video communication, and the like. In addition, the controller 280 may include a multimedia module 281 for reproducing multimedia content. The multimedia module 281 may be implemented in the control unit 280 or may be implemented separately from the control unit 280.

The power supply unit 290 receives external power and internal power under the control of the controller 280 and supplies power required for operation of the respective components.

3 illustrates a portable terminal including various components, but not all illustrated components are essential components. That is, the portable terminal may be implemented by more components than those illustrated in FIG. 3, and at least one of the illustrated components may be omitted.

According to an embodiment of the present invention, the display device 100 and the portable terminal 200 having the configuration as described with reference to FIGS. 1 to 3, the portable terminal 200 is in contact with the display device 100. In this case, the portable terminal 200 may perform different data transmission / reception functions according to the contact direction.

For example, the user may contact one of the front, rear, and side surfaces of the portable terminal 200 to request content sharing with the display apparatus 100 by contacting the front screen of the display apparatus 100. Data transmission and reception function performed between the 100 and the portable terminal 200 may be different according to the contact direction (for example, any one of the front, rear and side) of the portable terminal 200.

4 is a flowchart illustrating a data transmission and reception method according to an embodiment of the present invention, and illustrates a method of controlling data transmission and reception with the portable terminal 200 in the display apparatus 100.

Referring to FIG. 4, the display apparatus 100 establishes a network connection with the portable terminal 200 (S300).

For example, the network interface unit 120 of the display apparatus 100 is portable according to a corresponding communication standard for data communication with the portable terminal 200 using a wireless communication scheme such as WiFi, Bluetooth, UPnP / DLBNA, UWB, or the like. It is possible to send and receive information for network setting with the terminal 200 and to connect a wireless network using the transmitted and received network setting information.

The network setting information transmitted and received between the display apparatus 100 and the portable terminal 200 for the network connection may include identification information (ID), identification information (ID), security information (password), etc. of each device. It may include.

Meanwhile, a program (for example, a content sharing application) for executing a data transmission / reception method according to an embodiment of the present invention may be preinstalled in each of the display apparatus 100 and the portable terminal 200.

Before the step S300, in order to share content between the display apparatus 100 and the portable terminal 200, a step of registering the portable terminal 200 to the display apparatus 100 may be performed, and the portable terminal 200 may also be performed. When authenticating the network connection, the step of authenticating the portable terminal 200 using the registration information may be further performed.

According to an embodiment of the present invention, in the state that the wireless communication function such as WiFi or Bluetooth is activated (on) in the display device 100 and the portable terminal 200, the content is installed in the portable terminal 200 When the application is executed, the display apparatus 100 and the portable terminal 200 may each search for each other and establish a network connection.

To this end, the portable terminal 200 may store a service set identifier (SSID) and encryption keys (encryption keys) for a WiFi network connected to the display apparatus 100.

After the network connection is established, when the portable terminal 200 contacts the screen of the display apparatus 100 (step S310), the display apparatus 100 recognizes the contact direction of the portable terminal 200 (step S320). .

The screen unit of the display apparatus 100 may refer to a portion in which an image is displayed on the front of the display apparatus 100 when viewed from the user side.

For example, the display unit 180 of the display apparatus 100 includes a display panel (not shown) for displaying an image and a backlight unit (not shown) provided at the rear of the display panel to provide light to the display panel. In this case, the screen unit to which the portable terminal 200 is in contact may represent the front of the display panel.

On the other hand, when a functional layer such as an optical sheet or a touch panel is formed on the front of the display panel, the screen portion to which the portable terminal 200 is in contact may represent a functional layer formed on the front of the display panel. Can be.

In addition, contact of the portable terminal 200 with the screen unit of the display apparatus 100 indicates that the portable terminal 200 is in physical contact with the screen unit. Alternatively, the portable terminal 200 may include a case in which the portable terminal 200 is very close to the screen unit within a distance in which the contact may be recognized.

According to one embodiment of the invention, the display unit 180 of the display device 100 may be implemented as a touch screen, the touch screen is disposed on the front of the display panel object such as a user's finger It can detect the contact of.

The touch panel detects the contact position of the object, converts the contact position into an electrical signal, and outputs the electrical signal. The display apparatus 100 may be driven to perform a function corresponding to the contact position according to the electrical signal. have.

Meanwhile, the touch panel may include a plurality of touch sensors to detect the contact and the contact position of the object, and the touch sensors may sense a touch by using a resistive film method, a light sensing method, or a capacitive method. Can be.

For example, the capacitive touch panel senses a change in capacitance formed by a conductive sensing pattern with another sensing pattern or a ground electrode when a human finger or an object comes in contact with each other, thereby converting the contact position into an electrical signal. I can convert it.

In this case, the display apparatus 100 may detect a contact and a contact position of the portable terminal 200 by using the touch panel provided in the display unit 180.

The sensing unit 150 of the display apparatus 100 may recognize a contact direction of the portable terminal 200 using sensors such as a magnetic field sensor, an acceleration sensor, a gyro sensor, a proximity sensor, an ambient light sensor, and a colorimeter.

For example, the user may contact any one of the front, rear, and side surfaces of the mobile terminal 200 with the screen of the display apparatus 100. When the user touches the sensing unit 150, the mobile terminal 200 may face the front side. It can recognize whether the contact has been made in which direction, the rear side and the side.

Meanwhile, the controller 160 of the display apparatus 100 may determine the contact direction of the portable terminal 200 by using the sensing value output from the sensing unit 150. The sensing unit may be used to determine the contact direction. Information received from the portable terminal 200 may be used together with the sensing value of 150. The information received from the portable terminal 200 may be a sensing value measured by the sensing unit 240 of the portable terminal 200.

Alternatively, the contact direction of the portable terminal 200 may be recognized by the sensing unit 240 or the control unit 280 of the portable terminal 200, in which case the portable terminal 200 is connected to the portable terminal 200 using the network connected in step S300. Information about a contact direction of the terminal 200 may be received by the display apparatus 100.

Thereafter, the display apparatus 100 transmits and receives data to and from the portable terminal 200 according to the recognized contact direction of the portable terminal 200 (step S330).

Specifically, the data transmission / reception function performed in step S300 may be different according to the contact direction of the portable terminal 200 recognized in step S320, and thus the user may display the display by changing the contact direction of the portable terminal 200. A desired data transmission / reception function may be performed between the device 100 and the portable terminal 200.

For example, one of the first data transmission / reception function and the second data transmission / reception function set in advance according to whether the contact direction of the portable terminal 200 is the front side or the rear side may be the display device 100 and the portable terminal. May be performed between 200.

According to an embodiment of the present invention, when the first surface of the portable terminal 200 contacts the screen of the display apparatus 100, data transmission from the portable terminal 200 to the display apparatus 100 may be performed. .

On the contrary, when the second surface of the portable terminal 200 contacts the screen of the display apparatus 100, data transmission from the display apparatus 100 to the portable terminal 200 may be performed.

For example, the first surface may be a front surface of the portable terminal 200, and the second surface may be a rear surface of the portable terminal 200.

Hereinafter, a data transmission / reception method according to an embodiment of the present invention will be described taking the case where the first surface is the front surface of the portable terminal 200 and the second surface is the rear surface of the portable terminal 200. The first side may be the rear side of the portable terminal 200 and the second side may be the front side of the portable terminal 200, and any one of the first and second sides may be the front side of the portable terminal 200. It may also be a side.

That is, when the rear surface of the portable terminal 200 contacts the screen portion of the display apparatus 100, data is transmitted from the portable terminal 200 to the display apparatus 100, and the front surface of the portable terminal 200 is the display apparatus ( When contacted with the screen of the screen 100, data from the display apparatus 100 to the portable terminal 200 may be transmitted.

As shown in FIGS. 5A and 5B, the front surface 200F of the portable terminal 200 includes a display unit 251 displaying an image, for example, a picture C1, and a rear surface 200R. ) May be covered with a case.

Referring to FIG. 6, a user moves the front surface 200F of the mobile terminal 200 toward the display apparatus 100 so that the front surface 200F of the mobile terminal 200 moves to the screen unit 181 of the display apparatus 100. ) Can be contacted.

In this case, data stored in the portable terminal 200 may be transmitted to the display apparatus 100 using the connected network, and the data transmitted to the display apparatus 100 may be content selected by the user in the portable terminal 200. It may include.

Referring to FIG. 7, in a state where the picture C1 is displayed on the portable terminal 200, the user contacts the front surface 200F of the portable terminal 200 to the screen unit 181 of the display apparatus 100. When released, the data including the picture C1 may be transmitted from the portable terminal 200 to the display apparatus 100.

In addition, the picture (C1) data transmitted to the display device 100 may be output by the display unit 180, the area of the screen unit 181 corresponding to the position where the portable terminal 200 is in contact with the Photo C1 may be displayed.

 Referring to FIG. 8, a user moves the rear surface 200R of the portable terminal 200 toward the display apparatus 100 to move the rear surface 200R of the portable terminal 200 to the screen unit 181 of the display apparatus 100. ) Can be contacted.

In this case, data stored in the display apparatus 100 may be transmitted to the portable terminal 200 using the connected network, and the data transmitted to the portable terminal 200 may be one of contents stored in the display apparatus 100. It may include content selected by the user.

Referring to FIG. 9, when the user contacts the rear surface 200R of the portable terminal 200 with the screen unit 181 of the display apparatus 100 and then releases it, the user may include a photo C2 stored in the display apparatus 100. Data may be transmitted from the display apparatus 100 to the portable terminal 200.

In addition, the picture C2 data transmitted to the portable terminal 200 may be output by the display unit 251 and displayed on the screen of the portable terminal 200.

In this case, the data transmitted from the display apparatus 100 to the portable terminal 200 may include content displayed at a position where the portable terminal 200 is in contact with the screen unit 181 of the display apparatus 100.

In the above, the data transmission and reception method according to an embodiment of the present invention has been described with reference to FIG. 5 to FIG. 9 as an example of sharing a picture between the display apparatus 100 and the portable terminal 200. The present invention is not limited thereto, and various contents such as video, music, application, contact information, video streaming service, video call, game, news, and the like, in addition to the above picture may be displayed using the display device 100 and the portable terminal 200 by using an embodiment of the present invention. Can be shared between.

Hereinafter, embodiments of a data transmission / reception method according to the present invention will be described in detail with reference to FIGS. 10 to 21.

Referring to FIG. 10, when a user contacts the front surface 200F of the mobile terminal 200 on which the picture C1 is displayed on the screen, the screen unit 181 of the display apparatus 100 may be touched. Data including the picture C1 may be transmitted from the display device 100 to the display device 100 so that the picture C1 may be displayed in an area corresponding to the contact position on the screen unit 181 of the display device 100. .

On the other hand, as shown in (b) of Figure 10, when the portable terminal 200 is in contact, the picture (C1) is larger than the size displayed on the portable terminal 200 on the screen of the display device 100 May be displayed. To this end, the portable terminal 200 may enlarge the picture C1 at a predetermined ratio and transmit it to the display apparatus 100.

In addition, the data transmission state from the portable terminal 200 to the display apparatus 100 (for example, the ratio of the data currently transmitted in the entire picture C1 data) is displayed using the progressive bar. ) May be displayed on the screen.

As shown in FIG. 10C, when the user detaches the portable terminal 200 from the screen unit 181 of the display apparatus 100 and the contact of the portable terminal 200 is released, the enlarged picture ( C1) may be reduced and displayed on the screen of the display apparatus 100 in the form of a thumbnail icon.

Thereafter, when the user selects a thumbnail icon of the picture C1 displayed on the screen of the display apparatus 100, the picture C1 may be enlarged and displayed on the original size or the entire screen.

Referring to FIG. 11, the front surface 200F of the portable terminal 200 is displayed on the screen unit 181 of the display apparatus 100 while the user pauses the video C3 being played on the portable terminal 200. In the case of contacting, data including the video C3 is transmitted from the portable terminal 200 to the display apparatus 100, and the data corresponding to the contact position of the screen unit 181 of the display apparatus 100 is transmitted to the display apparatus 100. An image of one frame of the video C3 may be displayed in the form of a thumbnail icon C3 '.

Meanwhile, the transmission progress state of the video (C3) data from the portable terminal 200 may be displayed on the screen of the display apparatus 100 using the progressive bar.

Thereafter, as shown in FIG. 11C, when the user touches and selects a thumbnail icon C3 'of the video C3 displayed on the screen with a finger H, the thumbnail icon C3' is selected. The video C3 transmitted to the size of the preview and transmitted from the portable terminal 200 may be played on the display apparatus 100.

In addition, the video C3 played back on the display apparatus 100 may be played back from a point in time before being played back on the portable terminal 200 when the display apparatus 100 contacts the display apparatus 100.

For example, when the user selects the thumbnail icon C3 ', the video C3 received from the portable terminal 200 is displayed after returning to 3 seconds before the pause time shown in FIG. Playback may be performed through the screen unit 181 of the device 100.

Meanwhile, the video C3 being played on the portable terminal 200 may be an image provided through a video streaming service. In this case, the portable terminal 200 may log in for the video streaming service. For example, display user ID and password, location information (e.g., URL of streaming server) and playback time information (e.g., elapsed time or seek location of video streaming) May transmit to the device 100.

For example, when the user is in contact with the screen unit 181 of the display apparatus 100 when the front surface 200F of the portable terminal 200 is provided with a video streaming service through the portable terminal 200, the video is displayed. Information about the user ID and password of the streaming service, the URL of the streaming server, the elapsed playing time, and the search position is transmitted from the portable terminal 200 to the display apparatus 100, and the portable terminal 200 logs from the video streaming service. It can be logged off.

Meanwhile, the display apparatus 100 may log in to the service using the received user ID and password after accessing the streaming server using the URL received from the portable terminal 200.

Thereafter, the display apparatus 100 searches for an image provided from the portable terminal 200 using the received search position, and continuously provides the searched video streaming service from a time corresponding to the received elapsed playing time. can do.

Referring to FIG. 12, when a user contacts the front surface 200F of the portable terminal 200 where music C4 is being played on the screen unit 181 of the display apparatus 100, the display is displayed from the portable terminal 200. Data including the music C4 is transmitted to the device 100 so that the music played on the portable terminal 200 may be continuously played on the display device 100.

Meanwhile, as illustrated in FIG. 12C, when the user detaches the portable terminal 200 from the screen unit 181 of the display apparatus 100 and the contact of the portable terminal 200 is released, the display apparatus 100 is released. Is displayed on the screen of the display device 100 in the form of a thumbnail icon, and together with the information about the music C4 (for example, a title or file name of the music) ) May be displayed.

According to another exemplary embodiment of the present invention, an application executed in the portable terminal 200 is executed by contacting the front surface 200F of the portable terminal 200 with the screen unit 181 of the display apparatus 100. ) Can be executed continuously.

Referring to FIG. 13, in a state where a messenger application C5 is being executed in the portable terminal 200, the user displays the front surface 200F of the portable terminal 200 on the screen unit of the display apparatus 100 ( 181), login information (e.g., user ID and password) for the messenger service and message information (e.g., chat session data for messages sent and received so far). May be transmitted to the display apparatus 100.

For example, upon contact of the portable terminal 200, the user ID and password of the messenger application service executed in the portable terminal 200, chat session data are transmitted to the display apparatus 100, and the portable terminal 200 is transmitted. May be logged off from the messenger application service.

Meanwhile, the display apparatus 100 may log in to a service using a user ID and password received from the portable terminal 200 after executing a messenger application installed therein.

Referring to FIGS. 13C and 13D, the display apparatus 100 displays messages transmitted and received through the portable terminal 200 on the screen by using the received chat session data, and displays the portable terminal 200. The messenger application C5 that was executed in the server can be continuously executed.

Referring to FIG. 14, when a user touches the front surface 200F of the mobile terminal 200 in which contact information C6 of a specific person is displayed on the screen, the mobile terminal 200 touches the screen unit 181 of the display apparatus 100. Data including the contact information C6 is transmitted from the 200 to the display apparatus 100 so that the contact information C6 is located in an area corresponding to the contact location on the screen unit 181 of the display apparatus 100. May be displayed.

On the other hand, when the portable terminal 200 touches a location where specific content is displayed on the screen of the display apparatus 100, contact information displayed on the portable terminal 200 is transmitted to the display apparatus 100 so that the portable terminal ( The content may be displayed in association with the content displayed on the contact location of the 200.

Referring to FIG. 14B, the user contacts the front surface 200F of the portable terminal 200 to a position where the picture C2 is displayed on the screen unit 181 of the display apparatus 100, thereby displaying the portable terminal 200. The contact information C6 displayed on) may be mapped to the photo C2 stored in the display apparatus 100.

Meanwhile, as shown in FIG. 14C, contact information mapped to the picture C2 is iconized for each item and displayed on the screen of the display apparatus 100 so as to be adjacent to the picture C2. Can be.

For example, the mobile phone number of the contact information C6 displayed on the portable terminal 200 is indicated by the first icon C6a, the email address is indicated by the second icon C6b, and SNS (Social Network Servie) The user ID of may be represented by a second icon C6c.

The user may simultaneously check a specific person's picture and contact information by using the contact icons C6a, C6b, and C6c mapped and displayed on the picture C2, and any one of the icons C6a, C6b, and C6c. Select to access the contact corresponding to the item.

Referring to FIGS. 15A and 15B, a user drags a picture C1 (or a thumbnail icon representing the picture) displayed on the display apparatus 100 to map an email icon mapped to the picture C2. It may drop in the area marked (C6b).

In this case, as shown in FIG. 15C, data including the dragged picture C1 may be transmitted to an email address (ie ab@x.com) corresponding to the email icon C6b. have.

Since the method of displaying contact information illustrated in FIG. 15 is only an embodiment of the present disclosure, the present disclosure is not limited thereto and may be mapped to content stored in the display apparatus 100 and displayed in various forms.

Referring to FIG. 16, as described above, contact information received from the portable terminal 200 may be arranged in a circle shape around a picture C2, and the contact icons arranged in the circle may be mobile phone numbers, respectively. It may correspond to an email address, a video call service ID, SNS service IDs, messenger service IDs, and the like.

On the other hand, when a certain time elapses from when the contact of the portable terminal 200 is released or when the user taps the desktop screen of the display apparatus 100, the circular contact as shown in FIG. The icons may disappear.

When the user selects the picture C2 displayed on the display device 100, the disappeared circular contact icons may again appear on the screen of the display device 100.

In addition, when the user requests zoom-in for the photo C2 displayed on the display device 100, the photo C2 and contact information mapped thereto are enlarged and displayed as a widget in the form of a business card. It may be displayed on the screen of the device 100.

Referring to FIGS. 16B and 16C, an area in which an e-mail icon C6d disposed around the picture C2 is displayed by dragging a picture C1 displayed on the screen of the display apparatus 100. In this case, the option menu corresponding to the email icon C6d is enlarged and displayed, and the data including the dragged picture C1 may be transmitted to the "ab@x.com" email address.

17 to 19 illustrate embodiments of a method of transmitting content data stored in the display apparatus 100 to the portable terminal 200.

Referring to FIG. 17, a plurality of images may be displayed on the screen unit 181 of the display apparatus 100, and the plurality of images may correspond to contents stored in the display apparatus 100, respectively.

The user selects one or more contents to be transmitted to the portable terminal 200 among the contents stored in the display apparatus 100, and then displays the rear surface 200R of the portable terminal 200 on the screen unit 181 of the display apparatus 100. ), The selected content may be transmitted from the display apparatus 100 to the portable terminal 200.

According to an embodiment of the present invention, the display apparatus 100 recognizes a position where the rear surface 200R of the portable terminal 200 is in contact with, and then portables data including content displayed at the recognized contact position. It may be transmitted to the terminal 200.

Referring to FIGS. 17B and 17C, the user places the rear surface 200R of the portable terminal 200 at a position where a picture C2 is displayed among the images displayed on the screen of the display apparatus 100. In the case of contact, data including the photo C2 may be transmitted from the display apparatus 100 to the portable terminal 200 so that the photo C2 may be displayed on the screen of the portable terminal 200.

According to another exemplary embodiment of the present invention, when the rear surface 200R of the portable terminal 200 contacts the screen unit 181, the display apparatus 100 displays the content pre-selected by the user in the portable terminal 200. Can be sent to.

Referring to FIG. 18, after a user selects a thumbnail icon representing music C4 among images displayed on the screen of the display apparatus 100, the user may move the rear surface 200R of the portable terminal 200 to the rear surface 200R of the display apparatus 100. When contacting the screen unit 181, the music (C4) data corresponding to the selected thumbnail icon may be transmitted to the portable terminal 200.

Referring to FIG. 18B, when the rear surface 200R of the portable terminal 200 contacts the screen unit 181 of the display apparatus 100, thumbnails of music C4 previously selected by the user are displayed. The icon may be moved to the contact position of the portable terminal 200, and the music (C4) data may be transmitted from the display apparatus 100 to the portable terminal 200.

When the transmission of the music C4 data is completed, as illustrated in FIG. 18C, the music c4 may be continuously played in the portable terminal 200.

In addition, as illustrated in FIG. 19, the user may select two or more contents displayed on the screen of the display apparatus 100 and transmit them to the portable terminal 200.

For example, the user selects the picture C1, the picture C2, and the music C4 displayed on the screen of the display apparatus 100 using three fingers, and then displays the rear surface 200R of the portable terminal 200. When contacting the screen unit 181 of the device 100, thumbnail icons corresponding to the selected content is moved to the contact position of the portable terminal 200, the photo (C1), photo (C2) and music (C4) Data including the data may be transmitted to the portable terminal 200.

Meanwhile, the display apparatus 100 may recognize a position where the rear surface 200R of the portable terminal 200 contacts, and then transmit the content moved to the recognized contact position to the portable terminal 200.

For example, the user contacts the rear surface 200R of the portable terminal 200 to the screen unit 181 of the display apparatus 100, and then selects an image corresponding to the content to be transmitted, thereby selecting the portable terminal 200. By dragging to a contacted position, the corresponding content data can be controlled to be transmitted to the portable terminal 200.

According to an embodiment of the present invention, when the side of the portable terminal 200 contacts the screen unit 181 of the display apparatus 100, the content corresponding to the contact position of the portable terminal 200 may be selected. have.

20 and 21 illustrate embodiments of a method of selecting specific content stored in the display apparatus 100 using the portable terminal 200.

Referring to FIG. 20, the user may move the portable terminal 200 toward the display apparatus 100 in an oblique direction rather than the front or rear side so that the side of the portable terminal 200 contacts the screen unit 181. .

In this case, among the contents displayed on the screen of the display apparatus 100, the content corresponding to the position where the side surface of the portable terminal 200 is in contact may be selected by the user.

For example, when the user touches a side of the portable terminal 200 within an area where a photo (C2) thumbnail icon is displayed on the screen unit 181 of the display apparatus 100, the content of the contents stored in the display apparatus 100 may be changed. Photo C2 may be selected.

Referring to FIG. 21, after a user contacts the side of the portable terminal 200 to a specific point P of the screen unit 181 of the display apparatus 100, the user contacts the screen unit 181 with the portable terminal 200. When the side surface of the terminal 200 is moved to form a curve, contents (eg, the picture C1 and the picture C2) located in the formed curve may be selected.

Hereinafter, a first embodiment of a configuration of a display apparatus and a portable terminal for performing a data transmission / reception method according to an embodiment of the present invention will be described with reference to FIGS. 22 to 30.

The display apparatus 100 according to the first embodiment of the present invention may be configured to include a touch screen, and the touch screen may recognize whether the portable terminal 200 is in contact with the touch screen.

According to an embodiment of the present invention, before performing the data transmission and reception method as described with reference to FIGS. 4 through 21, the registration and authentication process for the portable terminal 200 may be performed.

For example, the registration process is a step of allowing the content sharing with the display apparatus 100 by storing identification information of the portable terminal 200 on the display apparatus 100, and the authentication process is performed by the display apparatus for content sharing. It is a step of checking whether the corresponding device is registered with respect to the portable terminal 200 approaching 100.

Referring to FIG. 22, the display apparatus 100 includes an FM transmitter 300, and the FM transmitter 300 may transmit an FM signal including registration information using an FM frequency band.

For example, the FM transmitter 300 scans the FM frequency bands and uses a radio frequency data (RDS) signal that includes identification information (network ID) and password for the wireless network through the FM frequency band which is not currently being used. Can be sent out in a carousel manner.

The RDS signal has identification information for identifying data included in an RDS payload, and the RDS signal sent from the FM transmitter 300 has a unique sequence for identifying the registration information. It can be included as a (bit sequence).

In addition, the network identification information (network ID) and password included in the RDS signal is encrypted, the portable terminal 200 stores the encrypted network identification information (network ID) and keys for decrypting the password (keys) You may be doing For security, the encryption key may be changed over time, and the changed encryption key may be known to the display apparatus 100 and the portable terminal 200 in advance.

Meanwhile, when an application for sharing content with the display apparatus 100 is executed in the portable terminal 200, identification information (ID) for the portable terminal 200 is given, and the portable terminal 200 has an FM spectrum. Can be scanned.

In the process of scanning the FM spectrum, the mobile terminal 200 may detect the RDS signal transmitted from the display apparatus 100 by checking the unique ID bit sequence included in the RDS payload.

Thereafter, the portable terminal 200 may extract an encrypted network ID and password from the detected RDS signal and decrypt the encrypted network ID and password using a key known in advance.

The portable terminal 200 may connect a wireless network with the display apparatus 100 using the decrypted network ID and password.

Meanwhile, the portable terminal 200 may transmit portable terminal identification information (ID) and user information (for example, a user name or a picture) to the display apparatus 100 through the connected network.

The display apparatus 100 may register the corresponding terminal by storing portable terminal identification information (ID) received from the portable terminal 200.

On the other hand, when the RDS signal transmitted from the display apparatus 100 is not detected during the FM spectrum scanning process, the portable terminal 200 displays a message indicating that it cannot connect to a network for content sharing with the display apparatus 100. Can be forwarded to

According to an embodiment of the present invention, the wireless network to which the display apparatus 100 and the portable terminal 200 are connected may be in accordance with the WiFi wireless communication standard. Accordingly, the registration information transmitted using the RDS signal may be a WiFi network. It may include the ID and password of.

Referring to FIG. 23, the registration information as described above may be transferred from the display apparatus 100 to the portable terminal 200 through a pattern 310 using an information stealography mechanism.

First, when an application for content sharing is executed in each of the display apparatus 100 and the portable terminal 200, a pattern 310 including encrypted information for setting a network may be displayed on the display apparatus 100.

In this case, the user may focus the camera (not shown) provided on the portable terminal 200 on the pattern 310 so that the pattern 310 may be displayed on the screen 251 of the portable terminal 200. .

Meanwhile, the portable terminal 200 collects information for network setting, for example, WiFi network ID and password, from the obtained pattern 310 image, and wirelessly communicates with the display apparatus 100 using the received information. You can connect the network.

The portable terminal 200 may transmit portable terminal identification information (for example, model number or IMEI serial (International Mobile Equipment Identity Serial)) to the display apparatus 100 through the connected wireless network. The identification information of 200 may be stored and registered in the display apparatus 100.

After the registration and authentication process for the portable terminal 200 is performed as described above, when the portable terminal 200 contacts the screen unit 181 of the display apparatus 100, the mobile terminal 200 will be described with reference to FIGS. 4 to 21. As described above, different data transmission / reception functions may be performed between the display apparatus 100 and the portable terminal 200 according to the contact direction of the portable terminal 200.

Hereinafter, embodiments of a method of recognizing a contact direction of the portable terminal 200 will be described in detail with reference to FIGS. 24 to 30.

Referring to FIG. 24, the portable terminal 200 may include a magnetic field sensor, and recognize the contact direction by using the provided magnetic field sensor and display information on the contact direction. Can be sent to.

For example, as illustrated in FIG. 24, when the output value of the magnetic field sensor indicates 108 ° or more, the portable terminal 200 determines that the contact direction is the front surface, and displays the information that the contact direction is the front surface. 100 can be sent.

In this case, the display apparatus 100 may request the portable terminal 200 to transmit content according to the received contact direction information when the portable terminal 200 contacts, and receive the content data selected by the portable terminal 200. Can be.

Meanwhile, when the output value of the magnetic field sensor indicates less than 108 °, the portable terminal 200 may determine that the contact direction is the back side, and transmit the information indicating that the contact direction is the back side to the display apparatus 100.

In this case, the display apparatus 100 may transmit content data to the portable terminal 200 according to the received contact direction information when the portable terminal 200 contacts.

In addition, the contact direction of the recognized portable terminal 200 as described above may be stored and managed in the display apparatus 100 together with the portable terminal identification information ID as shown in Table 1 below.

ID Contact orientation 10 Front 21 back side 51 Front

 Referring to FIG. 25, the portable terminal 200 may include an accelerometer, and may recognize the contact direction by using an output value of the provided accelerometer.

For example, as illustrated in FIG. 25, values measured by the acceleration sensor along an axis of the portable terminal 200 may be opposite to each other when the contact direction is the front side and the rear side. Since it has a value, the portable terminal 200 may recognize the contact direction by using the output value of the acceleration sensor.

Referring to FIG. 26, the portable terminal 200 may recognize a contact direction to the display apparatus 100 using proximity sensors 320 and 321 provided at the front surface 200F and the rear surface 200R, respectively. .

For example, when the front surface of the portable terminal 200 contacts the screen unit 181 of the display device 100, the proximity sensor 320 provided on the front surface 200F of the portable terminal 200 may access an object. When the rear surface of the portable terminal 200 contacts the screen unit 181 of the display apparatus 100, the proximity sensor 321 provided on the rear surface 200R of the portable terminal 200 may access an object. It can be detected.

Referring to FIG. 27, the portable terminal 200 may recognize a contact direction to the display apparatus 100 using a gyro sensor.

Each of the display apparatus 100 and the portable terminal 200 is provided with a gyro sensor, and the display apparatus 100 receives a specific value of the gyro sensor provided in the portable terminal 200 from the portable terminal 200 and has an internal gyro. The contact direction of the portable terminal 200 may be recognized by comparing with the measured value of the sensor.

That is, the display apparatus 100 may include an xyz axis g1 indicating a direction of the display apparatus 100 detected by the gyro sensor provided therein and a portable terminal detected by the gyro sensor provided in the portable terminal 200. The contact direction may be determined by comparing the xyz axis g2 indicating the direction of 200 with each other.

For example, when specific values of the gyro sensors provided in the display apparatus 100 and the portable terminal 200 correspond to each other, the display apparatus 100 may determine that the rear surface of the portable terminal 200 is in contact with each other. have.

On the other hand, when the xyz axis g1 indicating the direction of the display device 100 and the xyz axis g2 indicating the direction of the portable terminal 200 differ by about 180 ° from any one axis, the display device 100 It may be determined that the front surface of the portable terminal 200 is in contact.

In addition, when the xyz axis g1 indicating the direction of the display apparatus 100 and the xyz axis g2 indicating the direction of the portable terminal 200 are different from each other, the display apparatus 100 may have a side surface of the portable terminal 200. It can be determined that the contact.

Referring to FIG. 28, the portable terminal 200 may detect a contact direction to the display apparatus 100 using the light sensor 330, and the light sensor 330 may include an ambient light sensor ALS, It can be implemented using an Ambient Light Sensor) or a colorimeter.

For example, the portable terminal 200 transmits the color information measured through the light sensor 330 provided on the front surface 200F to the display apparatus 100 together with identification information (ID) of the portable terminal, and displays the display. The device 100 may determine the contact direction by comparing the color information of the image displayed when the portable terminal 200 is in contact with the color information received from the portable terminal 200.

Referring to FIG. 29, when the front surface of the portable terminal 200 is in contact with the shoes of the display apparatus 100, the display apparatus may be controlled by the photosensitive sensor 330 provided in the front surface 200F of the portable terminal 200. The image displayed on the display 100 may be detected, and the color information measured by the light sensor 330 and the color information of the image displayed on the display apparatus 100 may coincide with each other.

Accordingly, the brightness of the image displayed on the display apparatus 100 (for example, the average brightness of an area corresponding to the position where the portable terminal 200 is in contact with the display image) and the portable terminal based on the contact point of time. When the brightness of the light measured by the ambient light sensor ALS provided on the front surface of the device 200 coincides with each other (or falls within a preset error range), the display apparatus 100 may be configured to have a front surface of the portable terminal 200. It can be determined that the contact.

In addition, the color temperature of the image displayed on the display apparatus 100 (for example, the color temperature of the region corresponding to the position where the portable terminal 200 is in contact with the display image) and the portable terminal based on the contact time point. When the color temperatures measured by the colorimeter provided on the front surface of the screen 200 coincide with each other (or within a preset error range), the display apparatus 100 determines that the front surface of the portable terminal 200 is in contact with each other. can do.

To this end, the display apparatus 100 may obtain color information (eg, light brightness or color temperature) of the image displayed at the contact point in time from the display image data and store the color information in the storage unit 170.

Referring to FIG. 30, when the rear surface of the portable terminal 200 contacts the shoes of the display apparatus 100, the color information measured by the light sensor 330 and the image displayed on the display apparatus 100 may be compared. Color information may be different from each other.

Accordingly, the brightness of the image displayed on the display apparatus 100 (for example, an average brightness of an area corresponding to the position where the portable terminal 200 is in contact with the display image) on the basis of the contact time point is determined by the portable terminal ( When the brightness of the display device 100 is different from the light brightness measured by the ambient light sensor ALS provided at the front of the sensor 200 (or outside the preset error range), the display apparatus 100 contacts the rear surface of the portable terminal 200. It can be judged.

In addition, the color temperature of the image displayed on the display apparatus 100 (for example, the color temperature of the region corresponding to the position where the portable terminal 200 is in contact with the display image) on the basis of the contact time point, is the portable terminal. If the temperature is different from the color temperature measured by the colorimeter provided on the front of the 200 (or outside the preset error range), the display apparatus 100 may determine that the rear surface of the portable terminal 200 is in contact. have.

As another embodiment of the present invention, one or more conductors may be attached to the front and rear surfaces of the portable terminal 200, and the contact of the portable terminal 200 may be sensed using the attached conductors.

In addition, the portable terminal 200 may sense current flowing through the front conductors and recognize that the front surface of the portable terminal 200 is in contact with the display apparatus 100, or sense current flowing through the rear conductors. Therefore, the rear surface of the portable terminal 200 may recognize that the display device 100 is in contact with the display device 100.

Meanwhile, the portable terminal 200 may include a gyro sensor and an acceleration sensor together to recognize the contact direction.

For example, the portable terminal 200 may recognize the contact direction by using a 3-axis gyro sensor and a 2-axis acceleration sensor, and then transmit information about the recognized contact direction to the display apparatus 100.

Hereinafter, a second embodiment of a configuration of a display apparatus and a portable terminal for performing a data transmission / reception method according to an embodiment of the present invention will be described with reference to FIGS. 31 to 34.

The display apparatus 100 according to the second embodiment of the present invention may be configured to include a plurality of Near Field Communication (NFC) tags, and recognizes whether the portable terminal 200 is in contact with the NFC terminal by using the NFC tags. can do.

The NFC is a field of radio frequency identification (RFID) RFID, and is a short-range wireless communication scheme defined as a standard in ISO 18092 for transmitting data at short range to low power using a frequency of 13.56 MHz. In addition, the NFC may perform short-range wireless communication using various frequency bands such as 125 kHz, 135 kHz or 900 MHz in addition to the frequency of 13.56 MHz.

Referring to FIG. 31, the display apparatus 100 may include a plurality of NFC tags 400 disposed behind the display unit 180, and the NFC tag 400 may be a passive NFC tag. .

Meanwhile, the NFC tag 400 identifies a location where the corresponding NFC tag is disposed along with manufacturer information, a model name, a model number, and identification information (for example, a serial number) of the display device 100. The tag index is stored, and the tag index may indicate the position of the NFC tag 400 in (x, y) coordinates.

That is, among the information stored in the NFC tag 400, the serial number is different for each display device and used to identify the corresponding display device 100, and the tag index is different for each NFC tag so as to identify the corresponding NFC tag 400. Can be used to identify the location.

Referring to FIG. 32, the portable terminal 200 includes an NFC reader 410, and the NFC reader 410 uses a display device using a signal of a predetermined frequency band (for example, a frequency band of 13.56 MHz). 100 may be activated by transmitting power and a signal to the NFC tag 400 provided in the tag, and the data stored therein may be read from the activated tag 400.

The NFC reader 410 provided in the portable terminal 200 may read data from an NFC tag located within a predetermined distance, for example, 4 cm.

Accordingly, when the portable terminal 200 approaches the display device 100 and approaches within 4 cm from the NFC tag disposed behind the display unit 180, the NFC reader 410 provided in the portable terminal 200 Information stored in the NFC tag may be received.

For example, as illustrated in FIG. 32, when the portable terminal 200 contacts the display apparatus 100, the NFC reader 410 provided in the portable terminal 200 may be a portable terminal among a plurality of NFC tags. Information stored in the NFC tags 401 to 406 disposed in the contact area R of the 200 may be read.

The portable terminal 200 may recognize the contact with the display apparatus 100 by checking the manufacturer information, the model name, the model number, and the serial number read through the NFC reader 410.

As described above, in order to recognize whether the portable terminal 200 is contacted using the NFC tag 400 provided in the display apparatus 100 and the NFC reader 410 provided in the portable terminal 200, the display apparatus 100. The distance from the front of the) to the NFC tag 400 may be set to a predetermined distance (for example, 4cm) that can read the data stored in the NFC tag 400 or a value slightly larger than the predetermined distance.

That is, as illustrated in FIG. 31, when the NFC tag 400 is disposed behind the display unit 180, the thickness of the display unit 180 (for example, the thickness of the display panel and the backlight unit) is constant. It is desirable to have a distance or slightly larger value.

In addition, the portable terminal 200 may recognize the contact location by using a tag index read through the NFC reader 410.

For example, the portable terminal 200 in contact with the display apparatus 100 reads a tag index from the NFC tags 401 to 406 disposed in the contact area R, and selects (x, y) the location where the portable terminal 200 is contacted can be recognized using the coordinates.

Meanwhile, the data stored in the NFC tag 400 may be UPnP device description parameters. When the portable terminal 200 is in contact with the display device 100, the portable terminal 200 may be NFC. The contact and the location of the contact may be recognized using the UPnP device description parameters read from the NFC tag 400 through the reader 410.

In addition, the UPnP device description parameters may be used in the registration and authentication process for the portable terminal 200 as described above.

Referring to FIG. 33, the display apparatus 100 may store data (eg, UPnP device) stored in the RFID tag 430 of the portable terminal 200 through a plurality of RFID radars 420 to 423 disposed at corners. Description parameters).

The display apparatus 100 may recognize the contact position of the portable terminal 200 by comparing the strengths of the RF signals received by the RFID radars 420 to 423.

For example, when the strengths of the RF signals received by the four RFID radars 420 to 423 are the same, it may be determined that the contact position of the portable terminal 200 is a central portion of the display apparatus 100. As the strength of the RF signal received by a particular RFID radar becomes stronger, the contact location may be moved to be adjacent to the corresponding RFID radar.

Referring to FIG. 34, an RFID reader 440 is provided in the display apparatus 100, and an RFID tag 430 is provided in the portable terminal 200 to perform an operation as described with reference to FIGS. 31 to 33. You may.

Meanwhile, by using the RFID short-range wireless communication method described with reference to FIGS. 31 to 33, the display apparatus 100 measures sensing values measured by the sensing unit 240 of the portable terminal 200 (for example, the portable terminal ( Information on a contact direction of the sensor 200 or an output value of a sensor for recognizing the contact direction).

35 to 41 illustrate a third embodiment of the configuration of a display apparatus and a portable terminal for performing a data transmission / reception method according to an embodiment of the present invention, and include a catadioptric provided in the display apparatus 100. The contact position and the contact direction of the portable terminal 200 may be recognized using a camera.

Referring to FIG. 35, a plurality of reflective refraction cameras 500 to 530 may be installed at corner portions of the display apparatus 100.

As shown in FIG. 36, the reflective refractive camera 500 may include a reflective refractive reflector 501 having a low profile and a camera 502 having a special lens system. have. The reflective refractive reflector 501 may be implemented using a convex mirror having a certain focal length.

By the reflective refraction cameras 500 to 530 having the above-described configuration, the display apparatus 100 may obtain an image of the screen unit from four different viewpoints, and thus, as shown in FIG. 37. A field of view can be secured.

Referring to FIG. 38, when a user moves the front surface of the portable terminal 200 toward the display apparatus 100 to enter the field of view of the reflective refractive cameras 500 to 530 as illustrated in FIG. 37, the portable terminal ( The cameras 212f and 212r provided at the front and the rear of the 200 are operated, so that the display apparatus 100 and the portable terminal 200 operate the reflective refraction cameras 500 to 530 and the front camera 212f, respectively. Can recognize each other.

In this case, the portable terminal 200 determines that the contact direction of the portable terminal 200 is the front surface by using the image of the display apparatus 100 acquired through the front camera 212f, or the display apparatus 100 reflects the image. The contact direction may be determined to be the front using an image of the portable terminal 200 (for example, a rear shape of the portable terminal 200) obtained through the refraction cameras 500 to 530.

Referring to FIG. 39, when the user moves the rear surface of the portable terminal 200 toward the display apparatus 100 to enter the field of view of the reflective refraction cameras 500 to 530, the display apparatus 100 and the portable terminal 200 may be used. ) May recognize each other through the reflective refraction cameras 500 to 530 and the rear camera 212r, respectively.

In this case, the portable terminal 200 determines that the contact direction of the portable terminal 200 is the rear side by using the image of the display apparatus 100 acquired through the rear camera 212r, or the display apparatus 100 reflects. The contact direction may be determined to be the rear side using an image of the portable terminal 200 acquired through the refractive cameras 500 to 530 (eg, the rear shape of the portable terminal 200).

Referring to FIG. 40, when a user moves the side of the portable terminal 200 toward the display apparatus 100 to enter the field of view of the reflective refraction cameras 500 to 530, the display apparatus 100 and the portable terminal 200 may be used. ) May recognize each other through reflective refraction cameras 500 to 530 and front and rear cameras 212f and 212r, respectively.

In this case, the portable terminal 200 determines that the contact direction of the portable terminal 200 is the side by using the image of the display apparatus 100 obtained through the front and back cameras 212f and 212r, or displays the display apparatus ( 100 determines that the contact direction is a side by using an image of the portable terminal 200 (for example, a front and rear shape of the portable terminal 200) acquired through the reflective refraction cameras 500 to 530. It may be.

Alternatively, when the portable terminal 200 enters the field of view of the reflective refraction cameras 500 to 530, a magnetic field sensor, an acceleration sensor, a gyro sensor, a proximity sensor, an ambient light sensor, or a colorimeter provided in the portable terminal 200. Etc., the contact direction may be recognized using the method as described above.

On the other hand, when the portable terminal 200 contacts the display apparatus 100, the display apparatus 100 uses the image acquired through the reflective refraction cameras 500 to 530 to contact the position of the portable terminal 200. Can be recognized.

Referring to FIG. 41, the distance d (x) from the optical axis of the reflective refraction camera 500 to the contact point P is determined by the distance x at the image plane and the mirror. It can be obtained using the angle θ of the vertical line.

Meanwhile, as described above, the distances d (x) to the contact point P are obtained by using four reflective refractive cameras 500 to 530 at the corner portions of the display apparatus 100. The display device may determine the contact position of the portable terminal 200 using the obtained distances d (x).

In the above, embodiments of a method of recognizing whether the portable terminal 200 touches the display apparatus 100, the contact position, and the direction of contact with reference to FIGS. 22 to 41 have been described, but the present invention is limited thereto. Not.

For example, the display apparatus 100 uses a plurality of light sources (eg, IR LED Emitters) and a plurality of light detection sensors (eg, IR Photodetectors) disposed at the edge portion of the portable terminal 200. ) Can be recognized whether or not the contact.

The above-described data transmission / reception method according to the present invention may be stored in a computer-readable recording medium that is produced as a program for execution on a computer. Examples of the computer-readable recording medium may include ROM, RAM, CD-ROM, Magnetic tapes, floppy disks, optical data storage devices, and the like, and also include those implemented in the form of carrier waves (eg, transmission over the Internet).

The computer readable recording medium may be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And, functional programs, codes and code segments for implementing the above method can be easily inferred by programmers of the technical field to which the present invention belongs.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

Claims (30)

A method for transmitting and receiving data with a portable terminal in a display device connectable to a wireless network,
Establishing a network connection for communication with the portable terminal; And
Recognizing a contact direction of the portable terminal when the portable terminal contacts the display device; And
Transmitting and receiving data to and from the portable terminal using the connected network;
The data transmission and reception step
And a data transmitting / receiving method which performs different data transmitting / receiving functions according to the recognized contact direction of the portable terminal. The method of claim 1, wherein the step of recognizing the contact direction
And a method for recognizing whether any of front, rear, and side surfaces of the portable terminal are in contact with the screen of the display device. The method of claim 2, wherein the data transmission and reception step is
And receiving data stored in the portable terminal when the first surface of the portable terminal contacts the screen of the display device. The method of claim 3, wherein the data received from the portable terminal is
Data transmission and reception method comprising the content being played in the portable terminal. The method of claim 3, wherein the first surface is
Data transmission and reception method that is the front of the portable terminal. The method of claim 3,
Recognizing a location where the portable terminal is in contact with the screen of the display device; And
And displaying at least one of selected content and information about the content in the recognized contact location in the portable terminal. The method of claim 6, wherein the displaying step
Displaying the image selected by the portable terminal on a screen; And
If the image displayed on the screen is selected, playing the selected video on the portable terminal. The method of claim 6, wherein the displaying step
Displaying information about the music selected by the portable terminal on a screen;
And receiving the audio data including the music from the display device and continuously playing the music played in the portable terminal. The method of claim 6, wherein the displaying step
Displaying contact information selected on the portable terminal on a screen;
The contact information is displayed in association with the content displayed on the contact location of the screen. The method of claim 6, wherein the displaying step
Continuously executing an application executed in the portable terminal,
The data transmission and reception step
And receiving at least one of login information and message information for the application from the portable terminal. The method of claim 2, wherein the data transmission and reception step is
And transmitting data stored in the display device to the portable terminal when the second surface of the portable terminal contacts the screen of the display device. The method of claim 11,
Recognizing a location where the portable terminal is in contact with the screen of the display device;
The data transmission and reception step
And transmitting data including the content displayed at the contact position of the screen to the portable terminal. The method of claim 11, wherein the second surface is
Data transmission and reception method of the rear of the portable terminal. The method of claim 1, wherein the step of recognizing the contact direction
And a magnetic field sensor, an acceleration sensor, a gyro sensor, a proximity sensor, an ambient light sensor, and a colorimeter to recognize the contact direction. The method of claim 1, wherein the step of recognizing the contact direction
Receiving color information measured by using a sensor provided at the front or the rear of the portable terminal; And
And determining the contact direction by using the color information received from the portable terminal. The method of claim 15, wherein the determining step
And determining the contact direction by comparing the color information of the image displayed on the screen of the display apparatus with the color information received from the portable terminal, based on the contact time point of the portable terminal. The method of claim 16, wherein the determining step
And determining that the front surface of the portable terminal is in contact with the screen of the display device when the color information measured by the sensor provided in the front surface of the portable terminal corresponds to the color information of the display image. The method of claim 6, wherein the contact location recognition step
And determining a contact location of the portable terminal using at least one of a touch sensor, a near field communication (NFC) tag, and a catadioptric camera provided in the display device. The method of claim 18, wherein the determining step
Detecting at least one NFC tag from which information is read by an NFC reader provided in the portable terminal, from among a plurality of NFC tags disposed behind the screen of the display device; And
And determining a contact position of the portable terminal to correspond to the detected position of the NFC tag. The method of claim 18, wherein the determining step
And determining a contact position of the portable terminal by using an image photographed by a plurality of reflective refraction cameras disposed at front edge portions of the display device. In the display device for transmitting and receiving data with a portable terminal using a wireless network,
A network interface unit for establishing a network connection for communication with the portable terminal and transmitting and receiving data to and from the portable terminal using the connected network when the portable terminal contacts the mobile terminal; And
And a control unit which controls the network interface unit to perform different data transmission / reception functions according to the direction in which the portable terminal is in contact. The method of claim 21, wherein the control unit
Recognizing whether any of the front, rear and side of the portable terminal is in contact with the screen portion of the display device,
When the first side of the portable terminal contacts the screen unit of the display device, data stored in the portable terminal is received through the network interface unit, and the display when the second side of the portable terminal contacts the screen unit And a data stored in the device is transmitted to the portable terminal through the network interface unit. The method of claim 22,
The first surface is a front surface of the portable terminal, the second surface is a rear surface of the portable terminal. The method of claim 22, wherein the control unit
Recognizes the position where the first surface of the portable terminal is in contact with the screen of the display device,
And at least one of the content selected from the portable terminal and the information about the content are displayed at the recognized contact location. The method of claim 22, wherein the control unit
Recognizes the position where the second surface of the portable terminal is in contact with the screen of the display device,
And a data including contents displayed at the contact position of the screen unit is transmitted to the portable terminal. The method of claim 21, wherein the control unit
The display apparatus determines the contact direction by comparing the color information of the image displayed on the screen with the color information received from the portable terminal on the basis of the contact point of time of the portable terminal. In a portable terminal for transmitting and receiving data with a display device using a wireless network,
A storage unit for storing content;
A wireless communication unit which transmits / receives data with the display apparatus when the portable terminal contacts the display apparatus; And
And a controller configured to control the wireless communication unit to perform different data transmission / reception functions according to the direction of contact with the display device.
When the first side of the portable terminal contacts the screen unit of the display device, data stored in the storage unit is transmitted to the display unit through the wireless communication unit, and the second side of the portable terminal contacts the screen unit. And the data stored in the display device are received through the wireless communication unit. The method of claim 27, wherein the wireless communication unit
A portable terminal for receiving information about at least one of the contact direction and the contact position of the portable terminal from the display device. A display device provided with a program for executing the method according to any one of claims 1 to 20. A computer-readable recording medium having recorded thereon a program for executing the method according to any one of claims 1 to 20 on a computer.

Images