KR20140057150A - System and method for transfering content among devices using touch command and unusual touch - Google Patents

Abstract

A system and a method for transferring content among devices using a touch command and an unusual touch are disclosed. A content device of the system for transferring content among devices comprises a touch information generating unit for outputting a control signal according to a touch type by recognizing touch of an object; a location information collecting unit for collecting location information of a portable device according to the control signal of the touch information generating unit; a coupling unit for coupling with the portable device based on the touch information and the location information of the object; and a content moving unit for moving content to the portable device based on the touch information and the location information of the object.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system and method for moving content between devices using a touch command and a specific touch,

The present invention relates to a system and method for moving content between devices using a touch command and a specific touch, and more particularly, to a system and method for moving content between devices by selecting a content , And systems and methods that allow intuitive multi-device content movement.

Digital signage is an intelligent billboard in which the billboards around the user provide useful information and advertisement information to the user, thereby allowing the user to view and obtain desired information.

In order to utilize digital signage, there is a need for a method and system capable of moving content desired by the user to the user's terminal and moving the content from the user's terminal to the digital signage among contents of the digital signage.

In the article "Stitching: Pen Gestures that Span Multiple Displays ", there is disclosed a technique of moving a content from a first device to a second device when a first device starts a touch and continues to touch a second device, .

However, in the related art, there is an inconvenience that the content has to go beyond the display boundary of the first device in order to move the content to the second device. Since the display serves as a billboard, in a digital signage having a very large display size, the distance to the end of the display, in which the content is touched in order to move the content to another device, may be far.

In addition, since one of the hands of the user has to place the second device next to the first device, there has been inconvenience to use both hands to move the content.

Accordingly, there is a need for a system and method for moving content between devices with simple input.

The present invention can provide a system and method for intuitively moving content between multi-devices by moving content to a portable device when a user selects contents of the content device while holding the portable device in his / her hand.

In addition, the present invention can provide a system and a method that can omit a process of selecting a device for moving content by identifying and coupling a portable device held by a user.

The present invention can provide a system and a method for allowing a user to move desired content to a desired device without requiring any training by allowing the user to select a content device to be moved and a device to which the content is to be moved using an intuitive gesture.

A content device according to an embodiment of the present invention includes a touch information generation unit for recognizing a touch of an object and outputting a control signal according to a touch type; A position information collecting unit for collecting position information of the portable device according to a control signal of the touch information generating unit; A coupling unit for coupling with the portable device based on touch information of the object and the position information; And a content moving unit for moving the content to the portable device based on the touch information and the position information of the object.

A portable device according to an embodiment of the present invention includes a location information providing unit for providing location information of the portable device to the content device in response to a request of the content device touched by the user; A coupling unit for coupling with the content device when the content device makes a coupling request based on the location information; And a content moving unit for moving the content selected by the user to the coupled content device.

According to another aspect of the present invention, there is provided a content device that provides content to a portable device using a touch-enabled display, the method comprising: when an input to the content is detected, A code conversion unit; A coupling unit for coupling the portable device with the portable device according to a result of comparison between the image code and the code value when the code value recognized by the portable device is received from the portable device; And a content moving unit for transmitting the content to the portable device having the coupling.

According to an embodiment of the present invention, when a user selects content of a content device while holding a portable device in hand, it is possible to intuitively provide a system capable of moving content between multi-devices by moving content to a portable device .

In addition, according to an embodiment of the present invention, a process of selecting a device for moving contents can be omitted by identifying and coupling a portable device held by a user.

According to an embodiment of the present invention, a content to be moved and a device to be moved are selected using an intuitive gesture, so that a user can move his / her desired content to a desired device without training.

1 is a diagram illustrating a system for moving content between devices according to an exemplary embodiment of the present invention.
2 is a diagram illustrating an operation of a conventional device-to-device content movement system.
3 illustrates a content device according to an embodiment of the present invention.
FIG. 4 is an example of a method of selecting a content to be moved from a content device to a single-touch according to an embodiment of the present invention.
FIG. 5 is an example of a method of selecting a plurality of contents to be moved from a content device to a single-touch according to an exemplary embodiment of the present invention.
FIG. 6 is an example of a method of selecting a content to be moved to a specific touch in a content device according to an exemplary embodiment of the present invention.
FIG. 7 is an example of a method for selecting a content to be moved in multi-touch in a content device according to an embodiment of the present invention.
8 is an example of a specific touch according to an embodiment of the present invention.
9 is an example of a method of selecting a content to be moved to a specific touch in a content device according to an embodiment of the present invention.
FIG. 10 is an example of a method of selecting a location to display content received by a content device according to an embodiment of the present invention.
FIG. 11 is an example of a method of moving content in a content device according to an embodiment of the present invention with a single-touch and a specific-touch.
12 is an example of a touch trace recognized by the content device 110 when moving content from the content device 110 to the portable device 120 according to an embodiment of the present invention.
13 is an example of a method of moving content from a portable device to a content device using a single touch and a specific touch according to an embodiment of the present invention.
14 is an example of a touch trace recognized by a content device when moving content from a portable device to a content device according to an embodiment of the present invention.
15 is another example of a method of moving content from the content device 110 to the portable device using a single touch and a specific touch according to an embodiment of the present invention.
16 is another example of a method of moving content from a portable device to a content device using a single touch and a specific touch according to an embodiment of the present invention.
17 is another example of a method for selecting contents to be moved in multi-touch in a content device according to an embodiment of the present invention.
18 is another example of a method for selecting a content to be moved from a content device to a specific touch according to an embodiment of the present invention.
19 illustrates a portable device according to an embodiment of the present invention.
20 is a diagram illustrating a process of moving content between devices according to an embodiment of the present invention.
21 is a flowchart illustrating an operation method of a content device according to an embodiment of the present invention.
22 is a flowchart showing a coupling method according to an embodiment of the present invention.
23 is a flowchart illustrating a content moving method according to an embodiment of the present invention.
24 is a flowchart showing an operation method of the portable device according to an embodiment of the present invention.
25 is a view showing a content device according to another embodiment of the present invention.
26 and 27 illustrate an example of a method of moving content from a content device to a portable device using multi-touch and image code recognition according to another embodiment of the present invention.
28 is a diagram illustrating a portable device according to another embodiment of the present invention.
29 is a diagram illustrating a process of moving content between devices according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. A method for moving content between devices according to an exemplary embodiment of the present invention may be performed by a device-to-device content movement system.

1 is a diagram illustrating a system for moving content between devices according to an exemplary embodiment of the present invention.

Referring to FIG. 1, a device-to-device content movement system according to an embodiment of the present invention may include a content device 110 and a portable device 120.

The content device 110 may provide the content to a user using a touch-enabled display. For example, the content device 110 may be a digital signage.

At this time, when a touch input occurs on the display of the content device 110, the content device 110 may broadcast a peripheral device search message for confirming whether the portable device 120 exists within a predetermined distance. At this time, the touch input may be one of a drag, a sweep, and a flick. In addition, the peripheral device search message may request location information from the portable device 120 that has received the peripheral device search message. Accordingly, the response message corresponding to the peripheral device search message may include the location information of the portable device 120 that has received the peripheral device search message.

When receiving the response message, the content device 110 compares the position information of the portable device 120 included in the response message with the touch information generated based on the touch input inputted from the display of the content device 110 . The position information of the portable device 120 includes at least one of the position of the portable device 120, the time of space movement, the movement distance, and the movement pattern information. The touch information includes at least one of a position of the touch input performed on the display, A time, a moving distance, and a movement pattern.

When the position information of the portable device 120 and the touch input coincide with each other within a predetermined error, the content device 110 transmits a response message to the portable device 120 using the identification information of the portable device 120 included in the response message, So that the content can be transmitted.

The portable device 120 may be a device sized for the user to hold in one hand. In addition, the portable device 120 can provide contents to a user using a touch-enabled display. For example, the portable device 120 may be a portable touch device such as a smart phone or a PDA.

When the portable device 120 receives the portable device 120 search message from the content device 110, the portable device 120 can identify the spatial movement of the portable device 120 and generate the location information.

Next, the portable device 120 may transmit the generated location information and the identification information of the portable device 120 to the content device 110 in a response message corresponding to the search message.

When receiving the coupling message from the content device 110, the portable device 120 couples with the content device 110 based on the coupling message, and can perform content movement and copying.

When the user holds the portable device 120 and performs a touch input, the contents device 110 is coupled with the portable device 120, and the user selects the portable device 120 The portable device 120 can move the content 100 selected by the user.

The content device 110 can receive the content 101 selected by the portable device 120 while the user holds the portable device 120 from the portable device 120 and display the received content 101 at a location where the user has touched.

At this time, the content device 110 compares the touch input with the spatial movement of the portable device 120 to identify whether the user holds the portable device 120 and touched.

The system for moving content between devices according to an exemplary embodiment of the present invention includes a portable device 120 and a portable device 120. In the content device 110, The content 100 can be easily moved to another device without moving the content 100 to the outside of the screen in order to move the content 100 to another device.

When the user selects the content 101 of the portable device 120 while holding the portable device 120 in hand and touches the content device 110, The user can move the content 101 from the portable device 120 to the content device 110 easily with only one hand by moving the content 101 from the content device 110 to the content device 110. [

2 is a diagram illustrating an operation of a conventional device-to-device content movement system.

A conventional device-to-device content movement system may include a digital signage 201 and a terminal 202 as shown in FIG.

In step 210 the user may approach one side of the digital signage 201 while holding the terminal 202 with one hand and select one of the contents contained in the digital signage 201 on the other hand .

In step 220, the user may drag the content 200 selected in step 210 toward the terminal 202. At this time, the user can move the content 200 to the outside of the display of the digital signage 201.

The digital signage 201 may move the content 200 that has moved out of the display to the terminal 202 in step 220.

In other words, the conventional device-to-device content movement system must move the content to the outside of the display every time the content is moved to another device, so that the length of the touch input may be inconvenient.

3 is a diagram illustrating a content device 110 according to an embodiment of the present invention.

3, the content device 110 includes a location information collecting unit 310, a touch information generating unit 320, a coupling unit 330, a content moving unit 340, And a camera control unit 350.

The location information collecting unit 310 may collect location information of the portable device 120 adjacent to the content device 110 when there is an object touched on the display of the content device 110. [

Specifically, when there is an object touched on the display of the content device 110, the location information collecting unit 310 can transmit a peripheral device search message.

If the response message to the peripheral device search message is not received, it means that the user does not have the portable device 120, so that the position information collection unit 310 can terminate the coupling unit 330.

When receiving a response message to the peripheral device search message, the location information collecting unit 310 extracts location information of the portable device 120 adjacent to the content device 110 and collects the location information in the response message.

Also, when the location information collecting unit 310 transmits a peripheral device search message whenever there is an object touched on the display of the content device 110, even if the user does not intend to move the content, Since the ring is performed, resources may be wasted.

For example, the user may hold the portable device 120 and touch the display of the content device 110 regardless of the content movement. Accordingly, when the touch command inputted by touching the display of the object is a simple touch, the position information collecting unit 310 does not transmit the peripheral device search message, and the touch command is related to the movement of the contents such as drag, sweep and flick The peripheral device search message can be transmitted only in the case of the preset touch command.

That is, the position information collecting unit 310 couples with the portable device 120 only when the user inputs a specific touch command with the hand holding the portable device 120 or the portable device 120, It is possible to prevent unnecessary resources from being consumed in order to search for the portable device 120 to move the content in a situation where it is not desired to move.

The touch information generating unit 320 can identify the touch type of the object based on the number of objects touched on the display of the content device 110, the area of the object, and the shape of the object. In addition, the touch information generation unit 320 can identify a touch command that the user inputs to the content device 110 using the object based on the movement pattern of the object. The touch information generating unit 320 can generate touch information including a touch command and an object touch type.

At this time, the touch information generating unit 320 generates a touch information such as a touch-down state in which the object starts to touch the display and a touch-up time in which the object is in touch with the display, Location can be identified. The touch information generating unit 320 may generate at least one of a moving pattern, a moving distance, a moving time, and a moving direction of a moving object in a touch-move state in which an object moves in a state of touching a display One may be identified.

The touch information generation unit 320 generates a touch information by using a single touch in which one of the fingers of the user touches and inputs the display, a multi-touch in which the fingers of the user touch and input a plurality of positions of the display, ), Or a specific touch that a user's hand holding the portable device 120 enters by touching the display.

Specifically, if the shape of the object touched on the display is the user's finger and the number of objects touched on the display is one, the touch information generating unit 320 can identify the touch type of the object with a single touch. If the shape of the object touched on the display is the user's finger and the number of objects touched on the display is plural, the touch information generating unit 320 can identify the touch type of the object by multi-touch. If the shape of the object touched on the display is different from the shape of the user's finger, the touch information generation unit 320 can identify the touch type of the object as a specific touch.

A method by which the touch information generating unit identifies a specific touch will be described in detail with reference to FIG.

In addition, the touch information generating unit 320 can output a control signal based on the touch type of the object and the movement pattern of the object. At this time, the position information collecting unit 310 may collect the position information of the portable device 120 according to the control signal.

Specifically, when the touch type is a preset touch type including a specific touch, or when a moving pattern is generated by moving the object in a touched state, the touch information generating unit 320 transmits the position information to the position information collecting unit 310, And may output a control signal to collect position information of the device 120. [

The coupling unit 330 can make a coupling with the portable device 120 based on the touch information of the object generated by the touch information generating unit 320 and the position information received from the portable device 120. [

Specifically, when the movement time, the movement distance, and the movement pattern of the portable device 120 included in the position information correspond to the movement time, the movement distance, and the movement pattern of the object included in the touch information, The device 120 can be coupled. At this time, if the movement time, the movement distance, and the movement pattern of the portable device 120 included in the position information coincide with the movement time, the movement distance, and the movement pattern of the object included in the touch information within a certain error, Can determine that the position information and the touch input correspond to each other.

When the user touches the display with the portable device 120 in his or her hand or touches the display with the portable device 120, the user's hand touching the display, or the impact reflected to the portable device 120, The value of the portable device 120 accelerometer sensor may change. At this time, the portable device 120 may include the change and the change time of the value of the accelerometer sensor in the movement information.

The coupling unit 330 compares the time at which the object touches the display with the time at which the value of the accelerometer sensor changes. If the time at which the touching time and the time at which the value of the accelerometer sensor coincide are within a predetermined error range, The device 120 can be coupled. At this time, the time at which the object touches the display may be the time from the touchdown start to the touch command input such as drag and the touch up.

In addition, the user may hold the portable device 120 and touch the display of the content device 110 regardless of the content movement. Therefore, the coupling unit 330 does not couple with the portable device 120 when the touch command is a simple touch, and only when the touch command is a predetermined touch command related to movement of contents such as drag, sweep and flick, Or may be coupled to device 120.

Specifically, if the user simply touches the content displayed on the display with the handheld device 120, or with the hand holding the portable device 120, the coupling portion 330 may not couple with the portable device 120 . At this time, the content moving unit 340 can perform operations such as play / stop, button input, text highlight, field selection, and image selection / enlargement according to the position touched by the user.

When the user inputs one of the dragged, swept, and flicked content displayed on the display with the hand held device 120, or the hand held device 120, the coupling unit 330 can be operated by the portable device 120, Lt; RTI ID = 0.0 > and / or < / RTI >

That is, the coupling unit 330 couples with the portable device 120 only when the user inputs a specific touch command with the hand held device 120 or the hand holding the portable device 120, The portable device 120 can be prevented from being moved.

When the position information collecting unit 310 collects the position information from the plurality of portable devices 120, the coupling unit 330 compares the collected position information with the touch information, It is possible to identify and connect the portable device 120 in the hand when a user touches the display among the plurality of portable devices 120 located.

In addition, when the object moves for a touch command input such as a drag, the coupling unit 330 can make a coupling with the portable device 120 from the time when the object starts to move and touch the display. Also, the coupling part 330 can maintain the coupling with the portable device 120 until the object is separated from the display and the touch is terminated.

In addition, when the touch type is a specific touch, the coupling portion 330 can be coupled to the portable device 120. [ If the touch type is a single touch or multi-touch, and the touch command is input, the coupling unit 330 can couple with the portable device 120. [ On the other hand, if the touch type is a single touch or a multi-touch, the coupling unit 330 may not be coupled to the portable device 120 when the touch is terminated without a simple touch.

The content moving unit 340 moves the portable device (coupling unit 330) coupled with the coupling unit 330 based on the touch information of the object generated by the touch information generating unit 320 and the position information collected by the position information collecting unit 310 120). ≪ / RTI >

At this time, the content moving unit 340 can move the display position where the content is displayed on the display based on the touch information. Then, the content moving unit 340 can move the content to the portable device 120 based on the display position and the moving direction of the display position.

When the touch type is a specific touch, a method of moving content to the portable device 120 will be described in detail with reference to FIG.

When an object selects a plurality of contents and then inputs a touch command to move the portable device 120 in the direction in which the portable device 120 is located, the content moving unit 340 may move all the plurality of contents selected by the object to the portable device 120 have.

Specifically, when an object touching the display selects a plurality of contents displayed on the display using one of the drag, sweep, and flick, the content moving unit 340 moves all the plurality of contents selected by the object to the portable device 120, . ≪ / RTI >

A method of moving all of the plurality of contents to the portable device 120 will be described in detail with reference to FIG.

When an object touching the display inputs a touch command while content included in the portable device 120 is selected, the content moving unit 340 receives the content selected from the portable device 120, It can be displayed at the position where it is located.

A method for receiving and displaying content from the portable device 120 when the touch type is a special touch will be described in detail with reference to FIG.

The camera control unit 350 can control a camera included in the content device 110 or a camera connected to the content device 110 under the control of the portable device 120 to which the coupling unit 330 is coupled .

Specifically, the camera control unit 350 can display content for camera execution on the display of the content device 110. [

When the user selects content for camera execution, the touch information generating unit 320 generates touch information based on the touch command inputted by the user to select the content for camera execution, and the position information collecting unit 310 Can collect position information of the portable device 120 according to the touch information generated by the touch information generating unit 320. [

The coupling unit 330 can couple with the portable device 120 based on the position information collected by the position information collecting unit 310 and the touch information generated by the touch information generating unit 320. At this time, the camera controller 340 drives a camera included in the content device 110 or a camera connected to the content device 110, and can transmit a message requesting execution of the camera control program to the portable device 120 have.

Next, the camera control unit 350 can receive the camera control signal input by the user in accordance with the camera control program from the portable device 120. [

Finally, the camera control unit 350 may control a camera included in the content device 110 or a camera connected to the content device 110 according to the received camera control signal. At this time, the camera control unit 350 can control the angle of the camera, the number of times of shooting, the shooting start time, and the end time according to the camera control signal, and displays the images and images shot by the camera on the display of the content device 110 can do.

4 is an example of a method of selecting a content to be moved from the content device 110 to a single-touch according to an embodiment of the present invention.

The user can touch the area 411 of the content 410 displayed on the display of the content device 110 to the hand 400 holding the portable device 120 as shown in Case 1 of Fig. .

Then, the user can drag the hand 400 from the area 411 of the content 410 to another area 412 of the content 410. At this time, the user may input a touch command directed from the region 411 to the region 412 with a sweep or a flick instead of dragging.

At this time, the content device 110 can receive the location information of the portable device 120 from the portable device 120. [ When the position of the portable device 120 is moved by the distance and direction from the area 411 to the other area 412 or when the moving time of the portable device 120 corresponds to the time at which the drag is inputted, The portable device 110 may judge that the portable device 120 is held in the hand 400. [

Next, the content device 110 may move the content 410 to the portable device 120 held in the user's hand 400.

In addition, the user may touch the area 421 adjacent to the content 410 with the hand 400 as shown in case 2 of FIG. 4, and the area 421 adjacent to the opposite side of the content 410 in the area 421 Area 422 as shown in FIG. At this time, the user may input a touch command directed to the area 422 in the area 421 by sweep or flick instead of dragging.

At this time, the content device 110 searches the content 410 included in the virtual area 420 where the area 421 and the area 422 are set as one vertex, and searches the content 410 for the user's hand To the portable device 120 held in the housing 400.

5 is an example of a method of selecting a plurality of contents to be moved from a content device 110 to a single-touch according to an embodiment of the present invention.

The user can continuously select the content displayed on the display of the content device 110 with the hand 500 holding the portable device 120 as shown in Case 1 of Fig. Specifically, the user can select the area 511 of the first content 510, the area 521 of the second content 520, and the area 531 of the third content 530 displayed on the display of the content device 110 You can touch continuously.

At this time, the content device 110 can receive the location information of the portable device 120 from the portable device 120. [ Then, when the position of the portable device 120 is moved to the area 511, the area 521 and the area 531, the content device 110 determines that the portable device 120 is held in the hand 500 .

Next, the content device 110 transmits the first content 510, the second content 520, and the third content 530 corresponding to the touched area 511, the area 521, and the area 531, To the portable device 120 held in the user's hand 500.

The user may touch the area 541 adjacent to the first content 510 with the hand 500 as shown in case 2 of FIG. 5 and set the area 541 as a vertex The user may drag the hand 500 to the region 542 where the region 540 includes both the first content 510, the second content 520, and the third content 530.

At this time, the content device 110 stores the first content 510, the second content 520, and the third content 530 included in the virtual area 520 in a portable manner, To the device 120.

FIG. 6 is an example of a method of selecting a content to be moved from a content device 110 to a specific touch according to an embodiment of the present invention.

The user can touch the area 611 of one of the contents 610 displayed on the display of the content device 110 with the portable device 120 holding the hand 600 as shown in FIG.

At this time, since the shape of the object touched on the display differs from the finger of the user, the content device 110 can determine that the touch is unique. The content device 110 can receive the location information of the portable device 120 from the portable device 120. [ At this time, the positional information may include the position of the portable device 120 and the time at which the value of the accelerometer sensor of the portable device changes.

When the time when the content device 110 senses the object touched on the display coincides with the time when the value of the accelerometer sensor of the portable device changes, the content device 110 transmits the content 410 to the user's hand 400 To the portable device 120 being held by the user.

7 is an example of a method of selecting content to be moved in multi-touch in the content device 110 according to an embodiment of the present invention.

There may be content that is likely to use drag, sweep, and flick, such as map content, in content that often appears in digital signage among the content devices 110. At this time, since the map content often needs to enlarge or move the displayed terrain on the display, there is a high possibility of using drag, sweep, and flick in using the map contents.

Accordingly, when the user inputs a touch command such as drag, sweep, and flick to the content displayed on the display, the content device 110 determines whether the drag, sweep, and flick input by the user are for content movement or content It may be difficult to identify whether or not it is for controlling.

Accordingly, when the content device 110 touches a plurality of areas included in the content 710 in the hand 700 as shown in FIG. 7 and drags the content 710 in one direction, the content device 110 transmits the content 710 to the portable device 120 Can be set to move. Specifically, the user can touch area 711, area 712, and area 713 to hand 700 holding handheld device 120. The user can drag the hand 700 that touches the area 711, the area 712, and the area 713 to the area 714, the area 715, and the area 716.

That is, since the drag, sweep, and flick for moving the map content are input of one finger, and zooming of the map is a touch input in which two fingers move in different directions, , Sweeps, and flicks, the content device 110 may determine that the user desires to move the map content 710 to the portable device 120.

In addition, when the content device 110 is dragged from the area adjacent to the map content to the area adjacent to the opposite side of the map content as shown in case 2 (Case 2) of FIG. 4, the content device 110 is set to move the map content to the portable device .

8 is an example of a specific touch according to an embodiment of the present invention.

The specific type of touch among the touch types identified by the touch information generation unit of the present invention may be a type of touch that is difficult to be performed by a general finger.

For example, the singular touch may be to touch the display of the content device 110 to the user portable device 120, or to touch the finger node of the hand 800 holding the portable device 120.

Specifically, when a general touch made of a finger is input, the shape of the touch trace 811 sensed by the content device 110 may be circular as shown in Case 1 of FIG.

On the other hand, when a specific touch composed of the portable device 120 is input, the shape of the touch trace 821 sensed by the content device 110 is the same as that of the portable device 120 ), Or an elliptical shape.

When a specific touch including a finger of the hand 800 is input, the shape of the touch trace 831 sensed by the content device 110 is the same as the shape of the touch trace 831 shown in Case 3 of FIG. 8 800, or a rectangular shape having a length corresponding to the finger width.

Therefore, the touch information generating unit 320 can identify whether the object is a finger of the user or the finger of the hand 800 holding the portable device 120 or the portable device 120 based on the shape of the touch trace have. If the object is a finger node of the hand held device 120 or the hand holding the portable device 120, the touch information generating unit 320 can identify the touch type of the object as a specific touch. At this time, the shape of the touch trace may correspond to the shape of the object touched on the display as shown in FIG.

9 is an example of a method of selecting a content to be moved from a content device 110 to a specific touch according to an embodiment of the present invention.

When the user drags the area 911 of the display to the area 912 with the portable device 120, the content device 110 generates a touch input for selecting the content to be moved using the specific touch And can make a coupling with the portable device 120. [ At this time, since the shape of the object touched in the area 911 differs from that of the user, the content device 110 can determine that a specific touch has occurred.

Next, the content device 110 can search the content 910 displayed between the region 911 and the region 912. [

Finally, the content device 110 may move the retrieved content 910 to the portable device 120 held in the user's hand 900.

That is, the user can easily move the content 910 to the portable device 120 by simply dragging the content 910 that he wants to move to the portable device 120 using the portable device 120. [

10 is an example of a method of selecting a location to display content received by the content device 110 according to an embodiment of the present invention.

When the user wants to move the content 1010 displayed on the portable device 120 to the content device 110, the user can touch the content 1010 displayed on the portable device 120 as shown in FIG. 10 .

Next, when the user drags the area 1021 to the area 1022 while touching the area 1021 with the portable device 120, the content device 110 determines that a specific touch has occurred, .

Next, the content device 110 can receive the content 1010 selected by touching from the portable device 120 by the user.

Finally, the content device 110 may display the received content 1010 in an area 1020 between the area 1021 and the area 1022. [

That is, the user selects the content 1010 desired to move from the portable device 120 to the content device 110, selects the content 1010 from the portable device 120, and simply touches and drags the display to the portable device 120, ) To the content device 110 with ease. In addition, the user can drag the content 1010 to the portable device 120 to display the content 1010 at a position desired by the user.

11 is an example of a method of moving content in a content device 110 according to an embodiment of the present invention with a single-touch and a specific-touch.

The content device 110 according to an exemplary embodiment of the present invention may move the content using a combination of a specific touch and a general touch.

Case 1 in FIG. 11 is a front view when content is moved using a combination of a specific touch and a general touch. In Case 2 of FIG. 11, content is moved using a specific touch and a general touch together As shown in Fig.

Specifically, the user can touch a portion of the display of the content device 110 to the portable device 120 as shown in FIG.

Next, the user can touch the area 1111 of the content 1110 that he / she wants to move to the other hand 1100.

Next, the user can move to the area 1112 of the display of the portable device 120 by dragging the hand 1100 that touches the area 1111, as shown in Case 2 of Fig. 11 .

At this time, the content device 110 can transmit a peripheral device search message. Specifically, when the user senses a general touch generated by touching the display of the content device 110 with the portable device 120 and a general touch generated by dragging the content 1110, the content device 110 transmits a peripheral device search message Lt; / RTI >

11, the handheld device 120 receives the peripheral device search message. When the hand dragged by the user moves to the area 1112 of the portable device 120 as shown in case 1 of FIG. 11, Can be transmitted. As a remedy, when the time at which the portable device 120 receives the peripheral device search message and the time at which the portable device 120 senses the touch of the hand being dragged to the area 1112 coincide within a predetermined error, 120 may transmit a response to the peripheral device search message received by the content device 110. [

Next, the content device 110 may receive at least one response message. The content device 110 may extract the touchdown time at which the touchdown occurred on the display of the portable device 120 that transmitted the response message from the location information included in the response message.

Next, the content device 110 identifies the touchdown time closest to the time at which the touchup occurred at the display of the content device 110, selects the portable device 120 corresponding to the identified touchdown time, Ring can be formed. Here, since the content device 110 sends a peripheral device search message after touchup occurs on the display of the content device 110, the touchdown time may be longer than the time when the touchup occurred on the display of the content device 110 have.

Finally, the content device 110 may move the content 1110 to the portable device 120.

In addition, although the user is dragging the content 1110, the finger of the user who touched the content device 110 falls in the middle, so that the touch trace sensed by the content device 110 may appear in a flick form. Here, the touch trace sensed by the content device 110 will be described in detail with reference to FIG.

Also, the content device 110 may couple with the portable device 120 based on the time at which the specific touch occurred.

11, when the user touches a part of the display of the content device 110 with the portable device 120, the content device 110 detects a specific touch based on the type of the touch input sensed by the content device 110 And transmits a peripheral device search message. In addition, the portable device 120 may change the value of the accelerometer sensor due to a touched impact with the content device 110. [ At this time, the portable device 120 may include the change in the value of the accelerometer sensor and the change time in the movement information in the movement information of the response message to the received peripheral device search message.

The content device 110 compares the time at which the specific touch occurs and the time at which the value of the accelerometer sensor changes. When the time at which the specific touch occurs and the time at which the value of the accelerometer sensor are changed are the same, Ring can be formed.

Also, the content device 110 may couple with the portable device 120 based on the time when the touch input of the specific touch occurs.

Specifically, the user can touch and drag the display of the content device 110 to the portable device 120 as shown in FIG. At this time, the content device 110 can identify a drag input by a specific touch and transmit a peripheral device search message.

In addition, the portable device 120 can measure the spatial movement time of the portable device 120 according to the received peripheral device search message, and generate the movement information including the spatial movement time of the portable device 120. [ And the portable device 120 may transmit a response message including movement information.

The content device 110 compares the drag time of the specific touch with the movement time of the portable device 120 extracted from the response message and determines that the drag time of the specific touch and the movement time of the space of the portable device 120 are the same Lt; RTI ID = 0.0 > 120 < / RTI >

When the user's hand touches the content of the display of the content device 110 as shown in Case 1 or Case 2 of FIG. 11 in a state where the coupling between the content device 110 and the portable device 120 is concluded Content can be moved from the content device 110 to the portable device 120 when the user drags the content to the device on the portable device 120. [ In addition, when the user's hand touches the content of the display of the portable device 120 and then drags the content to the display of the content device 110, the content can be moved from the portable device 120 to the content device 110. [

12 is an example of a touch trace recognized by the content device 110 when moving content from the content device 110 to the portable device 120 according to an embodiment of the present invention.

When the user touches a portion of the display of the content device 110 with the portable device 120 as shown in Fig. 11, the content device 110 displays the touch traces 1202 in the rectangular shape, as shown in Fig. 12, Can be detected. At this time, since the touch trace 1202 is different from the touch shape 811 of the finger shown in Case 1 of FIG. 8, the content device 110 can determine that a specific touch has occurred.

11, when a user drags the content 1110 to move the content 1110 to the portable device 120, the finger of the user who touched the content device 110 moves on the portable device 120 And may be dropped from the display of the content device 110. Accordingly, the touch trace 1201 detected by the content device 110 as a drag for the user to move the content 1110 to the portable device 120 may appear in a flick-like form as shown in FIG.

When the content device 110 detects a touch trace as in case 1 in FIG. 12, the content device 110 can transmit a peripheral device search message. The content device 110 may receive a response message to the peripheral device search message from the portable device 120. [ In addition, the content device 110 may select the portable device 120 to be coupled based on the touch information and the location information included in the response message, and may couple with the selected portable device 120.

The coupling between the content device 110 and the portable device 120 can be performed in the same manner as in the case 2 where the user moves the portable device 120 to the area 1204 in the state of coupling with the portable device 120 Can be maintained.

Accordingly, when the user drags or flick-touches the content 1220 to the portable device 120 moved to the area 1204, the content device 110 omits the coupling process and transmits the content 1220 to the portable device 1202 120).

13 is an example of a method of moving content from the portable device 120 to the content device 110 using a single touch and a specific touch according to an embodiment of the present invention.

Case 1 in FIG. 13 is a front view when content is moved from the portable device 120 to the content device 110 using a combination of a specific touch and a general touch, and Case 2 in FIG. The content may be moved from the portable device 120 to the content device 110 using a combination of the specific touch and the general touch.

Specifically, the user can touch a portion of the display of the content device 110 to the portable device 120 as shown in FIG.

Next, the user can touch the area 1311 of the content 1310 displayed on the portable device 120 with the other hand 1300. [

Next, the user can move the hand 1300 that touches the area 1111 to the area 1312 of the display of the content device 110, as shown in Case 2 of Fig. 13 .

At this time, the content device 110 may be configured to detect a specific touch due to the user touching the display of the content device 110 with the portable device 120, or to select a drag, flick touch, The peripheral device search message can be transmitted at the time of detecting the touch input. The content device 110 may receive a response message to the peripheral device search message from the portable device 120. [ In addition, the content device 110 may select the portable device 120 to be coupled based on the touch information and the location information included in the response message, and may couple with the selected portable device 120.

The process and conditions for establishing a coupling between the content device 110 and the portable device 120 are the same as those in FIG. 11, and thus a detailed description thereof will be omitted.

When the coupling between the content device 110 and the portable device 120 is established, the portable device 120 can transmit the content 1310 of the area 1311 touched by the user to the content device 110.

Finally, the content device 110 may display the content 1310 received from the portable device 120 in the area 1312 where the user drags the hand 1300.

14 is an example of a touch trace recognized by the content device 110 when the content is moved from the portable device 120 to the content device 110 according to an embodiment of the present invention.

When the user touches a part of the display of the content device 110 with the portable device 120 as shown in Fig. 13, the content device 110 displays a rectangular touch touch 1402 as shown in Fig. 14, Can be detected. At this time, since the touch trace 1402 is different from the touch shape 811 of the finger shown in Case 1 of FIG. 8, the content device 110 can determine that a specific touch has occurred.

13, when the user drags the content 1110 in order to move the content 1110 to the content device 110, the finger of the user who touched the portable device 120 moves to the content device 110 The display of the content device 110 can be touched. Accordingly, the touch trace 1401 detected by the content device 110 as a drag for the user to move the content 1110 to the content device 110 may appear in a flick form as shown in FIG.

When the content device 110 detects a touch trace with FIG. 14, the content device 110 can transmit a peripheral device search message. The content device 110 may receive a response message to the peripheral device search message from the portable device 120. [ In addition, the content device 110 may select the portable device 120 to be coupled based on the touch information and the location information included in the response message, and may couple with the selected portable device 120.

15 is another example of a method of moving content from the content device 110 to the portable device 120 using a single touch and a specific touch according to an embodiment of the present invention.

15 may be a process of moving content in a specific touch direction using a flick touch. In addition, FIG. 15 may be a process performed after coupling with the portable device 120 identified by the content device 110 in FIG.

The user can touch the content 1510 displayed on the display of the content device 110 with the finger 1520 and perform the flick touch in the direction in which the portable device 120 is located.

In step 1502, the content device 110 may move the content 1510 in the direction in which the portable device 120 is located based on the flick touch performed in step 1501. [ Also, the content device 110 may perform step 1503 if the content 1510 being moved is moved to a specific touch generated by the touch of the portable device 120. [

The content device 110 may move the content 1510 to the portable device 120 in step 1503 so that the portable device 120 displays the content 1510. [

16 is another example of a method for moving content from the portable device 120 to the content device 110 using a single touch and a specific touch according to an embodiment of the present invention.

16 may be a process of moving content from the portable device 120 to the content device 110 using a flick touch. 16 may be a process performed after coupling with the portable device 120 identified by the content device 110 in FIG.

In step 1601, the user can touch the content 1610 displayed on the display of the portable device 120 with the finger 1620 and perform a flick touch upwards.

In step 1602, the portable device 120 may move the content 1610 upwards based on the flick touch performed in step 1601. [ In addition, the portable device 120 may perform step 1603 if the moving content 1610 has moved to the end of the display of the portable device 120. [

The content device 110 receives the content 1610 from the portable device 120 and displays the content 1610 above the unusual touch generated by the touch of the portable device 120 in step 1603 .

17 is another example of a method of selecting content to be moved in multi-touch in the content device 110 according to an embodiment of the present invention.

Depending on how the user grasps the portable device 120, the user can hold the portable device 120 only with the thumb and index finger in the hand 1700 as shown in Fig.

Accordingly, the inter-device content movement system according to an exemplary embodiment of the present invention can utilize the touch of the display of the content device 110 as a touch command for content movement by the user's stop, phonemes, and possession.

For example, the inter-device content movement system may transmit a touch of a sweep / flick type touch to content of the content device 110 to the portable device 120 as a touch command Can be set. In addition, the inter-device content movement system may set the touch of the content device 110 in the form of a grab by a hand holding the portable device 120 to a touch command that moves the content to the portable device 120 . The inter-device content movement system may set a touch in which the content of the portable device 120 is thrown toward the content device 110 as a touch command to move the content to the content device 110.

Specifically, when a touch command to move in the direction of the portable device 120 is input in the area 1701, the area 1702, and the area 1703, the touch command instructs the content of the content device 110 to be stored in the portable device The content device 110 may move the content 1710 to the portable device 120 since the content device 110 is in the form of a grab or sweep / flick grab.

On the other hand, when touching the area 1701, the area 1702, and the area 1703 and then ending the touch without moving, the corresponding touch command throws the content of the portable device 120 toward the content device 110, The content device 110 can receive the content from the portable device 120 and display the content.

18 is another example of a method for selecting a content to be moved from a content device 110 to a specific touch according to an embodiment of the present invention.

The content device 110 according to an exemplary embodiment of the present invention may determine a device to move content using a touch command such as drag, sweep, and flick and a simple touch start and stop without touch movement.

For example, the inter-device content movement system sets a touch of a type in which content of the content device 110 is scanned with a hand holding the portable device 120 to a touch command that moves the content to the portable device 120 . In addition, the inter-device content movement system can set a touch in which the content of the portable device 120 is pasted to the content device 110 as a touch command in which the content is moved to the content device 110.

When the user touches and drags the area 1801 of the content 1800 displayed on the display with the finger of the hand holding the portable device 120 as shown in Case 1 of FIG. 18, The device 110 can determine that a specific touch and drag has occurred and can make a coupling with the portable device 120. [

The content device 110 may receive the location information of the portable device 120 from the portable device 120 when a specific touch and a drag appear on the content 1800. [ At this time, the positional information may include the position of the portable device 120 and the time at which the value of the accelerometer sensor of the portable device changes. When the time when the content device 110 starts dragging on the content 1800 and the time when the content device 110 detects termination coincides with the time when the value of the accelerometer sensor of the portable device coincides with a predetermined error, Lt; RTI ID = 0.0 > 120 < / RTI >

Next, since the touch command input by the user is a form in which the content 1800 is scanned by the hand holding the portable device 120, the content device 110 transmits the content 1800 to a portable device (for example, 120).

In addition, the user can touch the area of the content 1800 with the finger of the hand holding the portable device 120, and then end the touch without moving. Specifically, the user can touch down the finger node of the hand holding the portable device 120 and immediately touch up. At this time, since the touch command is a form in which the content 1800 is thrown by the hand holding the portable device 120, the content device 110 transmits the content 1800 to the portable device 120, .

19 is a diagram illustrating a portable device 120 in accordance with an embodiment of the present invention.

19, the portable device 120 according to an embodiment of the present invention includes a position information generating unit 1910, a position information providing unit 1920, a coupling unit 1930, a content moving unit 1940, And a control signal transmitting unit 1950.

The position information generating unit 1910 may include at least one of a change in the accelerometer of the portable device 120, a position of the portable device 120, a moving distance of the portable device 120, and a movement pattern of the portable device 120 Location information can be generated.

Specifically, the location information generation unit 1910 may receive a peripheral device search message from the content device 110. [

When receiving the peripheral device search message, the position information generator 1910 may measure the position of the portable device 120, and may identify at least one of the movement distance and the movement pattern of the portable device 120. For example, the position information generating unit 1910 may include an accelerometer or a gyro sensor for identifying the GPS for measuring the position of the portable device 120, the movement distance and the movement pattern of the portable device 120, and the like.

The position information generator 1910 measures the accelerometer of the portable device 120. When the accelerometer changes, the position information generator 1910 can include the change time of the value of the accelerometer sensor and the change time of the accelerometer in the movement information.

The location information providing unit 1920 can provide the location information generated by the location information generating unit 1910 to the content device 110. [ Specifically, the location information providing unit 1920 may generate a response message corresponding to the peripheral device search message using the location information and the identification information of the portable device 120. [ Then, the location information providing unit 1920 can transmit the generated response message to the content device 110.

The coupling unit 1930 may receive a coupling request from the content device 110. [

At this time, when the location information received from the location information providing unit 1920 corresponds to the touch information of the content device 110, the content device 110 transmits the identification information included in the location information to the coupling unit 1930 A coupling request can be transmitted.

Then, the coupling unit 1930 can couple to the content device 110 that transmitted the coupling request.

The content moving unit 1940 receives at least one content from the content device 110 and displays the received content on the display of the portable device 120. [

In addition, when the user selects a content displayed on the display of the portable device 120 and inputs a touch command to the content device 110, the content moving unit 1940 transmits the content selected by the user to the content device 110 .

The camera control signal transmitting unit 1950 transmits a camera control signal for controlling the camera related to the content device 110 to the content device 110 when receiving a message requesting execution of the camera control program from the content device 110. [ Lt; / RTI >

Specifically, when receiving a message requesting the execution of the camera control program from the content device 110, the camera control signal transmitting unit 1950 carries out a camera control program to transmit a camera control command to the display of the portable device 120 An input window for receiving input can be displayed. At this time, the input window includes a control command input means for controlling the angle of the camera, an input box for inputting the number of shooting times of the camera, an input box for inputting a shooting start time and an ending time of the camera, And image control means for controlling an image captured by the camera and displayed on the display of the content device 110. [

Next, the camera control signal transmitting unit 1950 can generate the camera control signal based on the information input by the user in the input window and the control command. At this time, the camera control signal includes a control command for controlling the angle of the camera, a shooting count of the camera, a photographing start time and an ending time of the camera, Or the like.

Finally, the camera control signal transmitting unit 1950 can transmit the generated camera control signal to the content device 110. [

20 is a diagram illustrating a process of moving content between devices according to an embodiment of the present invention.

In step 2010, the touch information generating unit 320 of the content device 110 may detect a touched object on the display of the content device 110. [

If the position information collection unit 310 of the content device 110 detects the touched object on the display of the content device 110 in step 2010 or detects the start of dragging of the touched object in step 2010, A peripheral device search message can be transmitted.

In step 2030, the touch information generating unit 320 of the content device 110 may generate touch information of an object detected in step 2010. [ Specifically, the touch information generation unit 320 can identify the touch type of the object based on the number of objects detected in step 2010, the area of the object, and the shape of the object. In addition, the touch information generation unit 320 can identify a touch command that the user inputs to the content device 110 using the object based on the movement pattern of the object. The touch information generating unit 320 can generate touch information of an object including a touch command and an object touch type.

The location information generating unit 1910 of the portable device 120 in step 2035 determines whether the location information of the portable device 120 has been received or not, The moving distance of the portable device 120, and the movement pattern of the portable device 120. [0064] FIG.

In step 2040, the touch information generating unit 320 of the content device 110 may detect that the touch of an object that touched the display in step 2010 is terminated.

The location information providing unit 1920 of the portable device 120 in step 2050 may provide the location information generated in step 2035 to the content device 110. [ Specifically, the location information providing unit 1920 generates a response message corresponding to the peripheral device search message received in step 2020, using the location information generated in step 2035 and the identification information of the portable device 120 can do. Then, the location information providing unit 1920 can transmit the generated response message to the content device 110.

In step 2060, the coupling unit 330 of the content device 110 transmits the spatial movement time, distance, and movement pattern information of the portable device 120 included in the location information of the response message received in step 2050 The distance, and the movement pattern of the touch included in the touch information generated in step 2030. If the comparison result shows that the location information and the touch information coincide with each other within a predetermined error, the portable device that has transmitted the response message can be selected as a device to be coupled with the content device 110.

The coupling unit 330 of the content device 110 at step 2070 uses the identification information of the portable device 120 included in the response message received at step 2050 to select the portable device 120 Lt; / RTI >

In step 2080, the content moving unit 330 of the content device 110 moves the content to the portable device 120 based on the touch information generated in step 2030, or transmits the content received from the portable device 120 Can be displayed on the display.

FIG. 21 is a flowchart illustrating an operation method of the content device 110 according to an embodiment of the present invention.

In step 2110, the touch information generating unit 320 can identify the touch type of the object based on the number of objects touched, the area of the object, and the shape of the object on the display of the content device 110. In addition, the touch information generation unit 320 can identify a touch command that the user inputs to the content device 110 using the object based on the movement pattern of the object. The touch information generating unit 320 can generate touch information including a touch command and an object touch type.

At this time, the touch information generating unit 320 may include a touch type generating unit 320 for generating a touch type, such as a single touch in which one of the fingers of a user touches and inputs a display, a multi-touch in which fingers of a user touch and input a plurality of positions of the display, ), Or a specific touch that a user's hand holding the portable device 120 enters by touching the display.

In step 2120, the location information collecting unit 310 may collect location information of the portable device 120 adjacent to the content device 110. [

Specifically, when step 2110 is performed because there is a touched object on the display of the content device 110 or there is a movement of the touched object starting to be dragged, the position information collecting unit 310 transmits a peripheral device search message .

If the response message to the peripheral device search message is not received, it means that the user does not have the portable device 120, so that the position information collection unit 310 can terminate the coupling unit 330. When receiving a response message to the peripheral device search message, the location information collecting unit 310 extracts location information of the portable device 120 adjacent to the content device 110 and collects the location information in the response message.

The position information collecting unit 310 may also be configured to couple the portable device 120 to the portable device 120 only when the user inputs a specific touch command in step 2110 with the hand held portable device 120 or hand holding the portable device 120 , It is possible to prevent unnecessary resources from being consumed in order to search for the portable device 120 to move the content in a situation where the user does not want to move the content.

The position information collecting unit 310 acquires position information of the portable device 120 only when the user inputs a multi-touch command directed to one direction with the hand holding the portable device 120 or the portable device 120 in step 2110. [ It is possible to prevent unnecessary resources from being consumed in order to search for the portable device 120 to which the content is to be moved in a situation where the user does not want to move the content.

The coupling unit 330 in step 2130 performs coupling with the portable device 120 based on the touch information of the object generated in step 2110 and the position information of the portable device 120 collected in step 2120 Can be concluded.

The specific coupling method will be described in detail below with reference to FIG.

In step 2140, the content moving unit 340 may determine whether the touch information is touch information related to the content movement. At this time, the touch information confirmed by the content moving unit 340 is the touch information generated in step 2110, or the touch information generated in real time according to the touch of the object by the touch information generating unit 320 after the step 2110 is performed Touch information.

If the touch information generated in step 2110 is not the touch information related to the content movement, the content moving unit 340 may wait until the touch information related to the content movement is generated.

In step 2150, the content moving unit 340 performs the coupling in step 2130 based on the touch information of the object determined to be related to the movement of the content in step 2140 and the position information collected in step 2120 The portable device 120 can move the content.

A detailed content moving method will be described in detail with reference to FIG.

22 is a flowchart showing a coupling method according to an embodiment of the present invention. At this time, steps 2210 to 2260 shown in FIG. 22 may be included in step 2130 of FIG.

In step 2210, the coupling unit 330 can check whether the touch type included in the touch information of the object generated in step 2110 is a specific touch. If the touch type is a specific touch, the coupling unit 330 performs step 2220. If the touch type is a single touch or multi-touch other than a specific touch, the coupling unit 330 performs step 2230 can do.

In step 2120, the coupling unit 330 can check whether the touch information of the object generated in step 2110 and the position information of the portable device 120 collected in step 2120 are the same. Specifically, when the movement time, the movement distance, and the movement pattern of the portable device 120 included in the position information coincide with the movement time, the movement distance, and the movement pattern of the object included in the touch information within a certain error, 330 can determine that the position information and the touch input are the same.

If the position information and the touch input are the same, the coupling unit 330 may perform step 2240. [

Also, when the location information and the touch input are not the same, the portable device 120 can not couple with the content device 110. [ The coupling portion 330 may search for another portable device 120 that is to be coupled with the content device 110 while repeating the step 2220 using the location information of the other portable device 120 .

In step 2230, the coupling unit 330 may check in step 2210 whether a touch command is included in the touch information determined by the touch type as a single-touch or multi-touch.

If the touch information includes a touch command, the coupling unit 330 may perform step 2220 to check whether or not a coupling with the portable device 120 can be made. When the touch information is not included in the touch information, the user simply touches the touch screen and ends the touch without moving. Therefore, the user may touch the touch screen to execute the content and may not want to move the content. Accordingly, coupling portion 330 may perform step 2260 to terminate the coupling process.

In step 2240, the coupling unit 330 may couple with the portable device 120 that has collected the location information in step 2120.

In step 2250, the coupling unit 330 may check in step 2110 whether the object touching the display has finished touching. Specifically, when the touch information includes the touch-up time, the coupling unit 330 can determine that the touch is terminated when the current time reaches the touch-up time. When the touch is terminated, the coupling unit 330 may perform step 2260. FIG.

In addition, if the touch is not terminated, the coupling portion 330 can maintain the coupling in Step 2240.

In step 2260, the coupling unit 330 may terminate the coupling in step 2240 and terminate the content movement method.

23 is a flowchart illustrating a content moving method according to an embodiment of the present invention. At this time, steps 2310 to 2350 shown in FIG. 23 may be included in step 2150 of FIG.

In step 2310, the content moving unit 340 may determine whether the user has selected the content as the content movement gesture.

At this time, the content movement gesture may be one of a gesture for inputting a touch command such as a single touch or a drag, sweep, and flick, or a gesture using a specific touch, and a gesture for performing a specific touch and a single touch simultaneously .

When the user selects the content as the content movement gesture, the content movement unit 340 performs step 2320 to check whether the content is moved to the portable device 120 or whether the content is to be received from the portable device 120 have.

If the user does not select the content as the content movement gesture, since the user does not want to move the content, the content movement unit 340 repeats the step 2310 until the user selects the content as the content movement gesture .

In step 2320, the content moving unit 340 can check whether or not the portable device 120 has received the touch input.

Specifically, when at least one of the contents displayed on the display of the portable device 120 is selected by the user, the portable device 120 may transmit the content information on the content selected by the user to the content moving unit 340. [ When the content moving unit 340 receives the content information from the portable device 120, the content moving unit 340 can confirm that the portable device 120 has received the touch input.

If the portable device 120 receives a touch input, the content moving unit 340 may perform step 2350 because the content of the portable device 120 must be moved to the content device 110.

If the portable device 120 does not receive the touch input, the content moving unit 340 may perform step 2330 because the content of the content device 110 must be moved to the portable device 120.

In step 2330, the content moving unit 340 can check whether the movement direction of the content by the touch command corresponds to the position information.

For example, if the content moves downward by the touch command and the location information received from the portable device 120 moves downward, the content moving unit 340 moves the content in the downward direction, It can be judged that it corresponds.

When the portable device 120 is touched to the display of the content device 110 and the direction of movement of the content is the direction to move to the position of the specific touch by the portable device 120, It can be determined that the movement direction of the content corresponds to the position information.

If the moving direction of the content does not correspond to the position information, the user moves the content in the display device of the content device 110. Therefore, the content moving unit 340 performs step 2310 again, You can wait until the gesture is entered.

In step 2340, the content moving unit 340 may transmit the content selected in step 2310 to the coupled portable device 120.

In step 2350, the content moving unit 340 may receive the content selected in step 2320 from the coupled portable device 120. In step 2310, the content moving unit 340 may display the received content at the position where the gesture is input.

24 is a flowchart showing an operation method of the portable device 120 according to an embodiment of the present invention.

In step 2410, the location information generation unit 1910 can check whether the peripheral device search message is received from the content device 110. [ If the neighboring device search message is not received, the location information generating unit 1910 may repeat step 2410 until the neighboring device search message is received from the content device 110, and may wait.

In step 2420, the position information generating unit 1910 generates a position information of the portable device 120 based on the change of the accelerometer of the portable device 120, the position of the portable device 120, the moving distance of the portable device 120, It is possible to generate position information including at least one.

In operation 2430, the location information providing unit 1920 may provide the location information generated in operation 2420 to the content device 110. Specifically, the location information providing unit 1920 may generate a response message corresponding to the peripheral device search message using the location information and the identification information of the portable device 120. [ Then, the location information providing unit 1920 can transmit the generated response message to the content device 110.

In step 2440, coupling unit 1930 may verify that it has received a coupling request from content device 110. [ If the coupling request is not received, the coupling unit 1930 may repeat step 2440 and wait until it receives the coupling request.

In step 2450, the coupling unit 1930 may couple between the portable device 120 and the content device 110 that transmitted the coupling request.

In step 2460, the content moving unit 1940 receives at least one content from the content device 110 and displays the received content on the display of the portable device 120.

In addition, when the user selects a content displayed on the display of the portable device 120 and inputs a touch command to the content device 110, the content moving unit 1940 transmits the content selected by the user to the content device 110 .

According to another embodiment of the present invention, coupling between a content device and a portable device can be performed without performing location information collection through acquisition of accelerometer information of the portable device.

Hereinafter, a method of moving content by multi-touch and image code recognition in a content device according to another embodiment of the present invention will be described in detail.

Instead of collecting the location information of the portable device when the touch generated in the content device is multitouch when generating the touch information, the content device converts the content of the location where the user performed multi-touch into an image code, It is possible to obtain information on whether or not it has been recognized. Accordingly, the content device can perform the content movement by coupling with the portable device on which the gesture is performed.

25 is a diagram illustrating an internal configuration of a content device according to another embodiment of the present invention.

25, a content device according to another embodiment of the present invention includes a touch information generating unit 2510, an image code converting unit 2520, a coupling unit 2530, a content moving unit 2540, 2550).

Other components of the content device according to another embodiment of the present invention other than the image code conversion unit 2520 are the same as or similar to those described with reference to FIG. 3, and a detailed description thereof will be omitted.

The touch information generation unit 2510 identifies the touch type of the object based on the number of objects touched, the area of the object, and the shape of the object on the display of the content device, And can output a control signal based on the touch type of the object.

The image code converting unit 2520 may transmit a peripheral device search message for confirming whether or not the portable device exists within a predetermined distance according to the control signal of the touch information generating unit 2510. [ In addition, the image code converting unit 2520 converts the content existing at the position where the touch of the object is detected according to the control signal of the touch information generating unit 2510 into an image code, The image code can be displayed on the display screen. At this time, the image code may be realized by repeating or cross-displaying at least one color at a specific time interval or pattern, displaying an image composed of a bar code, a QR code, or the like. Accordingly, the portable device that receives the peripheral device search message from the content device recognizes the image code displayed on the display of the content device through the means capable of recognizing the image code, transmits it to the content device in the response message to the peripheral device search message . At this time, in the portable device, the image code displayed on the content device can be recognized using the illuminance sensor, the camera, the RGB sensor, the image sensor, and the like.

The coupling unit 2530 can make a coupling with the portable device based on the touch information of the object generated by the touch information generating unit 2510 and the response message received from the portable device. In other words, the coupling unit 2530 performs coupling with the corresponding portable device if the image code converted by the image code conversion unit 2520 and the image code recognized by the portable device that sent the response message match within a predetermined error range can do.

26 and 27, a content moving method by multi-touch and image code recognition will be described in detail.

The content device 110 is controlled so that the display of the portable device 120 and the display of the content device 110 face each other with the hand 2600 holding the portable device 120 as shown in Figure 26 (a) The user can touch the position of the content 2610 displayed on the touch panel 2610 by multi-touch. This is because the display of the portable device 120 and the display of the content device 110 face each other when the user touches the portable device 120 rather than directly to the display of the content device 110 and contacts the portable device 120, The user's hand 2600 is positioned between the content device 110 and the content device 110 so that the hand 2600 of the user holding the portable device 120 is naturally located in two or more areas 2611 to 2614 as shown in FIG. This is a situation where multi-touch is performed.

At this time, the content device 110 recognizes the coordinates on which the multi-touch is performed, performs image code conversion on the content 2610 existing in the coordinates, and then determines whether the portable device 120 exists within a predetermined distance A peripheral device search message may be transmitted.

Upon receiving the peripheral device search message from the content device 110, the portable device 120 detects whether the content on the content device 110 existing in front of the display device 110 is subjected to image code conversion. When the image code conversion is detected The content device 110 responds to the peripheral device search message. When the content device 110 receives the response message to the peripheral device search message, the content device 110 couples with the portable device 120 that has transmitted the response message.

A method for recognizing image code conversion for content on a content device in a portable device is as follows.

27, when the content device 110 identifies a multi-touch, a peripheral device search message is sent and at least a part of the content 2710 (hereinafter referred to as an 'image conversion area' Quot;) 2720, which is repeated twice and alternately in white or black at 0.5 second intervals (for example, white-black-white-black). After receiving the peripheral device search message, the portable device 120 measures the illuminance through the illuminance sensor located on the front surface of the portable device 120. [ Since the image code composed of white and black is displayed in the image conversion area 2720 of the content 2710 displayed on the content device 110 located on the front side of the portable device 120 in the portable device 120, The result of the sensor measurement is obtained by the lightness-darkness-lightness-darkness of the image code. The portable device 120, which has measured the illuminance sensor value for a predetermined time, transmits it to the content device 110 in response to a peripheral device search message. Upon receiving the response message of the peripheral device search message, the content device 110 determines whether the change value of the ambient light sensor value included in the response message and the time interval of the response message include the brightness order and time of the color displayed in the image conversion area 2720 And couples with the portable device 120 that sent the response message if they all agree within a predetermined error range.

[0], [1], [0], [0], [0], [0], and so forth are provided to the portable device by adjusting the color and time to be displayed in the image conversion area 2720, 1], [1], [0], [1]) and the portable device 120 can transmit the same by restoring the code transmitted by the content device 110 by the brightness sensor value have.

28 is a diagram showing an internal configuration of a portable device according to another embodiment of the present invention.

28, a portable device according to another embodiment of the present invention includes a recognizing unit 2810, a providing unit 2820, a coupling unit 2830, a content moving unit 2840, and a camera control signal transmitting unit 2850 ).

The remaining configuration of the portable device according to another embodiment of the present invention, except for the recognition unit 2810 and the provision unit 2820, is the same as or similar to the details described with reference to FIG. 19, and thus a detailed description thereof will be omitted.

Upon receiving the peripheral device search message, the recognition unit 2810 activates a module necessary for recognizing the image code displayed on the content device, and then transmits the image code through the corresponding module Can be recognized. For example, the recognition unit 2810 may recognize an image code displayed on the content device using an illuminance sensor, a camera, an RGB sensor, an image sensor, or the like.

The providing unit 2820 generates a response message corresponding to the peripheral device search message using the identification information of the portable device itself, stores the measurement result value recognized by the recognition unit 2810 in the response message, Lt; / RTI >

In the content device, if the code recognition value included in the response message sent from the portable device matches the image code converted by itself, the coupling device can transmit the coupling request to the portable device. Thus, And couples with the content device that sent the request.

29 is a diagram illustrating a process of moving content between devices according to another embodiment of the present invention.

In step 2910, the content device 110 may detect a touched object on the display of the content device 110.

In step 2920, the content device 110 identifies the touch type of the object based on the number of objects detected in step 2910, the area of the object, and the shape of the object, The touch information can be generated.

In step 2930, if the content device 110 detects an object touched on the display of the content device 110 in step 2910, the content device 110 transmits a peripheral device search message for confirming whether the portable device 120 exists within a predetermined distance Can be transmitted.

In step 2940, if the content device 110 detects an object touched on the display of the content device 110 in step 2910, the content device 110 converts the content existing at the detected position of the object into an image code, The image code can be displayed in the image conversion area which is at least some area displayed.

After receiving the peripheral device search message from the content device 110 in step 2950, the portable device 120 activates a module necessary for recognizing the image code displayed on the content device 110, Can be recognized.

In step 2960, the portable device 120 generates a response message corresponding to the peripheral device search message using the identification information of the portable device itself, and then stores the code recognition value recognized in step 2950 in a response message To the content device (110).

In step 2970, the content device 110 compares the code recognition value included in the response message transmitted from the portable device 120 with the image code converted in step 2940, and if the comparison result indicates that the two code information are within a predetermined error amount The portable device 120 that has transmitted the response message can select the content device 110 and the device to be coupled with.

In step 2980, the content device 110 uses the identification information of the portable device 120 included in the response message transmitted from the portable device 120 to perform coupling with the portable device 120 selected in step 2970 .

In step 2990, the content device 110 may move the content to the portable device 120 or display the content received from the portable device 120 on the display based on the touch information generated in step 2920 .

When the method of recognizing the image code conversion described above is applied, when the content device 110 simultaneously identifies multi-touches at various positions, colors are displayed in the image conversion area with different code values at each multi- It is possible to distinguish each portable device 120 when the portable devices 120 simultaneously perform an interaction for content movement.

Although the above description refers to the illuminance sensor as a method of recognizing the image code conversion for the content on the content device 110 in the portable device 120, the portable device 120 can also use the camera, the RGB sensor, the image sensor, It is operable. 26 (a), even when a user interacts with the portable device 120 by turning the portable device 120 upside down without facing the display device of the content device 110 and the display of the portable device 120, It is possible to operate in the same manner.

In addition, although a coupling method using multi-touch and image code recognition is described above, coupling and content movement can be performed through recognition of image conversion even when a specific touch is performed in addition to multi-touch. The same is true when the touch trace by the user is a combination of a specific touch and a multi-touch, and a general touch and a touch of a different type are performed.

In the image conversion recognition method described above, image codes are described in a form in which white or black is expressed in a certain region (i.e., an image conversion region) on the content, but the brightness of the content is temporarily changed to be very bright, very dark, (A barcode or a QR code) containing information of contents is temporarily displayed and recognized by a camera to move a desired code from a content device to a portable device It is also possible.

When performing the content movement by the above-described method of recognizing the image code conversion, the user can move the portable device 120 to the portable device 120 through the content movement gesture using the stop or thumb finger when the portable device 120 contacts the content device 110, The content moving direction can be controlled from the portable device to the content device or the content device to the portable device. Information on whether or not the user has touched the display on the portable device 120 (i.e., presence or absence of the content movement gesture) may be included in the response message of the peripheral device search message. Accordingly, the content device 110 can confirm whether to move the content to the portable device 120 or to receive the content from the portable device 120 according to the presence or absence of the content movement gesture included in the response message.

The present invention can provide a system capable of intuitively moving content between multi-devices by moving contents to a portable device when a user selects or drags contents of the content device while holding the portable device in his / her hand.

In addition, the present invention can omit a process of selecting a device for moving contents by identifying and coupling a portable device held by a user.

In addition, the present invention allows an intuitive gesture to select a content device to be moved and a device to which the content is to be moved, thereby allowing a user to move content desired by the user to the desired device without requiring any training.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

110: Content device
120: Portable device
310: Position information collecting unit
320: Touch information collecting unit
330: Coupling portion
340:

Claims (15)

A content device for providing content to a portable device using a touch-enabled display,
A touch information generation unit for recognizing a touch of an object and outputting a control signal according to a touch type;
A position information collecting unit for collecting position information of the portable device according to a control signal of the touch information generating unit;
A coupling unit for coupling with the portable device based on touch information of the object and the position information; And
A content moving unit for moving the content to the portable device based on the touch information of the object and the position information,
. The method according to claim 1,
Wherein the touch information generating unit comprises:
A touch type of the object based on the number of the objects touched on the display, an area of the object, and a shape of the object, and a movement pattern of the object, and outputs a control signal. 3. The method of claim 2,
Wherein the touch information generating unit comprises:
A single touch in which one of the fingers of the user inputs the touch by touching the display or a multi-touch in which a user's fingers touches and inputs a plurality of positions of the display, or the portable device, Is identified as one of the specific touches to which the touch is made. 3. The method of claim 2,
The coupling portion includes:
And transmits a message for coupling with the portable device when the touch type is a preset touch type including the specific touch. The method according to claim 1,
The coupling portion includes:
And couples the portable device with the portable device when the movement time, the movement distance, and the movement pattern of the portable device included in the position information correspond to the touch information of the object. The method according to claim 1,
The coupling portion includes:
Wherein the portable device is coupled to the portable device from a time when the object starts to move by touching the display and maintains the coupling with the portable device until the object is released from the display and the touch ends. The method according to claim 1,
Wherein the content moving unit comprises:
Wherein when the object selects a plurality of contents and then inputs a touch command to move the portable device in a direction in which the portable device is located, the content device moves all of the plurality of contents to the portable device. In a portable device,
A location information providing unit for providing the location information of the portable device to the content device according to a request of the content device touched by the user;
A coupling unit for coupling with the content device when the content device makes a coupling request based on the location information; And
A content moving unit for moving the content selected by the user to a content device having a coupling,
≪ / RTI > A content device for providing content to a portable device using a touch-enabled display,
An image code conversion unit for displaying an image code related to the content on the display when a touch input to the content is detected;
A coupling unit for coupling the portable device with the portable device according to a result of comparison between the image code and the code value when the code value recognized by the portable device is received from the portable device; And
And a content moving unit for transmitting the content to the portable device having the coupling,
. 10. The method of claim 9,
Wherein the image code conversion unit comprises:
Displaying the image code on at least some areas where the content is displayed on the display
. ≪ / RTI > 10. The method of claim 9,
Wherein the image code conversion unit comprises:
Converting the content into a code in which at least one color is displayed in a predetermined pattern
. ≪ / RTI > 10. The method of claim 9,
Wherein the image code conversion unit comprises:
Converting the content into a barcode or a quick response (QR) code including information related to the content
. ≪ / RTI > 10. The method of claim 9,
Wherein the image code conversion unit comprises:
Transmits a peripheral device search message for confirming the presence or absence of the portable device within a predetermined distance,
When the peripheral device search message is received, the portable device generates a response message for the peripheral device search message using its own identification information, and then transmits the code value, which recognizes the image code displayed on the display, Message to the content device
. ≪ / RTI > 14. The method of claim 13,
The coupling portion includes:
And if the image code matches the code value, coupling with the portable device using the identification information included in the response message
. ≪ / RTI > 10. The method of claim 9,
The portable device recognizes the image code displayed on the display using at least one of an illuminance sensor, a camera, an RGB sensor, and an image sensor
. ≪ / RTI >

Images