KR20150099670A - Apparatus and method for transferring contents among heterogeneous devices using virtual touch - Google Patents

Apparatus and method for transferring contents among heterogeneous devices using virtual touch Download PDF

Info

Publication number
KR20150099670A
KR20150099670A KR1020140020979A KR20140020979A KR20150099670A KR 20150099670 A KR20150099670 A KR 20150099670A KR 1020140020979 A KR1020140020979 A KR 1020140020979A KR 20140020979 A KR20140020979 A KR 20140020979A KR 20150099670 A KR20150099670 A KR 20150099670A
Authority
KR
South Korea
Prior art keywords
user
content
virtual touch
coordinate data
unit
Prior art date
Application number
KR1020140020979A
Other languages
Korean (ko)
Inventor
김석중
Original Assignee
주식회사 브이터치
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 브이터치 filed Critical 주식회사 브이터치
Priority to KR1020140020979A priority Critical patent/KR20150099670A/en
Priority to PCT/KR2015/001719 priority patent/WO2015126206A1/en
Publication of KR20150099670A publication Critical patent/KR20150099670A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention provides an apparatus and method for easily moving, copying, separating, expanding, deleting, and reproducing contents displayed on a screen of a home appliance by using a virtual touch interface using a camera. , Selects contents matched with the display surface of the electronic device through the virtual touch using the user's body calculated using the photographed image or the three-dimensional coordinate data of the pointer held by the user, and displays the gesture or voice based on the user A virtual touch control unit for processing the pointing information generated by the virtual touch control unit and transmitting or receiving the content selected on the basis of the pointing information to other electric devices connected to the network, , Copy, detach, expand, delete, and play. And a central server that performs one process.

Description

[0001] Apparatus and method for transferring content among heterogeneous devices using virtual touch [0002]

The present invention relates to an apparatus and method for moving content between heterogeneous devices, and more particularly, to an apparatus and a method for moving content displayed on a terminal using a virtual tactile to a different heterogeneous apparatus selected through a specific hand gesture (gesture) .

Recently, many devices have been able to provide digital contents. In other words, video files or music files that can be viewed or heard only on a computer can be played directly on TV, audio, or mobile terminal. In addition, with the development of home network technology, many household appliances are connected to the network, so that digital contents can be easily transferred between different types of home appliances.

However, user interfaces for moving content between different types of devices do not escape the method of using content through a drag and drop method of a window after connecting to each other through a wired / wireless communication network. This will be described with reference to FIG.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating an exemplary method for moving content between general disparate devices.

As shown in Fig. 1, the folder 11 of the second home appliance and the folder 12 of the third home appliance, to which the content is to be moved, are shown on the screen 10 of the first home appliance. At this time, the first home appliances, the second home appliances and the third home appliances are connected by a network or a USB cable.

When the user selects a content to be moved from the second home appliance folder 11 and moves the selected content to the third home appliance folder 12 by a drag and drop method, the actual content is transferred from the second home appliance to the third home appliance It is moved.

When the content is moved through the above method, the user needs a separate device capable of displaying a screen like the first home appliance, and a folder 12 of the third home appliance for copying contents from the first home appliance, It is troublesome to find it in the network.

Recently, technologies for selecting a content displayed on a screen of a home appliance through a virtual touch interface using a camera have been researched and developed. However, it is difficult to design a content of a plurality of contents displayed on a single home appliance And it is required to develop a variety of application technologies.

Patent Registration No. 10-1143601: System and method for moving digital content between heterogeneous devices Registration No. 10-0255284 discloses a computer device for creating a virtual pointing device, a method of indicating the computer system, and an article of manufacture having the computer usable medium

Accordingly, it is an object of the present invention to provide an apparatus and method for easily moving, copying, separating, and expanding contents displayed on a screen of a home appliance by using a virtual touch interface using a camera The present invention provides an apparatus and a method for controlling a display apparatus.

Other objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

According to another aspect of the present invention, there is provided a device for moving content among heterogeneous devices using virtual touches, the device comprising: means for generating a 3D virtual coordinate system based on 3D coordinate data of a user body or a pointer held by a user, A virtual touch control unit for selecting a content to be matched with a display surface of the electronic device through a virtual touch and generating pointing information for performing an operation set based on a user's gesture or voice; And a central server for processing at least one of contents movement, copying, separation, and expansion for transmitting or receiving contents selected based on the pointing information to other electric devices connected to the network.

Preferably, the electric device is connected to a central server through a wired or wireless network.

Preferably, the virtual touch control unit includes an image acquisition unit that captures a user's body or a pointer held by the user, a user's body (hand, finger) or a pointer held by the user using the image captured by the image acquisition unit A touch position calculating unit for calculating contact coordinate data for contacting the display surface of the electronic device through the user's gesture or voice using the three-dimensional coordinate data calculated by the space coordinate calculating unit; And a virtual touch processing unit for selecting the content selected in accordance with the contact coordinate data received from the touch position calculating unit and the other electric devices and generating pointing information for performing the set operation, do.

Preferably, the calculation of the three-dimensional coordinate data according to the positional information of the user's body or the pointer held by the user in the space coordinate calculation unit is performed using any one of optical triangulation, structured light method, and time-of-flight measurement method .

Preferably, the central server comprises: a communication unit for calculating the electric devices indicated by the user based on the pointing information received from the virtual touch control unit and allocating the selected electric devices to each other; A central processing unit for controlling a process of moving contents such as transmission or reception to an assigned second device, a different central processing unit connected to each other through a network through a control signal processed by the central processing unit, And a content processing unit for processing the transmitted and received contents.

Preferably, the communication unit has a built-in unique number pre-assigned to the electric device, and when requested by the other electric device or the central processing unit, transmits the unique number to assign the selected electric device.

Preferably, the central processing unit converts the image quality and the format (communication protocol) so that the contents can be processed by the electric appliance to which the contents are moved.

According to another aspect of the present invention, there is provided a method of moving content between heterogeneous devices using a virtual touch, the method comprising: calculating three-dimensional coordinate data based on a user body photographed through an image acquisition unit or a pointer image held by a user; Calculating contact point coordinate data for meeting a display surface of an electronic device through a user's gesture using the calculated three-dimensional coordinate data when a preset user's gesture or voice is sensed; The method comprising the steps of: generating pointing information for selecting contents and other electric devices corresponding to coordinate data and performing a set operation; calculating an electric appliance indicated by the user based on the generated pointing information, After the content is allocated, the content selected in the allocated first device is assigned Two devices transmit or receive content to move to, copy, separation, and makin comprises the step of performing at least one of the expansion.

The apparatus and method for moving content between heterogeneous devices using the virtual touch according to the present invention as described above have the following effects.

First, since the content can be transferred between different kinds of devices by using the virtual touch, there is no need for a separate device capable of displaying the screen, and there is no need to separately search the network for the home appliances for moving and copying contents, The content can be moved in an efficient and convenient manner.

Secondly, the present invention is applied to a variety of application technologies by applying the present invention to content transfer between heterogeneous devices through a virtual touch interface using a camera.

FIG. 1 is a diagram illustrating an example of a method of moving content between general heterogeneous devices
2 is a block diagram showing an example of applying an apparatus for moving content disparate between virtual machines using the virtual touch of the present invention
3 is a block diagram illustrating an apparatus for moving content between heterogeneous devices using a virtual touch according to an embodiment of the present invention.
4 is a flowchart illustrating a method of moving content between heterogeneous devices using a virtual touch according to the present invention.

Other objects, features and advantages of the present invention will become apparent from the detailed description of the embodiments with reference to the accompanying drawings.

Preferred embodiments of an apparatus and method for moving content between heterogeneous devices using a virtual touch according to the present invention will now be described with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. It is provided to let you know. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention and are not intended to represent all of the technical ideas of the present invention. Therefore, various equivalents It should be understood that water and variations may be present.

3 is a block diagram illustrating an apparatus for moving a content between heterogeneous devices using a virtual touch according to an embodiment of the present invention. FIG. 2 is a block diagram of a content moving apparatus using a virtual touch according to an embodiment of the present invention. to be.

2, the first device 101 to the n-th device 104 may be a heterogeneous device including a TV, a computer, a portable terminal, and the like. And is connected to the central server 200 via a network, and the position of the electric device can be fixed or motion can be performed. For example, when the mobile terminal is fixed, its position information may be set in the virtual touch controller 300. In the case where the mobile terminal has a movement from time to time as in the case of a portable terminal, And can be set from time to time through comparison with the image of the electric device.

There are many ways to track the location, including RFID, Indoor Positioning System (IPS), beacon, and Wi-Fi.

In the embodiment of the present invention, for the sake of explanation, the content movement in two different types of devices (the first device 101 and the second device 102) will be described.

As shown in FIG. 3, the apparatus for moving a content between heterogeneous devices using virtual touches can perform a virtual touch operation using a three-dimensional coordinate data of a user body or a pointer held by a user, A virtual touch controller 300 for selecting a content to be matched with a display surface of the electronic device and generating pointing information for performing an operation set based on a user's gesture or voice; Copying, separation, extension, deletion, and reproduction (hereinafter referred to as " movement ") of transmitting and receiving contents selected on the basis of the pointing information to other electric devices connected to the network And a central server 200 for performing the functions.

The virtual touch controller 300 includes an image acquisition unit 310 for capturing a user's body or a pointer held by the user, a user's body (hands, fingers, etc.) using the image captured by the image acquisition unit 310, A space coordinate calculation unit 320 for calculating three-dimensional coordinate data of the pointer held by the user or the pointer held by the user, and a three-dimensional coordinate data calculation unit 320 for calculating the three- A touch position calculating unit 330 for calculating contact point coordinate data to be contacted with the display surface of the electronic device, and a controller 330 for selecting and setting contents and other electric devices selected in correspondence with the contact point coordinate data received from the touch position calculating unit 330 And a virtual touch processing unit 340 for generating pointing information for performing an operation.

The spatial coordinate calculator 320 may calculate the three-dimensional coordinate data according to the position information of the user's body or the pointer held by the user by using an optical triangulation method, a structured light method, a time-of-flight measuring method Can be calculated. The method applied at this time is already known, and a detailed description thereof will be omitted. On the other hand, as patent documents related to a method of calculating three-dimensional coordinate data using a two-dimensional image, Korean Patent Laid-Open Nos. 10-0021803, 10-2004-0004135, 10-2007-0066382, 10-2007 -0117877 and so on.

 The central server 200 includes a communication unit 210 for calculating the electric devices indicated by the user based on the pointing information received from the virtual touch controller 300 and allocating the selected electric devices to the communication unit 210, A central processing unit 220 for controlling the processing of content movement such as transmitting or receiving the selected content from the first device 101 allocated to the second device 102 to the assigned second device 102, And a contents processing unit 230 for processing contents exchanged with the central server 200 or other electric appliances of different types connected through a network through control signals processed in the central server 200.

At this time, the communication unit 210 has a built-in unique number pre-assigned to the electric device, and when requested by another electric device or the central processing unit 220, transmits the unique number to allocate the selected electric devices. In addition, the operations performed by the content processing unit 230 include, but are not necessarily limited to, content movement, copying, separation, expansion, deletion, and playback.

On the other hand, when the device receiving the content can not process the content, the central processing unit 220 changes the image quality and the communication protocol so that the device can process the content. For example, when a high-quality image file stored in a computer is transferred to a portable terminal for reproduction, the central processing unit 220 can automatically convert the high-definition image file into an image quality and a format (communication protocol) suitable for the portable terminal . Also, when wirelessly connected between the network-connected electric devices, infrared communication, Bluetooth communication method, and the like can be used, and the present invention is not limited thereto.

The operation of the content moving apparatus using the virtual touch according to the present invention will now be described in detail with reference to the accompanying drawings. 2 and 3 denote the same members performing the same function.

4 is a flowchart illustrating a method of moving content between heterogeneous devices using a virtual touch according to the present invention.

Referring to FIG. 4, first, the 3D coordinate data is calculated based on the user's body image photographed through the image obtaining unit 310 (S10). The calculation of the three-dimensional coordinate data according to the position information of the user's body (fingertip) or the pointer held by the user can be calculated by applying optical triangulation, structured light method, time-of-flight measurement, and the like.

Next, when a preset user's gesture is sensed (S20), contact point coordinate data that meets the display surface of the electronic device through the gesture of the user is calculated using the calculated three-dimensional coordinate data through the touch position calculating unit 330 (S30). In this case, the gesture sensed may be a motion of a predetermined user body or a pointer held by the user, for example, up, down, left, right, front, Not a gesture of the user, but also a voice.

Then, in step S40, information corresponding to the calculated contact point coordinate data is selected and information according to pointing for selecting other electric devices and performing the set operation is generated.

Then, the central server 200 calculates the electric devices indicated by the user on the basis of the generated pointing information, and allocates the selected electric devices to each other (S50). After that, the central server 200 allocates the contents selected by the assigned first device 101 (Moving, copying, separating, expanding, deleting, playing) the content to the second device 102 (S60).

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. It will be apparent to those skilled in the art that various modifications may be made without departing from the scope of the present invention. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (8)

The user selects a content to be matched with the display surface of the electronic device through the virtual touch using the user's body calculated using the photographed image or the three-dimensional coordinate data of the pointer held by the user, and based on the gesture or voice of the user A virtual touch control unit for generating pointing information for performing the set operation;
The virtual touch control unit processes the pointing information generated by the virtual touch control unit and transmits the selected content to another electric device connected to the network through at least one of moving, copying, separating, expanding, deleting, And a central server that performs processing on the virtual touches. The method according to claim 1,
Wherein the electric device is connected to a central server through a wired or wireless network. The apparatus of claim 1, wherein the virtual touch control unit
An image acquiring unit for acquiring a user's body;
A space coordinate calculation unit for calculating three-dimensional coordinate data of a user body (hand, finger) or a pointer held by the user by using the image photographed by the image acquisition unit;
A touch position calculation unit for calculating contact point coordinate data that meets the display surface of the electronic device through the user's gesture or voice using the three-dimensional coordinate data calculated from the space coordinate calculation unit;
And a virtual touch processing unit for selecting contents corresponding to the contact point coordinate data received from the touch position calculating unit and the other electric devices and generating pointing information for performing the set operation. A device for moving content between heterogeneous devices. The method of claim 3,
The space coordinate calculation unit may calculate the three-dimensional coordinate data according to the position information of the user's body or the pointer held by the user by using any one of optical triangulation method, structured light method, and time-of-flight method Wherein the virtual touch device is a virtual touch device. The system of claim 1, wherein the central server
A communication unit for calculating the electric devices indicated by the user based on the pointing information received from the virtual touch controller and allocating the selected electric devices,
A central processing unit for controlling processing for content movement, such as transmitting or receiving the content selected by the first device assigned through the communication unit to the assigned second device,
And a content processor for processing contents exchanged with other types of electrical appliances or central servers connected through a network through control signals processed by the central processor, A content moving device. 6. The method of claim 5,
Wherein the communication unit has a built-in unique number pre-assigned to the electric device, and when requested by another electronic device or the central processing unit, transmits the unique number to each of the selected electric devices, Device for moving content between devices. 6. The method of claim 5,
And converting the image quality and the format (communication protocol) so that the central processing unit contents can be processed by the electric appliance to which the content is transferred. Calculating three-dimensional coordinate data based on a user body photographed through the image acquisition unit or a pointer image held by a user,
Calculating contact point coordinate data for meeting the display surface of the electronic device through the user's gesture using the calculated three-dimensional coordinate data when a predetermined user's gesture or voice is sensed,
Generating pointing information for selecting contents and other electric devices corresponding to the calculated contact point coordinate data and performing the set operation;
Copying, copying, transferring, or receiving the contents selected by the assigned first device to the assigned second device or receiving the selected first electric device after calculating the electric devices indicated by the user based on the generated pointing information, Separating, expanding, deleting, and / or reproducing the content. The method of claim 1, further comprising:
KR1020140020979A 2014-02-22 2014-02-22 Apparatus and method for transferring contents among heterogeneous devices using virtual touch KR20150099670A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020140020979A KR20150099670A (en) 2014-02-22 2014-02-22 Apparatus and method for transferring contents among heterogeneous devices using virtual touch
PCT/KR2015/001719 WO2015126206A1 (en) 2014-02-22 2015-02-23 Apparatus and method for moving content between different devices using virtual touch

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140020979A KR20150099670A (en) 2014-02-22 2014-02-22 Apparatus and method for transferring contents among heterogeneous devices using virtual touch

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020150174287A Division KR20150143399A (en) 2015-12-08 2015-12-08 Apparatus and method for transferring contents among heterogeneous devices using virtual touch

Publications (1)

Publication Number Publication Date
KR20150099670A true KR20150099670A (en) 2015-09-01

Family

ID=53878614

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140020979A KR20150099670A (en) 2014-02-22 2014-02-22 Apparatus and method for transferring contents among heterogeneous devices using virtual touch

Country Status (2)

Country Link
KR (1) KR20150099670A (en)
WO (1) WO2015126206A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210097389A (en) * 2020-01-30 2021-08-09 송현주 System and method for recommending travel itinerary based on real-time user environment
CN114257670A (en) * 2022-02-28 2022-03-29 荣耀终端有限公司 Display method of electronic equipment with folding screen

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100818171B1 (en) * 2006-06-09 2008-04-03 한국과학기술원 3D position recognition through hand pointing command
KR101143601B1 (en) * 2008-12-18 2012-05-11 한국전자통신연구원 System and method for a way to exchange digital contents among heterogeneous devices
US8312392B2 (en) * 2009-10-02 2012-11-13 Qualcomm Incorporated User interface gestures and methods for providing file sharing functionality
KR101381928B1 (en) * 2011-02-18 2014-04-07 주식회사 브이터치 virtual touch apparatus and method without pointer on the screen

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210097389A (en) * 2020-01-30 2021-08-09 송현주 System and method for recommending travel itinerary based on real-time user environment
CN114257670A (en) * 2022-02-28 2022-03-29 荣耀终端有限公司 Display method of electronic equipment with folding screen

Also Published As

Publication number Publication date
WO2015126206A1 (en) 2015-08-27

Similar Documents

Publication Publication Date Title
US10948950B2 (en) Information processing device, table, display control method, program, portable terminal, and information processing system
US10855899B2 (en) Method and apparatus for identifying a device from a camera input
KR102471230B1 (en) Mobile terminal and operating method thereof
EP2395416A1 (en) Information processing device, information processing method, and program
US11262857B2 (en) Rendering device and rendering method
AU2013203016A1 (en) Method and system for controlling display device and computer-readable recording medium
WO2016018809A1 (en) Mobile device input controller for secondary display
US20120146884A1 (en) Control transfer apparatus, control transfer system and method thereof
EP3112983A1 (en) Hand gesture recognition method, device, system, and computer storage medium
US20160018905A1 (en) Projector, interactive system, and interactive control method
KR102037415B1 (en) Method and system for controlling display device, and computer readable recording medium thereof
WO2015159602A1 (en) Information providing device
CN106293563B (en) Control method and electronic equipment
CN104301661A (en) Intelligent household monitoring method and client and related devices
US20100161744A1 (en) System and method for moving digital contents among heterogeneous devices
WO2016095641A1 (en) Data interaction method and system, and mobile terminal
KR20150099670A (en) Apparatus and method for transferring contents among heterogeneous devices using virtual touch
KR102381068B1 (en) Wireless device and operating method thereof
US20160192117A1 (en) Data transmission method and first electronic device
KR20150143399A (en) Apparatus and method for transferring contents among heterogeneous devices using virtual touch
TW201706825A (en) Apparatus and method for integrating smart mobile device and touch device, and electronic device and display control method
TW202242631A (en) Method and apparatus for transmitting target between devices, and electronic device
KR20170064417A (en) Method and system for contents sharing of source device
WO2014005435A1 (en) Electronic device and remote control method therefor
CN105787971A (en) Information processing method and electronic equipment

Legal Events

Date Code Title Description
E601 Decision to refuse application
AMND Amendment
A107 Divisional application of patent