KR20160120856A - System, apparatus and method for providing 3d haptic feedback - Google Patents

System, apparatus and method for providing 3d haptic feedback Download PDF

Info

Publication number
KR20160120856A
KR20160120856A KR1020150049817A KR20150049817A KR20160120856A KR 20160120856 A KR20160120856 A KR 20160120856A KR 1020150049817 A KR1020150049817 A KR 1020150049817A KR 20150049817 A KR20150049817 A KR 20150049817A KR 20160120856 A KR20160120856 A KR 20160120856A
Authority
KR
South Korea
Prior art keywords
haptic feedback
gesture
user
haptic
wearable device
Prior art date
Application number
KR1020150049817A
Other languages
Korean (ko)
Inventor
오창목
김민규
신희숙
임정묵
정현태
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR1020150049817A priority Critical patent/KR20160120856A/en
Publication of KR20160120856A publication Critical patent/KR20160120856A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A haptic feedback providing apparatus is disclosed. A haptic feedback providing apparatus includes a gesture input unit receiving a gesture from a user; A haptic setting unit for setting a haptic feedback corresponding to the gesture; A haptic feedback generator for generating haptic feedback according to a gesture input in a state of being in contact with the user; And a haptic feedback transmission unit for transmitting haptic feedback according to a gesture input in a non-contact state with the user to the wearable device worn by the user.

Description

TECHNICAL FIELD [0001] The present invention relates to a system, an apparatus, and a method for providing three-dimensional haptic feedback using a wearable device,

The present invention relates to a technique for providing haptic feedback according to a three-dimensional gesture using a wearable device worn by a user.

Currently, haptic or vibration feedback is implemented or designed in various forms in wearable devices (such as rings / bracelets / clothing) and touch-based tablets and mobile phones. Such a haptic feedback can indicate whether a gesture command on a plane or a touch on a space is operated or not, and realistic interaction is enabled by generating a haptic pattern corresponding to the virtual content. However, existing haptic feedback is limited to the device itself controlled by the user.

The background art of the present invention is disclosed in Korean Patent Laid-Open Publication No. 10-2014-0145707 (Apr. 24, 2014)

An object of the present invention is to provide haptic feedback according to a three-dimensional gesture using a wearable device.

According to an aspect of the present invention, there is provided a gesture input apparatus including: a gesture input unit receiving a gesture from a user;

A haptic setting unit for setting a haptic feedback corresponding to the gesture; A haptic feedback generator for generating haptic feedback according to a gesture input in a state of being in contact with the user; And a haptic feedback transmission unit for transmitting the haptic feedback according to the gesture inputted in a non-contact state with the user to the wearable device worn by the user.

According to an embodiment of the present invention, haptic feedback according to a three-dimensional gesture can be provided using a wearable device.

Further, according to embodiments of the present invention, it is possible to provide more diverse modulated feedback than that provided by a single device.

In addition, according to the embodiment of the present invention, it is possible to provide intuitive haptic feedback corresponding to a three-dimensional gesture.

1 is a block diagram of a haptic feedback providing system according to an embodiment of the present invention.
2 is a block diagram of an apparatus for providing haptic feedback according to an embodiment of the present invention.
3 is a flowchart of a method for providing haptic feedback according to an embodiment of the present invention.
4 is a view for explaining haptic feedback corresponding to a gesture input in a non-contact state according to an embodiment of the present invention.
FIG. 5 is a view for explaining a haptic feedback pattern corresponding to a picking-up and dropping-down gesture according to an embodiment of the present invention.

While the present invention has been described in connection with certain exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the present invention, detailed description of known related arts will be omitted when it is determined that the gist of the present invention may be unnecessarily obscured. In addition, the singular phrases used in the present specification and claims should be interpreted generally to mean "one or more " unless otherwise stated.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or corresponding components throughout. .

1 is a block diagram of a three-dimensional haptic feedback system according to an embodiment of the present invention.

Referring to FIG. 1, a haptic feedback providing system includes a wearable device 100 and a three-dimensional haptic feedback providing device 200.

The wearable device 100 receives the haptic feedback generated based on the gesture input in a state where the user is not in contact with the haptic feedback providing device 200 and receives haptic feedback from the haptic feedback providing device 200 to generate haptic feedback.

In one embodiment, the wearable device 100 may automatically connect to the haptic feedback providing device 200 within a critical distance from the wearable device 100. For example, the wearable device 100 may automatically connect to the haptic feedback providing device 200 within 10 meters.

In one embodiment, the wearable device 100 may transmit the wearable position information of the wearable device 100 to the haptic feedback providing device 200. For example, the wearable device 100 may transmit positional information, such as a right or left wrist, to the haptic feedback providing device 200 in the case of a bracelet.

In one embodiment, wearable device 100 may be a wearable type of device, such as a bracelet, landing gear, wrist watch, garment, or the like.

In one embodiment, the wearable device 100 may be multiple devices. For example, two bracelet-type wearable devices 100 may be worn on both wrists of a user.

In one embodiment, the wearable device 100 may receive haptic feedback from the haptic feedback providing device 200 using Bluetooth communication.

The haptic feedback providing apparatus 200 generates haptic feedback in a gesture input from a user in a contact state with a user and generates haptic feedback corresponding to a gesture input from the user in a non- And transmits the gesture information to the wearable device 100.

FIG. 1 (a) illustrates an exemplary situation in which a gesture is input when the user and the haptic feedback providing apparatus 200 are in contact with each other. Accordingly, in FIG. 1 (a), haptic feedback occurs in the haptic feedback providing apparatus 200.

FIG. 1 (b) illustrates an exemplary situation in which a gesture is input when the user and the haptic feedback providing apparatus 200 are in a non-contact state. Accordingly, in FIG. 1 (b), haptic feedback occurs in the wearable device 100.

2 is a block diagram of an apparatus 200 for providing haptic feedback according to an embodiment of the present invention.

Referring to FIG. 2, the haptic feedback providing apparatus 200 may include a gesture input unit 210, a haptic setting unit 220, a haptic feedback generating unit 230, and a haptic feedback transmitting unit 240.

The gesture input unit 210 receives a gesture from a user. Specifically, the gesture input 210 receives a gesture from a movement of a user's body-specific portion in contact with and contact with a specific portion of the user's body. Here, the gesture input in the contact state means, for example, that a moving operation is performed while the user's finger touches the touch panel. The gesture input in the non-contact state is a three-dimensional gesture, Quot; refers to an operation in which the user's finger moves in a state where the finger is not in contact with the finger.

In one embodiment, the gesture input 210 may include a camera, an infrared, an ultrasonic module, etc. to receive gestures in a non-contact state.

The haptic setting unit 220 sets a pattern of the haptic feedback to be generated corresponding to the gesture input from the user. For example, the haptic setting unit 220 may set the intensity of the vibration, the time interval, and the number of the wearable devices 100 to generate the haptic feedback differently for each specific gesture input.

In addition, the haptic setting unit 220 can set a haptic feedback pattern according to the texture of the content. For example, the haptic setting unit 220 may set the haptic pattern corresponding to the gesture that touches the rough content on the screen to an irregular vibration of a large intensity.

The haptic feedback generating unit 230 generates haptic feedback corresponding to a gesture input when the user and the haptic feedback providing apparatus 200 are in contact with each other.

In one embodiment, the haptic feedback generator 230 may be located at a portion where the user and the haptic feedback providing device 200 are in contact with the user at the time of gesture input.

The haptic feedback transmission unit 240 transmits gesture information input to the wearable device 100 so that haptic feedback corresponding to the gesture input in a non-contact state between the user and the haptic feedback providing device 200 can be generated in the wearable device 100 .

In one embodiment, the haptic feedback transmission unit 240 may transmit the input gesture information to the wearable device 100 in a non-contact state using a Bluetooth communication method.

3 is a flowchart of a method for providing haptic feedback according to an embodiment of the present invention. Hereinafter, an example in which the haptic feedback providing method is performed by the haptic feedback providing apparatus 200 will be described as an example.

In step S310, the haptic feedback providing apparatus 200 sets a haptic feedback pattern to be generated corresponding to the inputted gesture.

In step S320, the haptic feedback providing apparatus 200 receives the gesture from the user.

In step S330, the haptic feedback providing apparatus 200 determines whether the gesture input from the user has been input while the user and the haptic feedback providing apparatus 200 are in contact with each other.

In step S340, the haptic feedback providing apparatus 200 generates haptic feedback corresponding to the input gesture if the gesture is input in the touched state.

In step S350, the haptic feedback providing apparatus 200 determines whether or not the gesture is input in the non-contact state so that the haptic feedback corresponding to the gesture input in the non-contact state occurs in the wearable apparatus 100 And transmits the input gesture information to the wearable device 100.

4 is a view for explaining haptic feedback according to a gesture input in a non-contact state according to an embodiment of the present invention.

4, when a user wears a wearable device 100 in the form of a bracelet and inputs a gesture for picking up and releasing specific contents, and a situation in which the device 200 and the wearable device A haptic feedback pattern generated in the haptic feedback device 100 is shown.

At the first contact interval t0, the haptic feedback providing apparatus 200 generates a certain intensity of vibration, and the wearable apparatus 100 does not generate haptic feedback.

In the non-contact section t1, the wearable apparatus 100 generates a certain intensity of vibration, and the haptic feedback providing apparatus 200 does not generate haptic feedback.

At the second contact interval t2, the haptic feedback providing apparatus 200 generates a certain intensity of vibration, and the wearable apparatus 100 does not generate haptic feedback.

FIG. 5 is a view for explaining a haptic feedback pattern corresponding to a picking-up and dropping-down gesture according to an embodiment of the present invention.

Fig. 5 (a) shows a haptic feedback pattern according to the picking-up gesture. The haptic feedback providing apparatus 200 generates the haptic feedback for a predetermined period of time T and the wearable apparatus 100 receives the haptic feedback from the user 200 Generates haptic feedback from time t after elapse of time t until time t.

FIG. 5 (b) shows a haptic feedback pattern according to the drop gesture. The wearable device 100 generates the haptic feedback for a predetermined time T and the haptic feedback providing device 200 receives the haptic feedback from the haptic feedback providing device 200, Generates haptic feedback from time t after elapse of time t until time t.

The apparatus and method according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer readable medium may include program instructions, data files, data structures, and the like, alone or in combination.

Program instructions to be recorded on a computer-readable medium may be those specially designed and constructed for the present invention or may be available to those skilled in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes hardware devices specifically configured to store and execute program instructions such as magneto-optical media and ROM, RAM, flash memory, and the like. The above-mentioned medium may also be a transmission medium such as a light or metal wire, wave guide, etc., including a carrier wave for transmitting a signal designating a program command, a data structure and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The embodiments of the present invention have been described above. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (1)

A gesture input unit for receiving a gesture from a user;
A haptic setting unit for setting a haptic feedback corresponding to the gesture;
A haptic feedback generator for generating haptic feedback according to a gesture input in a state of being in contact with the user; And
A haptic feedback transmission unit for transmitting haptic feedback according to a gesture inputted in a non-contact state with the user to the wearable device worn by the user,
The haptic feedback device comprising:
KR1020150049817A 2015-04-08 2015-04-08 System, apparatus and method for providing 3d haptic feedback KR20160120856A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150049817A KR20160120856A (en) 2015-04-08 2015-04-08 System, apparatus and method for providing 3d haptic feedback

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150049817A KR20160120856A (en) 2015-04-08 2015-04-08 System, apparatus and method for providing 3d haptic feedback

Publications (1)

Publication Number Publication Date
KR20160120856A true KR20160120856A (en) 2016-10-19

Family

ID=57250462

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150049817A KR20160120856A (en) 2015-04-08 2015-04-08 System, apparatus and method for providing 3d haptic feedback

Country Status (1)

Country Link
KR (1) KR20160120856A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110692030A (en) * 2017-06-14 2020-01-14 福特全球技术公司 Wearable haptic feedback

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110692030A (en) * 2017-06-14 2020-01-14 福特全球技术公司 Wearable haptic feedback

Similar Documents

Publication Publication Date Title
US11392212B2 (en) Systems and methods of creating a realistic displacement of a virtual object in virtual reality/augmented reality environments
US11237625B2 (en) Interaction engine for creating a realistic experience in virtual reality/augmented reality environments
CN107810465B (en) System and method for generating a drawing surface
CN105518575B (en) With the two handed input of natural user interface
EP2907004B1 (en) Touchless input for a user interface
KR20200099574A (en) Human interactions with aerial haptic systems
EP3811183B1 (en) Methods and apparatuses for providing input for head-worn image display devices
Kharlamov et al. TickTockRay: smartwatch-based 3D pointing for smartphone-based virtual reality
EP2405403A1 (en) Three Dimensional User Interface
CN108027657A (en) Context sensitive user interfaces activation in enhancing and/or reality environment
JP6595597B2 (en) Wearable device, control method, and control program
CN105765490A (en) Systems and techniques for user interface control
KR102147430B1 (en) virtual multi-touch interaction apparatus and method
CN103339591A (en) Apparatus and method for user input for controlling displayed information
EP3353634B1 (en) Combining mobile devices with people tracking for large display interactions
US9753539B2 (en) Method, device, system and non-transitory computer-readable recording medium for providing user interface
CN103823548A (en) Electronic equipment, wearing-type equipment, control system and control method
KR20160137253A (en) Augmented Reality Device, User Interaction Apparatus and Method for the Augmented Reality Device
CN103558913A (en) Virtual input glove keyboard with vibration feedback function
KR20160120856A (en) System, apparatus and method for providing 3d haptic feedback
Knierim et al. The SmARtphone Controller: Leveraging Smartphones as Input and Output Modality for Improved Interaction within Mobile Augmented Reality Environments
KR102050600B1 (en) Wearable electronic device
KR20170021910A (en) Method, device, system and non-transitory computer-readable recording medium for providing user interface
WO2022174192A1 (en) X-ray sight view and remote anchor for selection tasks in xr environment
WO2015002566A1 (en) Interface device for a computer system ("virtual tablet")