KR20170016695A - Interaction controller, system and method for providing haptic feedback using the interaction controller - Google Patents

Interaction controller, system and method for providing haptic feedback using the interaction controller Download PDF

Info

Publication number
KR20170016695A
KR20170016695A KR1020150110132A KR20150110132A KR20170016695A KR 20170016695 A KR20170016695 A KR 20170016695A KR 1020150110132 A KR1020150110132 A KR 1020150110132A KR 20150110132 A KR20150110132 A KR 20150110132A KR 20170016695 A KR20170016695 A KR 20170016695A
Authority
KR
South Korea
Prior art keywords
haptic
interaction controller
controller
haptic actuators
feedback
Prior art date
Application number
KR1020150110132A
Other languages
Korean (ko)
Inventor
김진용
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR1020150110132A priority Critical patent/KR20170016695A/en
Publication of KR20170016695A publication Critical patent/KR20170016695A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

The present invention relates to an interactive controller for providing haptic feedback, and a system and method for providing haptic feedback using the haptic feedback. The haptic actuator includes a plurality of haptic actuators arranged at regular intervals in a grip portion of an interaction controller, And haptic feedback is provided to the user by operating a plurality of haptic actuators in response to feedback based on the interaction of the content on the screen. In this case, the plurality of haptic actuators operate independently of each other, thereby allowing the user to more finely provide spatial haptic feedback.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a system and a method for providing haptic feedback using an interaction controller, an interaction controller,

The present invention relates to an interactive controller for interacting with content on a screen and a system and method for providing feedback using the interactive controller. More particularly, the present invention relates to a system and method for providing haptic feedback To a haptic feedback interaction controller and a system and method for providing haptic feedback using the same.

The interactive controller means a device that controls contents on the screen according to the movement of the user and transmits feedback according to contents on the screen to the user, and can transmit haptic feedback according to the content control on the screen.

A gaming interactive controller for interacting with content on the screen, such as a Wii remote controller of a conventional interactive controller, such as Nintendo's Wii remote controller, is a general vibration that does not take into account the user's gesture or content situation when interacting with objects on the screen. To provide haptic feedback.

The Nintendo Wii Remote uses a motion detection function, an optical sensor and an accelerometer to recognize the user's gesture and interact with the content on the screen through the user's gesture. The user with the remote control can navigate the screen, When I select and interact with the object, I move by referring to the visual feedback displayed on the screen on the movement of my gesture.

Therefore, the conventional interactive controller has a problem that it is difficult for the user to move with the user's motion or to interact with the detailed motion.

In addition, since the simple vibration is transmitted to the user, there is a limitation in transmitting various events such as a game effect appearing on the screen to the interaction controller, and thus the feedback can not be effectively transmitted.

In order to solve the above-described problems, the present invention provides a method and apparatus for providing spatial tactile feedback as well as visual feedback based on the motion of an interaction controller through an interaction controller including a plurality of haptic actuators arranged in two dimensions It is an object of the present invention to provide an interaction controller.

According to an aspect of the present invention, there is provided an acceleration sensor comprising: a sensor unit including a gyro sensor and an acceleration sensor; And a plurality of haptic actuators arranged at regular intervals on the handle portion and including a plurality of haptic actuators operated according to the movement detected by the sensor portion, wherein the plurality of haptic actuators include a two- And the display controller is configured in a display form.

The sensor unit includes a wireless communication module, and transmits data sensed by the gyro sensor and the acceleration sensor to the main terminal through the wireless communication module, and the plurality of haptic actuators are received through a wireless communication module of the sensor unit Lt; / RTI > In addition, the sensor unit transmits operating state information of the plurality of haptic actuators to the main terminal, and transmits feedback information received from the main terminal to the plurality of haptic actuators.

The plurality of haptic actuators operate independently of each other, and operate at different intensities depending on the motion sensed by the sensor portion and the position of each haptic actuator.

Further, the plurality of haptic actuators may operate sequentially in a same time interval or in a same time or in a same row, and the plurality of haptic actuators may be arranged such that each of the haptic actuators operates in accordance with the same haptic drive signal, And operates in accordance with other haptic drive signals.

According to another aspect of the present invention, there is provided an interactive controller including a plurality of haptic actuators arranged at regular intervals in a handle portion and operating the plurality of haptic actuators according to movement sensed by a sensor portion. And a main terminal for receiving the motion information of the interaction controller and the operation state information of the plurality of haptic actuators from the interaction controller and transmitting feedback based on the received motion information and the operation state information to the interaction controller And provides a haptic feedback providing system using an interaction controller.

According to the present invention, it is possible to provide various spatial tactile feedback according to the motion of the interaction controller through a plurality of two-dimensionally arranged haptic actuators.

In addition, the user can precisely control the movement of the controller through visual feedback on the screen as well as the spatial tactile feedback provided through the interaction controller, providing tactile feedback in the form of a two-dimensional arrangement rather than a simple general vibration Game effects, and so on.

1 is a block diagram illustrating a configuration of an interactive controller according to an embodiment of the present invention.
2 is a two-dimensional diagram illustrating a haptic portion of an interaction controller according to an embodiment of the present invention.
3 is an illustration of an embodiment for providing haptic feedback by an interaction controller in accordance with an embodiment of the present invention.
4 is a flowchart illustrating a method of providing haptic feedback using an interaction controller according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. And is provided to fully convey the scope of the invention to those skilled in the art, and the present invention is defined by the claims.

It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. &Quot; comprises " and / or "comprising" when used in this specification is taken to specify the presence or absence of one or more other components, steps, operations and / Or add-ons. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 illustrates a structure of an interaction controller 100 according to an embodiment of the present invention.

The interaction controller 100 according to an embodiment of the present invention includes a sensor unit 110 and a haptic unit 120.

The sensor unit 110 includes a wireless communication module 111, a gyro sensor 112 and an acceleration sensor 113. The haptic unit 120 includes a plurality of haptic actuators 121 arranged at regular intervals.

The sensor unit 110 senses the movement of the interaction controller 100 through the gyro sensor 112 and the acceleration sensor 113 and detects the movement of the interaction controller 100 such as the position, Provide information in real time.

The gyro sensor 112 of the sensor unit 110 recognizes the motion in three axes and transmits the posture and direction data of the interaction controller 100 for balance and three-dimensional feeling in real time, and the acceleration sensor 113 transmits three Axis, and transmits the acceleration data for the velocity, tilt, and motion of the interaction controller 100 in real time.

Therefore, the accurate three-dimensional movement direction, distance, and position can be measured and transmitted in real time using the gyro sensor 112 and the acceleration sensor 113 together.

The haptic part 120 includes a plurality of haptic actuators 121 in the form of a cylindrical or polygonal handle. The haptic actuators 121 have a two-dimensional array of tactile displays.

Each of the haptic actuators 121 is disposed at regular intervals and provides a driver for driving a plurality of haptic actuators. The haptic driver provides a switch or MUX capable of driving each of the haptic actuators < RTI ID = 0.0 > 121. < / RTI >

FIG. 2 is a cross-sectional view of the haptic portion 120 of the interaction controller 100 according to an embodiment of the present invention.

As shown in FIG. 2, the haptic actuator 121 in the haptic part 120 is formed at regular intervals according to rows and columns. Each of the haptic actuators 121 can perform various haptic actuations according to the haptic signal. And the intensity of the haptic signal for each haptic actuator 121 can be adjusted.

Accordingly, the haptic actuator 121 of the haptic part 120 operates according to the movement sensed by the sensor part 110, thereby providing haptic actuation according to the movement to the user, and a plurality of haptic actuators 121 Independent operation to provide spatial haptic feedback.

In this case, the plurality of haptic actuators 121 operate independently, or may operate according to the same haptic signal or may operate according to different haptic signals. According to an embodiment of the present invention, the haptic actuators 121, (121) may be operated sequentially.

The sensor unit 110 transmits the sensed motion information to the haptic unit 120 so that the haptic actuator 121 is operated and the motion information sensed through the wireless communication module 111 and the operation of the haptic actuator 121 State information to the main terminal 200 and transmit the feedback received from the main terminal 200 to the haptic actuator 121. This will be described in detail with reference to the embodiment of Fig.

FIG. 3 illustrates a configuration of a system for providing haptic feedback using an interaction controller 100 according to an embodiment of the present invention. The interaction controller 100 interacts with a virtual object displayed on a screen 300 .

As shown in Figure 3, a user grasps the haptic portion 120 of the interaction controller 100 and moves the interaction controller 100 to interact with the content shown on the screen 300.

The interaction controller 100 senses the motion of the interaction controller 100 through the sensor unit 110 and outputs motion information such as position, direction, velocity, and acceleration. Accordingly, the plurality of haptic actuators 121 of the haptic part 120 operate.

For example, when the interaction controller 100 is shaken up and down like a water bottle, the plurality of haptic actuators 121 may include a plurality of haptic actuators 121 arranged two-dimensionally as if the water in the water bottles moves up and down, Oscillate sequentially in the same column or in the same row. Thus, the user can receive feedback such as shaking the actual water bottle.

The motion information measured through the sensor unit 110 is transmitted to the main terminal 200 through the wireless communication module 111 and is displayed as a movement of a virtual object through the screen 300. The main terminal 200 And transmits the feedback according to the motion of the virtual object to the interaction controller 100.

Accordingly, the interaction controller 100 provides haptic feedback to the user by operating the haptic actuator 121 by receiving the feedback generated according to the motion on the screen 300 while providing the haptic actuation according to the motion.

4 is a flowchart illustrating a method of providing haptic feedback using the interaction controller 100 according to an embodiment of the present invention.

When the user grasps and moves the interaction controller 100, the interaction controller 100 senses the movement of the interaction controller 100 (S400), and transmits information such as position, direction, speed, and acceleration according to the sensed movement Output.

Then, information on the output motion is transmitted to the haptic feedback drive driver (S410), and a plurality of haptic actuators 121 arranged at regular intervals in the haptic unit 120 are operated according to the haptic signal according to the motion ).

Accordingly, the user may use the interaction controller 100 and be provided with a plurality of haptic actuators 121 arranged at regular intervals to generate haptic actuations according to the motion. At this time, haptic feedback is provided through a plurality of haptic actuators 121 that operate independently and are arranged at regular intervals, thereby providing fine haptic actuation.

The main terminal 200 generates feedback on the contents of the screen 300 according to the motion of the interaction controller 100 and transmits the information on the mutual operation to the main terminal 200 To the action controller 100 (S440).

The interaction controller 100 transmits the feedback received from the main terminal 200 to the haptic feedback drive driver in operation S410 and activates the haptic actuator 121 in operation S420 to perform the interaction with the content on the screen 300 So that the spatial haptic feedback can be provided to the user.

The foregoing description is merely illustrative of the technical idea of the present invention and various changes and modifications may be made without departing from the essential characteristics of the present invention. Therefore, the embodiments described in the present invention are not intended to limit the scope of the present invention, but are intended to be illustrative, and the scope of the present invention is not limited by these embodiments. It is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents, which fall within the scope of the present invention as claimed.

100: interaction controller 110: sensor unit
111: Wireless communication module 112: Gyro sensor
113: Acceleration sensor 120: Haptic part
121: Haptic actuator 200: Main terminal
300: Screen

Claims (14)

A sensor unit including a gyro sensor and an acceleration sensor; And
And a plurality of haptic actuators arranged at regular intervals on the handle portion and operating in accordance with the movement sensed by the sensor portion,
/ RTI >
The method according to claim 1,
The plurality of haptic actuators are configured in a tactile display form of a two-dimensional array on a cylindrical handle portion
In interaction controller.
The method according to claim 1,
The sensor unit includes a wireless communication module and transmits data detected by the gyro sensor and the acceleration sensor to the main terminal through the wireless communication module
In interaction controller.
The method of claim 3,
Wherein the plurality of haptic actuators operate in accordance with data received through the wireless communication module of the sensor unit
In interaction controller.
The method of claim 3,
Wherein the sensor unit transmits operating state information of the plurality of haptic actuators to the main terminal and transmits feedback information received from the main terminal to the plurality of haptic actuators
In interaction controller.
The method according to claim 1,
The plurality of haptic actuators is characterized in that each haptic actuator is operated independently
In interaction controller.
The method according to claim 1,
The plurality of haptic actuators operate at different intensities depending on the movement sensed by the sensor unit and the position of each haptic actuator
In interaction controller.
The method according to claim 1,
The plurality of haptic actuators are arranged such that the haptic actuators arranged in the same column or in the same row sequentially operate at a constant time interval
In interaction controller.
The method according to claim 1,
The plurality of haptic actuators is characterized in that each haptic actuator operates in accordance with the same haptic drive signal
In interaction controller.
The method according to claim 1,
The plurality of haptic actuators is characterized in that each of the haptic actuators operates in accordance with different haptic drive signals
In interaction controller.
An interaction controller including a plurality of haptic actuators arranged at regular intervals in a handle portion and operating the plurality of haptic actuators according to movement sensed by the sensor portion; And
A main controller for receiving the motion information of the interaction controller and the operation state information of the plurality of haptic actuators from the interaction controller and transmitting feedback based on the received motion information and the operation state information to the interaction controller,
Wherein the haptic feedback system comprises an interactive controller.
12. The method of claim 11,
The interaction controller may operate the plurality of haptic actuators according to feedback received from the main terminal
A system for providing haptic feedback using an interactive controller.
12. The method of claim 11,
Wherein the interaction controller comprises independently operating the plurality of haptic actuators
A system for providing haptic feedback using an interactive controller.
12. The method of claim 11,
The main terminal controls content on the screen in accordance with the motion information received from the interaction controller and transmits feedback based on the user's movement to the content on the screen to the interaction controller
A system for providing haptic feedback using an interactive controller.

KR1020150110132A 2015-08-04 2015-08-04 Interaction controller, system and method for providing haptic feedback using the interaction controller KR20170016695A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150110132A KR20170016695A (en) 2015-08-04 2015-08-04 Interaction controller, system and method for providing haptic feedback using the interaction controller

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150110132A KR20170016695A (en) 2015-08-04 2015-08-04 Interaction controller, system and method for providing haptic feedback using the interaction controller

Publications (1)

Publication Number Publication Date
KR20170016695A true KR20170016695A (en) 2017-02-14

Family

ID=58121071

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150110132A KR20170016695A (en) 2015-08-04 2015-08-04 Interaction controller, system and method for providing haptic feedback using the interaction controller

Country Status (1)

Country Link
KR (1) KR20170016695A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190058111A (en) * 2017-11-21 2019-05-29 삼성전자주식회사 Method and apparatus for providing vibration
KR20200110502A (en) 2019-03-13 2020-09-24 한림대학교 산학협력단 Haptic controller, and System and Method for providing haptic feedback using the haptic controller
KR102355274B1 (en) 2020-11-20 2022-02-07 플레이스비 주식회사 System and method for providing temperature feedback using haptic controller
KR20220055646A (en) 2020-10-27 2022-05-04 플레이스비 주식회사 Haptic feedback system and method using haptic controller and electromyogram sensor
KR20230100455A (en) * 2021-12-28 2023-07-05 플레이스비 주식회사 Haptic controller apparatus

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190058111A (en) * 2017-11-21 2019-05-29 삼성전자주식회사 Method and apparatus for providing vibration
US11262845B2 (en) 2017-11-21 2022-03-01 Samsung Electronics Co., Ltd. Device and method for providing vibration
KR20200110502A (en) 2019-03-13 2020-09-24 한림대학교 산학협력단 Haptic controller, and System and Method for providing haptic feedback using the haptic controller
KR20220055646A (en) 2020-10-27 2022-05-04 플레이스비 주식회사 Haptic feedback system and method using haptic controller and electromyogram sensor
KR102355274B1 (en) 2020-11-20 2022-02-07 플레이스비 주식회사 System and method for providing temperature feedback using haptic controller
KR20230100455A (en) * 2021-12-28 2023-07-05 플레이스비 주식회사 Haptic controller apparatus

Similar Documents

Publication Publication Date Title
US9360944B2 (en) System and method for enhanced gesture-based interaction
US10331232B2 (en) Controller with situational awareness display
US10294069B2 (en) Multimodal user interface for destination call request of elevator systems using route and car selection methods
JP6093473B1 (en) Information processing method and program for causing computer to execute information processing method
KR20170016695A (en) Interaction controller, system and method for providing haptic feedback using the interaction controller
US20140309032A1 (en) Game controller and game system
US8847883B2 (en) Input apparatus, input method, and control system
KR101695365B1 (en) Treadmill motion tracking device possible omnidirectional awarenessand move
JP6877689B2 (en) Programming device and its control program, programming method
KR102449439B1 (en) Apparatus for unmanned aerial vehicle controlling using head mounted display
WO2014048506A1 (en) Remote control with 3d pointing and gesture recognition capabilities
US20170087455A1 (en) Filtering controller input mode
WO2018180050A1 (en) Programming device and recording medium, and programming method
JPH05149966A (en) Control unit
EP3489804A1 (en) Haptic accessory apparatus
CN117348743A (en) Computer, rendering method and position indication device
KR101291602B1 (en) Mixed Object, Tangible Science Experiment System and Providing Method Thereof
US20100313133A1 (en) Audio and position control of user interface
JP6140871B1 (en) Information processing method and program for causing computer to execute information processing method
US20140059255A1 (en) Input device, input system, electronic apparatus, and sense presentation method
JP2011065512A (en) Information processing system, information processing program, operation recognition system, and operation recognition program
KR101398402B1 (en) Screen Shooting Simulation System With Mat-type Recognition Interface For Movement
JP2018026105A (en) Information processing method, and program for causing computer to implement information processing method
Paravati et al. A reconfigurable multi-touch framework for teleoperation tasks
WO2019059944A1 (en) Sensing movement of a hand-held controller