KR20110032224A - System and method for providing user interface by gesture, gesture signal generator and terminal thereof - Google Patents

Abstract

PURPOSE: A mobile terminal UI recognizing a gesture, and a device for generating gesture signal are provided to offer a UI(User Interface) through a gesture on a space or a screen. CONSTITUTION: A gesture signal generator(1) installed a mobile terminal detects a user's gesture. The gesture signal generating apparatus generates gesture signal corresponding to the gesture, and outputs the gesture signal through local area wireless communication. If an event is generated, the mobile terminal(2) outputs an image corresponding to the event. If the gesture signal is received, the mobile terminal extracts a command corresponding to the gesture signal, and executes the command.

Description

System and method for providing a user interface by a gesture and a gesture signal generator and a terminal therefor {System and Method for Providing User Interface by Gesture, Gesture Signal Generator and Terminal}

The present invention relates to a user interface technology, and more particularly, to recognize an image output on a space or a screen, and when a user makes a gesture, a gesture signal generator mounted on the user generates a gesture signal. The present invention relates to a system and method for providing a user interface by a gesture which transmits to a terminal, and outputs an image corresponding to the execution result while the terminal extracts and executes a command corresponding to the gesture signal. .

Existing terminals configure input devices such as a keypad, a touch screen, a joystick, and a scroll wheel to support a user's operation, and a user operates a terminal or inputs necessary information into the terminal using the input device.

In this way, the user manipulates the input device according to a batch method and uses a function provided by the terminal. For example, the interface is performed by pressing a button provided on the front or side of the terminal or using a stylus pen.

However, since a keypad, a touch screen, a joystick, a scroll wheel, and the like must input within a limited area, there is a problem in that an area of a user interface is limited.

In order to solve such a conventional problem, the present invention can output an image on a space or screen, the terminal capable of outputting an image corresponding to the execution result of the command matched to the gesture signal, corresponding to the user's gesture It is an object of the present invention to provide a system and method for providing a user interface by a gesture that can extend a user interface environment to a space through a gesture signal generator capable of generating a gesture signal, and a gesture signal generator and a terminal therefor.

In order to achieve this object, a system for providing a user interface by a gesture according to the present invention is characterized by including a gesture signal generator and a terminal. The gesture signal generator is mounted on a user to detect a gesture of the user to generate a gesture signal corresponding to the gesture, and output the gesture signal through short-range wireless communication. The terminal outputs an image corresponding to the event in space when an event occurs. When the gesture signal is received from the gesture signal generator through short-range wireless communication, the terminal extracts a command corresponding to the gesture signal and executes the command. The image is output on the space corresponding to the execution result of the command.

In addition, the gesture signal generator of the user interface providing system according to the present invention is characterized in that it comprises a communication unit, a sensor unit, a control unit. The communication unit transmits and receives data through short-range wireless communication. The sensor unit detects a user's gesture. When the detection signal is transmitted from the sensor unit, the controller generates a gesture signal from the detection signal, and transmits the gesture signal to a terminal that outputs an image in the space through the communication unit. In this case, the sensor unit includes at least one of an inertial sensor for detecting a movement or position of the user and a distance sensor for detecting or measuring a distance relationship with the terminal. Here, the inertial sensor may be a gyro sensor or an acceleration sensor. In addition, when the response signal for the execution result of the gesture signal is received through the communication unit, it is preferable to further include a vibration unit for generating a vibration under the control of the controller. The gesture signal generator may be a ring type.

In addition, the terminal of the user interface providing system according to the present invention is characterized in that it comprises a communication unit, an image output unit, a storage unit and a terminal control unit. The communication unit transmits and receives data through wireless communication. The image output unit outputs an image in space. The storage unit stores a command corresponding to the gesture signal. When the event is received through the communication unit, the terminal controller outputs the event occurrence corresponding to the event as an image on the space through the image output unit, and receives the gesture signal received through the communication unit to receive the gesture signal. Extracts a command corresponding to and executes the command, and outputs the execution result of the command as an image on the space through the image output unit. In this case, the communication unit includes a short-range wireless communication module, and when the terminal control unit receives a gesture signal using the short-range wireless communication module included in the communication unit, the image corresponding to the gesture signal through the image output unit Output on space. The communication unit may include a mobile communication module. When the terminal control unit receives a text message or an incoming signal by using the mobile communication module included in the communication unit, the communication unit may be configured to indicate an event occurrence corresponding to the text message or the incoming signal. The image output unit outputs the image on the space. The image output unit may include at least two light source units, and the light source unit may control a position of the light source units such that some light source units collect diffusely reflected coherent light output from the light source unit and project the light onto a specific area of the space. The position of the remaining light source unit may be controlled to project the reference light to the specific area, and may be projected onto the space.

In addition, a method for providing a user interface by a gesture according to the present invention may include: a first output step of outputting an image in a space by a terminal when an event occurs, a reception step of receiving a gesture signal transmitted from a gesture signal generator by the terminal, An extraction step of extracting a command corresponding to the gesture signal received by the terminal, an execution step of executing the command extracted by the terminal, and outputting an image corresponding to an execution result of the command on the space by the terminal; It characterized in that it comprises two output stages. In this case, when the terminal receives the gesture signal through the short range wireless communication module or receives a text message or an incoming call through the mobile communication module, the terminal outputs an image corresponding to the gesture signal. Outputting the image on the space or generating an event corresponding to the text message or the incoming signal as an image on the space. The first output step may further include outputting the same image as the image output on the space through a display unit provided in the main body of the terminal. The image output on the space may include outputting light from a light source unit, controlling a position to collect diffusely reflected coherent light output from some light source units of the light source unit, and to project the light onto a corresponding image position, Controlling a position to project the reference light to the corresponding image position, and projecting the coherent light and the reference light onto the space. After the second output step, the terminal may further include a step of transmitting a response signal to a result of executing the command, and generating a vibration by the gesture signal generator receiving the response signal. .

As described above, since the present invention performs the user interface through a user gesture on a space or a screen, the user can extend the interface environment and provide convenience to the user.

In addition, the present invention can match various user gestures and terminal functions, thereby providing enjoyment of terminal operation through various operation methods.

In addition, the present invention may provide a more extended user interface environment through a combination with virtual reality.

Hereinafter, with reference to the accompanying drawings will be described in detail an embodiment of the present invention.

1 is a conceptual diagram illustrating a user interface providing system using a gesture according to an embodiment of the present invention.

Referring to FIG. 1, a system for providing a user interface based on a gesture according to the present exemplary embodiment may include a gesture signal generator 1 that generates a gesture signal corresponding to a gesture of a user and an image on a space or a screen. It comprises a terminal (2).

The gesture signal generator 1 performs a function of generating a gesture signal corresponding to a gesture of a user. To this end, the gesture signal generator 1 includes a sensor for detecting a user's movement, which includes a spin gyro, a bar gyro, a wire gyro and an accelerometer. You can use a gyroscope such as an accelerometer. In addition, it may include a distance sensor for sensing the distance to set the initial position between the gesture signal generator 1 and the terminal (2). In addition, the gesture signal generator 1 performs a function of transmitting the detected signal to the adjacent terminal 2. To this end, the gesture signal generator 1 includes a short range wireless communication module, and the short range wireless communication module includes a Bluetooth module, a Zigbee module, a Radio Frequency Identification (RFID) module, and a UWB (Ultra Wide). At least one of a Band module and an Infrared Data Association (IrDA) module may be applied. In addition, the gesture signal generator 1 may provide a switch for supporting a user operation, for example, a switch for supplying power, a switch for dragging or clicking an object in an image output on a space or screen, and the like. Can be. As such, the gesture signal generator 1 detects a user's gesture by a sensor, processes the detected signal, and transmits the detected signal to a terminal through short-range wireless communication to interface with an image output on a space or a screen. The gesture signal generator 1 is manufactured in a ring type such as a ring or a bracelet, and can be easily mounted by a user. The gesture signal generator 1 may be manufactured in a band type and attached like a band-aid.

Meanwhile, the terminal 2 receives a gesture signal transmitted from the gesture signal generator 1 and reflects it to an image output on a space or a screen. To this end, the terminal 2 includes holography or projection for outputting an image on a space or screen. This holography or projection preferably uses a projection type that projects light to the outside of the terminal 2. In addition, the terminal 2 performs a function of receiving a gesture signal from the gesture signal generator 1. To this end, the terminal 2 includes a short range wireless communication module, which includes a Bluetooth module, a Zigbee module, a Radio Frequency Identification (RFID) module, and a UWB (Ultra Wide Band) module. At least one of the Infrared Data Association (IrDA) modules may be applied. In addition, the terminal 2 stores a command corresponding to the gesture signal. Through this command, the control of the object and the image itself displayed on the image is made. As such, the terminal 2 receives the gesture signal, extracts and executes a command corresponding to the gesture signal, and outputs an image corresponding to the execution result of the command.

As described above, a process of performing an interface between the gesture signal generator 1 and the terminal 2 constituting the user interface providing system by gestures is as follows. First, when the terminal 2 outputs an image on a space or a screen, the user recognizes the image and makes a gesture using the gesture signal generator 1. The gesture signal generator 1 generates a gesture signal and transmits the gesture signal to the terminal 2. Meanwhile, the terminal 2 receives the gesture signal, extracts a command corresponding to the gesture signal, and outputs an execution result according to the execution of the command on the image.

Next, the configuration of the gesture signal generator 1 and the terminal 2 for providing the user interface by the gesture will be described in detail.

2 is a block diagram showing a gesture signal generator according to an embodiment of the present invention.

Referring to FIG. 2, the gesture signal generator 1 according to the present embodiment includes a power supply unit 11, a communication unit 12, a sensor unit 13, a vibration unit 14, a memory unit 15, and a control unit. It comprises 16.

The power supply unit 11 performs a function of supplying power to a circuit of the gesture signal generator 1 in response to a user's power switch (not shown) operation or a driving request signal transmitted from the terminal 2.

The communication unit 12 performs a function of transmitting the gesture signal generated by the user gesture to the terminal 2 under the control of the controller 16. In addition, the communication unit 12 receives a response signal transmitted from the terminal 2 and transmits the response signal to the control unit 16.

The sensor unit 13 detects a user gesture and transmits the gesture to the control unit 16. That is, when the sensor unit 13 outputs at least one detection signal among a user's movement direction, movement tilt, movement speed, and movement time, the controller 16 performs an encoding process to generate a gesture signal. In order to generate such a gesture signal, the sensor unit 13 measures an inertial sensor for detecting a movement or position of a gyro sensor, an acceleration sensor, or the like, or a distance relationship between the gesture signal generator 1 and the terminal 2. It may include a distance sensor for detecting or measuring.

The vibrator 14 receives a response signal transmitted from the terminal 2 and generates a vibration under the control of the controller 16. That is, the vibrator 14 may generate a vibration by receiving a response signal or an error state transmitted from the terminal 2 to an error response signal that alerts the user, thereby making it possible to feel the result of the user gesture as a vibration. . Although the vibration unit 14 is exemplified in the present embodiment, it may be possible to feel the response to the gesture in various ways such as electric stimulation, sound, image, and fragrance.

The memory unit 15 stores information about the execution program and the gesture signal generator 1 and performs a function of providing the corresponding data in response to the execution program or the specific data call from the control unit 16. Here, the execution program stored in the memory unit 15 includes a communication signal processing program for transmitting the gesture signal generated by the control of the control unit 16 through the communication unit 12.

In addition, the controller 16 performs a function as a microprocessor for performing an overall control operation of the gesture signal generator 1. That is, the controller 16 generates a gesture signal by encoding the detection signal transmitted from the sensor unit 13 to the terminal 2 and transmits the generated gesture signal to the communication unit 12 to communicate with the communication unit 12. Control the transmission of the data, call the executable program and the specific data from the memory 15, decode the response signal or the error response signal received through the communication unit 12 and transmit it to the vibration unit 14, and the vibration unit 14 ) To control the function.

3 is a block diagram showing a terminal according to an embodiment of the present invention.

Referring to FIG. 3, the terminal 2 according to the present embodiment includes a communication unit 21, an input unit 22, a storage unit 23, a display unit 24, an image output unit 25, and a vibration unit 26. And a sound source processing unit 27 and a terminal control unit 28.

The communication unit 21 performs a function of transmitting and receiving data through wireless communication. The communication unit 21 may include a mobile communication module 211 and a short range wireless communication module 212. The mobile communication module 211 performs a function of transmitting and receiving data such as a call and a message with the counterpart under the control of the terminal controller 28. The short-range wireless communication module 212 receives a gesture signal from the gesture signal generator 1 or transmits a response signal corresponding to the gesture to the gesture signal generator 1 under the control of the terminal controller 28. Do this.

The input unit 22 provides a plurality of keys for the operation of the terminal 2, and supports a user operation to transmit an input signal according to a user's key selection to the terminal controller 28. The input unit 22 may be a keypad, a pointing device such as a touch pad, a touch screen, or the like.

The storage unit 23 stores an execution program necessary for controlling the operation of the terminal 2, data generated during execution of the execution program, and commands corresponding to a gesture signal, and calls an execution program or a command from the terminal control unit 28. It performs the function of providing the corresponding data. To this end, the storage unit 23 may include one or more volatile memory devices and nonvolatile memory devices. In addition, the storage unit 23 may store a gesture signal matching program to match various commands in response to the gesture signal.

The display unit 24 performs a function of outputting information corresponding to a user's request on the panel under the control of the terminal control unit 28, including various function menus executed in the terminal 2. In addition, the display unit 24 may perform a function of outputting the same image as the image output from the image output unit 25 under the control of the terminal controller 28. As the display unit 24 performing such a function, a liquid crystal display (LCD) or a touch screen may be used. The touch screen may simultaneously serve as a display device and an input device.

When the video output unit 25 receives an event or a gesture signal generated in real time from the outside such as a call request or a message reception to the communication unit 21, the image output unit 25 controls the terminal control unit 28 to display the corresponding video space or screen. Performs a function to output to the image. On the other hand, the image output unit 25 may output the same content in conjunction with the display unit 24 as described above. The image output unit performing such a function may be holography or projection, and it is preferable to use a projection type for projecting light to the outside of the terminal 2.

First, holography may generate a 3D stereoscopic image represented by a plane or a stereoscopic image using two light sources. In other words, by scanning the space using the two infrared beams can be recognized by the user. By implementing the contrast using the interference of the two beams it is also possible to reproduce the three-dimensional image. To this end, the holography controls the position so that the two light source units and the image signal output from the terminal control unit collect the diffusely reflected coherent light output from one light source unit and project the image onto the corresponding image position. The light source may be configured to control the position of the light source to project the reference light to the corresponding image position, and the lens unit may enlarge and project the image output from the light scanner. As the light scanner portion, a rotating mirror that linearly deflects light output from two light sources can be used on the X axis. In addition, as the lens unit, a rotatable lens that linearly deflects light output through the rotatable mirror along the Y axis may be used. In addition to the analog light emitting device, a digital light emitting device such as a matrix image signal processor may be used.

On the other hand, the projector is provided with a light source unit composed of a light unit and a light homogenizing optical system such as a lamp unit and a red eye, and a red (R), green (G), blue (B) LED modules are separated from each other, and is provided from the light source unit according to the image signal And a lens unit for enlarging and projecting an image output from the light modulation device. In this case, the lamp unit may include not only a light emitting diode (LED) but also an organic light emitting diode (OLED), a laser diode (LD), and the like, and the optical modulation device may be a liquid crystal display (LCD) panel or a digital micromirror device (DMD) device. Transmissive or reflective light modulators such as GLV (Grating Light Valve) devices, Lcos, etc. may be selectively used.

The vibrator 26 performs a function of generating various vibrations under the control of the terminal controller 28 in response to various function menus executed in the terminal 2. That is, the vibrator 26 may generate vibrations in response to a user manipulation input through the input unit 22 or in response to a gesture signal, and may be linked with the display unit 24 and the sound source processing unit 27.

The sound source processing unit 27 digitizes the voice input through the microphone MIC to obtain voice information, and demodulates the voice information received through the communication unit 21 and outputs it through the speaker SPK. The sound source processor 27 may output a sound corresponding to the gesture signal through the speaker.

In addition, the terminal controller 28 performs a function as a microprocessor for performing the overall control operation of the terminal 2. In particular, the terminal controller 28 receives the gesture signal received from the short range wireless communication module 212 and extracts a command corresponding to the gesture signal from the storage unit 23 to perform a function of the terminal 2 corresponding to the command. Run That is, the terminal controller 28 extracts information corresponding to at least one of a user's movement direction, movement inclination, movement speed, and movement time from the gesture signal, and extracts a corresponding command from the storage unit 23. By executing the control result to be transmitted to the image output unit 25 according to the execution of the command output to the image. Meanwhile, the terminal controller 28 performs a control to transmit a response signal corresponding to the user gesture to the gesture signal generator 1 through the short range wireless communication module 212.

Meanwhile, in the present embodiment, the terminal 2 capable of making a call as a mobile communication terminal is illustrated as an example, but a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia (PMP) It is possible to apply all of the technical ideas of the present invention to a player) and a navigation device. In addition, in the above-described configuration, the present invention can be realized by using a terminal having a minimum configuration including a communication unit 21, a storage unit 23, an image output unit 25, and a terminal control unit 28. ), The storage unit 23, the display unit 24 and the terminal control unit 28 can be realized using the terminal of the minimum configuration. Accordingly, the present invention can be applied to a TV, a monitor, a projector, a stereoscopic image display device, etc. including a terminal having a minimum configuration.

Next, the user interface process in the user interface providing system by the gesture having the above configuration will be described in detail.

4 is a flowchart illustrating a method for providing a user interface by a gesture according to an embodiment of the present invention.

First, it is assumed that the gesture signal generator 1 maintains the off state as the initial state, and the terminal 2 maintains the standby state after the initial initialization. In addition, it is assumed that the gesture signal generator 1 is registered in the terminal 2. That is, it is assumed that basic information about the gesture signal generator 1 is stored in the terminal 2 through pairing between the gesture signal generator 1 and the terminal 2.

1 to 4, when an event such as a call request, a video call request, or a message reception is received from the outside through the mobile communication module 211 (S1), the terminal 2 is controlled by the terminal controller 28. ) Is made (S2). That is, the terminal 2 maintains the driving standby state, and when an event occurs, the display unit 24, the image output unit 25, the vibration unit 26, under the control of the terminal control unit 28 according to the event. The necessary device is driven among the sound source processing units 27.

As such, the display unit 24, the image output unit 25, the vibration unit 26, or the sound source processing unit 27 of the terminal 2 may be driven to output an image, a call sound, or a vibration on a screen, a space, or a screen. The display unit 24 or the image output unit 25 is driven to prepare the output or to output an image on the screen or a space or the screen so that a message can be output.

In the present embodiment, a case in which an event is received from the outside is described, but a user may generate an event for driving the terminal 2 by operating the terminal 2. In addition, the event may be a gesture signal, and may drive the terminal 2 as such a gesture signal.

Subsequently, in order to drive the gesture signal generator 1 according to the initial state condition, the terminal 2 is controlled by the terminal controller 28 to the gesture signal generator 1 through the short range wireless communication module 212. The driving request signal is transmitted (S3).

At this time, the terminal 2 transmits the driving request signal, and under the control of the terminal controller 28, the image output unit 25 outputs the image I corresponding to the corresponding event (S4). In this case, in the case of the terminal 2 to which the holography is applied, an image output is performed in the space, and in the case of the terminal to which the projection is applied, the image projection is performed on a screen or a wall. On the other hand, the display unit 24 may also output the image (I) corresponding to the event.

Meanwhile, the gesture signal generator 1 is supplied with power from the power supply unit 11 under the control of the controller 16 in response to receiving the driving request signal transmitted from the terminal 2 (S5). In the present embodiment, a case in which power is supplied to the gesture signal generator 1 by the driving request signal is described. However, a user arbitrarily turns on a power supply switch (not shown) to power the gesture signal generator 1. Supply may be made.

Accordingly, the gesture signal generator 1 is driven and initialized under the control of the controller 16 (S6). This initialization process is a process of recognizing the gesture signal generator 1 in the terminal 2 through communication between the communication unit 12 of the gesture signal generator 1 and the short-range wireless communication module 212 of the terminal 2. Include. That is, when the gesture signal generator 1 is driven, the recognition request message is transmitted to the terminal 2 through the communication unit 12 under the control of the control unit 16, so that the terminal 2 controls the terminal control unit 28. The recognition process is completed by confirming whether the gesture signal generator 1 is registered under the control of. In this way, technical information including a name, a class, a list of services, and a characteristic, a manufacturer, a specification, and the like for the gesture signal generator 1 stored in advance in the terminal 2 are stored. It may be confirmed whether the gesture signal generator 1 is registered in advance. Thereafter, the user mounts the gesture signal generator 1 on a finger, a wrist, or the like, and prepares to interface with the terminal 2.

Meanwhile, before performing the interface between the gesture signal generator 1 and the terminal 2, the initial position of the gesture signal generator 1 in the image I output through the image output unit 25 is set. You can proceed. The process of setting the initial position of the gesture signal generator 1 in the image I is as follows. First, the distance with the terminal 2 is sensed using the distance sensor included in the gesture signal generator 1. When the gesture signal generator 1 and the terminal 2 are determined to be within a preset distance, the gesture signal generator 1 transmits a cursor request signal to the terminal 2 under the control of the controller 16. Accordingly, the terminal 2 displays the cursor in the image I output on the space or the screen under the control of the terminal controller 28. At this time, the cursor is preferably located at the center of the image (I). Thereafter, in response to the movement of the gesture signal generator 1, the terminal 2 may output the movement of the cursor through the image output unit 25.

When the process of setting the initial position of the gesture signal generator 1 in the image I is completed, the gesture signal generator 1 determines whether there is a gesture by the user (S7). That is, the sensor unit 13 determines whether the user's gesture is detected.

As a result of the determination in step S7, when the sensor unit 13 does not detect the user's gesture, the sensor unit 13 maintains the gesture detection standby state.

As a result of the determination in step S7, when the sensor unit 13 detects a gesture of the user, the sensor unit 13 generates and outputs a gesture signal corresponding to the user gesture (S8).

Here, the types of gesture signals that may be generated from the sensor unit 13 will be briefly described.

First, a gesture that moves in a straight line toward a forward / rearward / leftward / rightward / upward / downward direction on a space or a screen is defined as a basic operation signal. Modification operation signals such as a direction, a rotation, and a tilt that combine two adjacent linear directions may be added thereto. It may also include a repetitive operation signal that includes a number of repetitive operations, such as a click operation. And, it may include an operation time for each operation signal. The basic operation signal, the modified operation signal, the repetitive operation signal, and the operation time may be arbitrarily combined, and the command of the terminal 2 may be matched with the combined operation signal, respectively. In this case, the user may arbitrarily match the operation signal and the command according to his or her taste.

For example, the cursor position is identified in the output image, and the terminal 2 outputs an image in which the cursor moves back, forth, left, and right in response to the user moving the gesture signal generator 1 in front, rear, left and right. When a specific button provided in the gesture signal generator 1 is pressed, an object such as an icon is selected, and when the object is moved back, front, left, or right in this state, the terminal 2 outputs an image in which the object moves back, forth, left, and right. When an object such as an icon is selected and double-clicked or moved up and down by using a specific button provided in the gesture signal generator 1, the terminal 2 outputs an image of data linked to the object. At this time, when the linked data is an e-book, when the gesture signal generator 1 is tilted to the left, the terminal 2 outputs an image to which the bookshelf is turned. In addition, when a plurality of picture files are outputted images, when the gesture signal generator 1 is tilted in an arbitrary direction, the terminal 2 outputs a scrolled image. When the gesture signal generator 1 takes the X pattern within the set time, the terminal 2 closes the image currently output and outputs the initial screen or the previous image. As such, the interface may be performed using a behavioral method known from an input device such as a mouse, and since various gestures exist, it may be matched with various image control commands.

In this way, the generated gesture signal is transmitted to the terminal 2 through the communication unit 12 under the control of the control unit 16 (S9).

Thereafter, when the gesture signal transmitted from the gesture signal generator 1 is received through the short range wireless communication module 212 of the terminal 2 (S10), the terminal 2 is normally controlled by the terminal controller 28. Signal processing of the In other words, the gesture signal is amplified, filtered from the amplified high frequency signal, and converted into a digital signal.

Subsequently, the terminal control unit 28 of the terminal 2 analyzes the gesture signal, extracts the movement direction, the tilt of the user, the movement speed, the movement time, etc. of the user included in the operation signal, and stores a command corresponding thereto. 23) (S11).

In addition, the terminal controller 28 of the terminal 2 executes a command and simultaneously performs a control for outputting the execution result to the image I (S12). That is, the terminal controller 28 of the terminal 2 controls the image output unit 25 to move the output page, to turn over the page in response to the diagonal direction or tilt, or to respond to the repetitive operation. Runs the icon, or outputs the image (I) to adjust the running speed in proportion to the speed.

In the case of holography, when the terminal controller 28 transmits an image signal to the image output unit 25, the image output unit 25 is output from one light source unit according to the image signal. The position is controlled so that the diffusely reflected coherent light is collected and projected to the corresponding image position, and the position is controlled so that the reference light can be projected from the other light source to the corresponding image position. Thereafter, the image output unit 25 projects the coherent light and the reference light on the space. In the case of the projector, when the terminal control unit 28 transmits the image signal to the image output unit 25, the image output unit 25 outputs light corresponding to the image signal according to the image signal, and modulates the light. Form an image. Thereafter, the image output unit 25 is enlarged and projected.

Meanwhile, the terminal controller 28 of the terminal 2 generates a response signal indicating that a function corresponding to a user gesture has been executed, and transmits the response signal to the short range wireless communication module 212, and then the terminal controller 28 of the terminal 2. In step S13, the wireless communication module 212 transmits a response signal to the gesture signal generator 1 in step S13.

Accordingly, the gesture signal generator 1 receives the response signal received through the communication unit 12 and transmits the response signal to the controller 16, and the control unit 16 of the gesture signal generator 1 controls the response signal. The vibration unit 14 is driven to generate vibration (S14). Of course, a sound, a display, a fragrance, or the like may be output in response to the response signal.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to aid understanding, and are not intended to limit the scope of the present invention. In addition to the embodiments disclosed herein, it is apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be implemented.

The present invention can output an image on a space or screen, through a terminal capable of outputting an execution result corresponding to a gesture signal as an image and a gesture signal generator capable of generating a gesture signal in response to a user's gesture. Since the user interface environment can be extended to a space or a screen, when the present invention is applied to a device having a limited interface area or the like, it is possible to increase the convenience and interest of the user using the same.

1 is a conceptual diagram illustrating a user interface providing system using a gesture according to an embodiment of the present invention.

2 is a block diagram showing a gesture signal generator according to an embodiment of the present invention.

3 is a block diagram showing a terminal according to an embodiment of the present invention.

4 is a flowchart illustrating a method for providing a user interface by a gesture according to an embodiment of the present invention.

Description of the main parts of the drawing

1: Gesture signal generator 11: Power supply

12: communication unit 13: sensor unit

14: vibration unit 15: memory unit

16 controller 2 terminal

21: communication unit 22: input unit

23: storage unit 24: display unit

25: video output unit 26: vibration unit

27: sound source processing unit 28: terminal control unit

Claims (15)

A gesture signal generator mounted on a user to generate a gesture signal corresponding to the gesture by detecting the gesture of the user, and outputting the gesture signal through short-range wireless communication; And Outputs an image corresponding to the event in space when an event occurs, and when the gesture signal is received from the gesture signal generator through short-range wireless communication, extracts a command corresponding to the gesture signal and executes the command; And a terminal for outputting an image corresponding to an execution result of the command on the space. Communication unit for transmitting and receiving data through short-range wireless communication; A sensor unit for detecting a gesture of a user; And a control unit for generating a gesture signal from the detection signal and transmitting the gesture signal to a terminal for outputting an image in a space through the communication unit when the detection signal is transmitted from the sensor unit. Gesture signal generator of a user interface providing system. The method of claim 2, wherein the sensor unit comprises at least one of an inertial sensor for detecting a movement or a position of the user and a distance sensor for detecting or measuring a distance relationship with the terminal. Gesture signal generator of a user interface providing system. The apparatus of claim 3, wherein the inertial sensor is a gyro sensor or an acceleration sensor. The system of claim 2, further comprising a vibration unit configured to generate vibrations under the control of the controller when a response signal for the execution result of the gesture signal is received through the communication unit. Gesture signal generator. The gesture signal generator of claim 2, wherein the gesture signal generator is a ring type. Communication unit for transmitting and receiving data through wireless communication; An image output unit which outputs an image in a space; A storage unit which stores a command corresponding to the gesture signal; And When an event is received through the communication unit, the event occurrence corresponding to the event is output as an image on the space through the image output unit, and receives a gesture signal received through the communication unit corresponding to the gesture signal The terminal of the user interface providing system by a gesture, characterized in that for extracting from the storage to execute the command, and outputs the execution result of the command as an image on the space through the image output unit . The apparatus of claim 7, wherein the communication unit comprises a short range wireless communication module, and the terminal control unit outputs an image corresponding to the gesture signal when receiving a gesture signal using a short range wireless communication module included in the communication unit. A terminal of a user interface providing system based on a gesture, which is output on the space through a unit. The mobile terminal of claim 7, wherein the communication unit comprises a mobile communication module, and when the terminal control unit receives a text message or an incoming signal using a mobile communication module included in the communication unit, an event corresponding to the text message or an incoming signal Terminal of the user interface providing system by a gesture, characterized in that the output of the fact in the image on the space through the image output unit. The method of claim 7, wherein the image output unit, At least two light source units, wherein the light source unit controls a position of the light source unit to collect diffusely reflected coherent light output from the light source unit and to project it onto a specific area in the space, and the remaining light source unit to control the specific area. The terminal of the user interface providing system according to the gesture, characterized in that for controlling the position so as to project the reference light to project on the space. A first output step of the terminal outputting an image in a space when an event occurs; A reception step of receiving, by the terminal, a gesture signal transmitted from a gesture signal generator; Extracting a command corresponding to the gesture signal received by the terminal; An execution step of executing the command extracted by the terminal; And And a second output step of outputting, by the terminal, an image corresponding to the execution result of the command on the space. 12. The method of claim 11, wherein the first outputting step comprises: when the terminal receives the gesture signal through a short range wireless communication module or receives a text message or an incoming call through a mobile communication module, the terminal receives the gesture signal. And outputting a corresponding image on the space, or outputting an event occurrence corresponding to the text message or an incoming signal as an image on the space. The method of claim 11, wherein the first outputting step further comprises the terminal outputting the same image as the image output on the space through a display unit provided in the main body of the terminal. How to provide a user interface. The method of claim 11, wherein the image output on the space, Outputting light from the light source unit; Controlling a position of the light source unit so as to collect diffusely reflected coherent light output from a portion of the light source unit and to project the image to a corresponding image position, and to control a position of the remaining light source unit to project a reference light to the corresponding image position; And And projecting the coherent light and the reference light onto the space. The method of claim 11, further comprising, after the second outputting step, the terminal transmitting a response signal to a result of executing the command, and generating a vibration by the gesture signal generator receiving the response signal. Method for providing a user interface by a gesture, characterized in that.

Images