KR101542986B1 - System and control method for gestures recognition using holographic - Google Patents

System and control method for gestures recognition using holographic Download PDF

Info

Publication number
KR101542986B1
KR101542986B1 KR1020130159601A KR20130159601A KR101542986B1 KR 101542986 B1 KR101542986 B1 KR 101542986B1 KR 1020130159601 A KR1020130159601 A KR 1020130159601A KR 20130159601 A KR20130159601 A KR 20130159601A KR 101542986 B1 KR101542986 B1 KR 101542986B1
Authority
KR
South Korea
Prior art keywords
gesture recognition
gesture
hologram
hand
recognition area
Prior art date
Application number
KR1020130159601A
Other languages
Korean (ko)
Other versions
KR20150072206A (en
Inventor
김선아
Original Assignee
현대자동차 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대자동차 주식회사 filed Critical 현대자동차 주식회사
Priority to KR1020130159601A priority Critical patent/KR101542986B1/en
Publication of KR20150072206A publication Critical patent/KR20150072206A/en
Application granted granted Critical
Publication of KR101542986B1 publication Critical patent/KR101542986B1/en

Links

Images

Abstract

A gesture recognition system using a hologram and a control method thereof are disclosed.
According to an embodiment of the present invention, there is provided a gesture recognition system using a hologram, including: a camera unit installed in a vehicle and photographing an interior of the vehicle; A hologram projection unit for projecting a hologram to three-dimensionally display a gesture recognition area of the camera unit; A storage unit for storing gesture setting information and manual information matched with various convenience functions in the vehicle; A gesture recognition unit for extracting a feature point according to a shape of a hand previously stored in the image obtained through the camera unit to detect hand coordinates and tracking a movement pattern of the detected hand to recognize a gesture; And a control unit for detecting a function matched with the gesture recognized by the gesture recognition unit and controlling the detected function.

Description

TECHNICAL FIELD [0001] The present invention relates to a gesture recognition system using a hologram,

The present invention relates to a gesture recognition system using a hologram applied to a vehicle and a control method thereof.

In general, a camera-based gesture recognition system applied to a vehicle is applied as a new conceptual user interface (UI) that enables a user to safely and conveniently operate various convenient functions in a vehicle.

In this camera - based gesture recognition system, it is considered that the recognition success rate that accurately recognizes user 's gesture input and the responsiveness to quickly process the gesture recognition in the acquired image are very important factors.

Generally, the gesture recognition system has a range in which a gesture recognition of a camera-based user is possible (hereinafter referred to as a gesture recognition area). Therefore, the user can stably recognize the gesture when the user takes the gesture within the optimum gesture recognition area.

However, the gesture recognition system has a problem that the recognition success rate is inevitably lowered when the user takes a gesture outside the gesture recognition area.

On the other hand, in order to solve such a problem, it is possible to consider expanding the gesture recognition area. However, in order to recognize a gesture, a process of calculating a gesture recognition area is included in every frame constituting an image. As the recognition area becomes wider, the object (hand) image becomes smaller and recognition becomes difficult. There is a drawback that the sex is reduced.

Therefore, there is a need for a method for allowing the user to input the gesture recognition within the optimum gesture recognition area set in the in-vehicle space.

In addition, a user who is new to the gesture recognition system applied to a vehicle or an elderly person who is not familiar with advanced digital devices has difficulty in understanding how to use the gesture recognition system, and accordingly, the UI may be used less frequently or may be regarded as an inconvenient UI.

Therefore, it is urgent to guide the user who is new to the gesture recognition system applied to the vehicle or the elderly who are not familiar with the advanced digital device to easily understand the use of the gesture recognition system.

The present invention provides a gesture recognition system using a hologram capable of intuitively displaying an optimal gesture recognition area set in a vehicle interior space using a hologram and adjusting a gesture recognition area to a desired position by the user, Method.

According to another aspect of the present invention, there is provided a gesture recognition system using a hologram capable of guiding a gesture input manual to a user using a hologram, and a control method thereof.

According to an aspect of the present invention, there is provided a gesture recognition system using a hologram, comprising: a camera unit installed in a vehicle and photographing the inside of the vehicle; A hologram projection unit for projecting a hologram to three-dimensionally display a gesture recognition area of the camera unit; A storage unit for storing gesture setting information and manual information matched with various convenience functions in the vehicle; A gesture recognition unit for extracting a feature point according to a shape of a hand previously stored in the image obtained through the camera unit to detect hand coordinates and tracking a movement pattern of the detected hand to recognize a gesture; And a control unit for detecting a function matched with the gesture recognized by the gesture recognition unit and controlling the detected function.

In addition, the camera unit may include a three-dimensional vision sensor or a stereo camera having an infrared function to detect a hand position of a passenger in three-dimensional coordinates.

The hologram projecting unit may display the changed gesture recognition area by changing the projection position of the hologram according to the gesture recognition area setting change of the camera unit.

In addition, the hologram projecting unit may display, in the gesture recognition area, an image for performing a matching function for each gesture guiding a user using the gesture recognition mode.

In addition, the hologram projecting unit may display and adjust the display color or brightness of the gesture recognition area according to the brightness of the surroundings.

The storage unit may store a spatial coordinate system within the vehicle and store gesture recognition area setting information formed on the basis of the coordinate system-based camera unit.

The gesture recognition unit may recognize at least one of a hand gesture according to movement of the hand and a hand posture to bend or straighten at least one finger when recognizing the gesture.

According to an aspect of the present invention, there is provided a gesture recognition control method using a hologram of a vehicle gesture recognition system, the method comprising: a) photographing a gesture recognition area through a camera unit when a gesture recognition mode is started; b) stereoscopically displaying the gesture recognition area by projecting a hologram through the hologram projection part; c) recognizing a gesture operation of the user in the gesture recognition area indicated by the hologram; And d) detecting a function matched with the recognized gesture and controlling the function.

In the step b), the hologram projecting unit may be set to be automatically projected according to a user's option setting in the gesture recognition mode.

The step (c) may further include the steps of: acquiring a photographed image photographed in the hologram display area through the camera unit and extracting feature points according to the shape of the hand to detect the hand bone and hand end coordinates; And recognizing the input gesture by tracking the movement patterns of the hand and the hand coordinates detected.

Meanwhile, a manual mode control method using a hologram of a gesture recognition system for a vehicle according to an aspect of the present invention includes: a) executing a manual guidance mode menu in a gesture recognition mode of a vehicle; b) executing a hologram projection unit according to the start of the manual guidance mode and displaying a demonstration image sequentially executing gesture-matched functions through a hologram; c) if the demonstration image of the predetermined gesture is displayed according to the stored manual information, actually operating the vehicle function matched with the predetermined gesture; And d) projecting the hologram to the gesture recognition area of the camera unit when the sequential display of the demonstration image is completed, thereby indicating that the current hologram display area is the optimal gesture recognition area.

In addition, the demonstration image may include a step of retrieving from the manual information stored in the storage unit and displaying the stereoscopic image in the gesture recognition area.

The step (b) may further include the steps of: (b-1) activating a first function of the vehicle matched with the first gesture if a first gesture according to one-sided movement of the hand is displayed through the hologram; And (b-2) activating a second function of the vehicle matched to the second gesture if a second gesture according to two-sided movement of the hand is displayed through the hologram.

In the step b), when the user inputs a predetermined gesture during reproduction of the demonstration image, the user can exit the manual guidance mode.

In addition, during the operation of the manual guidance mode, the announcement can be output together with the video display using the hologram.

According to an aspect of the present invention, there is provided a gesture recognition area change control method using a hologram of a vehicle gesture recognition system, comprising: a) photographing a gesture recognition area through a camera unit when a gesture recognition mode is started; b) stereoscopically displaying the gesture recognition area by projecting a hologram through the hologram projection part; c) recognizing a first hand posture instruction to change the gesture recognition area within the gesture recognition area indicated by the hologram; And d) if the user recognizes the second hand posture instruction at the position where the hand stops after the movement, setting the changed hand gesture recognition area to the changed gesture recognition area based on the stopped position.

The method may further include moving the gesture recognition area between the steps c) and d) by tracking the user's hand movement coordinates and projecting the hologram to a synchronized position along the movement coordinates of the hand.

Also, the first hand posture instruction recognizes that the user's hand grasps the fist, and the second hand posture instruction recognizes that the user's hand spreads the fist.

In addition, in the step (c), the gesture recognition area may be changed and set by moving to any one point of the coordinate system set in the in-vehicle three-dimensional space.

According to an embodiment of the present invention, an optimal gesture recognition area can be intuitively displayed through a hologram for gesture recognition of a vehicle, so that a user can precisely input a gesture, thereby improving the recognition success rate.

In addition, the purchaser of the vehicle can receive guiding visual and auditory guidance through the hologram on the function description depending on the existing booklet, thereby reducing the fatigue for the function acquisition and providing the differentiated function of the gesture insight system.

In addition, the gesture recognition area can be freely changed in consideration of the user's body size and driving posture, so that the gesture input of the user can be performed in a comfortable state.

1 is a block diagram schematically showing a configuration of a gesture recognition system using a hologram according to an embodiment of the present invention.
FIG. 2 shows a state in which a gesture recognition area using a hologram according to an embodiment of the present invention is displayed.
3 illustrates movable coordinates of a gesture recognition area according to an embodiment of the present invention.
4 is a flowchart illustrating a gesture recognition method using a hologram according to the first embodiment of the present invention.
5 is a flowchart illustrating a gesture recognition guide method using a hologram according to a second embodiment of the present invention.
FIG. 6 shows a state in which an optimal gesture recognition area using a hologram according to an embodiment of the present invention is displayed.
7 is a flowchart illustrating a method of changing a gesture recognition area according to a third embodiment of the present invention.
8 and 9 illustrate a process of changing a gesture recognition area according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. Also, the terms " part, "" module," and " module ", etc. in the specification mean a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software have.

Now, a gesture recognition system using a hologram and a control method thereof according to an embodiment of the present invention will be described in detail with reference to the drawings.

1 is a block diagram schematically showing a configuration of a gesture recognition system using a hologram according to an embodiment of the present invention.

FIG. 2 shows a state in which a gesture recognition area using a hologram according to an embodiment of the present invention is displayed.

1 and 2, a gesture recognition system 100 according to an exemplary embodiment of the present invention includes a camera unit 110, a hologram projection unit 120, a storage unit 130, a gesture recognition unit 140, And a control unit 150.

The camera unit 110 is installed in the vehicle, photographs the inside of the vehicle, and transmits the photographed image to the gesture recognition unit 140.

The camera unit 110 may be configured to detect a hand position in 3D (X, Y, Z) by using a 3D vision sensor or a stereo camera having an infrared function, but the present invention is not limited thereto. The position of the hand can be detected.

The hologram projecting unit 120 is installed in a plurality of vehicles, and when the gesture recognition mode is executed, the hologram is projected to three-dimensionally display the gesture recognition area of the camera unit 110. [

The hologram projecting unit 120 can display the gesture recognition area by changing the projection position of the hologram according to the change of the gesture recognition area setting of the camera unit 110. [

In addition, the hologram projecting unit 120 may project the image, which is executed by the gesture recognition system 100 in the manual guidance mode guiding the user's gesture recognition mode using the gesture-matched function, using the hologram, Can be displayed.

The storage unit 130 stores various setting information and programs for the implementation of the gesture recognition system 100 and stores data generated according to the operation of the gesture recognition system 100. [

For example, the storage unit 130 stores gesture setting information matched with various convenience functions in the vehicle and corresponding manual information.

For example, the storage unit 130 stores a predetermined gesture based on a change of a skeleton of a passenger, a position of a joint, and a position thereof in order to operate various functions in the vehicle. Here, the skeleton and the joint may include an elbow, a wrist, a finger, and the like.

In addition, the storage unit 130 may store the spatial coordinate system of the vehicle and store the gesture recognition area setting information formed on the basis of the coordinate system-based camera unit 110. [

The gesture recognition unit 140 extracts feature points according to the shape of the hand stored in advance in the image obtained through the camera unit 110 to detect hand and fingertip coordinates and tracks movement patterns of the detected hand and fingertip Thereby recognizing the gesture.

At this time, the gesture recognition unit 140 can extract various feature points such as the color of the hand, the shape, the brightness, the shape of the wrist and the finger joint, and then detect the hand through morphological modeling of the hand.

Accordingly, the gesture recognized by the gesture recognizing unit 140 according to the embodiment of the present invention includes a hand gesture according to the movement of the hand and a hand force (e.g., a fist, a scissors, a crease) for bending or stretching at least one finger .

The control unit 150 controls the overall operation of the respective units for driving the gesture recognition system 100 using the hologram according to the embodiment of the present invention.

The control unit 150 photographs the gesture recognition area through the camera unit 110 when the gesture recognition mode is executed by a user's operation input or voice input, and at the same time, the gesture recognition area is three-dimensionally projected through the hologram projecting unit 120 Display.

In this case, the gesture recognition area displayed through the hologram projecting unit 120 may be displayed in a darker color and brighter in the daytime and lighter and darker in the nighttime, depending on the brightness of the surroundings.

The control unit 150 detects the function matched with the gesture recognized by the gesture recognition unit 140 in the storage unit 130 and controls the corresponding function in cooperation with various electronic control units in the vehicle although it is omitted in the drawing.

When the user who is unfamiliar with the use of the gesture recognition system executes the gesture recognition manual mode, the control unit 150 executes the hologram projecting unit 120 according to the stored manual information and displays a demonstration image .

For example, when the demonstration image through the gesture for the AVN function operation is displayed, the controller 150 may actually guide the user's gesture input by actually driving the AVN function according to the setting manual.

In addition, since the position of the seat is different according to the body size of the driver, and the gestureable range may be different according to the arm length, the controller 150 may vary the gesture recognition area of the camera unit 110 have.

At this time, the control unit 150 changes the projection position of the hologram projecting unit 120 so that the gesture recognition area can be displayed in synchronization with the change of the gesture recognition area setting of the camera unit 110.

For example, FIG. 3 shows movable coordinates of a gesture recognition area according to an embodiment of the present invention.

Referring to FIG. 3, a coordinate system in which a plurality of coordinates are arranged in a three-dimensional form is set in an image capturing area of the camera unit 110. At this time, the coordinate system shown in FIG. 3 is displayed only in the plane coordinates of the left and right axes (X, Y), but the coordinates are further arranged in the depth direction (Z axis).

When the user recognizes the gesture input through the gesture recognition unit 140, the control unit 150 can change the gesture recognition area according to the position of the coordinates.

For example, when moving the gesture recognition area, the gesture recognition unit 140 detects hand gestures and fingertip coordinates, recognizes a hand posture in which the user holds the fist as a gesture input, and displays a pattern in which the coordinates . Then, from the coordinates at which the movement of the fist has been started to the stop,

3, the gesture recognition unit 140 may perform an algorithm for optimizing a variable of a desired change position as follows.

The gesture recognition unit 140 finds optimal variables at specific coordinates predetermined in advance, such as the respective coordinates of FIG. 3 for each vehicle type, and stores it in a lookup table. If the user wishes to move the gesture recognition area at a position other than the coordinates, an optimum parameter at that position is calculated using an interpolation technique.

For example, when the hand position of the user is inputted between the first coordinate and the neighboring second coordinate as the changing position, the optimal variable stored in the lookup table at the first coordinate and the optimum variable stored in the lookup table at the current coordinate are set as the distance ratio The gesture recognition area can be changed on the basis of any one of the two coordinates after calculating the optimal parameter at the input position.

Meanwhile, a vehicle gesture recognition method based on the configuration of the gesture recognition system 100 using the hologram according to the embodiment of the present invention will be described with reference to the following embodiments.

[First Embodiment]

4 is a flowchart illustrating a gesture recognition method using a hologram according to the first embodiment of the present invention.

Referring to FIG. 4, the gesture recognition system 100 photographs a gesture recognition area through the camera unit 110 (S102) when a gesture recognition mode is started by a user's operation input or voice input (S101).

The gesture recognition system 100 projects the hologram through the hologram projection unit 120 to display the gesture recognition area of the camera unit 110 in three dimensions (S103).

At this time, the driving of the hologram projection unit 120 can be set to be automatically projected according to the option setting of the user.

The gesture recognition system 100 recognizes the gesture operation of the user in the hologram display area (i.e., the optimal gesture recognition area) (S104).

More specifically, the gesture recognition system 100 acquires hand gesture photographed images in the hologram display area through the camera unit 110, extracts feature points corresponding to previously stored hand shapes, . Then, the input gesture can be recognized by tracking the movement pattern (movement coordinates) of the detected hand gestures and hand ends.

The gesture recognition system 100 detects a function matched with the recognized gesture and controls the corresponding function (S105).

Thereafter, the gesture recognition system 100 ends the gesture recognition mode if there is no gesture input for a predetermined time (S106).

[Second Embodiment]

Meanwhile, a method of operating the gesture recognition system 100 in the manual guidance mode of the user through the second embodiment of the present invention will be described.

5 is a flowchart illustrating a gesture recognition manual guidance method using a hologram according to a second embodiment of the present invention.

Referring to FIG. 5, the gesture recognition system 100 starts a manual guidance mode when the driver purchases a vehicle and executes a gesture mode for the first time or receives a gesture guide mode execution menu (S201)

The gesture recognition system 100 executes the hologram projection unit 120 according to the start of the manual guidance mode and displays a demonstration image sequentially executing the matched functions for each gesture (S202). At this time, the demonstration image may be retrieved from the stored manual information and displayed as a stereoscopic image in the gesture recognition area.

When the demonstration image of the predetermined gesture is displayed according to the manual information, the gesture recognition system 100 actually drives the matched function (S203).

For example, the gesture recognition system 100 may execute a music function with a predetermined gesture to sequentially guide the following gestures.

If the first gesture is displayed in which the hand moves from right to left, the whole music can be reproduced from the music list.

Also, if a second gesture is displayed in which the hand moves from the left to the right, the previous song of the music list can be reproduced.

Further, when the third gesture in which the hand rotates in the clockwise direction is displayed, the volume is increased, and when the third gesture in which the hand is rotated in the counterclockwise direction is displayed, the volume can be lowered.

At this time, although not shown in the drawing, the gesture recognition system 100 can exit the manual guidance mode when the user inputs a specific gesture during the reproduction of the demonstration image.

Meanwhile, FIG. 6 shows a state in which an optimal gesture recognition area using a hologram according to an embodiment of the present invention is displayed.

The gesture recognition system 100 projects the hologram through the hologram projection unit 120 when the reproduction of the preview image is completed, and indicates that the current hologram display area is the optimal gesture recognition area (S204).

Thereafter, the gesture recognition system 100 performs the first embodiment if there is a gesture input of the user, and ends the gesture recognition mode if there is no gesture input for a predetermined period of time (S205).

In the description according to the second embodiment of the present invention described above, it is possible to output the announcement along with the video display of the hologram during the operation of the manual guidance mode.

You can also get a description of other features depending on your options. Therefore, the user can receive the guidance of the audiovisual guidance through the hologram by explaining the function description which depended on the existing book, thereby reducing the fatigue of searching the book of the vehicle and conveniently checking the function of the vehicle.

[Third Embodiment]

Meanwhile, a method of changing the gesture recognition area according to the setting of the user by the gesture recognition system 100 will be described with reference to the third embodiment of the present invention.

7 is a flowchart illustrating a method of changing a gesture recognition area according to a third embodiment of the present invention.

Referring to FIG. 7, the gesture recognition system 100 determines whether the gesture recognition mode is activated (S301) after the step S103 or S204, (Step S302).

For example, the gesture recognition system 100 can recognize a first hand posture command by holding a fist in a hand-held state in the gesture recognition area.

8 and 9 illustrate a process of changing a gesture recognition area according to an embodiment of the present invention.

Referring to FIGS. 8 and 9, the gesture recognition system 100 recognizes the gesture command and then tracks the movement coordinates of the user's hand (S303), projects the hologram to the synchronized position along the movement coordinates of the hand The gesture recognition area is moved (S304)

Then, the gesture recognition system 100 recognizes the second hand posture instruction to open the fist when the user's hand is stopped (S305), and sets the designated current position as the changed gesture recognition area (S306).

Accordingly, the gesture recognition system 100 can display a gesture recognition area by projecting a hologram to a changed position through the hologram projection unit 120 in a gesture recognition mode executed subsequently.

According to the embodiment of the present invention described above, an optimal gesture recognition area is intuitively displayed through a hologram for gesture recognition of a vehicle, so that a user can precisely input the gesture, thereby enhancing the recognition success rate .

In addition, the purchaser of the vehicle can receive the guidance of the audiovisual guidance through the hologram, which is dependent on the existing booklet, thereby reducing the fatigue for acquiring the function and providing differentiated functions of the gesture in-system.

Further, the gesture recognition area can be freely changed in consideration of the body size and the driving posture of the user, so that the gesture input of the user can be performed in a comfortable state.

The embodiments of the present invention are not limited to the above-described apparatuses and / or methods, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded And such an embodiment can be easily implemented by those skilled in the art from the description of the embodiments described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

100: gesture recognition system 110: camera part
120: hologram projection unit 130:
140: Gesture recognition unit 150:

Claims (19)

  1. A camera unit installed in the vehicle and photographing the inside of the vehicle;
    A hologram projection unit for projecting a hologram to three-dimensionally display a gesture recognition area of the camera unit;
    A storage unit for storing gesture setting information and manual information matched with various convenience functions in the vehicle;
    A gesture recognition unit for extracting a feature point according to a shape of a hand previously stored in the image obtained through the camera unit to detect hand coordinates and tracking a movement pattern of the detected hand to recognize a gesture; And
    And a control unit for detecting a function matched with the gesture recognized by the gesture recognition unit and controlling the detected function,
    Wherein the controller is configured to change a gesture recognition area in accordance with a movement position of the hand coordinate when the user recognizes a gesture input to move the gesture recognition area and to change a gesture recognition area in the gesture recognition area, And recognizes a second hand posture instruction at a position where the user's hand stops after moving, and sets the changed gesture recognition area on the basis of the stopped position.
  2. The method according to claim 1,
    The camera unit includes:
    A three-dimensional vision sensor or a stereo camera having an infrared function and configured to detect a hand position of a passenger in three-dimensional coordinates.
  3. The method according to claim 1,
    Wherein the hologram projecting unit comprises:
    And changing the projection position of the hologram according to the gesture recognition area setting change of the camera unit to display the changed gesture recognition area.
  4. The method according to claim 1,
    Wherein the hologram projecting unit comprises:
    A gesture recognition system using a hologram that displays an image that executes a matching function for each gesture guiding a user using the gesture recognition mode using a hologram.
  5. The method according to claim 1,
    Wherein the hologram projecting unit comprises:
    And a display color or brightness of the gesture recognition area is adjusted according to a degree of brightness of a surrounding area to display the gesture recognition area.
  6. The method according to claim 1,
    Wherein,
    And storing gesture recognition area setting information formed based on the coordinate system based on the coordinate system.
  7. The method according to claim 1,
    The gesture recognizing unit recognizes,
    And recognizing at least one of a hand gesture according to the movement of the hand when recognizing the gesture and a hand posture in which at least one finger is bent or stretched.
  8. A gesture recognition control method using a hologram of a vehicle gesture recognition system,
    a) photographing the gesture recognition area through the camera unit when the gesture recognition mode is started;
    b) stereoscopically displaying the gesture recognition area by projecting a hologram through the hologram projection part;
    c) recognizing a gesture operation of the user in the gesture recognition area indicated by the hologram; And
    d) detecting a function matched with the recognized gesture and controlling the function,
    Between the step b) and the step c), a first hand posture instruction for changing the gesture recognition area in the gesture recognition area is recognized, and a second hand posture instruction is recognized And setting a changed gesture recognition area on the basis of the stopped position.
  9. 9. The method of claim 8,
    The step b)
    Wherein the hologram projection unit is set to be automatically projected according to a user's option setting in the gesture recognition mode.
  10. 9. The method of claim 8,
    The step c)
    Acquiring a photographed image photographed in the hologram display area through the camera unit and extracting a feature point according to a shape of a hand to detect a hand bone and a hand end coordinate; And
    And recognizing the input gesture by tracking the detected movement pattern of the hand and the hand end coordinates.
  11. A manual mode control method using a hologram of a vehicle gesture recognition system,
    a) executing a manual guidance mode menu in a gesture recognition mode of the vehicle;
    b) executing a hologram projection unit according to the start of the manual guidance mode to display a demonstration image sequentially executing a function matched to each gesture through a hologram;
    c) if the demonstration image of the predetermined gesture is displayed according to the stored manual information, a step of actually operating the vehicle function matched with the predetermined gesture, and
    and d) projecting a hologram to the gesture recognition area of the camera unit when the sequential display of the demonstration image is completed, thereby indicating that the current hologram display area is the optimal gesture recognition area.
  12. 12. The method of claim 11,
    And displaying the demonstration image as a stereoscopic image in the gesture recognition area by calling from the manual information stored in the storage unit.
  13. 12. The method of claim 11,
    The step b)
    b-1) activating a first function of the vehicle matched to the first gesture if a first gesture according to one-sided movement of the hand is displayed through the hologram; And
    b-2) activating a second function of the vehicle matched with the second gesture if the second gesture according to the two-sided movement of the hand is displayed through the hologram.
  14. 12. The method of claim 11,
    The step b)
    Wherein when the user inputs a predetermined gesture during reproduction of the demonstration image, the manual guiding mode is terminated.
  15. 12. The method of claim 11,
    And outputting an announcement along with an image display using the hologram when the manual guide mode is operated.
  16. A gesture recognition area change control method using a hologram of a vehicle gesture recognition system,
    a) photographing the gesture recognition area through the camera unit when the gesture recognition mode is started;
    b) stereoscopically displaying the gesture recognition area by projecting a hologram through the hologram projection part;
    c) recognizing a first hand posture instruction to change the gesture recognition area within the gesture recognition area indicated by the hologram; And
    d) recognizing a second hand posture command at a position where the user's hand has stopped moving, setting the changed hand gesture recognition area to the changed gesture recognition area based on the stopped position
    Wherein the gesture recognition area change control method comprises the steps of:
  17. 17. The method of claim 16,
    Between step c) and step d)
    And moving the gesture recognition area by tracking the user's hand movement coordinates and projecting the hologram to a synchronized position along the movement coordinates of the hand to move the gesture recognition area.
  18. 17. The method of claim 16,
    Wherein the first hand posture instruction recognizes that the user's hand grasps the fist, and the second hand posture instruction recognizes that the user's hand spreads the fist. The gesture recognition area change control method using the hologram .
  19. 17. The method of claim 16,
    In the step (c), the gesture recognition area may include:
    Wherein the gesture recognition area is changed and set by moving to any one point of the coordinate system set in the three-dimensional space in the vehicle.
KR1020130159601A 2013-12-19 2013-12-19 System and control method for gestures recognition using holographic KR101542986B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130159601A KR101542986B1 (en) 2013-12-19 2013-12-19 System and control method for gestures recognition using holographic

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130159601A KR101542986B1 (en) 2013-12-19 2013-12-19 System and control method for gestures recognition using holographic

Publications (2)

Publication Number Publication Date
KR20150072206A KR20150072206A (en) 2015-06-29
KR101542986B1 true KR101542986B1 (en) 2015-08-07

Family

ID=53518272

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130159601A KR101542986B1 (en) 2013-12-19 2013-12-19 System and control method for gestures recognition using holographic

Country Status (1)

Country Link
KR (1) KR101542986B1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150185858A1 (en) * 2013-12-26 2015-07-02 Wes A. Nagara System and method of plane field activation for a gesture-based control system
DE102015213424A1 (en) * 2015-07-16 2017-01-19 Audi Ag Method and operating system for operating at least one function in a vehicle
KR20170050293A (en) 2015-10-30 2017-05-11 삼성전자주식회사 Method and apparatus of detecting gesture recognition error
KR20170060473A (en) * 2015-11-24 2017-06-01 엘지전자 주식회사 Mobile terminal and method for controlling the same
GB2552703B (en) * 2016-08-04 2018-11-14 Ford Global Tech Llc A holographic display system
KR101934587B1 (en) * 2017-06-15 2019-01-02 주식회사 진진 Blackbox for vehicle and control method thereof

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001216069A (en) 2000-02-01 2001-08-10 Toshiba Corp Operation inputting device and direction detecting method
JP2004334590A (en) 2003-05-08 2004-11-25 Denso Corp Operation input device
JP2005254851A (en) 2004-03-09 2005-09-22 Nissan Motor Co Ltd Command input device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001216069A (en) 2000-02-01 2001-08-10 Toshiba Corp Operation inputting device and direction detecting method
JP2004334590A (en) 2003-05-08 2004-11-25 Denso Corp Operation input device
JP2005254851A (en) 2004-03-09 2005-09-22 Nissan Motor Co Ltd Command input device

Also Published As

Publication number Publication date
KR20150072206A (en) 2015-06-29

Similar Documents

Publication Publication Date Title
KR101148484B1 (en) Input apparatus
CN102141839B (en) Image processing apparatus, metheod therefor
JP5261554B2 (en) Human-machine interface for vehicles based on fingertip pointing and gestures
JP2013037675A (en) System and method for close-range movement tracking
CN101566875B (en) Image processing apparatus, and image processing method
US9477303B2 (en) System and method for combining three-dimensional tracking with a three-dimensional display for a user interface
US20120102436A1 (en) Apparatus and method for user input for controlling displayed information
US20110169750A1 (en) Multi-touchpad multi-touch user interface
CN104508618B (en) For providing equipment, method and the graphic user interface of touch feedback for the operation performed in the user interface
EP3518080A1 (en) Human-body-gesture-based region and volume selection for hmd
JP2011081480A (en) Image input system
US9529513B2 (en) Two-hand interaction with natural user interface
US20150378158A1 (en) Gesture registration device, gesture registration program, and gesture registration method
KR20140010616A (en) Apparatus and method for processing manipulation of 3d virtual object
WO2014147686A1 (en) Head-mounted device for user interactions in an amplified reality environment
KR101881925B1 (en) Method and apparatus for implementing multi-vision system using multiple portable terminals
KR20130105725A (en) Computer vision based two hand control of content
EP2797796A1 (en) Systems, methods, and apparatus for controlling gesture initiation and termination
CN102906671B (en) Gesture input apparatus and gesture input method
CN104246682A (en) Enhanced virtual touchpad and touchscreen
CA2817181A1 (en) Apparatus and method for user input for controlling displayed information
US10394334B2 (en) Gesture-based control system
DE102012110508A1 (en) Robot adjustment device with 3-D display
CN102541365A (en) Multi-touch command generating apparatus and method
TW201145184A (en) Vision-based hand movement recognition system and method thereof

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20180730

Year of fee payment: 4