WO2012157793A1 - Procédé et appareil de reconnaissance de geste - Google Patents

Procédé et appareil de reconnaissance de geste Download PDF

Info

Publication number
WO2012157793A1
WO2012157793A1 PCT/KR2011/003611 KR2011003611W WO2012157793A1 WO 2012157793 A1 WO2012157793 A1 WO 2012157793A1 KR 2011003611 W KR2011003611 W KR 2011003611W WO 2012157793 A1 WO2012157793 A1 WO 2012157793A1
Authority
WO
WIPO (PCT)
Prior art keywords
gesture recognition
recognition apparatus
light
information
gesture
Prior art date
Application number
PCT/KR2011/003611
Other languages
English (en)
Inventor
Kyungyoung Lim
Soungmin Im
Sunjin YU
Yongwon Cho
Sangki Kim
Original Assignee
Lg Electronics Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lg Electronics Inc. filed Critical Lg Electronics Inc.
Priority to PCT/KR2011/003611 priority Critical patent/WO2012157793A1/fr
Publication of WO2012157793A1 publication Critical patent/WO2012157793A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141—Control of illumination
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/145—Illumination specially adapted for pattern recognition, e.g. using gratings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0382—Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC

Definitions

  • the present invention relates to a method and apparatus for recognizing a movement, i.e. gesture of a user and more particularly, to a gesture recognition method and apparatus, which are devised to prevent interference between a plurality of gesture recognition apparatuses.
  • a user of a conventional content display apparatus operates a device, such as a remote controller, a keyboard or a mouse, so as to interact with a user interface. That is, in order to input a specific command to a content display apparatus, a user must operate a separate device, such as a remote controller, a keyboard, a mouse or a keypad.
  • a device such as a remote controller, a keyboard, a mouse or a keypad.
  • These content display apparatuses may include a gesture recognition apparatus to recognize a user gesture.
  • the gesture recognition apparatus operates using light, such as infrared (IR) light.
  • An object of the present invention devised to solve the problem lies in a gesture recognition method and apparatus for accurately and efficiently recognizing a user gesture by preventing interference between a plurality of gesture recognition apparatuses.
  • the object of the present invention can be achieved by providing a gesture recognition apparatus configured to recognize a user gesture using light, the gesture recognition apparatus including a camera unit including a light source to project the light, a sensor to recognize incident light, an image processor to produce information of a user shape image using information of the light incident on the sensor, and a timing controller to control the light source such that the light is projected based on a projection timing, a communication unit to transmit information of the projection timing and receive projection timing information of a light source separate from the light source, and a control unit to recognize the user gesture using the user shape image and set a unique projection timing of the gesture recognition apparatus using the projection timing information received via the communication unit.
  • the control unit may control the communication unit to periodically transmit and receive the projection timing information, and may reset the unique projection timing of the gesture recognition apparatus using the projection timing information received via the communication unit.
  • the control unit may control the communication unit to transmit and receive the projection timing information and may reset the unique projection timing of the gesture recognition apparatus using the projection timing information received via the communication unit if a status of the gesture recognition apparatus is changed.
  • the control unit may control the communication unit to transmit and receive the projection timing information and may reset the unique projection timing of the gesture recognition apparatus using the projection timing information received via the communication unit if the sensor senses light different from the light projected from the light source.
  • the control unit may analyze incidence timing information of the light incident on the sensor and may set the unique projection timing of the gesture recognition apparatus using the incidence timing information.
  • a gesture recognition apparatus configured to recognize a user gesture using light
  • the gesture recognition apparatus including at least two camera units, each of which includes a light source to project the light, a sensor to recognize incident light, an image processor to produce information of a user shape image using information of the light incident on the sensor, and a timing controller to control the light source so as to project the light based on a projection timing, and a control unit to recognize the user gesture using the user shape image and differently set projection timings of the camera units.
  • the control unit may divide a preset time into the number of the camera units and allot the divided time to each camera unit so as to differently set the projection timings of the camera units.
  • the control unit may set an interval between the projection timings of the camera units to a preset time so as to differently set the projection timings of the camera units.
  • a gesture recognition apparatus configured to recognize a user gesture using light
  • the gesture recognition apparatus including a camera unit including a light source to project the light, a sensor to recognize incident light, an image processor to produce information of a user shape image using information of the light incident on the sensor, a first polarizing filter located at a front surface of the light source, a second polarizing filter located at a front surface of the sensor, and a polarizing filter controller to control a polarization direction of the first and second polarizing filters, a communication unit to transmit polarization information of the first and second polarizing filters and receive polarization information of polarizing filters separate from the first and second polarizing filters, and a control unit to recognize the user gesture using the user shape image and set a unique polarization direction of the first and second polarizing filters using the polarization information received via the communication unit.
  • the control unit may control the communication unit to periodically transmit and receive the polarization information and may reset the unique polarization direction of the first and second polarizing filters using the polarization information received via the communication unit.
  • the control unit may control the communication unit to transmit and receive the polarization information and may reset the unique polarization direction of the first and second polarizing filters using the polarization information received via the communication unit if a status of the gesture recognition apparatus is changed.
  • the control unit may control the communication unit to transmit and receive the projection information and may set the unique polarization direction of the first and second polarizing filters using the polarization information received via the communication unit if the sensor senses light separate from the light projected from the light source.
  • the control unit may analyze the polarization information of the light incident on the sensor and may set the unique polarization direction of the first and second polarizing filters using the recognized polarization information.
  • a gesture recognition method to recognize a user gesture using light including setting a unique projection timing of a gesture recognition apparatus, projecting the light based on the set projection timing, recognizing light incident on a sensor, producing information of a user shape image using information of the light incident on the sensor, and recognizing the user gesture using the produced user shape image, wherein setting the unique projection timing includes receiving projection timing information of a light source separate from a light source of the gesture recognition apparatus, and setting the unique projection timing of the gesture recognition apparatus using the received projection timing information.
  • the gesture recognition method may further include transmitting the unique projection timing of the gesture recognition apparatus.
  • the gesture recognition method may further include periodically resetting the unique projection timing.
  • the gesture recognition method may further include resetting the unique projection timing if a status of the gesture recognition apparatus is changed.
  • the gesture recognition method may further include setting the unique projection timing if the sensor senses light separate from the light projected from the light source of the gesture recognition apparatus.
  • the gesture recognition method may further include recognizing incidence timing information of the light incident on the sensor, and setting the unique projection timing using the incidence timing information.
  • a gesture recognition method to recognize a user gesture using light including setting a unique polarization direction of a gesture recognition apparatus, setting a polarization direction of polarizing filters located respectively at front surfaces of a light source and a sensor included in the gesture recognition apparatus based on the set polarization direction, projecting the light, recognizing light incident on the sensor, producing information of a user shape image using information of the light incident on the sensor, and recognizing the user gesture using the produced user shape image, wherein setting the unique polarization direction includes receiving polarization information of a polarizing filter separate from the polarizing filter, and setting the unique polarization direction of the gesture recognition apparatus using the received polarization information.
  • the gesture recognition method may further include transmitting the unique polarization direction of the gesture recognition apparatus.
  • the gesture recognition method may further include periodically resetting the unique polarization direction.
  • the gesture recognition method may further include resetting the unique polarization direction if a status of the gesture recognition apparatus is changed.
  • the gesture recognition method may further include setting the unique polarization direction if the sensor senses light separate from the light projected from the light source of the gesture recognition apparatus.
  • the gesture recognition method may further include recognizing polarization information of the light incident on the sensor, and setting the unique polarization direction using the recognized polarization information.
  • the gesture recognition method may further include setting unique projection timings of at least two light sources included in the gesture recognition apparatus.
  • the gesture recognition method and apparatus according to the present invention can prevent interference between the gesture recognition apparatuses even if communication between the gesture recognition apparatuses is impossible.
  • the gesture recognition method and apparatus according to the present invention propose to periodically confirm the gesture recognition environment, which can prevent interference between the gesture recognition apparatuses even if the gesture recognition environment is changed at a later time.
  • FIG. 1 is a view illustrating a gesture recognition environment according to one embodiment of the present invention.
  • FIGs. 2 and 3 are views illustrating a gesture recognition environment according to another embodiment of the present invention.
  • FIG. 4 is a block diagram illustrating a configuration of a gesture recognition apparatus according to an embodiment of the present invention.
  • FIG. 5 is a block diagram illustrating a configuration of a camera unit included in a gesture recognition apparatus according to an embodiment of the present invention.
  • FIG. 6 is a view illustrating an operating method of a gesture recognition apparatus according to an embodiment of the present invention.
  • FIG. 7 is a view explaining a gesture recognition method according to a first embodiment of the present invention.
  • FIG. 8 is a flow chart of the gesture recognition method according to the first embodiment of the present invention.
  • FIG. 9 is a view illustrating a gesture recognition method according to a second embodiment of the present invention.
  • FIG. 10 is a flow chart of the gesture recognition method according to the second embodiment of the present invention.
  • FIG. 11 is a view illustrating a gesture recognition method according to a third embodiment of the present invention.
  • FIG. 12 is a view illustrating a camera unit of a gesture recognition apparatus according to the third embodiment of the present invention.
  • FIG. 13 is a flow chart of the gesture recognition method according to the third embodiment of the present invention.
  • FIG. 14 is a view illustrating a gesture recognition method according to a fourth embodiment of the present invention.
  • FIG. 15 is a flow chart of the gesture recognition method according to the fourth embodiment of the present invention.
  • FIG. 1 is a view illustrating a gesture recognition environment according to one embodiment of the present invention.
  • a user can control the content display apparatus via an intuitive gesture without operating a separate input unit.
  • the content display apparatus includes the gesture recognition apparatus 10 to recognize a user gesture.
  • the gesture recognition apparatus 10 is devised to recognize a user gesture using light, such as infrared (IR) light.
  • IR infrared
  • the content display apparatus functions to convert the user gesture, recognized via the gesture recognition apparatus 10, into a corresponding control command. Thereby, the content display apparatus can be controlled based on a user intention.
  • FIGs. 2 and 3 are views illustrating a gesture recognition environment according to another embodiment of the present invention.
  • FIG. 1 illustrates a gesture recognition environment in which a single gesture recognition apparatus 10 is present
  • FIGs. 2 and 3 illustrate a gesture recognition environment in which a plurality of gesture recognition apparatuses 10 is present.
  • a plurality of content display apparatuses which can function to recognize a user gesture, such as a television, laptop computer, and the like, may be present in the same space.
  • FIG. 2 illustrates a gesture recognition environment in which a plurality of content display apparatuses, each of which includes a single gesture recognition apparatus 10, is present.
  • the user can control the plurality of content display apparatuses via a single gesture.
  • FIG. 3 illustrates a gesture recognition environment in which a content display apparatus including a plurality of gesture recognition apparatuses 10 is present.
  • Providing a single content display apparatus with a plurality of gesture recognition apparatuses 10 enables more accurate user gesture recognition (FIG. 3(a)). Also, the plurality of gesture recognition apparatuses 10 may serve to recognize gestures of a plurality of users individually (FIG. 3(b)).
  • FIG. 4 is a block diagram illustrating a configuration of the gesture recognition apparatus 10 according to an embodiment of the present invention.
  • the gesture recognition apparatus 10 of the present invention includes a control unit 100, a camera unit 300, and a communication unit 500.
  • the camera unit 300 of the present invention functions to recognize a user gesture and produce image information about the recognized user gesture.
  • the camera unit 300 may include a light source 310, a sensor 330, a timing controller 350, and an image processor 370.
  • the light source 310 is configured to project light, such as infrared (IR) light.
  • IR infrared
  • the sensor 330 is configured to recognize light introduced into the camera unit 300.
  • the timing controller 350 serves to control the light source 310 so as to adjust light projection time. Specifically, the timing controller 350 controls the light source 310 to project light at a preset timing.
  • the image processor 370 serves to analyze light incident on the sensor 330 and produce a user shape image containing information about a user position and posture, etc.
  • the communication unit 500 of the present invention is configured to receive status information of the gesture recognition apparatus 10 or to transmit status information of the gesture recognition apparatus 10 to another gesture recognition apparatus 10.
  • Example of the status information of the gesture recognition apparatus 10 include timing information and polarizing filter information, which will be described hereinafter.
  • the control unit 100 of the present invention serves to control overall operation of the camera unit 300 and the communication unit 500.
  • control unit 100 of the present invention controls the camera unit 300 to produce a user shape image and recognizes a user gesture based on the produced shape image. Also, the control unit 100 controls the communication unit 500 to receive status information of the gesture recognition apparatus 10 or to transmit status information of the gesture recognition apparatus 10 to another gesture recognition apparatus 10.
  • the gesture recognition apparatus 10 of the present invention may include two or more camera units 300.
  • each camera 300 serves to analyze light incident on the corresponding sensor 330 and produce a user shape image containing information about a user position and posture, etc.
  • FIG. 5 is a block diagram illustrating a configuration of the camera unit 300 of the gesture recognition apparatus 10 according to an embodiment of the present invention.
  • the camera unit 300 of the present invention may further include a first polarizing filter 311, a second polarizing filter 333 and a polarizing filter controller 390.
  • the first polarizing filter 311 and the second polarizing filter 333 of the present invention function to selectively pass only light vibrating in a predetermined direction from among light incident on the polarizing filters 311 and 333.
  • the first polarizing filter 311 of the present invention may be located at a front surface of the light source 310 such that light projected from the light source 310 passes through the first polarizing filter 311.
  • the second polarizing filter 333 may be located at a front surface of the sensor 330 such that light incident on the sensor 330 passes through the second polarizing filter 333.
  • the first polarizing filter 311 allows only light vibrating in a predetermined direction to be projected from the light source 310
  • the second polarizing filter 333 allows only light vibrating in a predetermined direction to be incident on the sensor 330.
  • the polarizing filter controller 390 of the present invention serves to control the first polarizing filter 311 and the second polarizing filter 333 and select the type of light to be projected from the light source 310 and the type of light to be incident on the sensor 330.
  • the polarizing filter controller 390 may control positions of the first polarizing filter 311 and the second polarizing filter 333.
  • the polarizing filter controller 390 locates the first polarizing filter 311 at the front surface of the light source 310 if the first polarizing filter 311 is necessary, and removes the first polarizing filter 311 from the front surface of the light source 310 if the first polarizing filter 311 is unnecessary.
  • the polarizing filter controller 390 locates the second polarizing filter 333 at the front surface of the sensor 330 if the second polarizing filter 333 is necessary, and removes the second polarizing filter 333 from the front surface of the sensor 330 if the second polarizing filter 333 is unnecessary.
  • the polarizing filter controller 390 may control a polarization direction of the first polarizing filter 311 and the second polarizing filter 333. Specifically, the polarizing filter controller 390 may rotate the first polarizing filter 311 and the second polarizing filter 333 to control a vibrating direction of light passing through the first polarizing filter 311 or the second polarizing filter 333.
  • the first polarizing filter 311 and the second polarizing filter 333 of the present invention are configured to have the same polarization direction, the light projected from the light source 310 and the light incident on the sensor 330 vibrate in the same direction.
  • FIG. 6 is a view illustrating an operating method of the gesture recognition apparatus 10 according to an embodiment of the present invention.
  • a first gesture recognition apparatus 10 is provided in a television and a second gesture recognition apparatus 10 is provided in a laptop computer will be described hereinafter.
  • the drawing illustrates a gesture recognition environment in which two gesture recognition apparatuses 10 are provided to recognize a user gesture.
  • an operating method of these gesture recognition apparatuses 10 will be described on the basis of the first gesture recognition apparatus 10 provided in the television.
  • the gesture recognition apparatus 10 of the present invention includes the light source 310 and the sensor 330 provided in the camera unit 300.
  • the light source 310 periodically projects light, such as infrared (IR) light, to a user, and the sensor 330 receives the light reflected from the user.
  • IR infrared
  • the light projected from the light source 310 to the user is referred to as projected light 11 and the light reflected from the user to thereby be incident on the sensor 330 is referred to as incident light 13.
  • the control unit 100 of the present invention may produce information about a user position and posture using the projected light 11 from the light source 310 to the user and the incident light 13 reflected from the user to the sensor 330.
  • control unit 100 of the present invention is devised to recognize a user position and posture by measuring projection time of the projected light 11 and incidence time of the incident light 13, or by analyzing a pattern of the incident light 13.
  • the light source 310 of the present invention may function to project the light 11 plural times within a short time to enable recognition of movement, i.e. user gestures.
  • the projected light 11 from the first gesture recognition apparatus 10 may be incident on the sensor 330 of the second gesture recognition apparatus 10.
  • the projected light 11 from the second gesture recognition apparatus 10 may be incident on the sensor 330 of the first gesture recognition apparatus 10.
  • the sensor 330 of the first gesture recognition apparatus 10 may receive both the lights overlapping each other.
  • interference Such interference may occur when a plurality of gesture recognition apparatuses 10 is present in the same gesture recognition environment. The interference may make it difficult for the gesture recognition apparatus 10 to correctly recognize a user gesture.
  • FIG. 7 is a view explaining a gesture recognition method according to a first embodiment of the present invention.
  • a time for which the light source 310 projects the light 11 to perform user gesture recognition is allotted on a per gesture recognition apparatus 10 basis. That is, the gesture recognition method according to the first embodiment of the present invention allots a unique timing on a per gesture recognition apparatus 10 basis.
  • FIG. 7(a) illustrates a state in which only the first gesture recognition apparatus 10 provided in the television projects the light 11 to recognize a user gesture at a timing allotted thereto
  • FIG. 7(b) illustrates a state in which only the second gesture recognition apparatus 10 provided in the laptop computer projects the light 11 to recognize a user gesture at a timing allotted thereto. That is, each gesture recognition apparatus 10 has a unique time, i.e. a unique timing for projecting the light 11 so as to recognize a user gesture.
  • the sensors 330 receive only the projected light 11 from the first gesture recognition apparatus 10 at the timing allotted to the first gesture recognition apparatus 10 and also, receive only the projected light 11 from the second gesture recognition apparatus 10 at the timing allotted to the second gesture recognition apparatus 10.
  • each gesture recognition apparatus 10 recognizes a user gesture using only the light 13 incident on the sensor 330 at the timing allotted thereto and neglects the light 13 incident on the sensor 330 for a time except for the timing allotted thereto, which can prevent interference.
  • each gesture recognition apparatus 10 may share information about a unique timing thereof with other gesture recognition apparatuses 10 via the communication unit 500, which assists each gesture recognition apparatus 10 in setting a unique timing thereof to prevent interference with other gesture recognition apparatuses 10.
  • each gesture recognition apparatus 10 can set a unique timing thereof via communication with other gesture recognition apparatuses 10.
  • FIG. 8 is a flow chart of the gesture recognition method according to the first embodiment of the present invention.
  • the first gesture recognition apparatus 10 performs the gesture recognition method according to the first embodiment of the present invention to prevent interference (S101).
  • the control unit 100 of the first gesture recognition apparatus 10 determines a reference timing to be used thereby (S103). Then, the control unit 100 of the first gesture recognition apparatus 10 controls the communication unit 500 to transmit information of the determined reference timing to the second gesture recognition apparatus 10 (S105).
  • the control unit 100 of the second gesture recognition apparatus 10 searches for and selects an available timing different from the reference timing (S107). That is, the control unit 100 of the second gesture recognition apparatus 10 searches for and selects an empty timing which does not overlap with the reference timing of the first gesture recognition apparatus 10.
  • control unit 100 of the second gesture recognition apparatus 10 controls the communication unit 500 to transmit information of the selected available timing to the first gesture recognition apparatus 10 (S109).
  • each of the gesture recognition apparatuses 10 has a unique timing to prevent interference with the other gesture recognition apparatus 10.
  • control unit 100 of the first gesture recognition apparatus 10 controls the timing controller 350 such that light is projected only at the reference timing to enable recognition of a user gesture (S111), and the control unit 100 of the second gesture recognition apparatus 10 controls the timing controller 350 such that light is projected only at the selected available timing to enable recognition of a user gesture (S113).
  • each gesture recognition apparatus 10 needs to periodically confirm timing information of the other party so as to determine whether or not interference of current timings of the respective gesture recognition apparatuses 10 occurs (S115).
  • third and fourth gesture recognition apparatuses 10 may be added to the same gesture recognition environment, or the second gesture recognition apparatus 10 may disappear from the gesture recognition environment. In this case, each gesture recognition apparatus 10 needs to perform the above described operations to obtain a timing suitable for the current gesture recognition environment.
  • the gesture recognition environment of the present invention may be changed as occasion demands (S117).
  • an orientation of the first gesture recognition apparatus 10 may be changed, or a position of the second gesture recognition apparatus 10 may be changed.
  • control unit 100 of the first gesture recognition apparatus 10 as a reference resets a reference timing suitable for the changed user gesture recognition environment (S119).
  • control unit 100 of the first gesture recognition apparatus 10 controls the communication unit 500 to transmit a command to update the timing information with the reset reference timing information to the second gesture recognition apparatus 10 (S121).
  • the control unit 100 of the second gesture recognition apparatus 10 searches for and selects an available timing required to recognize a user gesture while preventing interference based on the reset reference timing information (S123).
  • control unit 100 of the first gesture recognition apparatus 10 controls the timing controller 350 such that light is projected at the reset reference timing so as to enable recognition of a user gesture (S125), and the control unit 100 of the second gesture recognition apparatus 10 controls the timing controller 350 such that light is projected at the reselected available timing so as to enable recognition of a user gesture (S127).
  • each gesture recognition apparatus 10 has a unique time, i.e. a unique timing for projecting the light 11 to enable recognition of a user gesture and neglects the incident light 13 for a time except for the timing thereof, thereby being free from interference.
  • the control unit 100 of the gesture recognition apparatus 10 functions to differently set projection timings of the respective camera units 300.
  • control unit 100 may divide a preset time into the number of the camera units 300 and allot the divided time to each camera unit 300, thereby differently setting projection timings of the camera units 300.
  • control unit 100 may differently set projection timings of the camera units 300 by setting an interval between the projection timings of the camera units 300 to a preset time.
  • FIG. 9 is a view illustrating a gesture recognition method according to a second embodiment of the present invention.
  • the above described gesture recognition method according to the first embodiment of the present invention is devised to allow the respective gesture recognition apparatuses 10 to share their timing information with each other via communication, which enables setting a unique timing of each gesture recognition apparatus 10.
  • the gesture recognition method according to the second embodiment of the present invention is a method for setting a unique timing of the above described third gesture recognition apparatus 10.
  • the third gesture recognition apparatus 10 is devised to analyze timing information of light incident on the sensor 330 when a plurality of gesture recognition apparatuses projects light, thereby selecting an available timing to be used thereby.
  • the first gesture recognition apparatus 10 and the second gesture recognition apparatus 10 are provided in a gesture recognition environment, the first gesture recognition apparatus 10 projects a first light 15 to recognize a user gesture, and the second gesture recognition apparatus 10 projects a second light 17 to recognize a user gesture.
  • the first gesture recognition apparatus 10 and the second gesture recognition apparatus 10 share their timing information with each other via communication, which enables setting of a unique timing to recognize a user gesture without interference.
  • the third gesture recognition apparatus 10 which cannot communicate with the first gesture recognition apparatus 10 and the second gesture recognition apparatus 10, is added to the gesture recognition environment, the light 15 or 17 projected from the first or second gesture recognition apparatus 10 present in the user gesture recognition environment may be reflected from a user and be incident on the sensor 330 of the third gesture recognition apparatus 10.
  • the third gesture recognition apparatus 10 measures incidence time, i.e. incidence timing of the first light 15 projected from the first gesture recognition apparatus 10 and the second light 17 projected from the second gesture recognition apparatus 10. As such, the third gesture recognition apparatus 10 searches for and selects an available timing to be used thereby.
  • FIG. 10 is a flow chart of the gesture recognition method according to the second embodiment of the present invention.
  • the control unit 100 performs the gesture recognition method according to the second embodiment of the present invention to prevent interference (S201).
  • the control unit 100 collects timing information of the light incident on the sensor 330 (S203).
  • the control unit 100 analyzes the collected timing information of the incident light and searches for a timing to be used by the gesture recognition apparatus 10 (S205). That is, the control unit 100 searches for a timing, which differs from timings of the light incident on the sensors 330 of other gesture recognition apparatuses 10 to prevent interference and enable recognition of a user gesture.
  • control unit 100 controls the timing controller 350 such that light is projected at the searched available timing (S207).
  • the control unit 100 needs to periodically confirm timing information of light projected from other gesture recognition apparatuses 10 so as to determine whether or not interference of a preset current timing occurs (S209). That is, the control unit 100 determines whether or not the preset current timing overlaps with timings of other gesture recognition apparatuses 10.
  • the corresponding gesture recognition apparatus 10 can set a unique timing thereof so as not to interfere with the other gesture recognition apparatuses 10.
  • gesture recognition methods according to the first and second embodiments of the present invention as described above, it is possible to allot a unique timing to prevent interference with other gesture recognition apparatuses 10 to each gesture recognition apparatus 10.
  • FIG. 11 is a view illustrating a gesture recognition method according to a third embodiment of the present invention.
  • each gesture recognition apparatus 10 includes unique polarizing filters provided at the front surfaces of the light source 310 and the sensor 330.
  • a first light 31 projected from the light source 310 of the first gesture recognition apparatus 10 has characteristics of vibrating in a vertical direction, and only the light vibrating in the vertical direction is incident on the sensor 330 of the first gesture recognition apparatus 10.
  • the second light 31 projected from the light source 310 of the second gesture recognition apparatus 10 has characteristics of vibrating in a horizontal direction, and only the light vibrating in the horizontal direction is incident on the sensor 330 of the second gesture recognition apparatus 10.
  • each gesture recognition apparatus 10 can receive only the light projected from the corresponding gesture recognition apparatus 10.
  • the light projected from other gesture recognition apparatuses 10 is not incident on the sensor 330, which prevents interference between the respective gesture recognition apparatuses 10.
  • Each gesture recognition apparatus 10 may shape polarizing filter information thereof with other gesture recognition apparatuses 10 via the communication unit 500, thereby being capable of selecting unique polarizing filters thereof to prevent interference.
  • FIG. 12 is a view illustrating the camera unit 300 of the gesture recognition apparatus 10 according to the third embodiment of the present invention.
  • the camera unit 300 of the present invention may include the first polarizing filter 311, the second polarizing filter 333 and the polarizing filter controller 390.
  • the first polarizing filter 311 may be located at the front surface of the light source 310 to set a vibrating direction of the projected light 11.
  • the second polarizing filter 333 may be located at the front surface of the sensor 330 to set a vibrating direction of the incident light 13.
  • the polarizing filter controller 390 controls positions and postures of the first polarizing filter 311 and the second polarizing filter 333.
  • the polarizing filter controller 390 may control the first polarizing filter 311 and the second polarizing filter 333 such that the first polarizing filter 311 and the second polarizing filter 333 are located at the front surfaces of the light source 310 and the sensor 330 and also, may control orientations of the polarizing filters 331 and 333 such that polarized light is directed in a vertical direction or horizontal direction or by an inclination of 45 degrees.
  • FIG. 12(a) illustrates the camera unit 300 of the first gesture recognition apparatus 10.
  • the first gesture recognition apparatus 10 is provided with the horizontal polarizing filters 311 and 333.
  • FIG. 12(b) illustrates the camera unit 300 of the second gesture recognition apparatus 10.
  • the second gesture recognition apparatus 10 is provided with the vertical polarizing filters 311 and 333.
  • the first gesture recognition apparatus 10 projects and receives only light vibrating in a horizontal direction
  • the second gesture recognition apparatus 10 projects and receives only light vibrating in a vertical direction.
  • each gesture recognition apparatus 10 receives only the light projected from the corresponding gesture recognition apparatus 10, which prevents interference with another gesture recognition apparatus 10.
  • FIG. 13 is a flow chart of the gesture recognition method according to the third embodiment of the present invention.
  • the control unit 100 of the first gesture recognition apparatus 10 performs the gesture recognition method according to the third embodiment of the present invention to prevent interference (S301).
  • the control unit 100 of the first gesture recognition apparatus 10 selects a reference polarizing filter to be used by the first gesture recognition apparatus 10 (S303).
  • the control unit 100 of the first gesture recognition apparatus 10 controls the communication unit 500 and transmits information of the selected reference polarizing filter to the second gesture recognition apparatus 10 (S305).
  • the control unit 100 of the second gesture recognition apparatus 10 searches for and selects an available polarizing filter different from the information of the reference polarizing filter (S307).
  • control unit 100 of the second gesture recognition apparatus 10 controls the communication unit 500 to transmit the information of the selected available polarizing filter to the first gesture recognition apparatus 10 (S309). As such, unique polarizing filters of the respective gesture recognition apparatuses 10 are selected.
  • the control unit 100 of the first gesture recognition apparatus 10 controls the polarizing filter controller 390 such that the reference polarizing filters 311 and 333 are provided at the front surfaces of the light source 310 and the sensor 330 (S311).
  • control unit 100 of the second gesture recognition apparatus 10 controls the polarizing filter controller 390 to allow the selected available polarizing filters 311 and 333 to be installed to the front surfaces of the light source 310 and the sensor 330 (S313).
  • the polarizing filter controller 390 may rotate the previously installed polarizing filters 311 and 333, or may replace the previously installed polarizing filters 311 and 33 by the selected polarizing filters 311 and 333.
  • the control unit 100 of each gesture recognition apparatus 10 controls the light source 310 to project light so as to enable recognition of a user gesture.
  • each gesture recognition apparatus 10 adopt different polarizing filters, the sensor 330 of each gesture recognition apparatus 10 does not receive light projected from another gesture recognition apparatus 10, which can prevent interference between the respective gesture recognition apparatuses 10.
  • each gesture recognition apparatus 10 can periodically confirm polarizing filter information of the other party and determine whether or not the polarizing filters of the respective gesture recognition apparatuses 10 overlap each other.
  • FIG. 14 is a view illustrating a gesture recognition method according to a fourth embodiment of the present invention.
  • the respective gesture recognition apparatuses 10 share polarizing filter information thereof with each other via communication, thereby being capable of selecting unique polarizing filters thereof to recognize a user gesture without interference.
  • the gesture recognition method according to the fourth embodiment of the present invention is a method for selecting unique polarizing filters of the above described third gesture recognition apparatus 10.
  • the third gesture recognition apparatus 10 is devised to analyze a vibrating direction of each light incident on the sensor 330, i.e. polarization information when a plurality of gesture recognition apparatuses projects light, thereby selecting available polarizing filters to be used thereby.
  • the first gesture recognition apparatus 10 and the second gesture recognition apparatus 10 are present in a gesture recognition environment, the first gesture recognition apparatus 10 projects a first light 51 to recognize a user gesture and the second gesture recognition apparatus 10 projects a second light 53 to recognize a user gesture.
  • the first light 51 is a light having passed through the vertical polarizing filter installed to the first gesture recognition apparatus 10
  • the second light 53 is a light having passed through the horizontal polarizing filter installed to the second gesture recognition apparatus 10.
  • the first gesture recognition apparatus 10 and the second gesture recognition apparatus 10 share polarizing filter information with each other via communication, thereby being capable of selecting unique polarizing filters thereof to recognize a user gesture without interference.
  • the light 51 or 53 projected from the first or second gesture recognition apparatus 10 present in the gesture recognition environment may be reflected from a user and be incident on the sensor 330 of the third gesture recognition apparatus 10.
  • the third gesture recognition apparatus 10 analyzes characteristics of the first light 51 projected from the first gesture recognition apparatus 10 and the second light 53 projected from the second gesture recognition apparatus 10. That is, the third gesture recognition apparatus 10 analyzes vibrating directions of the first light 51 and the second light 53.
  • the third gesture recognition apparatus 10 can search for and select available polarizing filters different from among the polarizing filters of the first gesture recognition apparatus 10 and the second gesture recognition apparatus 10.
  • FIG. 15 is a flow chart of the gesture recognition method according to the fourth embodiment of the present invention.
  • the control unit 100 performs the gesture recognition method according to the fourth embodiment of the present invention to prevent interference (S401).
  • the control unit 100 collects polarization information of each light incident on the sensor 330 (S403). Specifically, the control unit 100 analyzes a vibrating direction of the light incident on the sensor 330.
  • the control unit 100 analyzes the collected polarization information of the incident light and searches for the polarizing filters 311 and 333 to be used by the gesture recognition apparatus 10 (S405). Once the vibrating direction of the light incident on the sensor 330 is analyzed, the polarizing filters 311 and 333 used in the gesture recognition apparatus 10 present under the same gesture recognition environment can be analyzed. Thus, the control unit 100 can search for and select the available polarizing filters 311 and 333 different from the recognized polarizing filters 311 and 333.
  • the control unit 100 controls the polarizing filter controller 390 to install the searched available polarizing filters 311 and 333 to the front surfaces of the light source 310 and the sensor 330 (S407).
  • control unit 100 controls the light source 330 to project light, thereby enabling recognition of a user gesture (S409).
  • control unit 100 may periodically confirm polarization information of light from other gesture recognition apparatuses 10 and determine whether or not interference of the preset current polarizing filters 311 and 333 occurs.
  • control unit 100 If it is determined that the preset current polarizing filters 311 and 333 interfere with each other, the control unit 100 repeatedly performs the above described operations to reset the polarizing filters 311 and 333.
  • the gesture recognition apparatus 10 can select the polarizing filters having no risk of interference even if the gesture recognition apparatus 10 cannot communicate with the other gesture recognition apparatuses 10 present under the same user gesture recognition environment.
  • the gesture recognition apparatus 10 includes the polarizing filters having no risk of interference with other gesture recognition apparatuses 10.
  • the gesture recognition methods of the present invention for efficiently recognizing a user gesture without interference have been described above.
  • the gesture recognition methods according to the first and second embodiments of the present invention are devised to set a unique timing of each gesture recognition apparatus 10, and the gesture recognition methods according to the third and fourth embodiments of the present invention are devised to install different polarizing filters to the respective gesture recognition apparatuses 10.
  • the present invention is not limited to the above described embodiments, and a method for setting a unique timing of each gesture recognition apparatus 10 and simultaneously, installing different polarizing filters to respective gesture recognition apparatuses 10 is within the scope of the present invention.
  • the present invention provides a method and apparatus for recognizing a user gesture without interference between gesture recognition apparatuses usable with content display apparatuses.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un appareil de reconnaissance de geste qui comprend une unité de caméra comprenant une source de lumière pour projeter une lumière, un capteur pour reconnaître une lumière incidente, un processeur d'image pour produire des informations d'une image de forme d'utilisateur en utilisant les informations de la lumière frappant le capteur, et un contrôleur de synchronisation pour commander la source de lumière de sorte que la lumière soit projetée sur la base d'une synchronisation de projection, une unité de communication pour transmettre des informations de la synchronisation de projection et recevoir des informations de synchronisation de projection d'une source de lumière séparée, et une unité de commande pour reconnaître un geste d'utilisateur en utilisant l'image de forme d'utilisateur et déterminer une synchronisation de projection unique de l'appareil en utilisant les informations de synchronisation de projection reçues par l'intermédiaire de l'unité de communication. Même si plusieurs appareils de reconnaissance de geste sont présents dans le même environnement de reconnaissance de geste, une interférence entre eux ne se produit pas et chaque appareil de reconnaissance de geste agit pour reconnaître avec précision un geste d'utilisateur.
PCT/KR2011/003611 2011-05-17 2011-05-17 Procédé et appareil de reconnaissance de geste WO2012157793A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2011/003611 WO2012157793A1 (fr) 2011-05-17 2011-05-17 Procédé et appareil de reconnaissance de geste

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2011/003611 WO2012157793A1 (fr) 2011-05-17 2011-05-17 Procédé et appareil de reconnaissance de geste

Publications (1)

Publication Number Publication Date
WO2012157793A1 true WO2012157793A1 (fr) 2012-11-22

Family

ID=47177104

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2011/003611 WO2012157793A1 (fr) 2011-05-17 2011-05-17 Procédé et appareil de reconnaissance de geste

Country Status (1)

Country Link
WO (1) WO2012157793A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095098A (zh) * 2016-06-07 2016-11-09 深圳奥比中光科技有限公司 体感交互装置以及体感交互方法
JP2018503899A (ja) * 2014-12-12 2018-02-08 ヴァレオ・シャルター・ウント・ゼンゾーレン・ゲーエムベーハー 発光ユニットの同期作動によって自動車の乗員のジェスチャおよび／または視線方向を認識するための取込装置、操作装置、自動車、ならびに方法
US11803247B2 (en) 2021-10-25 2023-10-31 Kyndryl, Inc. Gesture-based control of plural devices in an environment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090195166A1 (en) * 2008-01-31 2009-08-06 Lite-On It Corporation Light Output Control Method and Lighting System Using the Same
US20090228841A1 (en) * 2008-03-04 2009-09-10 Gesture Tek, Inc. Enhanced Gesture-Based Image Manipulation
US20100060576A1 (en) * 2006-02-08 2010-03-11 Oblong Industries, Inc. Control System for Navigating a Principal Dimension of a Data Space
US20100208038A1 (en) * 2009-02-17 2010-08-19 Omek Interactive, Ltd. Method and system for gesture recognition
KR20110042806A (ko) * 2009-10-20 2011-04-27 에스케이텔레콤 주식회사 제스처를 이용한 사용자 인터페이스 제공 단말기 및 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100060576A1 (en) * 2006-02-08 2010-03-11 Oblong Industries, Inc. Control System for Navigating a Principal Dimension of a Data Space
US20090195166A1 (en) * 2008-01-31 2009-08-06 Lite-On It Corporation Light Output Control Method and Lighting System Using the Same
US20090228841A1 (en) * 2008-03-04 2009-09-10 Gesture Tek, Inc. Enhanced Gesture-Based Image Manipulation
US20100208038A1 (en) * 2009-02-17 2010-08-19 Omek Interactive, Ltd. Method and system for gesture recognition
KR20110042806A (ko) * 2009-10-20 2011-04-27 에스케이텔레콤 주식회사 제스처를 이용한 사용자 인터페이스 제공 단말기 및 방법

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018503899A (ja) * 2014-12-12 2018-02-08 ヴァレオ・シャルター・ウント・ゼンゾーレン・ゲーエムベーハー 発光ユニットの同期作動によって自動車の乗員のジェスチャおよび／または視線方向を認識するための取込装置、操作装置、自動車、ならびに方法
CN106095098A (zh) * 2016-06-07 2016-11-09 深圳奥比中光科技有限公司 体感交互装置以及体感交互方法
US11803247B2 (en) 2021-10-25 2023-10-31 Kyndryl, Inc. Gesture-based control of plural devices in an environment

Similar Documents

Publication Publication Date Title
WO2021100932A1 (fr) Dispositif électronique de commande de taille d'écran d'affichage et procédé de commande associé
WO2021112272A1 (fr) Dispositif électronique de fourniture de contenu et son procédé de commande
WO2013147464A1 (fr) Dispositif à écran tactile multipoint
WO2015023145A1 (fr) Appareil de détection de distance destiné à acquérir des informations de distance ayant une résolution spatiale variable et appareil d'affichage d'image l'ayant
WO2011062389A2 (fr) Ecran tactile, procédé de commande d'écran tactile et dispositif d'affichage comprenant un écran tactile
WO2021137319A1 (fr) Dispositif électronique permettant d'afficher un contenu lié à une application et son procédé de commande
WO2016028004A1 (fr) Appareil de commande d'éclairage et procédé de commande d'éclairage associé
WO2016182108A1 (fr) Terminal mobile et son procédé de commande
CN107409173A (zh) 拍摄设备及其控制方法、装置
WO2019093676A1 (fr) Dispositif électronique, procédé de configuration de dispositif d'affichage et multi-vision
WO2015115698A1 (fr) Dispositif portatif et procédé de commande associé
WO2021251549A1 (fr) Dispositif d'affichage
WO2019135475A1 (fr) Appareil électronique et son procédé de commande
WO2016129923A1 (fr) Dispositif d'affichage, procédé d'affichage et support d'enregistrement lisible par ordinateur
WO2014157757A1 (fr) Dispositif de saisie mobile et procédé de saisie utilisant ce dernier
WO2019231042A1 (fr) Dispositif d'authentification biométrique
WO2012157793A1 (fr) Procédé et appareil de reconnaissance de geste
WO2021085663A1 (fr) Dispositif électronique pour pilotage d'application, et son procédé de commande
WO2021132743A1 (fr) Dispositif électronique permettant d'afficher un contenu portant sur une application et son procédé de commande
WO2021149844A1 (fr) Dispositif électronique pour afficher des contenus et son procédé de commande
WO2017010593A1 (fr) Dispositif de reconnaissance de geste
WO2017126736A1 (fr) Terminal mobile
WO2019022492A1 (fr) Caméra, et appareil d'affichage d'images l'incluant
WO2015093640A1 (fr) Dispositif terminal d'utilisateur et son procédé de fourniture de service d'interaction
WO2021091105A1 (fr) Appareil électronique et procédé de commande correspondant

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11865853

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11865853

Country of ref document: EP

Kind code of ref document: A1