US20160028943A9 - Gesture recognition system and gesture recognition method based on sharpness values - Google Patents

Gesture recognition system and gesture recognition method based on sharpness values Download PDF

Info

Publication number
US20160028943A9
US20160028943A9 US13/961,558 US201313961558A US2016028943A9 US 20160028943 A9 US20160028943 A9 US 20160028943A9 US 201313961558 A US201313961558 A US 201313961558A US 2016028943 A9 US2016028943 A9 US 2016028943A9
Authority
US
United States
Prior art keywords
gesture recognition
processing unit
recognition system
image
current
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/961,558
Other versions
US20130321662A1 (en
US9628698B2 (en
Inventor
En-Feng Hsu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pixart Imaging Inc
Original Assignee
Pixart Imaging Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixart Imaging Inc filed Critical Pixart Imaging Inc
Assigned to PIXART IMAGING INC reassignment PIXART IMAGING INC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HSU, EN FENG
Publication of US20130321662A1 publication Critical patent/US20130321662A1/en
Publication of US20160028943A9 publication Critical patent/US20160028943A9/en
Application granted granted Critical
Publication of US9628698B2 publication Critical patent/US9628698B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H04N5/23219
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/673Focus control based on electronic image sensor signals based on contrast or high frequency components of image signals, e.g. hill climbing method
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/24Coupling light guides
    • G02B6/36Mechanical coupling means
    • G02B6/38Mechanical coupling means having fibre to fibre mating means
    • G02B6/3807Dismountable connectors, i.e. comprising plugs
    • G02B6/3897Connectors fixed to housings, casing, frames or circuit boards
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/24Coupling light guides
    • G02B6/42Coupling light guides with opto-electronic elements
    • G02B6/4201Packages, e.g. shape, construction, internal or external details
    • G02B6/4256Details of housings
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/24Coupling light guides
    • G02B6/42Coupling light guides with opto-electronic elements
    • G02B6/4201Packages, e.g. shape, construction, internal or external details
    • G02B6/4256Details of housings
    • G02B6/426Details of housings mounting, engaging or coupling of the package to a board, a frame or a panel
    • G02B6/4261Packages with mounting structures to be pluggable or detachable, e.g. having latches or rails
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/65Control of camera operation in relation to power supply
    • H04N23/651Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera

Definitions

  • This disclosure generally relates to a human machine interface device and, more particularly, to a gesture recognition system and method employing a zoom lens.
  • a gesture recognition system generally includes an image sensor and a processing unit, wherein the image sensor is configured to capture images containing an operating object, e.g. a finger; and the processing unit is configured to post-process the images to accordingly control an application.
  • the image sensor is configured to capture images containing an operating object, e.g. a finger
  • the processing unit is configured to post-process the images to accordingly control an application.
  • an image senor 91 is configured to capture a plurality of images containing an object O within its focus range FR, and a processing unit 92 is configured to identify a position variation of the object O according to the images.
  • the processing unit 92 is not able to identify a depth of the object O according to the images, and when the focus range FR includes another object, e.g. a background object O′, the processing unit 92 can not distinguish the objects O and O′ such that the control error may occur.
  • an infrared light source 93 to project a pattern, e.g. a chessboard pattern, onto the object O such that the processing unit 92 can identify the depth of the object O according to a size of the pattern in the images captured by the image sensor 91 .
  • the control error may still occur.
  • the present disclosure further provides a gesture recognition system and method that may recognize a three-dimensional coordinate of an object and interact with an image device according to a coordinate variation of the three-dimensional coordinate.
  • the present disclosure provides a gesture recognition system and method that may determine a current depth of at least one object according to a previously constructed lookup table regarding object depths versus sharpness.
  • the present disclosure further provides a gesture recognition system and method that may remove the object outside a predetermined operable range so as to eliminate the interference from environment objects.
  • the present disclosure further provides a gesture recognition system and method that may reduce the consumption power of the processing unit in operation by employing sub-sampling technique.
  • the present disclosure provides a gesture recognition system including a zoom lens, an image sensor, a memory unit and a processing unit.
  • the zoom lens is configured to receive a control signal to accordingly adjust a focus length of the zoom lens.
  • the image sensor is configured to capture an image frame through the zoom lens.
  • the memory unit is configured to previously save a lookup table of depths versus sharpness associated with at least one the focus length corresponding to the control signal.
  • the processing unit is configured to calculate a current sharpness value of at least one object image in the image frame and to obtain a current depth of the object image according to the lookup table.
  • the present disclosure further provides a gesture recognition method adapted to a gesture recognition system having a zoom lens.
  • the gesture recognition method includes the steps of: constructing and saving a lookup table of depths versus sharpness associated with at least one focus length of the zoom lens; capturing an image frame using an image capturing device with a current focus length; calculating a current sharpness value of at least one object image in the image frame with a processing unit; and obtaining a current depth of the at least one object image according to the current sharpness value as well as the lookup table.
  • the present disclosure further provides a gesture recognition system including an image capturing device, a memory unit and a processing unit.
  • the image capturing device has a zoom lens and is configured to capture an image frame with a focus length.
  • the memory unit is configured to previously save a lookup table of depths versus sharpness associated with at least one the focus length of the zoom lens.
  • the processing unit is configured to calculate a current sharpness value of at least one object image in the image frame and to obtain a current depth of the object image according to the lookup table.
  • an operable range may be previously set and saved so that the processing unit may remove the object image outside the operable range accordingly thereby eliminating the interference from environment objects, wherein the operable range may be a sharpness range or a depth range set before shipment or in a setup stage before the system is actually operated.
  • the processing unit is further configured to perform a sub-sampling process on the image frame before obtaining the current sharpness value so as to reduce the consumption power of the processing unit in operation, wherein a sub-sampled pixel area of the sub-sampling process is at least a 4 ⁇ 4 pixel area.
  • the processing unit may calculate a three-dimensional coordinate of the object image according to the image frame captured by the image sensor, wherein the three-dimensional coordinate may include two transverse coordinates and a depth coordinate.
  • the processing unit may further control a display device according to a coordinate variation of the three-dimensional coordinate between a plurality of image frames, e.g. controlling a cursor motion or an application.
  • FIG. 1 shows a schematic diagram of the conventional gesture recognition system.
  • FIG. 2 shows a schematic diagram of another conventional gesture recognition system.
  • FIG. 3 shows a schematic diagram of the gesture recognition system according to an embodiment of the present disclosure.
  • FIG. 4 shows a lookup table of the gesture recognition system according to the embodiment of the present disclosure.
  • FIG. 5 shows a schematic diagram of the sub-sampling process of the gesture recognition system according to the embodiment of the present disclosure.
  • FIG. 6 shows a flow chart of the gesture recognition method according to an embodiment of the present disclosure.
  • the gesture recognition system includes an image capturing device 10 , a memory unit 11 and a processing unit 12 .
  • the gesture recognition system may be coupled to a display device 2 to interact therewith.
  • the image capturing device 10 includes a zoom lens 101 , a control unit 102 and an image sensor 103 .
  • the control unit 102 outputs a control signal S C to the zoom lens 101 so as to change a focus length FL of the zoom lens 101 , wherein the control signal S C may be a voltage signal, a pulse width modulation (PWM) signal, a step motor control signal or other signals adapted to control the zoom lens.
  • PWM pulse width modulation
  • the control unit 102 may be, for example, a voltage control module configured to output different voltage values to the zoom lens 101 for adjusting its focus length FL.
  • the image sensor 103 may be a CCD image sensor, a CMOS image sensor or other sensors for sensing optical energy, and is configured to capture an image of an object O through the zoom lens 101 and output an image frame I F .
  • the image capturing device 10 may capture images of the object O with a variable focus length FL and outputs the image frame I F ; and the zoom lens 101 is adapted to receive a control signal S C to accordingly adjust a focus length FL of the zoom lens 101 .
  • the zoom lens 101 and the control unit 102 may combine together to form a zoom lens module.
  • the memory unit 11 previously saves a lookup table of depths versus sharpness associated with at least one focus length FL of the zoom lens 101 , wherein said focus length FL is corresponding to the control signal S C , e.g. each voltage value outputted by the control unit 102 corresponds to one focus length FL.
  • FIG. 4 shows a lookup table previously saved in the memory unit 11 of the gesture recognition system according to the embodiment of the present disclosure. Before shipment, it is able to select at least one control signal S C to be inputted into the zoom lens 101 so as to determine a focus length FL and calculate the depth (i.e. a longitudinal distance with respect to the image capturing device 10 ) corresponding to sharpness of different object distances at that focus length FL.
  • the zoom lens 101 when the zoom lens 101 is controlled to focus on the object distance of 50 cm, it is able to obtain the highest sharpness value (e.g. 0.8 herein) at the depth of 50 cm, and the sharpness value decreases with the increasing and decreasing of the depth.
  • An embodiment of the sharpness may be indicated by the modulation transfer function (MTF) value, but not limited thereto.
  • MTF modulation transfer function
  • it is able to control the zoom lens 101 to focus on a plurality of object distances before shipment and respectively construct a lookup table of depths versus sharpness associated with different object distances.
  • FIG. 4 further shows the relationship between depths and sharpness when focusing on the object distance of 10 cm, 30 cm and 70 cm, and this lookup table is previously saved in the memory unit 11 . It should be mentioned that values shown in FIG. 4 are only exemplary but not to limit the present disclosure.
  • the processing unit 12 is configured to calculate a current sharpness value of at least one object image (e.g. the image of the object O) in the image frames I F and to obtain a current depth D of the object image according to the lookup table. For example, when the image capturing device 10 is focused on the object distance of 10 cm, an image frame I F is captured and if the processing unit 12 calculates that a sharpness value of an object image in the image frame I F is 0.8, it means that the current depth D is 10 cm; if the sharpness value is 0.7, it means that the current depth D is 20 cm; if the sharpness value is 0.6, it means that the current depth D is 30 cm and so on.
  • a sharpness value of an object image in the image frame I F is 0.8, it means that the current depth D is 10 cm; if the sharpness value is 0.7, it means that the current depth D is 20 cm; if the sharpness value is 0.6, it means that the current depth D is 30 cm and so on.
  • the processing unit 12 may obtain a current depth D according to the obtained sharpness value in comparison with the lookup table.
  • one sharpness value may correspond to two current depths D, e.g. when the image capturing device 10 is focused on the object distance of 50 cm, each sharpness value is corresponded to two depths. Therefore, in order to confirm the correct current depth D, in the present disclosure it is able to control the image capturing device 10 to change the focus length FL (e.g. focusing on the object distance of 30 cm or 70 cm) and further capture an image frame I F for calculating another current sharpness value of the object image. Accordingly, two current sharpness values may determine a correct current depth D.
  • the processing unit 12 may further be configured to remove the object image outside an operable range.
  • an operable range may be previously set as 30-70 cm before shipment and saved in the memory unit 11 ; or the operable range may be set as 30-70 cm in a setup stage before the gesture recognition system of the present disclosure is actually operated.
  • a switching mode may be provided (e.g. in the starting procedure or by enabling a selection switch) to select the setup stage for setting the operable range to be saved in the memory unit 11 .
  • the operable range may be a sharpness range or a depth range.
  • the processing unit 12 may determine whether to keep the object image for post-processing directly according to the sharpness range without comparing with the lookup table; or the processing unit 12 may convert the current sharpness value of the object image to a current depth D according to the lookup table and then determine whether to keep the object image for post-processing according to the depth range.
  • the processing unit 12 may perform a sub-sampling process on the image frame I F before obtaining the current sharpness value.
  • a sub-sampled pixel area in the sub-sampling process is preferably at least a 4 ⁇ 4 pixel area.
  • the image sensor 103 may capture and output the image frames I F having a size of 20 ⁇ 20, and the processing unit 12 only retrieves a part of pixel areas in the post-processing process, e.g. the blank pixel areas I F1 in FIG.
  • a size of the sub-sampled pixel area i.e. the blank pixel areas I F1
  • the sub-sampled pixel area in the sub-sampling process may further be dynamically adjusted according to the image quality of the captured images, and this may be realized by changing the timing control of the image sensor.
  • the processing unit 12 is able to calculate a three-dimensional coordinate of the object image according to the image frame I F ; e.g. calculating a plane coordinate (x,y) according to a transverse position of the object image with respect to the image capturing device 10 and obtaining a three-dimensional coordinate (x,y,D) of the object image further cooperating with the current depth D of the object image with respect to the image capturing device 10 .
  • the processing unit 12 may interact with the display device 2 according to a coordinate variation ( ⁇ x, ⁇ y, ⁇ D) of the three-dimensional coordinate (x,y,D), e.g. controlling the cursor motion of a cursor on the display device 2 and/or an application (e.g.
  • a gesture may be a simple two-dimensional transverse trace (i.e. horizontal movement) or a one-dimensional longitudinal trace (i.e. movement along the depth with respect to the image capturing device 10 ), or a three-dimensional trace, and various combinations are possible according to the user definition.
  • the gesture motion may be defined by three-dimensional information so that more complicated and various gesture commands can be implemented.
  • FIG. 6 it shows a flow chart of the gesture recognition method according to an embodiment of the present disclosure, which includes the steps of: constructing and saving a lookup table of depths versus sharpness associated with at least one focus length of a zoom lens (Step S 31 ); setting an operable range (Step S 32 ); capturing an image frame with a current focus length (Step S 33 ); performing a sub-sampling process on the image frame (Step S 34 ); calculating a current sharpness value of at least one object image in the image frame (Step S 35 ); obtaining a current depth of the at least one object image according to the current sharpness value and the lookup table (Step S 36 ); removing the object image outside the operable range (Step S 37 ); calculating a three-dimensional coordinate of the object image (Step S 38 ); and controlling a display device according to a coordinate variation of the three-dimensional coordinate (Step S 39 ).
  • the gesture recognition method according to the embodiment of the present disclosure may be adapted to
  • Step S 31 Preferably, before shipment of the gesture recognition system, a lookup table of depths verses sharpness associated with at least one focus length FL of the zoom lens 101 is previously constructed (as shown in FIG. 4 ).
  • the lookup table is stored in the memory unit 11 to be served as the lookup reference in actual operation.
  • Step S 32 Next, an operable range is set, and the operable range may be determined according to different applications of the gesture recognition system.
  • the operable range may be set before shipment of the gesture recognition system.
  • the operable range may be set by a user in a setup stage before the actual operation; i.e. the operable range may be set according to the requirement of user.
  • the operable range may be a sharpness range or a depth range. In other embodiments, if the gesture recognition system is operated in an environment without the interference from the environment object, the Step S 32 may not be implemented.
  • Step S 33 In the actual operation, the image capturing device 10 captures an image frame I F with a current focus length FL and the image frame I F is outputted to the processing unit 12 .
  • a size of the image frame I F may be determined according to different sizes of a sensing array of the image sensor 103 .
  • Step S 34 After receiving the image frame I F and before calculating a current sharpness value of the object image, the processing unit 12 may selectively perform a sub-sampling process on the image frame I F so as to reduce the power consumption.
  • a size of a sub-sampled pixel area of the sub-sampling process is at least 4 ⁇ 4 and the size of the sub-sampled pixel area may be determined according to the size and/or the image quality of the image frame I F . In other embodiments, Step S 34 may not be implemented.
  • Step S 35 The processing unit 12 calculates a current sharpness value of at least one object image in the image frame I F according to the image frame I F or the sub-sampled image frame, wherein the method of calculating the sharpness value of an object image in the image frame is well known, e.g. calculating the modulation transfer function (MTF) value of the image frame, and thus details thereof are not described herein.
  • MTF modulation transfer function
  • Step S 36 The processing unit 12 then compares the current sharpness value with the lookup table so as to obtain a current depth D of the at least one object image, e.g. a depth of the object O, corresponding to the current sharpness value.
  • a current depth D of the at least one object image e.g. a depth of the object O
  • the corresponded current depth D may be obtained by using the interpolation technique.
  • Step S 37 In order to eliminate the interference on the gesture recognition system from environment objects, after obtaining the current depth D of every object image, the processing unit 12 may identify whether the current depth D is within the operable range or not and may remove the object image outside the operable range. It is appreciated that when the Step S 32 is not implemented, the Step S 37 is neither implemented.
  • Step S 38 the processing unit 12 may calculate a three-dimensional coordinate of each object image within the operable rage according to the image frame I F , e.g. including two transverse coordinates and a depth coordinate (i.e. the current depth D obtained in the Step S 36 ), wherein the method of calculating the transverse coordinates by the processing unit 12 is well known and thus details thereof are not described herein.
  • the present embodiment is to correctly calculate the depth of the object O with respect to the image capturing device 10 .
  • Step S 39 the processing unit 12 may control a display device 2 according to a coordinate variation of the three-dimensional coordinate between a plurality of the image frames I F , e.g. controlling a cursor motion and/or an application, wherein the display device 2 may be a television, a projection screen, a computer screen, a game host screen or other display devices configured to display/project images.
  • the display device 2 may be a television, a projection screen, a computer screen, a game host screen or other display devices configured to display/project images.
  • the gesture recognition system of this embodiment returns to the Step S 33 to capture a new image frame I F and then identifies following positions of the object O.
  • the present disclosure further provides a gesture recognition system ( FIG. 3 ) and a gesture recognition method ( FIG. 6 ) that may achieve the object of recognizing the object depth by employing a zoom lens in cooperation with a previously constructed lookup table ( FIG. 4 ).

Abstract

A gesture recognition system includes an image capturing device, a memory unit and a processing unit. The image capturing device includes a zoom lens and captures an image frame with a focus length. The memory unit previously saves a lookup table of depths versus sharpness associated with at least one the focus length of the zoom lens. The processing unit is configured to calculate a current sharpness value of at least one object image in the image frame and to obtain a current depth of the object image according to the lookup table.

Description

    CROSS REFERENCE TO RELATED APPLICATION
  • This application claims the priority benefit of Taiwan Patent Application Serial Number 101132634, filed on Sep. 7, 2012, the full disclosure of which is incorporated herein by reference.
  • BACKGROUND
  • 1. Field of the Disclosure
  • This disclosure generally relates to a human machine interface device and, more particularly, to a gesture recognition system and method employing a zoom lens.
  • 2. Description of the Related Art
  • In recent years, introducing the interactive mechanism into multimedia systems so as to improve the operational convenience has become a popular technique, wherein the gesture recognition is an important technique adapted to replace the traditional mouse, stick or remote controller.
  • A gesture recognition system generally includes an image sensor and a processing unit, wherein the image sensor is configured to capture images containing an operating object, e.g. a finger; and the processing unit is configured to post-process the images to accordingly control an application.
  • For example as shown in FIG. 1, an image senor 91 is configured to capture a plurality of images containing an object O within its focus range FR, and a processing unit 92 is configured to identify a position variation of the object O according to the images. However, the processing unit 92 is not able to identify a depth of the object O according to the images, and when the focus range FR includes another object, e.g. a background object O′, the processing unit 92 can not distinguish the objects O and O′ such that the control error may occur.
  • Referring to FIG. 2, in order to identify the depth of the object O, it is able to use an infrared light source 93 to project a pattern, e.g. a chessboard pattern, onto the object O such that the processing unit 92 can identify the depth of the object O according to a size of the pattern in the images captured by the image sensor 91. However, when the pattern is interfered by ambient light sources, the control error may still occur.
  • Accordingly, the present disclosure further provides a gesture recognition system and method that may recognize a three-dimensional coordinate of an object and interact with an image device according to a coordinate variation of the three-dimensional coordinate.
  • SUMMARY
  • The present disclosure provides a gesture recognition system and method that may determine a current depth of at least one object according to a previously constructed lookup table regarding object depths versus sharpness.
  • The present disclosure further provides a gesture recognition system and method that may remove the object outside a predetermined operable range so as to eliminate the interference from environment objects.
  • The present disclosure further provides a gesture recognition system and method that may reduce the consumption power of the processing unit in operation by employing sub-sampling technique.
  • The present disclosure provides a gesture recognition system including a zoom lens, an image sensor, a memory unit and a processing unit. The zoom lens is configured to receive a control signal to accordingly adjust a focus length of the zoom lens. The image sensor is configured to capture an image frame through the zoom lens. The memory unit is configured to previously save a lookup table of depths versus sharpness associated with at least one the focus length corresponding to the control signal. The processing unit is configured to calculate a current sharpness value of at least one object image in the image frame and to obtain a current depth of the object image according to the lookup table.
  • The present disclosure further provides a gesture recognition method adapted to a gesture recognition system having a zoom lens. The gesture recognition method includes the steps of: constructing and saving a lookup table of depths versus sharpness associated with at least one focus length of the zoom lens; capturing an image frame using an image capturing device with a current focus length; calculating a current sharpness value of at least one object image in the image frame with a processing unit; and obtaining a current depth of the at least one object image according to the current sharpness value as well as the lookup table.
  • The present disclosure further provides a gesture recognition system including an image capturing device, a memory unit and a processing unit. The image capturing device has a zoom lens and is configured to capture an image frame with a focus length. The memory unit is configured to previously save a lookup table of depths versus sharpness associated with at least one the focus length of the zoom lens. The processing unit is configured to calculate a current sharpness value of at least one object image in the image frame and to obtain a current depth of the object image according to the lookup table.
  • In one aspect, an operable range may be previously set and saved so that the processing unit may remove the object image outside the operable range accordingly thereby eliminating the interference from environment objects, wherein the operable range may be a sharpness range or a depth range set before shipment or in a setup stage before the system is actually operated.
  • In one aspect, the processing unit is further configured to perform a sub-sampling process on the image frame before obtaining the current sharpness value so as to reduce the consumption power of the processing unit in operation, wherein a sub-sampled pixel area of the sub-sampling process is at least a 4×4 pixel area.
  • In the gesture recognition system and method of the present disclosure, the processing unit may calculate a three-dimensional coordinate of the object image according to the image frame captured by the image sensor, wherein the three-dimensional coordinate may include two transverse coordinates and a depth coordinate. The processing unit may further control a display device according to a coordinate variation of the three-dimensional coordinate between a plurality of image frames, e.g. controlling a cursor motion or an application.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Other objects, advantages, and novel features of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.
  • FIG. 1 shows a schematic diagram of the conventional gesture recognition system.
  • FIG. 2 shows a schematic diagram of another conventional gesture recognition system.
  • FIG. 3 shows a schematic diagram of the gesture recognition system according to an embodiment of the present disclosure.
  • FIG. 4 shows a lookup table of the gesture recognition system according to the embodiment of the present disclosure.
  • FIG. 5 shows a schematic diagram of the sub-sampling process of the gesture recognition system according to the embodiment of the present disclosure.
  • FIG. 6 shows a flow chart of the gesture recognition method according to an embodiment of the present disclosure.
  • DETAILED DESCRIPTION OF THE EMBODIMENT
  • It should be noted that, wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
  • Referring to FIG. 3, it shows a schematic diagram of the gesture recognition system according to an embodiment of the present disclosure. The gesture recognition system includes an image capturing device 10, a memory unit 11 and a processing unit 12. The gesture recognition system may be coupled to a display device 2 to interact therewith. The image capturing device 10 includes a zoom lens 101, a control unit 102 and an image sensor 103. The control unit 102 outputs a control signal SC to the zoom lens 101 so as to change a focus length FL of the zoom lens 101, wherein the control signal SC may be a voltage signal, a pulse width modulation (PWM) signal, a step motor control signal or other signals adapted to control the zoom lens. In one embodiment, the control unit 102 may be, for example, a voltage control module configured to output different voltage values to the zoom lens 101 for adjusting its focus length FL. The image sensor 103 may be a CCD image sensor, a CMOS image sensor or other sensors for sensing optical energy, and is configured to capture an image of an object O through the zoom lens 101 and output an image frame IF. In other words, in this embodiment the image capturing device 10 may capture images of the object O with a variable focus length FL and outputs the image frame IF; and the zoom lens 101 is adapted to receive a control signal SC to accordingly adjust a focus length FL of the zoom lens 101. In other embodiments, the zoom lens 101 and the control unit 102 may combine together to form a zoom lens module.
  • The memory unit 11 previously saves a lookup table of depths versus sharpness associated with at least one focus length FL of the zoom lens 101, wherein said focus length FL is corresponding to the control signal SC, e.g. each voltage value outputted by the control unit 102 corresponds to one focus length FL. For example referring to FIG. 4, it shows a lookup table previously saved in the memory unit 11 of the gesture recognition system according to the embodiment of the present disclosure. Before shipment, it is able to select at least one control signal SC to be inputted into the zoom lens 101 so as to determine a focus length FL and calculate the depth (i.e. a longitudinal distance with respect to the image capturing device 10) corresponding to sharpness of different object distances at that focus length FL. For example, when the zoom lens 101 is controlled to focus on the object distance of 50 cm, it is able to obtain the highest sharpness value (e.g. 0.8 herein) at the depth of 50 cm, and the sharpness value decreases with the increasing and decreasing of the depth. An embodiment of the sharpness may be indicated by the modulation transfer function (MTF) value, but not limited thereto. Similarly, it is able to control the zoom lens 101 to focus on a plurality of object distances before shipment and respectively construct a lookup table of depths versus sharpness associated with different object distances. For example, FIG. 4 further shows the relationship between depths and sharpness when focusing on the object distance of 10 cm, 30 cm and 70 cm, and this lookup table is previously saved in the memory unit 11. It should be mentioned that values shown in FIG. 4 are only exemplary but not to limit the present disclosure.
  • In actual operation of the gesture recognition system, the processing unit 12 is configured to calculate a current sharpness value of at least one object image (e.g. the image of the object O) in the image frames IF and to obtain a current depth D of the object image according to the lookup table. For example, when the image capturing device 10 is focused on the object distance of 10 cm, an image frame IF is captured and if the processing unit 12 calculates that a sharpness value of an object image in the image frame IF is 0.8, it means that the current depth D is 10 cm; if the sharpness value is 0.7, it means that the current depth D is 20 cm; if the sharpness value is 0.6, it means that the current depth D is 30 cm and so on. In this manner, the processing unit 12 may obtain a current depth D according to the obtained sharpness value in comparison with the lookup table. In addition, according to FIG. 4, one sharpness value may correspond to two current depths D, e.g. when the image capturing device 10 is focused on the object distance of 50 cm, each sharpness value is corresponded to two depths. Therefore, in order to confirm the correct current depth D, in the present disclosure it is able to control the image capturing device 10 to change the focus length FL (e.g. focusing on the object distance of 30 cm or 70 cm) and further capture an image frame IF for calculating another current sharpness value of the object image. Accordingly, two current sharpness values may determine a correct current depth D.
  • In addition, in order to remove the image of background objects, in this embodiment the processing unit 12 may further be configured to remove the object image outside an operable range. Referring to FIG. 3 again, for example an operable range may be previously set as 30-70 cm before shipment and saved in the memory unit 11; or the operable range may be set as 30-70 cm in a setup stage before the gesture recognition system of the present disclosure is actually operated. For example, a switching mode may be provided (e.g. in the starting procedure or by enabling a selection switch) to select the setup stage for setting the operable range to be saved in the memory unit 11. The operable range may be a sharpness range or a depth range. For example when the processing unit 12 calculates a current sharpness value of an object image, the processing unit 12 may determine whether to keep the object image for post-processing directly according to the sharpness range without comparing with the lookup table; or the processing unit 12 may convert the current sharpness value of the object image to a current depth D according to the lookup table and then determine whether to keep the object image for post-processing according to the depth range.
  • In addition, in order to reduce the power consumption of the processing unit 12 in operation, the processing unit 12 may perform a sub-sampling process on the image frame IF before obtaining the current sharpness value. In this embodiment, as the object depth has to be recognized according to different sharpness values, in order not to loss image information of blurred areas in the sub-sampling process, a sub-sampled pixel area in the sub-sampling process is preferably at least a 4×4 pixel area. For example referring to FIG. 5, the image sensor 103 may capture and output the image frames IF having a size of 20×20, and the processing unit 12 only retrieves a part of pixel areas in the post-processing process, e.g. the blank pixel areas IF1 in FIG. 5 (i.e. sub-sampled pixels) to accordingly calculate the depth of the object image. Filled pixel areas IF2 (i.e. not sub-sampled pixels) are abandoned. This is the sub-sampling process referred by the present disclosure. It is appreciated that, according to the size of the image frame IF, a size of the sub-sampled pixel area (i.e. the blank pixel areas IF1) may be 4×4, 8×8 and so on as long as it is larger than 4×4 pixel area. In addition, the sub-sampled pixel area in the sub-sampling process may further be dynamically adjusted according to the image quality of the captured images, and this may be realized by changing the timing control of the image sensor.
  • After the current depth D of the object image has been calculated, the processing unit 12 is able to calculate a three-dimensional coordinate of the object image according to the image frame IF; e.g. calculating a plane coordinate (x,y) according to a transverse position of the object image with respect to the image capturing device 10 and obtaining a three-dimensional coordinate (x,y,D) of the object image further cooperating with the current depth D of the object image with respect to the image capturing device 10. The processing unit 12 may interact with the display device 2 according to a coordinate variation (Δx,Δy,ΔD) of the three-dimensional coordinate (x,y,D), e.g. controlling the cursor motion of a cursor on the display device 2 and/or an application (e.g. the icon selection), but not limited thereto, wherein a gesture may be a simple two-dimensional transverse trace (i.e. horizontal movement) or a one-dimensional longitudinal trace (i.e. movement along the depth with respect to the image capturing device 10), or a three-dimensional trace, and various combinations are possible according to the user definition. Particularly, as the present embodiment may detect three-dimensional movement information of an object, the gesture motion may be defined by three-dimensional information so that more complicated and various gesture commands can be implemented.
  • Referring to FIG. 6, it shows a flow chart of the gesture recognition method according to an embodiment of the present disclosure, which includes the steps of: constructing and saving a lookup table of depths versus sharpness associated with at least one focus length of a zoom lens (Step S31); setting an operable range (Step S32); capturing an image frame with a current focus length (Step S33); performing a sub-sampling process on the image frame (Step S34); calculating a current sharpness value of at least one object image in the image frame (Step S35); obtaining a current depth of the at least one object image according to the current sharpness value and the lookup table (Step S36); removing the object image outside the operable range (Step S37); calculating a three-dimensional coordinate of the object image (Step S38); and controlling a display device according to a coordinate variation of the three-dimensional coordinate (Step S39). The gesture recognition method according to the embodiment of the present disclosure may be adapted to a gesture recognition system having a zoom lens 101.
  • Referring to FIGS. 3 to 6, details of the gesture recognition method of this embodiment are described hereinafter.
  • Step S31: Preferably, before shipment of the gesture recognition system, a lookup table of depths verses sharpness associated with at least one focus length FL of the zoom lens 101 is previously constructed (as shown in FIG. 4). The lookup table is stored in the memory unit 11 to be served as the lookup reference in actual operation.
  • Step S32: Next, an operable range is set, and the operable range may be determined according to different applications of the gesture recognition system. In one embodiment, the operable range may be set before shipment of the gesture recognition system. In another embodiment, the operable range may be set by a user in a setup stage before the actual operation; i.e. the operable range may be set according to the requirement of user. As mentioned above, the operable range may be a sharpness range or a depth range. In other embodiments, if the gesture recognition system is operated in an environment without the interference from the environment object, the Step S32 may not be implemented.
  • Step S33: In the actual operation, the image capturing device 10 captures an image frame IF with a current focus length FL and the image frame IF is outputted to the processing unit 12. A size of the image frame IF may be determined according to different sizes of a sensing array of the image sensor 103.
  • Step S34: After receiving the image frame IF and before calculating a current sharpness value of the object image, the processing unit 12 may selectively perform a sub-sampling process on the image frame IF so as to reduce the power consumption. As mentioned above, a size of a sub-sampled pixel area of the sub-sampling process is at least 4×4 and the size of the sub-sampled pixel area may be determined according to the size and/or the image quality of the image frame IF. In other embodiments, Step S34 may not be implemented.
  • Step S35: The processing unit 12 calculates a current sharpness value of at least one object image in the image frame IF according to the image frame IF or the sub-sampled image frame, wherein the method of calculating the sharpness value of an object image in the image frame is well known, e.g. calculating the modulation transfer function (MTF) value of the image frame, and thus details thereof are not described herein.
  • Step S36: The processing unit 12 then compares the current sharpness value with the lookup table so as to obtain a current depth D of the at least one object image, e.g. a depth of the object O, corresponding to the current sharpness value. In addition, when the current sharpness value is not included in the lookup table, the corresponded current depth D may be obtained by using the interpolation technique.
  • Step S37: In order to eliminate the interference on the gesture recognition system from environment objects, after obtaining the current depth D of every object image, the processing unit 12 may identify whether the current depth D is within the operable range or not and may remove the object image outside the operable range. It is appreciated that when the Step S32 is not implemented, the Step S37 is neither implemented.
  • Step S38: Next, the processing unit 12 may calculate a three-dimensional coordinate of each object image within the operable rage according to the image frame IF, e.g. including two transverse coordinates and a depth coordinate (i.e. the current depth D obtained in the Step S36), wherein the method of calculating the transverse coordinates by the processing unit 12 is well known and thus details thereof are not described herein. The present embodiment is to correctly calculate the depth of the object O with respect to the image capturing device 10.
  • Step S39: Finally, the processing unit 12 may control a display device 2 according to a coordinate variation of the three-dimensional coordinate between a plurality of the image frames IF, e.g. controlling a cursor motion and/or an application, wherein the display device 2 may be a television, a projection screen, a computer screen, a game host screen or other display devices configured to display/project images.
  • After the three-dimensional coordinate has been calculated, the gesture recognition system of this embodiment returns to the Step S33 to capture a new image frame IF and then identifies following positions of the object O.
  • As mentioned above, the conventional gesture recognition method has the problem of unable to recognize the object depth or has the requirement of projecting an additional optical pattern. Therefore, the present disclosure further provides a gesture recognition system (FIG. 3) and a gesture recognition method (FIG. 6) that may achieve the object of recognizing the object depth by employing a zoom lens in cooperation with a previously constructed lookup table (FIG. 4).
  • Although the disclosure has been explained in relation to its preferred embodiment, it is not used to limit the disclosure. It is to be understood that many other possible modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the disclosure as hereinafter claimed.

Claims (20)

What is claimed is:
1. A gesture recognition system, comprising:
a zoom lens configured to receive a control signal to accordingly adjust a focus length thereof;
an image sensor configured to capture an image frame through the zoom lens;
a memory unit configured to previously save a lookup table of depths versus sharpness associated with at least one the focus length corresponding to the control signal; and
a processing unit configured to calculate a current sharpness value of at least one object image in the image frame and obtain a current depth of the object image according to the lookup table.
2. The gesture recognition system as claimed in claim 1, wherein the processing unit is further configured to remove the object image outside an operable range.
3. The gesture recognition system as claimed in claim 2, wherein the operable range is a sharpness range or a depth range set previously before shipment or in a setup stage before operation.
4. The gesture recognition system as claimed in claim 1, wherein the control signal is a voltage signal or a PWM signal.
5. The gesture recognition system as claimed in claim 1, wherein the processing unit is further configured to perform a sub-sampling process before obtaining the current sharpness value.
6. The gesture recognition system as claimed in claim 5, wherein a sub-sampled pixel area of the sub-sampling process is at least a 4×4 pixel area.
7. The gesture recognition system as claimed in claim 1, wherein the processing unit is further configured to calculate a three-dimensional coordinate of the object image according to the image frame.
8. The gesture recognition system as claimed in claim 7, wherein the processing unit is further configured to control a display device according to a coordinate variation of the three-dimensional coordinate.
9. A gesture recognition method, adapted to a gesture recognition system comprising a zoom lens, the gesture recognition method comprising:
constructing a lookup table of depths versus sharpness associated with at least one focus length of the zoom lens;
capturing an image frame using an image capturing device with a current focus length;
calculating a current sharpness value of at least one object image in the image frame with a processing unit; and
obtaining a current depth of the at least one object image according to the current sharpness value and the lookup table.
10. The gesture recognition method as claimed in claim 9, further comprising:
setting an operable range.
11. The gesture recognition method as claimed in claim 10, further comprising:
removing the object image outside the operable range.
12. The gesture recognition method as claimed in claim 10, wherein the operable range is a sharpness range or a depth range.
13. The gesture recognition method as claimed in claim 9, wherein before the step of calculating a current sharpness value, further comprises:
performing, using the processing unit, a sub-sampling process on the image frame, and a sub-sampled pixel area of the sub-sampling process is at least a 4×4 pixel area.
14. The gesture recognition method as claimed in claim 9, further comprising:
calculating, using the processing unit, a three-dimensional coordinate of the object image according to the image frame.
15. The gesture recognition method as claimed in claim 14, further comprising:
controlling, using the processing unit, a display device according to a coordinate variation of the three-dimensional coordinate.
16. A gesture recognition system, comprising:
an image capturing device comprising a zoom lens and configured to capture an image frame with a focus length;
a memory unit configured to previously save a lookup table of depths versus sharpness associated with at least one the focus length of the zoom lens; and
a processing unit configured to calculate a current sharpness value of at least one object image in the image frame and obtain a current depth of the object image according to the lookup table.
17. The gesture recognition system as claimed in claim 16, wherein the processing unit is further configured to remove the object image outside an operable range.
18. The gesture recognition system as claimed in claim 17, wherein the operable range is a sharpness range or a depth range.
19. The gesture recognition system as claimed in claim 16, wherein the processing unit is further configured to perform a sub-sampling process before obtaining the current sharpness value, and a sub-sampled pixel area of the sub-sampling process is at least a 4×4 pixel area.
20. The gesture recognition system as claimed in claim 16, wherein the processing unit is further configured to calculate a three-dimensional coordinate of the object image according to the image frame to accordingly control at least one of a cursor motion and an application.
US13/961,558 2012-09-07 2013-08-07 Gesture recognition system and gesture recognition method based on sharpness values Active 2033-11-28 US9628698B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2011-025372 2011-02-08
TW101132634A 2012-09-07
TW101132634 2012-09-07
TW101132634A TWI494792B (en) 2012-09-07 2012-09-07 Gesture recognition system and method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/076817 Continuation WO2012070537A1 (en) 2010-11-22 2011-11-21 Coagulation spinning structure and production method therefor, and electric wire using same

Publications (3)

Publication Number Publication Date
US20130321662A1 US20130321662A1 (en) 2013-12-05
US20160028943A9 true US20160028943A9 (en) 2016-01-28
US9628698B2 US9628698B2 (en) 2017-04-18

Family

ID=50820857

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/961,558 Active 2033-11-28 US9628698B2 (en) 2012-09-07 2013-08-07 Gesture recognition system and gesture recognition method based on sharpness values

Country Status (2)

Country Link
US (1) US9628698B2 (en)
TW (1) TWI494792B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160370880A1 (en) * 2015-06-22 2016-12-22 Quanta Computer Inc. Optical input method and optical virtual mouse utilizing the same
CN107329632A (en) * 2017-06-06 2017-11-07 西安电子科技大学 The hand exercise information processing method of body-sensing mouse based on infrared ray sensor

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014185497A1 (en) 2013-05-17 2014-11-20 独立行政法人産業技術総合研究所 Drawn carbon nanotube yarn and production method therefor
WO2015001681A1 (en) 2013-07-05 2015-01-08 古河電気工業株式会社 Optical module, optical module mounting method, optical module-mounted circuit substrate, optical module evaluation kit system, circuit substrate and communication system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0368671A2 (en) 1988-11-11 1990-05-16 Canon Kabushiki Kaisha Feature extracting apparatus
US20090143671A1 (en) 2007-12-03 2009-06-04 Fujifilm Corporation Position identifying system, position identifying method, and computer readable medium
US20100321524A1 (en) 2009-06-17 2010-12-23 Altek Corporation Sharpness processing method and system for digital image
US20110019067A1 (en) 2009-07-27 2011-01-27 Panasonic Corporation Imaging apparatus
US20120113300A1 (en) 2010-11-04 2012-05-10 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US20120140110A1 (en) 2010-09-30 2012-06-07 Nikon Corporation Interchangeable lens and camera body
US20150124155A1 (en) 2013-03-28 2015-05-07 Huawei Technologies Co., Ltd. Quick Automatic Focusing Method and Image Acquisition Apparatus

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2640682B2 (en) 1988-10-27 1997-08-13 ファナック株式会社 Abnormal display method of machining fluid temperature of wire electric discharge machine
JP2647733B2 (en) 1990-07-26 1997-08-27 ファナック株式会社 Air conditioning management system for wire cut electric discharge machine
JP4503878B2 (en) * 2001-04-27 2010-07-14 オリンパス株式会社 Imaging apparatus and imaging method
JP4678597B2 (en) * 2005-12-27 2011-04-27 富士フイルム株式会社 Lens barrel
US8614669B2 (en) * 2006-03-13 2013-12-24 Navisense Touchless tablet method and system thereof
KR100783552B1 (en) * 2006-10-11 2007-12-07 삼성전자주식회사 Input control method and device for mobile phone
JP5052127B2 (en) * 2006-12-28 2012-10-17 三星電子株式会社 Imaging apparatus and imaging method
US8233077B2 (en) * 2007-12-27 2012-07-31 Qualcomm Incorporated Method and apparatus with depth map generation
WO2009152769A1 (en) * 2008-06-17 2009-12-23 深圳华为通信技术有限公司 Video communication method, apparatus and system
WO2010073616A1 (en) * 2008-12-25 2010-07-01 パナソニック株式会社 Information displaying apparatus and information displaying method
CN103210641B (en) 2010-02-19 2017-03-15 双光圈国际株式会社 Process multi-perture image data
CN101853071B (en) * 2010-05-13 2012-12-05 重庆大学 Gesture identification method and system based on visual sense
TW201219740A (en) * 2010-11-04 2012-05-16 Quanta Comp Inc Method and apparatus for measuring Depth of Field
CN102253713B (en) * 2011-06-23 2016-10-12 康佳集团股份有限公司 Towards 3 D stereoscopic image display system
TWI451344B (en) * 2012-08-27 2014-09-01 Pixart Imaging Inc Gesture recognition system and method
JP6202927B2 (en) * 2012-08-31 2017-09-27 キヤノン株式会社 Distance detection device, imaging device, program, recording medium, and distance detection method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0368671A2 (en) 1988-11-11 1990-05-16 Canon Kabushiki Kaisha Feature extracting apparatus
US20090143671A1 (en) 2007-12-03 2009-06-04 Fujifilm Corporation Position identifying system, position identifying method, and computer readable medium
US20100321524A1 (en) 2009-06-17 2010-12-23 Altek Corporation Sharpness processing method and system for digital image
US20110019067A1 (en) 2009-07-27 2011-01-27 Panasonic Corporation Imaging apparatus
US20120140110A1 (en) 2010-09-30 2012-06-07 Nikon Corporation Interchangeable lens and camera body
US20120113300A1 (en) 2010-11-04 2012-05-10 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US20150124155A1 (en) 2013-03-28 2015-05-07 Huawei Technologies Co., Ltd. Quick Automatic Focusing Method and Image Acquisition Apparatus

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160370880A1 (en) * 2015-06-22 2016-12-22 Quanta Computer Inc. Optical input method and optical virtual mouse utilizing the same
CN107329632A (en) * 2017-06-06 2017-11-07 西安电子科技大学 The hand exercise information processing method of body-sensing mouse based on infrared ray sensor

Also Published As

Publication number Publication date
TWI494792B (en) 2015-08-01
US20130321662A1 (en) 2013-12-05
US9628698B2 (en) 2017-04-18
TW201411407A (en) 2014-03-16

Similar Documents

Publication Publication Date Title
US9311712B2 (en) Image processing device and image processing method
US9959681B2 (en) Augmented reality contents generation and play system and method using the same
US8831282B2 (en) Imaging device including a face detector
US9459695B2 (en) Gesture recognition system and method
EP3531418A1 (en) Electronic device displaying interface for editing video data and method for controlling same
US9628698B2 (en) Gesture recognition system and gesture recognition method based on sharpness values
US11143879B2 (en) Semi-dense depth estimation from a dynamic vision sensor (DVS) stereo pair and a pulsed speckle pattern projector
KR101691880B1 (en) Interactive System Having Auto Calibration Function And Auto Calibration Method of Interactive System
CN103096094A (en) Vision recognition apparatus and method
KR20190087215A (en) Electronic device and methof to control auto focus of camera
US9857918B2 (en) Content display control method and system
JP2007086995A (en) Pointing device
JP2022092215A (en) Projection method, projection system, and program
US9373035B2 (en) Image capturing method for image recognition and system thereof
US9838615B2 (en) Image editing method and electronic device using the same
CN110297545B (en) Gesture control method, gesture control device and system, and storage medium
US11128764B2 (en) Imaging apparatus, control method, and non-transitory computer readable medium
US9942459B2 (en) Method and system for image quality learning with solid state image sensors
KR100849532B1 (en) Device having function of non-contact mouse and method thereof
JP2019161247A (en) Projection type display device and control method thereof
KR100843586B1 (en) Device capable of non-contact function selection and method thereof
CN103679124A (en) Gesture recognition system and method
JP2011135285A (en) Imaging apparatus, and imaging control program
TWI610198B (en) Remote control system and method of generating a control command according to at least one static gesture
CN103699238B (en) Optical movement sensing method

Legal Events

Date Code Title Description
AS Assignment

Owner name: PIXART IMAGING INC, TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HSU, EN FENG;REEL/FRAME:030967/0552

Effective date: 20120410

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4