WO2012065516A1

WO2012065516A1 - Method and mobile phone device for realizing the shutter function of camera by the gesture recognition

Info

Publication number: WO2012065516A1
Application number: PCT/CN2011/081750
Authority: WO
Inventors: 刘科
Original assignee: 惠州Tcl移动通信有限公司
Priority date: 2010-11-15
Filing date: 2011-11-03
Publication date: 2012-05-24
Also published as: CN102055844B; CN102055844A

Abstract

The present invention relates to the mobile terminal field, and discloses a method and mobile phone device for realizing the shutter function of camera by the gesture recognition. The method and mobile phone device for realizing the shutter function of camera by the gesture recognition provided in the present invention, because of adopting an infrared induction sensor (also called proximity sensor) to recognize the fixed gesture when the camera function is open, can simulate the shutter of camera and control the lens to perform "focusing => taking picture" and "focusing => returning to preview"; so that the new functions of "focusing => taking picture" and "focusing => returning to preview" are increased to the mobile phone with lens, and the convenience is provided to the user.

Description

Method for realizing camera shutter function by gesture recognition and mobile phone device

Technical field

The present invention relates to the field of mobile terminals, and in particular, to a method for implementing a camera shutter function by gesture recognition and a mobile phone device.

Background technique

The camera function of the mobile phone is getting stronger and stronger, and it is almost the same as the card digital camera on the market. Now the mobile phone camera pixel on the market has reached 12 million pixels. The 5 megapixel camera phone with auto focus has become the mainstream of the market, and may even become the mainstream. The standard for arcades.

However, due to the limitations of mobile phone design space and product reliability requirements, most mobile phones cannot be equipped with a convenient camera shutter like the digital camera. The prior art camera with a camera does not have "focus => camera", "focus => return". To preview the function.

Therefore, the prior art has yet to be improved and developed.

Summary of the invention

The technical problem to be solved by the present invention is to provide a method for realizing a camera shutter function by gesture recognition and a mobile phone device, which increases the "focus => of a mobile phone with a camera for the above-mentioned defects of the prior art. The new features of “Photographing” and “Focus => Return to Preview” provide convenience for the user.

The technical solution adopted by the present invention to solve the technical problem is as follows:

A method for realizing a camera shutter function by gesture recognition, comprising the steps of:

A. Turn on the camera function, set the infrared light emitted by the central processor to control the infrared LED and the driving circuit;

B. setting, by the infrared sensing sensor, the infrared light is reflected by different gestures to reflect infrared light signals of different intensities, and converting the reflected infrared light signals into digital signals of different intensities and transmitting the digital signals to the central processor;

C. The central processor receives the digital signals of different intensities from the infrared sensing sensors, and generates corresponding control signals according to the digital signals of different intensities to control the camera to implement a corresponding shutter function.

The method for implementing a camera shutter function by gesture recognition, wherein the step C further includes:

C1. In the preview mode, when the digital signal received by the central processing unit from the infrared sensing sensor is a trend from small to large in the first time period T1, the camera is controlled to implement a focusing function;

C2, waiting for the second time T2, the camera is in focus.

C30. When the camera is in focus, in the third time period T3, when the digital signal received by the central processing unit from the infrared sensing sensor is from a large to a small trend, the camera is controlled to implement a photographing function.

The method for implementing a camera shutter function by gesture recognition, wherein the third time period T3 is less than one-half of the first time period T1.

C31. When the camera is in focus, in the fourth time period T4, when the digital signal received by the central processing unit from the infrared sensing sensor is from a large to a small trend, the camera is controlled to return to the preview mode.

The method for implementing a camera shutter function by gesture recognition, wherein the fourth time period T4 is equal to the first time period T1.

A mobile phone device, comprising an infrared LED and a driving circuit, an infrared sensing sensor, a processor and a camera;

The infrared LED and the driving circuit are connected to the central processor for emitting infrared light according to the control of the central processor;

The infrared sensing sensor is connected to the central processing unit, and configured to receive the reflected infrared light signal of the infrared light that is reflected by different gestures to different intensities, and convert the reflected infrared light signal into digital signals of different intensities and send the digital signals to the Central processor

The central processor is configured to receive the digital signals of different intensities from the infrared inductive sensor, and generate corresponding control signals according to the digital signals of different intensities to control the camera to implement a corresponding shutter function.

The mobile phone device, wherein the infrared LED and the infrared LED in the driving circuit are disposed in the same plane as the infrared sensing sensor, and a light blocking plate is disposed between the infrared LED and the infrared sensing sensor;

The central processor is connected to the infrared LED and the driving circuit through an IO port control switch; the camera and the infrared sensing sensor are respectively connected to the central processor through an I2C bus.

In the mobile phone device, the camera is a camera with an auto focus shooting function, and the shutter function includes: focus=> Photo function, focus => Return to preview function.

The mobile phone device, wherein the central processor further comprises:

a focus control unit, configured to control the camera to achieve a focus function when a digital signal received from the infrared sensor is in a trend from a small to a large value in a preview mode in a preview mode; and wait At a second time T2, the camera is in focus;

a photographing control unit, configured to control the camera to implement a photographing function when the digital signal received from the infrared sensing sensor is from a large to a small trend when the camera is in focus;

a preview control unit, configured to: when the camera is in focus, in a fourth time period T4, when the digital signal received from the infrared sensing sensor is from a large to a small trend, the camera is controlled to return to the preview mode;

The third time period T3 is less than one-half of the first time period T1, and the fourth time period T4 is equal to the first time period T1.

The method for implementing the camera shutter function by gesture recognition and the mobile phone device provided by the present invention use a infrared sensing sensor (also called a proximity sensor) to recognize a fixed gesture when the camera function is turned on, and simulate a camera shutter to control the camera "focus = > Take a photo, "Focus => Return to preview"; it adds a new function of "focus => photo", "focus => return to preview" for the camera-equipped mobile phone, providing convenience for the user.

DRAWINGS

1 is a schematic block diagram of a mobile phone device according to an embodiment of the present invention;

2 is a schematic structural diagram of a working principle of a mobile phone device according to an embodiment of the present invention;

3 is a schematic block diagram of a central processing unit of a mobile phone device according to an embodiment of the present invention;

4 is a flow chart of a method for implementing a camera shutter function by gesture recognition according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a focusing feature of a mobile phone device according to an embodiment of the present invention;

6 is a schematic diagram of a focus of a mobile phone device according to an embodiment of the present invention;

FIG. 7 is a flow chart showing the principle of working sampling of a mobile phone device according to an embodiment of the present invention.

detailed description

The present invention provides a method for realizing a camera shutter function by gesture recognition and a mobile phone device. The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile phone device according to an embodiment of the present invention, as shown in FIG. 1, includes an infrared LED and driving circuit 110, an infrared sensing sensor 120, a central processing unit 130, and a camera 140;

The infrared LED and the driving circuit 110 are connected to the central processing unit 130 for emitting infrared light according to the control of the central processing unit 130; preferably, as shown in FIG. 1, the central processing unit 130 passes the IO. The port control switch is connected to the infrared LED and the driving circuit 110.

The infrared sensor 120 is connected to the central processing unit 130, and configured to receive the reflected infrared light signal of the infrared light by different gestures and convert the reflected infrared light signal into digital signals of different intensities. Giving the central processor 130;

The central processing unit 130 is configured to receive the digital signals of different intensities from the infrared sensing sensor 120, and generate corresponding control signals according to the digital signals of different intensities to control the camera 140 to implement a corresponding shutter function. Preferably, the camera 140 and the infrared sensor 120 are respectively connected to the central processing unit 130 through an I2C bus, and the camera is a camera with an auto focus shooting function, and the shutter function includes: focus=> Photo function, focus => Return to preview function.

Preferably, as shown in FIG. 2, the infrared LED and the infrared LED in the driving circuit 110 The infrared sensing sensor 120 is disposed on the same plane 101, and a light blocking plate 102 is disposed between the infrared LED 111 and the infrared sensing sensor 120.

Its control principle is shown in Figure 2, infrared LED 111 emits an infrared light pulse. When the infrared light encounters an object, a part of the light is reflected or diffusely reflected to the infrared light sensor 120, and the optical signal is converted into a digital signal by the infrared light sensor 120, and then output to the central processing unit. 130; the closer the object is to the sensing area, The more light reflected back, the stronger the light received by the infrared light sensor 120, and the larger the digital signal data converted, the central processor 130 can control the camera 140 to perform related processing according to the read digital signal.

The mobile phone device, as shown in FIG. 3, the central processing unit 130 further includes:

The focus control unit 131 is configured to control the camera to implement the focusing function when the digital signal received from the infrared sensing sensor is in a trend from small to large in the first time period T1 in the preview mode; Waiting for the second time T2, the camera is focused.

The photographing control unit 132 is configured to control the camera to implement the photographing function when the digital signal received from the infrared inductive sensor is from a large to a small trend in the third time period T3 when the focusing of the camera is completed.

The preview control unit 133 is configured to control the camera to return to the preview mode when the digital signal received from the infrared sensor is in a trend from large to small in the fourth time period T4 when the camera is in focus.

Based on the working principle of the mobile phone device in the above embodiment, the embodiment of the present invention further provides a method for implementing a camera shutter function by gesture recognition. As shown in FIG. 4, the method includes the following steps:

Step S410, turning on the camera function, setting the infrared light emitted by the central processor to control the infrared LED and the driving circuit;

Step S420, setting, by the infrared sensing sensor, the infrared light is reflected by different gestures to reflect infrared light signals of different intensities, and converting the reflected infrared light signals into digital signals of different intensities and transmitting the signals to the central processor;

Step S430, the central processor receives the digital signals of different intensities from the infrared sensing sensors, and generates corresponding control signals according to the digital signals of different intensities to control the camera to implement a corresponding shutter function.

The step S430 further includes: implementing focus=>photo function, and achieving focus=> Return to the preview function.

When achieving focus => The photographing function specifically includes: C1, in the preview mode, when the digital signal received by the central processing unit from the infrared inductive sensor is a trend from small to large in the first time period T1, the camera is controlled. The focus function is implemented; C2, waiting for the second time T2, the camera is in focus. C30. When the camera is in focus, in the third time period T3, when the digital signal received by the central processing unit from the infrared sensing sensor is from a large to a small trend, the camera is controlled to implement a photographing function. And the third time period T3 is less than one-half of the first time period T1.

When achieving focus => The method of returning to the preview function specifically includes: C1, in the preview mode, when the digital signal received by the central processing unit from the infrared sensing sensor changes from small to large in the first time period T1, the control is performed. The camera implements a focusing function; C2, waits for a second time T2, the camera is in focus; C31, when the camera is in focus, in a fourth time period T4, the central processor receives from the infrared sensing sensor When the digital signal is changed from large to small, the camera is controlled to return to the preview mode. And, the fourth time period T4 is equal to the first time period T1.

The present invention will be further described in detail below through specific application examples.

When the focus => camera function is implemented, the motion characteristics and identification are as shown in the embodiment shown in FIG. 5:

Focusing action: As shown in Fig. 5, 111 is an infrared sensing sensor. When the finger 200 (see Fig. 2) is approached by the far-infrared sensing sensor 111, the finger is vertically close to the infrared sensing sensor 111 to sense the window, infrared The digital signal output by the inductive sensor 111 is gradually changed from DATA(0) to DATA(max). The process takes time T1.

In a specific implementation, as shown in step 710 of FIG. 7, in the preview mode, the infrared LED is sampled ten times, and the average value is taken, DATA(0)=average(D0-D9), wherein DATA(0) corresponds to Is the ambient or internal diffraction infrared light intensity; Judge the sample DATA(0)<D(n)? If yes, take K=n; If D(n)>DATA(0), the intensity of the received infrared light is greater than the original value, indicating that there is a finger close, and K is used to record the transition point.

When D(n)>D(n-1), The intensity of the received infrared light is increasing, indicating that the finger is close to the sensor area.

D(n) no longer increases, indicating that the finger has touched the sensor area; DATA(max) is the data corresponding to the intensity of the reflected light for this moment, and T1 is the time from the start of the approach to the contact of the sensor.

Photographing action: As shown in FIG. 5, the finger 200 slides from the infrared sensing sensor sensing window to one side (see FIG. 2), that is, a gesture in which the finger slides out in parallel after a good focal length; the infrared sensing sensor 111 outputs DATA (max) ) Gradient to DATA (0), the process takes time T3. In a specific implementation, step 720 shown in Figure 7; D(n)< DATA(max); indicates that the received light intensity begins to weaken; M corresponds to the time at which the weakening begins; T3 is the minimum time used for the maximum attenuation of light intensity; T1>2*T3, T1 is greater than twice T3; the judgment gesture is a finger Slide to one side; otherwise, judge the finger to return vertically.

And setting T1 is generally greater than twice T3;

As can be seen from the above, in the phone camera preview mode, when the sensor output D(n) is detected The gradual change from DATA(0) to DATA(max) lasts for T1, that is, the gesture of judging that the finger is vertically close, and the camera 140 is controlled to implement the focusing function. That is, in the preview mode, when the digital signal received by the central processing unit from the infrared sensing sensor is a trend from small to large during the first time period T1, the camera is controlled to implement the focusing function.

After a good focal length, when the sensor output D(n) is detected Gradient from DATA(max) to DATA(0), lasting T3, and T3 is less than one-half T1, that is, the gesture of sliding the finger in parallel after the good focal length is determined, thereby controlling the mobile phone to take a picture. That is, when the camera 140 is in focus, in the third time period T3, when the digital signal received by the central processing unit from the infrared sensor is from a large to a small trend, the camera is controlled to implement a photographing function.

When the focus => preview function is implemented, the motion characteristics and identification are as shown in the embodiment shown in FIG. 6:

Focusing action: As shown in Fig. 6, the finger is approached to the sensing window of the infrared sensing sensor 111 (see Fig. 2), and the infrared sensing sensor output D(n) is gradually changed from DATA(0) to DATA(max). Process time T1;

Photographing action: as shown in FIG. 6, the finger is vertically away from the sensing window of the infrared sensing sensor 111, and the infrared sensing sensor 111 outputs D(n) from DATA(max) to DATA(0), and the process takes time T4;

And T1 is approximately equal to T4;

As can be seen from the above, in the phone camera preview mode, when the sensor output D(n) is detected Gradient from DATA(0) to DATA(max), lasting T1, that is, the gesture of judging that the finger is vertically close, and controlling the focus of the hand;

After a good focal length, when the infrared sensing sensor 111 is detected to output D(n) Gradient from DATA(max) to DATA(0), lasting T3, and T3 is approximately equal to T1, that is, after the good focal length is determined, the finger is vertically away from the sensing area, and then returns to the preview mode. That is, when the camera is in focus, in the fourth time period T4, when the digital signal received by the central processing unit from the infrared sensing sensor is from a large to a small trend, the camera is controlled to return to the preview mode. And, the fourth time period T4 is equal to the first time period T1.

Throughout the process, the processor controls the infrared sensing sensor 111 to collect data in the sampling period T; in order to reduce power consumption, the infrared LED can be set to pulse emission, the infrared LED is turned on before reading the data, and the infrared LED is turned off after reading the number. In addition, according to the experimental test results, it is better to set the appropriate size of the current control infrared LED illumination intensity, and the infrared detection sensor 111 vertical detection effective distance is preferably set at about 2 cm.

In summary, the method for implementing the camera shutter function by gesture recognition and the mobile phone device provided by the present invention use a infrared sensing sensor (also called a proximity sensor) to recognize a fixed gesture and simulate a camera shutter when the camera function is turned on. Control camera "focus => Take a photo, "Focus => Return to preview"; it adds a new function of "focus => photo", "focus => return to preview" for the camera-equipped mobile phone, providing convenience for the user.

It is to be understood that the application of the present invention is not limited to the above-described examples, and those skilled in the art can make modifications and changes in accordance with the above description, all of which are within the scope of the appended claims.

Claims

A method for realizing a camera shutter function by gesture recognition, comprising the steps of:

A. Turn on the camera function, set the infrared light emitted by the central processor to control the infrared LED and the driving circuit;

B. setting, by the infrared sensing sensor, the infrared light is reflected by different gestures to reflect infrared light signals of different intensities, and converting the reflected infrared light signals into digital signals of different intensities and transmitting the digital signals to the central processor;

C. The central processor receives the digital signals of different intensities from the infrared sensing sensors, and generates corresponding control signals according to the digital signals of different intensities to control the camera to implement a corresponding shutter function.
The method for implementing a camera shutter function by gesture recognition according to claim 1, wherein the step C further comprises:

C1. In the preview mode, when the digital signal received by the central processing unit from the infrared sensing sensor is a trend from small to large in the first time period T1, the camera is controlled to implement a focusing function;

C2, waiting for the second time T2, the camera is in focus.
The method for implementing a camera shutter function by gesture recognition according to claim 2, wherein the step C further comprises:

C30. When the camera is in focus, in the third time period T3, when the digital signal received by the central processing unit from the infrared sensing sensor is from a large to a small trend, the camera is controlled to implement a photographing function.
The method for implementing a camera shutter function by gesture recognition according to claim 3, wherein the third time period T3 is less than one-half of the first time period T1.
The method for implementing a camera shutter function by gesture recognition according to claim 2, wherein the step C further comprises:

C31. When the camera is in focus, in the fourth time period T4, when the digital signal received by the central processing unit from the infrared sensing sensor is from a large to a small trend, the camera is controlled to return to the preview mode.
The method for implementing a camera shutter function by gesture recognition according to claim 5, wherein the fourth time period T4 is equal to the first time period T1.
A mobile phone device, comprising: an infrared LED and a driving circuit, an infrared sensing sensor, a processor and a camera;

The infrared LED and the driving circuit are connected to the central processor for emitting infrared light according to the control of the central processor;

The infrared sensing sensor is connected to the central processing unit, and configured to receive the reflected infrared light signal of the infrared light that is reflected by different gestures to different intensities, and convert the reflected infrared light signal into digital signals of different intensities and send the digital signals to the Central processor

The central processor is configured to receive the digital signals of different intensities from the infrared inductive sensor, and generate corresponding control signals according to the digital signals of different intensities to control the camera to implement a corresponding shutter function.
The mobile phone device according to claim 7, wherein the infrared LED and the infrared LED in the driving circuit are disposed in the same plane as the infrared sensing sensor, and the infrared LED and the infrared sensing sensor are Between the setting of a light barrier;

The central processor is connected to the infrared LED and the driving circuit through an IO port control switch; the camera and the infrared sensing sensor are respectively connected to the central processor through an I2C bus.
The mobile phone device according to claim 7, wherein the camera is a camera having an auto focus shooting function, and the shutter function comprises: focusing => Photo function, focus => Return to preview function.
The mobile phone device according to claim 7, wherein the central processor further comprises:

a focus control unit, configured to control the camera to achieve a focus function when a digital signal received from the infrared sensor is in a trend from a small to a large value in a preview mode in a preview mode; and wait At a second time T2, the camera is in focus;

a photographing control unit, configured to control the camera to implement a photographing function when the digital signal received from the infrared sensing sensor is from a large to a small trend when the camera is in focus;

a preview control unit, configured to: when the camera is in focus, in a fourth time period T4, when the digital signal received from the infrared sensing sensor is from a large to a small trend, the camera is controlled to return to the preview mode;

The third time period T3 is less than one-half of the first time period T1, and the fourth time period T4 is equal to the first time period T1.