CN108200265B - Mobile phone control platform based on gesture recognition - Google Patents
Mobile phone control platform based on gesture recognition Download PDFInfo
- Publication number
- CN108200265B CN108200265B CN201711172893.8A CN201711172893A CN108200265B CN 108200265 B CN108200265 B CN 108200265B CN 201711172893 A CN201711172893 A CN 201711172893A CN 108200265 B CN108200265 B CN 108200265B
- Authority
- CN
- China
- Prior art keywords
- image
- equipment
- mobile phone
- flash
- gesture recognition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Environmental & Geological Engineering (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephone Function (AREA)
Abstract
The invention relates to a mobile phone control platform based on gesture recognition, which comprises: the device comprises a light quantity sensing device, a flash shooting device and a control device, wherein the light quantity sensing device is arranged on the back of the mobile phone and used for detecting the current ambient light quantity, judging that equipment for performing flash shooting operation exists around the mobile phone when the current ambient light quantity is detected to reach a flash shooting level, and sending a flash equipment existence signal; the rear camera is arranged on the back of the mobile phone, is connected with the light quantity sensing equipment and is used for starting shooting a front scene when receiving the signal of the existence of the flash equipment so as to obtain and output a front scene image; and the gesture recognition equipment is used for receiving the combined filtering image, carrying out human gesture recognition on the combined filtering image, and sending out an auxiliary lighting signal when the recognized human gesture is matched with the shooting gesture. According to the invention, the operation of providing auxiliary lighting for photographing other equipment can be automatically triggered according to surrounding scenes, so that the image photographing quality is improved.
Description
Technical Field
The invention relates to the field of mobile phones, in particular to a mobile phone control platform based on gesture recognition.
Background
The fourth generation mobile phone (4G) which is the most widely used mobile phone worldwide is developed at present, is of a digital system, and can transmit and receive short messages, wireless application protocols and the like besides voice communication. The cellular phone with a telephone keypad part includes various functions such as PDA, game machine, MP3, camera, photographing, recording, GPS, internet, etc. in addition to typical telephone functions, and there is a trend toward the development of a PDA with a cellular phone function. The mouthpiece and the earpiece of the telephone and the corresponding microphone and earpiece are all mounted on a single handle. A portable telephone terminal which is called a mobile phone, a portable telephone, a mobile phone, or a facsimile and can move in a wide range.
The industry people analyze and think that although the basic protection function of mobile phone security products is relatively complete, the mobile phone security products are still lack of harassment prevention, privacy protection and data protection, a larger market space still exists in the future, security manufacturers such as QQ mobile phone stewards, security stewards, Qin networks and the like declare the mobile cloud security field, and all the security manufacturers must continue to increase the investment on mobile cloud security solutions.
Disclosure of Invention
At present, the mobile phone cannot accurately detect the shooting behavior of the surrounding shooting terminal, so that the opportunity for providing auxiliary lighting for the shooting behavior of the surrounding shooting terminal cannot be grasped. In order to solve the above problems, the present invention provides a gesture recognition-based mobile phone control platform, which can detect the shooting behavior of a surrounding shooting terminal in time based on the current ambient light amount and the recognition of the human body shooting gesture, and provide important reference data for auxiliary lighting for a mobile phone.
According to an aspect of the present invention, there is provided a mobile phone control platform based on gesture recognition, the platform comprising:
the device comprises a light quantity sensing device, a flash shooting device and a control device, wherein the light quantity sensing device is arranged on the back of the mobile phone and used for detecting the current ambient light quantity, judging that equipment for performing flash shooting operation exists around the mobile phone when the current ambient light quantity is detected to reach a flash shooting level, and sending a flash equipment existence signal;
the rear camera is arranged on the back of the mobile phone and is connected with the light quantity sensing equipment;
the rear camera is used for starting shooting a front scene when receiving the flash equipment existence signal so as to obtain and output a front scene image;
the gesture recognition device is used for receiving the image, performing human gesture recognition on the image, and sending an auxiliary lighting signal when the recognized human gesture is matched with the shooting gesture;
and the flash lamp equipment is arranged on the back of the mobile phone, is connected with the gesture recognition equipment and is used for automatically starting flash operation when the auxiliary illumination signal is received so as to realize that auxiliary illumination is provided for shooting of equipment which carries out flash shooting operation around.
It can be seen that the present invention has at least the following important features:
(1) when the light quantity sensing equipment detects that the current ambient light quantity reaches the flash shooting level, the equipment for carrying out flash shooting operation is judged to exist around, and a precondition is provided for providing auxiliary lighting for shooting of the equipment for carrying out flash shooting operation;
(2) and determining the posture of the surrounding human body in an image recognition mode to further judge whether equipment for carrying out flash shooting operation exists in the periphery.
Drawings
Embodiments of the invention will now be described with reference to the accompanying drawings, in which:
fig. 1 is a block diagram illustrating a structure of a mobile phone control platform based on gesture recognition according to an embodiment of the present invention.
Detailed Description
Embodiments of the gesture recognition-based handset control platform according to the present invention will be described in detail below with reference to the accompanying drawings.
In order to overcome the defects, the invention builds a mobile phone control platform based on gesture recognition, and the specific implementation scheme is as follows.
Fig. 1 is a block diagram illustrating a structure of a mobile phone control platform based on gesture recognition according to an embodiment of the present invention, where the platform includes:
and the light quantity sensing device is arranged on the back of the mobile phone and used for detecting the current ambient light quantity, judging that equipment for carrying out flash shooting operation exists around when the current ambient light quantity is detected to reach a flash shooting level, and sending a flash equipment existence signal.
Next, the following further description is made on the specific structure of the gesture recognition-based mobile phone control platform according to the present invention.
The mobile phone control platform based on gesture recognition can further comprise:
the rear camera is arranged on the back of the mobile phone and is connected with the light quantity sensing equipment;
the rear camera is used for starting shooting of a front scene when the flash equipment existence signal is received so as to obtain and output a front scene image.
The mobile phone control platform based on gesture recognition can further comprise:
the smoothing processing device is used for receiving a front scene image, equally dividing the front scene image into blocks with corresponding block sizes based on the distance between the average brightness of the front scene image and a preset brightness range central value, selecting corresponding smoothing processing with different strengths based on the random noise size of each block to obtain smooth blocks, and splicing the obtained smooth blocks to obtain a smooth processed image.
The mobile phone control platform based on gesture recognition can further comprise:
the gamma correction device is connected with the smoothing device and used for receiving the smoothed image, determining background complexity in the smoothed image, and determining the number of image fragments for averagely segmenting the smoothed image based on the background complexity, wherein the higher the background complexity is, the more the number of the image fragments for averagely segmenting the smoothed image is, the gamma correction processing operation based on image fragment contrast is respectively carried out on each image fragment to obtain each gamma correction fragment, and the smaller the image fragment contrast is, the stronger the gamma correction processing operation intensity is carried out on the image fragment is, and the gamma correction fragments are combined to obtain a corrected combined image;
the type analysis equipment is connected with the gamma correction equipment and used for receiving the corrected combined image, extracting noise-related characteristic quantity of the corrected combined image, inputting the extracted characteristic quantity into a convolutional neural network consisting of an input layer, an output layer and a plurality of hidden layers, and performing data analysis on the characteristic quantity input by the input layer by layer, wherein the output layer is connected with the last hidden layer and used for outputting the result of data analysis performed on the last hidden layer, and the output quantity type of the output layer is a noise type;
the combined filtering device is connected with the type analysis device and used for receiving the noise type, selecting a corresponding filter combination from a filtering database based on the noise type, and performing filtering operation on the corrected combined image by using the filter combination to obtain and output a combined filtering image;
the gesture recognition equipment is connected with the combined filtering equipment and used for receiving the combined filtering image, carrying out human gesture recognition on the combined filtering image and sending out an auxiliary lighting signal when the recognized human gesture is matched with the shooting gesture;
the flash lamp equipment is arranged on the back of the mobile phone, is connected with the gesture recognition equipment and is used for automatically starting flash operation when receiving the auxiliary illumination signal so as to realize the purpose of providing auxiliary illumination for the shooting of equipment which carries out flash shooting operation around;
wherein, in the smoothing processing apparatus, the closer the front scene image average luminance is to the preset luminance range center value, the larger the respective blocks into which the front scene image is equally divided.
The mobile phone control platform based on gesture recognition can further comprise:
and the FLASH memory card is connected with the smoothing processing equipment and is used for pre-storing the preset brightness range.
In the mobile phone control platform based on gesture recognition:
wherein, in the smoothing device, for each block, the greater the random noise of the block, the greater the selected smoothing strength.
In the mobile phone control platform based on gesture recognition:
the preset brightness range is a brightness range limited by a preset brightness upper threshold and a preset brightness lower threshold, and the preset brightness upper threshold is larger than the preset brightness lower threshold.
In addition, the mobile phone control platform based on gesture recognition may further include: and the ultrasonic ranging equipment is used for detecting the current distance between the nearest target and the mobile phone.
Ultrasonic waves are often used for measuring distances because of strong directivity, slow energy consumption and long propagation distance in a medium, and for example, a distance meter, a level meter and the like can be realized by ultrasonic waves. The ultrasonic detection is often relatively rapid and convenient, the calculation is simple, the real-time control is easy to realize, and the industrial requirement on the aspect of measurement precision can be met.
Many ultrasonic generators have been designed and built for the purpose of studying and utilizing ultrasonic waves. Generally, ultrasonic generators can be divided into two main categories: one is to generate ultrasonic waves electrically and the other is to generate ultrasonic waves mechanically. The electric system includes a piezoelectric type, a magnetostrictive type, an electrodynamic type, and the like; mechanical methods include a flute, a liquid whistle, and a cyclone whistle. The frequency, power and acoustic characteristics of the ultrasonic waves generated by them are different, and thus the applications are different. Piezoelectric ultrasonic generators are currently used.
Piezoelectric ultrasound generators actually operate using the resonance of a piezoelectric crystal. The ultrasonic generator is internally provided with two piezoelectric wafers and a resonance plate. When pulse signals are applied to two poles of the piezoelectric crystal, and the frequency of the pulse signals is equal to the natural oscillation frequency of the piezoelectric crystal, the piezoelectric crystal can resonate, and the resonance plate is driven to vibrate, so that ultrasonic waves are generated. On the contrary, if no voltage is applied between the two electrodes, when the resonance plate receives ultrasonic waves, the piezoelectric wafer is pressed to vibrate, mechanical energy is converted into an electric signal, and then the resonance plate becomes an ultrasonic receiver.
The principle of ultrasonic ranging is as follows: the ultrasonic transmitter transmits ultrasonic waves to a certain direction, timing is started at the same time of transmitting time, the ultrasonic waves are transmitted in the air and return immediately when encountering an obstacle in the process, and the ultrasonic receiver stops timing immediately when receiving reflected waves. The propagation speed of the ultrasonic wave in the air is 340m/s, and the distance(s) of the transmitting point from the obstacle can be calculated according to the time t recorded by the timer, namely: and s is 340 t/2. This is the so-called time difference ranging method. The principle of ultrasonic ranging is that the propagation speed of ultrasonic waves in the air is known, the time of the sound waves reflected back when encountering an obstacle after being transmitted is measured, and the actual distance from a transmitting point to the obstacle is calculated according to the time difference between transmitting and receiving. It follows that the principles of ultrasonic ranging are the same as those of radar.
However, in practice, the propagation velocity of the ultrasonic wave in the air is a variable, and the propagation velocity of the ultrasonic wave in the air is different according to the ambient temperature, so in order to improve the accuracy of the ultrasonic distance measurement, it is necessary to calculate the propagation velocity of the ultrasonic wave in the air according to the ambient temperature first.
The ultrasonic ranging is mainly applied to distance measurement of car backing reminding, construction sites, industrial sites and the like, and although the current ranging range can reach one hundred meters, the measurement precision can only reach centimeter magnitude order.
By adopting the mobile phone control platform based on gesture recognition, aiming at the technical problem that the shooting behavior of the peripheral terminal is difficult to accurately detect in the prior art, the device for carrying out flash shooting operation is judged to exist around when the light quantity sensing device detects that the current ambient light quantity reaches the flash shooting level, a precondition is provided for providing auxiliary illumination for the shooting of the device for carrying out flash shooting operation, and in addition, the device for carrying out flash shooting operation is further judged to exist around by adopting the image recognition mode to determine the gesture of the peripheral human body, so that the technical problem is effectively solved.
It is to be understood that while the present invention has been described in conjunction with the preferred embodiments thereof, it is not intended to limit the invention to those embodiments. It will be apparent to those skilled in the art from this disclosure that many changes and modifications can be made, or equivalents modified, in the embodiments of the invention without departing from the scope of the invention. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention are still within the scope of the protection of the technical solution of the present invention, unless the contents of the technical solution of the present invention are departed.
Claims (3)
1. A mobile phone control platform based on gesture recognition, the platform comprising:
the device comprises a light quantity sensing device, a flash shooting device and a control device, wherein the light quantity sensing device is arranged on the back of the mobile phone and used for detecting the current ambient light quantity, judging that equipment for performing flash shooting operation exists around the mobile phone when the current ambient light quantity is detected to reach a flash shooting level, and sending a flash equipment existence signal;
the rear camera is arranged on the back of the mobile phone and is connected with the light quantity sensing equipment;
the rear camera is used for starting shooting a front scene when receiving the flash equipment existence signal so as to obtain and output a front scene image;
the device comprises a smoothing device, a processing device and a processing device, wherein the smoothing device is used for receiving a front scene image, averagely dividing the front scene image into blocks with the sizes of corresponding blocks based on the distance between the average brightness of the front scene image and a preset brightness range central value, selecting corresponding smoothing processing with different strengths based on the random noise size of each block to obtain smooth blocks, and splicing the obtained smooth blocks to obtain a smooth processed image;
the gamma correction device is connected with the smoothing device and used for receiving the smoothed image, determining background complexity in the smoothed image, and determining the number of image fragments for averagely segmenting the smoothed image based on the background complexity, wherein the higher the background complexity is, the more the number of the image fragments for averagely segmenting the smoothed image is, the gamma correction processing operation based on image fragment contrast is respectively carried out on each image fragment to obtain each gamma correction fragment, and the smaller the image fragment contrast is, the stronger the gamma correction processing operation intensity is carried out on the image fragment is, and the gamma correction fragments are combined to obtain a corrected combined image;
the type analysis equipment is connected with the gamma correction equipment and used for receiving the corrected combined image, extracting noise-related characteristic quantity of the corrected combined image, inputting the extracted characteristic quantity into a convolutional neural network consisting of an input layer, an output layer and a plurality of hidden layers, and performing data analysis on the characteristic quantity input by the input layer by layer, wherein the output layer is connected with the last hidden layer and used for outputting the result of data analysis performed on the last hidden layer, and the output quantity type of the output layer is a noise type;
the combined filtering device is connected with the type analysis device and used for receiving the noise type, selecting a corresponding filter combination from a filtering database based on the noise type, and performing filtering operation on the corrected combined image by using the filter combination to obtain and output a combined filtering image;
the gesture recognition equipment is connected with the combined filtering equipment and used for receiving the combined filtering image, carrying out human gesture recognition on the combined filtering image and sending out an auxiliary lighting signal when the recognized human gesture is matched with the shooting gesture;
the flash lamp equipment is arranged on the back of the mobile phone, is connected with the gesture recognition equipment and is used for automatically starting flash operation when receiving the auxiliary illumination signal so as to realize the purpose of providing auxiliary illumination for the shooting of equipment which carries out flash shooting operation around;
wherein, in the smoothing processing apparatus, the closer the front scene image average luminance is to the preset luminance range center value, the larger the respective blocks into which the front scene image is equally divided;
and the FLASH memory card is connected with the smoothing processing equipment and is used for pre-storing the preset brightness range.
2. The gesture recognition based handset control platform of claim 1, wherein:
wherein, in the smoothing device, for each block, the greater the random noise of the block, the greater the selected smoothing strength.
3. The gesture recognition based handset control platform of claim 2, wherein:
the preset brightness range is a brightness range limited by a preset brightness upper threshold and a preset brightness lower threshold, and the preset brightness upper threshold is larger than the preset brightness lower threshold.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711172893.8A CN108200265B (en) | 2017-11-22 | 2017-11-22 | Mobile phone control platform based on gesture recognition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711172893.8A CN108200265B (en) | 2017-11-22 | 2017-11-22 | Mobile phone control platform based on gesture recognition |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108200265A CN108200265A (en) | 2018-06-22 |
| CN108200265B true CN108200265B (en) | 2020-04-24 |
Family
ID=62572829
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711172893.8A Active CN108200265B (en) | 2017-11-22 | 2017-11-22 | Mobile phone control platform based on gesture recognition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108200265B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111443325B (en) * | 2019-01-17 | 2022-03-29 | 中电装备山东电子有限公司 | Watt-hour meter field parameter extracting method |
| CN109800722B (en) * | 2019-01-25 | 2021-01-05 | 青岛市市立医院 | Medical equipment wireless communication platform |
| CN109889537B (en) * | 2019-03-20 | 2020-06-23 | 北方工业大学 | Automatic network communication mechanism and method |
| CN111027355B (en) * | 2019-03-20 | 2021-03-16 | 深圳市成果转化中心有限公司 | Automatic network communication mechanism |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4496784B2 (en) * | 2004-01-16 | 2010-07-07 | 日本電気株式会社 | Automatic light emitting device and method for portable terminal |
| CN105812673B (en) * | 2014-12-31 | 2019-02-26 | 富泰华工业（深圳）有限公司 | Flash lamp control system and method |
| CN105974712B (en) * | 2016-04-27 | 2019-05-17 | 朱宏静 | More fill-flash lamp systems and fill-flash control device |
| CN106060415B (en) * | 2016-05-25 | 2019-06-21 | 努比亚技术有限公司 | A kind of mobile terminal and its photographic method |
| CN106713780A (en) * | 2017-01-16 | 2017-05-24 | 维沃移动通信有限公司 | Control method for flash lamp and mobile terminal |
-
2017
- 2017-11-22 CN CN201711172893.8A patent/CN108200265B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108200265A (en) | 2018-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108200265B (en) | Mobile phone control platform based on gesture recognition | |
| US10061010B2 (en) | Distance measurement | |
| JP4870130B2 (en) | Method and apparatus for configuring a handheld audio device using ear biometrics | |
| CN103344959B (en) | A kind of ultrasound positioning system and the electronic installation with positioning function | |
| EP3979611B1 (en) | Ultrasonic processing method and apparatus, electronic device, and computer-readable medium | |
| CN105204270B (en) | The method of adjustment and device of a kind of photo terminal focal distance | |
| SE518418C2 (en) | Sound-based proximity detector | |
| CN108989698B (en) | Mobile phone control method | |
| WO2019233145A1 (en) | Payment method, distance measurement method, payment device, and distance measurement device | |
| CN101827150A (en) | Mobile phone with blind guide function and blind guide method | |
| US20140341386A1 (en) | Noise reduction | |
| CN103995483A (en) | Control method, device and system of ultrasonic transducer | |
| CN108900694A (en) | Ear line information acquisition method and device, terminal, earphone and readable storage medium storing program for executing | |
| CN102540191A (en) | Distance detecting device and distance detecting method of capacitive screen of mobile phone | |
| CN110418023B (en) | Ring processing method, device, mobile terminal and storage medium | |
| CN104067140A (en) | Environment detection device and related method for determining the position and/or motion of an object | |
| JP2007147406A (en) | Searching device of object | |
| CN110782890A (en) | Alarm clock reminding method, intelligent projector and related product | |
| CN112019987A (en) | Speaker device and output adjusting method for speaker | |
| US7092512B2 (en) | Call control device and call control method | |
| CN113574911B (en) | Earphone and wearing state detection method thereof | |
| US6525990B2 (en) | Target simulation system and method | |
| CN105759278B (en) | Laser scale and its measuring method | |
| WO2019056760A1 (en) | Electronic apparatus and acoustic distance measurement method thereof | |
| WO2016000297A1 (en) | Audio adjustment method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200326 Address after: 201800 room j10214, building 2, No. 4268, Zhennan Road, Jiading District, Shanghai Applicant after: SHANGHAI YIZHUO NETWORK TECHNOLOGY Co.,Ltd. Address before: 221000 Jiangsu city of Xuzhou Province Economic and Technological Development Zone of High Road No. 19 Applicant before: Qin Guangmin |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |