CN103685940A - Method for recognizing shot photos by facial expressions - Google Patents

Method for recognizing shot photos by facial expressions Download PDF

Info

Publication number
CN103685940A
CN103685940A CN201310600001.5A CN201310600001A CN103685940A CN 103685940 A CN103685940 A CN 103685940A CN 201310600001 A CN201310600001 A CN 201310600001A CN 103685940 A CN103685940 A CN 103685940A
Authority
CN
China
Prior art keywords
step
photographer
control module
main control
image information
Prior art date
Application number
CN201310600001.5A
Other languages
Chinese (zh)
Inventor
崔宗敏
郑新建
邵笑杰
王琼
Original Assignee
上海斐讯数据通信技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海斐讯数据通信技术有限公司 filed Critical 上海斐讯数据通信技术有限公司
Priority to CN201310600001.5A priority Critical patent/CN103685940A/en
Publication of CN103685940A publication Critical patent/CN103685940A/en

Links

Abstract

A method for recognizing shot photos by facial expressions is used for shooting of photos or videos of mobile equipment. A main camera acquires an object or a scene required to be shot; an auxiliary camera acquires complete face information of a photographer and image information; whether the facial expression, which is captured by the auxiliary camera, of the photographer or the image information of an action of the photographer is matched with a preset condition or not is judged; and if the facial expression, which is captured by the auxiliary camera, of the photographer or the image information of the action of the photographer is matched with the preset condition, a shooting shutter procedure is triggered, and a photo is shot. By using the method, the shooting means of the mobile equipment is flexible; when the photographer inconveniently touches a shuttle key, a photo can be shot by a simple facial expression or a simple action of the photographer; and moreover, a shutter triggering method is in a non-contact mode, and the possibility of blurring of photos due to manual shaking is greatly reduced.

Description

一种通过表情识别拍摄照片的方法 An expression recognition method by taking a picture of

技术领域 FIELD

[0001] 本发明涉及一种通过表情识别拍摄照片的方法。 [0001] The present invention relates to a method of identifying expression through photographs.

背景技术 Background technique

[0002]目前人们对拍摄的需求越来越高,特别是随着智能化的移动设备的普及,人们希望做到随时随地,灵活方便地拍摄照片或者视频片段。 [0002] There is now increasing demand for shooting, especially with the popularity of intelligent mobile devices, people want to do anytime, anywhere, flexible and convenient to take pictures or video clips. 然而目前大部分的拍摄方法都是接触式的,比如机械和电子快门,都是物理按键,拍摄者使用的时候,一方面需要稳定移动设备,另一方面需要按下快门,很不适合单手操作,缺乏灵活性。 However, most of the current imaging methods are a contact type, such as mechanical and electronic shutter, are physical buttons, when the photographer to use, one needs a stable mobile device, and the need to press the shutter, is very suitable for single hand operation, lack of flexibility. 随着智能手机发展,拍照按钮被屏幕上快门图标取代,但是由于没有触感,经常出现按错位置的情况。 With the development of smart phones, camera shutter button is an icon on the screen to replace, but the absence of touch, the situation often pressed the wrong position appears. 而且接触移动设备时不可避免地造成设备抖动,或多或少会引起拍摄的画面模糊。 And inevitably causes jitter apparatus, more or less will cause the pictures taken blurred upon contact with the mobile device.

[0003] 现有的与表情识别触发拍照相关的专利有我国2009年公开的笑脸追踪系统及方法(申请号:200710203477.X),此专利是一种笑脸追踪方法,通过相机模块的镜头拍摄图片;将上述拍摄的图片转换成黑白图片;读取所述黑白图片上的各个点的亮度值;通过上述亮度值及脸部的基本轮廓截取图片中的头像图形,及在上述截取的头像图形中截取嘴唇图形;比较上述截取的嘴唇图形与相机模块保存的人脸微笑时嘴唇图形的相似度,得出一个百分比的值,所述百分比的值作为相似度的值;判断所述相似度的值是否大于相机模块设定的值;当所述相似度的值大于相机模块设定的值时,将拍摄的图片保存到相机模块的存储介质中。 [0003] Existing and expression recognition triggered camera-related patents smile tracking system and method (application number: 200710203477.X) of 2009 disclosed in this patent is a method for tracking smile, take a picture through the lens of the camera module ; converting the photographed image into a monochrome image; luminance values ​​of each point of the image of the monochrome reading; pictures taken by the picture pattern and the basic outline of the luminance value of the face, head and taken in the above-described pattern intercepting mouth pattern; pattern similarity lips when comparing the stored pattern taken with the camera module lips smiling face, a percentage of the value obtained, as the value of the percentage of the degree of similarity; determining the value of the similarity is greater than the value set in the camera module; when the similarity is larger than the value set by the camera module, the image shot by the camera to a storage medium of the camera module.

[0004] 笑脸追踪系统及方法有触发快门拍摄照片的功能,但是准确地讲,这种方法并不是拍摄者主动触发的拍摄手段,应用场景只有被拍摄对象是人物,并且在微笑的情况才会自动触发快门。 [0004] smile tracking systems and methods trigger shutter function to take pictures, but precisely, this approach means the photographer is not taken the initiative to trigger the application scenario only the subject is a person, and only in the case of a smile automatically trigger the shutter. 如果需要拍摄的画面里没有人物笑脸的时候,拍摄者还是需要借助物理按键和触摸按钮来主动触发快门拍摄。 If you need to take pictures of smiling faces when there are no characters, the photographer still need the help of physical buttons and touch trigger shutter button to take the initiative.

[0005] 因此,急需提供一种灵活的非接触式的拍摄照片的方法。 [0005] Therefore, an urgent need to provide a flexible way to take pictures of non-contact.

发明内容 SUMMARY

[0006] 本发明提供的一种通过表情识别拍摄照片的方法,触发快门的方法是非接触式的,提高了拍摄的灵活性,准确性,降低了照片模糊的可能性。 [0006] A method of the present invention is provided by expression identifying photographs, the method of triggering a non-contact type shutter, photographing improved flexibility, accuracy, reducing the likelihood of blurred pictures.

[0007] 为了达到上述目的,本发明提供一种通过表情识别拍摄照片的方法,该方法用于移动设备上,基于移动设备上的硬件实现,所述的硬件包含主控制模块、电路连接该主控制模块的主摄像头、辅助摄像头、数字信号处理器DSP、内部存储器和显示屏,该方法包含以下步骤: [0007] To achieve the above object, the present invention provides a method of identifying expression by taking pictures, the method is used on a mobile device, hardware-based on the mobile device, the hardware includes a main control module, the main circuit connection the camera main control module, the auxiliary camera, the DSP digital signal processor, an internal memory and a display screen, the method comprising the steps of:

步骤1、移动设备进入拍摄程序,主控制模块判断内部存储器中是否已经存储有面部表情或者动作的图像信息,如果有,进行步骤2,如果没有,进行步骤1.1 ; Step 1, the mobile device enters the imaging sequence, the master control module determines whether the internal memory of the image information already stored facial expression or action, if any, step 2, and if not, step 1.1;

步骤1.1、主控制模块提醒用户是否要输入表情或者动作图像信息,如果用户选择输入表情或者动作图像信息,则主控制模块控制辅助摄像头捕获拍摄者的表情或者动作的图像信息,然后用于后面触发快门的判断条件,如果用户不选择输入表情或者动作图像信息,则后续在判断是否触发快门的时候完全依靠图像处理算法,最后跳转到步骤2 ; Step 1.1, the master control module to remind the user whether or not to enter the expression or the operation of the image information, if the user selects the input face or the operation of the image information, the main control module controls the auxiliary camera captured image information expression or action of the photographer, and then for subsequent triggering Analyzing the condition of the shutter, if the user does not select the input face image or the operation information, deciding whether to trigger follow-up when the shutter completely rely on image processing algorithms, and finally proceeds to step 2;

步骤2、进入到预览模式,主控制模块控制主摄像头采集需要拍摄的物体或者场景,经过数字信号处理器DSP处理之后,在显示屏上显示,同时,主控制模块控制辅助摄像头也开始采集图像信息,通过数字信号处理器DSP处理捕获的面部轮廓信息; Step 2 proceeds to the preview mode, the main control module controls the main camera capture an object or the scene need to take, after a digital signal processor DSP processing, on the display, at the same time, the main control module controls the auxiliary camera began to acquire image information , by a digital signal processor DSP processing information captured facial contour;

步骤3、主控制模块判断辅助摄像头采集到的图像信息是否包含拍摄者完整的面部信息,如果拍摄者没有面对辅助摄像头,主控制模块应当通过显示屏提醒拍摄者目前的状态,并且跳转到步骤1,重新进入下一次的拍摄流程,继续捕捉面部信息; Step 3, the main control module determines that the auxiliary camera captured image information contains information on the photographer full face, if the face is not captured by the auxiliary camera, the main control module should the current state through the display screen to remind the photographer, and jumps to step 1, a shot at re-enter the process, continue to capture the face information;

步骤4、数字信号处理器DSP开始对拍摄者完整的面部图像信息进行计算和分析; Step 4, a digital signal processor DSP complete the photographer starts the face image information is calculated and analyzed;

步骤5、主控制模块对步骤4的计算结果进行判断,如果捕获的图像数据和用户预设的条件吻合,那么进行步骤6,如果条件不吻合,主控制模块通过显示屏提醒拍摄者目前的状态,并且跳转到步骤1,重新进入下一次的拍摄流程,继续捕捉面部信息; Step 5, the main control module calculates the result of judgment in step 4, if the captured image data and the user-preset condition is met, then step 6, if the condition does not match, the main control module alerts the current state through the display the photographer and jumps to step 1, in a capture process to re-enter, continue to capture the face information;

步骤6、主控制模块触发拍摄的快门流程,设置好合适的拍摄参数,完成自动对焦过程,控制王摄像头拍摄照片,将照片存储在内部存储器当中。 Step 6, the main control module triggers shutter photographing process, appropriate shooting parameters set, auto-focus process is completed, the control Wang camera taking pictures, the pictures stored in the internal memory of them.

[0008] 步骤7、主控制模块判断拍摄者的面部表情或者动作是否仍然满足预设条件,如果满足,跳转到步骤6,实现连续拍摄功能,如果不满足,跳转到步骤8 ; [0008] Step 7, the main control module determines whether the facial expression or action of the photographer still meets the preset condition, if so, skip to step 6, to realize a continuous shooting function, and if not, skip to step 8;

步骤8、拍摄程序回到预览模式,并且跳转到步骤1,重新进入下一次的拍摄流程,继续捕捉面部信息,等待下一次拍摄。 Step 8, filming the program back to the preview mode, and skip to step 1, re-enter the next shooting process, continue to capture the facial information, waiting for the next shot.

[0009] 所述的步骤4中,纵向上,数字信号处理器DSP分别处理得到的每一帧图像信息,记录拍摄者面部表情或者动作的变化过程,横向上,数字信号处理器DSP用得到的图像信息和预存在内部存储器里拍摄者的表情或者动作信息比对;如果用户没有使用预存图像信息,那么数字信号处理器DSP只做纵向分析。 In step [0009] of the 4, the longitudinal direction, respectively, a digital signal processor DSP processing each frame of image information obtained by photographing the recording process of change of facial expression or action, the transverse direction, with the digital signal processor DSP obtained the image information captured and stored in the internal memory in the motion information the faces or alignment; then only longitudinal analysis digital signal processor DSP pre-stored image information if the user does not use.

[0010] 所述的移动设备是智能手机,或数码相机。 The mobile device [0010] The smart phone, or digital camera.

[0011] 本发明的优点在于: [0011] The advantage of the present invention:

1、本发明实现了一种通过表情识别触发快门拍摄的方法,以拍摄者的面部表情或者动作作为触发条件,使用起来更加灵活,具有趣味性。 1, the present invention implements a method for triggering a shutter by expression recognition, facial expression or action of a photographer as a trigger, the use of more flexible, having fun.

[0012] 2、本发明具有主要数据采集模块(主摄像头)和辅助数据采集模块(辅助摄像头),辅助数据采集模块不依靠被拍摄物体和场景,连续对拍摄者的面部表情或者动作进行捕捉。 [0012] 2, the present invention has a primary data acquisition module (main camera) and an auxiliary data acquisition module (secondary camera), an auxiliary data acquisition module does not depend on the object being photographed and scenes, continuous facial expression or action of the photographer capture.

[0013] 3、本发明是一种非触摸式的快门触发手段,避免接触造成移动设备抖动,减少照片模糊的可能性。 [0013] 3, the present invention is a non-touch-trigger shutter means, to avoid contact with the jitter caused by the mobile device, reducing the likelihood of blurred pictures.

附图说明 BRIEF DESCRIPTION

[0014] 图1是本发明的硬件结构示意图。 [0014] FIG. 1 is a schematic diagram of a hardware configuration of the present invention.

[0015] 图2是本发明的流程图。 [0015] FIG 2 is a flowchart of the present invention.

具体实施方式 Detailed ways

[0016] 以下根据图1和图2,具体说明本发明的较佳实施例。 [0016] According to the FIGS. 1 and 2, described in detail preferred embodiments of the present invention.

[0017] 本发明提供一种通过表情识别拍摄照片的方法,该方法可用于移动设备上。 [0017] The present invention provides a method of identifying expression of photographs, the method may be used on mobile devices.

[0018] 所述的移动设备可以是智能手机,数码相机,但是并不局限于这些移动设备。 [0018] The mobile device may be a smart phone, a digital camera, but is not limited to these mobile devices. [0019] 本发明基于移动设备上的硬件实现,如图1所示,这些硬件包含主控制模块101、电路连接该主控制模块101的主摄像头102、辅助摄像头103、数字信号处理器DSP104、内部存储器105和显示屏106。 [0019] The present invention is based on the mobile device hardware implementation shown in Figure 1, the hardware module 101 includes a main control circuit connected to the main control module 102 of the main camera, the secondary camera 103 101, a digital signal processor DSP 104, the internal The memory 105 and the display 106.

[0020] 所述的主控制模块101可以采用arm、MIPS等架构的微处理芯片,完成整个拍摄流程的监测和控制。 [0020] The main control module 101 may employ a micro chip arm, MIPS architecture, etc., to monitor and control the completion of the entire shooting process.

[0021] 所述的主摄像头102和辅助摄像头103是数据输入装置,主摄像头102是用来采集被拍摄物体或者场景的,根据需要选择合适的规格,辅助摄像头103用来捕捉拍摄者面部的表情和动作,所以选择视角较大的摄像头,以便完整地得到拍摄者的面部区域,并且帧率足够大,这样能够获得拍摄者完整的面部动作。 The main camera 102 and the auxiliary camera 103 [0021] of the data input means, a main camera 102 is used to collect the object to be photographed or a scene, to select the appropriate size according to need, the auxiliary camera 103 to capture the photographer facial expressions and action, so a larger viewing angle of the camera selected in order to obtain a complete face area of ​​the photographer, and the frame rate is sufficiently large, so that a photographer can obtain a full facial movements.

[0022] 主控制模块101通过I2C控制总线向主摄像头102和辅助摄像头103发送命令,完成摄像头寄存器初始化和曝光控制,主摄像头102和辅助摄像头103则通过MIPI串行总线或者并行总线向主控制模块101发送图像数据,这样就完成了主控制模块101和摄像头的双向通信。 [0022] The main control module 101 controls the bus to the main camera 103 sends a command 102 and the auxiliary camera, complete camera registers are initialized and exposure control via I2C, the main camera 102 and the auxiliary camera 103 via MIPI serial bus or a parallel bus to the master control module transmitting the image data 101, thus completing the main control module 101, and bidirectional communication camera.

[0023] 所述的数字信号处理器DSP104对主控制模块101通过摄像头获得的图像数据进行处理,该数字信号处理器DSP104和主控制模块101之间通过内部总线进行通信。 [0023] The digital signal processor DSP104 main control module 101 for processing image data obtained by the camera, the communication between the digital signal processor DSP104 and a main control module 101 through an internal bus.

[0024] 图像数据包括两部分,一部分是主摄像头102获得的被拍摄物体和场景的图像数据,这部分是拍摄者打算记录下来的,所以在数字信号处理器DSP104中经过白平衡算法,曝光算法,自动对焦算法等算法处理,最真实,优质地显示到显示屏106上,给拍摄者预览;另一部分是辅助摄像头103获得的拍摄者的面部表情或者动作的图像数据,这部分是用来作为触发快门的判断条件,因此并不需要显示到显示屏106上,数字信号处理器DSP104主要计算出图像数据的轮廓信息,判断拍摄者眼睛,嘴巴,眉毛等部位的位置,在不停获取拍摄者面部图像数据的过程中,计算嘴角有没有扬起来,拍摄者有没有点头等。 [0024] The image data consists of two parts, a part of the object is captured and the image data of a scene 102 obtained by the main camera, the photographer intended partly recorded, the digital signal processor DSP104 elapsed white balance algorithms, Algorithm exposure AF algorithm processing algorithm, the most realistic, high-quality displayed on the display screen 106, the photographer to preview; another part of the image data is a facial expression or action of the photographer's camera 103 obtains the secondary, which is used as part of shutter trigger condition is determined, and therefore does not need to be displayed on the display screen 106, a digital signal processor DSP104 main calculating the profile information of image data, determine the position of photographer's eye portion, a mouth, eyebrows, constantly obtaining a photographer process facial image data, calculate the mouth there is no up there, the photographer there nodding.

[0025] 本发明提供一种通过表情识别拍摄照片的方法,该方法包含以下步骤: [0025] The present invention provides a method of identifying expression of photographs, the method comprising the steps of:

步骤1、移动设备进入拍摄程序,主控制模块101判断内部存储器105中是否已经存储有面部表情或者动作的图像信息,如果有,进行步骤2,如果没有,进行步骤1.1 ; Step 1, the mobile device enters the imaging sequence, the main control module 101 determines whether the image information stored in the facial expression or action in the internal memory 105, and if so, step 2, and if not, step 1.1;

每个人表情动作多种多样,提前存储拍摄者的表情信息,比如微笑,点头,皱眉等可以提高判断的准确性,比如,拍摄者选择微笑作为触发快门的判断条件,程序会保存拍摄者面部各部位的轮廓信息,拍摄者的肤色信息,拍摄者从严肃到微笑这个过程中嘴角移动的形状和幅度; Everyone emotes diverse expression information stored in advance the photographer, such as a smile, a nod, frown, etc. can improve the accuracy of judgment, for example, the photographer select a smile as judgment conditions trigger the shutter, the program will save face each photographer parts of the profile information, color information of the photographer, the photographer from serious to smile this process moving mouth shape and amplitude;

步骤1.1、主控制模块101提醒用户是否要输入表情或者动作图像信息,如果用户选择输入表情或者动作图像信息,则主控制模块101控制辅助摄像头103捕获拍摄者的表情或者动作的图像信息,然后用于后面触发快门的判断条件,如果用户不选择输入表情或者动作图像信息,则后续在判断是否触发快门的时候完全依靠图像处理算法,最后跳转到步骤2 ; Step 1.1, the main control module 101 to alert the user whether or not to enter the expression or the operation of the image information, if the user selects the input face or the operation of the image information, the main control module 101 controls the auxiliary camera 103 captures image information captured by the expression or action, then behind the shutter trigger determination condition, if the user does not select the input image information expression or action, it is totally dependent on the subsequent image processing algorithm when deciding whether to trigger the shutter, the last hop to step 2;

步骤2、进入到预览模式,主控制模块101控制主摄像头102采集需要拍摄的物体或者场景,经过数字信号处理器DSP104处理之后,在显示屏106上显示,同时,主控制模块101控制辅助摄像头103也开始采集图像信息,通过数字信号处理器DSP104处理捕获的面部轮 Step 2 proceeds to the preview mode, the main control module 101 controls the main camera 102 capture an object or the scene need to take, after a digital signal processor DSP104 processing, on the display screen 106 display, while the main control module 101 controls the auxiliary camera 103 It began collecting image information by a digital signal processor processing the captured face wheel DSP104

廓信息; Profile information;

步骤3、主控制模块101判断辅助摄像头103采集到的图像信息是否包含拍摄者完整的面部信息,如果拍摄者没有面对辅助摄像头103,主控制模块101应当通过显示屏106提醒拍摄者目前的状态,并且跳转到步骤I,重新进入下一次的拍摄流程,继续捕捉面部信息;步骤4、数字信号处理器DSP104开始对拍摄者完整的面部图像信息进行计算和分析;拍摄者在预览的过程中,辅助摄像头保持对拍摄者面部表情或者动作的捕捉,当拍摄者希望拍摄当下预览里的画面时,只需要做出预设的面部表情或者动作; Step 3, the main control module 101 determines the auxiliary camera 103 captured image information contains the photographer full face information, if the photographer does not face the auxiliary camera 103, the main control module 101 should be reminded that the current state of the photographer through the display 106 and jumps to step I, in a capture process to re-enter, continue to capture the face information; step 4, a digital signal processor DSP104 complete the photographer starts the face image information is calculated and analyzed; photographer during previewing auxiliary camera for the photographer to keep capturing facial expressions or actions, when the photographer wishes to photograph the moment in the preview screen, just need to make the default facial expression or action;

纵向上,数字信号处理器DSP104分别处理得到的每一帧图像信息,记录拍摄者面部表情或者动作的变化过程,横向上,数字信号处理器DSP104用得到的图像信息和预存在内部存储器105里拍摄者的表情或者动作信息比对; In the longitudinal direction, a digital signal processor DSP104 process each frame of the image information obtained by photographing the recording process of change of facial expression or action, the transverse direction, the digital signal processor DSP104 image information obtained by photographing and stored in the internal memory 105 in the faces of the comparison or operation information;

如果用户没有使用预存图像信息,那么数字信号处理器DSP104只做纵向分析; If the user does not use the pre-stored image information, the digital signal processor DSP104 only vertical analysis;

步骤5、主控制模块101对步骤4的计算结果进行判断,如果捕获的图像数据和用户预设的条件吻合,那么进行步骤6,如果条件不吻合,主控制模块101通过显示屏106提醒拍摄者目前的状态,并且跳转到步骤I,重新进入下一次的拍摄流程,继续捕捉面部信息; Step 5, the main control module 101 in step 4 the results of the determination, if the captured image data and the user-preset condition is met, then step 6, if the condition does not match, the main control module 101 through the display 106 to remind the photographer current state, and jumps to step I, in a capture process to re-enter, continue to capture the face information;

步骤6、主控制模块101触发拍摄的快门流程,设置好合适的拍摄参数,完成自动对焦过程,控制主摄像头103拍摄照片,将照片存储在内部存储器105当中。 Step 6, the main control module 101 triggers shutter photographing process, appropriate shooting parameters set, auto-focus process is completed, control of the main camera 103 to take pictures, among pictures stored in the internal memory 105.

[0026] 步骤7、主控制模块101判断拍摄者的面部表情或者动作是否仍然满足预设条件,如果满足,跳转到步骤6,实现连续拍摄功能,如果不满足,跳转到步骤8 ; [0026] Step 7, the main control module 101 determines whether the facial expression or action of the photographer still meets the preset condition, if so, skip to step 6, to realize a continuous shooting function, and if not, skip to step 8;

步骤8、拍摄程序回到预览模式,并且跳转到步骤1,重新进入下一次的拍摄流程,继续捕捉面部信息,等待下一次拍摄。 Step 8, filming the program back to the preview mode, and skip to step 1, re-enter the next shooting process, continue to capture the facial information, waiting for the next shot.

[0027] 本发明主要用于移动设备照片或者视频拍摄,判断辅助摄像头捕获到的拍摄者面部表情或者动作的图像信息与预设条件是否吻合,如果条件满足,触发拍摄的快门流程,完成照片拍摄,本发明使移动设备的拍摄手段更加灵活,在拍摄者不方便触摸快门按键的时候,只需要一个简单的面部表情或者动作就可以拍摄到照片,另一方面,本发明所述触发快门的方法是非接触式的,极大地减少人为抖动造成照片模糊的机会。 [0027] The present invention is mainly used in mobile devices capturing photos or videos, image information preset condition is determined by the secondary imaging camera to capture facial expressions or actions is consistent, if the condition is satisfied, the trigger shutter photographing process, to take the picture the mobile device more flexible imaging means of the present invention, when the photographer touches a shutter button is inconvenient, requiring only a simple operation of facial expression can be captured or pictures, on the other hand, the present invention is a method of triggering a shutter non-contact, greatly reducing the chance of human shake blur pictures.

[0028] 尽管本发明的内容已经通过上述优选实施例作了详细介绍,但应当认识到上述的描述不应被认为是对本发明的限制。 [0028] While the present invention have been described in detail by the above preferred embodiments, it should be appreciated that the above description should not be construed as limiting the present invention. 在本领域技术人员阅读了上述内容后,对于本发明的多种修改和替代都将是显而易见的。 After the skilled artisan reading the foregoing, various modifications and alternatives to the present invention will be apparent. 因此,本发明的保护范围应由所附的权利要求来限定。 Accordingly, the scope of the invention be defined by the appended claims.

Claims (3)

1.一种通过表情识别拍摄照片的方法,该方法用于移动设备上,基于移动设备上的硬件实现,所述的硬件包含主控制模块(101)、电路连接该主控制模块(101)的主摄像头(102)、辅助摄像头(103)、数字信号处理器DSP (104)、内部存储器(105)和显示屏(106); 其特征在于,该方法包含以下步骤: 步骤1、移动设备进入拍摄程序,主控制模块(101)判断内部存储器(105)中是否已经存储有面部表情或者动作的图像信息,如果有,进行步骤2,如果没有,进行步骤1.1 ; 步骤1.1、主控制模块(101)提醒用户是否要输入表情或者动作图像信息,如果用户选择输入表情或者动作图像信息,则主控制模块(101)控制辅助摄像头(103)捕获拍摄者的表情或者动作的图像信息,然后用于后面触发快门的判断条件,如果用户不选择输入表情或者动作图像信息,则后续在判断是否触发快门的时候完全依 1. A method of taking pictures of the facial expression recognition, the method is used on a mobile device, hardware-based on the mobile device, the hardware includes a main control module (101), a circuit connected to the main control module (101) the main camera (102), an auxiliary camera (103), a digital signal processor DSP (104), an internal memory (105) and a display screen (106); wherein the method comprises the following steps: step 1, the mobile device enters the shooting program, the main control module (101) determines an internal memory (105) has been stored image information of facial expression or action, if any, step 2, and if not, step 1.1; step 1.1, the main control module (101) to remind the user whether or not to enter the expression or the operation of the image information, if the user selects the input face or the operation of the image information, the main control module (101) controls the auxiliary camera (103) the captured image information expression or action of the photographer, and then for subsequent triggering Analyzing the condition of the shutter, if the user does not select the input face image or the operation information, deciding whether to trigger follow-up when the shutter completely by 图像处理算法,最后跳转到步骤2 ; 步骤2、进入到预览模式,主控制模块(101)控制主摄像头(102)采集需要拍摄的物体或者场景,经过数字信号处理器DSP (104)处理之后,在显示屏(106)上显示,同时,主控制模块(101)控制辅助摄像头(103)也开始采集图像信息,通过数字信号处理器DSP (104)处理捕获的面部轮廓信息; 步骤3、主控制模块(101)判断辅助摄像头(103)采集到的图像信息是否包含拍摄者完整的面部信息,如果拍摄者没有面对辅助摄像头(103),主控制模块(101)应当通过显示屏(106)提醒拍摄者目前的状态,并且跳转到步骤I,重新进入下一次的拍摄流程,继续捕捉面部信息; 步骤4、数字信号处理器DSP (104)开始对拍摄者完整的面部图像信息进行计算和分析; 步骤5、主控制模块(101)对步骤4的计算结果进行判断,如果捕获的图像数据和用户预设的条件吻合,那么 After step 2, into the preview mode, the main control module (101) controls the main camera (102) collecting a scene or objects need to take, through the digital signal processor DSP (104) processing; image processing algorithm, the last hop to Step 2 , on the display screen (106) displays, at the same time, the main control module (101) controls the auxiliary camera (103) also starts acquisition of image information, (104) for the facial contour information captured by the digital signal processor, the DSP; step 3, the main the control module (101) determines an auxiliary camera (103) captured image information contains the photographer full face information, if the photographer does not face the auxiliary camera (103), the main control module (101) shall be through the display (106) warns the photographer of the current state, and jumps to step I, re-enter the next photographing process, continue to capture the face information; step 4, a digital signal processor DSP (104) complete the photographer starts the face image information is calculated and analysis; step 5, the main control module (101) to the calculation result of judgment in step 4, if the captured image data and the user-preset condition is met, then 行步骤6,如果条件不吻合,主控制模块(101)通过显示屏(106)提醒拍摄者目前的状态,并且跳转到步骤1,重新进入下一次的拍摄流程,继续捕捉面部信息; 步骤6、主控制模块(101)触发拍摄的快门流程,设置好合适的拍摄参数,完成自动对焦过程,控制主摄像头(103)拍摄照片,将照片存储在内部存储器(105)当中; 步骤7、主控制模块(101)判断拍摄者的面部表情或者动作是否仍然满足预设条件,如果满足,跳转到步骤6,实现连续拍摄功能,如果不满足,跳转到步骤8 ; 步骤8、拍摄程序回到预览模式,并且跳转到步骤1,重新进入下一次的拍摄流程,继续捕捉面部信息,等待下一次拍摄。 Step 6 rows, if the condition does not match, the master control module (101) through the display to remind (106) the current state of the photographer, and jumps to step 1, in a capture process to re-enter, continue to capture the face information; Step 6 the main control module (101) triggers the imaging shutter process, set the appropriate imaging parameters, and auto-focus process, control of the main camera (103) photographs, the (105) among pictures stored in an internal memory; step 7, the main control module (101) determines whether a facial expression or action the photographer is still meets the preset condition, if so, skip to step 6, to realize a continuous shooting function, and if not, skip to step 8; step 8, the program returns to the shooting preview mode, and skip to step 1, under a process of re-entering the shooting, continue to capture the facial information, waiting for the next shot.
2.如权利要求1所述的通过表情识别拍摄照片的方法,其特征在于,所述的步骤4中,纵向上,数字信号处理器DSP (104)分别处理得到的每一帧图像信息,记录拍摄者面部表情或者动作的变化过程,横向上,数字信号处理器DSP (104)用得到的图像信息和预存在内部存储器(105)里拍摄者的表情或者动作信息比对;如果用户没有使用预存图像信息,那么数字信号处理器DSP (104)只做纵向分析。 2. The method of taking a picture of the expression recognition by claim 1, wherein said step 4, the longitudinal direction, a digital signal processor DSP (104), respectively, each frame of image processing information obtained, the recording change process photographer facial expression or action, the transverse direction, a digital signal processor DSP (104) and the image information obtained by photographing stored in the internal memory (105) in the face or by comparing the motion information; if the user does not use the pre-stored the image information, the digital signal processor only longitudinal analysis DSP (104).
3.如权利要求1所述的通过表情识别拍摄照片的方法,其特征在于,所述的移动设备是智能手机,或数码相机。 The method of identifying expression of the photographs by claim 1, wherein said mobile device is a smart phone, or digital camera.
CN201310600001.5A 2013-11-25 2013-11-25 Method for recognizing shot photos by facial expressions CN103685940A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310600001.5A CN103685940A (en) 2013-11-25 2013-11-25 Method for recognizing shot photos by facial expressions

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310600001.5A CN103685940A (en) 2013-11-25 2013-11-25 Method for recognizing shot photos by facial expressions

Publications (1)

Publication Number Publication Date
CN103685940A true CN103685940A (en) 2014-03-26

Family

ID=50322092

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310600001.5A CN103685940A (en) 2013-11-25 2013-11-25 Method for recognizing shot photos by facial expressions

Country Status (1)

Country Link
CN (1) CN103685940A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104333701A (en) * 2014-11-28 2015-02-04 广东欧珀移动通信有限公司 Method and device for displaying camera preview pictures as well as terminal
CN104486542A (en) * 2014-11-28 2015-04-01 广东欧珀移动通信有限公司 Triggering picture taking method and device
CN104869318A (en) * 2015-06-12 2015-08-26 上海鼎讯电子有限公司 Automatic shooting subassembly
CN105391922A (en) * 2014-09-02 2016-03-09 宏达国际电子股份有限公司 Electronic device and image capture method thereof
CN105450930A (en) * 2015-11-09 2016-03-30 广州多益网络科技有限公司 Selfie method and device
CN105516576A (en) * 2014-09-22 2016-04-20 中兴通讯股份有限公司 Picture taking method and picture taking device based on mouth shape identification, and mobile terminal
CN105872378A (en) * 2016-04-12 2016-08-17 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN105872352A (en) * 2015-12-08 2016-08-17 乐视移动智能信息技术(北京)有限公司 Method and device for shooting picture
CN105959563A (en) * 2016-06-14 2016-09-21 北京小米移动软件有限公司 Image storing method and image storing apparatus
CN106161954A (en) * 2016-08-16 2016-11-23 北京金山安全软件有限公司 Video shooting control method, video shooting control device and electronic equipment
CN106713764A (en) * 2017-01-24 2017-05-24 维沃移动通信有限公司 Photographic method and mobile terminal
CN106878583A (en) * 2017-03-22 2017-06-20 广州市吉星信息科技有限公司 Intelligent high-speed photographic apparatus
CN106919943A (en) * 2015-12-25 2017-07-04 北京搜狗科技发展有限公司 Data processing method and apparatus
CN107360366A (en) * 2017-06-30 2017-11-17 广东欧珀移动通信有限公司 Photographing method and device, storage medium, and electronic equipment
CN107368777A (en) * 2017-06-02 2017-11-21 广州视源电子科技股份有限公司 Smile motion detection method and device and in vivo recognition method and system
CN107635095A (en) * 2017-09-20 2018-01-26 广东欧珀移动通信有限公司 Photographing method and apparatus, storage medium and photographing device

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5570151A (en) * 1993-12-27 1996-10-29 Nikon Corporation Camera which operates a shutter according to a photographer's wink and the vibration level
US5859921A (en) * 1995-05-10 1999-01-12 Mitsubishi Denki Kabushiki Kaisha Apparatus for processing an image of a face
US20030021601A1 (en) * 2001-07-30 2003-01-30 Tim Goldstein System and method for controlling electronic devices
CN1788234A (en) * 2004-04-01 2006-06-14 松下电器产业株式会社 Eye imaging apparatus and mobil terminal device
CN101627335A (en) * 2007-03-02 2010-01-13 索尼爱立信移动通讯股份有限公司 Remote control of an image capturing unit in a portable electronic device
CN101646017A (en) * 2008-08-07 2010-02-10 华晶科技股份有限公司 Automatic photographing method for face detection
CN101959011A (en) * 2009-07-15 2011-01-26 联发科技股份有限公司 Electronic device and method for operating electronic device
CN102413282A (en) * 2011-10-26 2012-04-11 惠州Tcl移动通信有限公司 Self-shooting guidance method and equipment
CN103220467A (en) * 2013-04-10 2013-07-24 广东欧珀移动通信有限公司 Intelligent shooting method for mobile terminal and system thereof
CN103269415A (en) * 2013-04-16 2013-08-28 广东欧珀移动通信有限公司 Automatic photo taking method for face recognition and mobile terminal

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5570151A (en) * 1993-12-27 1996-10-29 Nikon Corporation Camera which operates a shutter according to a photographer's wink and the vibration level
US5859921A (en) * 1995-05-10 1999-01-12 Mitsubishi Denki Kabushiki Kaisha Apparatus for processing an image of a face
US20030021601A1 (en) * 2001-07-30 2003-01-30 Tim Goldstein System and method for controlling electronic devices
CN1788234A (en) * 2004-04-01 2006-06-14 松下电器产业株式会社 Eye imaging apparatus and mobil terminal device
CN101627335A (en) * 2007-03-02 2010-01-13 索尼爱立信移动通讯股份有限公司 Remote control of an image capturing unit in a portable electronic device
CN101646017A (en) * 2008-08-07 2010-02-10 华晶科技股份有限公司 Automatic photographing method for face detection
CN101959011A (en) * 2009-07-15 2011-01-26 联发科技股份有限公司 Electronic device and method for operating electronic device
CN102868857A (en) * 2009-07-15 2013-01-09 联发科技股份有限公司 Electronic device and method for operating the same
CN102413282A (en) * 2011-10-26 2012-04-11 惠州Tcl移动通信有限公司 Self-shooting guidance method and equipment
CN103220467A (en) * 2013-04-10 2013-07-24 广东欧珀移动通信有限公司 Intelligent shooting method for mobile terminal and system thereof
CN103269415A (en) * 2013-04-16 2013-08-28 广东欧珀移动通信有限公司 Automatic photo taking method for face recognition and mobile terminal

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105391922B (en) * 2014-09-02 2019-04-26 宏达国际电子股份有限公司 Electronic device and image acquisition method
CN105391922A (en) * 2014-09-02 2016-03-09 宏达国际电子股份有限公司 Electronic device and image capture method thereof
CN105516576A (en) * 2014-09-22 2016-04-20 中兴通讯股份有限公司 Picture taking method and picture taking device based on mouth shape identification, and mobile terminal
CN104486542A (en) * 2014-11-28 2015-04-01 广东欧珀移动通信有限公司 Triggering picture taking method and device
CN104333701A (en) * 2014-11-28 2015-02-04 广东欧珀移动通信有限公司 Method and device for displaying camera preview pictures as well as terminal
CN104869318A (en) * 2015-06-12 2015-08-26 上海鼎讯电子有限公司 Automatic shooting subassembly
CN105450930A (en) * 2015-11-09 2016-03-30 广州多益网络科技有限公司 Selfie method and device
CN105872352A (en) * 2015-12-08 2016-08-17 乐视移动智能信息技术(北京)有限公司 Method and device for shooting picture
CN106919943A (en) * 2015-12-25 2017-07-04 北京搜狗科技发展有限公司 Data processing method and apparatus
CN105872378A (en) * 2016-04-12 2016-08-17 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN105959563A (en) * 2016-06-14 2016-09-21 北京小米移动软件有限公司 Image storing method and image storing apparatus
CN106161954A (en) * 2016-08-16 2016-11-23 北京金山安全软件有限公司 Video shooting control method, video shooting control device and electronic equipment
CN106713764A (en) * 2017-01-24 2017-05-24 维沃移动通信有限公司 Photographic method and mobile terminal
CN106878583A (en) * 2017-03-22 2017-06-20 广州市吉星信息科技有限公司 Intelligent high-speed photographic apparatus
CN107368777A (en) * 2017-06-02 2017-11-21 广州视源电子科技股份有限公司 Smile motion detection method and device and in vivo recognition method and system
CN107360366A (en) * 2017-06-30 2017-11-17 广东欧珀移动通信有限公司 Photographing method and device, storage medium, and electronic equipment
CN107635095A (en) * 2017-09-20 2018-01-26 广东欧珀移动通信有限公司 Photographing method and apparatus, storage medium and photographing device

Similar Documents

Publication Publication Date Title
US8243182B2 (en) Method of making a digital camera image of a scene including the camera user
KR101401165B1 (en) Image-capturing apparatus and method, expression evaluation apparatus, and recording medium
CN101193208B (en) Image shooting device, image processing device, image processing method and image processing program
CN103905730B (en) Photographing method and a mobile terminal of the mobile terminal
US9402033B2 (en) Image sensing apparatus and control method therefor
CN101399916B (en) Image taking apparatus and image taking method
CN101860679B (en) Digital camera and image capturing method
JP2011050038A (en) Image reproducing apparatus and image sensing apparatus
CN102938825B (en) A method for taking photos and videos and devices
CN102349292B (en) Device with display device, method and device for responsing obscure detection to image
US9596398B2 (en) Automatic image capture
US7868926B2 (en) Digital camera with automatic functions
CN101325658B (en) Imaging device, imaging method and computer program
JP5136669B2 (en) Image processing apparatus, image processing method, and program
CN103795913B (en) Method and apparatus for controlling the camera apparatus
US8988529B2 (en) Target tracking apparatus, image tracking apparatus, methods of controlling operation of same, and digital camera
JP4264663B2 (en) Capturing apparatus, an image processing apparatus, and a program for executing the image processing method and the method in these computers
JP4442330B2 (en) An electronic camera and an electronic camera system,
US8199221B2 (en) Image recording apparatus, image recording method, image processing apparatus, image processing method, and program
JP4639869B2 (en) Imaging apparatus and timer photographing method
CN101378458B (en) Using a face recognition function digital photographing apparatus and method
CN101600051B (en) Image capturing apparatus and image capturing method
CN103888683B (en) Mobile terminal and shooting method thereof
TWI549501B (en) An imaging device, and a control method thereof
JP2008136174A (en) Imaging apparatus and imaging control method

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20140326