CN107301390A - Shoot reminding method, device and terminal device - Google Patents
Shoot reminding method, device and terminal device Download PDFInfo
- Publication number
- CN107301390A CN107301390A CN201710458976.7A CN201710458976A CN107301390A CN 107301390 A CN107301390 A CN 107301390A CN 201710458976 A CN201710458976 A CN 201710458976A CN 107301390 A CN107301390 A CN 107301390A
- Authority
- CN
- China
- Prior art keywords
- state
- shooting
- smile
- tooth
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000004590 computer program Methods 0.000 claims description 17
- 238000000605 extraction Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 4
- 230000008921 facial expression Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
- G06V40/175—Static expression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Geometry (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
Reminding method, device and terminal device are shot the invention discloses one kind, wherein, method includes：When including face in detecting present filming scene, according to the mouth region in face recognition technology locating human face；Judge whether current face is in smile state according to mouth region；If current face is not in smile state, the prompt message that generation is smiled for target reference object, and will be prompted to information and be supplied to user.With it, one be shooted can be reminded to smile when one be shooted does not smile, it is ensured that one be shooted is smile state in photo, improves photographic quality, solve in the prior art the problem of one be shooted, which does not smile, influences photographic quality.
Description
Technical Field
The invention relates to the technical field of intelligent terminals, in particular to a shooting prompting method and device and terminal equipment.
Background
With the higher and higher camera configuration of the smart phone, the mobile phone camera is accepted by more and more users. In daily life, especially when the user plays outside, the user who uses the mobile phone camera to take pictures is everywhere visible.
Because the picture taking is to acquire the image instantly, the picture quality of the portrait picture actually taken, especially the self-taking or the co-taking, is easily influenced because the person to be taken is not smiling.
Disclosure of Invention
The object of the present invention is to solve at least to some extent one of the above mentioned technical problems.
Therefore, a first objective of the present invention is to provide a shooting prompting method to remind a photographed person of smiling when the photographed person is not smiling, so as to ensure that the photographed person is in a smiling state in a photo, improve the quality of the photo, and solve the problem in the prior art that the quality of the photo is affected because the photographed person is not smiling.
The second objective of the present invention is to provide a shooting prompting device.
A third object of the present invention is to provide a terminal device.
A fourth object of the invention is to propose a non-transitory computer-readable storage medium.
A fifth object of the invention is to propose a computer program product.
In order to achieve the above object, an embodiment of a first aspect of the present invention provides a shooting prompting method, including:
when the current shooting scene is detected to contain the face, positioning a mouth area in the face according to a face recognition technology;
judging whether the current face is in a smiling state or not according to the mouth area;
and if the current face is not in a smiling state, generating prompt information for smiling the target shooting object, and providing the prompt information for the user.
According to the shooting prompting method, when the face is detected to be contained in the current shooting scene, the mouth area in the face is positioned according to the face recognition technology, and when the current face is judged to be not in a smiling state according to the mouth area, the prompting information for smiling the target shooting object is generated and provided for the user. Therefore, the photographed person can be reminded of smiling when the photographed person does not smile, the photographed person is guaranteed to be in a smiling state in the photo, and the photo quality is improved.
In order to achieve the above object, a second aspect of the present invention provides a shooting prompting apparatus, including:
the positioning module is used for positioning a mouth region in a face according to a face recognition technology when the face is detected to be contained in a current shooting scene;
the judging module is used for judging whether the current face is in a smiling state according to the mouth area;
the generating module is used for generating prompt information for smiling a target shooting object when the current face is not in a smiling state;
and the providing module is used for providing the prompt information for the user.
According to the shooting prompting device provided by the embodiment of the invention, when the face is detected to be contained in the current shooting scene, the mouth area in the face is positioned according to the face recognition technology, and when the current face is judged and known not to be in a smiling state according to the mouth area, the prompting information for smiling the target shooting object is generated and provided for the user. Therefore, the photographed person can be reminded of smiling when the photographed person does not smile, the photographed person is guaranteed to be in a smiling state in the photo, and the photo quality is improved.
In order to achieve the above object, a third embodiment of the present invention provides a terminal device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the shooting prompting method described in the first embodiment is implemented.
To achieve the above object, a fourth aspect of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the shooting prompting method described in the first aspect.
To achieve the above object, a fifth aspect of the present invention provides a computer program product, wherein when instructions of the computer program product are executed by a processor, the computer program product executes a shooting prompting method, and the method includes:
when the fact that a face is contained in a current shooting scene is detected, a mouth area in the face is located according to a face recognition technology;
judging whether the current face is in a smiling state or not according to the mouth area;
and if the current face is not in a smiling state, generating prompt information for smiling the target shooting object, and providing the prompt information for the user.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flow chart of a shooting prompting method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a shooting prompting method according to another embodiment of the present invention;
fig. 3A is a schematic flow chart of a shooting prompting method according to another embodiment of the present invention;
fig. 3B is a schematic flowchart of a shooting prompting method according to yet another embodiment of the present invention;
fig. 4 is a schematic structural diagram of a shooting prompt apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a shooting prompting device according to another embodiment of the present invention;
fig. 6 is a schematic structural diagram of a shooting prompting device according to yet another embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The following describes a shooting prompting method, a shooting prompting device and terminal equipment according to embodiments of the invention with reference to the accompanying drawings.
Fig. 1 is a schematic flow chart of a shooting prompting method according to an embodiment of the present invention. The method can be applied to intelligent terminal equipment with a photographing function so as to prompt a shot in photographing scenes such as self-photographing and group photographing. The intelligent terminal device can be an electronic device with a camera, such as a smart phone, a tablet computer, a notebook computer or a camera.
As shown in fig. 1, the shooting prompting method may include the steps of:
and S11, when the face is detected to be contained in the current shooting scene, positioning the mouth area in the face according to the face recognition technology.
Almost everyone has a self-timer or group-shot experience, and when a self-timer or group-shot is taken, the main subject is a person, and the facial expression of the subject has a great influence on the picture quality. Especially, in group shooting, even if only one person does not smile, the picture quality is affected, and the satisfaction of the shot person on the picture quality is reduced.
In this embodiment, before the picture is taken, the display area of the shooting scene may be scanned, and a face recognition technology is used to detect whether the current shooting scene contains a face. If the face is not contained in the current shooting scene, the shooting is not focused on the facial expression of the shot person, the shooting object can be an animal, a plant, a building or the back shadow of a person, and the normal shooting function can be directly operated without giving any prompt information to the user. If a human face is detected in the current shooting scene, it indicates that the facial expression of the subject is a factor that needs to be considered and affects the quality of the picture. In order to avoid the problem of picture quality reduction caused by the fact that the shot person does not smile, when the face is detected to be contained in the current shooting scene, the mouth area in the face can be further positioned according to the face recognition technology.
The face recognition technology is based on the face features of people, can detect whether a face exists in an image, and further detects the position and size of each face and the position information of each main facial organ when the face is detected.
And S12, judging whether the current face is in a smiling state according to the mouth area.
Wherein the smile state is understood to include a smile-tooth-free state and a tooth-exposed smile state.
Because the smile of the shot person may be smiling without exposing teeth or may be smiling with exposing teeth, and the mouth characteristics of the shot person in the smiling without exposing teeth state and the smiling with exposing teeth state are different, therefore, in this embodiment, whether the current face is in the smiling without exposing teeth state or the smiling with exposing teeth state can be determined according to the mouth region of the shot person.
It should be noted that, the specific process of determining whether the subject is in the smiling state or the smiling state will be given in the following content, and in order to avoid repetition, detailed description will not be given here.
And S13, if the current face is not in a smiling state, generating prompt information for smiling the target shooting object, and providing the prompt information for the user.
In the embodiment, if the current face is judged to be in the smiling state according to the mouth area of the shot person, the shooting is normally operated; and if the face is judged to be not in the smiling state, generating prompt information for smiling of a target shooting object, namely the shot person, and providing the prompt information for the user.
It should be understood that when the shooting is self-shooting, the user is the target object; when the shooting is non-self-shooting, the user is the shooting subject, and after the prompt information is provided for the user, the user reminds the target object of smiling.
The embodiment provides two possible implementation manners for providing the generated prompt information for smiling the target shooting object to the user.
As one possible implementation manner, the prompt information may be presented in the shooting interface. For example, the prompt message can be presented in a shooting interface in a pop-up window display mode. When the current face is detected not to be in the smile state, a popup appears on the shooting interface, and the content of the popup is displayed as' please smile! "," people not laughing! And the like, which is used for prompting the user that the current face of the user is not in a smiling state. And after receiving the prompt message, the user smiles or reminds the target shooting object to smile.
When the prompt information is displayed in the shooting interface in a popup window display mode, in order to reduce the influence of the popup window on the shooting interface, the popup window display duration can be set to automatically disappear when reaching a threshold value, or a touch key, such as a 'confirm' key, is arranged in the popup window, and after a user receives the prompt information, the user touches the key, and the popup window disappears after the key is triggered.
With the development of artificial intelligence technology, voice broadcast services are increasingly applied to intelligent terminals, such as voice broadcast of navigation information, voice broadcast of mobile phone calls, and the like. Therefore, as another possible implementation manner, the prompt information can be provided to the user by means of voice broadcasting. For example, the user can be prompted by voice broadcasting information such as "please smile", "someone is not smiling", and the like that the current face of the user is not in a smiling state. And after receiving the prompt message, the user smiles or reminds the target shooting object to smile. The prompt information is provided for the user in a voice broadcasting mode, a shooting interface cannot be occupied, the influence of the mode for displaying the prompt information in the shooting interface on the shooting interface is avoided, and the user experience can be further improved.
It should be noted that, the two ways of providing the prompt information to the user in this embodiment may exist at the same time, and the user may select which way to prompt by himself. For example, a switch key may be set in the camera setting for providing the prompt information to the user in a voice broadcast manner, and when the key is in an on state, the voice broadcast manner is preferentially used to provide the prompt information to the user; when the key is in the closed state, the prompt information is provided for the user in a mode of displaying the prompt information in the shooting interface.
According to the shooting prompting method, when the fact that the face is contained in the current shooting scene is detected, the mouth area in the face is located according to the face recognition technology, and when the fact that the face is not in the smile state is judged and known according to the mouth area, prompting information for smiling of the target shooting object is generated and provided for the user. Therefore, the photographed person can be reminded of smiling when the photographed person does not smile, the photographed person is guaranteed to be in a smiling state in the photo, and the photo quality is improved.
Because the smile can be a smile with smile teeth or a smile with smile teeth, and the mouth characteristics of the smile with smile teeth are different, the way of judging whether the current face is in the smile state according to the mouth region is also different.
Fig. 2 is a schematic flow chart illustrating a process of determining whether a current face is in a smiling tooth-exposing state. As shown in fig. 2, on the basis of the embodiment shown in fig. 1, step S12 may include the following steps:
s21, lip arc information in the mouth region is extracted.
Wherein the lip arc may be a line between the upper and lower lips when the mouth is closed.
Generally, when a person is expressionless, the arc lines of the lips are a straight line; when the device is in a smiling state, the arc line of the lip is in a concave parabolic shape, and two ends of the arc line of the lip are raised; when the lip is in a difficult state, the arc line of the lip is in a convex parabola shape, and two ends of the arc line of the lip droop.
Therefore, in this embodiment, after the mouth region in the face is located, the lip arc information in the mouth region may be extracted by using the related technology, so as to determine the expression of the current face according to the lip arc information.
And S22, judging whether the lip arc information meets a first preset condition.
The first preset condition is that the arc line of the lips is in a concave parabolic shape, two ends of the arc line of the lips are raised, the distance between the left mouth corner and the right mouth corner of the lips in the x direction is larger than a certain threshold value, and the distance between the upper lips and the lower lips of the lips is smaller than a certain threshold value.
In this embodiment, after the lip arc information in the mouth region is extracted, whether the lip arc information satisfies a first preset condition may be further determined, and when the lip arc information satisfies the first preset condition, step S23 is executed; when the lip arc information does not satisfy the first preset condition, step S13 is performed, in which prompt information for smiling the target photographic subject is generated and provided to the user.
And S23, judging that the current human face is in a smiling tooth-exposing state.
In this embodiment, when the extracted lip arc information satisfies the first preset condition, it can be determined that the current face is in the smiling tooth-exposing state, and at this time, the face can be photographed in normal operation.
The shooting prompting method of the embodiment judges whether the lip arc line information meets a first preset condition or not by extracting the lip arc line information in the mouth region, judges that the current face is in a smiling tooth-sticking state when the first preset condition is met, can accurately recognize the expression of the current face, ensures that a photographed person is in a smiling state in a photo, and improves the photo quality.
Since the exposed teeth can largely ensure that the subject is in a smiling state during photographing, it can be determined whether the current face is in the smiling state by detecting whether the mouth region contains tooth information, and thus, as shown in fig. 3A, on the basis of the embodiment shown in fig. 1, step S12 may include the following steps:
and S31, extracting the characteristic information with white color from the mouth area, and positioning the tooth area according to the characteristic information with white color.
In general, since the color of a tooth is close to white and the luminance is high in the mouth region, in this embodiment, after the mouth region in the human face is located, feature information whose color is white may be further extracted from the mouth region, and the tooth region may be located based on the feature information whose color is white.
Since only the color of the teeth in the mouth region is white, the region having the color of white is extracted from the mouth region, and then the region can be determined to be the tooth region.
And S32, judging whether the tooth area meets a second preset condition.
The second preset condition may be that the tooth region is located between the upper and lower lips in the mouth region, and the size of the tooth region is greater than a certain threshold.
In this embodiment, after the mouth region is located in the tooth region, it may be further determined whether the tooth region meets a second preset condition, for example, whether the tooth region is located between the upper lip and the lower lip of the mouth region, and the size of the tooth region is greater than a certain threshold. If the tooth area satisfies the second preset condition, performing step S33; if the tooth area does not satisfy the second preset condition, step S13 is performed, in which prompt information for smiling the target photographic subject is generated and provided to the user.
And S33, judging that the current face is in the tooth exposing smile state.
In this embodiment, when the tooth area located in the mouth area satisfies the second preset condition, it can be determined that the current face is in the smiling tooth-uncovering state, and at this time, the photographing can be performed normally.
And S34, performing exposure and white balance processing on the image to be processed according to the tooth information in the tooth area. Wherein, the tooth information can be understood to include the brightness value corresponding to the tooth area.
Because the brightness of the tooth area is brighter, when a picture is taken, exposure and white balance processing can be carried out on the image to be processed according to tooth information in the tooth area, and better white balance and exposure compensation effects can be obtained.
The shooting prompting method of the embodiment extracts the white characteristic information from the mouth region, positions the tooth region according to the white characteristic information, judges whether the mouth region meets a second preset condition, judges that the current face is in a smiling tooth-exposing state when the mouth region meets the second preset condition, and performs exposure and white balance processing on an image to be processed according to the tooth information in the tooth region.
Optionally, in order to further improve the picture quality and improve the usability and feasibility of the present invention, in an embodiment of the present invention, as shown in fig. 3B, the shooting prompting method may include:
and S41, when the face is detected to be contained in the current shooting scene, positioning the mouth area in the face according to the face recognition technology.
And S42, judging whether the current face is in a smiling and tooth-exposing state according to the mouth region.
Specifically, in the embodiment of the present invention, the lip arc information in the mouth region may be extracted first, and then, whether the lip arc information satisfies the first preset condition may be determined, if so, it is determined that the current face is in the smiling tooth-exposing state, and if not, it is determined that the current face is not in the smiling tooth-exposing state.
And S43, when the current human face is judged to be in the smiling tooth-exposing state according to the mouth area, the photographing is normally operated.
And S44, when the current face is not in the smiling tooth-exposing state, further judging whether the current face is in the smiling tooth-exposing state according to the mouth region.
Specifically, in the embodiment of the present invention, a specific implementation manner of determining whether the current face is in the outcrook state according to the mouth region may be as follows: extracting feature information with white color from the mouth region, positioning the tooth region according to the feature information with white color, judging whether the tooth region meets a second preset condition, if so, judging that the current face is in the outoft smile state, and if not, judging that the current face is not in the outoft smile state.
And S45, when the current face is in the tooth exposing smile state, the photographing is normally operated.
And S46, when the current face is not in the outcrook smile state, generating prompt information for smiling the target shooting object, and providing the prompt information for the user.
Optionally, in an embodiment of the present invention, it may be further determined whether the current face is in the smiling state according to the mouth region, and if not, it may be further determined whether the current face is in the smiling non-smiling state according to the mouth region.
The shooting prompting method of the embodiment can prompt the user to shoot the scene by detecting that the current shooting scene contains the human face, the mouth area in the human face is positioned according to the human face recognition technology, whether the current human face is in a smiling and tooth-exposing state or not is judged according to the mouth area, when the current face is in the smiling tooth-exposing state, the photographing is normally operated, when the current face is not in the smiling tooth-exposing state, whether the current face is in the tooth-exposing smile state is further judged according to the mouth region, when the current face is in the outcroissant state, the photographing is normally operated, when the current face is not in the outcroissant state, the prompt information for smiling the target photographed object is generated, and the prompt information is provided for the user, so that the user can be reminded of smiling when the photographed person does not smile, the photographed person is ensured to be in a smiling state in the photo, the photo quality is further improved, and the usability and the feasibility of the method are improved.
In order to realize the embodiment, the invention further provides a shooting prompting device.
Fig. 4 is a schematic structural diagram of a shooting prompting device according to an embodiment of the present invention. As shown in fig. 4, the shooting presentation apparatus 40 includes: a location module 410, a determination module 420, a generation module 430, and a provision module 440. Wherein,
and the positioning module 410 is configured to, when it is detected that a face is included in the current shooting scene, position a mouth region in the face according to a face recognition technology.
The determining module 420 is configured to determine whether the current face is in a smiling state according to the mouth region.
Wherein the smile state includes a smile-like-teeth-exposed state and a tooth-exposed smile state.
And the generating module 430 is configured to generate prompt information for smiling the target photographic subject when the current face is not in a smiling state.
A providing module 440 for providing the prompt information to the user.
Optionally, in a possible implementation manner of the embodiment of the present invention, the providing module 440 is configured to display the prompt information in a shooting interface.
Optionally, in a possible implementation manner of the embodiment of the present invention, the providing module 440 is configured to provide the prompt information to the user in a voice broadcast manner.
It should be noted that the foregoing explanation of the embodiment of the shooting prompting method is also applicable to the shooting prompting device of the embodiment, and the implementation principle thereof is similar and will not be described herein again.
The shooting prompting device of the embodiment positions the mouth area in the face according to the face recognition technology when detecting that the current shooting scene contains the face, generates the prompting information for smiling the target shooting object when judging and knowing that the current face is not in a smiling state according to the mouth area, and provides the prompting information for the user. Therefore, the photographed person can be reminded of smiling when the photographed person does not smile, the photographed person is guaranteed to be in a smiling state in the photo, and the photo quality is improved.
Because smile can be laughing with the tooth-broken smile, also can be laughing with the tooth-broken smile, and the mouth characteristics of laughing with the tooth-broken smile are different, consequently, judge whether current people's face is in the mode of smile state also different according to the mouth region to, corresponding shooting suggestion device is also different.
Fig. 5 is a schematic structural diagram of a shooting prompting device according to another embodiment of the present invention. As shown in fig. 5, based on the embodiment shown in fig. 4, the determining module 420 may include:
a first extraction unit 4201, configured to extract lip arc information in the mouth region.
The first determining unit 4202 is configured to determine whether the lip arc information satisfies a first preset condition.
The first determining unit 4203 is configured to determine that the current face is in a smiling tooth-exposing state when the lip arc information satisfies a first preset condition.
It should be noted that the foregoing explanation of the embodiment of the shooting prompting method is also applicable to the shooting prompting device of the embodiment, and the implementation principle thereof is similar and will not be described herein again.
The shooting prompting method of the embodiment judges whether the lip arc line information meets a first preset condition or not by extracting the lip arc line information in the mouth region, judges that the current face is in a smiling tooth-sticking state when the first preset condition is met, can accurately recognize the expression of the current face, ensures that a photographed person is in a smiling state in a photo, and improves the photo quality.
Fig. 6 is a schematic structural diagram of a shooting prompting device according to yet another embodiment of the present invention. As shown in fig. 6, in addition to the embodiment shown in fig. 4, the shooting prompting apparatus 40 further includes:
and the processing module 450 is configured to, when it is determined that the current face is in the outcrop smiling state according to the mouth region, perform exposure and white balance processing on the image to be processed according to tooth information in the tooth region.
The determining module 420 may further include:
a second extraction unit 4211 is configured to extract feature information with white color from the mouth region.
The positioning unit 4212 is configured to position the tooth region according to the feature information that the color is white.
The second determining unit 4213 is configured to determine whether the tooth area is full of a second preset condition.
The second determination unit 4214 is configured to determine that the current face is in the outcrop smile state when the tooth region satisfies a second preset condition.
It should be noted that the foregoing explanation of the embodiment of the shooting prompting method is also applicable to the shooting prompting device of the embodiment, and the implementation principle thereof is similar and will not be described herein again.
The shooting prompt device of this embodiment, through extracting the color for white characteristic information in the mouth region, and be white characteristic information location tooth region according to the color, judge whether the mouth region satisfies the second preset condition, and conclude that current face is in laughing tooth state when the mouth region satisfies the second preset condition, and then according to the tooth information in the tooth region, treat that the image is exposed to the sun and the white balance is handled, can be at the expression of accurate discernment current face, when guaranteeing that the person of being shot is the smile state in the photo, obtain better white balance and exposure compensation effect, further improve photo quality.
In order to implement the above embodiments, the present invention further provides a terminal device.
Fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention. It should be noted that the terminal device in the embodiment of the present invention may be an electronic device with a camera, such as a smart phone, a tablet computer, a notebook computer, or a video camera. As shown in fig. 7, the terminal device 70 may include: a memory 71, a processor 72 and a computer program 73 stored on the memory 71 and operable on the processor 72, wherein when the processor 72 executes the computer program 73, the shooting prompting method described in the foregoing embodiment is implemented.
In order to implement the above embodiments, the present invention also proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the shooting prompting method described in the foregoing embodiments.
In order to implement the above embodiments, the present invention further provides a computer program product, wherein when instructions in the computer program product are executed by a processor, the computer program product executes a shooting prompting method, and the method comprises:
and S11', when the face is detected to be contained in the current shooting scene, positioning the mouth region in the face according to the face recognition technology.
And S12', judging whether the current face is in a smile state according to the mouth area.
And S13', if the current face is not in a smiling state, generating prompt information for smiling the target shooting object, and providing the prompt information for the user.
The computer program product of this embodiment executes instructions in the computer product through the processor, when it is detected that a current shooting scene includes a human face, locates a mouth region in the human face according to a human face recognition technology, determines, according to the mouth region, that the current human face is not in a smile state, generates prompt information for smiling a target shooting object, and provides the prompt information to a user. Therefore, the photographed person can be reminded of smiling when the photographed person does not smile, the photographed person is guaranteed to be in a smiling state in the photo, and the photo quality is improved.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (16)
1. A shooting prompting method is characterized by comprising the following steps:
when the fact that a face is contained in a current shooting scene is detected, a mouth area in the face is located according to a face recognition technology;
judging whether the current face is in a smiling state or not according to the mouth area;
and if the current face is not in a smiling state, generating prompt information for smiling the target shooting object, and providing the prompt information for the user.
2. The shooting prompting method according to claim 1, wherein the providing of the prompting information to the user includes:
and displaying the prompt information in a shooting interface.
3. The shooting prompting method according to claim 1, wherein the providing of the prompting information to the user includes:
and providing the prompt information for the user in a voice broadcasting mode.
4. The photography prompting method of claim 1, wherein the smile state includes a smile-lusterless state and a lusterless-smile state.
5. The method for prompting shooting as claimed in claim 4, wherein when the smile state is the smile tooth state, determining whether the current face is in the smile state according to the mouth region comprises:
extracting lip arc information in the mouth region;
judging whether the lip arc line information meets a first preset condition or not;
and if the lip arc information meets the first preset condition, judging that the current face is in a smiling and tooth-exposing state.
6. The shooting prompting method according to claim 4, wherein when the smile state is the outoft smile state, judging whether the current face is in the smile state according to the mouth region includes:
extracting feature information with white color from the mouth region, and positioning the tooth region according to the feature information with white color;
judging whether the tooth area meets a second preset condition or not;
and if the tooth area meets the second preset condition, judging that the current face is in a tooth exposing smile state.
7. The shooting prompting method according to claim 6, wherein when it is determined that the current face is in the outcrouch state according to the mouth region, the method further comprises:
and according to the tooth information in the tooth area, carrying out exposure and white balance processing on the image to be processed.
8. A shooting prompting device, comprising:
the positioning module is used for positioning a mouth region in a face according to a face recognition technology when the face is detected to be contained in a current shooting scene;
the judging module is used for judging whether the current face is in a smiling state according to the mouth area;
the generating module is used for generating prompt information for smiling a target shooting object when the current face is not in a smiling state;
and the providing module is used for providing the prompt information for the user.
9. The shooting prompt apparatus according to claim 8, wherein the providing module is specifically configured to:
and displaying the prompt information in a shooting interface.
10. The shooting prompt apparatus according to claim 8, wherein the providing module is specifically configured to:
and providing the prompt information for the user in a voice broadcasting mode.
11. The shooting prompting apparatus according to claim 8, wherein the smile state includes a smile-lusterless state and a lusterless-smile state.
12. The photographing prompting device of claim 11, wherein when the smile state is the smile tooth-not-exposed state, the determining module comprises:
a first extraction unit configured to extract lip arc information in the mouth region;
the first judging unit is used for judging whether the lip arc information meets a first preset condition or not;
and the first judging unit is used for judging that the current face is in a smiling tooth-exposing state when the lip arc information meets the first preset condition.
13. The shooting prompt apparatus according to claim 11, wherein when the smile state is the outcrouch state, the determining module includes:
a second extraction unit configured to extract feature information whose color is white from the mouth region;
the positioning unit is used for positioning the tooth area according to the characteristic information of which the color is white;
the second judging unit is used for judging whether the tooth area is full of a second preset condition or not;
and the second judging unit is used for judging that the current face is in the outcrop smile state when the tooth area meets the second preset condition.
14. The shooting prompting apparatus according to claim 13, further comprising:
and the processing module is used for carrying out exposure and white balance processing on the image to be processed according to the tooth information in the tooth area when the current face is judged to be in the tooth exposing smile state according to the mouth area.
15. A terminal device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the shooting prompting method according to any one of claims 1 to 7 when executing the program.
16. A non-transitory computer-readable storage medium on which a computer program is stored, the program, when executed by a processor, implementing the shooting prompting method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710458976.7A CN107301390A (en) | 2017-06-16 | 2017-06-16 | Shoot reminding method, device and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710458976.7A CN107301390A (en) | 2017-06-16 | 2017-06-16 | Shoot reminding method, device and terminal device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107301390A true CN107301390A (en) | 2017-10-27 |
Family
ID=60136354
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710458976.7A Pending CN107301390A (en) | 2017-06-16 | 2017-06-16 | Shoot reminding method, device and terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107301390A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995419A (en) * | 2017-11-24 | 2018-05-04 | 维沃移动通信有限公司 | One kind is taken pictures suggesting method, device and mobile terminal |
| CN108307120A (en) * | 2018-05-11 | 2018-07-20 | 优视科技有限公司 | Image capturing method, device and electric terminal |
| CN108388842A (en) * | 2018-01-31 | 2018-08-10 | 广东欧珀移动通信有限公司 | Intelligent prompt method and Related product |
| CN108509863A (en) * | 2018-03-09 | 2018-09-07 | 北京小米移动软件有限公司 | Information cuing method, device and electronic equipment |
| CN109151325A (en) * | 2018-10-26 | 2019-01-04 | 昆山亿趣信息技术研究院有限公司 | A kind of processing method and processing unit synthesizing smiling face |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101689303A (en) * | 2007-06-18 | 2010-03-31 | 佳能株式会社 | Facial expression recognition apparatus and method, and image capturing apparatus |
| US20110216217A1 (en) * | 2006-08-02 | 2011-09-08 | Sony Corporation | Image-capturing apparatus and method, expression evaluation apparatus, and program |
| CN102783136A (en) * | 2010-03-03 | 2012-11-14 | 伊斯曼柯达公司 | Imaging device for capturing self-portrait images |
| CN103098078A (en) * | 2010-09-13 | 2013-05-08 | 惠普发展公司，有限责任合伙企业 | Smile detection systems and methods |
| CN103369214A (en) * | 2012-03-30 | 2013-10-23 | 华晶科技股份有限公司 | An image acquiring method and an image acquiring apparatus |
| CN103458183A (en) * | 2007-07-27 | 2013-12-18 | 奥林巴斯映像株式会社 | Imaging apparatus and control method for the same |
| CN104144289A (en) * | 2013-05-10 | 2014-11-12 | 华为技术有限公司 | Photographing method and device |
-
2017
- 2017-06-16 CN CN201710458976.7A patent/CN107301390A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110216217A1 (en) * | 2006-08-02 | 2011-09-08 | Sony Corporation | Image-capturing apparatus and method, expression evaluation apparatus, and program |
| CN101689303A (en) * | 2007-06-18 | 2010-03-31 | 佳能株式会社 | Facial expression recognition apparatus and method, and image capturing apparatus |
| CN103458183A (en) * | 2007-07-27 | 2013-12-18 | 奥林巴斯映像株式会社 | Imaging apparatus and control method for the same |
| CN102783136A (en) * | 2010-03-03 | 2012-11-14 | 伊斯曼柯达公司 | Imaging device for capturing self-portrait images |
| CN103098078A (en) * | 2010-09-13 | 2013-05-08 | 惠普发展公司，有限责任合伙企业 | Smile detection systems and methods |
| CN103369214A (en) * | 2012-03-30 | 2013-10-23 | 华晶科技股份有限公司 | An image acquiring method and an image acquiring apparatus |
| CN104144289A (en) * | 2013-05-10 | 2014-11-12 | 华为技术有限公司 | Photographing method and device |
Non-Patent Citations (1)
| Title |
|---|
| FASHION摄影工作室: "《数码摄影完全自学手册》", 28 February 2009, 《北京：兵器工业出版社：北京科海电子出版社》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107995419A (en) * | 2017-11-24 | 2018-05-04 | 维沃移动通信有限公司 | One kind is taken pictures suggesting method, device and mobile terminal |
| CN107995419B (en) * | 2017-11-24 | 2019-10-15 | 维沃移动通信有限公司 | One kind is taken pictures suggesting method, device and mobile terminal |
| CN108388842A (en) * | 2018-01-31 | 2018-08-10 | 广东欧珀移动通信有限公司 | Intelligent prompt method and Related product |
| CN108509863A (en) * | 2018-03-09 | 2018-09-07 | 北京小米移动软件有限公司 | Information cuing method, device and electronic equipment |
| CN108307120A (en) * | 2018-05-11 | 2018-07-20 | 优视科技有限公司 | Image capturing method, device and electric terminal |
| WO2019214574A1 (en) * | 2018-05-11 | 2019-11-14 | 阿里巴巴集团控股有限公司 | Image capturing method and apparatus, and electronic terminal |
| CN109151325A (en) * | 2018-10-26 | 2019-01-04 | 昆山亿趣信息技术研究院有限公司 | A kind of processing method and processing unit synthesizing smiling face |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107301390A (en) | Shoot reminding method, device and terminal device | |
| JP4834725B2 (en) | Method and apparatus for incorporating iris color in red-eye correction | |
| JP6388673B2 (en) | Mobile terminal and imaging method thereof | |
| JP5089405B2 (en) | Image processing apparatus, image processing method, and imaging apparatus | |
| WO2019072190A1 (en) | Image processing method, electronic apparatus, and computer readable storage medium | |
| WO2019223292A1 (en) | Photographing angle determining method and apparatus, terminal, and readable storage medium | |
| US8334907B2 (en) | Photographing method and apparatus using face pose estimation of face | |
| CN107370961B (en) | Image exposure processing method, device and terminal device | |
| CN110569822A (en) | image processing method and device, electronic equipment and storage medium | |
| US20100053363A1 (en) | Photographing method and apparatus | |
| CN110620873B (en) | Device imaging method and device, storage medium and electronic device | |
| EP3761627B1 (en) | Image processing method and apparatus | |
| CN107463052B (en) | Shooting exposure method and device | |
| CN104539864B (en) | The method and apparatus for recording image | |
| US10666864B2 (en) | Image capturing apparatus and control method for image capturing apparatus | |
| CN110798627B (en) | Shooting method, shooting device, storage medium and terminal | |
| CN107426489A (en) | Processing method, device and terminal during shooting image | |
| CN112188091B (en) | Face information identification method and device, electronic equipment and storage medium | |
| CN111586280B (en) | Shooting method, shooting device, terminal and readable storage medium | |
| JP6370146B2 (en) | Image processing apparatus and control method thereof | |
| CN105227841A (en) | To take pictures reminding method and device | |
| CN111277754B (en) | Mobile terminal shooting method and device | |
| CN113315903B (en) | Image acquisition method and device, electronic equipment and storage medium | |
| CN114430456A (en) | Image capturing method, image capturing apparatus, and storage medium | |
| JP4781299B2 (en) | Image processing apparatus, image processing method, and imaging apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171027 |
|
| RJ01 | Rejection of invention patent application after publication |