CN112154656A - Shooting method and shooting equipment - Google Patents

Shooting method and shooting equipment Download PDF

Info

Publication number
CN112154656A
CN112154656A CN201980033879.0A CN201980033879A CN112154656A CN 112154656 A CN112154656 A CN 112154656A CN 201980033879 A CN201980033879 A CN 201980033879A CN 112154656 A CN112154656 A CN 112154656A
Authority
CN
China
Prior art keywords
target position
picture
shooting
photographing
photographic subject
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201980033879.0A
Other languages
Chinese (zh)
Other versions
CN112154656B (en
Inventor
林隽曦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of CN112154656A publication Critical patent/CN112154656A/en
Application granted granted Critical
Publication of CN112154656B publication Critical patent/CN112154656B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects

Abstract

A photographing method and a photographing apparatus, the photographing method comprising: identifying a shooting object in a picture; performing a trace operation: adjusting the posture of the shooting equipment to enable the shooting object to move to a target position in the picture; and sending out prompt information when the shooting object is not moved to the target position after the tracking operation, wherein the prompt information is used for guiding the shooting object to the target position.

Description

Shooting method and shooting equipment
Technical Field
The present disclosure relates to the field of shooting technologies, and in particular, to a shooting method and a shooting device.
Background
Portable equipment such as a holder, a holder camera and the like can adjust the posture of the camera, so that the content in the picture is changed, and the device is widely applied to scenes such as interviews and the like. Such a photographing apparatus generally has a tracking photographing function, and a photographic subject is located at a target position in a picture, as shown in fig. 1 (a). When the user tracks the photographing, the photographing object may move, or the photographing apparatus may shake, resulting in the photographing object not being at the target position. At this time, the photographing apparatus may be limited in the adjustment range of its posture, and cannot move the photographing object to the target position, so that the photographing object deviates from the target position, as shown in fig. 1 (b). Meanwhile, in the shooting process, the user usually does not always pay attention to the picture, and cannot pay attention to the position of the shooting object all the time. When the shooting object can not move to the target position, the user can not find and adjust the shooting object in time, so that the shooting effect is affected, the shooting quality is low, and the shot image can not be used.
BRIEF SUMMARY OF THE PRESENT DISCLOSURE
The present disclosure provides a photographing method, including:
identifying a shooting object in a picture;
performing a trace operation: adjusting the posture of the shooting equipment to enable the shooting object to move to a target position in the picture;
and sending out prompt information when the shooting object is not moved to the target position after the tracking operation, wherein the prompt information is used for guiding the shooting object to the target position.
The present disclosure also provides a photographing apparatus, including:
an image pickup unit configured to recognize a subject in a screen;
the cloud platform is used for executing a tracking operation: adjusting the posture of the image pickup part to enable the shooting object to move to the target position in the picture;
when the tracking operation is performed and the shooting object does not move to the target position, the shooting part sends out prompt information, and the prompt information is used for guiding the shooting object to the target position in the picture.
According to the technical scheme, the method has the following beneficial effects that:
when the shooting object cannot be moved to the target position due to the fact that the shooting object moves or the shooting equipment shakes and the shooting equipment is limited by the adjusting range of the posture of the shooting equipment, prompt information can be sent to a user, the user can be guided to move the shooting object to the target position through the prompt information, the user can move the shooting object to the target position timely and accurately, and therefore the shooting effect is guaranteed.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
fig. 1(a) shows a photographic subject located at a target position; fig. 1(b) shows that the photographic subject is deviated from the target position.
Fig. 2 is a flowchart of a shooting method according to an embodiment of the disclosure.
Fig. 3(a) shows a case where the photographic subject moves to the target position when the photographic subject is smaller than the target position; fig. 3(b) shows a case where the photographic subject moves to the target position when the photographic subject is larger than the target position; fig. 3(c) shows a case where the subject moves to the target position when the ratio of the subject to the subject at the overlapping portion of the subject and the target position exceeds the threshold value.
Fig. 4 is another flowchart of a photographing method according to an embodiment of the disclosure.
Fig. 5 shows a case where the photographic subject is not moved to the target position.
Fig. 6 shows a case where the photographing apparatus moves according to the hint information.
Fig. 7 shows the direction information.
FIG. 8(a) shows a picture of the person A speaking; FIG. 8(B) is a view showing a screen when the person B speaks; fig. 8(c) shows a case where the position between the a person and the B person is taken as the subject of photographing.
Fig. 9 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present disclosure.
Fig. 10 is another configuration diagram of the photographing apparatus according to the embodiment of the present disclosure.
Detailed Description
The technical solution of the present disclosure will be clearly and completely described below with reference to the embodiments and the drawings in the embodiments. It is to be understood that the described embodiments are merely illustrative of some, and not restrictive, of the embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
An embodiment of the present disclosure provides a photographing method for photographing a photographing target using a photographing apparatus. In the photographing method of the present embodiment, the photographing apparatus is an apparatus that can adjust the photographing field of view by a change in its own posture. As an example, the photographing apparatus may be a pan-tilt camera. Generally, the lens of the pan/tilt camera is mounted on the pan/tilt head, and the body simultaneously serves as a support or handle for supporting the pan/tilt head. The cloud platform is through the gesture that changes the camera lens to the adjustment is shot the field of vision. As another example, the photographing apparatus may also be a combination of a pan/tilt head and a camera. The camera is integrally installed on the cloud platform, and the cloud platform is through changing the holistic gesture of camera to the adjustment is shot the field of vision.
The shooting method of the embodiment, as shown in fig. 2, includes the following steps:
step S101: a photographic subject in a picture is identified.
Step S102: performing a trace operation: and adjusting the posture of the shooting equipment to enable the shooting object to move to a target position in the picture.
Step S103: and sending out prompt information when the shooting object is not moved to the target position after the tracking operation, wherein the prompt information is used for guiding the shooting object to the target position.
First, an application scenario of the present embodiment will be described. When a target is photographed by a photographing apparatus, if there is a definite subject, it is generally desirable to place the subject at an ideal position in a picture and perform tracking photographing so that the subject is more prominent and distinct to achieve a good photographing effect. For example, in an interview activity, an interviewee is taken as a shooting target, the face of the interviewee is generally taken as a shooting object, and the ideal position is generally the center position of a picture. Therefore, in the whole interviewing process, the face of the interviewee is always positioned in the center of the picture, the image of the interviewee is highlighted, and the shooting effect is good.
In step S101, the photographing apparatus recognizes a photographic subject in the screen. When the shooting device is in framing, the picture refers to a picture to be imaged, and the shooting device identifies a shooting object in the picture to be imaged. When the shooting device is shooting, the picture refers to a picture being imaged, and the shooting device identifies a shooting object in the picture being imaged.
In the present embodiment, the photographic subject generally refers to a partial area of a photographic subject, which is recognized by the photographing apparatus based on a piece of feature information. When a shooting target exists in the picture, for example, a person exists in the picture, and the feature information refers to face information of the person. During the shooting process, especially for the interview activity, the face of the interviewee is generally concerned, and other parts are not concerned objects, which may not appear in the picture or appear at the edge position of the picture. Therefore, the present embodiment takes the face of the person as a subject of shooting.
In step S102, the photographing apparatus performs a tracking operation. In the tracking operation, the posture of the photographing apparatus is changed to move the photographic subject to a target position in the screen.
The photographing apparatus generally has a plurality of photographing modes to cope with various photographing scenes, and the tracking mode is one of them. In the tracking mode, the posture of the shooting device is changed, so that the lens is aligned with the shot object, and the follow-up shooting of the shot object is realized. The photographing apparatus may be brought into the tracking mode in various ways, for example, by manual setting, voice-controlled triggering, and the like.
After entering the tracking mode, the photographing apparatus performs a tracking operation. Specifically, after recognizing the subject in step S101, the photographing apparatus detects a deviation of the subject from a target position, generates direction information from the target position to the subject based on the deviation, and moves the subject to the target position in the screen by changing its posture based on the direction information.
The target position can be determined according to a composition rule, wherein the composition rule is one of important factors influencing the shooting effect. The composition rule has various connotations, and for example, it may refer to a position of the photographic subject in the screen, that is, at which position in the screen the photographic subject is located. The composition rule may also refer to an angle of the photographic subject in the picture, i.e., at which angle the photographic apparatus photographs the photographic subject. The composition rule may also refer to the integrity of the photographic subject in the picture, i.e., the proportion of the portion of the photographic subject appearing in the picture.
The composition rule comprises the categories of balanced composition, symmetrical composition, diagonal composition, triangular composition, Sudoku composition and the like, and is specifically selected according to different shooting purposes and the desired shooting effect.
In this embodiment, the center position of the screen may be set as the target position. Therefore, the shot object is positioned at the center of the picture, so that the face of the interviewee is always positioned at the center of the picture in the shooting process, for example, in the interviewing process, the image of the interviewee is highlighted, and the shooting effect is good.
In this embodiment, the target position may be set in various ways. The target position may be a preset position, and the preset position is preset and stored in the shooting device. When the tracking operation is performed, the shooting device reads the preset position and sets the preset position as the target position, and the setting of the target position can be automatically completed. The target position may also be set manually. The user issues a target position instruction to the shooting equipment, and the shooting equipment receives the target position instruction and takes the position corresponding to the instruction as a target position. The target position command may be issued by a user in various ways, for example, through a key operation of the shooting device, through a touch screen operation of the shooting device, or through a voice control operation.
After the tracking operation is performed, different operations need to be performed according to whether the photographic subject has moved to the target position.
In the screen, the target position is usually identified by a graphic, such as a circle, a rectangle, or the like, and the area defined by the graphic represents the target position. The photographic subject usually occupies an area in the screen as well. There are various criteria for determining whether or not the photographic subject has moved to the target position, and in this embodiment, the determination is made based on the degree of coincidence between the photographic subject and the target position. When the proportion of the part of the shooting object, which is overlapped with the target position, exceeds a threshold value, the shooting object is considered to have moved to the target position, and otherwise, the shooting object is considered not to have moved to the target position. For example, whether the photographic subject is already completely within the graphic identifying the target position, or whether the photographic subject is already completely covering the graphic identifying the target position. As shown in FIG. 3, the target location is identified by a dashed rectangle. In fig. 3(a), the area of the photographic subject is smaller than that of the dotted rectangle, and if the photographic subject has completely entered the inside of the dotted rectangle, it is illustrated that the photographic subject has moved to the target position; as shown in fig. 3(b), the area of the photographic subject is larger than that of the dotted rectangle, and if the photographic subject completely covers the dotted rectangle, it also indicates that the photographic subject has moved to the target position. As shown in fig. 3(c), if the ratio of the subject to the target position overlapping the target position exceeds the threshold, the subject may be considered to have moved to the target position.
And then performing different operations according to whether the shooting object moves to the target position. As shown in fig. 4, the shooting method of the present embodiment further includes:
step S103': when the tracking operation is passed and the photographic subject has moved to the target position, the photographing apparatus starts or continues photographing the photographic subject.
Step S103' illustrates that the photographic subject can be moved to the target position only by the posture adjustment of the photographic apparatus itself. When the photographic subject moves to the target position, the photographic requirements have been satisfied. If the photographing apparatus is in the framing before, photographing of the subject can be started at this time. If the shooting device is in the shooting state, the shooting of the shooting object is continued. The tracking operation is continuously repeated in the whole shooting process to keep the shot object at the target position
In step S103, when the tracking operation is performed and the photographic subject does not move to the target position, a prompt message is issued, where the prompt message is used to guide the photographic subject to the target position.
Step S103 illustrates that the photographic subject cannot move to the target position only by the posture adjustment of the photographic apparatus itself. This may be caused by various factors, such as the attitude of the photographing apparatus being adjustable. The shooting equipment generally realizes attitude adjustment through the cloud platform, and the cloud platform can change the course angle, the pitch angle and the roll angle of camera lens or shooting equipment. The posture of the shooting equipment can be adjusted only within a certain range due to the rotation range of the holder. When the positional relationship between the photographing apparatus and the photographic subject is excessively different, the photographic subject cannot move to the target position even if the pan/tilt head has reached the limit of the rotation range. For example, in the case shown in fig. 1(b), the position of the subject is too high with respect to the target position, and the tracking operation in step S102 is first performed, in which the imaging device adjusts the posture, moves the screen upward, and the subject moves downward accordingly. When the shooting device moves to the limit of the upward direction, as shown in fig. 5, the shooting object still has no moving target position, and at this time, step S103 sends a prompt message, which prompts the user how to move the shooting object to the target position.
In this embodiment, the prompt message is an audible prompt, and the user is prompted by sending a voice prompt. The photographing apparatus detects a deviation of a photographing object from a target position, generates direction information of the target position to the photographing object based on the deviation, and broadcasts the direction information to a user. For example, in the case shown in fig. 5, the shooting object is deviated from the target position, and the shooting object is still located right above the target position, at this time, the voice prompt prompts the user that the shooting device should be moved right above, and the specific voice prompt content may be "please move the shooting device right above". After hearing the voice prompt, the user can move the shooting device to the right upper side, so that the shooting object in the picture moves to the right lower side, and the shooting object moves to the target position, as shown in fig. 6.
The above is only an exemplary illustration, and for step S102 and step S103, the direction information may include a plurality of directions besides the direction directly above, for example, as shown in fig. 7, further including: right below, right left, right, left above, left below, right above, right below. The shooting equipment can determine the direction information corresponding to the deviation according to the deviation between the shooting object and the target position, and prompts a user through voice prompt.
It should be noted that the above prompting process is a real-time dynamic process. When the user moves the shooting equipment, the shooting equipment continuously detects the deviation of the shooting object and the target position, determines the direction information corresponding to the latest deviation, and updates the direction information so as to move the shooting object to the target position.
In the present embodiment, when the user moves the photographing apparatus, the intensity of the voice guidance may be adjusted according to the distance between the photographing object and the target position. Specifically, when the distance between the shooting object and the target position is larger and larger, the volume of the voice prompt is increased, and conversely, the volume of the voice prompt is decreased, namely, the intensity of the voice prompt is proportional to the distance between the shooting object and the target position. Therefore, whether the moving direction is correct or not can be prompted to the user through the sound intensity. If the distance between the shooting object and the target position is larger and larger, the moving direction is wrong, and the user is prompted by large sound quantity at the moment. If the distance between the shooting object and the target position is smaller and smaller, the moving direction is correct, and the user is prompted through small volume. When the shooting object moves to the target position, the voice prompt can be turned off. Through the mode, the user can be guided more accurately, the shooting object can be moved to the target position more quickly, and the use convenience and efficiency are improved.
The above is only an exemplary illustration, and the prompt information of the present embodiment is not limited to the audible prompt, and may be a tactile prompt and a visual prompt, for example. The shooting equipment realizes the touch prompt for the user through vibration, and different direction information can be represented through different vibration frequencies and vibration times. Also, when the user moves the photographing apparatus, the intensity of the vibration may be adjusted according to the distance of the photographing object from the target position.
According to the shooting method, the human face is used as the shooting object, and the lips, the eyes, the nose and other parts can be used as the shooting object, so that a better shooting effect is achieved. Eyes in the picture can be recognized in various ways, for example, the eyes can be positioned by using the geometric features and the gray scale features of the eyes, or the eyes can be recognized by a pupil classifier, and the pupil classifier is obtained by machine learning. Similarly, there are various ways to identify the lips in the frame, for example, the lower half of the face in the vertical direction may be divided, and the left and right mouth corner points may be searched to locate the lips.
The present embodiment has been described above by taking an example of a part of a photographic subject being a person and a part of the photographic subject being a person, but the present disclosure is not limited thereto, and the photographic method of the present embodiment is applicable to any type of photographic subject and photographic subject.
When a user shoots with the shooting device, the shooting object may move, and the shooting device may shake, resulting in the shooting object not being at a target position. However, the user usually cannot always pay attention to the screen, and thus cannot always pay attention to the position of the subject. According to the shooting method, when the shooting object cannot be moved to the target position due to the fact that the shooting object moves or the shooting equipment shakes and the shooting equipment is limited by the adjustment range of the posture of the shooting equipment, prompt information can be sent to a user, the user can be guided to move the shooting object to the target position through the prompt information, the user can timely and accurately move the shooting object to the target position, and therefore the shooting effect is guaranteed.
For brevity, the same or similar features as those of the previous embodiment are not repeated, and only the features different from those of the previous embodiment are described below.
In step S101, when a plurality of shooting targets exist in the screen, for example, a plurality of persons exist in the screen, the feature information includes: face information and sound source location.
The photographing apparatus is provided with a plurality of sound sensors which receive the sound of a person speaking and detect the position of the person speaking, and the position of the person speaking is taken as the sound source position. Generally, a photographing apparatus includes at least three sound sensors, and a sound source position can be determined by trilateration or triangulation. The positions of the three sound sensors in the shooting equipment are dispersed as much as possible, so that the detection precision of the sound source position can be improved.
When a plurality of persons exist in the picture, the persons usually speak alternately, and the present embodiment takes the person who is speaking as the shooting target. This is particularly true in interviewing activities where multiple interviewees are present in a picture, which are often alternated to answer questions. In this case, the face information in the present embodiment includes a plurality of faces, and the photographic subject is recognized from the face located at the sound source position. Namely, the person who is speaking is taken as the shooting target, and the face of the person who is speaking is taken as the shooting target.
As shown in fig. 8(a), two characters a and B exist in the screen, and the a character is speaking. Two faces are recognized according to face information, the sound sensor receives the speaking sound of the person A, the detected sound source position is the position of the person A, and a shooting object is recognized from the face positioned at the sound source position, namely the face of the person A is used as the shooting object. As shown in fig. 8(B), when the a person does not speak and the B person starts speaking, the sound sensor receives the speech of the B person, the detected sound source position is the position of the B person, and the subject is recognized from the face located at the sound source position, that is, the face of the B person is the subject.
In the shooting method of the embodiment, when a plurality of persons exist in the picture, the positions among the faces can be used as shooting objects. As shown in fig. 8(c), when two persons a and B exist in the picture, the position between the faces of a and B is taken as the subject of photographing, and the position may be a position in the middle of the faces of a and B.
According to the shooting method, when a plurality of shooting targets exist in the picture, the shooting targets at the sound source positions or the positions among the shooting targets can be used as the shooting targets, especially for the interview activities, the phenomenon that when a plurality of interviewees exist in the picture, the shooting effect is influenced because the interviewees cannot be shot in a determined mode can be avoided, and therefore the shooting effect is further guaranteed.
The shooting equipment comprises a shooting part and a cloud platform, wherein the shooting part and the cloud platform are mechanically and electrically connected to form the shooting equipment.
The image pickup unit recognizes an object to be photographed on a screen.
The pan-tilt is used for executing a tracking operation: adjusting the posture of the camera part to enable the shooting object to move to a target position in the picture;
when the tracking operation is performed and the shooting object does not move to the target position, the shooting part sends out prompt information, and the prompt information is used for guiding the shooting object to the target position in the picture.
When the image pickup part is in framing, the picture refers to a picture to be imaged, and the image pickup part identifies a shooting object in the picture to be imaged. When the image pickup part is shooting, the picture refers to a picture which is imaging, and the image pickup part identifies a shooting object in the picture which is imaging.
In the present embodiment, when a shooting target exists in the image capturing section screen, for example, a person exists in the screen, the feature information is face information of the person. During the shooting process, especially for the interview activity, the face of the interviewee is generally concerned, and other parts are not concerned objects, which may not appear in the picture or appear at the edge position of the picture. Therefore, the imaging section of the present embodiment recognizes the subject as the face of the person.
The image pickup unit generally has a plurality of image pickup modes to cope with various image pickup scenes, and the tracking mode is one of them. In the tracking mode, the posture of the image pickup part is changed, so that the lens of the image pickup part is aligned with the shot object, and the follow-up shooting of the shot object is realized.
The camera shooting part is provided with input components such as keys, a touch screen and the like, and can enter a tracking mode through manual setting of the keys or the touch screen. The camera shooting part is also provided with a sound sensor, and can enter a tracking mode in a sound control triggering mode.
After entering the tracking mode, the image pickup section executes a tracking operation. Specifically, the imaging unit detects a deviation between the subject and the target position, and generates direction information from the target position to the subject based on the deviation. The pan/tilt head changes the posture of the image pickup unit based on the direction information, and moves the subject to be photographed to a target position on the screen.
The target position can be determined according to a composition rule, wherein the composition rule is one of important factors influencing the shooting effect. The composition rule has various connotations, and for example, it may refer to a position of the photographic subject in the screen, that is, at which position in the screen the photographic subject is located. The composition rule may also refer to an angle of the photographic subject in the picture, i.e., at which angle the photographic apparatus photographs the photographic subject. The composition rule may also refer to the integrity of the photographic subject in the picture, i.e., the proportion of the portion of the photographic subject appearing in the picture.
The composition rule comprises the categories of balanced composition, symmetrical composition, diagonal composition, triangular composition, Sudoku composition and the like, and is specifically selected according to different shooting purposes and the desired shooting effect.
In this embodiment, the center position of the screen may be set as the target position. Therefore, the shot object is positioned at the center of the picture, so that the face of the interviewee is always positioned at the center of the picture in the shooting process, for example, in the interviewing process, the image of the interviewee is highlighted, and the shooting effect is good.
In this embodiment, the target position may be set in various ways. The target position may be a preset position, and the preset position is preset and stored in the image capturing unit. When the tracking operation is performed, the camera shooting part reads the preset position and sets the preset position as the target position, and then the target position can be automatically set. The target position may also be set manually. A user issues a target position instruction to the camera shooting part through an input component such as a key or a touch screen, the camera shooting part receives the target position instruction, and the position corresponding to the instruction is used as a target position.
In the screen, the target position is usually identified by a graphic, such as a circle, a rectangle, or the like, and the area defined by the graphic represents the target position. The photographic subject usually occupies an area in the screen as well. There are various criteria for determining whether or not the photographic subject has moved to the target position, and in this embodiment, the determination is made based on the degree of coincidence between the photographic subject and the target position. When the proportion of the part of the shooting object, which is overlapped with the target position, exceeds a threshold value, the shooting object is considered to have moved to the target position, and otherwise, the shooting object is considered not to have moved to the target position. For example, whether the photographic subject is already completely within the graphic identifying the target position, or whether the photographic subject is already completely covering the graphic identifying the target position.
In the photographing apparatus of the embodiment, when the tracking operation is performed and the photographic subject has moved to the target position, the image pickup section starts or continues photographing the photographic subject.
In this case, the imaging target can be moved to the target position only by adjusting the posture of the imaging unit itself. When the photographic subject moves to the target position, the photographic requirements have been satisfied. If the image pickup section is in the framing state, the shooting of the shooting object can be started. If the image pickup section is already in the shooting state, the shooting of the shooting object is continued. And continuously executing tracking operation in the whole shooting process to keep the shot object at the target position.
When the shooting object does not move to the target position after the tracking operation, the shooting part sends out prompt information, and the prompt information is used for guiding the shooting object to the target position.
In this case, the imaging target cannot be moved to the target position only by the posture adjustment of the imaging unit itself. This may be caused by various factors, such as the posture of the image pickup section being adjustable. The tripod head can change the course angle, the pitch angle and the roll angle of the camera shooting part. Limited by the rotating range of the holder, the posture of the camera shooting part can be adjusted only within a certain range. When the positional relationship between the image pickup section and the photographic subject is excessively different, the photographic subject cannot move to the target position even if the pan/tilt head has reached the limit of the rotation range. At the moment, the camera shooting part sends out prompt information which prompts a user how to move the shooting object to the target position.
In this embodiment, the camera unit includes a speaker, the prompt is an audible prompt, and the speaker sends a voice prompt to remind the user. The imaging unit detects a deviation between the subject and the target position, generates direction information from the target position to the subject based on the deviation, and broadcasts the direction information to the user. For example, in the case shown in fig. 5, the shooting target is deviated from the target position, and the shooting target is still located right above the target position, and at this time, the voice prompt prompts the user to move the image pickup unit right above, and the specific voice prompt content may be "please move the image pickup unit right above". After hearing the voice prompt, the user can move the image pickup unit directly upward, so that the subject in the screen moves directly downward, and the subject moves to the target position, as shown in fig. 6.
The above is only an exemplary illustration, and the direction information may include a plurality of directions besides the direction directly above, for example, as shown in fig. 7, further including: right below, right left, right, left above, left below, right above, right below. The camera shooting part can determine direction information corresponding to deviation according to the deviation between the shooting object and the target position, and prompts a user through voice.
It should be noted that the above prompting process is a real-time dynamic process. When the user moves the shooting equipment, the shooting part continuously detects the deviation of the shooting object and the target position, determines the direction information corresponding to the latest deviation, and updates the direction information so as to move the shooting object to the target position.
In this embodiment, when the user moves the image pickup portion, the image pickup portion may adjust the volume of the speaker according to the distance between the subject and the target position. Specifically, when the distance between the shooting object and the target position is larger and larger, the volume of the loudspeaker is increased, and conversely, the volume of the loudspeaker is decreased, namely, the intensity of the voice prompt is proportional to the distance between the shooting object and the target position. Therefore, whether the moving direction is correct or not can be prompted to the user through the sound intensity. If the distance between the shooting object and the target position is larger and larger, the moving direction is wrong, and the user is prompted by large sound quantity at the moment. If the distance between the shooting object and the target position is smaller and smaller, the moving direction is correct, and the user is prompted through small volume. The image pickup section may also turn off the speaker when the photographic subject moves to the target position. Through the mode, the user can be guided more accurately, the shooting object can be moved to the target position more quickly, and the use convenience and efficiency are improved.
The above is only an exemplary illustration, and the prompt information of the present embodiment is not limited to the audible prompt, and may be a tactile prompt and a visual prompt, for example. The image pickup part is provided with a vibrator, the vibrator vibrates to realize tactile prompt for a user, and different direction information can be represented through different vibration frequencies and vibration times. Also, when the user moves the photographing apparatus, the intensity of the vibration may be adjusted according to the distance of the photographing object from the target position.
The shooting device of the embodiment can take the human face as the shooting object and the lips, the eyes, the nose and other parts as the shooting object so as to achieve a better shooting effect. Eyes in the picture can be recognized in various ways, for example, the eyes can be positioned by using the geometric features and the gray scale features of the eyes, or the eyes can be recognized by a pupil classifier, and the pupil classifier is obtained by machine learning. Similarly, there are various ways to identify the lips in the frame, for example, the lower half of the face in the vertical direction may be divided, and the left and right mouth corner points may be searched to locate the lips.
The present embodiment has been described above by taking an example in which the photographic target is a person and the photographic subject is a part of the person, but the present disclosure is not limited thereto, and the photographic apparatus of the present embodiment is applicable to any type of photographic target and photographic subject.
When a user takes a picture with the camera, the subject may move, and the camera may shake, resulting in the subject not being in a target position. However, the user usually cannot always pay attention to the screen, and thus cannot always pay attention to the position of the subject. According to the shooting device, when the shooting object cannot be moved to the target position due to the fact that the shooting object moves or shakes, and the shooting device is limited by the adjustment range of the posture of the shooting device, the shooting device can send prompt information to a user, the prompt information can guide the user to move the shooting object to the target position, the user can timely and accurately move the shooting object to the target position, and therefore the shooting effect is guaranteed.
In addition, the present embodiment does not limit the mechanical connection manner between the image pickup unit and the pan/tilt head. The shooting device of the embodiment may be a pan-tilt camera. As shown in fig. 9, in the pan/tilt/zoom camera, the body of the camera portion is also used as a holder or a handle of the pan/tilt, one end of the holder or the handle is connected to a stabilizing component of the pan/tilt, and the lens of the camera portion is mounted on the stabilizing component. The stability augmentation component comprises: a course shaft support, a pitch shaft support and a roll shaft support. The posture of the lens of the camera part is adjusted through the rotation of each support of the stability augmentation assembly, and the posture of the shooting equipment is adjusted. As shown in fig. 10, the camera portion and the pan/tilt head of the shooting apparatus of the present embodiment may also be separated, that is, the pan/tilt head includes a stability enhancement component and a support or a handle. The camera is integrally and detachably mounted on the stability augmentation component. The overall posture of the camera shooting part is adjusted through the rotation of each support of the stability augmentation assembly, and the posture of the shooting equipment is adjusted.
In this embodiment, the shooting device may also be an unmanned aerial vehicle. The unmanned aerial vehicle includes: unmanned aerial vehicle fuselage, camera shooting portion and cloud platform. The cloud platform install in the unmanned aerial vehicle fuselage, the portion of making a video recording is installed on the cloud platform.
For the sake of brief description, the same or similar features as those of the previous embodiment are not repeated, and only the features different from those of the previous embodiment are described below.
In the photographing apparatus of the embodiment, when a plurality of photographing targets exist in the picture, for example, a plurality of persons exist in the picture, the feature information includes: face information and sound source location.
The shooting equipment is also provided with a plurality of sound sensors, the sound sensors receive the voice of the person speaking, detect the position of the person speaking and use the position of the person speaking as the sound source position. Generally, as shown in fig. 9, a photographing apparatus includes three sound sensors, and a sound source position can be determined by trilateration or triangulation. The positions of the three sound sensors in the image pickup section should be dispersed as much as possible, so that the detection accuracy of the sound source position can be improved.
When a plurality of persons exist in the picture, the persons usually speak alternately, and the present embodiment takes the person who is speaking as the shooting target. This is particularly true in interviewing activities where multiple interviewees are present in a picture, which are often alternated to answer questions. In this case, the face information in the present embodiment includes a plurality of faces, and the photographic subject is recognized from the face located at the sound source position. Namely, the person who is speaking is taken as the shooting target, and the face of the person who is speaking is taken as the shooting target.
The photographing apparatus of the embodiment may further use, as a photographing object, a position between faces of a plurality of persons when the plurality of persons exist in the picture, where the position may be a position in the middle of the faces of the plurality of persons.
The shooting equipment of the embodiment can take the shooting target at the sound source position or the position between the shooting targets as the shooting target when a plurality of shooting targets exist in the picture, and particularly for the interview activities, can avoid the influence on the shooting effect caused by incapability of determining which interviewee is shot when a plurality of interviewees exist in the picture, thereby further ensuring the shooting effect.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present disclosure, and not for limiting the same; while the present disclosure has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; features in embodiments of the disclosure may be combined arbitrarily, without conflict; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present disclosure.

Claims (42)

1. A photographing method, characterized by comprising:
identifying a shooting object in a picture;
performing a trace operation: adjusting the posture of the shooting equipment to enable the shooting object to move to a target position in the picture;
and sending out prompt information when the shooting object is not moved to the target position after the tracking operation, wherein the prompt information is used for guiding the shooting object to the target position.
2. The photographing method according to claim 1, wherein the photographic subject is identified based on feature information.
3. The photographing method according to claim 2, wherein the feature information includes at least one of: face information, sound source position.
4. The photographing method according to claim 3, wherein when the face information includes a face, the photographic subject is recognized from the face.
5. The photographing method according to claim 3, wherein when the face information includes a plurality of faces, the photographic subject is recognized from the faces located at the sound source position.
6. The photographing method according to claim 3, wherein when the face information includes a plurality of faces, a position between the plurality of faces is taken as the photographing object.
7. The photographing method according to any one of claims 1 to 6, wherein the photographing object includes: at least one of a face, lips, eyes, nose.
8. The photographing method according to claim 1, further comprising: and automatically setting a preset position as the target position.
9. The photographing method according to claim 1, further comprising:
receiving a target position instruction;
and taking the position corresponding to the target position instruction as the target position.
10. The photographing method according to claim 1, 8 or 9, wherein the target position is determined according to a composition rule.
11. The photographing method of claim 10, wherein the composition rule includes at least one of: the position of the shooting object in the picture, the angle of the shooting object in the picture and the integrity of the shooting object in the picture.
12. The photographing method according to claim 10, wherein the target position is a center position of the picture.
13. The photographing method according to claim 1, wherein the prompt information takes at least one of the following forms: auditory cues, tactile cues, visual cues.
14. The photographing method according to claim 13, wherein the prompt information includes: and direction information from the target position to the photographic subject.
15. The photographing method according to claim 1, wherein in the tracking operation, the photographic subject moves to the target position in the screen according to direction information of the target position to the photographic subject.
16. The photographing method according to claim 14 or 15, wherein the direction information is updated according to a relative position of the photographic subject and the target position during the movement.
17. The photographing method according to claim 13, wherein the intensity of the cue information is proportional to a distance of the photographing object from the target position.
18. The photographing method according to claim 1, wherein the picture is a picture to be imaged or a picture being imaged.
19. The photographing method according to claim 18, wherein when the picture is a picture to be imaged, the photographing method further comprises:
and starting to image the shooting object after the shooting object moves to the target position in the picture to be imaged.
20. A photographing apparatus, characterized by comprising:
an image pickup unit configured to recognize a subject in a screen;
the cloud platform is used for executing a tracking operation: adjusting the posture of the camera part to enable the shooting object to move to a target position in the picture;
when the tracking operation is performed and the shooting object does not move to the target position, the shooting part sends out prompt information, and the prompt information is used for guiding the shooting object to the target position in the picture.
21. The photographing apparatus according to claim 20, wherein the image pickup section recognizes the photographic subject based on feature information.
22. The photographing apparatus of claim 21, wherein the feature information includes at least one of: face information, sound source position.
23. The photographing apparatus according to claim 22, wherein when the face information includes a face, the image pickup section recognizes the photographic subject from the face.
24. The photographing apparatus according to claim 22, wherein when the face information includes a plurality of faces, the image pickup section recognizes the photographic subject from the face at the sound source position.
25. The photographing apparatus according to claim 22, wherein when the face information includes a plurality of faces, the image pickup section takes a position between the plurality of faces as the photographing object.
26. The photographing apparatus according to claim 20, wherein the photographing section automatically sets a preset position as the target position.
27. The imaging apparatus according to claim 20, wherein the imaging section receives a target position instruction, and takes a position corresponding to the target position instruction as the target position.
28. The photographing apparatus of claim 20, 26 or 27, wherein the target position is determined according to a composition rule.
29. The camera of claim 28, wherein the composition rule comprises at least one of: the position of the shooting object in the picture, the angle of the shooting object in the picture and the integrity of the shooting object in the picture.
30. The photographing apparatus of claim 28, wherein the target position is a center position of the picture.
31. The camera device of claim 20, wherein the reminder information takes the form of at least one of: auditory cues, tactile cues, visual cues.
32. The photographing apparatus of claim 31, wherein the prompt information includes: and direction information from the target position to the photographic subject.
33. The photographing apparatus according to claim 20, wherein in the tracking operation, the photographic subject moves to the target position in the screen according to direction information of the target position to the photographic subject.
34. The photographing apparatus according to claim 32 or 33, wherein the image pickup section updates the direction information according to a relative position of the photographic subject and the target position in the course of the movement.
35. The photographing apparatus of claim 31, wherein an intensity of the hint information is proportional to a distance of the photographing object from the target position.
36. The photographing apparatus of claim 20, wherein the picture is a picture to be imaged or a picture being imaged.
37. The photographing apparatus according to claim 36, wherein the image pickup section starts imaging the photographic subject after the picture is a picture to be imaged and the photographic subject moves to the target position in the picture to be imaged.
38. The camera of claim 20, wherein the camera is a pan-tilt camera.
39. The camera apparatus of claim 38, wherein the lens of the camera portion is mounted to the stability-enhancing component of the pan/tilt head, and the body of the camera portion simultaneously serves as a support or a handle of the pan/tilt head, and one end of the support or the handle is connected to the stability-enhancing component of the pan/tilt head.
40. The photographing apparatus according to claim 20, wherein the image pickup section includes: a body and a lens; the camera lens is installed on the fuselage, the fuselage install in on the cloud platform.
41. The camera device of claim 20, wherein the camera device is a drone.
42. The camera device of claim 41, wherein the drone further comprises: an unmanned aerial vehicle body; the cloud platform install in the unmanned aerial vehicle fuselage.
CN201980033879.0A 2019-09-25 2019-09-25 Shooting method and shooting equipment Active CN112154656B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/107831 WO2021056260A1 (en) 2019-09-25 2019-09-25 Photographing method and photographing device

Publications (2)

Publication Number Publication Date
CN112154656A true CN112154656A (en) 2020-12-29
CN112154656B CN112154656B (en) 2022-10-11

Family

ID=73891976

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980033879.0A Active CN112154656B (en) 2019-09-25 2019-09-25 Shooting method and shooting equipment

Country Status (2)

Country Link
CN (1) CN112154656B (en)
WO (1) WO2021056260A1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1658655A (en) * 2005-01-13 2005-08-24 上海交通大学 Digital camera with auto-shoot tracking position and prompting function
US20080062267A1 (en) * 2006-09-13 2008-03-13 Fujitsu Limited Photographic system
CN103533226A (en) * 2013-06-07 2014-01-22 Tcl集团股份有限公司 Shooting method and system with voice prompt function
CN103618851A (en) * 2013-11-08 2014-03-05 杨睿琦 Self-photographing method and terminal
CN108122343A (en) * 2018-02-12 2018-06-05 广州市华标科技发展有限公司 Exempt from touching formula intelligent self-service license capture apparatus and method
CN108702458A (en) * 2017-11-30 2018-10-23 深圳市大疆创新科技有限公司 Image pickup method and device
CN108737717A (en) * 2018-03-21 2018-11-02 北京猎户星空科技有限公司 Image pickup method, device, smart machine and storage medium
CN109981964A (en) * 2017-12-27 2019-07-05 深圳市优必选科技有限公司 Image pickup method, filming apparatus and robot based on robot
WO2019140686A1 (en) * 2018-01-22 2019-07-25 深圳市大疆创新科技有限公司 Following control method, control terminal, and unmanned aerial vehicle
CN110113532A (en) * 2019-05-08 2019-08-09 努比亚技术有限公司 A kind of filming control method, terminal and computer readable storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1658655A (en) * 2005-01-13 2005-08-24 上海交通大学 Digital camera with auto-shoot tracking position and prompting function
US20080062267A1 (en) * 2006-09-13 2008-03-13 Fujitsu Limited Photographic system
CN103533226A (en) * 2013-06-07 2014-01-22 Tcl集团股份有限公司 Shooting method and system with voice prompt function
CN103618851A (en) * 2013-11-08 2014-03-05 杨睿琦 Self-photographing method and terminal
CN108702458A (en) * 2017-11-30 2018-10-23 深圳市大疆创新科技有限公司 Image pickup method and device
CN109981964A (en) * 2017-12-27 2019-07-05 深圳市优必选科技有限公司 Image pickup method, filming apparatus and robot based on robot
WO2019140686A1 (en) * 2018-01-22 2019-07-25 深圳市大疆创新科技有限公司 Following control method, control terminal, and unmanned aerial vehicle
CN108122343A (en) * 2018-02-12 2018-06-05 广州市华标科技发展有限公司 Exempt from touching formula intelligent self-service license capture apparatus and method
CN108737717A (en) * 2018-03-21 2018-11-02 北京猎户星空科技有限公司 Image pickup method, device, smart machine and storage medium
CN110113532A (en) * 2019-05-08 2019-08-09 努比亚技术有限公司 A kind of filming control method, terminal and computer readable storage medium

Also Published As

Publication number Publication date
CN112154656B (en) 2022-10-11
WO2021056260A1 (en) 2021-04-01

Similar Documents

Publication Publication Date Title
US10609273B2 (en) Image pickup device and method of tracking subject thereof
US11210796B2 (en) Imaging method and imaging control apparatus
CN106131413B (en) Shooting equipment and control method thereof
US9210324B2 (en) Image processing
CN108881724B (en) Image acquisition method, device, equipment and storage medium
US11812132B2 (en) Imaging device, control method therefor, and recording medium
WO2015080954A1 (en) Shift camera focus based on speaker position
EP2753064A1 (en) Apparatus and method for photographing portrait in portable terminal having camera
US11265477B2 (en) Image capturing apparatus and non-transitory recording medium
CN108702458B (en) Shooting method and device
US20190304081A1 (en) Arrangement for generating head related transfer function filters
US11457139B2 (en) Photography method, electronic device, and storage medium
US11503213B2 (en) Image capturing apparatus, control method, and recording medium
US20200329202A1 (en) Image capturing apparatus, control method, and recording medium
CN112738388B (en) Photographing processing method and system, electronic device and storage medium
CN111182280A (en) Projection method, projection device, sound box equipment and storage medium
WO2022141271A1 (en) Control method and control device for platform system, platform system, and storage medium
CN114615429A (en) Gesture recognition method, gesture recognition system, shooting terminal, shooting system and storage medium
CN112154656B (en) Shooting method and shooting equipment
CN106064383A (en) The white wall localization method of a kind of intelligent robot projection and robot
US11245830B2 (en) Image capture apparatus and control method for same, and storage medium
CN113747011A (en) Auxiliary shooting method and device, electronic equipment and medium
US11758260B1 (en) Electronic device with automatic camera selection based on eye gaze direction
US11889178B2 (en) Electronic device with automatic eye gaze tracking and camera adjustment
JP4934871B2 (en) Shooting support system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant