CN113170050A - Image acquisition method, electronic equipment and mobile equipment - Google Patents

Image acquisition method, electronic equipment and mobile equipment Download PDF

Info

Publication number
CN113170050A
CN113170050A CN202080006208.8A CN202080006208A CN113170050A CN 113170050 A CN113170050 A CN 113170050A CN 202080006208 A CN202080006208 A CN 202080006208A CN 113170050 A CN113170050 A CN 113170050A
Authority
CN
China
Prior art keywords
image
pose
target object
person
head
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080006208.8A
Other languages
Chinese (zh)
Inventor
朱超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Publication of CN113170050A publication Critical patent/CN113170050A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

An image acquisition method comprising: acquiring a first image; identifying a pose of a target object in the first image; adjusting and acquiring working parameters of a second image based on the pose of the target object in the first image; and acquiring a second image according to the adjusted working parameters so that the pose of the target object in the second image meets the preset condition.

Description

Image acquisition method, electronic equipment and mobile equipment
Technical Field
The present disclosure relates to the field of image processing, and in particular, to an image acquisition method, an electronic device, and a mobile device.
Background
With the explosion of digital technology and network technology, cameras have become an important tool and means for recording segments of life. For example, a certificate photo or a photo sticker is one of the scenes where cameras are used that is of great importance. However, the requirements of the certificate photo on image quality and specification are high, and the certificate photo shooting is limited by shooting sites and shooting equipment. For example, a professional single lens reflex camera is required, a special flash lamp, a flash lamp holder, blue, white and red background cloth and the like are required, the shooting process is very complicated, and the user experience is influenced. For example, in a camera use scene with simple and crude shooting conditions, short shooting time and high repeated shooting difficulty, the pose of a target object in an image may not completely meet the composition requirement, and the imaging effect may also be affected.
Disclosure of Invention
In view of this, the embodiment of the present disclosure provides an image acquisition method, an electronic device, and a mobile device, which can adjust a working parameter of a camera by identifying a pose of a target object in an image, so that the pose of the target object in the image acquired by the adjusted camera meets a composition requirement, and the pose of the target object does not need to be preset, so that the operation is convenient, and the experience of a user in an imaging process is improved.
In a first aspect, an embodiment of the present disclosure provides an image obtaining method, including: acquiring a first image; identifying a pose of a target object in the first image; adjusting and acquiring working parameters of a second image based on the pose of the target object in the first image; and acquiring a second image according to the adjusted working parameters so that the pose of the target object in the second image meets the preset condition.
In some embodiments of the present disclosure, the target object comprises a person.
In some embodiments of the present disclosure, the identifying a pose of a target object in the first image comprises: a pose of a shoulder of a person in the first image is identified.
In some embodiments of the present disclosure, the pose of the target object in the second image satisfies a preset condition, including: the shoulder reference line of the person in the second image is parallel to a preset reference line.
In some embodiments of the present disclosure, the identifying a pose of a target object in the first image comprises: identifying the position of the head and shoulders of the person in the first image;
in some embodiments of the present disclosure, the pose of the target object in the second image satisfies a preset condition, including: the head and shoulders of the person in the second image are located in a central region of the second image.
In some embodiments of the present disclosure, the identifying a pose of a target object in the first image comprises: a ratio between a size of a person in the first image and a size of the first image is identified.
In some embodiments of the present disclosure, the adjusting the working parameter when the second image is acquired so that the pose of the target object in the second image satisfies the preset condition and the pose of the target object in the second image satisfies the preset condition includes: the angle of field at the time of acquiring the second image is adjusted so that a ratio between the size of the person in the image at the time of acquiring the second image and the size of the second image satisfies a threshold.
In some embodiments of the present disclosure, the acquiring the second image with the adjusted operating parameter includes: and responding to a user instruction, and acquiring a second image according to the adjusted working parameters.
In some embodiments of the disclosure, the user instructions include at least one of: a user operation instruction; a user voice instruction; and (5) user behavior instructions.
In some embodiments of the present disclosure, the acquiring the second image with the adjusted operating parameter includes: and acquiring a second image according to the adjusted working parameters in response to the acquisition condition being met.
In some embodiments of the present disclosure, the satisfying of the acquisition condition includes at least one of: the preset time duration is met; and the pose of the target object in the second image meets a preset condition.
In some embodiments of the present disclosure, the method further comprises: processing the second image; and storing the processed image.
In some embodiments of the present disclosure, the method further comprises: processing the second image; and displaying the processed image.
In some embodiments of the disclosure, the processing the second image comprises at least one of: processing the face of the person in the second image; rendering the background in the second image; or correcting the inclination angle of the head of the person in the second image with respect to the shoulders.
In some embodiments of the disclosure, the correcting the inclination angle of the head of the person in the second image with respect to the shoulders includes: determining an included angle between a symmetry line of the head and a datum line of the shoulder; adjusting the pose of the head based on the included angle to correct the angle of inclination of the head relative to the shoulder.
In some embodiments of the present disclosure, the method further comprises: displaying the second image and the processing progress in the process of processing the second image; and responding to the completion of the processing, storing the processed image and displaying the stored image.
In some embodiments of the present disclosure, the method further comprises: determining whether a target object is contained in the first image; and outputting prompt information when the first image does not contain the target object.
In a second aspect, an embodiment of the present disclosure provides an electronic device including an image acquisition apparatus, a processor, and a controller. The image acquisition device is used for acquiring images. The processor is connected with the image acquisition device and used for identifying the pose of the target object in the first image acquired by the image acquisition device and determining the working parameters when the image acquisition device acquires the second image based on the pose of the target object in the first image. The controller is connected with the processor and the image acquisition device, and is used for controlling the image acquisition device to acquire a second image according to the adjusted working parameters, so that the pose of the target object in the second image meets the preset condition.
In a third aspect, an embodiment of the present disclosure provides a mobile device, including an image capturing apparatus, a cradle head, a processor, and a controller. The image acquisition device is used for acquiring images. The holder is used for fixing the image acquisition device. The processor is connected with the image acquisition device and used for identifying the pose of the target object in the first image acquired by the image acquisition device and determining the working parameters when the image acquisition device acquires the second image based on the pose of the target object in the first image. The controller is connected with the processor and the cloud deck, and the controller is used for adjusting the position and the attitude of the cloud deck so that the image acquisition device acquires the second image according to the adjusted working parameters, and the position and the attitude of the target object in the second image meet the preset conditions.
In a fourth aspect, an embodiment of the present disclosure provides a computer system, including: one or more processors; a computer readable storage medium storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement a method as described above.
In a fifth aspect, embodiments of the present disclosure provide a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to implement a method as described above.
In a sixth aspect, the disclosed embodiments provide a computer program product comprising computer readable instructions, wherein the computer readable instructions, when executed, are configured to perform the method as described above.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the disclosure without limiting the disclosure. In the drawings:
fig. 1 schematically illustrates an application scenario of an image acquisition method according to an embodiment of the present disclosure;
FIG. 2 schematically illustrates a flow chart of an image acquisition method of an embodiment of the present disclosure;
3A-3D schematically illustrate diagrams of embodiments of the present disclosure for enabling the pose of a target object in an image to satisfy a preset condition;
FIG. 4 schematically illustrates a flow chart of an image acquisition method according to another embodiment of the present disclosure;
FIG. 5 schematically illustrates a block diagram of an electronic device of an embodiment of the disclosure;
FIG. 6 schematically illustrates a block diagram of a removable device of an embodiment of the disclosure; and
FIG. 7 schematically illustrates a block diagram of a computer system of an embodiment of the disclosure.
Detailed Description
For the purpose of promoting a better understanding of the objects, aspects and advantages of the present disclosure, reference is made to the following detailed description taken in conjunction with the accompanying drawings.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
The embodiment of the disclosure provides an image acquisition method, which includes acquiring a first image through an image acquisition device, and identifying the pose of a target object in the first image. Then, the working parameters of the image acquisition device when acquiring the second image are adjusted based on the pose of the target object in the first image. And controlling the image acquisition device to acquire the second image according to the adjusted working parameters so that the pose of the target object in the second image meets the preset condition, thereby realizing that the second image directly acquired can meet the user requirement, avoiding the complex operation brought by the prior photographing and post-processing in the related technology and improving the user experience.
Fig. 1 schematically illustrates an application scenario 100 of the image acquisition method of the embodiment of the present disclosure.
As shown in fig. 1, an application scenario 100 according to an embodiment of the present disclosure may include an electronic device 110 and a pan-tilt 120.
According to an embodiment of the present disclosure, the electronic device 110 may include an image acquisition apparatus. For example, the electronic device 110 may be a camera including a camera, a smartphone, a tablet computer, and so forth.
In the disclosed embodiment, the image capture device of electronic device 110 may be used to capture images that include user 130.
According to the embodiment of the present disclosure, the holder 120 may be used to change the operating parameters of the image capturing device of the electronic device 110.
For example, the electronic device 110 may be removably connected to the pan/tilt head 120. For example, the cradle head 120 may be disposed outside the electronic device 110 for fixing the electronic device 110. The electronic device 110 may be used to control the spatial layout (attitude) of the pan/tilt head 120. For example, the electronic device 110 may send a control signal to the holder 120 to control the holder 120 to change the posture of the three degrees of freedom, so as to drive the electronic device 110 to change the posture, and to adjust the operating parameters of the image capturing apparatus of the electronic device 110.
For another example, the cradle head 120 may be disposed inside the electronic device 110. For example, the pan/tilt head 120 may be directly connected to the image capture device inside the electronic device. The electronic device 110 can control the holder 120 to change the posture of the internal image capturing device while keeping itself still, thereby adjusting the operating parameters of the image capturing device of the electronic device 110.
According to the embodiment of the disclosure, the first image containing the user 130 may be acquired by the image acquisition device of the electronic device 110. The processor of the electronic device 110 may identify the pose of the user 130 in the captured first image and determine the operating parameters of the image capture apparatus based on the pose of the user 130. Then, the pan/tilt head 120 is controlled to change the attitude in three degrees of freedom to adjust the operating parameters of the image capturing apparatus. The image capturing device can capture the second image according to the adjusted working parameters, so that the purpose that the directly obtained second image can meet the requirement of the user 130 can be achieved. The image acquisition method provided by the embodiment of the disclosure is convenient to operate, can directly capture the image meeting the needs of the user, avoids the problem that the pose of the target object needs to be adjusted for many times during shooting in the related technology, or the complicated process of shooting the stored image first and then adjusting the image is needed, and improves the user experience.
It should be noted that fig. 1 is only an example of an application scenario in which the image acquisition method of the embodiment of the present disclosure may be applied to help a person skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiment of the present disclosure may not be applied to other devices, systems, environments or scenarios.
Fig. 2 schematically shows a flowchart of an image acquisition method of an embodiment of the present disclosure.
As shown in fig. 2, the method includes operations S201 to S204.
In operation S201, a first image is acquired.
According to the embodiment of the present disclosure, acquiring the first image may be, for example, acquiring the first image by an image acquisition device of the electronic device. For example, the first image may be acquired by an image sensor of the camera.
In the embodiment of the present disclosure, acquiring the first image may be, for example, turning on an image sensor and acquiring an image, and the process may not perform an image saving operation. Acquiring the first image may also be acquiring a pre-stored first image. The first image may be a real scene, or a scene virtualized by artificial intelligence or the like.
According to the embodiment of the disclosure, in response to receiving a starting instruction of a user, the image acquisition device of the electronic equipment is switched to a working state, and the acquired image is acquired and displayed so that the user can preview the image.
In the embodiment of the present disclosure, the acquired first image may be identified, whether the first image includes the target object may be determined, and in the case where the first image does not include the target object, the operation may be paused or terminated, or a prompt message may be output. For example, whether or not a person is included in the acquired image may be recognized, and if not, prompt information may be output. The prompt information may be used to prompt the user that no image of the user can be obtained in the current viewing range, and ask the user to move to the current viewing range. If the first image contains a person, the subsequent operation can be continuously executed.
In operation S202, a pose of the target object in the first image is identified.
According to an embodiment of the present disclosure, the target object may be, for example, a person. For example, when a person is recognized in the first image, the recognized person is the target object. For another example, when a plurality of persons are recognized in the first image, a person satisfying the condition may be selected as the target object. The satisfaction condition may be, for example, a person selected by the person for the user, or a proportion satisfaction condition of the person, or the like.
In an embodiment of the present disclosure, identifying the pose of the target object in the first image may be identifying the pose of the shoulder of the person in the first image. For example, the inclination angle between the shoulder reference line of the person and the preset reference line may be identified. For example, a head-shoulder level detection algorithm may be executed by an ISP (Image Signal Processing) chip to identify the inclination angle of the shoulder reference line with respect to the horizontal line of the Image sensor. It is understood that the embodiment of the present disclosure does not limit the algorithm of the shoulder reference line, and the setting may be performed by a person skilled in the art according to practical situations, for example, the shoulder reference line may be a connecting line between the highest points of the shoulders on both sides, and the like.
In another embodiment of the present disclosure, identifying the pose of the target object in the first image may also be identifying the position of the head and shoulders of the person in the first image. For example, the offset distance of the head and shoulders of the person with respect to the center position of the image may be identified. For example, the head and shoulder detection algorithm may be run by the ISP chip to detect the position of the head and shoulder in the image viewing range. It is understood that the embodiments of the present disclosure do not limit the specific algorithm for head and shoulder detection, and those skilled in the art can set the algorithm according to actual situations, for example, the position of the shoulder can be directly determined by detecting the position of the head, and the like.
In yet another embodiment of the present disclosure, identifying the pose of the target object in the first image may also be identifying a ratio between the size of the person in the first image and the size of the first image. For example, the ratio between the area occupied by a person and the area of an image may be identified. Alternatively, the ratio between the width/height of the person and the width/height of the image may also be identified.
The embodiment of the disclosure can identify whether the pose of the user in the first image meets the requirement of the certificate photo through the method described above or other methods.
In operation S203, the working parameters when the second image is acquired are adjusted based on the pose of the target object in the first image.
According to the embodiment of the disclosure, the working parameters of the image acquisition device can be adjusted based on the pose of the target object in the first image. For example, internal and/or external parameters of the image capture device may be adjusted. For example, the pose of the image acquisition device in three degrees of freedom may be adjusted. Or the focal length, exposure time, etc. of the image acquisition device may be adjusted.
In an embodiment of the present disclosure, the working parameters of the image capturing device when capturing the second image may be adjusted based on the posture of the shoulder of the person in the first image, so that the shoulder reference line of the person in the second image is parallel to the preset reference line.
For example, as shown in FIG. 3A, the image capture device 330 may capture the first image 310 at the original operating parameters. It is recognized that there is an inclination angle between the shoulder reference line L1 of the person in the first image 310 and the horizontal line L2 of the image capturing apparatus 330. The image capturing device 330 may be controlled to rotate by a first angle with respect to the z-axis based on the tilt angle so that the shoulder reference line L1 of the person in the second image 320 captured by the image capturing device 330 after the adjustment is parallel to the horizontal line L2 of the image capturing device 330.
In another embodiment of the present disclosure, the operating parameters of the image capturing device when capturing the second image may be adjusted based on the position of the head and shoulders of the person in the first image, such that the head and shoulders of the person in the second image are located in the center region of the second image.
For example, as shown in FIG. 3B, the image capture device 330 may capture the first image 330 at the original operating parameters. The offset distance of the person's head and shoulders in the first image 330 relative to the image center position is identified. The image capture device 330 may be controlled to rotate a second angle with respect to the x-axis and a third angle with respect to the y-axis based on the offset distance such that the head and shoulders of the person in the second image 340 captured by the adjusted image capture device 330 are located within the central region of the image.
In still another embodiment of the present disclosure, the operation parameter when the image capturing apparatus captures the second image may be adjusted based on a ratio between a size of a person in the first image and a size of the first image so that the ratio between the size of the person in the image at the time of capturing the second image and the size of the second image satisfies a threshold.
For example, as shown in FIG. 3C, the image capture device 330 may capture a first image 350 at the original operating parameters. A ratio between the area of the person in the first image 350 and the area of the first image is identified. The field angle of the image capturing device 330 may be adjusted based on the ratio, for example, the adjustment of the field angle of the image capturing device 330 may be achieved by changing the focal length of the image capturing device 330. So that the ratio between the area of the person in the second image 330 acquired by the adjusted image acquisition device 330 and the area of the second image satisfies the threshold. It is understood that the threshold of the embodiment of the present disclosure may be, for example, a threshold range, and the ratio between the area of the person in the second image 330 acquired by the adjusted image acquisition device and the area of the second image should be higher than the lowest threshold and lower than the highest threshold.
The embodiment of the present disclosure does not limit the adjustment sequence of each operating parameter of the image capturing device, and those skilled in the art can set the adjustment sequence according to actual needs. For example, the working parameter corresponding to the threshold value may be adjusted to make the ratio between the size of the person in the second image and the size of the second image satisfy, the working parameter to make the head and the shoulder of the person in the second image located in the central area of the second image may be adjusted, and the working parameter to make the shoulder reference line of the person in the second image parallel to the preset reference line may be adjusted.
According to the embodiment of the present disclosure, the adjusting of the operating parameter when the second image is acquired may be further performing stretching processing on the acquired second image by the image acquisition device to scale up or down the original image. Alternatively, the acquired second image may be distorted to adjust for the proportion of the original image that is distorted proportionally, e.g., when the user's shoulders are not balanced or symmetrical, the distortion may be adjusted. Alternatively, the acquired second image may also be subjected to a cropping process to crop a portion of the original image, or the like.
In operation S204, a second image is acquired with the adjusted working parameters, so that the pose of the target object in the second image satisfies a preset condition.
According to an embodiment of the present disclosure, the second image may be captured with the adjusted operating parameter in response to a user instruction. The user instructions may include at least one of user operation instructions, user voice instructions, or user behavior instructions. For example, the user may control the image acquisition device to capture the second image through a key. Alternatively, the user may control the image capturing device to capture the second image by issuing a voice instruction of "take a picture". Alternatively, the user may control the image capturing device to capture the second image through a specific gesture.
According to the embodiment of the present disclosure, the second image may also be acquired with the adjusted operating parameter in response to the acquisition condition being satisfied. The satisfying of the acquisition condition may include at least one of satisfying a preset duration or the pose of the target object in the second image having satisfied the preset condition. For example, a duration from the current time to the target object entering the shooting mode may be detected, and if the duration reaches a duration threshold, the image acquisition device may be controlled to capture the second image. Alternatively, it may be detected whether the pose of the person in the image acquired by the image acquisition device has met the requirements of the identification photo, and if so, the image acquisition device may be controlled to capture the second image.
In the embodiment of the present disclosure, the acquired second image may also be processed.
In an embodiment of the present disclosure, the face of the person in the second image may be processed. For example, the face of the person in the second image is treated with buffing, whitening, spot removal, acne removal, face thinning, or highlighting.
In another embodiment of the present disclosure, the rendering process may be further performed on the background in the second image. For example, the background in the second image, excluding the person, is rendered based on a background color selected by the user or determined from the identification photograph scene or default. Alternatively, the second image is rendered based on a filter selected by the user or determined from the identification photo scene or by default.
In still another embodiment of the present disclosure, the inclination angle of the head of the person in the second image with respect to the shoulder may also be corrected. For example, an angle between a line of symmetry of the head of the person and a reference line of the shoulder is determined, and the pose of the head is adjusted based on the angle to correct the inclination angle of the head with respect to the shoulder.
For example, as shown in fig. 3D, it is possible to recognize an angle between the line of symmetry L3 of the head of the person and the reference line L1 of the shoulder, and in the case where the angle exceeds a threshold range (for example, 85 degrees to 95 degrees), the inclination angle of the head with respect to the shoulder is corrected so that the angle between the corrected line of symmetry L3 of the head and the reference line L1 of the shoulder satisfies the threshold range.
According to the embodiment of the disclosure, the second image before processing and the current processing progress can be displayed in the process of processing the second image. For example, a second image acquired in response to a user instruction may be presented, and the current progress of processing the second image may be presented in the form of a floating window. For example, the presentation may be in the form of a progress bar.
According to the embodiment of the present disclosure, in response to completion of processing, the processed image may be stored and the stored image may be displayed.
The embodiment of the disclosure may acquire the image in the acquisition mode in real time by the image acquisition device, but does not perform the storage. For example, a first image may be acquired by the image acquisition device in an acquisition mode, and the operating parameters of the image acquisition device may be adjusted based on the pose of the target object in the first image, and the image acquisition device may then acquire a second image with the adjusted operating parameters, such that the shoulder reference line of the person in the second image may be parallel to the preset reference line, and/or the head and shoulders may be located in a central region, and/or the person size ratio may be eligible. The image acquisition device and the image acquisition method can display the acquired image to the user in a preview mode, and the user can instruct the image acquisition device to shoot and capture the current image according to the preview effect. The embodiment of the disclosure can further process the captured image, for example, correct the head and shoulder inclination angle, and/or make a beautiful look, and/or render a background, etc., and store and display the processed image to the user. Compared with the prior art that the pose of the target object needs to be adjusted for many times to meet the composition requirement, or the target object needs to be shot by the user and then guided into the application program for post-processing, the complicated process of repeated operation of the user is simplified, the user can directly shoot and obtain the desired image, and the user experience is improved.
Fig. 4 schematically shows a flow chart of an image acquisition method according to another embodiment of the present disclosure.
As shown in fig. 4, the method includes operations S401 to S415.
In operation S401, a camera is started.
According to the embodiment of the disclosure, the user can control the camera to start through the starting instruction. For example, in a handheld pan-tilt camera scenario, a user may start the camera by pressing a power-on key.
In the embodiment of the present disclosure, after the camera is started, a User may preview a viewfinder image of the camera through a GUI (Graphical User Interface) built in the camera or an external application APP.
In operation S402, the GUI or APP selects a certificate mode.
According to the embodiment of the present disclosure, the user may perform the operation of mode selection through the GUI or the APP. For example, the shooting mode of the camera may be selected as a certified shooting mode.
In operation S403, the pan/tilt head is rotated to a self-portrait position.
According to the embodiment of the disclosure, when the shooting mode of the camera is switched to the identification photo mode, the cradle head can enter the identification photo shooting mode. For example, the Yaw axis (Yaw axis) of the pan/tilt head may be controlled to rotate 180 ° into a self-portrait state with the viewing range of the camera facing the user.
In operation S404, face recognition and head-shoulder recognition are turned on.
According to the embodiment of the disclosure, the face recognition and head and shoulder detection algorithms can be operated through the ISP chip of the camera, and the positions of the face and the head and shoulder in the view finding range can be detected.
In the embodiment of the present disclosure, if a face is not detected, the user may be prompted on a GUI or APP. For example, the "identification photo mode needs to place the face in the viewing range" and other prompting contents. In the embodiment of the disclosure, if the movement of the face or the head and the shoulder is detected, the holder can be controlled to adjust and track the face or the head and the shoulder, so that the face and the head and the shoulder are kept in the view finding range.
In operation S405, the face and shoulder ROI regions are locked.
According to the embodiment Of the present disclosure, a rectangular roi (region Of interest) region may be formed according to the positions Of the detected face and the head and shoulder in the viewing range.
In operation S406, the pan/tilt head adjusts the posture so that the head and the shoulder are centered and horizontal.
According to the embodiment of the present disclosure, the ISP chip of the camera may run a head-shoulder level detection algorithm for the ROI region, and identify an inclination angle of the shoulder reference line with respect to the horizontal line of the image sensor of the camera, a positional difference of the head-shoulder with respect to the center point of the finder range, and an inclination angle of the head with respect to the shoulder. And then sending an instruction to the tripod head to inform an MCU (Microcontroller Unit) of the tripod head to drive a motor to control a Yaw axis (Yaw), a Roll axis (Roll) and a Pitch axis (Pitch) to adjust the posture, and particularly, controlling the Roll axis (Roll) to eliminate the inclination angle of a shoulder datum line relative to the horizontal line of an image sensor of the camera, so that the shoulder datum line is parallel to the horizontal line of the image sensor of the camera, and eliminate the position difference of a head shoulder relative to the central point of a view range, so that the head shoulder is in the central area of the view range, and thus, the effect that the head shoulder of a person in the acquired image is centered and horizontal is realized. In operation S407, the face is beautified.
According to the embodiment of the disclosure, the face beautifying algorithm can be operated through the ISP chip of the camera, the portrait face beautifying mode is entered, and the treatments of skin grinding, skin beautifying, spot removing, acne removing, highlight and the like are carried out on the face in the acquired image.
In operation S408, the optical zoom or the digital zoom adjusts the viewing range.
According to the embodiment of the disclosure, optical zooming or digital zooming can be performed according to the ratio of the size of the ROI to the size of the viewing range, so that the imaging size of the head and the shoulder meets the requirement of the identification photo.
In operation S409, a background color or a filter is selected.
According to the embodiment of the disclosure, a user can select a desired background color and a filter through GUI or APP according to a previewable real-time certificate photo effect on an LCD of the handheld pan-tilt camera. The background color may include, for example, a background color such as white, blue, or red. The filters may include, for example, borders, rendering or animal morphology filters, and the like.
In operation S410, photographing is started.
According to the embodiment of the present disclosure, photographing may be started in response to the user pressing the shutter key. The ISP chip can acquire the raw image in rggb format from the image sensor, and form a rough certificate photo YUV image after a series of filtering processing and format conversion processing.
In operation S411, a head-shoulder area is cut according to the head-shoulder frame position.
According to the embodiment of the disclosure, the head and the shoulder in the YUV image can be cut out, and the inclination angle of the head relative to the shoulder is eliminated through a head correction algorithm.
Or when the detected inclination angle of the head relative to the shoulder is larger than a certain range, the head of the user is prompted to be incorrect in real time on the LCD, so that the user can move the head position according to the prompt information on the LCD, and the inclination angle of the head relative to the shoulder is eliminated.
In operation S412, the non-head-shoulder area performs background rendering.
According to the embodiment of the present disclosure, the rendering process may be performed on the background area other than the head-shoulder area according to the background color and the filter selected by the user in operation S409.
In operation S413, the ISP generates a photograph.
According to the embodiment of the disclosure, the ISP chip can carry out Jpeg coding on the rendered YUV image to generate a photo.
In operation S414, the photograph is stored.
According to the embodiment of the disclosure, the generated photos can be stored in a storage device such as an SD card.
In operation S415, the LCD or APP displays that the photographing is completed.
According to the embodiment of the disclosure, the shooting completion animation can be displayed on the LCD or the APP of the camera, and can be used for playing back, previewing and downloading the certificate photo through the GUI and the APP.
It is to be understood that the application of the above-mentioned image acquisition method to a handheld pan-tilt camera is only an exemplary embodiment of the present disclosure, and the present disclosure is not limited thereto, and the above-mentioned image acquisition method may also be applied to a mobile phone, a motion camera, or other electronic devices.
The image acquisition method disclosed by the embodiment of the invention can use image processing algorithms such as face detection, head and shoulder detection, pan-tilt tracking, pan-tilt leveling, optical zooming or digital zooming, portrait beautifying, intelligent cutting, background rendering and the like, and is integrated in a camera chip, so that a small household camera or mobile phone commonly used can have the capability of taking a certificate photo or a photo sticker, the portrait is processed in real time in the shooting process, post-processing is not needed, the intelligent degree is high, one-key film forming and intelligent shooting are realized, the shooting complexity and the post-processing professional degree are greatly reduced, the shooting time is greatly shortened, and the shooting experience of a user is improved.
Fig. 5 schematically shows a block diagram of an electronic device 500 of an embodiment of the disclosure.
As shown in fig. 5, an electronic device 500 of an embodiment of the present disclosure may include an image acquisition apparatus 510, a processor 520, and a controller 530.
Image capture device 510 may be used to capture images.
Processor 520 may be configured to identify the pose of the target object in the first image captured by image capture device 510 and determine the operating parameters of image capture device 510 when capturing the second image based on the pose of the target object in the first image.
The controller 530 may be configured to control the image capturing device 510 to capture the second image with the adjusted operating parameters, so that the pose of the target object in the second image satisfies the preset condition.
According to the embodiment of the present disclosure, the electronic device 500 may be various electronic devices having an image capturing apparatus, such as a camera, a mobile phone, and a tablet computer. The electronic device 500 may be provided with an image acquisition apparatus 510, a processor 520, and a controller 530. Processor 520 may be coupled to image capture device 510. For example, processor 520 may capture an image captured by image capture device 510. Controller 530 may be coupled to processor 520 and image capture device 510. For example, controller 530 may receive control instructions from processor 520 and control adjustments to the operating parameters of image capture device 510 based on the control instructions.
According to the disclosed embodiment, the image capturing device 510 may be, for example, various camera assemblies capable of capturing images. For example, it may be an image sensor or the like.
The processor 520 may be, for example, a general purpose processor CPU, an image processor GPU, an image signal processing unit ISP chip, or the like, of various processors 520 according to the embodiments of the present disclosure. For example, when the electronic device 500 is a camera, the processor 520 may be an ISP chip or other processing module of the camera. For another example, when the electronic device 500 is a smartphone, the processor 520 may also be a CPU or other processing module of the smartphone.
According to an embodiment of the present disclosure, the target object may include a person.
According to an embodiment of the present disclosure, identifying a pose of a target object in a first image includes: a pose of a shoulder of the person in the first image is identified.
According to the embodiment of the disclosure, the pose of the target object in the second image satisfies a preset condition, including: the shoulder reference line of the person in the second image is parallel to the preset reference line.
According to an embodiment of the present disclosure, identifying a pose of a target object in a first image includes: the positions of the head and shoulders of the person in the first image are identified.
According to the embodiment of the disclosure, the pose of the target object in the second image satisfies a preset condition, including: the head and shoulders of the person in the second image are located in a central region of the second image.
According to an embodiment of the present disclosure, identifying a pose of a target object in a first image includes: a ratio between a size of a person in the first image and a size of the first image is identified.
According to the embodiment of the present disclosure, controlling the image obtaining apparatus to obtain the second image according to the adjusted working parameter, so that the pose of the target object in the second image satisfies the preset condition, and the pose of the target object in the second image satisfies the preset condition includes: and adjusting the angle of view when the second image is acquired by the image acquisition device so that the ratio between the size of the person in the image and the size of the second image when the second image is acquired satisfies a threshold value.
According to the embodiment of the present disclosure, acquiring the second image according to the adjusted working parameter includes: and responding to a user instruction, and acquiring a second image according to the adjusted working parameters.
According to an embodiment of the disclosure, the user instructions include at least one of: a user operation instruction, a user voice instruction, or a user behavior instruction.
According to the embodiment of the present disclosure, acquiring the second image according to the adjusted working parameter includes: and acquiring a second image according to the adjusted working parameters in response to the acquisition condition being met.
According to the embodiment of the present disclosure, the obtaining condition is satisfied, including at least one of: the preset time length is met or the pose of the target object in the second image meets the preset condition.
Processor 520 is also configured to process the second image according to an embodiment of the disclosure. The electronic device 500 further includes: and the memory is used for storing the processed image.
Processor 520 is also configured to process the second image according to an embodiment of the disclosure. The electronic device 500 further includes: and the display device is used for displaying the processed image. The presentation device may be, for example, various presentation devices such as an LCD, LED, GUI, ink screen, or projector. For example, when the electronic device 500 is a camera, the display device may be a GUI of the camera or a display screen of the external APP. For another example, when the electronic device 500 is a smart phone, the display device may be a display screen of the smart phone.
According to an embodiment of the disclosure, the processing of the second image comprises at least one of: processing the face of the person in the second image, rendering the background in the second image, or correcting the inclination angle of the head of the person in the second image with respect to the shoulders.
According to an embodiment of the present disclosure, correcting an inclination angle of a head of a person in a second image with respect to a shoulder includes: and determining an included angle between the symmetry line of the head and the reference line of the shoulder, and adjusting the pose of the head based on the included angle to correct the inclination angle of the head relative to the shoulder.
According to the embodiment of the disclosure, the display device is further used for displaying the second image and the processing progress in the process of processing the second image. The memory is also for storing the processed image in response to completion of the processing. The presentation device is also used for presenting the processed image stored in the memory.
According to the embodiment of the disclosure, the processor is further configured to determine whether the first image contains the target object, and in a case that the first image does not contain the target object, output the prompt information. For example, the prompt message is output through the presentation device.
The electronic device 500 in the disclosed embodiment is integrated with an image acquisition apparatus 510, a processor 520, and a controller 530. The processor 520 may use image processing algorithms such as face detection, head and shoulder detection, pan and tilt tracking, pan and tilt leveling, optical or digital zooming, portrait beautifying, smart clipping, background rendering, etc., and be integrated inside the electronic device, so that a control instruction may be sent to the controller 530 based on the pose of the person in the first image acquired by the image acquisition device 510. The controller 530 may control the image capturing apparatus 510 to adjust the operating parameters, so that the adjusted image capturing apparatus 510 may directly capture an image satisfying a preset condition. Make electronic equipment 500 possess certificate photograph or sticker shooting ability, carry out real-time processing to the portrait at the shooting in-process, need not the aftertreatment, intelligent degree is high, and a key becomes the piece, and intelligent shooting shoots, shoots complexity and aftertreatment professional degree also greatly reduced, and the shooting time shortens greatly, improves the user and shoots experience and feels.
FIG. 6 schematically illustrates a block diagram of a removable device 600 of an embodiment of the disclosure.
As shown in fig. 6, the removable device 600 may include an image capture apparatus 610, a pan and tilt head 620, a processor 630, and a controller 640.
According to an embodiment of the present disclosure, the removable device 600 may be a camera including a camera, a smartphone, a tablet computer, or the like.
In an embodiment of the present disclosure, the movable device 600 may be, for example, a handheld pan-tilt camera. For example, the movable device 600 may include two parts, a camera and a pan/tilt head, to which the camera may be detachably connected. Within the camera may be provided an image acquisition device 610 (e.g., an image sensor) and a process 630 (e.g., an ISP chip). The cradle head may have a controller 640 disposed therein. For example, the pan/tilt head may be disposed outside the camera for fixing the camera. The processor 630 of the camera may send a control signal to the controller 640 of the pan/tilt head (e.g., the MCU of the pan/tilt head), and the controller 640 may drive the motor to control the pan/tilt head to adjust the attitude in the three axes of Yaw axis (Yaw), Roll axis (Roll) and Pitch axis (Pitch), so as to drive the camera to adjust the working parameters.
In another embodiment of the present disclosure, the removable device 600 may be, for example, a smartphone. For example, the movable apparatus 600 may be internally provided with an image acquisition device 610, a pan and tilt head 620, a processor 630, and a controller 640. For example, the head may be directly internally connected to the image acquisition means of the mobile device. The movable equipment can control the holder to change the posture of the image acquisition device in the movable equipment under the condition that the movable equipment is kept still.
Image capture device 610 may be used to capture images.
The pan/tilt head 620 may be used to secure the image capture device 610.
Processor 630 is coupled to image capture device 610. The processor 630 may be configured to identify a pose of the target object in the first image captured by the image capture device 610, and determine an operating parameter for the image capture device 610 in capturing the second image based on the pose of the target object in the first image.
Controller 640 is coupled to processor 630 and pan/tilt head 620. The controller 640 may be configured to adjust the pose of the pan/tilt head 620, so that the image capturing apparatus 610 captures the second image according to the adjusted operating parameters, so that the pose of the target object in the second image satisfies the preset condition.
According to an embodiment of the present disclosure, the target object includes a person.
According to an embodiment of the present disclosure, identifying a pose of a target object in the first image includes: a pose of a shoulder of a person in the first image is identified.
According to the embodiment of the present disclosure, adjusting the pose of the pan/tilt head to enable the image capturing device to capture the second image according to the adjusted working parameter includes: and controlling the holder to rotate by a first angle relative to the first axis so that the shoulder datum line of the person in the second image is parallel to a preset reference line.
According to an embodiment of the present disclosure, identifying a pose of a target object in the first image includes: the positions of the head and shoulders of the person in the first image are identified.
According to the embodiment of the present disclosure, adjusting the pose of the pan/tilt head to enable the image capturing device to capture the second image according to the adjusted working parameter includes: and controlling the holder to rotate by a second angle relative to the second axis and a third angle relative to the third axis so that the head and the shoulders of the person in the second image are positioned in the central area of the second image.
According to an embodiment of the present disclosure, identifying a pose of a target object in the first image includes: a ratio between a size of a person in the first image and a size of the first image is identified.
According to the embodiment of the present disclosure, controlling the image obtaining device to obtain the second image according to the adjusted working parameter includes: and adjusting the angle of view when the second image is acquired by the image acquisition device so that the ratio between the size of the person in the image and the size of the second image when the second image is acquired satisfies a threshold value.
According to the embodiment of the present disclosure, acquiring the second image according to the adjusted working parameter includes: and responding to a user instruction, and acquiring a second image according to the adjusted working parameters.
According to an embodiment of the disclosure, the user instructions include at least one of: user operation instructions, user voice instructions, or user behavior instructions.
According to the embodiment of the present disclosure, acquiring the second image according to the adjusted working parameter includes: and acquiring a second image according to the adjusted working parameters in response to the acquisition condition being met.
According to the embodiment of the present disclosure, the obtaining condition is satisfied, including at least one of: and meeting a preset time or enabling the pose of the target object in the second image to meet a preset condition.
Processor 630 is also configured to process the second image according to an embodiment of the present disclosure. The removable device 600 further comprises: and the memory is used for storing the processed image.
Processor 630 is also configured to process the second image according to an embodiment of the present disclosure. The removable device 600 further comprises: and the display device is used for displaying the processed image.
The presentation device may be, for example, various presentation devices such as an LCD, LED, GUI, ink screen, or projector. For example, when the electronic device 500 is a camera, the display device may be a GUI of the camera or a display screen of the external APP. For another example, when the electronic device 500 is a smart phone, the display device may be a display screen of the smart phone.
According to an embodiment of the disclosure, the processing of the second image comprises at least one of: processing the face of the person in the second image, rendering the background in the second image, or correcting the inclination angle of the head of the person in the second image with respect to the shoulders.
According to an embodiment of the present disclosure, correcting an inclination angle of a head of a person in a second image with respect to a shoulder includes: and determining an included angle between the symmetry line of the head and the reference line of the shoulder, and adjusting the pose of the head based on the included angle to correct the inclination angle of the head relative to the shoulder.
According to the embodiment of the disclosure, the display device is further used for displaying the second image and the processing progress in the process of processing the second image. The memory is also for storing the processed image in response to completion of the processing. The presentation device is also used for presenting the processed image stored in the memory.
According to the embodiment of the disclosure, the processor is further configured to determine whether the first image contains the target object, and in a case that the first image does not contain the target object, output the prompt information. For example, the prompt message is output through the presentation device.
The mobile device 600 in the disclosed embodiment is integrated with an image acquisition apparatus 610, a pan-tilt 620, a processor 630, and a controller 640. The processor 630 may use image processing algorithms such as face detection, head and shoulder detection, pan and tilt tracking, pan and tilt leveling, optical or digital zooming, portrait beautifying, smart clipping, background rendering, and the like, and be integrated inside the electronic device, so that a control instruction may be sent to the controller 640 based on the pose of the person in the first image acquired by the image acquisition device 610. The controller 640 may drive the motor to control the pan/tilt head 620 to adjust the attitude in the three axes of the Yaw axis (Yaw), the Roll axis (Roll), and the Pitch axis (Pitch), so as to drive the image capturing device 610 to adjust the working parameters, so that the adjusted image capturing device 610 may directly capture the image meeting the preset conditions. The mobile device 600 is enabled to have the capability of taking a certificate photo or a photo sticker, the image is processed in real time in the shooting process, post-processing is not needed, the intelligent degree is high, one key is used for forming a photo, intelligent shooting is achieved, the shooting complexity and the post-processing professional degree are greatly reduced, the shooting time is greatly shortened, and the shooting experience of a user is improved.
Fig. 7 schematically illustrates a block diagram of a computer system 700 of an embodiment of the disclosure. The computer system illustrated in FIG. 7 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure.
As shown in fig. 7, an electronic device 700 according to an embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. The processor 701 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 701 may also include on-board memory for caching purposes. The processor 701 may comprise a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
In the RAM703, various programs and data necessary for the operation of the system 700 are stored. The processor 701, the ROM 702, and the RAM703 are connected to each other by a bus 704. The processor 701 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 702 and/or the RAM 703. It is noted that the programs may also be stored in one or more memories other than the ROM 702 and RAM 703. The processor 701 may also perform various operations of method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to an embodiment of the present disclosure, the system 700 may also include an input/output (I/O) interface 705, the input/output (I/O) interface 705 also being connected to the bus 704. The system 700 may also include one or more of the following components connected to the I/O interface 705: an input portion 706 including a keyboard, a mouse, and the like; an output section 707 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. A drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read out therefrom is mounted into the storage section 708 as necessary.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711. The computer program, when executed by the processor 701, performs the above-described functions defined in the system of the embodiment of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. Examples may include, but are not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 702 and/or the RAM703 and/or one or more memories other than the ROM 702 and the RAM703 described above.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims (57)

1. An image acquisition method comprising:
acquiring a first image;
identifying a pose of a target object in the first image;
adjusting and acquiring working parameters of a second image based on the pose of the target object in the first image; and
and acquiring a second image according to the adjusted working parameters so that the pose of the target object in the second image meets the preset condition.
2. The method of claim 1, wherein the target object comprises a human figure.
3. The method of claim 2, wherein the identifying the pose of the target object in the first image comprises:
a pose of a shoulder of a person in the first image is identified.
4. The method according to claim 3, wherein the pose of the target object in the second image satisfies a preset condition, including:
the shoulder reference line of the person in the second image is parallel to a preset reference line.
5. The method of claim 2, wherein the identifying the pose of the target object in the first image comprises:
the positions of the head and shoulders of the person in the first image are identified.
6. The method of claim 5, wherein the pose of the target object in the second image satisfies a preset condition, comprising:
the head and shoulders of the person in the second image are located in a central region of the second image.
7. The method of claim 2, wherein the identifying the pose of the target object in the first image comprises:
a ratio between a size of a person in the first image and a size of the first image is identified.
8. The method of claim 7, wherein the adjusting the operating parameters when the second image is acquired so that the pose of the target object in the second image satisfies the preset conditions comprises:
the angle of field at the time of acquiring the second image is adjusted so that a ratio between the size of the person in the image at the time of acquiring the second image and the size of the second image satisfies a threshold.
9. The method of claim 1, wherein said acquiring a second image at the adjusted operating parameters comprises:
and responding to a user instruction, and acquiring a second image according to the adjusted working parameters.
10. The method of claim 9, wherein the user instruction comprises at least one of:
a user operation instruction;
a user voice instruction;
and (5) user behavior instructions.
11. The method of claim 1, wherein said acquiring a second image at the adjusted operating parameters comprises:
and acquiring a second image according to the adjusted working parameters in response to the acquisition condition being met.
12. The method of claim 11, wherein the satisfying an acquisition condition comprises at least one of:
the preset time duration is met;
and the pose of the target object in the second image meets a preset condition.
13. The method of claim 1, further comprising:
processing the second image; and
and storing the processed image.
14. The method of claim 1, further comprising:
processing the second image; and
and displaying the processed image.
15. The method of claim 13 or 14, wherein the processing of the second image comprises at least one of:
processing the face of the person in the second image;
rendering the background in the second image; or
Correcting an inclination angle of the head of the person in the second image with respect to the shoulders.
16. The method of claim 15, wherein the correcting the angle of inclination of the head of the person in the second image relative to the shoulders comprises:
determining an included angle between a symmetry line of the head and a datum line of the shoulder;
adjusting the pose of the head based on the included angle to correct the angle of inclination of the head relative to the shoulder.
17. The method of claim 13 or 14, further comprising:
displaying the second image and the processing progress in the process of processing the second image;
and responding to the completion of the processing, storing the processed image and displaying the stored image.
18. The method of claim 1, further comprising:
determining whether a target object is contained in the first image;
and outputting prompt information when the first image does not contain the target object.
19. An electronic device, comprising:
image acquisition means for acquiring an image;
the processor is connected with the image acquisition device and used for identifying the pose of the target object in the first image acquired by the image acquisition device and determining working parameters when the image acquisition device acquires the second image based on the pose of the target object in the first image; and
and the controller is connected with the processor and the image acquisition device and is used for controlling the image acquisition device to acquire a second image according to the adjusted working parameters so as to enable the pose of the target object in the second image to meet the preset condition.
20. The electronic device of claim 19, wherein the target object comprises a human figure.
21. The electronic device of claim 20, wherein the identifying a pose of a target object in the first image comprises:
a pose of a shoulder of a person in the first image is identified.
22. The electronic device of claim 21, wherein the pose of the target object in the second image satisfies a preset condition comprising:
the shoulder reference line of the person in the second image is parallel to a preset reference line.
23. The electronic device of claim 20, wherein the identifying a pose of a target object in the first image comprises:
the positions of the head and shoulders of the person in the first image are identified.
24. The electronic device of claim 23, wherein the pose of the target object in the second image satisfies a preset condition comprising:
the head and shoulders of the person in the second image are located in a central region of the second image.
25. The electronic device of claim 20, wherein the identifying a pose of a target object in the first image comprises:
a ratio between a size of a person in the first image and a size of the first image is identified.
26. The electronic device of claim 25, wherein the controlling the image capturing device to capture the second image with the adjusted operating parameters such that the pose of the target object in the second image satisfies the preset condition comprises:
and adjusting the angle of view when the second image is acquired by the image acquisition device so that the ratio between the size of the person in the image and the size of the second image when the second image is acquired satisfies a threshold value.
27. The electronic device of claim 19, wherein the acquiring the second image at the adjusted operating parameter comprises:
and responding to a user instruction, and acquiring a second image according to the adjusted working parameters.
28. The electronic device of claim 27, wherein the user instructions include at least one of:
a user operation instruction;
a user voice instruction;
and (5) user behavior instructions.
29. The electronic device of claim 19, wherein the acquiring the second image at the adjusted operating parameter comprises:
and acquiring a second image according to the adjusted working parameters in response to the acquisition condition being met.
30. The electronic device of claim 29, wherein the satisfaction of an acquisition condition comprises at least one of:
the preset time duration is met;
and the pose of the target object in the second image meets a preset condition.
31. The electronic device of claim 19,
the processor is further configured to: processing the second image;
the electronic device further includes: and the memory is used for storing the processed image.
32. The electronic device of claim 19, wherein,
the processor is further configured to: processing the second image;
the electronic device further includes: and the display device is used for displaying the processed image.
33. The electronic device of claim 31 or 32, wherein the processing of the second image comprises at least one of:
processing the face of the person in the second image;
rendering the background in the second image; or
Correcting an inclination angle of the head of the person in the second image with respect to the shoulders.
34. The electronic device of claim 33, wherein the correcting the angle of inclination of the head of the person in the second image relative to the shoulders comprises:
determining an included angle between a symmetry line of the head and a datum line of the shoulder;
adjusting the pose of the head based on the included angle to correct the angle of inclination of the head relative to the shoulder.
35. The electronic device of claim 32, wherein:
the display device is further configured to: displaying the second image and the processing progress in the process of processing the second image;
the memory is further configured to: in response to the processing being complete, storing the processed image;
the display device is further configured to: displaying the processed image stored in the memory.
36. The electronic device of claim 19, the processor further configured to:
determining whether a target object is contained in the first image;
and outputting prompt information when the first image does not contain the target object.
37. A mobile device, comprising:
image acquisition means for acquiring an image;
the holder is used for fixing the image acquisition device;
the processor is connected with the image acquisition device and used for identifying the pose of the target object in the first image acquired by the image acquisition device and determining working parameters when the image acquisition device acquires the second image based on the pose of the target object in the first image; and
and the controller is connected with the processor and the cloud deck, and is used for adjusting the pose of the cloud deck so as to enable the image acquisition device to acquire the second image according to the adjusted working parameters and enable the pose of the target object in the second image to meet the preset condition.
38. The removable device of claim 37, wherein the target object comprises a person.
39. The movable apparatus of claim 38, wherein the identifying a pose of a target object in the first image comprises:
a pose of a shoulder of a person in the first image is identified.
40. The mobile device according to claim 39, wherein the adjusting the pose of the pan/tilt head to cause the image capture device to capture the second image at the adjusted operating parameters comprises:
and controlling the holder to rotate by a first angle relative to the first axis so that the shoulder datum line of the person in the second image is parallel to a preset reference line.
41. The movable apparatus of claim 38, wherein the identifying a pose of a target object in the first image comprises:
the positions of the head and shoulders of the person in the first image are identified.
42. The mobile device of claim 41, wherein the adjusting the pose of the pan/tilt head to cause the image capture device to capture the second image at the adjusted operating parameters comprises:
and controlling the holder to rotate by a second angle relative to the second axis and a third angle relative to the third axis so that the head and the shoulders of the person in the second image are positioned in the central area of the second image.
43. The movable apparatus of claim 38, wherein the identifying a pose of a target object in the first image comprises:
a ratio between a size of a person in the first image and a size of the first image is identified.
44. The mobile device of claim 43, wherein the controlling the image acquisition apparatus to acquire the second image at the adjusted operating parameter comprises:
and adjusting the angle of view when the second image is acquired by the image acquisition device so that the ratio between the size of the person in the image and the size of the second image when the second image is acquired satisfies a threshold value.
45. The mobile device of claim 37, wherein said acquiring a second image at the adjusted operating parameter comprises:
and responding to a user instruction, and acquiring a second image according to the adjusted working parameters.
46. The removable device of claim 45, wherein the user instructions comprise at least one of:
a user operation instruction;
a user voice instruction;
and (5) user behavior instructions.
47. The mobile device of claim 37, wherein said acquiring a second image at the adjusted operating parameter comprises:
and acquiring a second image according to the adjusted working parameters in response to the acquisition condition being met.
48. The removable device of claim 47, wherein the satisfaction of an acquisition condition comprises at least one of:
the preset time duration is met;
and the pose of the target object in the second image meets a preset condition.
49. The removable device of claim 37,
the processor is further configured to: processing the second image;
the mobile device further comprises: and the memory is used for storing the processed image.
50. The removable device of claim 37,
the processor is further configured to: processing the second image;
the mobile device further comprises: and the display device is used for displaying the processed image.
51. The removable device of claim 49 or 50, wherein the processing of the second image comprises at least one of:
processing the face of the person in the second image;
rendering the background in the second image; or
Correcting an inclination angle of the head of the person in the second image with respect to the shoulders.
52. The removable device of claim 51, wherein the correcting for the angle of inclination of the head of the person in the second image relative to the shoulders comprises:
determining an included angle between a symmetry line of the head and a datum line of the shoulder;
adjusting the pose of the head based on the included angle to correct the angle of inclination of the head relative to the shoulder.
53. The removable device of claim 49 or 50, wherein:
the display device is further configured to: displaying the second image and the processing progress in the process of processing the second image;
the memory is further configured to: in response to the processing being complete, storing the processed image;
the display device is further configured to: displaying the processed image stored in the memory.
54. The removable device of claim 37, the processor further to:
determining whether a target object is contained in the first image;
and outputting prompt information when the first image does not contain the target object.
55. A computer system, comprising:
one or more processors;
a computer-readable storage medium for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-18.
56. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 18.
57. A computer program product comprising computer readable instructions, wherein the computer readable instructions, when executed, are for performing the method of any of claims 1-18.
CN202080006208.8A 2020-06-22 2020-06-22 Image acquisition method, electronic equipment and mobile equipment Pending CN113170050A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/097444 WO2021258249A1 (en) 2020-06-22 2020-06-22 Image acquisition method, and electronic device, and mobile device

Publications (1)

Publication Number Publication Date
CN113170050A true CN113170050A (en) 2021-07-23

Family

ID=76879235

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080006208.8A Pending CN113170050A (en) 2020-06-22 2020-06-22 Image acquisition method, electronic equipment and mobile equipment

Country Status (2)

Country Link
CN (1) CN113170050A (en)
WO (1) WO2021258249A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114466140A (en) * 2022-02-09 2022-05-10 维沃移动通信有限公司 Image shooting method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120019620A1 (en) * 2010-07-20 2012-01-26 Hon Hai Precision Industry Co., Ltd. Image capture device and control method
CN104243832A (en) * 2014-09-30 2014-12-24 北京金山安全软件有限公司 Method and device for shooting through mobile terminal and mobile terminal
CN105554285A (en) * 2015-12-22 2016-05-04 努比亚技术有限公司 Processing method for taking photo of people, and intelligent mobile terminal
CN111311729A (en) * 2020-01-18 2020-06-19 西安电子科技大学 Natural scene three-dimensional human body posture reconstruction method based on bidirectional projection network

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7602413B2 (en) * 2002-10-18 2009-10-13 Sony Corporation Information processing system and method, information processing apparatus, image-capturing device and method, recording medium, and program
CN106210507A (en) * 2016-06-27 2016-12-07 联想(北京)有限公司 Image adjusting method and electronic equipment
CN107749947A (en) * 2017-09-28 2018-03-02 努比亚技术有限公司 Photographic method, mobile terminal and computer-readable recording medium
CN110830705A (en) * 2018-08-08 2020-02-21 深圳市优必选科技有限公司 Robot photographing method, robot, terminal device and storage medium
CN110633629A (en) * 2019-08-02 2019-12-31 广东电网有限责任公司清远供电局 Power grid inspection method, device, equipment and storage medium based on artificial intelligence
CN111147749A (en) * 2019-12-31 2020-05-12 宇龙计算机通信科技(深圳)有限公司 Photographing method, photographing device, terminal and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120019620A1 (en) * 2010-07-20 2012-01-26 Hon Hai Precision Industry Co., Ltd. Image capture device and control method
CN104243832A (en) * 2014-09-30 2014-12-24 北京金山安全软件有限公司 Method and device for shooting through mobile terminal and mobile terminal
CN105554285A (en) * 2015-12-22 2016-05-04 努比亚技术有限公司 Processing method for taking photo of people, and intelligent mobile terminal
CN111311729A (en) * 2020-01-18 2020-06-19 西安电子科技大学 Natural scene three-dimensional human body posture reconstruction method based on bidirectional projection network

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114466140A (en) * 2022-02-09 2022-05-10 维沃移动通信有限公司 Image shooting method and device
CN114466140B (en) * 2022-02-09 2023-10-24 维沃移动通信有限公司 Image shooting method and device

Also Published As

Publication number Publication date
WO2021258249A1 (en) 2021-12-30

Similar Documents

Publication Publication Date Title
US9692964B2 (en) Modification of post-viewing parameters for digital images using image region or feature information
CN107911621B (en) Panoramic image shooting method, terminal equipment and storage medium
WO2018201809A1 (en) Double cameras-based image processing device and method
US9578260B2 (en) Digital photographing apparatus and method of controlling the digital photographing apparatus
JP6263623B2 (en) Image generation method and dual lens apparatus
EP3346329B1 (en) Image processing method and apparatus
CN108154514B (en) Image processing method, device and equipment
WO2014071840A1 (en) Method and device for taking photo and video
JP2012199675A (en) Image processing apparatus, image processing method, and program
WO2013155804A1 (en) Photograph shooting method and electronic device
US20120133816A1 (en) System and method for user guidance of photographic composition in image acquisition systems
JP6472183B2 (en) Image processing apparatus, control method thereof, and program
CN107038362B (en) Image processing apparatus, image processing method, and computer-readable recording medium
WO2019214574A1 (en) Image capturing method and apparatus, and electronic terminal
CN110177212B (en) Image processing method and device, electronic equipment and computer readable storage medium
US20170359508A1 (en) Capturing apparatus and method for capturing images using the capturing apparatus
CN108270959B (en) Panoramic imaging method, terminal equipment and panoramic imaging device
CN106791390B (en) Wide-angle self-timer real-time preview method and user terminal
CN110740260A (en) shooting method, device and computer readable storage medium
CN108833786B (en) Mode control method and electronic equipment
WO2018196854A1 (en) Photographing method, photographing apparatus and mobile terminal
CN113302908B (en) Control method, handheld cradle head, system and computer readable storage medium
CN113170050A (en) Image acquisition method, electronic equipment and mobile equipment
JP5092961B2 (en) Imaging apparatus, imaging method, and program
CN107911609B (en) Image processing method, image processing device, computer-readable storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210723

WD01 Invention patent application deemed withdrawn after publication