WO2022247731A1 - Appareil photo, procédé de photographie, terminal et support de stockage - Google Patents

Appareil photo, procédé de photographie, terminal et support de stockage Download PDF

Info

Publication number
WO2022247731A1
WO2022247731A1 PCT/CN2022/093984 CN2022093984W WO2022247731A1 WO 2022247731 A1 WO2022247731 A1 WO 2022247731A1 CN 2022093984 W CN2022093984 W CN 2022093984W WO 2022247731 A1 WO2022247731 A1 WO 2022247731A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
lens
target
target object
preview image
Prior art date
Application number
PCT/CN2022/093984
Other languages
English (en)
Chinese (zh)
Inventor
郭红红
Original Assignee
西安闻泰信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 西安闻泰信息技术有限公司 filed Critical 西安闻泰信息技术有限公司
Publication of WO2022247731A1 publication Critical patent/WO2022247731A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026—Details of the structure or mounting of specific components
    • H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals

Definitions

  • the present disclosure relates to a camera, a photographing method, a device, a terminal and a storage medium.
  • a camera a photographing method, a terminal, and a storage medium are provided, which can flexibly zoom when photographing and improve photographing effects.
  • a camera comprising:
  • the camera body is installed on the terminal through the rigid-flex board;
  • the camera body includes a lens and a lens barrel, and the motor is configured to push the lens and the lens barrel to zoom.
  • the outside of the lens and the lens barrel are surrounded by a coil, and the coil is located in the motor; when the coil outside the lens is energized, the motor pushes the lens of the camera body to move , so that the camera body performs primary zooming; when the coil outside the lens barrel is energized, the motor pushes the lens barrel of the camera body to move, so that the camera body performs secondary zooming.
  • the camera head further includes: a translation assembly; the translation assembly pushes the lens and the lens barrel to translate; the translation assembly is installed on the connection between the lens barrel and the rigid-flex board and installed at the connection between the lens and the lens barrel.
  • the camera head further includes: a tilting assembly; the tilting assembly is installed at the connection between the lens barrel and the rigid-flex board, and at the connection between the lens and the lens barrel .
  • the lens is provided with a light hole; when the motor pushes the lens and the lens barrel to move, the light hole is used to transmit light to change the aperture of the camera the amount of incoming light.
  • a magnet is installed in the motor; when the coil outside the lens is energized, the magnet generates electromagnetic induction, so that the motor pushes the lens of the camera body to move; When the coil is energized, the magnet generates electromagnetic induction, so that the motor pushes the lens barrel of the camera body to move.
  • the number of the camera is 1; when the camera is not used through the terminal, the lens of the camera is on the same plane as the terminal; when the camera is used through the terminal, The motor drives the lens and the lens barrel to zoom, so that the plane where the lens of the camera is located is higher than the plane where the terminal is located.
  • a method for taking pictures is applied to a terminal, the terminal includes the camera described in the embodiments of the present disclosure, and the method includes:
  • focus adjustment information is generated based on the image information of the shooting preview image; the focus adjustment information includes lens pushing information and lens barrel pushing information;
  • the camera is controlled to adjust the focus, and the camera is controlled to take pictures based on the adjusted focus.
  • the generating focus adjustment information based on the image information of the shooting preview image includes: determining the target focus point of the lens based on the outline data of the target object in the shooting preview image; The target focusing point of the target object generates the focus adjustment information.
  • contour recognition is performed on the target object in the shooting preview image, and the contour point position of the target object is determined; based on the contour point position, the target focus point of the lens is determined.
  • the target focus point of the lens is the outline center point of the target object; two objects are included in the shooting preview image.
  • the target focusing point of the lens is determined based on the center point of the outline of each target object.
  • the determining the target focusing point of the lens based on the center point of the outline of each target object includes: determining two target objects in the shooting preview image. the center point of the outline of the target object, and the midpoint of the line connecting the center points of the outline of the two target objects as the target focus point of the lens; in the case where the shooting preview image includes more than two target objects , determine the contour center point of each target object, and construct a polygon based on the contour center point of each target object, and use the polygon center point as the target focus point of the lens.
  • the generating the focus adjustment information based on the target focus point of the target object includes: determining the distance between the target focus point and the center point of the camera lens; if the distance is less than a double the focal length or greater than twice the focal length, and generate the focus adjustment information.
  • the method further includes: determining a vertical line between the shooting preview image and the plane where the camera is located based on the center point of the camera; when the target focusing point is not on the vertical line, Generate camera translation information, and control the camera translation based on the camera translation information; correspondingly, controlling the camera to take pictures based on the adjusted focal length includes: controlling the camera based on the adjusted focal length and the translated location to take pictures.
  • the method before generating focus adjustment information based on the image information of the shot preview image, the method further includes: inputting the shot preview image into a trained detection model to obtain the target The detection result of the object, the detection model is obtained based on the training of the first type of image including the target object and the second type of image not including the target object, the detection result of the target object includes the presence of the target object in the shooting preview image And the situation that the target object does not exist in the shooting preview image.
  • the method further includes: when it is detected that there is no target object in the shot preview image, the focus adjustment information is lens push information; controlling the camera adjustment based on the lens push information focal length, and control the camera to take pictures based on the adjusted focal length.
  • the method further includes: controlling the camera to adjust the focal length based on the focal length adjustment information, so that the adjusted focal length is between one focal length and two times the focal length of the lens. between focal lengths, and control the camera to take pictures.
  • the controlling the camera to take pictures based on the adjusted focal length includes: controlling the camera to take pictures based on the adjusted focal length, translation and tilted positions.
  • a photographing device configured in a terminal, the terminal includes the camera provided in any embodiment of the present disclosure, and the device includes:
  • the shooting preview image acquisition module is configured to obtain the shooting preview image collected by the camera when it is detected that entering the camera mode
  • the focal length adjustment information generation module is configured to generate focus adjustment information based on the image information of the shooting preview image when it is detected that there is a target object in the shooting preview image, and the focus adjustment information includes: lens push information and Lens barrel pushing information;
  • the photographing control module is configured to control the camera to adjust the focal length based on the focal length adjustment information, and control the camera to take photographs based on the adjusted focal length.
  • the focus adjustment information generation module is specifically configured to: determine the target focus point of the lens based on the outline data of the target object in the shooting preview image; determine the target focus point of the target object based on the , to generate the focus adjustment information.
  • the focus adjustment information generation module is specifically configured to: perform contour recognition on the target object in the shooting preview image, determine the contour point position of the target object; determine the contour point position based on the contour point position the target focus point of the above lens.
  • the focus adjustment information generation module is specifically configured to: in the case that only one target object is included in the shooting preview image, use the outline center point of the target object as the target of the lens A focus point: in the case that the shooting preview image includes two or more target objects, determining the target focus point of the lens based on the outline center point of each target object.
  • the focus adjustment information generation module is specifically configured to: determine the center points of the contours of the two target objects when the shooting preview image includes two target objects, and combine the two target objects The midpoint of the line connecting the outline center points of the object is used as the target focusing point of the lens; when the shooting preview image includes more than two target objects, the outline center point of each target object is determined, and based on A polygon is constructed from the center point of the outline of each target object, and the center point of the polygon is used as the target focus point of the lens.
  • the focus adjustment information generation module is specifically configured to: determine the distance between the target focus point and the center point of the camera lens; if the distance is less than one focal length or greater than two focal lengths, generate the Focus adjustment information described above.
  • the device further includes: a perpendicular line determination module configured to determine a perpendicular line between the shooting preview image and the plane where the camera is located based on the center point of the camera;
  • a translation control module configured to generate camera translation information when the target focusing point is not on the vertical line, and control the camera translation based on the camera translation information.
  • the perpendicular line determining module is further configured to determine the perpendicular line between the shooting preview image and the plane where the camera is located based on the center point of the camera; when the target focusing point is not in the When on the vertical line, camera translation information is generated, and the camera translation is controlled based on the camera translation information; the camera is controlled to take pictures based on the adjusted focal length and the translated position.
  • the shooting preview acquisition module is further configured to input the shooting preview into the trained detection model to obtain the detection result of the target object, and the detection model is based on the detection model including the target object
  • the first type of images and the second type of images that do not include the target object are trained, and the detection result of the target object includes the situation that the target object exists in the shooting preview image and the situation that the target object does not exist in the shooting preview image.
  • the focus adjustment information generating module is further configured to, when it is detected that there is no target object in the shot preview image, that the focus adjustment information is lens push information; based on the lens push information controlling the camera to adjust the focal length, and controlling the camera to take pictures based on the adjusted focal length.
  • the focal length adjustment information generating module is further configured to control the camera to adjust the focal length based on the focal length adjustment information, so that the adjusted focal length is between the primary focal length and the secondary focal length , and control the camera to take pictures.
  • the photographing control module is further configured to generate camera tilt information when the target focusing point is not on the vertical line, and control the lens and mirror of the camera based on the camera tilt information.
  • the barrel is tilted so that the center point of the tilted camera is aligned with the target focus point; the camera is controlled to take pictures based on the adjusted focal length, translation and tilted position.
  • a terminal including a memory and one or more processors, the memory stores computer-readable instructions, and the one or more processors execute the computer-readable instructions to implement a method provided by any embodiment of the present disclosure.
  • One or more non-transitory computer-readable storage media having stored thereon computer-readable instructions that, when executed by one or more processors, implement any implementation of the present disclosure The steps of a method for taking pictures provided by the example.
  • Figure 1a is a front view of a camera in one or more embodiments
  • Figure 1b is a side view of a camera in one or more embodiments
  • Figure 1c is a front view of a lens in one or more embodiments
  • Figure 1d is a front view of the camera body in one or more embodiments
  • Figure 2a is a rear view of a terminal with a single camera installed in one or more embodiments
  • Figure 2b is a side view of a terminal with a single camera installed in one or more embodiments when the lens and lens barrel are not moved;
  • Figure 2c is a side view of a terminal with a single camera installed when moving the lens and lens barrel in one or more embodiments;
  • Fig. 3 is a schematic flowchart of a photographing method in one or more embodiments
  • Fig. 4 is a photo preview in one or more embodiments
  • Fig. 5 is a logical schematic diagram of a photographing method in one or more embodiments.
  • Fig. 6 is a schematic flowchart of another photographing method in one or more embodiments.
  • Fig. 7 is a structural block diagram of a shooting device in one or more embodiments.
  • Fig. 8 is a structural diagram of a device in one or more embodiments.
  • the rear cameras on mobile phones are all fixed at present, and the rear cameras can only realize software zoom, not hardware zoom.
  • Software zoom methods include: optical zoom and digital zoom.
  • the optical zoom method is to achieve zooming through the lens of the periscope structure.
  • the disadvantage of this zoom method is: the size of the sensor on the rear camera is extremely small, which affects the clarity of the image; the lens of the periscope structure is easy to get dust , affecting the imaging effect; and, the amount of light entering the lens of the periscope structure will be limited, affecting the imaging effect.
  • the digital zoom method achieves zooming by cutting the image.
  • the disadvantage of this zoom method is: after the image is cut, the pixels of the image will offset, which will affect the imaging effect of the image.
  • embodiments of the present disclosure provide a camera, a photographing method, a device, a terminal, and a storage medium.
  • a single camera is installed on the terminal, and the motor on the single camera can push the lens for initial zooming and the lens barrel for secondary zooming, which changes the fixed structure of the mobile phone camera.
  • the cost of mobile phones is reduced.
  • the above-mentioned single camera is not easy to get dust, and in the process of moving the lens and lens barrel, it can increase the amount of light entering the aperture and improve the imaging effect.
  • optical zooming can be realized through the above-mentioned single camera, and compared with the digital zooming method, there is no need to crop images to realize zooming.
  • Fig. 1a and Fig. 1b provide a camera
  • Fig. 1a is a front view of the camera
  • Fig. 1b is a side view of the camera.
  • This embodiment is mainly described by taking a camera applied to a terminal as an example.
  • a camera is configured on the terminal, and the terminal may be but not limited to a smart phone, a tablet computer, and the like.
  • the camera includes a rigid-flex board 1 , a camera body 2 and a motor 3 .
  • the camera main body 2 is installed on the terminal through the rigid-flex board 1 , the camera main body 2 includes a lens 21 and a lens barrel 22 , and the motor 3 is configured to push the lens 21 and the lens barrel 22 to zoom.
  • Figure 1c is a front view of the lens
  • Figure 1d is a front view of the camera body.
  • a lens 211 is disposed on the lens 21
  • the lens 21 includes a light hole 212 .
  • the motor 3 can be configured on both the lens 21 and the lens barrel 22 .
  • the motor 3 pushes the lens 21 and the lens barrel 22 to move, the camera transmits light through the light hole 212.
  • the amount of light entering the aperture of the camera will be changed to improve the imaging effect.
  • the outer sides of the lens 21 and the lens barrel 22 are surrounded by a coil 23 , and a magnet 31 is installed in the motor 3 disposed on the lens 21 and the lens barrel 22 .
  • the motor pushes the lens 21 of the camera body 2 to move, so that the camera body 2.
  • the motor pushes the lens barrel 22 of the camera body 2 to move , so that the camera body 2 performs secondary zooming.
  • the camera based on the above structure can respectively control the movement of the lens of the main body of the camera through the principle of magnetic induction to realize primary zooming, and control the movement of the lens barrel of the main body of the camera to realize secondary zooming.
  • the camera may further include a translation component (not shown in the figure), which pushes the lens and lens barrel to translate.
  • the translation assembly can be installed at the joint between the lens barrel and the rigid-flex board and at the joint between the lens and the lens barrel.
  • the translation assembly may include, but is not limited to, any one of magnets, springs, and slide rails.
  • the translation component on the camera can push the lens and the lens barrel to translate to horizontally adjust the position of the lens focus, so that the lens focus can be more precisely aimed at the subject to improve the image quality. Effect.
  • the camera head may further include a tilting component (not shown in the figure), which drives the lens and lens barrel to tilt.
  • the tilting component can be installed at the joint between the lens barrel and the rigid-flex board and at the joint between the lens and the lens barrel.
  • the tilting assembly can be structures such as magnets and springs.
  • the tilting component on the camera can drive the lens and the lens barrel to tilt to adjust the position of the lens focus, so that the lens focus is more precisely aimed at the subject to improve the image effect .
  • the position of the focus of the lens can be adjusted, so that the focus of the lens can be aimed more precisely at the object to be photographed, so as to improve the image effect.
  • Figure 2a is a rear view of a terminal with a single camera installed
  • Figure 2b is a side view of a terminal with a single camera installed without moving the lens and lens barrel
  • Figure 2c is a side view of a terminal with a single camera installed when the lens and lens barrel are moved .
  • a single camera is installed on the terminal to provide a camera function, which can reduce the number of cameras, and reduce the cost of the mobile phone compared to a mobile phone equipped with multiple cameras; when the terminal does not move the lens and lens barrel, the camera , the lens and lens barrel are not pushed, the lens and the terminal are located on the same plane, this design method will not increase the thickness of the terminal, only when the terminal uses the camera, the motor pushes the lens and lens barrel to zoom, at this time, the thickness of the terminal Increase.
  • a single camera is installed on the terminal, which reduces the cost of the mobile phone compared to a mobile phone equipped with multiple cameras; the motor on the single camera can push the lens and the lens barrel to zoom, changing the fixed position of the mobile phone camera.
  • Type structure when the terminal does not use the camera, the thickness of the terminal will not increase, only when the camera is used, the thickness will increase; in addition, the above-mentioned single camera will not enter the dust compared with the lens of the periscope structure , and in the process of pushing the lens and lens barrel to move, it can increase the amount of light entering the aperture and improve the imaging effect.
  • optical zooming can be realized through the above-mentioned single camera, and compared with the digital zooming method, there is no need to crop images to realize zooming.
  • a method for taking pictures is provided. This embodiment is mainly described by taking the method applied to a terminal as an example.
  • the terminal includes the aforementioned camera.
  • the photographing method may specifically include the following steps.
  • the terminal when the terminal receives that the user clicks on the photographing icon or the user activates the photographing shortcut, the terminal generates camera activation information, and enters the photographing mode based on the activation information.
  • the camera mode may include, but not limited to, portrait mode, landscape mode, macro mode, sports mode, night scene mode, and panorama mode.
  • the shooting preview image refers to the image collected by the camera before the terminal enters the camera mode and the shutter is pressed to take a photo.
  • the photo preview image can include scenery, people, animals, and other equipment.
  • the photo preview can be referred to in FIG. 4 .
  • the lens barrel and the lens of the camera do not move.
  • the state of the camera on the terminal can be referred to the rear view shown in FIG. 2b.
  • the target object may include characters, in one embodiment, characters and animals, in one embodiment, characters and scenery, and so on.
  • the method before generating focus adjustment information based on the image information of the shot preview image, the method further includes:
  • detecting whether there is a target object in the shooting preview image includes:
  • the detection model is trained based on the first type of image including the target object and the second type of image not including the target object.
  • the detection result of the target object includes A case where the target object exists in the shot preview image and a case where the target object does not exist in the shot preview image.
  • the detection model can be any one of convolutional network, long short-term memory network, full convolutional network, recurrent neural network, gated recurrent network, and confrontation network.
  • the shot preview image can be input into the trained detection model, the shot preview image can be classified based on the detection model, and the target object can be determined based on the classification result; in one embodiment, the shot preview image can be detected based on the detection model Detection, to determine the target object based on the face detection result.
  • the focus adjustment information includes: lens pushing information and lens barrel pushing information.
  • the lens pushing information includes a lens pushing instruction and a lens pushing distance.
  • the lens barrel pushing information includes a lens pushing command and a lens barrel pushing distance.
  • focus adjustment information is generated based on the image information of the shooting preview image, including:
  • focus adjustment information is generated.
  • the target focus point of the lens refers to the point that the lens needs to be aligned on the shooting preview image.
  • the target focusing point may be located at the center of the outline of the target object, or at the center of the facial features of the target object, or at other positions of the target object. In this embodiment, a specific explanation is given that the target focusing point is located at the center point of the outline of the target object.
  • determining the target focus point of the lens based on the outline data of the target object in the shooting preview image may include:
  • the target focus point of the lens is determined.
  • the gray value of each pixel in the shooting preview image can be extracted, and the contour recognition of the target object in the shooting preview image can be performed based on the gray value, so as to determine the contour point position of the target object.
  • the color value of each pixel in the shooting preview image may be extracted, and contour recognition is performed on the target object in the shooting preview image based on the color value, so as to determine the position of the contour point of the target object.
  • preprocessing may be performed on the shot preview image, so as to perform contour recognition on the preprocessed shot preview image.
  • the preprocessing manner at least includes low-pass filtering processing.
  • the center point of the outline of the target object is used as the target focusing point of the lens
  • the target focusing point of the lens is determined based on the outline center point of each target object.
  • the camera may be controlled to aim at the target object, and then the center point of the outline of the target object may be used as the target focusing point.
  • determining the target focusing point of the lens based on the center point of the outline of each target object includes:
  • the center point of the outline of each target object is determined, and a polygon is constructed based on the center point of the outline of each target object, and the center point of the polygon is used as the target pair of the lens focus.
  • the midpoint between the outline center points of each target object is used as the target focusing point; if three or more target objects are included in the shooting preview image, A polygon formed by the center points of the outlines of all target objects is determined, and the center point of the polygon is used as the target focus point.
  • the target focusing point can be accurately determined for shooting preview images including different numbers of target objects.
  • generating focus adjustment information based on the target focus point of the target object may include:
  • focus adjustment information is generated.
  • the center point of the camera may be the center point of the aperture on the camera.
  • the terminal calculates the distance between the target focus point and the center point of the camera lens based on the position of the target focus point and the center point of the camera lens; further, it determines whether the calculated distance is between one focal length and two focal lengths of the camera If the distance is less than one focal length or greater than two focal lengths, generate focal length adjustment information, and the terminal can further control the camera to adjust the focal length based on the focal length adjustment information, so that the adjusted focal length is between one focal length and two focal lengths of the camera to control the camera to take pictures.
  • the focal length refers to the measurement method to measure the concentration or divergence of light in the optical system, and refers to the distance from the optical center of the lens to the focus of light when parallel light is incident.
  • the terminal after the terminal generates the focus adjustment information, it can generate a current value corresponding to the lens push distance based on the lens push command and the lens push distance in the focus distance adjustment information, and control the power supply of the coil outside the lens based on the current value, so that The coil outside the lens generates a magnetic field, which makes the magnet in the motor where the coil outside the lens is located generate electromagnetic induction. Based on the principle of magnet repulsion, the motor pushes the lens to move.
  • the distance the lens moves is the lens pushing distance, so that the camera can move Initial zooming; and, based on the lens barrel pushing instruction and the lens barrel pushing distance in the focal length adjustment information, a current value corresponding to the lens barrel pushing distance can be generated, and the coil outside the lens barrel is controlled to be energized based on the current value, so that the outside of the lens barrel
  • the coil on the outside of the lens barrel generates a magnetic field, so that the magnet in the motor where the coil outside the lens barrel is located generates electromagnetic induction.
  • the motor pushes the lens barrel to move, and the moving distance of the lens barrel is the lens barrel pushing distance, so that The camera zooms twice.
  • the terminal adjusts the focal length through the aforementioned steps, it generates a photographing instruction based on the user's touch operation.
  • the photographing instruction is automatically generated, and the camera is controlled to take photographs based on the photographing instruction.
  • the terminal can automatically control the movement of the lens of the camera for primary zooming, and control the movement of the barrel of the camera for secondary zooming.
  • the terminal can take pictures based on the adjusted focal length, that is, the Take pictures to get the target image.
  • the shooting preview image collected by the camera is obtained to determine whether there is a target object in the shooting preview image. If there is a target object in the shooting preview image, the image information of the shooting preview image can be , generate focus adjustment information, further control the camera to perform initial zooming based on the lens push information in the focus adjustment information, and control the camera to perform secondary zoom based on the lens barrel push information in the focus adjustment information, which improves the focus adjustment function of the terminal camera, and , in the process of moving the lens and lens barrel, the amount of light entering the aperture can be increased. Therefore, when the camera is controlled to take pictures based on the adjusted focal length, the picture quality of the image can be improved. It is especially suitable for portrait shooting to record life anytime and anywhere , to meet the needs of users for taking photos, and improve the user's photo experience.
  • a method for taking pictures is provided. This embodiment is mainly described by taking the method applied to a terminal as an example.
  • the terminal includes the aforementioned camera.
  • the photographing method may specifically include the following steps.
  • the focus adjustment information may include: lens pushing information and lens barrel pushing information.
  • S240 Determine, based on the center point of the camera, a vertical line between the shooting preview image and the plane where the camera is located.
  • the plane where the camera is located coincides with or is parallel to the plane of the terminal, and a perpendicular line is drawn to the plane where the camera is located based on the center point of the camera.
  • the perpendicular line may or may not include the target focus point.
  • the terminal can generate camera translation information based on the position of the target focus point and the center point of the camera, and based on the camera translation information, control the translation component on the camera to drive the lens and lens barrel of the camera to translate, so that the center of the camera after translation point to align with the target focus point.
  • the translation assembly may include, but not limited to, any one of magnets, springs, and slide rails.
  • the terminal can generate a photographing instruction based on the user's touch operation to generate the photographing instruction.
  • the photographing instruction is automatically generated, and the camera is controlled based on the photographing instruction. Photograph.
  • a tilting component may also be installed on the camera, configured to drive the lens and lens barrel to tilt.
  • S250 can be used to determine the vertical line between the shooting preview image and the plane where the camera is located, and when the target focus point is not on the vertical line, generate camera tilt information, and control the camera lens and mirror based on the camera tilt information.
  • the barrel is tilted so that the center point of the tilted camera is aligned with the target focus point; further, the camera is controlled to take pictures based on the adjusted focal length and the rotated position.
  • the rotating structure may be a structure such as a magnet and a spring.
  • the target focus point when the target focus point is not on the vertical line, it is also possible to control the translation and/or tilt of the camera so that the center point of the camera after translation and/or tilt is aligned with the target focus point, and further control
  • the camera takes pictures based on the adjusted focal length and the translated position, and/or controls the camera to take pictures based on the adjusted focal length and the tilted position.
  • the photographing effect of the image can be further improved, and it is especially suitable for taking portraits, so as to record life anytime and anywhere, meet the photographing needs of the user, and improve the photographing experience of the user.
  • a photographing device including: a photographing preview acquisition module 310 , a focus adjustment information generation module 320 and a photographing control module 330 . in,
  • the shooting preview image acquisition module 310 is configured to obtain the shooting preview image collected by the camera when it is detected that the camera is entered;
  • the focus adjustment information generating module 320 is configured to generate focus adjustment information based on the image information of the shooting preview image in the case of detecting that there is a target object in the shooting preview image, and the focus adjustment information includes: lens push information and barrel push information;
  • the photographing control module 330 is configured to control the camera to adjust the focal length based on the focal length adjustment information, and control the camera to take photographs based on the adjusted focal length.
  • the focus adjustment information generation module 320 is specifically configured to determine the target focus point of the lens based on the outline data of the target object in the shooting preview image;
  • the focus adjustment information is generated based on a target focus point of the target object.
  • the target focus point of the lens is the outline center point of the target object
  • the target focus point of the lens is determined based on the outline center point of each target object.
  • the focus adjustment information generating module 320 is specifically configured to, in the case that the shooting preview image includes two target objects, determine the center points of the contours of the two target objects, and combine the contours of the two target objects The midpoint of the line connecting the center points is used as the target focusing point of the lens;
  • the shooting preview image includes more than two target objects, determine the center point of the contour of each target object, and construct a polygon based on the center point of the contour of each target object, and use the center point of the polygon as the The target focus point of the lens.
  • the focus adjustment information generation module 320 is specifically configured to determine the distance between the target focus point and the center point of the camera lens;
  • the focus adjustment information is generated.
  • the device also includes: a vertical line determination module and a translation control module;
  • the vertical line determination module is configured to determine the vertical line between the shooting preview image and the plane where the camera is located based on the center point of the camera;
  • a translation control module configured to generate camera translation information when the target focusing point is not on the vertical line, and control the camera translation based on the camera translation information.
  • the photographing control module 330 is specifically configured to control the camera to photograph based on the adjusted focal length and the translated position.
  • the device also includes: a detection module;
  • the detection module is configured to input the shooting preview image into the trained detection model to obtain the detection result of the target object, and the detection model is based on the first type of image including the target object and the The second type of image training is obtained, and the detection result of the target object includes the situation that the target object exists in the shooting preview image and the situation that the target object does not exist in the shooting preview image.
  • the shooting preview image collected by the camera is obtained to determine whether there is a target object in the shooting preview image. If there is a target object in the shooting preview image, the image information of the shooting preview image can be , generate focus adjustment information, further control the camera to perform initial zooming based on the lens push information in the focus adjustment information, and control the camera to perform secondary zoom based on the lens barrel push information in the focus adjustment information, which improves the focus adjustment function of the terminal camera, and , in the process of moving the lens and lens barrel, the amount of light entering the aperture can be increased. Therefore, when the camera is controlled to take pictures based on the adjusted focal length, the picture quality of the image can be improved. It is especially suitable for portrait shooting to record life anytime and anywhere , to meet the needs of users for taking photos, and improve the user's photo experience.
  • Each module in the above-mentioned photographing device can be fully or partially realized by software, hardware and a combination thereof.
  • the above-mentioned modules can be embedded in or independent of one or more processors in the terminal in the form of hardware, or can be stored in the memory of the terminal in the form of software, so that one or more processors can call and execute the corresponding functions of the above-mentioned modules. operation.
  • a terminal is provided, and the terminal may be a vehicle-mounted Bluetooth module. Its internal structure diagram can be shown in FIG. 8 .
  • the terminal includes one or more processors, memory, and network interfaces connected by a system bus. Among other things, one or more processors of the terminal are configured to provide computing and control capabilities.
  • the memory of the terminal includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system and computer readable instructions.
  • the internal memory provides an environment for the execution of the operating system and computer readable instructions in the non-volatile storage medium.
  • the display screen of the computer device may be a liquid crystal display screen or an electronic ink display screen, and the communication interface of the computer device is configured to communicate with an external terminal in a wired or wireless manner, and the wireless method may be Bluetooth communication.
  • the input device of the terminal may be a touch layer covered on the display screen, or a button, a trackball or a touch pad provided on the casing of the computer equipment, or an external keyboard, touch pad or mouse.
  • FIG. 8 is only a block diagram of a partial structure related to the disclosed solution, and does not constitute a limitation on the computer equipment to which the disclosed solution is applied.
  • the specific terminal may include There may be more or fewer components than shown in the figures, or certain components may be combined, or have different component arrangements.
  • the photographing device provided in the present disclosure can be implemented in the form of a computer-readable instruction, and the computer-readable instruction can be run on a terminal as shown in FIG. 8 .
  • the memory of the terminal can store various program modules that make up the photographing device, for example, the photographing preview acquisition module 310 , focus adjustment information generation module 320 and photographing control module 330 shown in FIG. 7 .
  • the computer-readable instructions constituted by each program module enable one or more processors to execute the steps in the photographing method of each embodiment of the present disclosure described in this specification.
  • the terminal shown in FIG. 8 can execute S110 through the shooting preview acquisition module 310 in the photographing device as shown in FIG. .
  • a terminal including a memory and one or more processors, the memory stores computer-readable instructions, and the one or more processors execute the computer-readable instructions to implement the following steps:
  • focus adjustment information is generated based on the image information of the shooting preview image, and the focus adjustment information includes: lens pushing information and lens barrel pushing information;
  • the camera is controlled to adjust the focus, and the camera is controlled to take pictures based on the adjusted focus.
  • the focus adjustment information is generated based on a target focus point of the target object.
  • one or more processors when executing computer readable instructions, also implement:
  • the target focusing point of the lens is the outline center point of the target object
  • the target focusing point of the lens is determined based on the outline center points of at least two target objects.
  • one or more processors when executing computer readable instructions, also implement:
  • the center points of the outlines of the two target objects are determined, and the midpoint of the line connecting the center points of the outlines of the two target objects is used as the target pair of the lens. focus;
  • the shooting preview image includes more than two target objects, determine the center point of the contour of each target object, and construct a polygon based on the center point of the contour of each target object, and use the center point of the polygon as the The target focus point of the lens.
  • the focus adjustment information is generated.
  • the controlling the camera to take pictures based on the adjusted focal length includes:
  • the camera is controlled to take pictures based on the adjusted focal length and the translated position.
  • the detection model is trained based on a first type of image including the target object and a second type of image not including the target object,
  • the detection result of the target object includes a situation in which the target object exists in the shooting preview image and a situation in which the target object does not exist in the shooting preview image.
  • the shooting preview image collected by the camera is obtained to determine whether there is a target object in the shooting preview image. If there is a target object in the shooting preview image, the image information of the shooting preview image can be , generate focus adjustment information, further control the camera to perform initial zooming based on the lens push information in the focus adjustment information, and control the camera to perform secondary zoom based on the lens barrel push information in the focus adjustment information, which improves the focus adjustment function of the terminal camera, and , in the process of moving the lens and lens barrel, the amount of light entering the aperture can be increased. Therefore, when the camera is controlled to take pictures based on the adjusted focal length, the picture quality of the image can be improved. It is especially suitable for portrait shooting to record life anytime and anywhere , to meet the needs of users for taking photos, and improve the user's photo experience.
  • one or more non-transitory computer-readable storage media having computer-readable instructions stored thereon, the computer-readable instructions being executed by one or more processors When performing the following steps:
  • focus adjustment information is generated based on the image information of the shooting preview image, and the focus adjustment information includes: lens pushing information and lens barrel pushing information;
  • the camera is controlled to adjust the focus, and the camera is controlled to take pictures based on the adjusted focus.
  • the focus adjustment information is generated based on a target focus point of the target object.
  • one or more processors when executing computer readable instructions, also implement:
  • the target focusing point of the lens is the outline center point of the target object
  • the target focus point of the lens is determined based on the outline center point of each target object.
  • one or more processors when executing computer readable instructions, also implement:
  • the center points of the outlines of the two target objects are determined, and the midpoint of the line connecting the center points of the outlines of the two target objects is used as the target pair of the lens. focus;
  • the shooting preview image includes more than two target objects, determine the center point of the contour of each target object, and construct a polygon based on the center point of the contour of each target object, and use the center point of the polygon as the The target focus point of the lens.
  • the focus adjustment information is generated.
  • the controlling the camera to take pictures based on the adjusted focal length includes:
  • the camera is controlled to take pictures based on the adjusted focal length and the translated position.
  • the detection model is trained based on a first type of image including the target object and a second type of image not including the target object,
  • the detection result of the target object includes a situation in which the target object exists in the shooting preview image and a situation in which the target object does not exist in the shooting preview image.
  • the shooting preview image collected by the camera is obtained to determine whether there is a target object in the shooting preview image. If there is a target object in the shooting preview image, the image information of the shooting preview image can be , generate focus adjustment information, further control the camera to perform initial zooming based on the lens push information in the focus adjustment information, and control the camera to perform secondary zoom based on the lens barrel push information in the focus adjustment information, which improves the focus adjustment function of the terminal camera, and , in the process of moving the lens and lens barrel, the amount of light entering the aperture can be increased. Therefore, when the camera is controlled to take pictures based on the adjusted focal length, the picture quality of the image can be improved. It is especially suitable for portrait shooting to record life anytime and anywhere , to meet the needs of users for taking photos, and improve the user's photo experience.
  • Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory or optical memory, etc.
  • Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory.
  • RAM Random Access Memory
  • SRAM Static Random Access Memory
  • DRAM Dynamic Random Access Memory
  • the motor on the camera provided by this disclosure can push the lens and the lens barrel to zoom, which changes the fixed structure of the mobile phone camera; so that the thickness of the terminal will not increase when the camera is not used, and only when the camera is used Increase the thickness, and in the process of moving the lens and the lens barrel, it can increase the amount of light entering the aperture and improve the imaging effect, which has strong industrial applicability.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Studio Devices (AREA)

Abstract

La présente divulgation concerne une technologie de communication, et en particulier un appareil photo, un procédé de photographie, un terminal et un support de stockage. L'appareil photo comprend une carte flexorigide, un corps principal d'appareil photo et un moteur, le corps principal d'appareil photo étant monté sur un terminal au moyen de la carte flexorigide ; le corps principal d'appareil photo comprend un objectif et un barillet d'objectif ; et le moteur est configuré pour pousser l'objectif et le barillet d'objectif pour un zoom. Le moteur sur l'appareil photo sur le terminal peut pousser l'objectif et le barillet d'objectif pour un zoom, de telle sorte que la structure fixe d'un appareil photo de téléphone mobile peut être changée ; en outre, par rapport à l'objectif d'une structure périscopique, la poussière ne peut pas entrer dans l'appareil photo unique, et dans le processus de poussée de l'objectif et du barillet d'objectif pour qu'ils se déplacent, la quantité d'entrée de lumière d'une ouverture peut être augmentée, améliorant ainsi un effet d'imagerie. De plus, un zoom optique peut être obtenu au moyen de l'appareil photo unique, et comparé à un zoom numérique, un zoom peut être réalisé sans recadrer une image.
PCT/CN2022/093984 2021-05-28 2022-05-19 Appareil photo, procédé de photographie, terminal et support de stockage WO2022247731A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110590535.9A CN113507549B (zh) 2021-05-28 2021-05-28 一种摄像头、拍照方法、终端及存储介质
CN202110590535.9 2021-05-28

Publications (1)

Publication Number Publication Date
WO2022247731A1 true WO2022247731A1 (fr) 2022-12-01

Family

ID=78008632

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/093984 WO2022247731A1 (fr) 2021-05-28 2022-05-19 Appareil photo, procédé de photographie, terminal et support de stockage

Country Status (2)

Country Link
CN (1) CN113507549B (fr)
WO (1) WO2022247731A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113507549B (zh) * 2021-05-28 2022-10-14 西安闻泰信息技术有限公司 一种摄像头、拍照方法、终端及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101118309A (zh) * 2006-08-01 2008-02-06 扬明光学股份有限公司 镜头模块
JP2008152240A (ja) * 2006-12-15 2008-07-03 Fuzhun Precision Industry (Shenzhen) Co Ltd 内蔵式焦点調節構造
CN104917959A (zh) * 2015-05-19 2015-09-16 广东欧珀移动通信有限公司 一种拍照方法及终端
CN209472670U (zh) * 2019-04-15 2019-10-08 深圳市飞斯贝尔科技有限公司 一种自动变焦摄像头
CN112526700A (zh) * 2020-12-21 2021-03-19 维沃移动通信有限公司 摄像头模组及电子设备
CN113507549A (zh) * 2021-05-28 2021-10-15 西安闻泰信息技术有限公司 一种摄像头、拍照方法、终端及存储介质

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4179410B2 (ja) * 2002-10-30 2008-11-12 京セラ株式会社 ズームレンズ鏡胴
CN2757155Y (zh) * 2004-12-03 2006-02-08 鸿富锦精密工业（深圳）有限公司 镜头驱动机构
US8009371B2 (en) * 2005-09-02 2011-08-30 Nidec Sankyo Corporation Lens driving apparatus
JP2014126668A (ja) * 2012-12-26 2014-07-07 Mitsumi Electric Co Ltd レンズ駆動装置、カメラモジュール、及びカメラ付き携帯端末
CN203133369U (zh) * 2013-04-02 2013-08-14 嘉兴中润光学科技有限公司 一种防尘变焦镜头及其取像模组、移动通讯装置
CN203164572U (zh) * 2013-04-24 2013-08-28 蔡陆青 一种双重自动变焦镜头及其取像模组、移动通讯装置
WO2020022025A1 (fr) * 2018-07-26 2020-01-30 富士フイルム株式会社 Barillet de lentille, dispositif d'imagerie, procédé de commande de lentille et programme de commande de lentille
CN108777767A (zh) * 2018-08-22 2018-11-09 Oppo广东移动通信有限公司 拍照方法、装置、终端及计算机可读存储介质
CN208798061U (zh) * 2018-09-29 2019-04-26 广州希泰电子有限公司 一种手动调焦的监控摄像头
CN110673294A (zh) * 2019-10-10 2020-01-10 青岛海信激光显示股份有限公司 调焦方法及投影系统
CN111474702A (zh) * 2020-04-08 2020-07-31 深圳传音控股股份有限公司 镜头结构、摄像头、终端及其控制方法、计算机存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101118309A (zh) * 2006-08-01 2008-02-06 扬明光学股份有限公司 镜头模块
JP2008152240A (ja) * 2006-12-15 2008-07-03 Fuzhun Precision Industry (Shenzhen) Co Ltd 内蔵式焦点調節構造
CN104917959A (zh) * 2015-05-19 2015-09-16 广东欧珀移动通信有限公司 一种拍照方法及终端
CN209472670U (zh) * 2019-04-15 2019-10-08 深圳市飞斯贝尔科技有限公司 一种自动变焦摄像头
CN112526700A (zh) * 2020-12-21 2021-03-19 维沃移动通信有限公司 摄像头模组及电子设备
CN113507549A (zh) * 2021-05-28 2021-10-15 西安闻泰信息技术有限公司 一种摄像头、拍照方法、终端及存储介质

Also Published As

Publication number Publication date
CN113507549A (zh) 2021-10-15
CN113507549B (zh) 2022-10-14

Similar Documents

Publication Publication Date Title
US9712751B2 (en) Camera field of view effects based on device orientation and scene content
US9374529B1 (en) Enabling multiple field of view image capture within a surround image mode for multi-LENS mobile devices
CN110505411B (zh) 图像拍摄方法、装置、存储介质及电子设备
RU2649773C2 (ru) Управление камерой посредством функции распознавания лица
US11158027B2 (en) Image capturing method and apparatus, and terminal
WO2021047077A1 (fr) Procédé, appareil et dispositif de traitement d'images basés sur de multiples modules photographiques et support
KR102665654B1 (ko) 구도를 추천하기 위한 전자 장치 및 그의 동작 방법
CN111901524B (zh) 对焦方法、装置和电子设备
KR102059598B1 (ko) 디지털 촬영 장치 및 그의 제어 방법
CN108419008B (zh) 一种拍摄方法、终端及计算机可读存储介质
CN108259759A (zh) 对焦方法、装置及存储介质
KR102661185B1 (ko) 전자 장치 및 그의 이미지 촬영 방법
KR20100027700A (ko) 촬영 방법 및 장치
CN109905604A (zh) 对焦方法、装置、拍摄设备及飞行器
WO2023072088A1 (fr) Procédé et appareil de mise au point
CN115802158B (zh) 切换摄像头的方法与电子设备
CN112184722B (zh) 图像处理方法、终端及计算机存储介质
WO2022247731A1 (fr) Appareil photo, procédé de photographie, terminal et support de stockage
KR101817659B1 (ko) 디지털 촬영 장치 및 이의 제어 방법
WO2022156672A1 (fr) Procédé et appareil de photographie, dispositif électronique et support de stockage lisible
WO2021185374A1 (fr) Procédé de capture d'image et dispositif électronique
KR101094648B1 (ko) 구도결정을 하는 사진사 로봇 및 그 제어방법
CN111586280B (zh) 拍摄方法、装置、终端及可读存储介质
WO2023142830A1 (fr) Procédé de commutation de caméra et dispositif électronique
CN114339022B (zh) 摄像头拍摄参数确定方法、神经网络模型的训练方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22810458

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22810458

Country of ref document: EP

Kind code of ref document: A1