WO2019179413A1 - Depth-of-field image generating method and mobile terminal - Google Patents

Depth-of-field image generating method and mobile terminal Download PDF

Info

Publication number
WO2019179413A1
WO2019179413A1 PCT/CN2019/078635 CN2019078635W WO2019179413A1 WO 2019179413 A1 WO2019179413 A1 WO 2019179413A1 CN 2019078635 W CN2019078635 W CN 2019078635W WO 2019179413 A1 WO2019179413 A1 WO 2019179413A1
Authority
WO
WIPO (PCT)
Prior art keywords
lens
target
mobile terminal
image
motor
Prior art date
Application number
PCT/CN2019/078635
Other languages
French (fr)
Chinese (zh)
Inventor
王鹏
黎冠英
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2019179413A1 publication Critical patent/WO2019179413A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/676Bracketing for image capture at varying focusing conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/57Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/958Computational photography systems, e.g. light-field imaging systems for extended depth of field imaging
    • H04N23/959Computational photography systems, e.g. light-field imaging systems for extended depth of field imaging by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics

Definitions

  • the present disclosure relates to the field of communications technologies, and in particular, to a depth of field image generating method and a mobile terminal.
  • the experience of the electronic consumer product is also required to be higher and higher, especially the photographing demand; not only requires clearer and richer, but also has more A good visual experience, with the background blur effect of the SLR camera.
  • Professional cameras can achieve different depth of field effects by adjusting the aperture size. When shooting macros and portraits, the subject can be highlighted from the background to form a good visual effect.
  • a mobile terminal of a portable device it is apparent that there is not enough space to satisfy the aperture conversion like a professional camera lens, and a fixed aperture cannot achieve a specific depth of field conversion.
  • a dual camera is usually provided in the mobile terminal or a dual-pixel autofocus sensor is provided in the single camera. In this way, the cost of the mobile terminal will be higher.
  • Embodiments of the present disclosure provide a depth of field image generation method and a mobile terminal to solve the problem of high cost of the mobile terminal.
  • an embodiment of the present disclosure provides a method for generating a depth of field image, which is applied to a mobile terminal, where the mobile terminal includes a lens, an image chip, and a motor, and the method includes:
  • a depth of field image is obtained based on the target image.
  • an embodiment of the present disclosure further provides a mobile terminal, where the mobile terminal includes a lens, an image chip, and a motor, and the mobile terminal further includes:
  • control module configured to control the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
  • An acquiring module configured to acquire, at each target position in the target plane, a target image acquired by the image chip at each of the target locations, where the target position is at least two;
  • a processing module configured to obtain a depth image according to the target image.
  • FIG. 1 is a flowchart of a depth image generation method according to an embodiment of the present disclosure
  • FIG. 2 is an exploded structural diagram of an OIS module applied to a depth image generation method according to an embodiment of the present disclosure
  • FIG. 3 is a structural diagram of a motor in an OIS module to which a depth image generation method according to an embodiment of the present disclosure is applied;
  • FIG. 4 is a positional display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure
  • FIG. 5 is a second position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure
  • FIG. 6 is a third position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure
  • FIG. 7 is a fourth position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure
  • FIG. 8 is a fifth diagram of a position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure
  • FIG. 9 is a structural diagram of a mobile terminal according to an embodiment of the present disclosure.
  • FIG. 10 is a second structural diagram of a mobile terminal according to an embodiment of the present disclosure.
  • FIG. 1 is a flowchart of a method for generating a depth of field image according to an embodiment of the present disclosure.
  • the method for generating a depth of field image is applied to a mobile terminal for controlling generation of a depth of field image.
  • the mobile terminal includes an OIS module, and the OIS module includes a lens 201, a motor 202, a filter 203, a bracket 204, an image chip 205, a circuit board 206, a connector 207, and a resistor and capacitor.
  • 208 and driver IC 209 Integrated Circuit
  • the depth of field image generation method includes the following steps:
  • Step 101 controlling the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
  • the depth of field image may be generated in an application scenario such as taking a picture or capturing a video.
  • the depth of field image may be generated first, and then the generated depth image is used as a late stage.
  • Image blurring When a video is captured, if the mobile terminal receives a video capture command, a depth of field image can be generated, and then the generated depth image is subjected to post-3D or image blurring processing.
  • the process of generating a late 3D or image blurring process according to the depth of field image is not further limited herein.
  • the processor of the mobile terminal may output a control signal to control the motor to drive the lens to move in the target plane.
  • the processor may output a control signal to the driving IC 209 when receiving the photographing instruction or the video capturing instruction, and control the operation of the motor 202 through the driving IC 209 to drive the lens 201 to move in the target plane.
  • the motor 202 can drive the lens 201 to move in a target plane (XY plane) formed by the X-axis and the Y-axis.
  • Step 102 Acquire a target image acquired by the image chip at each of the target locations when the lens is located at each target position in the target plane, where the target location is at least two;
  • the target position includes the first position and the first obtained after the lens 201 moves in the first axial direction. a second position; or, the target position includes a first position and a second position obtained by moving the lens 201 in the first axial direction, and a third position and a fourth obtained after moving in the second axial direction position.
  • the first axial direction may be an axial direction of the X axis
  • the second axial direction may be an axial direction of the Y axis
  • the rear axial direction is not limited to one step here.
  • the control lens 201 is moved in the plane in the axial direction to obtain two or four target positions, the movement realization manner is simple, and the difficulty in generating the depth of field image can be reduced.
  • the specific positions of the first position, the second position, the third position, and the fourth position may be set according to actual needs.
  • the first position and the second position are the lens.
  • the first axially movable region is centrally symmetrically disposed
  • the third and fourth positions are centrally symmetrically disposed in the second axially movable region of the lens.
  • the distance between the first position and the second position may be maximized
  • the distance between the third position and the fourth position may be maximized.
  • the first position and the second position are extreme positions at which the lens is movable in the first axial direction; the third position and the fourth position are The limit position that can be moved in two axial directions.
  • the process in which the motor 202 can drive the lens 201 to move in the target plane is not further limited herein, which will be described in detail below.
  • the movable area of the lens 201 is the area 401.
  • the lens 201 In the case where the uncontrolled lens 201 is moved, the lens 201 is at the center of the area 401, which is the origin of the X-axis and the Y-axis.
  • the direction in which the first axial direction is the X-axis direction and the second axial direction is the Y-axis direction will be described as an example.
  • the lens 201 can be driven by the motor 202 to move in the negative direction of the X-axis, thereby reaching the boundary of the region 401, and the lens 201 is in the first position (as shown in FIG.
  • the lens 201 is driven by the motor 202 to move in the positive direction of the X-axis to reach the boundary of the region 401, at which time the lens 201 is in the second position (as shown in FIG. 6). If the target position is four, after moving to the first position and the second position respectively, the lens 201 can be driven to return to the origin by the motor 202, and then the lens 201 is driven by the motor 202 to move in the negative direction of the Y-axis, thereby reaching the area 401.
  • the boundary of the lens 201 is at the third position (as shown in Figure 7).
  • the lens 201 is then driven by the motor 202 to move in the positive direction of the Y-axis to reach the boundary of the region 401, at which time the lens 201 is in the fourth position (as shown in Fig. 8).
  • the first position and the second position are set as the limit positions of the first axial movement, the center distance between the first position and the second position is large, and the generated depth image is blurred. better.
  • the object to be photographed taking pictures at the first position, the second position, the third position, and the fourth position at the same time, the object to be photographed can be positioned to achieve a 3D effect.
  • the OIS motor in the related art is adopted, wherein the displacement between the first position and the second position can reach 0.5 mm, and the center distance of the photograph is much larger than the Dual pixel, which can be used for the depth of field application, and the effect is more than that of the Dual pixel. it is good.
  • Step 103 Obtain a depth of field image according to the target image.
  • DSP digital signal processing
  • the disparity map represents the displacement difference of the same point of the two images, but due to the displacement difference in the triangulation It is proportional to the target distance (the distance between the subject and the lens), so the disparity map is often used directly as a depth of field map.
  • this graph is stored in the form of a grayscale image.
  • a depth of field image is obtained by driving the lens through the motor and taking an image taken at at least two different positions. In this way, it is not necessary to provide a dual camera or a single camera in the mobile terminal to set a dual pixel auto focus sensor, thereby reducing the cost of the mobile terminal.
  • the structure of the above-mentioned motor 202 can be set according to actual needs.
  • the motor 202 can adopt an optical image stabilizer (OIS) motor in the related art.
  • the OIS motor includes an AF direction coil, two oppositely disposed first magnets, and two oppositely disposed second magnets.
  • the first magnet is for controlling movement of the lens in a first direction of the target plane;
  • the second magnet is for controlling movement of the lens in a second direction of the target plane, the second direction is
  • the first direction is vertical
  • the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane to perform AF focusing.
  • the AF direction is the Z-axis direction and is perpendicular to the target plane.
  • the first direction is a direction of the X axis
  • the second direction is a direction of the Y axis.
  • the motor 202 may be an OIS motor or a motor with a structural improvement of the OIS motor as long as the control lens 201 can be moved in the target plane.
  • the structure of the motor 202 adopts the following four cases.
  • the motor 202 is an OIS motor, that is, the motor 202 includes an AF direction coil, two oppositely disposed first magnets, and two oppositely disposed second magnets. Since the OIS motor in the related art is adopted, there is no need to improve the structure of the mobile terminal itself, and the scope of application is wide.
  • the second case: the motor 202 is an OIS motor that removes the second magnet, that is, the motor 202 includes an AF direction coil and two oppositely disposed first magnets. Since the design of the second magnet is removed, the volume of the motor 202 can be reduced while the cost of the mobile terminal can be further reduced.
  • the motor 202 is an OIS motor that removes the AF direction coil, that is, the motor 202 includes two oppositely disposed first magnets and two oppositely disposed second magnets. Since the design of the AF direction coil is removed, the volume of the motor 202 can be reduced, and the cost of the mobile terminal can be further reduced.
  • the motor 202 is an OIS motor that removes the AF direction coil and the second magnet, that is, the motor 202 includes two oppositely disposed first magnets. Since the design of the AF direction coil and the second magnet is removed, the volume of the motor 202 can be reduced, and the cost of the mobile terminal can be further reduced.
  • FIG. 9 is a structural diagram of a mobile terminal according to an embodiment of the present disclosure.
  • the mobile terminal provided by the embodiment of the present disclosure includes a lens, an image chip, and a motor. As shown in FIG. 9, the mobile terminal further includes:
  • control module 901 configured to control the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
  • the acquiring module 902 is configured to acquire, when the lens is located at each target position in the target plane, a target image acquired by the image chip at each of the target locations, where the target location is at least two;
  • the processing module 903 is configured to obtain a depth image according to the target image.
  • the target position includes a first position and a second position obtained after the lens is moved in the first axial direction; or the target position includes the lens after moving in the first axial direction The obtained first position and second position, and the third position and the fourth position obtained after moving in the second axial direction.
  • the first position and the second position are limit positions in which the lens is movable in a first axial direction; the third position and the fourth position are that the lens is movable in a second axial direction The extreme position.
  • the first axial direction is perpendicular to the second axial direction.
  • the motor includes two opposite first magnets, and the first magnet is configured to control movement of the lens in a first direction of the target plane.
  • the motor further includes an AF direction coil and/or two oppositely disposed second magnets, wherein the second magnet is configured to control movement of the lens in a second direction of the target plane, the second The direction is perpendicular to the first direction, and the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
  • the second magnet is configured to control movement of the lens in a second direction of the target plane
  • the second The direction is perpendicular to the first direction
  • the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
  • the mobile terminal provided by the embodiment of the present disclosure can implement various processes implemented by the mobile terminal in the method embodiment of FIG. 1 to FIG. 8. To avoid repetition, details are not described herein again. Since the lens is moved by the motor and the image taken at at least two different positions is captured, a depth of field image is obtained. In this way, it is not necessary to provide a dual camera or a single camera in the mobile terminal to set a dual pixel auto focus sensor, thereby reducing the cost of the mobile terminal.
  • FIG. 10 is a schematic diagram of a hardware structure of a mobile terminal that implements various embodiments of the present disclosure.
  • the mobile terminal 1000 includes, but is not limited to, a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, and a power supply. 1011, lens, video chip, and motor components. It will be understood by those skilled in the art that the mobile terminal structure shown in FIG. 10 does not constitute a limitation of the mobile terminal, and the mobile terminal may include more or less components than those illustrated, or combine some components, or different components. Arrangement.
  • the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle terminal, a wearable device, a pedometer, and the like.
  • the processor 1010 is configured to control the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip; and each target in the target plane of the lens In the position, the target image acquired by the image chip at each of the target positions is acquired, and the target position is at least two; and the depth image is obtained according to the target image.
  • the target position includes a first position and a second position obtained after the lens is moved in the first axial direction; or the target position includes the lens after moving in the first axial direction The obtained first position and second position, and the third position and the fourth position obtained after moving in the second axial direction.
  • the first position and the second position are limit positions in which the lens is movable in a first axial direction; the third position and the fourth position are that the lens is movable in a second axial direction The extreme position.
  • the first axial direction is perpendicular to the second axial direction.
  • the motor includes two opposite first magnets, and the first magnet is configured to control movement of the lens in a first direction of the target plane.
  • the motor further includes an AF direction coil and/or two oppositely disposed second magnets, wherein the second magnet is configured to control movement of the lens in a second direction of the target plane, the second The direction is perpendicular to the first direction, and the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
  • the second magnet is configured to control movement of the lens in a second direction of the target plane
  • the second The direction is perpendicular to the first direction
  • the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
  • the radio frequency unit 1001 can be used for receiving and transmitting signals during and after receiving or transmitting information or a call, and specifically, after receiving downlink data from the base station, processing the processor 1010; The uplink data is sent to the base station.
  • radio frequency unit 1001 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio unit 1001 can also communicate with the network and other devices through a wireless communication system.
  • the mobile terminal provides wireless broadband Internet access to the user through the network module 1002, such as helping the user to send and receive emails, browse web pages, and access streaming media.
  • the audio output unit 1003 can convert the audio data received by the radio frequency unit 1001 or the network module 1002 or stored in the memory 1009 into an audio signal and output as a sound. Moreover, the audio output unit 1003 may also provide audio output (eg, call signal reception sound, message reception sound, etc.) related to a specific function performed by the mobile terminal 1000.
  • the audio output unit 1003 includes a speaker, a buzzer, a receiver, and the like.
  • the input unit 1004 is for receiving an audio or video signal.
  • the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 images an still picture or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode.
  • the data is processed.
  • the processed image frame can be displayed on the display unit 1006.
  • the image frames processed by the graphics processor 10041 may be stored in the memory 1009 (or other storage medium) or transmitted via the radio frequency unit 1001 or the network module 1002.
  • the microphone 10042 can receive sound and can process such sound as audio data.
  • the processed audio data can be converted to a format output that can be transmitted to the mobile communication base station via the radio unit 1001 in the case of a telephone call mode.
  • the mobile terminal 1000 also includes at least one type of sensor 1005, such as a light sensor, motion sensor, and other sensors.
  • the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 10061 according to the brightness of the ambient light, and the proximity sensor can close the display panel 10061 when the mobile terminal 1000 moves to the ear. / or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the attitude of the mobile terminal (such as horizontal and vertical screen switching, related games).
  • sensor 1005 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors and the like are not described here.
  • the display unit 1006 is for displaying information input by the user or information provided to the user.
  • the display unit 1006 can include a display panel 10061.
  • the display panel 10061 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
  • the user input unit 1007 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the mobile terminal.
  • the user input unit 1007 includes a touch panel 10071 and other input devices 10072.
  • the touch panel 10071 also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 10071 or near the touch panel 10071. operating).
  • the touch panel 10071 may include two parts of a touch detection device and a touch controller.
  • the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
  • the processor 1010 receives the commands from the processor 1010 and executes them.
  • the touch panel 10071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the user input unit 1007 may also include other input devices 10072.
  • the other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which are not described herein.
  • the touch panel 10071 can be overlaid on the display panel 10061. After the touch panel 10071 detects a touch operation thereon or nearby, the touch panel 10071 transmits to the processor 1010 to determine the type of the touch event, and then the processor 1010 according to the touch. The type of event provides a corresponding visual output on display panel 10061.
  • the touch panel 10071 and the display panel 10061 are used as two independent components to implement the input and output functions of the mobile terminal in FIG. 10, in some embodiments, the touch panel 10071 and the display panel 10061 may be integrated. The input and output functions of the mobile terminal are implemented, and are not limited herein.
  • the interface unit 1008 is an interface in which an external device is connected to the mobile terminal 1000.
  • the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more.
  • the interface unit 1008 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 1000 or can be used at the mobile terminal 1000 and externally Data is transferred between devices.
  • an external device eg, data information, power, etc.
  • the memory 1009 can be used to store software programs as well as various data.
  • the memory 1009 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.).
  • the memory 1009 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
  • the processor 1010 is a control center of the mobile terminal that connects various portions of the entire mobile terminal using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 1009, and recalling data stored in the memory 1009.
  • the mobile terminal performs various functions and processing data to perform overall monitoring on the mobile terminal.
  • the processor 1010 may include one or more processing units; optionally, the processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application, etc., and a modulation solution
  • the processor mainly handles wireless communication. It will be appreciated that the above described modem processor may also not be integrated into the processor 1010.
  • the mobile terminal 1000 may further include a power source 1011 (such as a battery) for supplying power to various components.
  • a power source 1011 such as a battery
  • the power source 1011 may be logically connected to the processor 1010 through a power management system to manage charging, discharging, and power consumption through the power management system. Management and other functions.
  • the mobile terminal 1000 includes some functional modules not shown, and details are not described herein again.
  • an embodiment of the present disclosure further provides a mobile terminal, including a processor 1010, a memory 1009, a computer program stored on the memory 1009 and executable on the processor 1010, and the computer program is executed by the processor 1010.
  • a mobile terminal including a processor 1010, a memory 1009, a computer program stored on the memory 1009 and executable on the processor 1010, and the computer program is executed by the processor 1010.
  • the embodiment of the present disclosure further provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the computer program is executed by the processor, implements various processes of the foregoing depth image generation method embodiment, and can achieve the same Technical effects, to avoid repetition, will not be repeated here.
  • the computer readable storage medium such as a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present disclosure.
  • each functional unit in various embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the functions, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, a portion of the technical solution of the present disclosure that contributes in essence or to the related art or a part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several The instructions are for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present disclosure.
  • the foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

Provided in the present disclosure are a depth-of-field image generating method and a mobile terminal, the mobile terminal comprising a lens, an imaging chip, and a motor, and the method comprising: controlling the motor to drive the lens to move in a target plane, the target plane being parallel to the photosensitive surface of the imaging chip; when the lens is positioned in each target position in the target plane, acquiring a target image collected by the imaging chip in each target position, there being at least two target positions; and obtaining a depth-of-field image on the basis of the target images.

Description

景深图像生成方法及移动终端Depth of field image generation method and mobile terminal
相关申请的交叉引用Cross-reference to related applications
本申请主张在2018年3月21日在中国提交的中国专利申请号No.201810234190.1的优先权,其全部内容通过引用包含于此。The present application claims the priority of the Chinese Patent Application No. 20110123419, the entire disclosure of which is incorporated herein by reference.
技术领域Technical field
本公开涉及通信技术领域,尤其涉及一种景深图像生成方法及移动终端。The present disclosure relates to the field of communications technologies, and in particular, to a depth of field image generating method and a mobile terminal.
背景技术Background technique
随着摄像头在手机终端上的应用,人类在满足对智能产品的基础功能需求之后,对电子消费品的体验也要求越来越高,尤其是拍照需求;不仅要求更清晰更丰富,还要有更好的视觉体验,要有媲美单反相机的背景虚化效果。专业相机通过调解光圈大小来实现不同的景深效果,在拍摄微距、人像时,可以将拍摄对象从背景中突显出来,以此形成良好的视觉效果。但作为便携设备的移动终端,显然没有足够的空间满足同专业相机镜头般的光圈变换,而固定的光圈无法实现特定景深的转换。With the application of the camera on the mobile terminal, after the human being meets the basic functional requirements of the smart product, the experience of the electronic consumer product is also required to be higher and higher, especially the photographing demand; not only requires clearer and richer, but also has more A good visual experience, with the background blur effect of the SLR camera. Professional cameras can achieve different depth of field effects by adjusting the aperture size. When shooting macros and portraits, the subject can be highlighted from the background to form a good visual effect. However, as a mobile terminal of a portable device, it is apparent that there is not enough space to satisfy the aperture conversion like a professional camera lens, and a fixed aperture cannot achieve a specific depth of field conversion.
相关技术中的移动终端中,为了获得景深图像,在移动终端通常设置了双摄像头或者在单摄像头内设置双像素自动对焦(Dual-pixel autofocus)传感器。这样,将会导致移动终端的成本较高。In the mobile terminal in the related art, in order to obtain a depth of field image, a dual camera is usually provided in the mobile terminal or a dual-pixel autofocus sensor is provided in the single camera. In this way, the cost of the mobile terminal will be higher.
发明内容Summary of the invention
本公开实施例提供一种景深图像生成方法及移动终端,以解决移动终端的成本较高的问题。Embodiments of the present disclosure provide a depth of field image generation method and a mobile terminal to solve the problem of high cost of the mobile terminal.
为了解决上述技术问题,本公开是这样实现的:In order to solve the above technical problems, the present disclosure is implemented as follows:
第一方面,本公开实施例提供了一种景深图像生成方法,应用于移动终端,所述移动终端包括镜头、影像芯片和马达,所述方法包括:In a first aspect, an embodiment of the present disclosure provides a method for generating a depth of field image, which is applied to a mobile terminal, where the mobile terminal includes a lens, an image chip, and a motor, and the method includes:
控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;Controlling the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;Obtaining, at each target position in the target plane, the target image acquired by the image chip at each of the target positions, where the target position is at least two;
根据所述目标图像得到景深图像。A depth of field image is obtained based on the target image.
第二方面,本公开实施例还提供了一种移动终端,所述移动终端包括镜头、影像芯片和马达,所述移动终端还包括:In a second aspect, an embodiment of the present disclosure further provides a mobile terminal, where the mobile terminal includes a lens, an image chip, and a motor, and the mobile terminal further includes:
控制模块,用于控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;a control module, configured to control the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
获取模块,用于在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;An acquiring module, configured to acquire, at each target position in the target plane, a target image acquired by the image chip at each of the target locations, where the target position is at least two;
处理模块,用于根据所述目标图像得到景深图像。And a processing module, configured to obtain a depth image according to the target image.
本公开实施例中,控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;根据所述目标图像得到景深图像。由于通过马达驱动镜头移动,并拍摄获得至少两个不同位置拍摄的图像,从而得到景深图像。这样,无需在移动终端设置双摄像头或者单摄像头内设置双像素自动对焦传感器,从而可以降低移动终端的成本。In an embodiment of the present disclosure, controlling the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip; when the lens is located at each target position in the target plane And acquiring, by the image chip, a target image acquired at each of the target locations, where the target location is at least two; and obtaining a depth of field image according to the target image. Since the lens is moved by the motor and the image taken at at least two different positions is captured, a depth of field image is obtained. In this way, it is not necessary to provide a dual camera or a single camera in the mobile terminal to set a dual pixel auto focus sensor, thereby reducing the cost of the mobile terminal.
附图说明DRAWINGS
为了更清楚地说明本公开实施例的技术方案,下面将对本公开实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings used in the description of the embodiments of the present disclosure will be briefly described. It is obvious that the drawings in the following description are only some embodiments of the present disclosure. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings.
图1是本公开实施例提供的景深图像生成方法的流程图;FIG. 1 is a flowchart of a depth image generation method according to an embodiment of the present disclosure;
图2是本公开实施例提供的景深图像生成方法应用的OIS模组的爆炸结构图;2 is an exploded structural diagram of an OIS module applied to a depth image generation method according to an embodiment of the present disclosure;
图3是本公开实施例提供的景深图像生成方法应用的OIS模组中马达的结构图;3 is a structural diagram of a motor in an OIS module to which a depth image generation method according to an embodiment of the present disclosure is applied;
图4是本公开实施例提供的景深图像生成方法应用的OIS模组中镜头的位置展示图之一;4 is a positional display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure;
图5是本公开实施例提供的景深图像生成方法应用的OIS模组中镜头的位置展示图之二;5 is a second position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure;
图6是本公开实施例提供的景深图像生成方法应用的OIS模组中镜头的位置展示图之三;6 is a third position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure;
图7是本公开实施例提供的景深图像生成方法应用的OIS模组中镜头的位置展示图之四;7 is a fourth position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure;
图8是本公开实施例提供的景深图像生成方法应用的OIS模组中镜头的位置展示图之五;FIG. 8 is a fifth diagram of a position display diagram of a lens in an OIS module applied to a depth image generation method according to an embodiment of the present disclosure; FIG.
图9是本公开实施例提供的移动终端的结构图之一;FIG. 9 is a structural diagram of a mobile terminal according to an embodiment of the present disclosure;
图10是本公开实施例提供的移动终端的结构图之二。FIG. 10 is a second structural diagram of a mobile terminal according to an embodiment of the present disclosure.
具体实施方式detailed description
下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本公开保护的范围。The technical solutions in the embodiments of the present disclosure are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present disclosure. It is obvious that the described embodiments are a part of the embodiments of the present disclosure, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present disclosure without departing from the inventive scope are the scope of the disclosure.
参见图1,图1是本公开实施例提供的一种景深图像生成方法的流程图,该景深图像生成方法应用于移动终端,用于控制景深图像的生成。具体的,如图2所示,该移动终端包括OIS模组,该OIS模组包括镜头201、马达202、滤光片203、支架204、影像芯片205、线路板206、连接器207、电阻电容208和驱动IC 209(Integrated Circuit,集成电路)。如图1所示,景深图像生成方法包括以下步骤:Referring to FIG. 1 , FIG. 1 is a flowchart of a method for generating a depth of field image according to an embodiment of the present disclosure. The method for generating a depth of field image is applied to a mobile terminal for controlling generation of a depth of field image. Specifically, as shown in FIG. 2, the mobile terminal includes an OIS module, and the OIS module includes a lens 201, a motor 202, a filter 203, a bracket 204, an image chip 205, a circuit board 206, a connector 207, and a resistor and capacitor. 208 and driver IC 209 (Integrated Circuit). As shown in FIG. 1, the depth of field image generation method includes the following steps:
步骤101,控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面; Step 101, controlling the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
该步骤中,景深图像具体可以是在拍照或者拍摄视频等应用场景下生成的,例如,在进行拍照时,若移动终端接收到拍照指令,可以首先生成景深图像,然后根据生成的景深图像作后期的图像虚化处理。在拍摄视频时,若 移动终端接收到视频拍摄指令,可以生成景深图像,然后根据生成的景深图像作后期3D或图像虚化处理。具体的,生成根据景深图像作后期3D或图像虚化处理的过程在此不做进一步的限定。In this step, the depth of field image may be generated in an application scenario such as taking a picture or capturing a video. For example, when the camera takes a photo, if the mobile terminal receives the camera instruction, the depth of field image may be generated first, and then the generated depth image is used as a late stage. Image blurring. When a video is captured, if the mobile terminal receives a video capture command, a depth of field image can be generated, and then the generated depth image is subjected to post-3D or image blurring processing. Specifically, the process of generating a late 3D or image blurring process according to the depth of field image is not further limited herein.
本实施例中,移动终端的处理器可以输出控制信号控制所述马达驱动所述镜头在目标平面内移动。具体的,该处理器在接收到拍照指令或者视频拍摄指令的情况下,可以输出控制信号到驱动IC 209,通过驱动IC 209控制马达202工作,以驱动镜头201在目标平面内进行移动。如图3所示,马达202可以驱动镜头201在X轴和Y轴构成的目标平面(XY平面)内进行移动。In this embodiment, the processor of the mobile terminal may output a control signal to control the motor to drive the lens to move in the target plane. Specifically, the processor may output a control signal to the driving IC 209 when receiving the photographing instruction or the video capturing instruction, and control the operation of the motor 202 through the driving IC 209 to drive the lens 201 to move in the target plane. As shown in FIG. 3, the motor 202 can drive the lens 201 to move in a target plane (XY plane) formed by the X-axis and the Y-axis.
步骤102,在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;Step 102: Acquire a target image acquired by the image chip at each of the target locations when the lens is located at each target position in the target plane, where the target location is at least two;
应理解,上述目标位置的具体的位置和数量可以根据实际需要进行设置,例如,在本实施例中,上述目标位置包括所述镜头201在第一轴向上移动后得到的第一位置和第二位置;或者,上述目标位置包括所述镜头201在所述第一轴向上移动后得到的第一位置和第二位置,以及在第二轴向上移动后得到的第三位置和第四位置。其中,上述第一轴向可以为X轴的轴向,第二轴向可以为Y轴的轴向,当然还可以是其他轴向,例如可以是相对于X轴顺时针或者逆时针旋转一定角度后的轴向,在此不做进行一步的限定。本实施例中,由于控制镜头201在平面内沿轴向移动,得到两个或者四个目标位置,移动实现方式简单,同时可以降低景深图像的生成难度。It should be understood that the specific position and the number of the above-mentioned target positions may be set according to actual needs. For example, in the embodiment, the target position includes the first position and the first obtained after the lens 201 moves in the first axial direction. a second position; or, the target position includes a first position and a second position obtained by moving the lens 201 in the first axial direction, and a third position and a fourth obtained after moving in the second axial direction position. Wherein, the first axial direction may be an axial direction of the X axis, and the second axial direction may be an axial direction of the Y axis, and of course may be other axial directions, for example, may be rotated clockwise or counterclockwise with respect to the X axis. The rear axial direction is not limited to one step here. In this embodiment, since the control lens 201 is moved in the plane in the axial direction to obtain two or four target positions, the movement realization manner is simple, and the difficulty in generating the depth of field image can be reduced.
应当说明的是,上述第一位置、第二位置、第三位置和第四位置的具体位置可以根据实际需要进行设置,例如在本实施例中,上述第一位置和第二位置为所述镜头在第一轴向上可移动的区域内呈中心对称设置,上述第三位置和第四位置为所述镜头在第二轴向上可移动的区域内呈中心对称设置。进一步的,为了得到较好的深度图像,避免深度信息较浅和不准确,可以设置第一位置和第二位置的间距最大化,同时可以设置第三位置和第四位置的间距最大化。也就是说,在本实施例中,所述第一位置和第二位置为所述镜头在第一轴向上可移动的极限位置;所述第三位置和第四位置为所述镜头在第二轴向上可移动的极限位置。具体的,马达202可以驱动镜头201在目标平面内移动的过程在此不做进一步限定,以下对此进行详细说明。It should be noted that the specific positions of the first position, the second position, the third position, and the fourth position may be set according to actual needs. For example, in the embodiment, the first position and the second position are the lens. The first axially movable region is centrally symmetrically disposed, and the third and fourth positions are centrally symmetrically disposed in the second axially movable region of the lens. Further, in order to obtain a better depth image and avoid shallower and inaccurate depth information, the distance between the first position and the second position may be maximized, and the distance between the third position and the fourth position may be maximized. That is, in the embodiment, the first position and the second position are extreme positions at which the lens is movable in the first axial direction; the third position and the fourth position are The limit position that can be moved in two axial directions. Specifically, the process in which the motor 202 can drive the lens 201 to move in the target plane is not further limited herein, which will be described in detail below.
如图4所示,镜头201可移动的区域为区域401,在未控制镜头201移动的情况下,镜头201处于区域401的正中心,该正中心为X轴和Y轴的原点。以上述第一轴向为X轴的方向,上述第二轴向为Y轴的方向为例进行说明。具体的,若目标位置为两个,可以通过马达202驱动镜头201向X轴的负方向移动,从而达到区域401的边界,此时镜头201处于第一位置(如图5所示);然后可以通过马达202驱动镜头201向X轴的正方向移动,从而达到区域401的边界,此时镜头201处于第二位置(如图6所示)。若目标位置为四个,在分别移动到第一位置和第二位置后,可以通过马达202驱动镜头201回到原点,然后通过马达202驱动镜头201向Y轴的负方向移动,从而达到区域401的边界,此时镜头201处于第三位置(如图7所示)。接着通过马达202驱动镜头201向Y轴的正方向移动,从而达到区域401的边界,此时镜头201处于第四位置(如图8所示)。As shown in FIG. 4, the movable area of the lens 201 is the area 401. In the case where the uncontrolled lens 201 is moved, the lens 201 is at the center of the area 401, which is the origin of the X-axis and the Y-axis. The direction in which the first axial direction is the X-axis direction and the second axial direction is the Y-axis direction will be described as an example. Specifically, if the target position is two, the lens 201 can be driven by the motor 202 to move in the negative direction of the X-axis, thereby reaching the boundary of the region 401, and the lens 201 is in the first position (as shown in FIG. 5); The lens 201 is driven by the motor 202 to move in the positive direction of the X-axis to reach the boundary of the region 401, at which time the lens 201 is in the second position (as shown in FIG. 6). If the target position is four, after moving to the first position and the second position respectively, the lens 201 can be driven to return to the origin by the motor 202, and then the lens 201 is driven by the motor 202 to move in the negative direction of the Y-axis, thereby reaching the area 401. The boundary of the lens 201 is at the third position (as shown in Figure 7). The lens 201 is then driven by the motor 202 to move in the positive direction of the Y-axis to reach the boundary of the region 401, at which time the lens 201 is in the fourth position (as shown in Fig. 8).
由于在本实施例中,第一位置和第二位置设置为第一轴向上移动的极限位置,因此在第一位置和第二位置的中心距较大,产生的景深图像进行虚化的效果较好。此外,同时在第一位置、第二位置、第三位置和第四位置进行拍照,可以定位被拍摄物体,实现3D效果。具体的,采用相关技术中的OIS马达,其中第一位置和第二位置之间的位移可以达到0.5mm,拍照的中心距比Dual pixel大很多,可以用来做景深应用,效果比Dual pixel的好。Since in the present embodiment, the first position and the second position are set as the limit positions of the first axial movement, the center distance between the first position and the second position is large, and the generated depth image is blurred. better. In addition, taking pictures at the first position, the second position, the third position, and the fourth position at the same time, the object to be photographed can be positioned to achieve a 3D effect. Specifically, the OIS motor in the related art is adopted, wherein the displacement between the first position and the second position can reach 0.5 mm, and the center distance of the photograph is much larger than the Dual pixel, which can be used for the depth of field application, and the effect is more than that of the Dual pixel. it is good.
步骤103,根据所述目标图像得到景深图像。Step 103: Obtain a depth of field image according to the target image.
本实施例中,可以对所述目标图像进行数字信号处理DSP(digital signal processing),得到景深图像。具体的,通过在两张目标图像计算出不同点差异的图(Disparity Map)(即,视差图),这个视差图表示的是两张图像相同点的位移差异,但是由于三角定位中的位移差异和目标距离(被拍摄物体与镜头的距离)成正比,因此很多时候视差图就直接被用作景深图,多数时候这个图是以灰度图的形式进行存储。In this embodiment, digital signal processing (DSP) can be performed on the target image to obtain a depth of field image. Specifically, by calculating a disparity map (ie, a disparity map) of the difference between the two target images, the disparity map represents the displacement difference of the same point of the two images, but due to the displacement difference in the triangulation It is proportional to the target distance (the distance between the subject and the lens), so the disparity map is often used directly as a depth of field map. Most of the time, this graph is stored in the form of a grayscale image.
本公开实施例中,控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;根据所述目标图像得到景深图像。由于通过马达 驱动镜头移动,并拍摄获得至少两个不同位置拍摄的图像,从而得到景深图像。这样,无需在移动终端设置双摄像头或者单摄像头内设置双像素自动对焦传感器,从而可以降低移动终端的成本。In an embodiment of the present disclosure, controlling the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip; when the lens is located at each target position in the target plane And acquiring, by the image chip, a target image acquired at each of the target locations, where the target location is at least two; and obtaining a depth of field image according to the target image. A depth of field image is obtained by driving the lens through the motor and taking an image taken at at least two different positions. In this way, it is not necessary to provide a dual camera or a single camera in the mobile terminal to set a dual pixel auto focus sensor, thereby reducing the cost of the mobile terminal.
应当说明的是,上述马达202的结构可以根据实际需要进行设置,例如在本实施例中,上述马达202可以采用相关技术中的光学图像稳定器(Optical Image Stabilizer,OIS)马达。具体的,OIS马达包括AF方向线圈、两相对设置的第一磁铁和两相对设置的第二磁铁。其中,第一磁铁用于控制所述镜头在所述目标平面的第一方向上移动;第二磁铁用于控制所述镜头在所述目标平面的第二方向上移动,所述第二方向与所述第一方向垂直,所述AF方向线圈用于控制所述镜头在垂直于所述目标平面的第三方向上移动,以进行AF对焦。上述AF方向即为Z轴方向,与上述目标平面垂直。It should be noted that the structure of the above-mentioned motor 202 can be set according to actual needs. For example, in the embodiment, the motor 202 can adopt an optical image stabilizer (OIS) motor in the related art. Specifically, the OIS motor includes an AF direction coil, two oppositely disposed first magnets, and two oppositely disposed second magnets. Wherein the first magnet is for controlling movement of the lens in a first direction of the target plane; the second magnet is for controlling movement of the lens in a second direction of the target plane, the second direction is The first direction is vertical, and the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane to perform AF focusing. The AF direction is the Z-axis direction and is perpendicular to the target plane.
其中,上述第一方向为X轴的方向,第二方向为Y轴的方向。The first direction is a direction of the X axis, and the second direction is a direction of the Y axis.
基于上述方案,马达202也可以是OIS马达,也可以是对OIS马达进行结构改进后的马达,只要能够实现控制镜头201在上述目标平面移动即可。在本实施例中马达202的结构采用以下四种情况。Based on the above-described scheme, the motor 202 may be an OIS motor or a motor with a structural improvement of the OIS motor as long as the control lens 201 can be moved in the target plane. In the present embodiment, the structure of the motor 202 adopts the following four cases.
第一种情况:马达202为OIS马达,即马达202包括AF方向线圈、两相对设置的第一磁铁和两相对设置的第二磁铁。由于采用相关技术中的OIS马达,无需对移动终端本身的结构进行改进,适用范围较广。In the first case, the motor 202 is an OIS motor, that is, the motor 202 includes an AF direction coil, two oppositely disposed first magnets, and two oppositely disposed second magnets. Since the OIS motor in the related art is adopted, there is no need to improve the structure of the mobile terminal itself, and the scope of application is wide.
第二种情况:马达202为去除第二磁铁的OIS马达,即马达202包括AF方向线圈和两相对设置的第一磁铁。由于去除了第二磁铁的设计,可以减少马达202的体积,同时可以进一步降低移动终端的成本。The second case: the motor 202 is an OIS motor that removes the second magnet, that is, the motor 202 includes an AF direction coil and two oppositely disposed first magnets. Since the design of the second magnet is removed, the volume of the motor 202 can be reduced while the cost of the mobile terminal can be further reduced.
第三种情况:马达202为去除AF方向线圈的OIS马达,即马达202包括两相对设置的第一磁铁和两相对设置的第二磁铁。由于去除了AF方向线圈的设计,可以减少马达202的体积,同时可以进一步降低移动终端的成本。In the third case, the motor 202 is an OIS motor that removes the AF direction coil, that is, the motor 202 includes two oppositely disposed first magnets and two oppositely disposed second magnets. Since the design of the AF direction coil is removed, the volume of the motor 202 can be reduced, and the cost of the mobile terminal can be further reduced.
第四种情况:马达202为去除AF方向线圈和第二磁铁的OIS马达,即马达202包括两相对设置的第一磁铁。由于去除了AF方向线圈和第二磁铁的设计,可以减少马达202的体积,同时可以进一步降低移动终端的成本。In the fourth case, the motor 202 is an OIS motor that removes the AF direction coil and the second magnet, that is, the motor 202 includes two oppositely disposed first magnets. Since the design of the AF direction coil and the second magnet is removed, the volume of the motor 202 can be reduced, and the cost of the mobile terminal can be further reduced.
需要说明的是,本公开实施例中介绍的多种可选的实施方式,彼此可以相互结合实现,也可以单独实现,对此本公开实施例不作限定。It should be noted that the various optional embodiments described in the embodiments of the present disclosure may be implemented in combination with each other, or may be implemented separately, and the embodiments of the present disclosure are not limited thereto.
参见图9,图9是本公开实施例提供的移动终端的结构图,本公开实施例提供的移动终端包括镜头、影像芯片和马达,如图9所示,所述移动终端还包括:Referring to FIG. 9, FIG. 9 is a structural diagram of a mobile terminal according to an embodiment of the present disclosure. The mobile terminal provided by the embodiment of the present disclosure includes a lens, an image chip, and a motor. As shown in FIG. 9, the mobile terminal further includes:
控制模块901,用于控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;a control module 901, configured to control the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
获取模块902,用于在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;The acquiring module 902 is configured to acquire, when the lens is located at each target position in the target plane, a target image acquired by the image chip at each of the target locations, where the target location is at least two;
处理模块903,用于根据所述目标图像得到景深图像。The processing module 903 is configured to obtain a depth image according to the target image.
可选的,所述目标位置包括所述镜头在第一轴向上移动后得到的第一位置和第二位置;或者,所述目标位置包括所述镜头在所述第一轴向上移动后得到的第一位置和第二位置,以及在第二轴向上移动后得到的第三位置和第四位置。Optionally, the target position includes a first position and a second position obtained after the lens is moved in the first axial direction; or the target position includes the lens after moving in the first axial direction The obtained first position and second position, and the third position and the fourth position obtained after moving in the second axial direction.
可选的,所述第一位置和第二位置为所述镜头在第一轴向上可移动的极限位置;所述第三位置和第四位置为所述镜头在第二轴向上可移动的极限位置。Optionally, the first position and the second position are limit positions in which the lens is movable in a first axial direction; the third position and the fourth position are that the lens is movable in a second axial direction The extreme position.
可选的,所述第一轴向与所述第二轴向垂直。Optionally, the first axial direction is perpendicular to the second axial direction.
可选的,所述马达包括两相对设置的第一磁铁,所述第一磁铁用于控制所述镜头在所述目标平面的第一方向上移动。Optionally, the motor includes two opposite first magnets, and the first magnet is configured to control movement of the lens in a first direction of the target plane.
可选的,所述马达还包括AF方向线圈和/或两相对设置的第二磁铁,所述第二磁铁用于控制所述镜头在所述目标平面的第二方向上移动,所述第二方向与所述第一方向垂直,所述AF方向线圈用于控制所述镜头在垂直于所述目标平面的第三方向上移动,以进行AF对焦。Optionally, the motor further includes an AF direction coil and/or two oppositely disposed second magnets, wherein the second magnet is configured to control movement of the lens in a second direction of the target plane, the second The direction is perpendicular to the first direction, and the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
本公开实施例提供的移动终端能够实现图1至图8的方法实施例中移动终端实现的各个过程,为避免重复,这里不再赘述。由于通过马达驱动镜头移动,并拍摄获得至少两个不同位置拍摄的图像,从而得到景深图像。这样,无需在移动终端设置双摄像头或者单摄像头内设置双像素自动对焦传感器,从而可以降低移动终端的成本。The mobile terminal provided by the embodiment of the present disclosure can implement various processes implemented by the mobile terminal in the method embodiment of FIG. 1 to FIG. 8. To avoid repetition, details are not described herein again. Since the lens is moved by the motor and the image taken at at least two different positions is captured, a depth of field image is obtained. In this way, it is not necessary to provide a dual camera or a single camera in the mobile terminal to set a dual pixel auto focus sensor, thereby reducing the cost of the mobile terminal.
图10为实现本公开各个实施例的一种移动终端的硬件结构示意图。FIG. 10 is a schematic diagram of a hardware structure of a mobile terminal that implements various embodiments of the present disclosure.
该移动终端1000包括但不限于:射频单元1001、网络模块1002、音频输出单元1003、输入单元1004、传感器1005、显示单元1006、用户输入单元1007、接口单元1008、存储器1009、处理器1010、电源1011、镜头、影像芯片、以及马达等部件。本领域技术人员可以理解,图10中示出的移动终端结构并不构成对移动终端的限定,移动终端可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。在本公开实施例中,移动终端包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载终端、可穿戴设备、以及计步器等。The mobile terminal 1000 includes, but is not limited to, a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, a processor 1010, and a power supply. 1011, lens, video chip, and motor components. It will be understood by those skilled in the art that the mobile terminal structure shown in FIG. 10 does not constitute a limitation of the mobile terminal, and the mobile terminal may include more or less components than those illustrated, or combine some components, or different components. Arrangement. In the embodiments of the present disclosure, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle terminal, a wearable device, a pedometer, and the like.
其中,处理器1010,用于控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;根据所述目标图像得到景深图像。The processor 1010 is configured to control the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip; and each target in the target plane of the lens In the position, the target image acquired by the image chip at each of the target positions is acquired, and the target position is at least two; and the depth image is obtained according to the target image.
可选的,所述目标位置包括所述镜头在第一轴向上移动后得到的第一位置和第二位置;或者,所述目标位置包括所述镜头在所述第一轴向上移动后得到的第一位置和第二位置,以及在第二轴向上移动后得到的第三位置和第四位置。Optionally, the target position includes a first position and a second position obtained after the lens is moved in the first axial direction; or the target position includes the lens after moving in the first axial direction The obtained first position and second position, and the third position and the fourth position obtained after moving in the second axial direction.
可选的,所述第一位置和第二位置为所述镜头在第一轴向上可移动的极限位置;所述第三位置和第四位置为所述镜头在第二轴向上可移动的极限位置。Optionally, the first position and the second position are limit positions in which the lens is movable in a first axial direction; the third position and the fourth position are that the lens is movable in a second axial direction The extreme position.
可选的,所述第一轴向与所述第二轴向垂直。Optionally, the first axial direction is perpendicular to the second axial direction.
可选的,所述马达包括两相对设置的第一磁铁,所述第一磁铁用于控制所述镜头在所述目标平面的第一方向上移动。Optionally, the motor includes two opposite first magnets, and the first magnet is configured to control movement of the lens in a first direction of the target plane.
可选的,所述马达还包括AF方向线圈和/或两相对设置的第二磁铁,所述第二磁铁用于控制所述镜头在所述目标平面的第二方向上移动,所述第二方向与所述第一方向垂直,所述AF方向线圈用于控制所述镜头在垂直于所述目标平面的第三方向上移动,以进行AF对焦。Optionally, the motor further includes an AF direction coil and/or two oppositely disposed second magnets, wherein the second magnet is configured to control movement of the lens in a second direction of the target plane, the second The direction is perpendicular to the first direction, and the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
本公开实施例中,控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像, 所述目标位置至少为两个;根据所述目标图像得到景深图像。由于通过马达驱动镜头移动,并拍摄获得至少两个不同位置拍摄的图像,从而得到景深图像。这样,无需在移动终端设置双摄像头或者单摄像头内设置双像素自动对焦传感器,从而可以降低移动终端的成本。In an embodiment of the present disclosure, controlling the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip; when the lens is located at each target position in the target plane And acquiring, by the image chip, a target image acquired at each of the target locations, where the target location is at least two; and obtaining a depth of field image according to the target image. Since the lens is moved by the motor and the image taken at at least two different positions is captured, a depth of field image is obtained. In this way, it is not necessary to provide a dual camera or a single camera in the mobile terminal to set a dual pixel auto focus sensor, thereby reducing the cost of the mobile terminal.
应理解的是,本公开实施例中,射频单元1001可用于收发信息或通话过程中,信号的接收和发送,具体的,将来自基站的下行数据接收后,给处理器1010处理;另外,将上行的数据发送给基站。通常,射频单元1001包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频单元1001还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in the embodiment of the present disclosure, the radio frequency unit 1001 can be used for receiving and transmitting signals during and after receiving or transmitting information or a call, and specifically, after receiving downlink data from the base station, processing the processor 1010; The uplink data is sent to the base station. In general, radio frequency unit 1001 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio unit 1001 can also communicate with the network and other devices through a wireless communication system.
移动终端通过网络模块1002为用户提供了无线的宽带互联网访问,如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The mobile terminal provides wireless broadband Internet access to the user through the network module 1002, such as helping the user to send and receive emails, browse web pages, and access streaming media.
音频输出单元1003可以将射频单元1001或网络模块1002接收的或者在存储器1009中存储的音频数据转换成音频信号并且输出为声音。而且,音频输出单元1003还可以提供与移动终端1000执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出单元1003包括扬声器、蜂鸣器以及受话器等。The audio output unit 1003 can convert the audio data received by the radio frequency unit 1001 or the network module 1002 or stored in the memory 1009 into an audio signal and output as a sound. Moreover, the audio output unit 1003 may also provide audio output (eg, call signal reception sound, message reception sound, etc.) related to a specific function performed by the mobile terminal 1000. The audio output unit 1003 includes a speaker, a buzzer, a receiver, and the like.
输入单元1004用于接收音频或视频信号。输入单元1004可以包括图形处理器(Graphics Processing Unit,GPU)10041和麦克风10042,图形处理器10041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元1006上。经图形处理器10041处理后的图像帧可以存储在存储器1009(或其它存储介质)中或者经由射频单元1001或网络模块1002进行发送。麦克风10042可以接收声音,并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元1001发送到移动通信基站的格式输出。The input unit 1004 is for receiving an audio or video signal. The input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 images an still picture or video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The data is processed. The processed image frame can be displayed on the display unit 1006. The image frames processed by the graphics processor 10041 may be stored in the memory 1009 (or other storage medium) or transmitted via the radio frequency unit 1001 or the network module 1002. The microphone 10042 can receive sound and can process such sound as audio data. The processed audio data can be converted to a format output that can be transmitted to the mobile communication base station via the radio unit 1001 in the case of a telephone call mode.
移动终端1000还包括至少一种传感器1005,比如光传感器、运动传感器以及其他传感器。具体地,光传感器包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板10061的亮度,接近传感器可在移动终端1000移动到耳边时,关闭显示面板10061和/或背光。 作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别移动终端姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;传感器1005还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等,在此不再赘述。The mobile terminal 1000 also includes at least one type of sensor 1005, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 10061 according to the brightness of the ambient light, and the proximity sensor can close the display panel 10061 when the mobile terminal 1000 moves to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the attitude of the mobile terminal (such as horizontal and vertical screen switching, related games). , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; sensor 1005 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors and the like are not described here.
显示单元1006用于显示由用户输入的信息或提供给用户的信息。显示单元1006可包括显示面板10061,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板10061。The display unit 1006 is for displaying information input by the user or information provided to the user. The display unit 1006 can include a display panel 10061. The display panel 10061 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
用户输入单元1007可用于接收输入的数字或字符信息,以及产生与移动终端的用户设置以及功能控制有关的键信号输入。具体地,用户输入单元1007包括触控面板10071以及其他输入设备10072。触控面板10071,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板10071上或在触控面板10071附近的操作)。触控面板10071可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器1010,接收处理器1010发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板10071。除了触控面板10071,用户输入单元1007还可以包括其他输入设备10072。具体地,其他输入设备10072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。The user input unit 1007 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071, also referred to as a touch screen, can collect touch operations on or near the user (such as the user using a finger, a stylus, or the like on the touch panel 10071 or near the touch panel 10071. operating). The touch panel 10071 may include two parts of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 1010 receives the commands from the processor 1010 and executes them. In addition, the touch panel 10071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 10071, the user input unit 1007 may also include other input devices 10072. Specifically, the other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which are not described herein.
进一步的,触控面板10071可覆盖在显示面板10061上,当触控面板10071检测到在其上或附近的触摸操作后,传送给处理器1010以确定触摸事件的类型,随后处理器1010根据触摸事件的类型在显示面板10061上提供相应的视觉输出。虽然在图10中,触控面板10071与显示面板10061是作为两个独立的部件来实现移动终端的输入和输出功能,但是在某些实施例中,可以将触控面板10071与显示面板10061集成而实现移动终端的输入和输出功能,具 体此处不做限定。Further, the touch panel 10071 can be overlaid on the display panel 10061. After the touch panel 10071 detects a touch operation thereon or nearby, the touch panel 10071 transmits to the processor 1010 to determine the type of the touch event, and then the processor 1010 according to the touch. The type of event provides a corresponding visual output on display panel 10061. Although the touch panel 10071 and the display panel 10061 are used as two independent components to implement the input and output functions of the mobile terminal in FIG. 10, in some embodiments, the touch panel 10071 and the display panel 10061 may be integrated. The input and output functions of the mobile terminal are implemented, and are not limited herein.
接口单元1008为外部装置与移动终端1000连接的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元1008可以用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到移动终端1000内的一个或多个元件或者可以用于在移动终端1000和外部装置之间传输数据。The interface unit 1008 is an interface in which an external device is connected to the mobile terminal 1000. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The interface unit 1008 can be configured to receive input from an external device (eg, data information, power, etc.) and transmit the received input to one or more components within the mobile terminal 1000 or can be used at the mobile terminal 1000 and externally Data is transferred between devices.
存储器1009可用于存储软件程序以及各种数据。存储器1009可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器1009可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 1009 can be used to store software programs as well as various data. The memory 1009 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.). Further, the memory 1009 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
处理器1010是移动终端的控制中心,利用各种接口和线路连接整个移动终端的各个部分,通过运行或执行存储在存储器1009内的软件程序和/或模块,以及调用存储在存储器1009内的数据,执行移动终端的各种功能和处理数据,从而对移动终端进行整体监控。处理器1010可包括一个或多个处理单元;可选的,处理器1010可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器1010中。The processor 1010 is a control center of the mobile terminal that connects various portions of the entire mobile terminal using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 1009, and recalling data stored in the memory 1009. The mobile terminal performs various functions and processing data to perform overall monitoring on the mobile terminal. The processor 1010 may include one or more processing units; optionally, the processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application, etc., and a modulation solution The processor mainly handles wireless communication. It will be appreciated that the above described modem processor may also not be integrated into the processor 1010.
移动终端1000还可以包括给各个部件供电的电源1011(比如电池),可选的,电源1011可以通过电源管理系统与处理器1010逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The mobile terminal 1000 may further include a power source 1011 (such as a battery) for supplying power to various components. Alternatively, the power source 1011 may be logically connected to the processor 1010 through a power management system to manage charging, discharging, and power consumption through the power management system. Management and other functions.
另外,移动终端1000包括一些未示出的功能模块,在此不再赘述。In addition, the mobile terminal 1000 includes some functional modules not shown, and details are not described herein again.
可选的,本公开实施例还提供一种移动终端,包括处理器1010,存储器1009,存储在存储器1009上并可在所述处理器1010上运行的计算机程序,该计算机程序被处理器1010执行时实现上述景深图像生成方法实施例的各 个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Optionally, an embodiment of the present disclosure further provides a mobile terminal, including a processor 1010, a memory 1009, a computer program stored on the memory 1009 and executable on the processor 1010, and the computer program is executed by the processor 1010. The various processes of the foregoing method for generating the depth of field image are implemented, and the same technical effects can be achieved. To avoid repetition, details are not described herein again.
本公开实施例还提供一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,该计算机程序被处理器执行时实现上述景深图像生成方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。其中,所述的计算机可读存储介质,如只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等。The embodiment of the present disclosure further provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the computer program is executed by the processor, implements various processes of the foregoing depth image generation method embodiment, and can achieve the same Technical effects, to avoid repetition, will not be repeated here. The computer readable storage medium, such as a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本公开的范围。Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present disclosure.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
在本申请所提供的实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the embodiments provided by the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本公开实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present disclosure.
另外,在本公开各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in various embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用 时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本公开的技术方案本质上或者说对相关技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本公开各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。The functions, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, a portion of the technical solution of the present disclosure that contributes in essence or to the related art or a part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several The instructions are for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present disclosure. The foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
以上所述,仅为本公开的具体实施方式,但本公开的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本公开揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本公开的保护范围之内。因此,本公开的保护范围应以权利要求的保护范围为准。The above is only the specific embodiment of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the disclosure. It should be covered within the scope of protection of the present disclosure. Therefore, the scope of protection of the disclosure should be determined by the scope of the claims.

Claims (14)

  1. 一种景深图像生成方法,应用于移动终端,所述移动终端包括镜头、影像芯片和马达,所述方法包括:A depth of field image generating method is applied to a mobile terminal, the mobile terminal comprising a lens, an image chip and a motor, the method comprising:
    控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;Controlling the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
    在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;Obtaining, at each target position in the target plane, the target image acquired by the image chip at each of the target positions, where the target position is at least two;
    根据所述目标图像得到景深图像。A depth of field image is obtained based on the target image.
  2. 根据权利要求1所述的方法,其中,所述目标位置包括所述镜头在第一轴向上移动后得到的第一位置和第二位置;或者,所述目标位置包括所述镜头在所述第一轴向上移动后得到的第一位置和第二位置,以及在第二轴向上移动后得到的第三位置和第四位置。The method of claim 1, wherein the target position comprises a first position and a second position obtained after the lens is moved in a first axial direction; or the target position comprises the lens in the a first position and a second position obtained after the first axial movement, and a third position and a fourth position obtained after moving in the second axial direction.
  3. 根据权利要求2所述的方法,其中,所述第一位置和第二位置为所述镜头在第一轴向上可移动的极限位置;所述第三位置和第四位置为所述镜头在第二轴向上可移动的极限位置。The method of claim 2, wherein the first position and the second position are extreme positions at which the lens is movable in a first axial direction; the third position and the fourth position are The second axially movable limit position.
  4. 根据权利要求2所述的方法,其中,所述第一轴向与所述第二轴向垂直。The method of claim 2 wherein said first axial direction is perpendicular to said second axial direction.
  5. 根据权利要求1所述的方法,其中,所述马达包括两相对设置的第一磁铁,所述第一磁铁用于控制所述镜头在所述目标平面的第一方向上移动。The method of claim 1 wherein said motor includes two opposing first magnets for controlling movement of said lens in a first direction of said target plane.
  6. 根据权利要求5所述的方法,其中,所述马达还包括AF方向线圈和/或两相对设置的第二磁铁,所述第二磁铁用于控制所述镜头在所述目标平面的第二方向上移动,所述第二方向与所述第一方向垂直,所述AF方向线圈用于控制所述镜头在垂直于所述目标平面的第三方向上移动,以进行AF对焦。The method according to claim 5, wherein said motor further comprises an AF direction coil and/or two oppositely disposed second magnets, said second magnet for controlling said lens in a second direction of said target plane Moving upward, the second direction is perpendicular to the first direction, and the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
  7. 一种移动终端,包括镜头、影像芯片和马达,其中,所述移动终端还包括:A mobile terminal includes a lens, an image chip, and a motor, wherein the mobile terminal further includes:
    控制模块,用于控制所述马达驱动所述镜头在目标平面内移动,所述目标平面平行于所述影像芯片的感光面;a control module, configured to control the motor to drive the lens to move in a target plane, the target plane being parallel to a photosensitive surface of the image chip;
    获取模块,用于在所述镜头位于所述目标平面内的每一目标位置时,获取所述影像芯片在每一所述目标位置采集的目标图像,所述目标位置至少为两个;An acquiring module, configured to acquire, at each target position in the target plane, a target image acquired by the image chip at each of the target locations, where the target position is at least two;
    处理模块,用于根据所述目标图像得到景深图像。And a processing module, configured to obtain a depth image according to the target image.
  8. 根据权利要求7所述的移动终端,其中,所述目标位置包括所述镜头在第一轴向上移动后得到的第一位置和第二位置;或者,所述目标位置包括所述镜头在所述第一轴向上移动后得到的第一位置和第二位置,以及在第二轴向上移动后得到的第三位置和第四位置。The mobile terminal of claim 7, wherein the target position comprises a first position and a second position obtained after the lens is moved in the first axial direction; or the target position comprises the lens in the The first position and the second position obtained after the first axial movement are performed, and the third position and the fourth position obtained after moving in the second axial direction.
  9. 根据权利要求8所述的移动终端,其中,所述第一位置和第二位置为所述镜头在第一轴向上可移动的极限位置;所述第三位置和第四位置为所述镜头在第二轴向上可移动的极限位置。The mobile terminal of claim 8, wherein the first position and the second position are extreme positions at which the lens is movable in a first axial direction; the third position and the fourth position are the lens An extreme position that is movable in the second axial direction.
  10. 根据权利要求8所述的移动终端,其中,所述第一轴向与所述第二轴向垂直。The mobile terminal of claim 8, wherein the first axial direction is perpendicular to the second axial direction.
  11. 根据权利要求7所述的移动终端,其中,所述马达包括两相对设置的第一磁铁,所述第一磁铁用于控制所述镜头在所述目标平面的第一方向上移动。The mobile terminal of claim 7, wherein the motor comprises two oppositely disposed first magnets for controlling movement of the lens in a first direction of the target plane.
  12. 根据权利要求11所述的移动终端,其中,所述马达还包括AF方向线圈和/或两相对设置的第二磁铁,所述第二磁铁用于控制所述镜头在所述目标平面的第二方向上移动,所述第二方向与所述第一方向垂直,所述AF方向线圈用于控制所述镜头在垂直于所述目标平面的第三方向上移动,以进行AF对焦。The mobile terminal of claim 11, wherein the motor further comprises an AF direction coil and/or two oppositely disposed second magnets, the second magnet for controlling the second lens of the lens in the target plane Moving in a direction, the second direction is perpendicular to the first direction, and the AF direction coil is used to control the lens to move in a third direction perpendicular to the target plane for AF focusing.
  13. 一种移动终端,包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如权利要求1至6中任一项所述的景深图像生成方法的步骤。A mobile terminal comprising a processor, a memory, and a computer program stored on the memory and operable on the processor, the computer program being executed by the processor to implement any of claims 1 to 6 A step of the depth of field image generation method described.
  14. 一种计算机可读存储介质,其上存储有计算机程序,其中,所述计算机程序被处理器执行时实现权利要求1-6中任一项所述的景深图像生成方法的步骤。A computer readable storage medium having stored thereon a computer program, wherein the computer program is executed by a processor to implement the steps of the depth of field image generating method of any one of claims 1-6.
PCT/CN2019/078635 2018-03-21 2019-03-19 Depth-of-field image generating method and mobile terminal WO2019179413A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810234190.1 2018-03-21
CN201810234190.1A CN108259727A (en) 2018-03-21 2018-03-21 A kind of depth image generation method and mobile terminal

Publications (1)

Publication Number Publication Date
WO2019179413A1 true WO2019179413A1 (en) 2019-09-26

Family

ID=62747021

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/078635 WO2019179413A1 (en) 2018-03-21 2019-03-19 Depth-of-field image generating method and mobile terminal

Country Status (2)

Country Link
CN (1) CN108259727A (en)
WO (1) WO2019179413A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108259727A (en) * 2018-03-21 2018-07-06 维沃移动通信有限公司 A kind of depth image generation method and mobile terminal
CN109241832B (en) * 2018-07-26 2021-03-30 维沃移动通信有限公司 Face living body detection method and terminal equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007058066A (en) * 2005-08-26 2007-03-08 Olympus Corp Measuring microscope
CN102724399A (en) * 2011-03-25 2012-10-10 索尼公司 Automatic setting of zoom, aperture and shutter speed based on scene depth map
CN202837765U (en) * 2012-09-17 2013-03-27 硕颖数码科技(中国)有限公司 Camera lens module
CN203365778U (en) * 2013-07-08 2013-12-25 爱佩仪光电技术(深圳)有限公司 Motor spring structure for controlling translational motion of lens
CN107026969A (en) * 2016-02-01 2017-08-08 中兴通讯股份有限公司 The determination method and device of phase difference
CN108259727A (en) * 2018-03-21 2018-07-06 维沃移动通信有限公司 A kind of depth image generation method and mobile terminal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102168954B (en) * 2011-01-14 2012-11-21 浙江大学 Monocular-camera-based method for measuring depth, depth field and sizes of objects
JP6230239B2 (en) * 2013-02-14 2017-11-15 キヤノン株式会社 Image processing apparatus, imaging apparatus, image processing method, image processing program, and storage medium
CN104010178B (en) * 2014-06-06 2017-01-04 深圳市墨克瑞光电子研究院 Binocular image parallax adjustment method and device and binocular camera
CN104902190A (en) * 2015-06-24 2015-09-09 联想(北京)有限公司 Control method, photographic device and electronic device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007058066A (en) * 2005-08-26 2007-03-08 Olympus Corp Measuring microscope
CN102724399A (en) * 2011-03-25 2012-10-10 索尼公司 Automatic setting of zoom, aperture and shutter speed based on scene depth map
CN202837765U (en) * 2012-09-17 2013-03-27 硕颖数码科技(中国)有限公司 Camera lens module
CN203365778U (en) * 2013-07-08 2013-12-25 爱佩仪光电技术(深圳)有限公司 Motor spring structure for controlling translational motion of lens
CN107026969A (en) * 2016-02-01 2017-08-08 中兴通讯股份有限公司 The determination method and device of phase difference
CN108259727A (en) * 2018-03-21 2018-07-06 维沃移动通信有限公司 A kind of depth image generation method and mobile terminal

Also Published As

Publication number Publication date
CN108259727A (en) 2018-07-06

Similar Documents

Publication Publication Date Title
CN108513070B (en) Image processing method, mobile terminal and computer readable storage medium
WO2018072353A1 (en) Image acquiring method and terminal device
WO2019174628A1 (en) Photographing method and mobile terminal
CN109348020B (en) Photographing method and mobile terminal
WO2018098638A1 (en) Electronic device photographing method and apparatus
US11297239B2 (en) Lens control method and mobile terminal
WO2021013009A1 (en) Photographing method and terminal device
CN111541845A (en) Image processing method and device and electronic equipment
CN107248137B (en) Method for realizing image processing and mobile terminal
CN116896675A (en) Electronic device for stabilizing image and method of operating the same
CN108924414B (en) Shooting method and terminal equipment
WO2019129020A1 (en) Automatic focusing method of camera, storage device and mobile terminal
CN109474786B (en) Preview image generation method and terminal
CN107948505B (en) Panoramic shooting method and mobile terminal
WO2021036623A1 (en) Display method and electronic device
CN108449546B (en) Photographing method and mobile terminal
CN109348019B (en) Display method and device
KR20210010148A (en) Foldable electronic device and method for photographing picture using a plurality of cameras in the foldable electronic device
WO2019076373A1 (en) Photographing method, mobile terminal and computer-readable storage medium
WO2019137535A1 (en) Object distance measurement method and terminal device
WO2021238564A1 (en) Display device and distortion parameter determination method, apparatus and system thereof, and storage medium
WO2021104226A1 (en) Photographing method and electronic device
CN108881721A (en) A kind of display methods and terminal
WO2019179413A1 (en) Depth-of-field image generating method and mobile terminal
WO2021136181A1 (en) Image processing method and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19771773

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19771773

Country of ref document: EP

Kind code of ref document: A1