WO2019033970A1

WO2019033970A1 - Method for image virtualization, mobile device, and storage device

Info

Publication number: WO2019033970A1
Application number: PCT/CN2018/099373
Authority: WO
Inventors: 周一博
Original assignee: 捷开通讯(深圳)有限公司
Priority date: 2017-08-17
Filing date: 2018-08-08
Publication date: 2019-02-21
Also published as: CN107707809A

Abstract

Disclosed are a method for image virtualization, a mobile device, and a storage device. The method comprises: acquiring a first image via a camera module; changing the position of a lens of the camera lens; then acquiring a second image via the camera module; and, synthesizing the first image with the second image into a third image, the third image being an optional virtualized image.

Description

Image blurring method, mobile device and storage device

【技术领域】[Technical Field]

The present invention relates to the field of image capturing technology, and in particular, to a method for blurring an image, a mobile device, and a storage device.

【背景技术】【Background technique】

At present, the ability to take pictures of mobile devices has become the focus of consumers' attention, and the shooting methods of image blurring are widely used. Image blurring will make the main body of the picture more prominent, showing a different kind of beauty, which is a kind of photo pursuit that the majority of photography users are very keen on. The blurring of images on mobile devices is actually a way of imitating a blurred photo with a large aperture SLR. To achieve a blurred effect, the lens needs to meet the long focal length, large aperture and choose the appropriate shooting distance. To achieve background blur, this generally requires a professional lens and a suitable selection of shooting scenes to achieve, some SLR cameras can shoot this effect. However, on mobile devices, limited by the specifications and process level of the camera module, it is impossible to produce a camera module that fully satisfies the requirements.

There are two main ways to achieve image blurring on mobile devices.

First, using the background blurring software algorithm, after taking a picture, the software algorithm crops out the parts of the photo that need to be highlighted according to the user's needs, and then performs the fuzzy algorithm processing on the rest of the image, and then synthesizes the two, and finally produces a similar A background blur effect produced by the SLR, because the subject that needs to be highlighted by the photo is completely captured by the algorithm and cut and generated, there will be a large error, so the blurred photo generated by this method is less effective;

Second, two camera modules are used, one captures the subject and the other captures the depth of field information, and then the captured body depth information is used to crop the main part of the object, and then the rest of the image is performed. The fuzzy algorithm processes and then synthesizes it, because the algorithm can accurately find the things that need to be highlighted according to the depth of field information, so the photo effect generated by this method is better than the former method;

Although both methods can achieve image blur, the actual effect is completely inferior to the blurring effect formed by the natural imaging of the optical lens that actually uses shallow depth of field on the SLR.

【发明内容】 [Summary of the Invention]

In view of this, the technical problem to be solved by the present invention is to provide a method for blurring an image, a mobile device, and a storage device, which can realize image blurring only through a set of camera modules.

In order to solve the above technical problem, a technical solution adopted by the present invention is to provide a method for image blurring, the method comprising:

Obtaining a first image through the camera module; changing a lens position of the camera module; then acquiring a second image through the camera module; synthesizing the first image and the second image into a third image, wherein the third image is a selectively blurred image .

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a mobile device, which includes a processor and a camera module. The processor is connected to the camera module, and the processor can execute a program to implement the following actions:

Controlling the camera module to acquire the first image; changing the lens position of the camera module; then controlling the camera module to acquire the second image; synthesizing the first image and the second image into a third image, the third image being a selectively blurred image .

In order to solve the above technical problem, another technical solution adopted by the present invention is to provide a storage device that stores program data, and the program data can be executed to implement a method for image blurring, the method comprising:

Obtaining a first image through the camera module; changing a lens position of the camera module; then acquiring a second image through the camera module; synthesizing the first image and the second image into a third image, wherein the third image is a selectively blurred image Obtaining the first image includes: acquiring a clear image as the first image in the depth of field of the camera module; and acquiring the second image comprises: controlling the lens of the camera module to move along the depth of field direction, acquiring one outside the depth of field of the camera module A blurred image corresponding to the clear image is used as the second image.

The beneficial effects of the present invention are: different from the prior art, the two images are collected by the two sets of image capturing devices to obtain a composite image, and the present invention obtains the first image through the camera module, and then changes the lens position of the camera module to obtain the second image. The image is combined to form a third image that is selectively blurred, and the image is blurred by only one set of camera modules.

【附图说明】 [Description of the Drawings]

1 is a schematic diagram of the principle of a camera module of the present invention;

2 is a schematic flow chart of an embodiment of an image blurring method according to the present invention;

3 is a schematic flow chart of another embodiment of an image blurring method of the present invention;

4 is a schematic structural diagram of an embodiment of a mobile device according to the present invention;

Figure 5 is a block diagram showing an embodiment of a memory device of the present invention.

【具体实施方式】【Detailed ways】

The technical solutions in the embodiments of the present invention will be clearly and completely described in the following with reference to the accompanying drawings.

Please refer to FIG. 1. FIG. 1 is a schematic diagram of the principle of the camera module of the present invention.

In this embodiment, the lens of the camera module is equivalent to a convex lens. Due to the depth of field of the convex lens, when photographing, the subject to be photographed is within the depth of field, while other parts are outside the depth of field. Objects within the depth of field will be clearly imaged, while other parts outside the depth of field will be blurred, resulting in a blurry subject with clear subjects and blurred backgrounds.

In the present embodiment, the depth of field varies depending on the focal length of the lens, the aperture value, and the shooting distance. For mobile devices, the focal length and aperture value of the mobile device are fixed values, which are determined by the specifications and process level when the camera module is manufactured during the production process of the mobile device, and may not be adjusted later, so after the mobile device completes production The focal length and aperture value of the camera module are determined accordingly. Because the focal length of the camera module of the mobile device and the aperture are insufficient to form a shallow depth of field, the captured photos are clearly imaged within the depth of field of the camera module. The sharpness of the shooting distance will be different.

Please refer to FIG. 2. FIG. 2 is a schematic flow chart of an embodiment of an image blurring method according to the present invention.

S201: acquiring a first image by using a camera module;

In this embodiment, the camera module captures the first image according to the need, the first image may be a clear image, or a blurred image, and the second image corresponds to the first image, that is, when the first image is a clear image. When the second image is a blurred image, the reverse is reversed.

S202: changing a lens position of the camera module;

In this embodiment, by driving the movement of the motor inside the camera module, thereby pushing the lens to move, the focal length of the lens is not actually changed, but the focus position of the camera module is changed, so that the lens can be moved to a suitable position. Allows the subject to be within the depth of field so that clear imaging can be received over the depth of field on the other side of the lens, thus achieving autofocus within a certain range (Auto Focus). Autofocus does not change the focal length, but changes the object distance and distance to find the sharpest point that the subject can image.

When the camera module finds the sharpest focus point, continue to control the lens to move back and forth, you will find that the image will become blurred. Due to the movement of the lens, the subject deviates from the imaging position of the best definition, resulting in the entire picture changing. It is blurred, that is, the phenomenon that the focus is not clear and the picture is blurred. As long as the distance of the lens movement can be controlled properly, the effect of the complete blurring of the current scene image can be fully realized, that is, the effect of blurring blurring is formed by using optical characteristics, and the blurring effect and the blurring of the SLR camera are realized. The effect is the same as the imaging is not clear, compared to the use of software to achieve better imaging results.

S203: Acquire a second image by using a camera module.

In this embodiment, the second image corresponds to the first image, that is, when the first image is a clear image, the second image is a blurred blurred image, and when the first image is a blurred blurred image, the second image is For clear images, that is, when the first image is captured within the depth of field of the camera module, the lens of the control camera module is moved to a second image outside the depth of field to capture blurring, when the first image is in the camera module When shooting outside the depth of field, the lens of the control camera module moves to a second image with a clear depth of field.

S204: synthesize the first image and the second image into a third image, where the third image is a selectively blurred image;

In this embodiment, the third image may be a background blur image or a selectively blurred image such as a main body blur image, and the third image is synthesized according to the first image and the second image captured by the camera module. When an image is a clear image and the second image is a blurred image, the outline of the clear body is determined in the first image, thereby cutting out a body that needs to be clear, and embedding a clear body into a corresponding position on the second image, and further A third image in which the main body is clear and the background is blurred. When the first image is a blurred image and the second image is a clear image, the contour of the blurring main body is determined in the first image, thereby cutting out a blurring process. The main body inserts a main body that needs to be blurred in a corresponding position on the second image, thereby synthesizing a third image in which the main body is blurred and the background is clear.

As can be seen from the above, the present invention acquires the first image through the camera module, and then changes the lens position of the camera module to acquire the second image, thereby synthesizing the selectively blurred third image, which is realized only by a set of camera modules. Image blur.

Please refer to FIG. 3. FIG. 3 is a schematic flow chart of another embodiment of the image blurring method of the present invention.

S301: Turn on the camera module;

In this embodiment, the shooting function of the mobile device is enabled, the camera module is turned on, and the corresponding picture is taken as needed. The position of the camera module on the mobile device may be located at the end of the mobile device, or in the middle of the mobile device, etc., and the camera module capable of conveniently using the mobile device is required to perform relative shooting, which is not limited herein.

S302: Select a subject to complete the focus;

In this embodiment, the first image is captured by the camera module, and the shooting target is focused within the depth of field of the camera module to obtain a clear image as the first image of the embodiment.

Optionally, the camera module can focus on the shooting target outside the depth of field, and obtain a blurred image as the first image of the embodiment, and the corresponding second image is a clear image. This embodiment synthesizes a third image that is selectively blurred, which is not limited herein.

S303: Determine whether the focus target is selected, and complete the focus;

In this embodiment, if the focus target has been selected and the focus is completed, step S304 is performed, and if the focus target is not selected, step S302 is continued.

S304: Select a suitable blur effect;

In this embodiment, by driving the movement of the motor inside the camera module, the lens is moved along the depth of field of the camera module, outside the depth of field of the camera module and according to the selected blurring effect, in the corresponding depth of field Obtaining a blurred image corresponding to the first image as the second image of the embodiment, that is, after selecting a suitable blurring effect, the camera module correspondingly captures the second image according to the position where the target of the first image is captured. The first image and the second image are identical except that the image quality is different.

Optionally, the second image corresponds to the first image, that is, when the first image is a clear image, the second image is a blurred blurred image, and when the first image is a blurred blurred image, the second image is clear The image, that is, when the first image is captured in the depth of field of the camera module, the lens of the control camera module is moved to the second image outside the depth of field range, and the first image is in the depth of field of the camera module. When the external shooting is obtained, the lens of the control camera module is moved to a second image with a clear depth in the depth of field.

Optionally, the blurring effect in the embodiment may be different according to the depth of focus of the camera module and the depth of field of the camera module, so as to achieve different blurring effects, that is, the focus of the camera module and the camera module. The greater the degree of deviation of the depth of field range, the more blurred the resulting image.

S305: determining whether the blur effect is selected;

In this embodiment, if the blurring effect has been selected, step S306 is performed, and if the blurring effect is not selected, step S304 is continued.

S306: Complete shooting to generate a third image;

In this embodiment, the shooting operation is ended, and the third image is combined and output according to the first image and the second image captured by the camera module. In this embodiment, the first image is a clear image, and the second image is a blurred image. The method of synthesizing the third image is explained, and thus the first image and the second image of the present embodiment are not limited.

Optionally, according to the first image, acquiring a clear body of the third image, synthesizing the clear body into a corresponding position on the second image, obtaining a third image with a clear subject and a blurred background; or acquiring according to the first image The clear background of the third image is synthesized into a corresponding position on the second image to obtain a third image with the subject blurred and the background clear.

Optionally, by determining the outline of the image body on the first image, thereby selecting a clear body or a clear background, determining the outline of the image body is obtained by algorithm cutting, which is a conventional means by those skilled in the art, and is no longer used herein. Narration.

In summary, the present invention acquires a first image in the depth of field of the camera module, and then controls the lens of the camera module to move in the depth direction of the camera module, and acquires a second image outside the depth of field of the camera module, thereby Synthesizing the third image of the selective blur, through a set of camera modules, to achieve image blur, which can improve image blur.

Please refer to FIG. 4. FIG. 4 is a schematic structural diagram of an embodiment of a mobile device according to the present invention.

In this embodiment, the mobile device 400 includes a processor 401 and a camera module 402. The processor 401 is connected to the camera module 402. The position of the camera module 402 on the mobile device 400 can be located at the end of the mobile device 400, or In the middle area of the mobile device 400, the camera module 402 that can conveniently use the mobile device 400 is required to perform corresponding shooting operations, which is not limited herein.

The processor 401 is capable of executing a program to control the camera module 402 to obtain a clear image as the first image within its depth of field; then controlling the lens of the camera module 402 to move along the depth of field and acquiring outside the depth of field range a blurred image corresponding to the clear image is used as the second image; according to the first image, the clear body of the third image is acquired, and the clear body is synthesized to the corresponding position on the second image, and the body is clear and the background is blurred. Or three images; or according to the first image, obtain a clear background of the third image, and synthesize the clear background to the corresponding position on the second image to obtain a third image with the subject blurred and the background clear.

The processor 401 drives the movement of the motor inside the camera module 402 to push the lens to move, and does not actually change the focal length of the lens. The focal length and aperture of the camera module 402 remain unchanged, but the focus position of the camera module 402 is changed. This allows the lens to be moved to the proper position so that the subject being shot is within the depth of field, so that clear imaging can be received over the depth of field on the other side of the lens, thus achieving autofocus within a certain range. Autofocus does not change the focal length, but changes the object distance and distance to find the sharpest point that the subject can image.

When the camera module 402 finds the sharpest focus point, continue to control the lens to move back and forth, and the image will be blurred. Due to the movement of the lens, the subject deviates from the imaging position of the best definition, resulting in the entire picture. It becomes blurred, that is, the phenomenon that the focus is not clear and the picture is blurred. As long as the distance of the lens movement can be controlled properly, the effect of the complete blurring of the current scene image can be fully realized, that is, the effect of blurring blurring is formed by using optical characteristics, and the blurring effect and the blurring of the SLR camera are realized. The effect is the same as the imaging is not clear, compared to the use of software to achieve better imaging results.

Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of an embodiment of a storage device according to the present invention.

In the present embodiment, the storage device 500 stores the program data 501, and the program data 501 can be executed to implement the image blurring method described in the above embodiments, and details are not described herein again.

In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device implementations described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the object of the present embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the methods of the various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read only memory (ROM, Read-Only) Memory, random access memory (RAM), disk or optical disk, and other media that can store program code.

The above is only the embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.

Claims

A storage device, wherein the storage device stores program data, the program data being executable to implement the following actions:

Acquiring the first image through the camera module;

Changing the lens position of the camera module;

Acquiring a second image through the camera module;

Combining the first image and the second image into a third image, the third image being a selectively blurred image;

The acquiring the first image includes: acquiring a clear image as the first image in a range of depth of the camera module;

The acquiring the second image includes: controlling the lens of the camera module to move along the depth of field direction, and acquiring a blurred image corresponding to the clear image as the second image outside the depth of field of the camera module.
The storage device of claim 1, wherein the synthesizing the first image and the second image into a third image comprises:

Acquiring a clear body of the third image according to the first image, synthesizing the clear body to a corresponding position on the second image, to obtain the third image with a clear subject and a blurred background; or

Obtaining a clear background of the third image according to the first image, and synthesizing the clear background to a corresponding position on the second image, to obtain the third image with a blurred subject and a clear background.
A method of image blurring, wherein the method comprises:

Acquiring the first image through the camera module;

Changing the lens position of the camera module;

Acquiring a second image through the camera module;

The first image and the second image are combined into a third image, the third image being a selectively blurred image.
The method of claim 3, wherein the obtaining the first image comprises acquiring a sharp image as the first image within a depth of field of the camera module.
The method according to claim 4, wherein the acquiring the second image comprises: controlling a lens of the camera module to move in a depth of field direction, and acquiring a corresponding image corresponding to the clear image outside the depth of field of the camera module The image is blurred as the second image.
The method of claim 5, wherein the synthesizing the first image and the second image into a third image comprises:

Acquiring a clear body of the third image according to the first image, synthesizing the clear body to a corresponding position on the second image, to obtain the third image with a clear subject and a blurred background; or

Obtaining a clear background of the third image according to the first image, and synthesizing the clear background to a corresponding position on the second image, to obtain the third image with a blurred subject and a clear background.
A mobile device, wherein the mobile device includes a processor and a camera module, the processor is coupled to the camera module, and the processor is capable of executing a program to:

Controlling the camera module to acquire a first image;

Changing the lens position of the camera module;

Controlling the camera module to acquire a second image;

The first image and the second image are combined into a third image, the third image being a selectively blurred image.
The mobile device of claim 7, wherein the obtaining the first image comprises: the processor controlling the camera module to acquire a clear image as the first image within a depth of field thereof.
The mobile device of claim 8, wherein the acquiring the second image comprises: the processor controlling the lens of the camera module to move in a depth of field direction, and controlling the camera module to acquire a range outside the depth of field thereof A blurred image corresponding to the clear image is used as the second image.
The mobile device of claim 9, wherein the synthesizing the first image and the second image into a third image comprises:

And the processor acquires a clear body of the third image according to the first image, and synthesizes the clear body into a corresponding position on the second image, to obtain the first body with clear background and blurred background Three images; or

And acquiring, by the processor, a clear background of the third image according to the first image, and synthesizing the clear background to a corresponding position on the second image, to obtain the first part that the subject is blurred and the background is clear Three images.
The mobile device of claim 9, wherein the focal length and aperture of the camera module remain unchanged.