WO2020063080A1

WO2020063080A1 - Method, system, and cell phone for creating blurring effect during recording

Info

Publication number: WO2020063080A1
Application number: PCT/CN2019/097824
Authority: WO
Inventors: 徐彭飞; 刘臻; 杨萍; 王函
Original assignee: 珠海格力电器股份有限公司
Priority date: 2018-09-28
Filing date: 2019-07-26
Publication date: 2020-04-02
Also published as: CN109087271A

Abstract

The present application relates to a method, a system, and a cell phone for creating a blurring effect during recording, applicable to an apparatus having a first camera and a second camera. The method comprises: setting a target object; detecting whether a recorded image contains the target object while the first camera is recording; and if the recorded image contains the target object, activating the second camera, and performing, in the recorded image, blurring processing on a first region excluding the target object, thereby achieving blurring processing of the recorded image during a recording process.

Description

Method, system and mobile phone for implementing video blurring

Related applications

This application claims the priority of a Chinese patent application filed on September 28, 2018, with application number 201811141071.8, entitled "Method, System and Mobile Phone for Video Bluring", which is hereby incorporated by reference in its entirety.

Technical field

The present application relates to the field of mobile phones, and in particular, to a method, a system, and a mobile phone for implementing video blurring.

Background technique

With the upgrading of smartphones, more and more smartphones are equipped with dual cameras. Mobile phones with dual cameras are usually a primary camera and a secondary camera. Due to the different positions of the two cameras, the two are different from two. Take pictures of objects at different angles, so you can get three-dimensional data of the objects. Based on the acquired data, you can blur the background to achieve blur photos.

In the prior art, the blurring function is usually implemented when the mobile phone performs dual-camera photography, and when the video is recorded by using a dual-camera mobile phone, the blurring function cannot be implemented.

Therefore, it is an urgent problem in the art to realize the blurring processing of the recorded image during the recording.

Summary of the Invention

In order to overcome the problems in the related technology at least to a certain extent, the present application provides a method, a system, and a mobile phone for implementing video blurring.

According to a first aspect of the embodiments of the present application, a method for implementing video blurring is provided for a device having a first camera and a second camera, including:

Set a target audience;

Monitoring whether the target object exists in the recorded image when the first camera is recording;

When the target object is included in the recorded image, the second camera is turned on and the first region except the target object in the recorded image is blurred.

In one of the embodiments, it further includes:

After the second camera is turned on, detecting whether there is a target object in the recorded image every first time period; if the target object is not included in the recorded image, the first camera or the second camera is turned off , Stopping the blurring processing on the first area.

In one embodiment, when the first camera is recording, monitoring whether the target object is included in the recorded image includes:

Acquiring a video image as a test image every second time period;

Detect whether the target object is present in the image to be tested.

In one embodiment, the target object is a person, an animal, a plant, and / or a building.

In one embodiment, setting a target object includes:

Selecting at least one object as a target object from a photo stored on the device;

and / or,

Selecting at least one object from the preview image as the target object during video preview;

and / or,

During the recording process, at least one object on the recorded image is selected as the target object.

According to a second aspect of the embodiments of the present application, a system for blurring a recorded image is provided for a device having a first camera and a second camera, including:

A setting module for setting a target object;

A first monitoring module, configured to monitor whether the target object is included in the recorded image when the first camera is recording video;

A blurring module is configured to, when the recorded image has the target object, the second camera is turned on and performs a blurring process on a first area except the target object in the recorded image.

In one of the embodiments, it further includes:

A second monitoring module, configured to detect whether there is a target object in the recorded image every first time after the second camera is turned on; if the target object is not included in the recorded image, turn off the The first camera or the second camera stops performing blur processing on the first area.

In one of the embodiments, when the first detection module performs recording on the first camera, monitoring whether the recorded image has the target object includes:

Acquiring a video image as a test image every second time period;

Detect whether the target object is present in the image to be tested.

In one embodiment, the setting module sets a target object, including:

and / or,

According to a third aspect of the embodiments of the present application, a mobile phone is provided, including:

The processor includes a processor, a memory, and a program stored in the memory and operable on the processor. When the processor executes the program, the steps of the method according to the foregoing embodiment are implemented.

In one embodiment, a mobile phone is provided, including the system described in the above embodiment.

The technical solutions provided by the embodiments of the present application may include the following beneficial effects:

During the video recording process, the blurred image processing is realized. Specifically, the power consumption is reduced without reducing the user experience, and the service life of the camera is prolonged.

It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and should not limit the present application.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings herein are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the description serve to explain the principles of the application.

Fig. 1 is a flow chart showing a method for implementing video blurring according to an exemplary embodiment;

Fig. 2 is a composition diagram of a system for blurring a recorded image according to an exemplary embodiment.

detailed description

In order to make the purpose, technical solution, and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described in combination with specific embodiments of the present application and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

It should be noted that the terms “first” and “second” in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data so used may be interchanged where appropriate so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. Furthermore, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, device, product, or appliance that includes a series of steps or units need not be limited to those explicitly listed Those steps or units may instead include other steps or units not explicitly listed or inherent to these processes, methods, products or appliances.

In the prior art, more and more devices have multiple cameras, such as dual-camera phones, tablets, and computers. However, the existing devices with multiple cameras can often only take blurred photos and cannot perform blurred video recording. Therefore, This application proposes a method for blurring a recorded image, which is used in a device with a first camera and a second camera, for example, a dual-camera mobile phone, which can be specifically used in the process of recording video by the device. Please refer to FIG. The proposed methods include:

S11: Set a target object.

Specifically, the target object is an object that does not need to be blurred during the video recording process, that is, an object that needs to be captured clearly, for example, it can be a certain type of person or object, or it can be a specific person or object.

S12: When the first camera is recording, monitor whether there is a target object in the recorded image.

Specifically, the first camera here refers to any camera in a device having dual cameras. In this embodiment, when using the device to record video, only one camera is opened to record video. The recorded image refers to video recording. Each frame picture produced in the process.

S13: When there is a target object in the recorded image, the second camera is turned on, and the first region except the target object in the recorded image is blurred.

Specifically, in the process of recording with a device, when a target object appears in a recorded image, all objects except the target object need to be blurred, that is, the first region is blurred. The first region is The remaining area other than the target object is removed from the recorded image. Because of the blurring process, at least two cameras must be turned on. Therefore, at this time, the first camera and the second camera are both turned on to realize the blurring during the recording process. Moreover, in this embodiment, when the recording mode is just turned on, that is, when the target object has not been detected in the recorded image, only the first camera is turned on, thereby reducing power consumption without reducing the user experience. , Which prolongs the service life of the device and has a better user experience.

Optionally, the method provided in this application further includes: after the second camera is turned on, detecting whether there is a target object in the recorded image every first time period; if the target is not included in the recorded image The object, turn off the first camera or the second camera, and stop the blurring processing on the first area.

Specifically, the second camera is turned on after having a target object in the recorded image, that is, both the first camera and the second camera are turned on at this time, thereby realizing the blurring processing of the first area. During the recording process, the target object may It repeatedly appears in the recorded image in a short period of time. If the recorded image is continuously detected in real time, the second camera needs to be repeatedly turned on and off, which shortens the service life of the second camera and the user experience is not good. Therefore, in this implementation, In the example, when the two cameras are turned on at the same time, every first time period, such as every 1 minute, to detect whether there is a target object in the recorded image. If the target object disappears, stop the blurring process and close it. Either camera reduces power consumption and extends service life. If this time the detection shows that the target object appears in the recorded image, then within the first time from the next detection, even if the target object does not appear in the recorded image, the first camera and the second camera are still turned on at the same time, thereby preventing Repeatedly turning the camera on and off for a short time affects the service life. Optionally, the first duration can be no less than 1 minute. In addition, in this application, the first camera and the second camera may work alternately during the process of being operated by one camera. For example, the first camera is turned on at the beginning, and the second camera is turned on after the target object appears for the first time. After the target object disappears, the first camera is turned off, and the second camera works instead of the first camera. After the target object appears again, the first camera turns on, and when the target object disappears again, the second camera turns off. By alternately working the first camera and the second camera separately, the service life of the two can be prolonged, so that the frequency of use of the two is similar, and the service life is equivalent. In the prior art, one of the cameras of the dual camera device often fails However, at this time, the service life of the dual-camera device is not much. If the camera is replaced, it will cause waste, and if the camera is not replaced, the user experience will be reduced. Comprehensive service life improves user experience.

Optionally, when the first camera is recording, monitoring whether the target object is included in the recorded image includes: acquiring a recorded image as a test image every second time period; and detecting whether the test object has the test object in the test image. target. Specifically, a target object is detected using image recognition technology.

Optionally, the target object is a character, an animal, a plant, and / or a building. Optionally, setting a target object includes: selecting at least one object as a target object from a photo stored on the device; and / or selecting at least one object from a preview image as a target object during video preview; and / Or, at least one object on the recorded image is selected as the target object during the recording process. Compared with the prior art, the camera itself can be used to obtain the target object, for example, when the display screen is clicked during video preview, photo preview, and / or video recording, the device automatically recognizes the clicked object as the target object, thereby improving User experience and user-friendly operation.

Optionally, in the method and system proposed in the present application, the target image may be set as an object in the recorded image, and the area ratio of the area occupied by the recorded image exceeds the first ratio. For example, the occupied area in the recorded image may be set. An object whose area is greater than 10% of the total area of the recorded image is the target object, or an object whose target pixel is more than 300 pixels is set as the target object. Or, any type of object whose area occupies more than the first proportion of the area of the recorded image. For example, in the recorded image, a person who occupies an area larger than 10% of the total area of the recorded image can be set as the target object. During actual use, The scene that uses blurred video is often the scene of shooting people. When shooting people, other people are often shot in, but the proportion of other people is generally small, so the first experience can improve the user experience. For example, when performing a virtual recording for a group of people, if you set the target object one by one, it will take time and effort. Therefore, at this time, you can directly set the target object as a person. At the same time, when it is a virtual video, it is easy to set non-targets. The task of the subject is shot in. Therefore, a person whose area of the person accounts for more than the first proportion of the recorded image area is set as the target object. Therefore, it is possible to quickly set a target object, save user time, and avoid the problem of poor shooting results caused by passers-by who accidentally enter a non-target object, improve the user experience, and avoid deliberately avoiding passers-by when performing blurred recording. Optionally, when a person who is not a target object is photographed, the non-target object is replaced according to the image in the video image. When a person who is a non-target object is photographed, as described above, it will be replaced. Blur, however, it is still easy to see from the outline of the non-target object that it is a person, resulting in poor video recording when the user blurs the video. Therefore, at this time, a replacement is generated based on the blurred background image in the first area. Image, replacing non-target objects with replacement images. The color and hue of the replacement image are similar to the background image, which has the technical effect of automatically processing the recorded image and improves the user experience when blurring the video.

In order to better illustrate the beneficial effects of this application, an optional embodiment is provided below.

In this embodiment, the device having the first camera and the second camera is a dual-camera mobile phone. When the user uses the mobile phone, he opens a photo application of the mobile phone and enters a photo preview mode. When using this method, it is used to select at least one target object. . Used to switch the photo preview mode to the video preview mode. At this time, the preview image is displayed on the mobile phone display. The user can click any object on the preview image as the target object. For example, when a person is displayed on the preview image, click the person. Automatically recognize the outline of a person. At this time, the mobile phone can prompt the user to specifically select the person as the target object, or choose the broad category of people as the target object. When the user starts recording, click the record button to enter the recording mode. At this time, the mobile phone only turns on the first camera to capture the recorded image, and at the same time monitors whether the target object selected by the user appears in the recorded image in real time. If the target object appears, turn on The second camera performs dual shooting to obtain information of the target object, and performs blurring processing on other regions except the target object, that is, the first region. During the simultaneous operation of the dual cameras, the recorded image is detected every first time period. When the target object in the recorded image disappears, any camera is turned off, preferably the first camera and the second camera are turned off in turn. If the target object is still in the recorded image, the first area is continuously blurred. The present application determines whether to select a target object by detecting whether the object obtained by the mobile phone during recording has a selected target object, and determines whether to open two cameras for blurring processing at the same time, so as to realize that the user can Selective blurring is performed on the current video content.

The present application also proposes a system for implementing video image blurring, for a device having a first camera and a second camera, for example, a dual-camera mobile phone, which can be specifically used in the process of recording video by the device. Please refer to FIG. The system proposed by the application includes: a setting module 10, a first detection module 20 and a blurring module 30.

The setting module 10 is used to set a target object.

The first monitoring module 20 is configured to monitor whether there is a target object in the recorded image when the first camera is recording.

Specifically, the first camera here refers to any camera in a device having dual cameras. In this embodiment, when using the device to record video, only one camera is opened to record video. The recorded image refers to video recording. Any frame in the process.

The blurring module 30 is configured to: when the recorded image has a target object, the second camera is turned on and performs a blurring process on a first area except the target object in the recorded image.

Optionally, the system proposed in this application further includes: a second detection module 40, configured to detect whether the recorded image has a target object every first time after the second camera is turned on; if the If the recorded image does not have the target object, the first camera or the second camera is turned off, and the blurring processing on the first area is stopped.

Specifically, the second camera is turned on after having a target object in the recorded image, that is, both the first camera and the second camera are turned on at this time, thereby realizing the blurring processing of the first area. During the recording process, the target object may It repeatedly appears in the recorded image in a short period of time. If the recorded image is continuously detected in real time, the second camera needs to be repeatedly turned on and off, which shortens the service life of the second camera and the user experience is not good. Therefore, in this implementation, In the example, when the two cameras are turned on at the same time, every first time period, such as every 1 minute, to detect whether there is a target object in the recorded image. If the target object disappears, stop the blurring process and close it. Either camera reduces power consumption and extends service life. If this time the detection shows that the target object appears in the recorded image, then within the first time from the next detection, even if the target object does not appear in the recorded image, the first camera and the second camera are still turned on at the same time, thereby preventing Repeatedly turning the camera on and off for a short time affects the service life. Optionally, the first duration can be no less than 1 minute. In addition, in this application, the first camera and the second camera may work alternately during the process of being operated by one camera. For example, the first camera is turned on at the beginning, and the second camera is turned on after the target object appears for the first time. After the target object disappears, the first camera is turned off, and the second camera works instead of the first camera. After the target object appears again, the first camera turns on, and when the target object disappears again, the second camera turns off. By alternately working the first camera and the second camera separately, the service life of the two can be prolonged, so that the frequency of use of the two is similar, and the service life is equivalent. In the prior art, one of the cameras in the dual-camera device is often damaged. However, at this time, the service life of the dual-camera device is not much. If the camera is replaced, it will cause waste, and if the camera is not replaced, the user experience will be reduced. Comprehensive service life improves user experience.

Optionally, the first detection module 20 monitors whether the target object is included in the recorded image when the first camera is recording, including: acquiring a recorded image as a test image every second time period; and detecting the test image Whether there is the target object in. Specifically, a target object is detected using image recognition technology.

Optionally, the target object is a character, an animal, a plant, and / or a building. Optionally, the setting module 10 sets a target object, including: selecting at least one object as a target object from a photo stored in the device; and / or selecting at least one object from a preview image as a video during video preview. A target object; and / or, selecting at least one object on a recorded image as the target object during a video recording process. Compared with the prior art, a camera-based system can be used to obtain a target object, for example, when the display screen is clicked during video preview, photo preview, and / or video recording, the device automatically recognizes the clicked object as the target object, thereby improving User experience and user-friendly operation.

The present application also proposes a mobile phone, including a processor, a memory, and a program stored in the memory and operable on the processor. When the processor executes the program, the steps of any method proposed in the application are implemented. The mobile phone has a first camera. And second camera device. This application also proposes another mobile phone, including any of the systems proposed in this application. The mobile phone is a device having a first camera and a second camera.

This application proposes a method, a system, and a mobile phone for realizing the blurring of a recorded image. During the recording process, the blurring processing of the recorded image is realized. Specifically, the power consumption is reduced and the camera is extended without reducing the user experience. Life.

The above description is only a preferred embodiment of the present application, and is not intended to limit the present application. For those skilled in the art, this application may have various modifications and changes. Any modification, equivalent replacement, or improvement made within the spirit and principle of this application shall be included in the protection scope of this application.

It can be understood that the same or similar parts in the above embodiments can be referred to each other. For the content that is not described in detail in some embodiments, refer to the same or similar content in other embodiments.

Any process or method description in a flowchart or otherwise described herein can be understood as a module, fragment, or portion of code that includes one or more executable instructions for implementing a particular logical function or step of a process And, the scope of the alternative implementations of this application includes additional implementations, in which the functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order according to the functions involved, which It should be understood by those skilled in the art to which the embodiments of the present application belong.

It should be understood that each part of the application may be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods may be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it may be implemented using any one or a combination of the following techniques known in the art: Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gate circuits, programmable gate arrays (PGA), field programmable gate arrays (FPGA), etc.

A person of ordinary skill in the art can understand that all or part of the steps carried by the methods in the foregoing embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium. The program is When executed, one or a combination of the steps of the method embodiment is included.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing module, or each unit may exist separately physically, or two or more units may be integrated into one module. The above integrated modules may be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

The aforementioned storage medium may be a read-only memory, a magnetic disk, or an optical disk.

In the description of this specification, the description with reference to the terms “one embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” and the like means specific features described in conjunction with the embodiments or examples , Structure, material, or characteristic is included in at least one embodiment or example of the present application. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limitations on the present application. Those skilled in the art may, within the scope of the present application, understand the above. Embodiments are subject to change, modification, substitution, and modification.

Claims

A method for implementing video blurring for a device having a first camera and a second camera, which includes:

Set a target audience;

Monitoring whether the target object exists in the recorded image when the first camera is recording;

When the target object is included in the recorded image, the second camera is turned on and the first region except the target object in the recorded image is blurred.
The method for blurring a recorded image according to claim 1, further comprising:

After the second camera is turned on, detecting whether there is a target object in the recorded image every first time period; if the target object is not included in the recorded image, the first camera or the second camera is turned off , Stopping the blurring processing on the first area.
The method for blurring a recorded image according to any one of claims 1-2, wherein when the first camera performs recording, monitoring whether the recorded image has the target object comprises:

Acquiring a video image as a test image every second time period;

Detect whether the target object is present in the image to be tested.
The method for blurring a recorded image according to any one of claims 1-3, wherein the target object is a person, an animal, a plant, and / or a building.
The method for blurring a recorded image according to any one of claims 1-4, wherein setting a target object comprises:

Selecting at least one object as a target object from a photo stored on the device;

and / or,

Selecting at least one object from the preview image as the target object during video preview;

and / or,

During the recording process, at least one object on the recorded image is selected as the target object.
A system for implementing the blurring of recorded images for a device having a first camera and a second camera, which is characterized in that it includes:

A setting module for setting a target object;

A first monitoring module, configured to monitor whether the target object is included in the recorded image when the first camera is recording video;

A blurring module is configured to, when the recorded image has the target object, the second camera is turned on and performs a blurring process on a first area except the target object in the recorded image.
The system for blurring a recorded image according to claim 6, further comprising:

A second monitoring module, configured to detect whether there is a target object in the recorded image every first time after the second camera is turned on; if the target object is not included in the recorded image, turn off the The first camera or the second camera stops performing blur processing on the first area.
The system for blurring a recorded image according to any one of claims 6 to 7, wherein the first detection module monitors whether the target object is included in the recorded image when the first camera performs recording, including: :

Acquiring a video image as a test image every second time period;

Detect whether the target object is present in the image to be tested.
The system for blurring a recorded image according to any one of claims 6 to 8, wherein the target object is a person, an animal, a plant, and / or a building.
The system for blurring a recorded image according to any one of claims 6-9, wherein the setting module sets a target object, including:

Selecting at least one object as a target object from a photo stored on the device;

and / or,

Selecting at least one object from the preview image as the target object during video preview;

and / or,

During the recording process, at least one object on the recorded image is selected as the target object.
A mobile phone is characterized by comprising a processor, a memory, and a program stored in the memory and operable on the processor. When the processor executes the program, the steps of the method according to any one of claims 1-5 are implemented.
A mobile phone, comprising the system according to any one of claims 6-10.