WO2021129669A1

WO2021129669A1 - Image processing method and system, electronic device, and computer-readable medium

Info

Publication number: WO2021129669A1
Application number: PCT/CN2020/138652
Authority: WO
Inventors: 姚坤
Original assignee: RealMe重庆移动通信有限公司
Priority date: 2019-12-23
Filing date: 2020-12-23
Publication date: 2021-07-01
Also published as: CN111131698A; CN111131698B

Abstract

Disclosed are an image processing method and system, an electronic device, and a computer-readable medium. The method comprises: in response to a first triggering operation, collecting the current frame image of a target scene; reading an image cache queue at the current moment, and performing sharpness evaluation on each cached image in the image cache queue at the current moment to acquire a sharpness value of each cached image; extracting the cached image with the maximum sharpness value as a key frame image, and matching the key frame image with the current frame image; and when the key frame image is successfully matched with the current frame image, performing fusion processing on the key frame image and the current frame image to generate a target image. The method, the system, the electronic device and the computer-readable medium of the embodiments of the present application can effectively avoid a blurry image caused by shaking during photographing.

Description

Image processing method and system, electronic equipment, and computer readable medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 23, 2019, the application number is 201911340930.0, and the invention title is "Image processing methods and devices, computer readable media, and electronic equipment". The entire content of the application is approved The reference is incorporated in this application.

Technical field

The embodiments of the present application relate to the field of image processing, and more specifically, to an image processing method, an image processing system, an electronic device, and a computer-readable medium.

Background technique

In order to avoid problems such as blurry and unclear images caused by jitter when the mobile terminal device takes pictures, the terminal device provides an anti-shake function. The existing anti-shake functions generally include optical anti-shake and algorithmic anti-shake. Among them, the optical image stabilization requires the addition of optical components to the terminal equipment, resulting in an increase in the volume and weight of the terminal equipment. Algorithmic image stabilization generally needs to crop the image, resulting in a loss of field of view, and when the algorithmic image stabilization is large in jitter, the cropped image cannot well compensate for the effect of jitter, which is manifested as the anti-shake effect is not obvious.

Summary of the invention

In view of this, the embodiments of the present application provide an image processing method, an image processing system, an electronic device, and a computer-readable medium, which are beneficial to improve the definition of images captured by a terminal device.

In a first aspect, an image processing method is provided. The image processing method includes: in response to a first trigger operation, collecting a current frame image of a target scene; Each cached image in the cache queue is evaluated for sharpness to obtain the sharpness value of each of the cached images; the cached image with the largest sharpness value is extracted as a key frame image, and the key frame image is compared with the current frame image Performing matching; when the key frame image is successfully matched with the current frame image, fusion processing is performed on the key frame image and the current frame image to generate a target image.

In a second aspect, an image processing system is provided. The system includes: a first trigger operation response module for collecting a current frame target image of a target scene in response to the first trigger operation; an image buffer queue reading module for Read the image buffer queue at the current moment, and use preset rules to evaluate the definition of each buffer image in the image buffer queue at the current moment to obtain the definition value of each buffer image; the matching module is used to extract the definition The buffer image with the largest value is used as a key frame image, and the key frame image is matched with the current frame image; a target image output module is used to successfully match the key frame image with the current frame target image At this time, fusion processing is performed on the key frame image and the current frame target image to generate a target image.

In a third aspect, an electronic device is provided, including: one or more processors; a storage device, used to store one or more programs, when the one or more programs are executed by the one or more processors At this time, the one or more processors are caused to execute the method in the above-mentioned first aspect.

In a fourth aspect, a computer-readable medium is provided for storing computer software instructions used to execute the method in the above-mentioned first aspect, which contains the programs designed to execute the above-mentioned aspects.

In this application, the names of electronic devices and interactive systems do not limit the devices themselves. In actual implementation, these devices may appear under other names. As long as the function of each device is similar to that of this application, it falls within the scope of the claims of this application and its equivalent technologies.

These and other aspects of the application will be more concise and understandable in the description of the following embodiments.

Description of the drawings

Fig. 1 shows a schematic diagram of an image processing method according to an embodiment of the present application.

Fig. 2 shows a schematic diagram of another image processing method according to an embodiment of the present application.

FIG. 3 shows a schematic diagram of an image processing method with multiple camera modules according to an embodiment of the present application.

Fig. 4 shows a schematic block diagram of an image processing system according to an embodiment of the present application.

Fig. 5 shows a schematic block diagram of a computer system of an electronic device according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

It should be understood that the technical solutions of the embodiments of the present application can be applied to various mobile terminal devices with camera functions, such as mobile phones and tablet smart terminal devices equipped with cameras.

In the existing smart terminal equipment, in order to provide better photographing effects, various anti-shake functions are added to improve image blurring caused by user jitter. Anti-shake methods are mainly divided into two categories, including optical anti-shake and algorithm anti-shake. Among them, optical image stabilization (OIS) relies on the structure of a special lens or CCD photosensitive element to minimize image instability caused by jitter during use by the operator. As an optical image stabilization technology, it is not to keep the body from shaking. It relies on a special lens or the structure of a CCD sensor to minimize the image instability caused by the jitter during use by the operator. Algorithmic anti-shake is also called electronic anti-shake technology. This technology uses dynamic vectors in jitter detection. According to the motion vector to grasp the image swing direction and amount, use this as a reference to move the image position in parallel to generate a motion image without jitter.

In order to achieve the optical image stabilization effect, a larger optical device and an optical image stabilization module need to be plugged into the mobile phone, which has a lot of tests on the size, weight, R&D cost, portability, etc. In the algorithm anti-shake, the current mobile phone manufacturers commonly used solutions are: crop a certain proportion of the picture, and the cropped part is used as a backup. When jitter occurs, the backup image is used to compensate according to the gyroscope information to ensure the stability of the picture, but the algorithm Anti-shake will often crop the image, and the field of view will have a certain loss, the general loss is more than 10%, and the algorithm anti-shake when the jitter amplitude is large, the cropped image cannot well compensate for the impact of jitter, and it is shown as anti-shake. The shaking effect is not obvious. In addition, anti-shake technology generally only realizes preview and video anti-shake functions.

Fig. 1 shows a schematic diagram of an image processing method according to an embodiment of the present application. As shown in Figure 1, the image processing method includes some or all of the following:

S11, in response to the first triggering operation, collecting a current frame image of the target scene; and

S12: Read the image buffer queue at the current moment, and perform sharpness evaluation on each buffer image in the image buffer queue at the current moment to obtain the sharpness value of each buffer image;

S13, extracting the buffer image with the largest sharpness value as a key frame image, and matching the key frame image with the current frame image;

S14: When the key frame image is successfully matched with the current frame image, perform fusion processing on the key frame image and the current frame image to generate a target image.

Specifically, the above-mentioned image processing method can be applied to electronic devices equipped with at least one camera module, such as terminal devices such as mobile phones and tablet computers. The terminal device may be equipped with multiple camera modules, for example, one or more of a main camera module, a macro camera module, a wide-angle camera module, and a depth camera module.

Optionally, in this embodiment of the present application, the above-mentioned first trigger operation may be a user's shooting operation in a camera or other third-party shooting application. According to the user's first trigger operation, the current frame image currently collected by the camera module is acquired.

Optionally, in the embodiment of the present application, after the user triggers the shooting operation, a control instruction can be generated, and the update of the graphics cache queue can be stopped according to the control instruction. At the same time, the image buffer queue can be read, and the definition of each buffer image in the image buffer queue at the current moment can be evaluated by using a preset algorithm to obtain the definition evaluation value of each buffer image. The current frame image and the cached image can be stored in different cache areas respectively. For example, the current frame image can be stored in the cache buffer, and the image cache queue can be stored in the capture buffer.

For example, an evaluation method based on an energy gradient function can be used to calculate the sharpness of the cached image. Specifically, the formula can include:

D(f)=Σ _y Σ _x (|f(x+1,y)-f(x,y)| ² +|f(x,y+1)-f(x,y)| ² )

Among them, f(x, y) represents the gray value of the pixel (x, y) corresponding to the image f, and D(f) is the result of the image definition calculation.

According to the above method, the sharpness evaluation result value of each frame of the buffer queue can be obtained.

Optionally, in this embodiment of the present application, after obtaining the definition value corresponding to each buffer image in the current buffer queue, a frame of the buffer image with the highest definition data may be selected as the key frame image. Then the key frame image is matched with the current frame image taken by the user. For example, the SIFT (Scale-invariant feature transform, scale-invariant feature transform) algorithm can be used to evaluate the matching between the key frame image and the current frame image.

Generally speaking, the SIFT algorithm can include the following steps: 1) Scale space extreme value detection: Search for image positions on all scales, and identify potential points of interest that are invariant to scale and rotation through Gaussian differential functions; 2) Key point positioning : At the location of each candidate, a fine-fitting model is used to determine the location and scale; the selection of key points is based on their degree of stability; 3) Direction determination: Based on the local gradient direction of the image, it is assigned to each key Point position in one or more directions; all subsequent operations on the image data are transformed relative to the direction, scale and position of the key points, so as to provide invariance to these transformations; 4) Key point description: at each key point In the surrounding neighborhood, the local gradients of the image are measured at selected scales; these gradients are transformed into a representation that allows relatively large local shape deformation and illumination changes. After obtaining the descriptor corresponding to each feature in the image, the corresponding feature vector is generated. Based on the feature vector of each feature point in the image, the feature point description vector of the entire image can be obtained. Based on the description vector, the current frame image and the key frame image are matched.

Optionally, in this embodiment of the present application, the threshold for image matching may be preset. When the matching result of the key frame image and the current frame image is greater than the preset threshold, it can be determined that the matching is successful. At this point, the key frame image and the current frame image can be fused, so that the fused image is used as the target image and displayed to the user.

For example, image fusion can use a variety of algorithms, such as a fusion algorithm based on pyramid transformation, a fusion method based on weighted average, or a fusion method based on PCNN (Pulse Coupled Neural Network), and so on. The specific execution process of each algorithm can be realized by adopting the existing technical solution, and the details are not repeated in this disclosure. The present disclosure does not specifically limit the specific fusion algorithm used.

Optionally, in the embodiment of the present application, if the matching result of the key frame image and the current frame image is less than the preset threshold, the fusion operation is not performed, and the current frame image is provided to the user as the target image.

Alternatively, a threshold may be pre-configured for the sharpness of the cached image, and if the sharpness value of the key frame image is less than the preset threshold, it indicates that the sharpness of the cached image is low. Then the current frame image can be directly provided to the user as the target image.

Or, for the image cache queue, you can also select the top n cache images with the highest sharpness value to match with the current frame image, and then select the cache image with the highest matching degree as the final key frame image, and then The key frame image is fused with the current frame image.

The display control method provided in the embodiments of the present application selects the buffer image with the largest sharpness value as the key frame image to match the current frame image, and then performs image fusion according to the matching result to generate the target image. Thereby, the target image can be combined with the features of the current frame image and the key frame image, effectively avoiding unclear images caused by jitter.

Fig. 2 shows a schematic diagram of an image processing method according to an embodiment of the present application. As shown in Figure 2, the image processing method includes some or all of the following:

S10, in response to a second trigger operation, continuously collect current images of the target scene and save them in the image buffer queue;

Optionally, in the embodiment of the present application, the above-mentioned second trigger operation may be a control operation of the user opening a camera application or another third-party shooting application and entering the shooting preview interface. For example, referring to FIG. 2, after the user clicks the "camera" control on the main interface of the terminal device to enter the camera, an image buffer queue can be established, for example, a RAW data frame queue can be established. At the same time, start to continuously collect the current image in the current scene, and save the continuously collected current image to the image buffer queue. For example, the length of the buffer queue can be configured in advance, for example, the length of the queue can be set to a value such as 8, 10, or 15. Multiple current images acquired continuously can be buffered in the RAW data frame queue. And configure an independent storage space in the terminal device for storing cached images.

Optionally, in the embodiment of the present application, if the storage space of the image buffer queue is empty, the current image collected is overwritten with the previous buffer image stored in the image buffer queue. For example, if the length of the RAW data frame queue is 10 and the current queue has cached images M1, M2...M9, M10, when M11 is collected, this M11 will cover M1, M12 will cover M2, and so on. As a result, when the user takes a photo, each buffered image in the RAW data frame queue is the image corresponding to the time closest to the time the user takes the photo.

Optionally, in the embodiment of the present application, it can also be configured that when the storage space of the cache queue is empty, only the last 3 or 5 cache images in the current cache queue are retained, and the other images are cleared together to form the cache queue. Provide more cache space.

The display control method provided in the embodiments of the present application establishes an image buffer queue in advance, so that when the terminal device takes a picture in response to the first trigger operation of the user, it can acquire the current frame image while simultaneously buffering each image in the image buffer queue. The image is evaluated for sharpness to obtain the corresponding sharpness value.

Optionally, in the embodiment of the present application, based on the foregoing content and referring to FIG. 3, the foregoing method may further include:

Step S21: Activate at least two of the camera components in response to the second triggering operation, collect the current images of the target scene through the two camera components, and save them in the corresponding image buffer queue;

Step S22, performing scene recognition on the current image to obtain the scene category of the target scene;

Step S23: Determine the corresponding target camera component and the target image cache queue corresponding to the target camera component according to the scene category, so as to read the target image cache queue when responding to the first trigger request.

Specifically, when the user enters the camera function or opens other third-party camera applications, multiple camera modules can be activated at the same time. For example, start the main camera module and the wide-angle camera module at the same time. At this time, corresponding image buffer queues can be created for the main camera module and the wide-angle camera module respectively. After the user captures the current frame of image, the scene corresponding to the current frame can be identified; for example, a macro shooting scene, a wide-angle shooting scene, a night shooting scene, or a sports shooting scene. The user can pre-configure the correspondence between the shooting scene and the target camera component. After the corresponding shooting scene is determined, the corresponding target camera component can be determined, and the image buffer queue corresponding to the target camera component can be extracted. Then, the definition of the buffered image in the image buffering queue is evaluated, and the other buffering queues are cleared. As a result, the finally generated fused image can have a better display effect.

Optionally, in the embodiment of the present application, the above-mentioned image buffer queue may also include at least one frame of the current frame of the target image after the acquisition of the buffer image.

For example, after the user shoots and obtains the current frame image at time t, the user can continue to collect the buffered image at time t+1 and save it in the image buffer queue. The current frame image collected by the user at time t may be a frame of image in the image buffer queue.

When the user takes an image, after the current frame of image is collected, the current shooting posture and the content of the shot scene may still be maintained. At this point, you can still collect one or more frames that are continuous with the current frame of image. Therefore, if the definition of each frame buffer image before the current frame image in the image buffer queue is not high, the multiple frames after the current frame image can still be used for matching and fusion. In this way, the situation where there is no available buffer image in the image buffer queue or the definition is low can be avoided to the greatest extent.

Therefore, the image processing method of the embodiment of the present application establishes an image cache queue corresponding to each camera component when the user enters the shooting function, and stores the cache image corresponding to the current scene in the image cache queue. While the user is taking a photo to obtain the current frame of image, the sharpness evaluation of each buffered image in the image buffer queue can be performed to obtain the corresponding sharpness value. And select one or more frames of the buffered image with the largest sharpness value as the key frame image to match the current frame image, and then determine whether to perform image fusion to generate the target image according to the matching result. Thus, the target image can be combined with the features of the current frame image and the key frame image, effectively avoiding unclear images caused by jitter; image fusion can further improve the details of the current frame image. Moreover, there is no need to crop the buffered image, which effectively avoids the loss of the field of view and effectively improves the image quality.

It should be understood that the terms "system" and "network" in this article are often used interchangeably in this article. The term "and/or" in this article is only an association relationship describing the associated objects, which means that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, exist alone B these three situations. In addition, the character "/" in this text generally indicates that the associated objects before and after are in an "or" relationship.

It should also be understood that, in the various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not be implemented in this application. The implementation process of the example constitutes any limitation.

The image processing method according to the embodiment of the present application is described in detail above. The image processing system according to the embodiment of the present application will be described below with reference to the accompanying drawings. The technical features described in the method embodiment are applicable to the following system embodiments.

FIG. 4 shows a schematic block diagram of an image processing system 40 according to an embodiment of the present application. As shown in FIG. 4, the image processing system 40 includes:

The first trigger operation response module 401 may be configured to collect a target image of the current frame of the target scene in response to the first trigger operation.

The image buffer queue reading module 402 is used to read the image buffer queue at the current moment, and use preset rules to evaluate the definition of each buffer image in the image buffer queue at the current moment to obtain the definition of each buffer image value.

The matching module 403 is configured to extract the buffer image with the largest sharpness value as a key frame image, and match the key frame image with the current frame image.

The target image output module 404 is configured to perform fusion processing on the key frame image and the current frame target image to generate a target image when the key frame image is successfully matched with the current frame target image.

Therefore, the image processing system of the embodiment of the present application can establish an image buffer queue in advance, so that when the terminal device takes a picture in response to the user's first trigger operation, it can obtain the current frame image while simultaneously checking each image in the image buffer queue. The sharpness of the buffered image is evaluated to obtain the corresponding sharpness value, so that the buffered image with the largest sharpness value can be selected as the key frame image to match the current frame image, and then image fusion is performed according to the matching result to generate the target image. Thereby, the target image can be combined with the features of the current frame image and the key frame image, effectively avoiding unclear images caused by jitter.

Optionally, in this embodiment of the present application, the image processing system 40 further includes:

The current frame image output module is configured to use the current frame image as a target image when the key frame image fails to match the current frame image.

The second trigger operation response module is configured to continuously collect the current image of the target scene and save it in the image buffer queue in response to the second trigger operation; and when the storage space of the image buffer queue is empty, collect The current image of overwrites the previous cached image that has been stored in the image cache queue.

Optionally, in this embodiment of the present application, the image buffer queue includes a plurality of image buffer queues configured respectively corresponding to each camera component.

The image buffer queue reading module 402 may also be configured to activate at least two of the camera components in response to a second triggering operation, collect the current image of the target scene through the two camera components, and save the current image in the corresponding image buffer. In the queue.

The scene recognition module is used to perform scene recognition on the current image to obtain the scene category of the target scene.

The target image buffer queue confirmation module is used to determine the corresponding target camera component and the target image buffer queue corresponding to the target camera component according to the scene category, so as to read the target image in response to the first trigger request Cache queue.

The pause processing module is used to respond to the first trigger operation to pause the acquisition of the current image corresponding to the target scene when the current frame image is acquired.

Optionally, in this embodiment of the present application, the image buffer queue includes at least one frame of the buffer image acquired after the target image of the current frame.

It should be understood that the above-mentioned and other operations and/or functions of each unit in the image processing system 40 according to the embodiment of the present application are used to implement the corresponding process in the method in FIG. 1, and are not repeated here for brevity.

FIG. 5 shows a computer system 500 of an electronic device implementing an embodiment of the present invention according to an embodiment of the present application; the electronic device may be, for example, a mobile phone, a tablet computer, or the like.

It should be noted that the computer system 500 of the electronic device shown in FIG. 5 is only an example, and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

As shown in FIG. 5, the computer system 500 includes a central processing unit (Central Processing Unit, CPU) 501, which can be loaded into a random storage device according to a program stored in a read-only memory (Read-Only Memory, ROM) 502 or from a storage part 508. Access to the program in the memory (Random Access Memory, RAM) 503 to execute various appropriate actions and processing. In RAM 503, various programs and data required for system operation are also stored. The CPU 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input/output (Input/Output, I/O) interface 505 is also connected to the bus 504.

The following components are connected to the I/O interface 505: the input part 506 including keyboard, mouse, etc.; including the output part 507 such as cathode ray tube (Cathode Ray Tube, CRT), liquid crystal display (LCD), and speakers 507 A storage part 508 including a hard disk, etc.; and a communication part 509 including a network interface card such as a LAN (Local Area Network) card and a modem. The communication section 509 performs communication processing via a network such as the Internet. The driver 510 is also connected to the I/O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed, so that the computer program read therefrom is installed into the storage portion 508 as needed.

In particular, according to an embodiment of the present invention, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication part 509, and/or installed from the removable medium 511. When the computer program is executed by the central processing unit (CPU) 501, various functions defined in the system of the present application are executed.

It should be noted that the computer-readable medium shown in the embodiment of the present invention may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Erasable Programmable Read Only Memory (EPROM), flash memory, optical fiber, portable compact disk read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical storage device, magnetic storage device, or any suitable of the above The combination. In the present invention, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

The units described in the embodiments of the present invention may be implemented in software or hardware, and the described units may also be provided in a processor. Among them, the names of these units do not constitute a limitation on the unit itself under certain circumstances.

It should be noted that, as another aspect, the present application also provides a computer-readable medium. The computer-readable medium may be included in the electronic device described in the above-mentioned embodiments; it may also exist alone instead of Assemble into the electronic device. The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by an electronic device, the electronic device realizes the method described in the following embodiments. For example, the electronic device can implement the steps shown in FIG. 1.

In addition, the above-mentioned drawings are merely schematic illustrations of the processing included in the method according to the exemplary embodiment of the present invention, and are not intended for limitation. It is easy to understand that the processing shown in the above drawings does not indicate or limit the time sequence of these processings. In addition, it is easy to understand that these processes can be executed synchronously or asynchronously in multiple modules, for example.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the unit is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or may also be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

If this function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

An image processing method, characterized in that it comprises:

In response to the first trigger operation, collecting the current frame image of the target scene; and

Read the image buffer queue at the current moment, and perform a sharpness evaluation on each buffer image in the image buffer queue at the current moment to obtain the sharpness value of each buffer image;

Extracting the buffer image with the largest sharpness value as a key frame image, and matching the key frame image with the current frame image;

When the key frame image and the current frame image are successfully matched, fusion processing is performed on the key frame image and the current frame image to generate a target image.
The image processing method according to claim 1, wherein the method further comprises:

When the key frame image fails to match the current frame image, the current frame image is used as the target image.
The image processing method according to claim 1, wherein before the responding to the first trigger operation, the method further comprises:

In response to the second trigger operation, continuously collect the current image of the target scene and save it in the image buffer queue; and

When the storage space of the image buffer queue is empty, the current image collected is overwritten with the previous buffer images stored in the image buffer queue.
The image processing method according to claim 1, wherein the image buffer queue comprises a plurality of image buffer queues configured respectively corresponding to each camera component; the method further comprises:

In response to the second triggering operation, at least two of the camera components are activated, and the current images of the target scene are collected by the two camera components respectively, and stored in the corresponding image buffer queue.
The image processing method according to claim 4, wherein the method further comprises:

Performing scene recognition on the current image to obtain the scene category of the target scene;

The corresponding target camera component and the target image buffer queue corresponding to the target camera component are determined according to the scene category, so as to read the target image buffer queue when responding to the first trigger request.
The image processing method according to claim 1, wherein when the current frame image is collected in response to the first trigger operation, the method further comprises:

Pause collecting the current image corresponding to the target scene.
4. The image processing method according to claim 1, wherein the image buffer queue includes at least one frame of the current frame of the target image after the acquisition of the buffer image.
The image processing method according to claim 3, wherein the second trigger operation is a control operation of opening a camera application or a third-party photographing application and entering a photographing preset interface;

When the second trigger operation occurs, the image buffer queue is created.
The image processing method according to claim 1, wherein the first trigger operation is a shooting operation in a camera application or a third-party shooting application.
An image processing system, characterized in that the image processing system includes:

The first trigger operation response module is configured to collect the target image of the current frame of the target scene in response to the first trigger operation;

The image buffer queue reading module is used to read the image buffer queue at the current moment, and use preset rules to evaluate the definition of each buffer image in the image buffer queue at the current moment to obtain the definition value of each buffer image ；

A matching module, configured to extract the buffer image with the largest sharpness value as a key frame image, and match the key frame image with the current frame image;

The target image output module is configured to perform fusion processing on the key frame image and the current frame target image to generate a target image when the key frame image is successfully matched with the current frame target image.
The image processing system according to claim 10, wherein the image processing system further comprises:

The current frame image output module is configured to use the current frame image as a target image when the key frame image fails to match the current frame image.
The image processing system according to claim 10, wherein the image processing system further comprises:

The second trigger operation response module is configured to continuously collect the current image of the target scene and save it in the image buffer queue in response to the second trigger operation; and when the storage space of the image buffer queue is empty, collect The current image of overwrites the previous cached image that has been stored in the image cache queue.
The image processing system according to claim 10, wherein the image buffer queue comprises a plurality of image buffer queues configured respectively corresponding to each camera component;

The image buffer queue reading module is further configured to activate at least two of the camera components in response to a second triggering operation, collect current images of the target scene through the two camera components, and save them in the corresponding image buffer queue .
The image processing system according to claim 13, wherein the image processing system further comprises:

A scene recognition module, configured to perform scene recognition on the current image to obtain the scene category of the target scene;

The target image buffer queue confirmation module is used to determine the corresponding target camera component and the target image buffer queue corresponding to the target camera component according to the scene category, so as to read the target image in response to the first trigger request Cache queue.
The image processing system according to claim 10, wherein the image processing system further comprises:

The pause processing module is used to respond to the first trigger operation to pause the acquisition of the current image corresponding to the target scene when the current frame image is acquired.
The image processing system according to claim 10, wherein the image buffer queue includes at least one frame of the current frame of the target image after the acquisition of the buffer image.
The image processing system according to claim 12, wherein the second trigger operation is a control operation of opening a camera application or a third-party photographing application and entering a photographing preset interface;

When the second trigger operation occurs, the image buffer queue is created.
The image processing system according to claim 10, wherein the first trigger operation is a shooting operation in a camera application or a third-party shooting application.
An electronic device, characterized in that, the electronic device includes:

One or more processors;

The storage device is configured to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement any of claims 1 to 9 The image processing method described in one item.
A computer-readable medium having a computer program stored thereon, wherein the computer program implements the image processing method according to any one of claims 1-9 when the computer program is executed by a processor.