WO2023185127A1

WO2023185127A1 - Image processing method and electronic device

Info

Publication number: WO2023185127A1
Application number: PCT/CN2022/140810
Authority: WO
Inventors: 陈国乔
Original assignee: 荣耀终端有限公司
Priority date: 2022-03-29
Filing date: 2022-12-21
Publication date: 2023-10-05
Also published as: CN116939363A

Abstract

The present application relates to the field of image processing. Provided are an image processing method and an electronic device, the image processing method being applied to the electronic device and comprising: starting a camera application in the electronic device; displaying a first preview image, the zoom ratio corresponding to the first preview image being a first ratio, and the center point of the first preview image being a first center point; determining a second center point in the first preview image, the second center point being the center point of a target area, and the first center point not coinciding with the second center point; detecting a first operation, the first operation indicating that the zoom ratio of the electronic device is a second ratio; and in response to the first operation, displaying a second preview image, the center point of the second preview image being the second center point. On the basis of the technical solution of the present application, automatic zooming of a target area in a shot scene can be achieved, so that photographing experience of a user is improved.

Description

Image processing methods and electronic equipment

This application claims priority to the Chinese patent application submitted to the State Intellectual Property Office on March 29, 2022, with application number 202210318644. Applying.

Technical field

The present application relates to the field of image processing, specifically, to an image processing method and electronic equipment.

Background technique

With the rapid development and widespread application of multimedia technology and network technology, people use a large amount of image information in daily life and production activities. In order to meet the needs of taking pictures in different scenes, camera modules in electronic devices usually have zoom capabilities. The zoom capabilities can include optical zoom (optical zoom) or digital zoom (digital zoom), etc.; optical zoom refers to the function of zooming through the camera module. The lens moves to enlarge or shrink the scene being photographed; digital zoom achieves the effect of magnifying distant scenes by increasing the area of each pixel of the image; for optical zoom or digital zoom, the image sensor in the electronic device is usually used. The center is the center point of zoom.

However, when it is necessary to zoom in on a target area in the photographed scenery, for example, to zoom in on an area of interest to the user, the user is required to move the electronic device and aim the electronic device at the target area in the photographed scenery, resulting in a poor user experience.

Therefore, how to automatically zoom on a target area in a photographed scene without moving the electronic device has become an urgent problem that needs to be solved.

Contents of the invention

This application provides an image processing method and an electronic device, which can realize automatic zooming of a target area in a photographed scene without the electronic device moving; thereby improving the user's shooting experience.

In a first aspect, an image processing method is provided. The image processing method is applied to electronic devices and includes:

Launch the camera application in the electronic device;

Display a first preview image, the zoom magnification corresponding to the first preview image is the first magnification, and the center point of the first preview image is the first center point;

Determine a second center point in the first preview image, the second center point is the center point of the target area, and the first center point does not coincide with the second center point;

Detecting a first operation indicating that the zoom magnification of the electronic device is a second magnification;

In response to the first operation, a second preview image is displayed, and the center point of the second preview image is the second center point.

It should be understood that the target area in the first preview image may refer to an image area in the first preview image that the user is interested in, or may refer to an image area in the first preview image that needs to be tracked for zooming.

The image processing method provided by the embodiment of the present application can realize zoom based on the target area during the zoom shooting process; for example, during the entire zoom shooting process, there is no need to collect the zoom center to always be the center of the sensor, but to change the zoom center from the sensor The center of the camera smoothly transitions to the center of the target area in the shooting scene; allowing users to achieve tracking zoom on the target area in the shooting scene without moving electronic devices, improving the user's shooting experience.

With reference to the first aspect, in some implementations of the first aspect, the second preview image coincides with the target area.

It should be understood that the second preview image coinciding with the target area may mean that the second preview image partially coincides with the target area, or the second preview image completely coincides with the target area.

In conjunction with the first aspect, in some implementations of the first aspect, the second preview image includes the target area.

In conjunction with the first aspect, in some implementations of the first aspect, the second preview image includes a part of the target area.

With reference to the first aspect, in some implementations of the first aspect, when the first preview image and the second preview image are displayed, the position of the electronic device is the same.

It should be noted that the fact that the electronic devices are in the same position may mean that the electronic devices do not undergo deflection, translation, flipping or other movements.

In embodiments of the present application, when the position of the electronic device is the same, that is, when the electronic device does not move, tracking zoom can be implemented for the target area in the first preview image, thereby improving the user's shooting experience.

Combined with the first aspect, some implementations of the first aspect also include:

A second operation is detected, the second operation refers to the zoom magnification of the electronic device being a third magnification;

In response to the second operation, a third preview image is displayed, the center point of the third preview image is a third center point, and the third center point is between the first center point and the second center point. Online.

In embodiments of the present application, before detecting the first operation, the electronic device may also detect a second operation. The second operation indicates that the zoom magnification of the electronic device is a third magnification, and the third magnification is greater than the first magnification and less than the second magnification. magnification; that is, during the zooming process of the electronic device, the zoom center can move from the first center point to the third center point, and then to the second center point; thereby avoiding the jump of the second preview image and achieving smooth zoom.

With reference to the first aspect, in some implementations of the first aspect, the connection between the first center point and the second center point includes N center points, and each of the N center points A point corresponds to at least one zoom factor, and N is an integer greater than or equal to 2.

In a possible implementation, the N center points include a first center point, a second center point and N-2 center points; wherein, the N-2 center points are located between the first center point and the second center point. On the connection line, each of the N-2 center points can correspond to one zoom factor; the second center point can correspond to at least one zoom factor.

In the embodiment of the present application, N center points may be included between the first center point and the second center point, and each center point may correspond to a zoom magnification, thereby achieving the transformation of the zoom center from the first center point to the second center point. The smooth transition of points allows users to achieve tracking zoom on the target area in the shooting scene without moving electronic devices.

The line connecting the first center point and the second center point is equally divided to obtain the N center points.

In the embodiment of the present application, the connection line between the first center point and the second center point can be equally divided, so that during the zooming process, the zoom center can be moved from the first center point to the second center point. The smooth transition of points allows users to achieve tracking zoom on the target area in the shooting scene without moving electronic devices.

The line connecting the first center point and the second center point is divided according to an interpolation algorithm to obtain the N center points.

In the embodiment of the present application, the connection line between the first center point and the second center point can be divided through an interpolation algorithm, so that during the zooming process, the zoom center can be moved from the first center point to the second center point. The smooth transition between the two center points allows users to achieve tracking zoom on the target area in the shooting scene without moving electronic devices.

In conjunction with the first aspect, in some implementations of the first aspect, displaying a second preview image in response to the first operation includes:

If the ratio between the area of the target area and the area of the first preview image is less than or equal to the first preset threshold, display the second preview image using a first pixel merging method;

If the ratio between the area of the target area and the area of the first preview image is greater than the first preset threshold, the second preview image is displayed using a second pixel combining method.

In the embodiment of the present application, when the ratio between the area of the target area and the area of the first preview image is less than or equal to the first preset threshold, since the field of view of the electronic device is small, the acquired pixels The number of points is small; displaying the second preview image through the first pixel merging method can increase the number of corresponding pixels in the image, thereby improving the clarity of the image.

It should be understood that the first pixel binning method may refer to using the Remosaic method to read the image; the second pixel binning method may refer to using the Binning method to read the image.

With reference to the first aspect, in some implementations of the first aspect, displaying the second preview image using a first pixel merging method includes:

Using the cutting area corresponding to the second magnification to perform cutting processing on the first preview image, a first image area is obtained, and the first image area includes M pixels;

The M pixels are rearranged to obtain K pixels, M and K are both positive integers, and K is greater than M;

The second preview image is displayed based on the K pixels.

The M pixels are merged to obtain H pixels, M and H are both positive integers, and H is less than M;

A second preview image is displayed based on the H pixels.

In the embodiment of the present application, when the ratio between the area of the target area and the area of the first preview image is greater than the first preset threshold, since the field of view of the electronic device is large, the number of pixels acquired is More; displaying the second preview image through the second pixel merging method can reduce the calculation load of the electronic device and improve the performance of the electronic device.

With reference to the first aspect, in some implementations of the first aspect, determining the second center point in the first preview image includes:

The user's click operation on the first preview image is detected, and the second center point is the touch point between the user and the electronic device.

The first subject in the first preview image is detected, and the second center point is the center point of the first subject.

In conjunction with the first aspect, in some implementations of the first aspect, the second magnification is determined based on a ratio between an area of the target area and an area of the first preview image.

In connection with the first aspect, in some implementations of the first aspect, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/4, the second magnification is 2 magnification.

In connection with the first aspect, in some implementations of the first aspect, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/9, the second magnification is 3 magnification.

In connection with the first aspect, in some implementations of the first aspect, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/16, the second magnification is 4x magnification.

In a second aspect, an electronic device is provided. The electronic device includes: one or more processors, a memory, and a display screen; the memory is coupled to the one or more processors, and the memory is used to store a computer Program code, the computer program code comprising computer instructions invoked by the one or more processors to cause the electronic device to perform:

Launch the camera application in the electronic device;

Combined with the second aspect, in some implementations of the second aspect, the second preview image coincides with the target area.

In conjunction with the second aspect, in some implementations of the second aspect, the second preview image includes the target area.

In conjunction with the second aspect, in some implementations of the second aspect, the second preview image includes a part of the target area.

With reference to the second aspect, in some implementations of the second aspect, when the first preview image and the second preview image are displayed, the position of the electronic device is the same.

In conjunction with the second aspect, in some implementations of the second aspect, the one or more processors invoke the computer instructions to cause the electronic device to execute:

A third operation is detected, the third operation refers to the zoom magnification of the electronic device being a third magnification;

In response to the third operation, a third preview image is displayed, the center point of the third preview image is a third center point, and the third center point is between the first center point and the second center point. Online.

Combined with the second aspect, in some implementations of the second aspect, the connection between the first center point and the second center point includes N center points, and each center point in the N center points A point corresponds to at least one zoom factor, and N is an integer greater than or equal to 2.

If the ratio between the area of the target area and the area of the second preview image is less than or equal to the first preset threshold, display the second preview image using a first pixel merging method;

If the ratio between the area of the target area and the area of the second preview image is greater than the first preset threshold, the second preview image is displayed using a second pixel combining method.

The second preview image is displayed based on the K pixels.

A second preview image is displayed based on the H pixels.

In conjunction with the second aspect, in some implementations of the second aspect, the second magnification is determined based on a ratio between the area of the target area and the area of the first preview image.

Combined with the second aspect, in some implementations of the second aspect, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/4, the second magnification is 2 magnification.

Combined with the second aspect, in some implementations of the second aspect, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/9, the second magnification is 3 magnification.

Combined with the second aspect, in some implementations of the second aspect, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/16, the second magnification is 4x magnification.

In a third aspect, an electronic device is provided, including a module/unit for executing the first aspect or any image processing method in the first aspect.

A fourth aspect provides an electronic device. The electronic device includes one or more processors and memories; the memory is coupled to the one or more processors, and the memory is used to store computer program codes, and the The computer program code includes computer instructions that are invoked by the one or more processors to cause the electronic device to perform the first aspect or any method in the first aspect.

In a fifth aspect, a chip system is provided. The chip system is applied to an electronic device. The chip system includes one or more processors. The processor is used to call computer instructions to cause the electronic device to execute the first aspect. Or any method in the first aspect.

In a sixth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer program code. When the computer program code is run by an electronic device, the electronic device causes the electronic device to execute the first aspect or the first aspect. any of the methods.

In a seventh aspect, a computer program product is provided. The computer program product includes: computer program code. When the computer program code is run by an electronic device, the electronic device causes the electronic device to execute the first aspect or any of the first aspects. a way.

The image processing method provided by the embodiment of the present application can realize zoom based on the target area during the zoom shooting process; for example, during the entire zoom shooting process, there is no need to collect the zoom center to always be the center of the sensor, but to change the zoom center from the sensor The center of the camera smoothly transitions to the center of the target area in the shooting scene; allowing users to achieve tracking zoom on the target area in the shooting scene without moving electronic devices, improving the user's shooting experience. In addition, when the field of view of the electronic device is small, the first pixel combining method can be used to read out the image, thereby avoiding a large loss of clarity of the image after zooming and improving the clarity of the image after zooming.

Description of drawings

Figure 1 is a schematic diagram of a pixel combining method provided by an embodiment of the present application;

Figure 2 is a schematic diagram of another pixel combining method provided by an embodiment of the present application;

Figure 3 is a schematic diagram of another pixel combining method provided by an embodiment of the present application;

Figure 4 is a schematic diagram of another pixel combining method provided by an embodiment of the present application;

Figure 5 is a schematic diagram of a hardware system suitable for the electronic device of the present application;

Figure 6 is a schematic diagram of a software system suitable for the electronic device of the present application;

Figure 7 is a schematic diagram of an application scenario suitable for the embodiment of the present application;

Figure 8 is a schematic interface diagram of an image processing method provided by an embodiment of the present application;

Figure 9 is a schematic interface diagram of an image processing method provided by an embodiment of the present application;

Figure 10 is a schematic diagram of the smooth transition of the zoom center provided by the embodiment of the present application;

Figure 11 is a schematic diagram of an image processing method provided by an embodiment of the present application;

Figure 12 is a schematic interface diagram of an image processing method provided by an embodiment of the present application;

Figure 13 is a schematic interface diagram of an image processing method provided by an embodiment of the present application;

Figure 14 is a schematic flow chart of an image processing method provided by an embodiment of the present application;

Figure 15 is a schematic diagram of a second preview image overlapping the target area provided by an embodiment of the present application;

Figure 16 is a schematic flow chart of an image processing method provided by an embodiment of the present application;

Figure 17 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

Figure 18 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

In the embodiments of the present application, the following terms “first”, “second”, etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, features defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

In order to facilitate understanding of the embodiments of the present application, the relevant concepts involved in the embodiments of the present application are briefly described first.

1. Pixel merging (Binning)

When the electronic device captures an image, the light reflected by the target object is collected by the camera, so that the reflected light is transmitted to the image sensor. The image sensor includes multiple photosensitive elements. The charge collected by each photosensitive element is one pixel, and a binning operation is performed on the pixel information. Specifically, Binning can merge n×n pixels into one pixel. For example, Binning can combine adjacent 2×2 pixels into one pixel; that is, the color of adjacent 2×2 pixels is presented in the form of one pixel.

For example, as shown in (a) in Figure 1 , the electronic device obtains the image and reads out the image in a Binning manner. Among them, (a) in Figure 1 is a 4×4 pixel diagram, and adjacent 2×2 pixels are synthesized into one pixel. (b) in Figure 1 is a schematic diagram of pixels read out by Binning. For example, using the Binning method, the 2×2 pixels in the 01 area shown in (a) in Figure 1 can be combined to form the pixel R shown in (b) in Figure 1; The 2×2 pixels in the 02 area shown in (a) are combined to form the pixel G shown in (b) in Figure 1; the 2×2 pixels in the 03 area shown in (a) in Figure 1 pixels are combined to form the pixel G shown in (b) in Figure 1; the 2×2 pixels in the 04 area shown in (a) in Figure 1 are combined to form the pixel G shown in (b) in Figure 1. Pixel B shown.

Among them, taking the output image format as a Bayer format image as an example, the Bayer format image refers to an image that only includes red, blue, and green (ie, the three primary colors). For example, the pixel formed by 2×2 pixels in the 01 area is red (R), the pixel formed by the 2×2 pixels in the 02 area is green (G), and the pixel formed by the 2×2 pixels in the 03 area is green (G), and the pixel formed by 2×2 pixels in the 04 area is blue (B).

It should be understood that what is shown in Figure 1 may refer to the four-in-one method of Binning, that is, the 2×2 pixels shown in (a) in Figure 1 are synthesized into one pixel shown in (b) in Figure 1; In addition, Binning can also include a nine-in-one method, or a sixteen-in-one method, etc.; among them, the nine-in-one method refers to using Binning to combine 3×3 pixels to form 1 pixel; the sixteen-in-one method refers to using Binning Combine 4×4 pixels to form 1 pixel.

For example, as shown in (a) of Figure 2 , the electronic device obtains the image and reads out the image in a Binning method (for example, a nine-in-one method). Among them, (a) in Figure 2 is a 6×6 pixel diagram, which combines adjacent 3×3 pixels into one pixel; (b) in Figure 2 is a pixel diagram read out by Binning. For example, using the Binning method, the 3×3 pixels in the 05 area shown in (a) in Figure 2 can be combined to form the pixel R shown in (b) in Figure 2; The 3×3 pixels in the 06 area shown in (a) are combined to form the pixel G shown in (b) in Figure 2; the 3×3 pixels in the 07 area shown in (a) in Figure 2 pixels are combined to form the pixel G shown in (b) in Figure 2; the 3×3 pixels in the 08 area shown in (a) in Figure 2 are combined to form the pixel G shown in (b) in Figure 2 Pixel B shown.

For example, as shown in (a) of Figure 3 , the electronic device obtains the image and reads out the image in a Binning manner (for example, a sixteen-in-one manner). Among them, (a) in Figure 3 is a 6×6 pixel diagram, which combines adjacent 3×3 pixels into one pixel; (b) in Figure 3 is a pixel diagram read out by Binning. For example, using the Binning method, the 4×4 pixels in the 09 area shown in (a) in Figure 3 can be combined to form the pixel R shown in (b) in Figure 3; The 4×4 pixels in the 10 area shown in (a) are combined to form the pixel G shown in (b) in Figure 3; the 4×4 pixels in the 11 area shown in (a) in Figure 3 pixels are combined to form the pixel G shown in (b) in Figure 3; the 4×4 pixels in the 12 areas shown in (a) in Figure 3 are combined to form the pixel G shown in (b) in Figure 3. Pixel B shown.

In the embodiments of the present application, for ease of understanding, the above-mentioned Binning method may be called the "second pixel merging method"; the "second pixel merging method" may also be called the "second pixel arrangement method", "second pixel merging method" Pixel combination mode" or "second image readout mode", etc.

2. Pixel rearrangement (Remosaic)

When the image is read out using the Remosaic method, the pixels are rearranged into a Bayer format image. For example, assuming that a pixel in the image is composed of n×n pixels; then Remosaic can be used to rearrange a pixel in the image into n×n pixels.

For example, (a) in Figure 4 is a schematic diagram of a pixel, and each pixel can be synthesized from adjacent 2×2 pixels. (b) in Figure 4 is an image diagram of the Bayer format read using the Remosaic method. Specifically, in (a) of FIG. 4 , pixel A is red, pixels B and C are green, and pixel D is blue. Divide each pixel in (a) in Figure 4 into 3×3 pixels and rearrange them respectively. That is, the Remosaic method is used to read, and the read image is the Bayer format image shown in (b) in Figure 4.

It should be understood that when the zoom factor of the electronic device increases during the process of capturing images, the impact on the clarity of the image will be greater. For example, as the zoom factor increases, the viewing range displayed by the electronic device will be adjusted to part of the scene being photographed, and the corresponding field of view (FOV) of the camera will also gradually decrease; Decrease, the number of acquired pixels decreases, which reduces the clarity of the image; through Remosaic, one pixel can be rearranged into multiple Bayer format pixels, thereby increasing the number of pixels; after the number of pixels increases, the details of the image Information is increased, which improves the clarity of the image.

In the embodiments of the present application, for ease of understanding, the above Remosaic method may be called the "first pixel merging method"; the "first pixel merging method" may also be called the "first pixel arrangement method", "the first pixel merging method" Pixel combination mode" or "first image readout mode", etc.

The image processing method and electronic device in the embodiments of the present application will be described below with reference to the accompanying drawings.

Figure 5 shows a hardware system suitable for the electronic device of the present application.

The electronic device 100 may be a mobile phone, a smart screen, a tablet, a wearable electronic device, a vehicle-mounted electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a notebook computer, or a super mobile personal computer ( Ultra-mobile personal computer (UMPC), netbook, personal digital assistant (personal digital assistant, PDA), projector, etc. The embodiment of the present application does not place any restrictions on the specific type of the electronic device 100.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It should be noted that the structure shown in FIG. 5 does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or less components than those shown in FIG. 5 , or the electronic device 100 may include a combination of some of the components shown in FIG. 5 , or , the electronic device 100 may include sub-components of some of the components shown in FIG. 5 . The components shown in Figure 5 may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), an image signal processor (image signal processor) , ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, neural network processing unit (NPU). Among them, different processing units can be independent devices or integrated devices. The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.

The connection relationship between the modules shown in FIG. 5 is only a schematic illustration and does not constitute a limitation on the connection relationship between the modules of the electronic device 100 . Optionally, each module of the electronic device 100 may also adopt a combination of various connection methods in the above embodiments.

The wireless communication function of the electronic device 100 can be implemented through components such as antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.

The electronic device 100 may implement display functions through a GPU, a display screen 194, and an application processor. The GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

For example, in the embodiment of the present application, determining the first center point, the second center point and the target area can be performed in the processor 110; in addition, N center points can be obtained based on the first center and the second center point. ;During the zoom shooting process, the zoom center can be smoothly transitioned from the first center to the second center based on N zoom center points, and while the electronic device keeps its position unchanged, tracking zoom can be achieved for the target area in the shooting scene.

For example, the relevant steps of determining the target area and the target center point in the image processing method of the present application may be executed in the processor 110 .

For example, the display screen 194 may be used to display the first preview image or the second preview image.

The electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera sensor through the lens, the optical signal is converted into an electrical signal, and the camera sensor passes the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can algorithmically optimize the noise, brightness and color of the image. ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

Camera 193 is used to capture still images or video. The object passes through the lens to produce an optical image that is projected onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard red green blue (RGB), YUV and other format image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

For example, in the embodiment of the present application, the camera 193 may be used to obtain the first preview image or the second preview image.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3 and MPEG4.

The gyro sensor 180B may be used to determine the motion posture of the electronic device 100 . In some embodiments, the angular velocity of electronic device 100 about three axes (ie, x-axis, y-axis, and z-axis) may be determined by gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyro sensor 180B detects the angle at which the electronic device 100 shakes, and calculates the distance that the lens module needs to compensate based on the angle, so that the lens can offset the shake of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used in scenarios such as navigation and somatosensory games.

The acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally the x-axis, y-axis, and z-axis). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. The acceleration sensor 180E can also be used to identify the posture of the electronic device 100 as an input parameter for applications such as horizontal and vertical screen switching and pedometer.

Distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, such as in a shooting scene, the electronic device 100 may utilize the distance sensor 180F to measure distance to achieve fast focusing.

The ambient light sensor 180L is used to sense ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touching.

Fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement functions such as unlocking, accessing application locks, taking photos, and answering incoming calls.

Touch sensor 180K, also known as touch device. The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen. The touch screen is also called a touch screen. The touch sensor 180K is used to detect a touch operation acted on or near the touch sensor 180K. The touch sensor 180K may pass the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 and at a different position from the display screen 194 .

The hardware system of the electronic device 100 is described in detail above, and the software system of the electronic device 100 is introduced below.

FIG. 6 is a schematic diagram of a software system of an electronic device provided by an embodiment of the present application.

As shown in Figure 6, the software system can be divided into four layers, from top to bottom: application layer, application framework layer, Android Runtime and system library, and kernel layer.

The application layer can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

The image processing of the embodiments of the present application can be applied to camera applications; for example, the image processing method provided by the embodiments of the present application can be used to achieve zoom based on the target area during the zoom shooting process of the camera application; specifically, throughout the During zoom shooting, the zoom center of the electronic device does not always need to be the center of the sensor. Instead, the zoom center smoothly transitions from the center of the sensor to the center of the target area in the shooting scene. This allows the user to focus on shooting without moving the electronic device. Tracking zoom is implemented on the target area in the scene.

The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer can include some predefined functions.

For example, the application framework layer includes the window manager, content provider, view system, phone manager, resource manager, and notification manager.

Android Runtime can include core libraries and virtual machines. The Android runtime is responsible for the scheduling and management of the Android system.

The core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.

The application layer and application framework layer can run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules, such as: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing libraries (such as: open graphics library for embedded systems, OpenGL ES) and 2D graphics engines (for example: skia graphics library (skia graphics library, SGL)).

The kernel layer is the layer between hardware and software. The kernel layer can include driver modules such as display driver, camera driver, audio driver, and sensor driver.

Currently, in order to meet the needs of taking pictures in different scenarios, camera modules in electronic devices usually have zoom capabilities. The zoom capabilities can include optical zoom or digital zoom. Optical zoom refers to zooming in or out by moving the lens in the camera module. Shooting scenery; digital zoom achieves the effect of magnifying distant scenery by increasing the area of each pixel of the image; however, for optical zoom or digital zoom, as the magnification increases during the zoom process, the zoom The center point is always the center of the sensor in the electronic device; that is, the image is cropped according to the center during the entire zoom process. During the zoom process, it is cropped step by step along the central area of the sensor imaging; the center of the image is always the sensor The center area of imaging; if you need to adjust the zoom center, you need to move the direction of the electronic device so that the electronic device points to the target object in the zoom center for zooming. In this zoom processing method, when it is necessary to zoom in on the target area in the photographed scene, for example, to zoom in on the user's area of interest, the user needs to move the electronic device to align the electronic device with the target area in the photographed scene, otherwise The zoom operation for the target area cannot be implemented, resulting in poor user experience.

In view of this, embodiments of the present application provide an image processing method that can achieve zoom based on the target area during the zoom shooting process; specifically, during the entire zoom shooting process, the zoom center of the electronic device does not always need to be Instead of moving the center of the sensor, the zoom center smoothly transitions from the center of the sensor to the center of the target area in the shooting scene; allowing users to achieve tracking zoom for the target area in the shooting scene without moving electronic devices, improving the user's shooting experience. experience.

Figure 7 is a schematic diagram of an application scenario suitable for this application. The image processing method provided by the embodiment of the present application can be applied to zoom photography of an electronic device; for example, in the process of zoom photography or zoom video recording of an electronic device.

Exemplarily, (a) and (b) in Figure 7 are schematic diagrams of existing zoom processing; when the electronic device photographs the target object, the electronic device displays a display as shown in (a) in Figure 7 In the preview image 210, the zoom factor of the electronic device is "1×" (1 times), that is, there is no zoom; after the electronic device detects the zoom operation, for example, after the electronic device detects the 2x zoom operation, it can be displayed as shown in Figure 7 The preview image 220 shown in (b); at this time, the electronic device displays that the zoom factor is "2×" (2 times); wherein, when the electronic device responds to the zoom operation, the preview image 220 is the preview image 210 without the zoom factor. part. In the existing zoom process, the zoom center remains unchanged, that is, the center point of the preview image 210 is the same as the center point of the preview image 220 .

Exemplarily, (c) and (d) in Figure 7 are schematic diagrams of the image processing method provided by the embodiment of the present application; when the electronic device captures the target object, the electronic device displays a display as shown in Figure 7 (c In the preview image 230 shown in ), the zoom factor of the electronic device is "1×" (1 times), that is, there is no zoom; the electronic device detects the operation of turning on the directional zoom and starts to execute the image processing method provided by the embodiment of the present application. Tracking zoom based on the target area in the preview image can be implemented; for example, after the electronic device detects the 2x zoom operation, the preview image 240 as shown in (d) of Figure 7 can be displayed; the difference between the preview image 230 and the preview image 240 The center point can be different.

The image processing method provided by the embodiment of the present application will be described in detail below with reference to Figures 8 to 15.

Figure 8 is a schematic interface diagram of the image processing method provided by the embodiment of the present application.

For example, as shown in (a) of FIG. 8 , the user can instruct the electronic device to run the camera application by clicking the icon 302 of the "Camera" application on the desktop 301. After the electronic device runs the camera application, the following is displayed: The shooting interface shown in (b) in Figure 8 . Alternatively, when the electronic device is in the lock screen state, the user can instruct the electronic device to run the camera application by sliding to the right on the display screen of the electronic device, and the electronic device can display the shooting interface as shown in (b) of Figure 8 . Alternatively, the electronic device is in a locked screen state, and the lock screen interface includes an icon of the camera application. The user instructs the electronic device to open the camera application by clicking on the icon of the camera application, and the electronic device can display (b) in Figure 8 the shooting interface shown. Or, when the electronic device is running other applications, the application has the permission to call the camera application; the user can instruct the electronic device to open the camera application by clicking the corresponding control, and then the electronic device can display as shown in (b) in Figure 8 shooting interface. For example, when the electronic device is running an instant messaging application, the user can instruct the electronic device to open the camera application by selecting the camera function control; as shown in (b) of Figure 8, the shooting interface can include a viewfinder 303, Shooting controls and function controls; among them, the shooting controls include controls 304, setting controls, etc.; the function controls include: large aperture, portrait, photography and video recording, etc.; after the electronic device detects the click operation on the control 304, it starts to execute the functions provided by this solution. The image processing method is to start executing the intelligent zoom method provided by this solution.

In some implementations, the zoom factor indication 305 may also be included in the shooting interface. Generally speaking, the default zoom factor of an electronic device is the basic factor, which can be "1×". Among them, the zoom factor can be understood as the focal length of the current camera, which is equivalent to the zoom/enlargement factor of the reference focal length; as shown in (c) of Figure 8, the shooting interface 306 can also include a ruler 307, which can be used to indicate the current The zoom ratio of “2×” displays the shooting interface shown in (d) in Figure 8 .

It should be understood that the image processing method provided by the embodiment of the present application is exemplified starting with clicking the control 304. The image processing method provided by the embodiment of the present application can also be selected to be opened through the setting options in the setting control shown in (b) in Figure 8 Processing method; Alternatively, other controls can be set in (b) of Figure 8 , and the electronic device detects click operations on other controls to start the image processing method according to the embodiment of the present application.

Figure 9 is a schematic interface diagram of an image processing method provided by yet another embodiment of the present application.

For example, as shown in (a) of Figure 9, the user can instruct the electronic device to run the camera application by clicking the icon 402 of the "Camera" application in the desktop 401, and the electronic device runs the camera application, as shown in Figure 9 The shooting interface shown in (b). As shown in (b) of Figure 9 , the shooting interface may include a viewfinder 403, shooting controls, and functional controls; the shooting controls include controls 404, setting controls, etc.; the functional controls include: large aperture, portrait, photo taking, and video recording. etc.; after the electronic device detects the click operation on the control 404, it starts to execute the image processing method provided by this solution.

In some implementations, the zoom factor indication 405 may also be included in the shooting interface. Generally speaking, the default zoom factor of an electronic device is the basic factor, which can be "1×". Among them, the zoom factor can be understood as the focal length of the current camera, which is equivalent to the zoom/enlargement factor of the reference focal length; as shown in (c) in Figure 9, the user can make two fingers on the display screen of the electronic device (or, Use a pinching gesture with three fingers to reduce the zoom ratio used by the electronic device; or, the user can make a gesture of sliding outwards with two fingers (or three fingers) on the display screen of the electronic device, that is, in the opposite direction to pinching. Increase the distance between your fingers and increase the zoom ratio used by electronic devices. For example, you can adjust the zoom ratio of the camera application from "1×" to "2×" through a two-finger sliding gesture on the display screen of the electronic device, and display the shooting as shown in (d) of Figure 9 interface.

It should be understood that the method of running the camera application shown in Figure 9 can be referred to the relevant description of Figure 8 and will not be described again here.

It should also be understood that the ruler shown in Figures 8 and 9 is located at the bottom of the viewfinder frame, and the ruler can also be located on the right side of the viewfinder frame; this application does not impose any restrictions on the specific position of the ruler.

Optionally, in another embodiment of the present application, the electronic device can turn on smart zoom, and the electronic device automatically adjusts the zoom magnification by identifying the distance between the electronic device and the photographed object; during the zooming process, the electronic device can perform the steps provided by the embodiments of the present application. Image processing methods.

Embodiments of the present application provide an image processing method that can be applied to zoom shooting of images; during the zoom shooting process, zoom based on a target area can be achieved, and the target area can refer to the image area that the user is interested in, or the target area. It can refer to the image area that needs to be tracked for zooming; for example, the zoom center of the electronic device does not always need to be the center of the sensor, but the zoom center smoothly transitions from the center of the sensor to the center of the target area; for example, as shown in Figure 10 ( a) shows the existing zoom processing process. The zoom center is always located at point 1 during zoom shooting; (b) in Figure 10 shows a schematic diagram of the zoom center obtained through the image processing method in the embodiment of the present application. ; Among them, the sensor center of the electronic device is point 1, the image area 410 is the target area, and the center point of the target area is point 4; through the image processing method provided by the embodiment of the present application, during zoom shooting (for example, 4 zooms include Zooming from image 1 to image 2, image 3 and image 4) can realize the zoom center point moving from point 1 to point 2, point 3 and finally the zoom center point moves to point 4, thereby achieving directional zoom based on the target area; therefore, Through the image processing method provided by the embodiment of the present application, when the position of the electronic device is the same, tracking zoom can be achieved for the target area in the shooting scene, thereby improving the user's shooting experience.

The zoom processing process based on the target area shown in (b) in FIG. 10 will be described in detail below with reference to FIG. 11 . The zoom processing process shown in Figure 11 may include the following steps:

Step 1: In the shooting mode of the electronic device at the reference focal length, collect the image 601; in the image 601, determine the area size of the target area 602 in the image 601 and the center point of the target area 602; according to the area size and the center point of the target area 602 The center point of the target area 602 may determine the location of the target area 602 .

It should be understood that the target area 602 may refer to an image area that the user is interested in, or the target area 602 may refer to an image area that needs to be tracked for zooming.

For example, the reference focal length of the electronic device may refer to the zoom magnification of “1×”; where the center of the image 601 is point A; point A may be determined based on the center position of the sensor in the electronic device.

For example, the location of the center point of the target area 602 can be obtained based on the following method:

Implementation method one

For example, after the electronic device displays the image 601, it detects the user's click operation on the image 601; in response to the user's click operation, the user's contact point with the image 601 can be used as the target center point; for example, for clicking the image 601 If you select the chin of the portrait in the image, you can use the chin of the portrait as the target center point, which is point D.

Implementation method two

For example, portrait recognition can be performed on the image to identify the portrait in the image 601; the center point of the portrait is used as the center point of the target area.

Implementation method three

For example, an image area with a higher priority level in the image 601 may be determined based on the recognition strategy, and the center point of the image area with a higher priority level may be used as the center point of the target area.

For example, the recognition strategy may mean that the shooting scene includes Category 1, Category 2 or Category 3, etc.; the priority of Category 1 is higher than the priority of Category 2; the priority of Category 2 is higher than the priority of Category 3; for example , for portrait shooting mode, category 1 can refer to portraits, category 2 can refer to green plants, and category 3 can refer to landscapes (for example, the sky, distant mountains, etc.); for example, for landscape shooting mode, category 1 can refer to landscapes. (For example, the sky, distant mountains, etc.) Category 2 can refer to green plants, and Category 3 can refer to portraits.

It should be understood that the above is an example of the recognition strategy. The recognition strategy can be used to determine the image area where the category with a higher priority in the image 601 is located. This application does not limit the specific content of the recognition strategy.

Implementation method four

For example, the electronic device can identify the subject in the first preview image; use the center point of the image area where the subject is located as the center point of the target area; for example, the subject can refer to a portrait or a green plant in the first preview image. , scenery or animals; after recognizing the subject in the first preview image, the center point of the image area where the subject is located can be used as the center point of the target area.

Implementation method five

For example, assuming that the image 601 includes at least two subjects, prompt information may be displayed on the display screen of the electronic device; the center point of the target subject among the at least two subjects selected by the user is used as the center point of the target area.

For example, assuming that the image 601 includes a portrait and the moon, the prompt message "Zoom is centered on the portrait" can be displayed on the display screen of the electronic device and the selection control "Yes" or "No" is displayed; if it is detected that the user clicks the control " If it is detected that the user clicks the control "No", the center of the moon can be used as the center point of the target area. It should be understood that the above implementation methods 1, 2, 3, 4 and 5 are examples of determining the center point of the target area 602; the center point of the target area 602 can also be determined through other methods. The application does not impose any restrictions on this.

In the embodiment of the present application, the center point of the target area 602 is the target zoom center. During the zooming process, the zoom center can be smoothly transitioned from the center of the sensor (for example, point A) to the target zoom center (for example, point A). Point D); allows the user to achieve tracking zoom for the target area in the shooting scene without moving the electronic device.

Optionally, the area size of the target area 602 in the image 601 may be determined.

For example, as shown in Figure 12, the electronic device can determine the target area based on the user's instructions, and the area size of the target area can be a preset value. When the electronic device detects that the touch point corresponding to the user's click operation on the screen is point D, it determines the target area centered on point D, where the prompt box 610 is used to identify the target area.

Optionally, the user can operate the prompt box 610 to adjust the size and position of the target area. For example, the user can drag the vertex area of the prompt box 610 to expand or reduce the target area. The user can also drag the edge of the prompt box 610 to select different target areas.

For example, the electronic device can automatically identify different image areas in the image 601, and obtain an image area with a higher priority in the image 601 based on the recognition strategy, and the target area 602 covers the image area with a higher priority; as shown in Figure 13, The electronic device recognition image 601 includes a user image area 620, a bench image area 630 and a fishing rod image area 640. Among them, the user image area 620 has the highest priority, so the target area 602 covers the user image area 620; the area of the target area 602 The size may be determined based on user image area 620.

As shown in Figure 11, according to the center position of the sensor in the electronic device, the center point of the image 601 can be determined to be point A, and point A is the center point of the single magnification; through the above implementation methods one to five, the center of the target area 602 can be determined Point D; the target zoom magnification corresponding to point D can be determined based on the area size of the target area 602; for example, assuming that the area size of the target area 602 is A1 and the area size of the image 601 is A2, then point D can be regarded as a zoom The magnification is

center point. Connect point A and point D to get the line between point A and point D; divide the line between point A and point D; for example, you can divide point A and point D according to the scale of the zoom ruler in the camera application The connecting lines between them are equally divided; for example, if point A is the center of single zoom magnification, point D is the center of 2x zoom magnification, and the scale of the zoom ruler in the camera application is 0.2, then point A and D can be The points are equally divided into 5 parts, namely 1x zoom magnification, 1.2x zoom magnification, 1.4x zoom magnification, 1.6x zoom magnification, 1.8x zoom magnification and 2x zoom magnification.

It should be understood that the cropping area during the zoom process is related to the zoom factor; assuming that the image pixels at a single magnification are N×M, and it is detected that the current zoom factor of the electronic device is K times zoom, then the area of the cropping area is

In order to ensure the integrity of the display of the target area, the cropping area needs to cover the target area; since the cropping area corresponding to 2x zoom magnification is 1/4 of the image with 1x zoom magnification; therefore, the area size of the target area 602 is equal to or When the image is smaller than the image corresponding to 1/4 single zoom magnification, the center point of the target area can be regarded as the center point corresponding to 2x zoom magnification.

In one example, if the area size of the target area 602 is equal to or smaller than 1/4 of the area of the image 601, the center point D of the target area 602 can be the center point of the 2x zoom magnification; assuming that point A and D The number of pixels between points is 100. Point A is the center point corresponding to 1x zoom magnification, and point D is the center point corresponding to 2x zoom magnification. As shown in Figure 11, point A and point D can be equally divided. It is 3 parts, namely between center point A, center point B, center point C and center point D. The diagonal pixel interval between each zoom point is 100/3=33.3 pixel size; center point B can represent The center point of 1.33x zoom; center point C can represent the center point of 1.66x zoom; center point D can represent the center point of 2x zoom.

In the embodiment of the present application, as shown in Figure 11, according to the center point A of the single zoom and the center point D of the target area, cropping is gradually performed based on the center point B and the center point C during the zooming process to achieve image-based Smooth zooming of the target area; since the zoom center point gradually moves from point A to point D, the problem of jumping in the preview image can be avoided.

In an example, points A and D can also be divided unequally; for example, the connection between point A and point D can be divided through an interpolation algorithm. For example, points B1 and C1 can be obtained through an interpolation algorithm. point, among which point A can represent the center point of unit zoom, point D can represent the center point of 2x zoom, point B1 can represent the center point of 1.2x zoom, and point C1 can represent the center point of 1.7x zoom.

It should be understood that the above is an example of the division between point A and point D by equal and unequal division; in the embodiment of the present application, during zoom shooting, the zoom center can be from the center of the sensor (for example, A point) smoothly transitions to the center of the target area (for example, point D). This application does not impose any restrictions on the specific division method of the connection between point A and point D.

For example, when the electronic device is in single zoom, the field of view (FOV) of the electronic device can be regarded as 100% of the original shooting angle range, as shown in image 601 in Figure 11; when the electronic device When the zoom magnification is adjusted to 1.33x zoom, for example, the zoom center of the electronic device moves 33.3 pixels from point A along the AD connection to the center point B, and the field of view of the electronic device becomes 56.5% of the original shooting angle range. , as shown in image 603 in Image 11; when the zoom magnification of the electronic device is adjusted to 1.66x zoom, for example, the zoom center of the electronic device moves 33.3 pixels from point B along the line AD to the center point C, and the electronic device The field of view becomes 36.3% of the original shooting angle range, as shown in image 604 in Figure 11; when the zoom magnification of the electronic device is adjusted to 2x zoom, for example, the zoom center of the electronic device is connected from point C along AD The line moves 33.3 pixels in size to the center point D, and the field of view of the electronic device becomes 25% of the original shooting angle range, as shown in image 605 in Figure 11 .

It should be noted that the field of view of the electronic device is used to indicate the maximum angle that the camera of the electronic device can capture when capturing a target object. If the target object is within the maximum angle range that the camera can capture, the light reflected by the target object can be collected by the camera, so that the image of the target object is presented in the electronic device display preview image. If the target object is outside the maximum angle range that the camera can capture, the light reflected by the target object cannot be collected by the camera, so the image of the target object cannot appear in the preview image displayed by the electronic device. Generally speaking, the larger the camera's field of view, the wider the shooting range when using the camera; and the smaller the camera's field of view, the smaller the shooting range when using the camera. The field of view angle can also be called "field of view range", "field of view range", "field of view area", etc.

Step 2: When the electronic device zooms 1.33 times, the field of view of the electronic device becomes 56.5% of the original shooting angle range; therefore, the image 601 can be cropped; specifically, the point B in the image 601 can be As the center point, crop 56.5% of the field of view range corresponding to image 601 to obtain image 603.

Step 3: When the electronic device zooms 1.66 times, the field of view of the electronic device becomes 36.3% of the original shooting angle range; therefore, the image 601 can be cropped; specifically, the point C in the image 601 can be As the center point, crop 36.3% of the field of view range corresponding to image 601 to obtain image 604.

Step 4: When the electronic device performs 2x zoom, since the field of view of the electronic device becomes 25% of the original shooting angle range; therefore, the image 601 can be cropped; specifically, the D point in the image 601 can be As the center point, crop 25% of the field of view range corresponding to image 601 to obtain image 605.

For example, assuming that the image 605 has a cropping area size corresponding to a 2x zoom magnification, the cropping area size of the image 605 is 1/4 of the entire image size; if the area size of the target area 602 is equal to 1 of the area size of the image 601 /4, at this time, the image 605 is the same as the target area 602; if the area size of the target area 602 is less than 1/4 of the area size of the image 601, then the image 605 includes the target area 602 and has point D as the center point. As shown in FIG. 11 , FIG. 11 illustrates that the area size of the target area 602 is 1/4 of the area size of the image 601 , then the image 605 and the target area 602 correspond to the same image content. Optionally, if the zoom process is continued on the image 605, that is, when the zoom process is performed on the image 601 with a zoom magnification greater than 2, further cropping can be performed based on the image corresponding to the 2x zoom magnification; for example, the image 605 is Baseline, use point D as the zoom center point for cropping.

In the embodiment of the present application, when performing 2x zoom, since the field of view of the electronic device is 25% of the field of view corresponding to single zoom, the field of view is smaller at this time, and the number of pixels acquired is smaller; If image 601 is cropped and displayed directly on an electronic device, the definition of the image corresponding to image 605 will be lower; further, in order to improve the clarity of the image after zoom processing, the Remosaic method can be used to perform image processing on the pixels in the image. , obtain image 605; by using the Remosaic method, the number of corresponding pixels in the image 605 can be increased, thereby improving the clarity of the image.

For example, assuming that the pixels collected by the image sensor of the electronic device are 4×4, (a) in Figure 4 is a pixel in Bayer format obtained by using the Binning method; (b) in Figure 4 is a pixel in the Remosaic format. Four Bayer format pixels obtained by using the Remosaic method; for the same number of pixels, the number of pixels can be effectively increased by using the Remosaic method; thereby improving the clarity of the image.

It should be understood that if the 2×2 Remosaic method is used to read the image, that is, the pixels collected by the image sensor are rearranged 2×2, then when the cropping area corresponding to the zoom magnification is less than or equal to 1/4 of the entire image area, use Read the image in Remosaic mode.

Step 5: Display the image corresponding to the target area 602 in the camera application.

For example, according to the resolution of the display screen of the electronic device, the image content corresponding to the image 605 can be adjusted to an image suitable for the display specifications of the electronic device for display.

For example, when the shooting mode of the camera application of the electronic device is in a normal scene (for example, a single zoom scene), the Binning method can be used to read out the image to improve the dynamic range and photosensitivity of the entire image; during the zoom process, if the zoom If the magnification is in the range of single zoom to double zoom, the Binning method can be used to read the image; if the zoom magnification is in the range of double zoom and above, in order to avoid the problem of reduced image clarity, the Remosaic method can be used to read the image. out image.

Optionally, the above example uses the 2×2 Remosaic mode to read out the image; the Remosaic mode to read the image may also be the 3×3 Remosaic mode to read the image, or the 4×4 Remosaic mode to read the image. image.

For example, if a 3×3 Remosaic method is used to read out the image, that is, the pixels collected by the image sensor are rearranged 3×3, then when the cropping area corresponding to the zoom magnification is less than or equal to 1/9 of the entire image area, The image is read out using the Remosaic method; when the cropping area corresponding to the zoom magnification is larger than 1/9 of the entire image area, the image is read out using the Binning method.

For example, if the 4×4 Remosaic method is used to read out the image, that is, the pixels collected by the image sensor are rearranged 4×4, then when the cropping area corresponding to the zoom magnification is less than or equal to 1/16 of the entire image area, The image is read out using the Remosaic method; when the cropping area corresponding to the zoom magnification is larger than 1/16 of the entire image area, the image is read out using the Binning method.

It should be understood that the above is an example description of the image read using the sampling Remosaic method, and this application does not place any limitation on the specific form of the image read using the sampling Remosaic method.

The image processing method provided by the embodiment of the present application can realize zoom based on the target area during the zoom shooting process; for example, during the entire zoom shooting process, there is no need to collect the zoom center to always be the center of the sensor, but to change the zoom center from the sensor The center of the shooting scene smoothly transitions to the center of the target area in the shooting scene; allowing the user to achieve tracking zoom for the target area in the shooting scene without moving the electronic device, improving the user's shooting experience; in addition, when the zoom magnification is large, The image can be read out using the Remosaic method through acquisition, thereby avoiding a large loss of clarity of the image after zooming and improving the clarity of the image after zooming.

Figure 14 is a schematic diagram of an image processing method provided by an embodiment of the present application. The method 700 shown in FIG. 14 includes steps S710 to S750, and these steps will be described in detail below.

Step S710: Start the camera application in the electronic device.

For example, to start the camera application of the electronic device, please refer to the relevant description of (a) in FIG. 8 , which will not be described again here.

Step S720: Display the first preview image.

Wherein, the zoom magnification corresponding to the first preview image is the first magnification, and the center point of the first preview image is the first center point.

For example, the zoom ratio corresponding to the first preview image is the first magnification, and the first magnification can be single zoom (1×); after the electronic device runs the camera application, the corresponding zoom ratio of the single zoom (1×) can be displayed. Preview image.

For example, the first preview image may be a preview image as shown in (b) of Figure 8; or, the first preview image may be a preview image as shown in (b) of Figure 9; or, the first preview image may be as In the image 601 shown in Figure 11, the first center point may be point A.

Step 730: Determine the second center point.

The second center point is the center point of the target area, and the first center point does not coincide with the second center point.

It should be understood that the first center point and the second center point do not coincide with each other may mean that the first center point and the second center point are two points with different positions.

For example, as shown in Figure 11, the first center point may refer to point A in the image 601; the second center point may refer to the center point D of the target area 602; or, as shown in (b) of Figure 10 , the first center point can be pointing point 1, and the second center point can be pointing point 4.

Optionally, the target zoom point may be determined by referring to the related description of determining the location of the center point of the target area in Implementation Mode 1 to Implementation Mode 5 in FIG. 11 , which will not be described again here.

Optionally, as shown in Figure 12, the electronic device can determine the target area based on the user's instructions, and the area size of the target area can be a preset value. When the electronic device detects that the touch point corresponding to the user's click operation on the screen is point D, it determines the target area centered on point D, where the prompt box 610 is used to identify the target area. It should be understood that the specific description can be seen in Figure 12 and will not be described again here.

Optionally, as shown in FIG. 13, a target shooting object (eg, image area 620) in the first preview image is detected, the target area includes the image area where the target shooting object is located, and the target shooting object is based on the first preview. The priority of the subjects in the image is determined. It should be understood that the specific description can be seen in Figure 13 and will not be described again here.

Optionally, the electronic device detects the first subject in the first preview image, and the second center point is the center point of the first subject; for example, the first subject may refer to a portrait or a green plant in the first preview image. , scenery or animals; after identifying the first subject in the first preview image, the center point of the image area where the first subject is located can be used as the center point of the target area.

Step S740: The first operation is detected.

Wherein, the first operation indicates that the zoom factor of the electronic device is the second zoom factor.

Exemplarily, the first operation may refer to a sliding operation, as shown in (c) of Figure 8; or, the first operation may refer to a pinching operation, or an outward sliding operation, as shown in (c) of Figure 9 Show.

Step S750: In response to the first operation, display the second preview image.

Wherein, the zoom magnification corresponding to the second preview image is the second magnification, and the center point of the second preview image is the second center point.

Optionally, the second preview image coincides with the target area; for example, the second preview image includes the target area; or the second preview image includes a part of the target area.

For example, as shown in Figure 15, the target area is 760 and the second preview image is 770, where the target area 760 includes the subject; the second preview image 770 including the target area 760 may mean that the second preview image 770 includes the target area 760 and other image areas; that is, the second preview image 770 includes the image area where the subject is located and other image areas, as shown in (a) of Figure 15; or, the second preview image 770 includes the target area 760 and may refer to the second The preview image 770 completely coincides with the target area 760; that is, the second preview image 770 coincides with the image area where the subject is located, as shown in (b) of Figure 15; the second preview image 770 includes a part of the target area 760, which may mean The second preview image 770 includes a part of the image area in the target area 760 , that is, the second preview image 770 includes a part of the image area where the subject is located, as shown in (c) of FIG. 15 .

It should be understood that including the target area in the second preview image may mean that the target area is covered in the second preview image; or that the second preview image includes the image content of the target area.

For example, the target area 760 shown in Figure 15 may refer to the image area 410 shown in (b) in Figure 10; the second preview image shown in (a) in Figure 15 may refer to the image area 410 shown in (b) in Figure 10 Image 3 shown in (b), image 3 includes the target area 410 and other image areas; wherein, the center point of the second preview image 770 can be the pointing point 3, and the center point of the target area 760 can be the pointing point 4; in Figure 15 The second preview image shown in (b) may refer to image 4 as shown in (b) in Figure 10 , and image 4 coincides with the target area 410; that is, the center point of the second preview image 770 and the center point of the target area 760 The center points coincide with each other, and the center point is point 4; the center point of the second preview image 770 shown in (c) in Figure 15 coincides with the center point of the target area 760, and the center point may refer to (b) in Figure 10 The center point of the image area 410 shown is point 4.

For example, the second preview image may be a preview image as shown in (d) of Figure 8; or, the second preview image may be a preview image as shown in (d) of Figure 9; or, the second preview image may be Image 605 shown in Figure 11.

Optionally, when the first preview image and the second preview image are displayed, the position of the electronic device is the same.

It should be understood that the same position of the electronic device may mean that the electronic device does not undergo deflection, translation, flipping, or other movement.

Optionally, the above image processing method further includes: detecting a second operation, the second operation indicates that the zoom magnification of the electronic device is a third magnification; in response to the second operation, displaying a third preview image, the third preview The center point of the image is the third center point, and the third center point is on the line connecting the first center point and the second center point. For example, as shown in Figure 11, the third center point may refer to point B, and the third preview image may refer to image 603; or, the third center point may refer to point C, and the third preview image may refer to image 604.

Optionally, the connection between the first center point and the second center point includes N center points, each of the N center points corresponds to at least one zoom magnification, and N is an integer greater than or equal to 2; for example , as shown in Figure 11, the first center point is point A, the second center point is point D, and the N center points can include point A, point B, point C and point D; for detailed description, please refer to the relevant description of Figure 11 , which will not be described again here.

For example, N center points include the first center point, the second center point and N-2 center points; among them, N-2 center points are located on the line connecting the first center point and the second center point, N-2 Each of the center points may correspond to one zoom factor; the second center point may correspond to at least one zoom factor; for example, the area of the target area (for example, A1) and the area of the first preview image (for example, A2) are The ratio between them is between (1/9, 1/4), then the second center point can be the center point of 2x zoom magnification, or the second center point can be

The center point of the zoom magnification.

Optionally, the line connecting the first center point and the target center point can be equally divided to obtain N center points; or, the line connecting the first center point and the target center point can be divided according to an interpolation algorithm. , N center points are obtained; for detailed description, please refer to the relevant description in Figure 11, and will not be repeated here.

Optionally, in response to the first operation, displaying a second preview image includes:

If the ratio between the area of the target area and the area of the first preview image is less than or equal to the first preset threshold, use the first pixel merging method to display the second preview image;

If the ratio between the area of the target area and the area of the first preview image is greater than the first preset threshold, the second preview image is displayed using the second pixel combining method. The first pixel merging method may refer to using the Remosaic method to read out the image, as shown in Figure 4; the second pixel merging method may refer to using the Binning method to read the image, as shown in Figures 1 to 3.

For example, if the ratio between the area of the target area and the area of the first preview image is less than or equal to the first preset threshold, the electronic device uses the cropping area corresponding to the second magnification to crop the first preview image, Obtain the first image area, which includes M pixels; rearrange the M pixels to obtain K pixels, M and K are both positive integers, and K is greater than M; display the second preview based on the K pixels image.

For example, if the ratio between the area of the target area and the area of the first preview image is greater than the first preset threshold, the first preview image is cropped using the cropping area corresponding to the second magnification, Obtain the first image area, which includes M pixels; merge the M pixels to obtain H pixels, M and H are both positive integers, and H is less than M; display the second preview image based on the H pixels .

For example, if the first pixel binning method is to read the image using a 2×2 Remosaic method, the first preset threshold is 1/4.

For example, if the first pixel binning method is to read the image using a 3×3 Remosaic method, the first preset threshold is 1/9.

For example, if the first pixel binning method is to read the image using a 4×4 Remosaic method, the first preset threshold is 1/16.

Optionally, the second magnification is determined based on a ratio between the area of the target area and the area of the first preview image.

For example, if the ratio between the area of the target area (for example, image 602 shown in Figure 11) and the area of the first preview image (for example, image 601 shown in Figure 11) is less than or equal to 1/4, then the The second magnification is 2x magnification, that is, 2x zoom magnification.

For example, if the ratio between the area of the target area (for example, image 602 shown in Figure 11) and the area of the first preview image (for example, image 601 shown in Figure 11) is less than or equal to 1/9, then the 2x is 3x magnification, that is, 3x zoom magnification.

For example, if the ratio between the area of the target area (for example, image 602 shown in Figure 11) and the area of the first preview image (for example, image 601 shown in Figure 11) is less than or equal to 1/16, then the 2x is 4x magnification, that is, 4x zoom magnification.

The image processing method provided by the embodiment of the present application can realize zoom based on the target area during the zoom shooting process; specifically, during the entire zoom shooting process, the zoom center of the electronic device does not always need to be the center of the sensor, but will be The zoom center smoothly transitions from the center of the sensor to the center of the target area in the shooting scene; allowing users to achieve tracking zoom on the target area in the shooting scene without moving electronic devices, improving the user's shooting experience.

Figure 16 is a schematic diagram of an image processing method provided by an embodiment of the present application. The method 800 shown in Figure 16 includes steps S801 to S808, and these steps will be described in detail below.

Step S801: The electronic device runs the camera application.

For example, to run the camera application of the electronic device, please refer to the relevant description of (a) in FIG. 8 , which will not be described again here.

Step S802: The electronic device displays the first preview image and determines the first zoom center.

It should be understood that the first zoom center may refer to the first center point shown in FIG. 14 .

For example, the first preview image may be a preview image as shown in (b) of Figure 8; or, the first preview image may be a preview image as shown in (b) of Figure 9; or, the first preview image may be as Image 601 shown in Figure 11.

For example, as shown in FIG. 11 , the first center point may refer to point A in the image 601 ; or, as shown in (b) of FIG. 10 , the first center point may refer to point 1 .

Step S803: Determine the target zoom center and target area according to the first preview image.

It should be understood that the target zoom center may refer to the second center point shown in FIG. 14 .

For example, as shown in FIG. 11 , the second center point may refer to point D in the target area 602 ; or, as shown in (b) of FIG. 10 , the second center point may be pointing point 4 .

Optionally, a first operation of the user on the first preview image is detected, and the target zoom center point and the target area are determined according to the first operation.

For example, the first operation may refer to an operation for clicking the first preview image, and the target zoom center point may refer to the user's touch point in the first preview image; as shown in Figure 11, the target zoom center may be Refers to point D in image 601.

Exemplarily, as shown in Figure 12, the user's click operation on the electronic device is detected, and the target center point is the touch point between the user and the first preview image (for example, point D); based on the target center point and the preset image area The size (eg, image area 610) determines the target area. It should be understood that the specific description can be seen in Figure 12 and will not be described again here.

Exemplarily, as shown in FIG. 13, a target shooting object (eg, image area 620) in the first preview image is detected, the target area includes the image area where the target shooting object is located, and the target shooting object is based on the first preview. The priority of the subjects in the image is determined. It should be understood that the specific description can be seen in Figure 13 and will not be described again here.

Optionally, the target zoom center may refer to the center point of the target area in the shooting scene; the target area may refer to the image area that the user is interested in, or the target area may refer to the image area that needs to be tracked for zooming; Determine the target zoom center For the specific method of the point, please refer to the relevant descriptions of the first to fifth implementation methods of determining the center point of the target area in image 11, which will not be described again here.

Optionally, the zoom magnification corresponding to the target zoom center point may be determined based on the area size of the target area. See the relevant description in Figure 11, which will not be described again here.

Step S804: Obtain N zoom center points according to the first zoom center and the target zoom center.

For example, the connection between the first zoom center and the target zoom center can be equally divided to obtain N zoom centers; or, the connection between the first zoom center and the target zoom center can also be performed through an interpolation algorithm. Divide and obtain N zoom centers. See the relevant description in Figure 11, which will not be described again here.

Optionally, N is related to the zoom ruler scale in the camera; for example, the first zoom center point corresponds to 1x zoom magnification, and the target zoom center point corresponds to 2x zoom magnification; the scale scale from 1x zoom to 2x zoom in the camera is 5 parts, that is, the process from 1x zoom to 2x zoom is 1×～1.2×～1.4×～1.6×～2×, then N can be equal to 5.

Step S805: Determine whether the current zoom ratio meets the preset condition; if the current zoom ratio meets the preset condition, execute step S806; if the current zoom ratio does not satisfy the preset condition, execute step S807.

For example, if the first pixel binning method refers to the 4×4 Remosaic method for reading the image, the preset condition refers to that the current zoom ratio is greater than or equal to 2x zoom ratio; if the current zoom ratio is greater than or equal to 2x zoom magnification, then the current zoom magnification satisfies the preset condition, and step S806 is executed; if the current zoom magnification is less than 2 times the zoom magnification, then the current zoom magnification satisfies the preset condition, and step S807 is executed.

Step S806: Sampling the first pixel combining method to generate a second preview image.

For example, the first pixel combining method may refer to using the Remosaic method to read out the image.

Step S807: Sampling the second pixel combining method to generate a second preview image.

For example, the second pixel binning method may refer to using the Binning method to read out the image.

Among them, the use of the Remosaic method to read out the image and the use of the Binning method to read the image have been described above and will not be repeated here.

Step S808: Display a second preview image, and the zoom factor corresponding to the second preview image is the current zoom factor.

Optionally, if the first pixel combining method refers to the 3×3 Remosaic method to read the image, at this time, if the area size of the target area is less than or equal to 1/9 of the area size of the first preview image, then the target zoom center The corresponding zoom magnification is 3 times the zoom magnification; if the area size of the target area is greater than 1/9 of the area size of the first preview image, the zoom magnification corresponding to the target zoom midpoint is

Among them, A1 represents the area size of the target area; A2 represents the size of the first preview image, and the preset condition refers to that the current zoom magnification is greater than or equal to 3 times the zoom magnification.

Optionally, if the first pixel merging method refers to the 4×4 Remosaic method to read out the image, at this time, if the area size of the target area is less than or equal to 1/16 of the area size of the first preview image, then the target zoom center The corresponding zoom magnification is 4x zoom magnification; if the area size of the target area is greater than 1/16 of the area size of the first preview image, the zoom magnification corresponding to the target zoom midpoint is

Among them, A1 represents the area size of the target area; A2 represents the size of the first preview image, and the preset condition refers to that the current zoom magnification is greater than or equal to 4 times the zoom magnification.

The image processing method provided by the embodiment of the present application can realize zoom based on the target area during the zoom shooting process; for example, during the entire zoom shooting process, there is no need to collect the zoom center to always be the center of the sensor, but to change the zoom center from the sensor The center of the camera smoothly transitions to the center of the target area in the shooting scene; allowing users to achieve tracking zoom on the target area in the shooting scene without moving electronic devices, improving the user's shooting experience. In addition, when the zoom magnification is large, the first pixel combining method can be used to read out the image, thereby avoiding a large loss of clarity of the zoomed image and improving the clarity of the zoomed image.

It should be understood that the above examples are to help those skilled in the art understand the embodiments of the present application, but are not intended to limit the embodiments of the present application to the specific numerical values or specific scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples, and such modifications or changes also fall within the scope of the embodiments of the present application.

The image processing method provided by the embodiment of the present application is described in detail above with reference to Figures 1 to 16; below, the device embodiment of the present application will be described in detail with reference to Figures 17 and 18. It should be understood that the devices in the embodiments of the present application can perform various methods of the foregoing embodiments of the present application, that is, for the specific working processes of the following various products, reference can be made to the corresponding processes in the foregoing method embodiments.

Figure 17 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. The electronic device 900 includes a processing module 910 and a display module 920 .

Among them, the processing module 910 is used to start the camera application in the electronic device; the display module 920 is used to display the first preview image, the zoom magnification corresponding to the first preview image is the first magnification, and the center point of the first preview image is the first Center point; the processing module 910 is also used to determine a second center point in the first preview image, the second center point is the center point of the target area, and the first center point and the second center point do not coincide; the first operation is detected, The first operation indicates that the zoom magnification of the electronic device is the second magnification; the display module 920 is further configured to display a second preview image in response to the first operation, and the center point of the second preview image is the second center point.

Optionally, as an embodiment, the second preview image coincides with the target area.

Optionally, as an embodiment, the second preview image includes the target area.

Optionally, as an embodiment, the second preview image includes a part of the target area.

Optionally, as an embodiment, when the first preview image and the second preview image are displayed, the position of the electronic device is the same.

Optionally, as an embodiment, the processing module 910 is also used to:

A second operation is detected, the second operation indicating that the zoom magnification of the electronic device is a third magnification;

Optionally, as an embodiment, the connection between the first center point and the second center point includes N center points, and each of the N center points corresponds to at least one zoom magnification. , N is an integer greater than or equal to 2.

Optionally, as an embodiment, the processing module 910 is also used to:

Optionally, as an embodiment, the processing module 910 is specifically used to:

The second preview image is displayed based on the K pixels.

A second preview image is displayed based on the H pixels.

Optionally, as an embodiment, the second magnification is determined based on the ratio between the area of the target area and the area of the first preview image.

Optionally, as an embodiment, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/4, the second magnification is 2 times the magnification.

Optionally, as an embodiment, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/9, the second magnification is 3 times the magnification.

Optionally, as an embodiment, if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/16, the second magnification is 4 times the magnification.

It should be noted that the above-mentioned electronic device 900 is embodied in the form of a functional module. The term "module" here can be implemented in the form of software and/or hardware, and is not specifically limited.

For example, a "module" may be a software program, a hardware circuit, or a combination of both that implements the above functions. The hardware circuit may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor) for executing one or more software or firmware programs. etc.) and memory, merged logic circuitry, and/or other suitable components to support the described functionality.

Therefore, the units of each example described in the embodiments of the present application can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Figure 18 shows a schematic structural diagram of an electronic device provided by this application. The dotted line in Figure 18 indicates that this unit or module is optional; the electronic device 1100 can be used to implement the method described in the above method embodiment.

The electronic device 1100 includes one or more processors 1101, and the one or more processors 1101 can support the electronic device 1100 to implement the image processing method in the method embodiment. Processor 1101 may be a general-purpose processor or a special-purpose processor. For example, the processor 1101 may be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), or a field programmable gate array (field programmable). gate array, FPGA) or other programmable logic devices, such as discrete gates, transistor logic devices, or discrete hardware components.

The processor 1101 can be used to control the electronic device 1100, execute software programs, and process data of the software programs. The electronic device 1100 may also include a communication unit 1105 to implement input (reception) and output (transmission) of signals.

For example, the electronic device 1100 may be a chip, and the communication unit 1105 may be an input and/or output circuit of the chip, or the communication unit 1105 may be a communication interface of the chip, and the chip may be used as a component of a terminal device or other electronic device. .

For another example, the electronic device 1100 may be a terminal device, and the communication unit 1105 may be a transceiver of the terminal device, or the communication unit 1105 may be a transceiver circuit of the terminal device.

The electronic device 1100 may include one or more memories 1102 on which a program 1104 is stored. The program 1104 may be run by the processor 1101 to generate instructions 1103, so that the processor 1101 performs the image processing described in the above method embodiment according to the instructions 1103. method.

Optionally, data may also be stored in the memory 11002.

Optionally, the processor 1101 can also read the data stored in the memory 1102. The data can be stored at the same storage address as the program 1104, or the data can be stored at a different storage address as the program 1104.

The processor 1101 and the memory 1102 can be provided separately or integrated together, for example, integrated on a system on chip (SOC) of the terminal device.

For example, the memory 1102 can be used to store the related programs 1104 of the image processing method provided in the embodiment of the present application, and the processor 1101 can be used to call the related programs 1104 of the image processing method stored in the memory 1102 when performing image processing. Execute the image processing method of the embodiment of the present application; for example, start the camera application in the electronic device; display the first preview image, the zoom magnification corresponding to the first preview image is the first magnification, and the center point of the first preview image is the first Center point; determine the second center point in the first preview image, the second center point is the center point of the target area, the first center point and the second center point do not coincide; the first operation is detected, and the first operation indicates the electronic device The zoom magnification is the second magnification; in response to the first operation, a second preview image is displayed, and the center point of the second preview image is the second center point.

This application also provides a computer program product, which when executed by the processor 1101 implements the image processing method of any method embodiment in this application.

The computer program product may be stored in the memory 1102, such as a program 1104. The program 1104 is finally converted into an executable object file that can be executed by the processor 1101 through processes such as preprocessing, compilation, assembly and linking.

This application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a computer, the image processing method described in any method embodiment of this application is implemented. The computer program may be a high-level language program or an executable object program.

The computer-readable storage medium is, for example, memory 1102. Memory 1102 may be volatile memory or nonvolatile memory, or memory 1102 may include both volatile memory and nonvolatile memory. Among them, non-volatile memory can be read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically removable memory. Erase electrically programmable read-only memory (EPROM, EEPROM) or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of illustration, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) ) and direct memory bus random access memory (direct rambus RAM, DR RAM).

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the embodiments of the electronic equipment described above are only illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components may be The combination can either be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.

It should be understood that in the various embodiments of the present application, the size of the sequence numbers of each process does not mean the order of execution. The execution order of each process should be determined by its functions and internal logic, and should not be used in the embodiments of the present application. The implementation process constitutes any limitation.

In addition, the term "and/or" in this article is only an association relationship describing related objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A alone exists, and A and B exist simultaneously. , there are three situations of B alone. In addition, the character "/" in this article generally indicates that the related objects are an "or" relationship.

If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of this application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code. .

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application. should be covered by the protection scope of this application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims. In short, the above descriptions are only preferred embodiments of the technical solution of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this application shall be included in the protection scope of this application.

Claims

An image processing method, characterized in that the image processing method is applied to electronic equipment, including:

Launch the camera application in the electronic device;

Display a first preview image, the zoom magnification corresponding to the first preview image is the first magnification, and the center point of the first preview image is the first center point;

Determine a second center point in the first preview image, the second center point is the center point of the target area, and the first center point does not coincide with the second center point;

Detecting a first operation indicating that the zoom magnification of the electronic device is a second magnification;

In response to the first operation, a second preview image is displayed, and the center point of the second preview image is the second center point.
The image processing method of claim 1, wherein the second preview image coincides with the target area.
The image processing method of claim 2, wherein the second preview image includes the target area.
The image processing method of claim 2, wherein the second preview image includes a part of the target area.
The image processing method according to any one of claims 1 to 4, wherein when the first preview image and the second preview image are displayed, the position of the electronic device is the same.
The image processing method according to any one of claims 1 to 5, further comprising:

A second operation is detected, the second operation indicating that the zoom magnification of the electronic device is a third magnification;

In response to the second operation, a third preview image is displayed, the center point of the third preview image is a third center point, and the third center point is between the first center point and the second center point. Online.
The image processing method according to any one of claims 1 to 5, characterized in that the connection between the first center point and the second center point includes N center points, and the N center points Each center point in corresponds to at least one zoom factor, and N is an integer greater than or equal to 2.
The image processing method according to claim 7, further comprising:

The line connecting the first center point and the second center point is equally divided to obtain the N center points.
The image processing method according to claim 7, further comprising:

The line connecting the first center point and the second center point is divided according to an interpolation algorithm to obtain the N center points.
The image processing method according to any one of claims 1 to 9, wherein displaying a second preview image in response to the first operation includes:

If the ratio between the area of the target area and the area of the first preview image is less than or equal to the first preset threshold, display the second preview image using a first pixel merging method;

If the ratio between the area of the target area and the area of the first preview image is greater than the first preset threshold, the second preview image is displayed using a second pixel combining method.
The image processing method according to claim 10, wherein the display of the second preview image using a first pixel merging method includes:

Using the cutting area corresponding to the second magnification to perform cutting processing on the first preview image, a first image area is obtained, and the first image area includes M pixels;

The M pixels are rearranged to obtain K pixels, M and K are both positive integers, and K is greater than M;

The second preview image is displayed based on the K pixels.
The image processing method according to claim 10, wherein the display of the second preview image using a first pixel merging method includes:

Using the cutting area corresponding to the second magnification to perform cutting processing on the first preview image, a first image area is obtained, and the first image area includes M pixels;

The M pixels are merged to obtain H pixels, M and H are both positive integers, and H is less than M;

A second preview image is displayed based on the H pixels.
The image processing method according to any one of claims 1 to 12, wherein determining the second center point in the first preview image includes:

The user's click operation on the first preview image is detected, and the second center point is the touch point between the user and the electronic device.
The image processing method according to any one of claims 1 to 12, wherein determining the second center point in the first preview image includes:

The first subject in the first preview image is detected, and the second center point is the center point of the first subject.
The image processing method according to any one of claims 1 to 14, wherein the second magnification is determined based on a ratio between an area of the target area and an area of the first preview image.
The image processing method according to claim 15, characterized in that if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/4, the second magnification is 2 times magnification.
The image processing method of claim 15, wherein if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/9, the second magnification is 3 times magnification.
The image processing method of claim 15, wherein if the ratio between the area of the target area and the area of the first preview image is less than or equal to 1/16, the second magnification is 4 magnification.
An electronic device, characterized in that the electronic device includes a processor and a memory, the memory is used to store a computer program, the processor is used to call and run the computer program from the memory, so that the electronic device The device executes the image processing method according to any one of claims 1 to 18.
A chip, characterized in that it includes a processor. When the processor executes instructions, the processor executes the image processing method according to any one of claims 1 to 18.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the processor causes the processor to execute the method as claimed in any one of claims 1 to 18. The image processing method described above.