WO2018072308A1

WO2018072308A1 - Image output method and electronic device

Info

Publication number: WO2018072308A1
Application number: PCT/CN2016/111452
Authority: WO
Inventors: 徐荣跃; 王君; 雷磊; 杜成
Original assignee: 华为技术有限公司
Priority date: 2016-10-17
Filing date: 2016-12-22
Publication date: 2018-04-26
Also published as: CN108476286A; CN108476286B

Abstract

An image output method and an electronic device. The method comprises: acquiring sampled data corresponding to a target sampling time point; determining whether a first target amount of shaking is less than or equal to a preset value, the first target amount of shaking being an amount of shaking of a first target image frame; and if the first target amount of shaking is less than or equal to the preset value, outputting the first target image frame. In the method, it is only needed to calculate an amount of shaking of a current first target image frame, without the need to calculate the contrast of all acquired images, and if it is calculated that the amount of shaking of the current first target image frame is less than or equal to a preset value, the current first target image frame is directly output without the need to calculate an amount of shaking of an image that is taken after the current first target image frame, thereby improving image output efficiency while ensuring the sharpness of images output by electronic devices.

Description

Image output method and electronic device

The present application claims priority to Chinese Patent Application No. PCT Application No. No. No. No. No. No. No. No. No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No No

Technical field

The present invention relates to the field of image processing, and in particular, to an image output method and an electronic device.

Background technique

With the improvement of the functions of electronic devices, the requirements for the sharpness of images output by the user after taking pictures of the lenses of the electronic devices are also increasing.

When using electronic devices for taking pictures, the user's handheld electronic devices will inevitably appear to be shaken, such as the natural shaking of the user's body. Natural jitter can be the user's heartbeat, pulse, breathing, etc. When the electronic device takes a picture, the user's jitter will be photographed. The moment causes vibration, and in the case of vibration, it has a great influence on the sharpness of the image captured by the electronic device. In order to avoid the influence of the jitter on the image sharpness, in the prior art, the electronic device can be continuously acquired. The multi-frame image is high-pass filtered to obtain the contrast of all the images in the multi-frame image, and the electronic device can output the image with the highest contrast.

However, with the solution shown in the prior art, the electronic device needs to generate a relatively long delay when performing contrast calculation on the multi-frame image, so that the electronic device cannot output the image quickly, thereby reducing the image output efficiency of the electronic device. .

Summary of the invention

The present invention provides an image output method and an electronic device capable of ensuring an output of a clear image of an electronic device while also improving the efficiency of outputting an image of the electronic device.

A first aspect of the embodiments of the present invention provides an image output method, including:

Step A: Obtain sampling data corresponding to a target sampling time point.

The electronic device shown in this embodiment may be periodically set with a sampling time point.

With the method shown in this embodiment, the electronic device can acquire the time-ordered frame image sequence reported by the sensor, and the frame image sequence includes a plurality of frame images sorted according to the exposure end chronological order. image.

The first target frame image is any frame image in the sequence of frame images.

Specifically, the electronic device shown in this embodiment acquires data reported by the sensor at the sampling time point, and the electronic device can acquire an exposure time, a frame rate FR, and a maximum of each frame image included in the frame image sequence. Frame rate, etc.

Determining a target sampling time point in an exposure time of the first target frame image, the target sampling time point being any one of sampling time points located in an exposure time of the first target frame image.

The sampled data is jitter data of a pixel corresponding to the target sampling time point in the first target frame image.

Step B: Determine whether the first target jitter amount is less than or equal to a preset value, and if yes, perform step C.

The first target shake amount is a shake amount of the first target frame image determined according to the target sampling time point and the sample data.

In this embodiment, the electronic device may be preset with the preset value in the process of performing the method shown in this embodiment, and the size of the preset value is not limited in this embodiment, as long as the When the first target shake amount of the first target frame image output by the electronic device is less than or equal to the preset value, the first target frame image can satisfy a certain definition, thereby enabling the user to obtain clear Image.

The smaller the preset value in this embodiment, the higher the resolution of the outputted first target frame image is when the jitter amount of the first target frame image is less than or equal to the preset value. , the different preset values can be set according to different requirements for image sharpness.

Step C: output the first target frame image.

In the method shown in this embodiment, when it is determined that the jitter amount of the first target frame image is less than or equal to the preset value, the first target frame image may be directly output.

In the method of the embodiment, the electronic device first calculates a first target jitter amount of the first target frame image in the acquired image frame sequence, where the first target jitter amount is smaller than a preset preset. In the case of a value, the first target frame image is directly output, and the electronic device calculates the amount of jitter of the frame image behind the first target frame image in the image frame sequence, thereby The time-consuming calculation of the amount of jitter of the frame image sorted after the first target frame image is saved, the efficiency of image output is improved, and the delay of image output is reduced.

With reference to the first aspect of the embodiments of the present invention, in the first implementation manner of the first aspect of the embodiment, the step B further includes: if the first target jitter amount is greater than the preset value, The method shown further includes the following steps;

Step D1: Determine a second target frame image.

In this embodiment, in a case where the first target jitter amount is greater than the preset value, in the image frame sequence, a second target frame image sorted after the first target frame image is determined.

Specifically, the exposure end time of the second target frame image is later than the exposure end time of the first target frame image, and there are N intervals between the first target frame image and the second target frame image. a target frame image, the N being a natural number greater than or equal to 0;

More specifically, when N is equal to 0, the second target frame image is a next target frame image of the first target frame image, and if N is a positive integer greater than 1, the second target frame image is There are N target frame images spaced between the first target frame images.

Step D2: Determine whether the second target jitter amount is less than or equal to the preset value.

The second target jitter amount is a jitter amount of the second target frame image.

For the specific process of obtaining the second target jitter amount, refer to the specific process of obtaining the first target jitter amount, which is not specifically described in this embodiment.

In the step, if it is determined that the second target jitter amount is less than or equal to the preset value, step D3 is performed.

Step D3: Output the second target frame image.

In this embodiment, if the second target jitter amount is less than or equal to the preset value, the second target frame image is directly output.

In the method of the embodiment, the electronic device first calculates a first target jitter amount of the first target frame image in the acquired image frame sequence, where the first target jitter amount is greater than or equal to a preset value. In the case of a preset value, it indicates that the current resolution of the first target frame image does not satisfy the requirement, and if the first target frame image is output, the definition of the frame image displayed by the electronic device cannot satisfy the user's Determining, the electronic device determines, in the sequence of frame images, that the exposure time is later than the second target frame image of the first target frame image, and the amount of jitter in the second target frame image is less than or In the case of the preset value, the second target frame image whose resolution meets the user's requirement is directly output, and the method shown in this embodiment avoids the frame image located behind the second target frame image. The amount of jitter is calculated, thereby saving the time required for calculating the amount of jitter of the frame image after sorting the image of the second target frame, improving the efficiency of image output and reducing the delay of image output.

With reference to the first implementation manner of the first aspect of the embodiment of the present invention, in the second implementation manner of the first aspect of the embodiment, the step B further includes: if it is determined that the first target jitter amount is greater than a preset value, The method shown in this embodiment further includes the following steps;

D4. Output a third target frame image.

In this embodiment, if the second jitter amount of the second target frame image is greater than the preset value, indicating that the second target frame image clarity is relatively low, the third target frame image is determined.

Specifically, the third target frame image is any frame image in a sequence of frame images, and the frame image sequence includes the first target frame image and the determined at least one second target frame image, and The amount of jitter that the third target frame image has is the minimum value of the amount of jitter that all of the frame images in the sequence of frame images have.

Before the step D4 shown in this embodiment is performed, the determined amount of jitter of the first target frame image and all the second target frame images is greater than the preset value, and then the determined In a target frame image and all of the second target frame images, a target frame image in which the amount of jitter is determined to be the smallest is determined as the third target frame image.

In the method of the embodiment, the electronic device, in the acquired image frame sequence, in a case where the jitter amount of the first target frame image and all the second target frame images are greater than the preset value And selecting the third target frame image with the highest definition in the frame image sequence, thereby outputting the third target frame image, and the method described in this embodiment can ensure the clarity of the output image of the electronic device, thereby enabling the user to The image with the highest sharpness can be obtained.

With reference to the first aspect of the first embodiment of the present invention to the second implementation manner of the first aspect of the embodiment of the present invention, the first aspect of the first embodiment of the present disclosure In the third implementation,

The step A specifically includes:

Step A11: Obtain target sampling data of the target pixel.

The target pixel is any pixel located in a target pixel row, and the target pixel is exposed For the target sampling time point, the target pixel acts on any pixel row included in the first target frame image, and the target sampling data is jitter data of the target pixel at the target sampling time point.

With the method shown in this embodiment, in order to improve the efficiency of the output image and reduce the delay of the output image, when calculating the jitter amount of the target frame image, first, the target pixel that satisfies the condition is determined, according to the determined target pixel. The amount of jitter of the target frame image can be determined, so that it is not necessary to process all the pixels included in the target frame image, thereby effectively improving the efficiency of calculating the jitter amount of the frame image.

With reference to the third implementation manner of the first aspect of the embodiment of the present invention, in a fourth implementation manner of the first aspect of the embodiment of the present invention,

Before the step A, the method shown in the embodiment of the present invention further includes:

Step A01: Obtain a time when any row of pixels included in the image of the first target frame starts to be exposed.

In this embodiment, the same jitter has different effects on different pixel rows. It can be seen that the jitter amount is only valid for a single row of pixels in the frame image. In order to accurately determine the influence of the jitter on the entire frame image, the jitter needs to be determined. The effect on a single pixel row of a frame image.

However, when acquiring the jitter amount of the target frame image, based on the image output efficiency consideration, all the pixel rows included in the target frame image cannot be calculated, and it is necessary to determine that all the pixel rows included in the target frame image can be used for performing. The target pixel row for the amount of jitter calculation.

In the process of determining the target pixel row, the electronic device shown in this embodiment first determines the time at which any row of pixels included in the first target frame image begins to be exposed.

Step A02: Determine the target pixel row.

The time at which the target pixel row starts to be exposed is the target sampling time point.

The more the target pixel row determined by the method shown in this embodiment, the more accurate the image jitter is obtained by calculating the image frame. In this embodiment, the target pixel row threshold may be preset, and then When the target pixel row is described, the target pixel row whose number is the target pixel row threshold may be acquired.

Taking the pixel of the target sampling time point as the target pixel row, the accuracy of the jitter calculation of the target frame image can be improved, so that the electronic device calculates the jitter amount according to the target pixel row. , can obtain the amount of jitter of the accurate target frame image.

With reference to the third implementation manner of the first aspect of the embodiment of the present invention or the fourth implementation manner of the first aspect of the embodiment of the present invention, in a fifth implementation manner of the first aspect of the embodiment of the present invention,

Before the step B, the method further includes:

Step B01: Calculate the sub-target jitter amount of the target pixel row.

The sub-target jitter amount is the influence of the jitter on the target pixel row, and the target pixel shown in this embodiment acts on any row of pixels included in the first target frame image.

If a plurality of target pixels are determined in the target pixel row, when the sub-target jitter amount is specifically calculated, the target number of target pixels may be selected to calculate the sub-target jitter amount. The specific value of the selected target number is not limited in this embodiment.

Step B02, determining the number of the target pixel rows;

Step B03, if the number of the target pixel rows is 1, the first target jitter amount is equal to the sub-target jitter amount;

Step B04: If the number of the target pixel rows is a natural number greater than 1, the all-sub-target jitter amount is calculated by an averaging algorithm to obtain the first target jitter amount.

In this embodiment, the averaging algorithm is not limited, as long as the sub-target jitter amount can be calculated to obtain an average value. For example, the averaging algorithm may be a moving average algorithm MA, an exponential smoothing average EMA, and a parameter average. SMA and weighted average DMA, etc.

With the method shown in this embodiment, when calculating the jitter of the target frame image, the sub-target jitter amount of the target pixel row included in the target frame image may be first determined, and after determining the sub-target jitter amount, Determining the amount of jitter of the target frame image, it can be seen that, by using the method shown in this embodiment, the calculation of the jitter amount of the target frame image is divided into each target based on the same jitter affecting different pixel rows. The pixel row improves the accuracy of the jitter calculation for the target frame image.

With reference to the fifth implementation manner of the first aspect of the embodiment of the present invention, in a sixth implementation manner of the first aspect of the embodiment of the present invention,

The step B01 includes:

Step B011: Calculate target coordinates of any target pixel located in the target pixel row.

In this embodiment, the target coordinates are calculated according to the target sampling time point and the target sampling data.

Step B012: If the number of the target pixels located in the target pixel row is one, the sub-target shake amount is a distance between the target coordinate and the origin coordinate.

Specifically, in the target pixel row, the number of the target pixels is one, and the target coordinates of P1 can be expressed in a two-dimensional coordinate system.

Then the target distance is the distance between the origin coordinates (0, 0) and P1 in the two-dimensional coordinate system.

Step B013: If the number of the target pixels located in the target pixel row is at least two, set the target set.

The target set includes a plurality of target distances, the target distance is a distance between any two of the target coordinates of the target coordinates, and the target distance is also any of the target coordinates and the origin The distance between the coordinates.

Specifically, in the target pixel row, taking the number of the target pixels as three as an example, the target coordinates of P1, the target coordinates of P2, and the target coordinates of P3 may be expressed in a two-dimensional coordinate system.

The target distance is a distance between P1 and P2, a distance between P2 and P3, a distance between P1 and P3, a distance between the origin coordinates (0, 0) and P1, and an origin in a two-dimensional coordinate system. The distance between the coordinates (0,0) and P2, the distance between the origin coordinates (0,0) and P3.

The electronic device sets the acquired target distance in the target set.

B014. Acquire the sub-target jitter amount.

Specifically, the sub-target jitter amount is a maximum value among all the target distances located in the target set.

In this embodiment, by obtaining the target coordinates of the target pixel in a two-dimensional coordinate system, acquiring the target distance in the two-dimensional coordinate system, thereby realizing the fast calculation of the sub-target jitter amount, and improving the The efficiency of image output, and the delay in image output is reduced.

With reference to the sixth implementation manner of the first aspect of the embodiment of the present invention, in a seventh implementation manner of the first aspect of the embodiment of the present invention,

The step B011 specifically includes:

Step B0111: Acquire first jitter data that is located on the X-axis of any target pixel in the target pixel row at the target sampling time point;

Specifically, the electronic device in this embodiment acquires target sampling data by using a target sampling time point corresponding to the target pixel, and acquires target coordinates of the target pixel according to the target sampling data.

In this embodiment, the jitter of the electronic device is divided into a three-dimensional coordinate system, which is divided into an X-axis, a Y-axis, and a Z-axis, wherein the X-axis is a direction in which the electronic device translates in the up-and-down direction, and the Y-axis and The X axis is vertical, and the Y axis is a direction in which the electronic device translates in the inner and outer directions, the Z axis is perpendicular to the X axis and the Y axis, and the Z axis is a direction in which the electronic device translates in the left and right directions.

The jitter of the target pixel shown in this embodiment includes first point spread function data of the target pixel moving along the X axis at the target sampling time point, second point spread function data translated along the Y axis, and third translation along the Z axis. Point spread function data, fourth point spread function data rotated about the X axis, fifth point spread function data rotated about the Y axis, and sixth point spread function data rotated about the Z axis.

In this embodiment, the target coordinates of the target pixel may be determined by the first point spread function data and the second point spread function data in the point spread function data.

In this embodiment, when the lens of the electronic device is translated in the direction of the X-axis, the first point spread function data PSF1=(a/b)d1.

Where a is the distance between the lens and the sensor of the electronic device, b is the distance between the object and the lens, that is, b is the object distance; d1 is the lens shift amount, and the lens shift amount d1 is the lens shift The distance between the rear position and the position before the movement in the X-axis direction.

Step B0112, performing an integration operation on the first jitter data to obtain first coordinate data;

The sensor shown in this embodiment can acquire the first jitter data x(t)=PSF1, limt<t<limx at the target sampling point.

Wherein, the target pixel is taken as the A-th target pixel in the target pixel row, and the A-th target pixel is any target pixel included in the target pixel row, and the lime is the target The time interval between the time when the pixel row starts to be exposed and the exposure time of the A target pixel. If the A target pixel is not the last pixel in the target pixel row, then limx is A*s, if A target pixel is the last pixel in the target pixel row, and limx is the exposure end time ex-time of the target pixel row.

After acquiring the sampled data, the electronic device may perform an integral operation to acquire the first coordinate data.

Specifically, the first coordinate data

Step B0113, acquiring second jitter data that is located in the target pixel row and that is translated along the Y axis at the target sampling time point;

In this embodiment, when the lens of the electronic device is translated in the direction of the Y-axis, the second point spread function data PSF2=(a/b)d1.

Where a is the distance between the lens and the sensor of the electronic device, b is the distance between the object and the lens, that is, b is the object distance; d1 is the lens shift amount, and the lens shift amount d1 is the lens shift The distance between the rear position and the position before the movement in the Y-axis direction.

Step B0114, performing an integration operation on the second jitter data to obtain second coordinate data;

Step B0115: target coordinates of any target pixel in the target pixel row include a target abscissa and a target ordinate, determining that the target abscissa is the first coordinate data, and the target ordinate is the second coordinate data.

In this embodiment, after acquiring the sampled data, the electronic device may perform an integration operation to acquire second coordinate data.

Specifically, the second coordinate data

With the image output method shown in this embodiment, the electronic device does not need to perform contrast calculation on all acquired frame images in the frame image sequence, and only needs to be in the sequence of frame images in the order of exposure end time. The frame image sequentially performs the calculation of the jitter amount. If the jitter amount of the current frame image is calculated to be less than or equal to the preset value, the current frame image is directly output without calculating the frame image sorted after the current frame image, thereby The time taken for calculating the frame image is saved, and the efficiency of outputting the image is improved while ensuring the sharpness of the output image of the electronic device.

A second aspect of the embodiments of the present invention provides an electronic device, including:

a first acquiring unit, configured to acquire sampling data corresponding to a target sampling time point, where the target sampling time point is any sampling time point located in at least one sampling time point of an exposure time of the first target frame image, The sampled data is jitter data of a pixel corresponding to the target sampling time point in the first target frame image;

The first obtaining unit shown in this embodiment is used to perform the step A shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

a first determining unit, configured to determine whether the first target jitter amount is less than or equal to a preset value, where the first target jitter amount is a first target frame image determined according to the target sampling time point and the sampling data Amount of jitter;

The first determining unit shown in this embodiment is used to perform the step B shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

And a first output unit, configured to output the first target frame image if the first target jitter amount is less than or equal to the preset value.

The first output unit shown in this embodiment is used to perform the step C shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

According to the electronic device of the embodiment, the electronic device first calculates a first target jitter amount of the first target frame image in the acquired image frame sequence, where the first target jitter amount is smaller than a preset pre-set In the case of setting a value, the first target frame image is directly output, and the electronic device calculates the amount of jitter of the frame image behind the first target frame image in the image frame sequence, thereby saving The time taken to calculate the amount of jitter of the frame image after the first target frame image is sorted, the efficiency of image output is improved, and the delay of image output is reduced.

With reference to the second aspect of the embodiments of the present invention, in a first implementation manner of the second aspect of the embodiment of the present invention,

The electronic device further includes:

a first determining unit, configured to determine a second target frame image if the first target shake amount is greater than the preset value, and an exposure end time of the second target frame image is later than the first target frame image Exposure end time, and there are N target frame images between the first target frame image and the second target frame image, the N being a natural number greater than or equal to 0;

The first determining unit shown in this embodiment is used to perform the step D1 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

a second determining unit, configured to determine whether the second target jitter amount is less than or equal to the preset value, where the second target jitter amount is a jitter amount of the second target frame image;

The second determining unit shown in this embodiment is used to perform the step D2 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

And a second output unit, configured to output the second target image frame if the second target jitter amount is less than or equal to the preset value.

The second output unit shown in this embodiment is used to perform the step D3 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

According to the electronic device of the embodiment, in the acquired image frame sequence, first, the first target jitter amount of the first target frame image is calculated, and the first target jitter amount is greater than or equal to a preset preset value. In the case, the current resolution of the image of the first target frame does not meet the requirement. If the image of the first target frame is output, the resolution of the frame image displayed by the electronic device cannot meet the user's needs. The electronic device determines, in the sequence of frame images, a second target frame image whose exposure time is later than the first target frame image, where the jitter amount of the second target frame image is less than or equal to the preset value In this case, the second target frame image whose resolution meets the user's requirement is directly output, and the method shown in this embodiment avoids the calculation of the jitter amount of the frame image located behind the second target frame image, thereby saving The time taken to calculate the amount of jitter of the frame image after sorting the image of the second target frame improves the efficiency of image output and reduces the delay of image output.

With reference to the first implementation manner of the second aspect of the embodiment of the present invention, in a second implementation manner of the second aspect of the embodiment of the present invention,

The second output unit is further configured to: if the second target jitter amount is greater than the preset value, output a third target frame image, where the third target frame image is any frame image in the frame image sequence The frame image sequence includes the first target frame image and the second target frame image, and the third target frame image has a jitter amount that is possessed by all frame images in the frame image sequence. The minimum amount of jitter.

The second output unit shown in this embodiment is used to perform the step D4 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

According to the electronic device of the embodiment, in the acquired image frame sequence, in a case where the jitter amount of the first target frame image and all the second target frame images are greater than the preset value, The frame image sequence selects the third target frame image with the highest definition, thereby outputting the third target frame image, and the method described in this embodiment can ensure the clarity of the output image of the electronic device, thereby enabling the user to obtain The highest resolution image.

With reference to the second aspect of the second aspect of the present invention, to the electronic device of the second aspect of the second aspect of the present invention,

The first acquiring unit is further configured to acquire target sampling data of a target pixel, where the target pixel is any pixel located in a target pixel row, and an exposure time of the target pixel is the target sampling time point, The target pixel acts on any pixel row included in the first target frame image, the mesh The target sample data is jitter data of the target pixel at the target sampling time point.

The first obtaining unit shown in this embodiment is used to perform the step A11 shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

According to the electronic device shown in this embodiment, in order to improve the efficiency of the output image and reduce the delay of the output image, when calculating the jitter amount of the target frame image, first, the target pixel that satisfies the condition is determined, according to the determined target. The pixel can determine the amount of jitter of the target frame image, so that it is not necessary to process all the pixels included in the target frame image, thereby effectively improving the efficiency of calculating the jitter amount of the frame image.

With reference to the third implementation manner of the second aspect of the embodiment of the present invention, in a fourth implementation manner of the second aspect of the embodiment of the present invention,

The electronic device further includes:

a second acquiring unit, configured to acquire a time when any row of pixels included in the first target frame image starts to be exposed;

The second obtaining unit shown in this embodiment is used to perform the step A01 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

a second determining unit, configured to determine the target pixel row, wherein a time when the target pixel row starts to be exposed is the target sampling time point.

The second determining unit shown in this embodiment is used to perform the step A02 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

With reference to the third implementation manner of the second aspect of the embodiment of the present invention or the fourth implementation manner of the second aspect of the embodiment of the present invention, in a fifth implementation manner of the second aspect of the embodiment of the present invention,

The electronic device further includes:

a first calculating unit, configured to calculate a sub-target jitter amount of the target pixel row according to the target sampling time point and the target sampling data;

The first calculation unit shown in this embodiment is used to perform the step B01 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

a third determining unit, configured to determine a number of the target pixel rows;

The third determining unit shown in this embodiment is used to perform the step B02 shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

a second calculating unit, configured to: if the number of the target pixel rows is 1, the first target jitter amount is equal to the sub-target jitter amount; if the target pixel row number is a natural number greater than 1, All of the sub-target shake amounts are calculated by an averaging algorithm to obtain the first target shake amount.

The second calculation unit shown in this embodiment is used to perform the step B03 and the step B04 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

With the electronic device shown in this embodiment, when calculating the jitter of the target frame image, the sub-target shake amount of the target pixel row included in the target frame image may be first determined, and after determining the sub-target shake amount, The amount of jitter of the target frame image can be determined. It can be seen that, by using the method shown in this embodiment, the calculation of the jitter amount of the target frame image is divided into various cases based on the same jitter affecting different pixel rows. The target pixel row improves the accuracy of the jitter calculation for the target frame image.

With reference to the fifth implementation manner of the second aspect of the embodiment of the present invention, in a sixth implementation manner of the second aspect of the embodiment of the present invention,

The second computing unit includes:

a calculation module, configured to calculate target coordinates of any target pixel located in the target pixel row according to the target sampling time point and the target sampling data;

The calculation module shown in this embodiment is used to perform the step B011 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

a first determining module, configured to: if the number of the target pixels located in the target pixel row is one, the sub-target jitter amount is a distance between the target coordinate and the origin coordinate;

The first determining module shown in this embodiment is used to perform the step B012 shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

a second determining module, configured to set a target set if the number of the target pixels located in the target pixel row is at least two, the target set includes a plurality of target distances, and the target distance is all the targets a distance between any two of the target coordinates in the coordinate, and the target distance is also a distance between any of the target coordinates and the origin coordinate;

The second determining module shown in this embodiment is used to perform the step B013 shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

a third determining module, configured to acquire the sub-target jitter amount, where the sub-target jitter amount is located at the location The maximum of all of the target distances within the set of targets.

The third determining module shown in this embodiment is used to perform the step B014 shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

With reference to the sixth implementation manner of the second aspect of the embodiment of the present invention, in the seventh implementation manner of the second aspect of the embodiment, the computing module includes:

a first acquiring sub-module, configured to acquire first jitter data that is located on the X-axis of any target pixel in the target pixel row at the target sampling time point;

The first obtaining sub-module shown in this embodiment is used to perform the step B0111 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

a first calculation submodule, configured to perform an integration operation on the first jitter data to obtain first coordinate data;

The first calculation sub-module shown in this embodiment is used to perform the step B0112 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

a second acquiring sub-module, configured to acquire second jitter data that is located on the Y-axis of any target pixel in the target pixel row at the target sampling time point;

The second obtaining sub-module shown in this embodiment is used to perform the step B0113 shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

a second calculation submodule, configured to perform an integration operation on the second jitter data to obtain second coordinate data;

The second calculation sub-module shown in this embodiment is used to perform the step B0114 shown in the first aspect of the embodiment of the present invention. For details, refer to the above description, and details are not described herein.

Determining a sub-module, wherein target coordinates for any target pixel located in the target pixel row include a target abscissa and a target ordinate, determining that the target abscissa is the first coordinate data, and the target ordinate is the Second coordinate data.

The determining sub-module shown in this embodiment is used to perform the step B0115 shown in the first aspect of the embodiment of the present invention. For details, refer to the foregoing description, and details are not described herein.

A third aspect of the embodiments of the present invention provides an electronic device, including:

One or more microcomputers, image memories, bus systems, and one or more programs, the microcomputers and the image memory being connected by the bus system;

Wherein the one or more programs are stored in the image memory, the one or more programs comprising instructions that, when executed by the electronic device, cause the electronic device to perform an embodiment of the present invention The method according to any one of the seventh aspect of the first aspect of the present invention.

A fourth aspect of embodiments of the present invention provides a computer readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device, cause the electronic device to perform, for example The method according to any one of the first aspect of the embodiments of the present invention to the seventh implementation manner of the first aspect of the present invention.

The embodiment provides an image output method and an electronic device. The method shown in this embodiment does not need to calculate the contrast of all the acquired frame images, and only needs to perform the jitter amount of the current first target frame image. Calculating, if the jitter amount of the current first target frame image is calculated to be less than or equal to the preset value, directly outputting the current first target frame image without sorting the exposure end time in the current first The amount of jitter of the frame image behind the target frame image is calculated, thereby saving the time taken for calculating the frame image, and improving the efficiency of the output image while ensuring the sharpness of the output image of the electronic device.

DRAWINGS

1 is a schematic structural view of an embodiment of an electronic device according to the present invention;

2 is a schematic diagram of an embodiment of an original image taken by an electronic device according to the present invention;

3 is a schematic diagram showing relationship between an angular velocity of an electronic device and an exposure time in a test environment according to the present invention;

4 is a schematic diagram showing the relationship between the angular velocity of the electronic device and the exposure time in another test environment provided by the present invention;

FIG. 5 is a schematic diagram of an embodiment of an output image provided by the present invention; FIG.

6 is a schematic diagram of another embodiment of an output image provided by the present invention;

FIG. 7 is a schematic diagram showing the steps of an embodiment of an image output method according to the present invention; FIG.

FIG. 8 is a timing diagram of an embodiment of an image output provided by the present invention; FIG.

9 is a schematic diagram of an embodiment of a frame image and an exposure function provided by the present invention;

10 is a schematic structural view of an embodiment before and after shaking provided by the present invention;

11 is a schematic structural view of another embodiment before and after shaking provided by the present invention;

12 is a schematic diagram of an embodiment of an effect of lens shift jitter and rotational jitter on an image quality of an electronic device according to the present invention;

FIG. 13 is a timing diagram of another embodiment of image output provided by the present invention; FIG.

14 is a schematic diagram of an embodiment of a coordinate system for representing target coordinates provided by the present invention;

15 is a schematic structural diagram of another embodiment of an electronic device according to the present invention;

16 is a schematic diagram showing the steps of another embodiment of an image output method according to the present invention;

FIG. 17 is a timing diagram of another embodiment of image output provided by the present invention.

detailed description

Embodiments of the present invention provide an image output method capable of ensuring that an electronic device can output a clear image while improving the efficiency of outputting an image of the electronic device.

For a better description of the method provided by the embodiments of the present invention, first, the structure of an electronic device capable of implementing the method shown in the embodiment of the present invention will be described with reference to FIG.

In this embodiment, the electronic device is not limited, as long as the electronic device can perform image capturing and image processing, for example, the electronic device can be a smart phone, a computer, a tablet computer, a digital camera, etc. This embodiment is not limited.

1 is a schematic structural view of an embodiment of an electronic device provided by the present invention.

The imaging optical system 101 forms an object image (not shown) on the image sensor 102.

1 shows an imaging optical system 101 composed of a single lens, but the imaging optical system 101 generally includes a plurality of lenses such as a zoom lens and a focus lens, and an aperture or the like to enable control of zooming, focusing, and amount of incident light, and the like. .

The image sensor 102 of the present embodiment is a CMOS image sensor including a plurality of photoelectric conversion elements configured in two dimensions, and the sequential output from the upper portion to the lower portion of the image sensor 102 is accumulated at different timings for each line during each frame. The charge.

As described above, the driving method is called a rolling shutter (English full name: rolling shutter, English abbreviation: RS). The image sensor 102 converts an object image formed using the imaging optical system 101 into an electrical signal serving as an image signal using a rolling shutter method, and supplies the converted electrical signal to the signal processing unit 103.

In recent years, CMOS image sensors used as image sensors used in electronic devices have become rapidly popular. In the case of capturing a moving image using a CMOS image sensor, a readout method of sequentially reading accumulated charges from the upper portion to the lower portion of the CMOS image sensor in a row is widely used. This readout method is called a rolling shutter method, and has a feature that the readout timing between the upper and lower portions of the image sensor is different. Due to this feature, in the case of shaking the electronic device and moving the position of the subject on the imaging surface, distortion (rolling shutter distortion) caused by the difference in charge readout timing of the image sensor is generated in the captured image.

The image output method shown in this embodiment can utilize image processing to correct such rolling shutter distortion. Please refer to the following examples for details.

The signal processing unit 103 generates a video signal conforming to, for example, the NTSC format based on the image signal obtained by the image sensor 102, and supplies the generated video signal to the image image memory 104.

The angular velocity sensor 111 detects the jitter of the electronic device 100 as an angular velocity signal, and supplies the angular velocity signal to the A/D converter 112.

The A/D converter 112 digitizes the angular velocity signal from the angular velocity sensor 111, and supplies the digitized signal as the angular jitter data to the microcomputer 110.

The microcomputer 110 calculates the digitized signal and transmits the calculated correlation data to the metadata generating unit 116.

The metadata generating unit 116 generates metadata based on data supplied from the microcomputer 110, and records the generated metadata in the recording medium 108.

The recording medium 108 may be, for example, a magnetic recording medium such as a hard disk or an information recording medium such as a semiconductor image memory, but is not limited thereto.

The display device 106 includes, for example, a liquid crystal display element (LCD) or the like, and displays an image output from the microcomputer 110.

The following describes the effect of jitter on image sharpness during photographing of an electronic device.

Referring first to FIG. 2, which shows the original sharp image, the original value of the width of the point spread function PSF of the original image shown in this embodiment is infinitesimal.

Wherein, the point spread function PSF is used to measure the resolution of the image, and the smaller the width of the PSF of the image, Then the more clear the image.

The electronic device shown in this embodiment can capture the original image to generate a captured image. To better illustrate the application of jitter to image sharpness, the embodiment places the electronic device on a test bench. The test bench shown in this embodiment refers to a device capable of simulating a jitter process.

The test environment of this embodiment is a scene in which the focus is normal and the exposure is normal.

First, the first test is performed on the electronic device. The first test is combined with FIG. 3 and FIG. 4. In the coordinate system of FIG. 3 and FIG. 4, the abscissa is the exposure time in milliseconds, and the ordinate is the electronic device. The angular velocity obtained by the angular velocity sensor.

In Figures 3 and 4, the electronic devices are placed in the same environment where the jitter is the same, i.e., in the different tests shown in Figures 3 and 4, the angular velocities obtained by the angular velocity sensors are the same.

In the test environment shown in FIG. 3, the exposure start time of the current frame image is start, and the exposure end time is end, and the exposure time of the frame image shown in FIG. 3 is end-start.

In the test environment shown in FIG. 4, the exposure start time of the current frame image is start, and the exposure end time is end, and the exposure time of the frame image shown in FIG. 4 is end-start.

3, relative to FIG. 4, the frame exposure time of FIG. 3 is longer than the frame exposure time shown in FIG. 4. The image output by using the exposure time shown in FIG. 3 is shown in FIG. 5, and the exposure time shown in FIG. The output image is shown in FIG. 6. As shown in FIG. 5 and FIG. 6, the sharpness of the image shown in FIG. 6 is higher than the sharpness of the image shown in FIG. 5, that is, the PSF shown in FIG. The width is smaller than the width of the PSF shown in FIG.

It can be seen that in the same jitter test environment, the longer the exposure time, the larger the width of the PSF of the image, that is, the longer the exposure time, the lower the sharpness of the image.

Similarly, the electronic device can be placed in the same exposure time, but the jitter is different. The specific test process is not described in this embodiment. In the test environment of the same exposure time, the larger the jitter, the PSF of the image. The larger the width, that is, the larger the jitter, the lower the sharpness of the image.

As can be seen from the above, the sharpness of the image depends on the severity of the jitter of the electronic device and the length of the exposure time during the exposure process. At the same time, the different motion forms of electronic devices have no obvious impact on image quality.

The image output method shown in this embodiment is based on the exposure time and jitter of the frame image. The detailed process of the image output method provided by the embodiment is described in detail below with reference to FIG. 7 , wherein FIG. 7 is an embodiment of the image output method provided by the present invention. flow chart.

Step 701: Determine a target sampling time point.

The electronic device shown in this embodiment may be preset with a sampling time point.

Specifically, the sampling time point shown in this embodiment may be periodically set, and the length of the sampling period in this embodiment is not limited. The sampling period shown in this embodiment is between any two adjacent sampling time points. Interval.

For example, in the embodiment, the sampling period is 10 milliseconds, and one sampling time point is set every 10 milliseconds as shown in this embodiment.

With the method shown in this embodiment, the electronic device can acquire a time-ordered frame image sequence reported by the sensor, and the frame image sequence includes a plurality of frame images sorted in order of exposure end time.

The electronic device shown in this embodiment first determines whether the current first target frame image satisfies an output condition.

Optionally, when the method shown in the embodiment of the present invention is performed for the first time, the first target frame image may be a frame image that is ranked in the first place in the frame image sequence by time.

Optionally, the frame image shown in this embodiment may also be a frame image that is randomly selected by the electronic device in the frame image sequence, and the embodiment is that the first target frame image is located in the frame. The specific position in the sequence of images is not limited as long as the first target frame image can be any frame image in the sequence of frame images.

In this embodiment, the first target frame image may be an example of arranging the frame images ranked first in the frame image sequence as an example.

In this embodiment, in order to determine whether to output the first target frame image, it is first necessary to determine an exposure time of the first target frame image.

Specifically, the electronic device shown in this embodiment acquires the data reported by the sensor at the sampling time point.

The sensor reporting data will be described below.

8 is taken as an example, wherein FIG. 8 is an embodiment of image output provided by the present invention. Schematic diagram.

In this embodiment, the electronic device can acquire an exposure time, a frame rate FR, a maximum frame rate, and the like of each frame image included in the frame image sequence.

The frame rate FR shown in this embodiment is the number of frames displayed per second, that is, the frame rate shown in this embodiment is used to indicate the number of times the frame synchronization signal EOF appears every second.

It can be seen that, by the frame rate reported by the sensor, the electronic device can determine an image frame that appears every second and a time point at which the exposure of each image frame ends.

Taking FIG. 8 as an example, FIG. 8 exemplifies an example in which the exposed frame image is the first target frame image and the second target frame image.

It should be noted that the number of the frame images that are specifically exposed is not limited in this embodiment, and the description of the exposure time of the frame image and the time of the frame synchronization signal EOF in this embodiment is an optional example, which is not limited.

Taking FIG. 8 as an example, the abscissa shown in FIG. 8 is time, the unit is millisecond, and the ordinate is the line number of the pixel array of the first target frame image formed on the sensor film.

Specifically, if the size of the negative film formed on the sensor shown in this embodiment is 12M, including 4000*3000 pixels, the ordinate has 4000 lines and each line has 3000 pixels.

The method application shown in this embodiment can be applied to a rolling shutter mechanism of a rolling shutter. Taking a first target frame image formed by the sensor as an example, the function 71 is a frame exposure of each pixel row of the first target frame image. The start time, the function 72 is the frame exposure end time of each pixel row of the first target frame image, and the second target frame image formed by the sensor is taken as an example, and the function 73 is the second target frame image. The frame exposure start time of each pixel row, function 74 is the frame exposure end time of each pixel row of the second target frame image.

It can be seen that, in this embodiment, the exposure start time of each pixel row of the frame image formed on the sensor is sequentially increased, and the exposure end time of each pixel row of the frame image formed on the sensor is also sequentially increased. As shown in FIG. 8, the functions formed by the first target frame image and the second target frame image in the present embodiment in the coordinate system shown in FIG. 8 have a parallelogram structure.

The sensor shown in this embodiment sends a first frame synchronization signal EOF when the first target frame image ends the last pixel exposure in the last pixel row, and the first EOF is used to indicate the frame exposure of the first target frame image. End Time.

The sensor shown in this embodiment sends a second frame synchronization signal EOF when the second target frame image ends the last pixel exposure in the last pixel row, and the second EOF is used to indicate the frame exposure of the second target frame image. End Time.

In this embodiment, in the sequence of frame images formed on the sensor, in the two adjacent frame images at the time, the exposure end time of the frame image located at the previous moment and the frame image at the next moment are Between the frame exposure start time and the exposure interval gap time, in the sequence of frame images formed on the sensor shown in this embodiment, each of the exposure intervals gap time is equal, and the exposure interval gap time= 1000/FR.

In this embodiment, the target sampling time point is determined during an exposure time of the first target frame image, and the target sampling time point is any one of at least one sampling time point located in an exposure time of the first target frame image. Sampling time point.

As shown in FIG. 8, the exposure time of the first target frame image is T1, and the target sampling time point is located in the time period of T1.

As shown in FIG. 8, the sampling time points t1, t2, t3, t4, and t5 shown in this embodiment are located within the exposure time T1 of the first target frame image.

Then, the sampling time points t1, t2, t3, t4, and t5 shown in this embodiment are the target sampling time points.

The sampling interval shown in this embodiment is exemplified by 10 milliseconds, that is, the time interval between t1 and t2 is 10 milliseconds, and so on, and the time interval between t4 and t5 is 10 milliseconds.

Step 702: Determine a target pixel row.

The electronic device shown in this embodiment acquires sampling data at the target sampling time point.

In this embodiment, the electronic device collects sampling data once every other sampling period. Specifically, the sampling data shown in this embodiment is data reported by the sensor at the sampling time point.

It should be clarified that the sampling time point and the sampling interval set in the process of outputting an image are not limited in this embodiment, and this embodiment is merely an explanation of an optional example.

The electronic device shown in this embodiment acquires the data reported by the sensor at the target sampling time points t1, t2, t3, t4, and t5, respectively.

For a better understanding of the embodiments of the present invention, the effect of jitter on a frame image will be described below with reference to the accompanying drawings.

As shown in FIG. 9, FIG. 9 is a schematic diagram of an embodiment of a frame image and an exposure function provided by the present invention. The description of the frame image 801 in the form of a parallelogram is shown in the above embodiment, and is not described in detail in this embodiment.

It should be understood that the jitter stable 802 is a quadrilateral structure in the case where the jitter is stable, as shown in FIG.

For jitter function 802 to exhibit jitter only during time period 803, the jitter only affects pixels in frame image 801 that are exposed during time period 803.

The dithering function 802 shown in this embodiment has different effects on different pixel rows in the frame image. Specifically, taking two pixel behavior examples in the frame image, that is, the pixel rows line1 and line2 as an example, it is necessary to be clear that This embodiment does not limit the specific line numbers of line1 and line2 in the frame image.

The influence of the dithering function 802 on the line1 is the first overlapping area of the dithering function 802 and the line1, and the influence of the dithering function 802 on the line2 is the second overlapping area of the dithering function 802 and the line2, As shown in FIG. 9, the first overlapping area is different from the second overlapping area, and the same dithering function 802 has different effects on different pixel rows of the same frame image.

In a scene with stable jitter, the same jitter can have different effects on different pixel rows in the frame image. In a scene with unstable jitter, the jitter can have different effects on different pixel rows in the frame image.

It can be seen that the amount of jitter is only valid for a single row of pixels in the frame image. In order to accurately determine the influence of the jitter on the entire frame image, it is necessary to determine the influence of the jitter on the single pixel row of the frame image.

The following describes how to obtain the sub-target jitter amount of the target pixel row, where the sub-target jitter amount is the influence of the jitter on the target pixel row, and the target pixel shown in this embodiment acts as the first target frame image. Any row of pixels included.

Optionally, in order to accurately calculate the amount of jitter of the target pixel row, determining a time at which any row of pixels included in the first target frame image starts to be exposed, determining the target pixel row, wherein the target pixel row The time at which the exposure starts is coincident with the target sampling time point.

Continuing with FIG. 8, the present embodiment is described by taking the target pixel behaviors line1 and line2 as an example, and the start exposure time of line1 coincides with the sampling time point t1, and the start exposure time of line2 coincides with the sampling time point t2. .

It should be noted that the description of the target pixel row in this embodiment is an optional example, which is not limited as long as the target pixel acts on the pixel row included in the first frame image.

It should be clarified that the more the target pixel rows are determined by the method shown in this embodiment, the more accurate the jitter is obtained by calculating the image frame, and the target pixel row threshold may be preset in this embodiment. And, when determining the target pixel row, the target pixel row whose number is the target pixel row threshold may be acquired.

In a specific application, different target pixel row thresholds may be set according to different requirements on the accuracy of the output image. The larger the target pixel row threshold is, the higher the resolution of the output image is.

Step 703: Determine a target pixel in the target pixel row.

The target pixel shown in this embodiment is a pixel whose exposure time is the target sampling time point.

In this embodiment, as shown in FIG. 8, the target pixels in line1 are pixels P1, P2, and P3, the exposure time of P1 is t1, the exposure time of P2 is t2, and the exposure time of P3 is t3. The number of target pixels included in the target pixel row is not limited. In this embodiment, three are taken as an example.

It should also be clarified that if a plurality of target pixels are determined in the target pixel row, the target number of target pixels can be selected for the calculation of the sub-target jitter amount when the sub-target jitter amount is specifically calculated. The specific value of the selected target number is not limited in this embodiment.

Step 704: Determine target coordinates of the target pixel.

Specifically, the target pixel P1 shown in FIG. 8 is taken as an example, and the electronic device acquires the sampled data reported by the sensor at the target sampling time point t1. Specifically, the sampled data shown in this embodiment is the jitter data of the target pixel.

The jitter of the target pixel shown in this embodiment includes first point spread function data of the target pixel moving along the X axis at the target sampling time point, second point spread function data translated along the Y axis, and third translation along the Z axis. Point spread function data, fourth point spread function data rotated around the X axis, rotated about the Y axis The fifth point spread function data and the sixth point spread function data rotated about the Z axis.

It is to be noted that the first point spread function data and the second point spread function data are used to determine the target coordinates as an example, which is not limited. In other embodiments, other points may also be adopted. The process of determining the target coordinates of the diffusion function data is not described in detail in this embodiment.

The following describes how the sensor specifically acquires the first point spread function data and the second point spread function data:

In this embodiment, when the lens of the electronic device is translated in the direction of the X-axis, as shown in FIG. 10, when the lens is translated from the position of the first time 901 in the direction of the X-axis to the position of the second time at 902, The point spread function data PSF1 = (a / b) d1.

It should be clarified that, before and after the lens of the electronic device shown in this embodiment is translated along X, the diameter of the lens is coincident in the X direction, and the lenses of the electronic device shown in FIG. In order to better explain the movement of the lens before and after the X translation, FIG. 10 is a schematic view, which is not limited.

Where a is the distance between the lens 903 and the sensor 904 of the electronic device, b is the distance between the object 905 and the lens 903, that is, b is the object distance; d1 is the lens shift amount, and the lens shift amount D1 is the distance in the X-axis direction between the position 902 after the lens is moved and the position 901 before the movement.

Where 1/a+1/b=1/f, the f is the focal length of the lens of the electronic device.

When the lens of the electronic device is translated in the direction of the Y axis, the process of acquiring the second point spread function data PSF2, please refer to the process of acquiring the first point spread function data, which is not described in detail in this embodiment. In the process of acquiring the second point spread function data, the lens shift amount d1 is a distance in the Y-axis direction between the position after the lens shift and the position before the movement.

For a better understanding of the embodiments of the present invention, the acquisition process of the point spread function data PSF is described below in conjunction with the lens rotation jitter of the electronic device shown in the embodiment of the present invention.

In this embodiment, when the lens of the electronic device rotates about the Z axis, as shown in FIG. 11, when the lens is rotated from the position of the first time 1001 in the direction of the Z axis to the position of the second time of 1002, the sixth point The diffusion function data PSF6 = a * tan θ.

Where a is the distance between the lens of the electronic device and the sensor 1004, and b is the object 1005 The distance from the lens, θ is the amount of rotation of the lens. Specifically, θ is the difference between the angle at the start of exposure and the angle at the end of exposure.

The effects of lens shift jitter and rotational jitter on the quality of the image of the electronic device are described below in conjunction with FIG. 12:

In this embodiment, in the scene of the lens rotation and the scene of the translational shake, the distance between the lens and the sensor of the electronic device is set to a=3 mm, the lens offset is d1=3 mm, and θ=1 degrees, and the figure The abscissa shown in Fig. 12 is the object distance, that is, the distance b between the object and the lens, in millimeters, and the ordinate is the width of the PSF.

As can be seen from FIG. 12, the curve 1101 is used to indicate the PSF when the lens of the electronic device is shifted, and the line 1102 is used to indicate the PSF when the electronic device is rotated.

It can be seen that in the case of the translational jitter of the electronic device, the PSF and the object distance are inversely proportional, and in the case of the rotation jitter of the electronic device, the PSF is independent of the object distance.

Based on the above description, in the embodiment, the sensor is capable of acquiring first jitter data of the target pixel that is translated along the X axis at the target sampling time point.

Specifically, the sensor shown in this embodiment can acquire the first jitter data x(t)=PSF1, limt<t<limx at the target sampling point.

Specifically, the sensor shown in this embodiment obtains the corresponding jitter data between the time of the limt and the limx. The specific acquisition process of the jitter data is shown in the foregoing embodiment, and details are not described herein.

More specifically, taking FIG. 8 as an example, for the target pixel row line1, the sensor may acquire the first jitter data x(t) at the target sampling points t1, t2, and t3, respectively.

At the target sampling point t1, for the first target pixel P1 in the target pixel row line1, the first jitter data x(t)=PSF1, 0<t≤S acquired by the sensor.

At the target sampling point t2, for the second target pixel P2 in the target pixel row line1, the pass The first jitter data x(t) obtained by the sensor = PSF1, S < t ≤ 2S.

At the target sampling point t3, for the third target pixel P3 in the target pixel row line1, the first jitter data x(t)=PSF1, 2S<t≤ex-time acquired by the sensor.

More specifically, for the target pixel row line1, the sensor may acquire the second jitter data y(t) at the target sampling points t1, t2, and t3, respectively.

At the target sampling point t1, for the first target pixel P1 in the target pixel row line1, the second jitter data y(t)=PSF2, 0<t≤S acquired by the sensor.

At the target sampling point t2, for the second target pixel P2 in the target pixel row line1, the second jitter data y(t)=PSF2, S<t≤2S acquired by the sensor.

At the target sampling point t3, for the third target pixel P3 in the target pixel row line1, the second jitter data y(t)=PSF2, 2S<t≤ex-time acquired by the sensor.

The sampling data acquired by the electronic device shown in this embodiment at the target sampling point t1 is Data1, and the Data1 includes Data1x and Data1y, where Data1x is x(t)=PSF1, 0<t≤S; Data1y is y. (t) = PSF2, 0 < t ≤ S;

The sampling data acquired by the electronic device at the target sampling point t2 is Data2, and the Data2 includes Data2x and Data2y, where Data2x is x(t)=PSF1, S<t≤2S; Data2y is y(t)= PSF2, S<t≤2S;

The sampling data acquired by the electronic device at the target sampling point t2 is Data3, and the Data3 includes Data3x and Data3y, where Data3x is x(t)=PSF1, 2S<t≤ex-time; Data3y is y(t ) = PSF2, 2S < t ≤ ex-time;

In this embodiment, after acquiring the sampling data, the electronic device may perform an integration operation to acquire the first coordinate data.

Specifically, the first coordinate data

More specifically, at the target sampling point t1, for the first target pixel P1 in the target pixel row line1, the first coordinate data x(t)=t*Data1x, 0<t≤S acquired by the sensor.

For details of Data1x, please refer to the above, please do not repeat them.

At the target sampling point t2, for the second target pixel P2 in the target pixel row line1, the first coordinate data x(t)=S*Data1x+t*Data2x acquired by the sensor, S<t≤2S;

For details of Data1x and Data2x, please refer to the above, please do not repeat them.

At the target sampling point t3, for the third target pixel P3 in the target pixel row line1, the first coordinate data acquired by the sensor x(t)=S*Data1x+S*Data2x+t*Data3x, 2S<t ≤ex-time;

For details of Data1x, Data2x, and Data3x, please refer to the above, and details are not described here.

After acquiring the sampled data, the electronic device may perform an integration operation to acquire the second coordinate data.

More specifically, at the target sampling point t1, for the first target pixel P1 in the target pixel row line1, the second coordinate data y(t)=t*Data1y, 0<t≤S acquired by the sensor.

For details of Data1y, please refer to the above, please do not repeat them.

At the target sampling point t2, for the second target pixel P2 in the target pixel row line1, the second coordinate data y(t)=S*Data1y+t*Data2y acquired by the sensor, S<t≤2S;

For details of Data1y and Data2y, please refer to the above, and the details are not described here.

At the target sampling point t3, for the third target pixel P3 in the target pixel row line1, the second coordinate data acquired by the sensor y(t)=S*Data1y+S*Data2y+t*Data3y, 2S<t ≤ex-time;

For details of Data1y, Data2y, and Data3y, please refer to the above, and the details are not described here.

Then, in the target pixel row line1, the target coordinates of the target pixel P1 are (x(t)=t*Data1x, y(t)=t*Data1y), in the target pixel row line1, the target pixel P2 The target coordinates are (x(t)=S*Data1x+t*Data2x, y(t)=S*Data1y+t*Data2y), and in the target pixel row line1, the target coordinate of the target pixel P3 is (x( t)=S*Data1x+S*Data2x+t*Data3x, y(t)=S*Data1y+S*Data2y+t*Data3y).

For the process of acquiring the target coordinates of the target pixels in the target pixel row 2 as shown in FIG. 8, please refer to the process of acquiring the target coordinates of each target pixel in line1, which is not described in detail in the embodiment.

The above description has been made on the case where a plurality of target pixels are included in the target pixel row, and the following If only one target pixel is included in the target pixel row, how to obtain the target coordinates will be described.

If the target pixel row has only one target pixel, the exposure time of the target pixel row is smaller than the sampling interval preset by the electronic device. If the sampling interval is 10 milliseconds as an example, in this case, The exposure time of the target pixel row is less than 10 mm such that there is only one target pixel in the target pixel row.

For example, as shown in FIG. 13, in the first target frame image, there is only one target pixel P4 in the target pixel row line1, and the exposure time of the target pixel row line1 is smaller than the sampling interval, and the sampling interval is the time difference between t2 and t1.

The sensor shown in this embodiment can acquire the first jitter data x(t)=PSF1, limt<t<ex-time at the target sampling point.

Wherein, limt is the time interval between the time when the target pixel row starts to be exposed and the exposure time of the target pixel, and ex-time is the exposure end time of the target pixel row.

Specifically, the sensor shown in this embodiment obtains the corresponding jitter data between the time of the exposure and the ex-time. The specific acquisition process of the jitter data is shown in the foregoing embodiment, and details are not described herein.

More specifically, taking the example shown in FIG. 13, for the target pixel row line3, the sensor can acquire the first jitter data x(t) at the target sampling point t1.

At the target sampling point t1, for the target pixel P4 in the target pixel row line3, the first jitter data x(t)=PSF1, 0<t<ex-time acquired by the sensor.

The sensor may also acquire second jitter data y(t) at the target sampling point t1.

At the target sampling point t1, for the target pixel P1 in the target pixel row line3, the second jitter data y(t)=PSF2, 0<t<ex-time acquired by the sensor.

The sampling data acquired by the electronic device shown in this embodiment at the target sampling point t1 is Data1, and the Data1 includes Data1x and Data1y, where Data1x is x(t)=PSF1, 0<t<ex-time; Data1y Is y(t)=PSF2, 0<t<ex-time;

Specifically, the first coordinate data

More specifically, at the target sampling point t1, for the target pixel P4 in the target pixel row line3, The first coordinate data x(t)=t*Data1x, 0<t<ex-time obtained by the sensor.

For details of Data1x, please refer to the above, please do not repeat them.

More specifically, at the target sampling point t1, for the target pixel P4 in the target pixel row line3, the second coordinate data y(t)=t*Data1y, 0<t<ex-time acquired by the sensor.

For details of Data1y, please refer to the above, please do not repeat them.

Then, in the target pixel row line1, the target coordinates of the target pixel P4 are (x(t)=t*Data1x, y(t)=t*Data1y).

Step 705: Determine a sub-target jitter amount.

Specifically, the electronic device shown in this embodiment first needs to determine the number of the target pixels in the target pixel row.

And if the number of the target pixels located in the target pixel row is at least two, setting a target set, where the target set includes a plurality of target distances, where the target distance is any two of all the target coordinates The distance between the target coordinates, and the target distance is also the distance between any of the target coordinates and the origin coordinates.

When determining the sub-target jitter amount, a two-dimensional coordinate system can be created, and the target coordinates of the respective target pixels located in the same row of target pixel rows are expressed in the two-dimensional coordinate system.

As shown in FIG. 8 and FIG. 14 , in the target pixel row line 1 , the number of the target pixels is three, and the target coordinates of P1 , the target coordinates of P 2 , and the target coordinates of P 3 may be as shown in FIG. 14 . Expressed in the coordinate system.

Then, the target distance is a distance between P1 and P2, a distance between P2 and P3, a distance between P1 and P3, and an origin coordinate (0, 0) in a two-dimensional coordinate system as shown in FIG. The distance from P1, the distance between the origin coordinates (0,0) and P2, and the distance between the origin coordinates (0,0) and P3.

The electronic device sets the acquired target distance in the target set.

In this case, the sub-target shake amount is the maximum of all of the target distances located within the target set.

Continuing with the example shown in FIG. 8 and FIG. 14, the sub-target shake amount of the target pixel line line1 is the distance between the origin coordinates and P3.

If the number of the target pixels located in the target pixel row is one, the sub-target shake amount is a distance between the target coordinate and the origin coordinate;

As shown in FIG. 13, in the target pixel row line3, there is only one target pixel P4, and the sub-target shake amount of the target pixel row is the distance between the target coordinates of P4 and the origin coordinates.

Step 706: Calculate a first target jitter amount of the first target frame image.

Specifically, if the number of the target pixel rows located in the first target frame image determined by the embodiment is a natural number greater than 1, all the sub-target jitter amounts are calculated by an averaging algorithm to obtain The first target jitter amount is described.

The specific process for determining the number of the target pixel rows shown in this step is shown in the above embodiment, and is not described in detail in this embodiment.

If the number of the target pixel rows is 1, the first target jitter amount is equal to the sub-target jitter amount.

Step 707: Determine whether the first target jitter amount is less than or equal to a preset value. If yes, execute step 708. If no, perform step 709.

Optionally, in the embodiment, when the preset value is set, the following manner may be adopted. It should be clarified that the description of the setting manner of the preset value in this embodiment is an optional example. It is not limited. In a specific application, the preset value may be set in other manners as long as the image is clear when the first target jitter amount is less than or equal to the preset value.

The following is described in conjunction with Table 1:

Table 1

In this embodiment, the electronic device is in different application scenarios, and different standards are applied. The description of the standard in this embodiment is an optional example. In a specific application, a standard that can be applied to more application scenarios may also be created.

Taking the scene “6-inch electronic device directly” as an example, if the electronic device needs to output a clear image, the corresponding standard C needs to be executed. In the C standard, the first fuzzy parameter is: the length of consecutive 10 pixels is 14um.

In a specific application, if a clear image is output, a length of 10 consecutive pixels in the image needs to be less than or equal to 14 um, and a clear image is output.

If the preset value shown in this embodiment is a parameter that is proportional to the fuzzy parameter, the preset value may be set by referring to the fuzzy parameter, so that the jitter amount of the image is less than or equal to the preset. In the case of a value, the electronic device can output an image whose resolution meets the requirements.

Step 708: Output the first target frame image.

In this embodiment, if the first target jitter amount of the first target frame image is less than or equal to the preset value, the first target is when the electronic device outputs the first target frame image. The frame image is an image whose resolution satisfies the condition, that is, the user can acquire the first target frame image that is clear.

Step 709: Determine a second target frame image.

The method shown in this embodiment may sequentially determine the second target frame image, that is, after performing step 708, and when step 709 is performed for the first time, the second target frame image is below the first target frame image. A target frame image.

Step 710: Determine whether the second target jitter amount is less than or equal to the preset value. If yes, execute step 711. If no, return to step 709 or step 712.

Specifically, the specific process of obtaining the second target jitter amount is described in detail in the specific process of obtaining the first target jitter amount, which is not specifically described in this embodiment.

For the description of the preset values shown in this step, please refer to the foregoing embodiment, which is not described in detail in this embodiment.

In this step, if the second jitter amount of the second target frame image is greater than the preset value, indicating that the second target frame image clarity is relatively low, returning to step 709 to re-determine the second target frame image, When the step 710 is performed in the second loop, the second target frame image and the first target frame image are separated by one frame image. After the second frame image is re-determined, step 710 is continued.

It can be seen that the exposure end time of the second target frame image shown in the embodiment is later than the exposure end time of the first target frame image, and the interval between the first target frame image and the second target frame image is N target frame image, the N being a natural number greater than or equal to 0;

If N is equal to 0, the second target frame image is the next target frame image of the first target frame image. If N is equal to 1, the second target frame image is the first target frame. The next two target frame images of the image, and so on.

In this embodiment, if the second target jitter amount is greater than the preset value, it is determined whether the current second target frame image is the last frame image sorted by the exposure end time in the frame image sequence, if If not, it is explained that there is a frame image in the sequence of frame images in which the amount of jitter has not yet been calculated.

If yes, it is determined that all frame images in the frame image sequence have been calculated, and the jitter amount of all frame images in the frame image sequence is greater than the preset value, and then step 712 is continued.

Step 711: Output the second target frame image.

For the description of step 711 shown in this embodiment, please refer to step 708, and details are not described herein.

Step 712: Output a third target frame image.

For example, in the above embodiment, a total of five frame images in the frame image sequence are determined, and the jitter amounts of the respective frame images are Q1, Q2, Q3, Q4, and Q5, respectively, and the third target frame image is It is a frame image having a minimum value among Q1, Q2, Q3, Q4, and Q5.

The advantageous effects of using the image output method shown in this embodiment are:

The electronic device does not need to calculate the contrast of all acquired frame images in the frame image sequence, and only needs to calculate the jitter amount of the frame images located in the frame image sequence in the order of the exposure end time, if the current calculation is calculated If the amount of jitter of the frame image is less than or equal to the preset value, the current frame image is directly output without calculating the frame image after the current frame image by sorting the exposure end time, thereby saving the calculation of the frame image. The duration of the image is improved in the case of ensuring the sharpness of the output image of the electronic device.

The method shown above is based on the rolling shutter shutter to implement the image output method provided by the embodiment. The following describes how the global shutter global shutter realizes the method shown in the embodiment of the present invention:

As shown in FIG. 16, in the case that the present embodiment is based on a global shutter global shutter, the image output method includes:

Step 1601: Determine a target sampling time point.

For details of the target sampling time point shown in this embodiment, refer to step 701 shown in FIG. 7 in this embodiment, and details are not described herein.

In the global shutter global shutter, the electronic device can determine the image frame appearing every second and the time point at which the exposure of each image frame ends by the data reported by the sensor.

Taking FIG. 17 as an example, FIG. 17 exemplifies an example in which the exposed frame image is the first target frame image and the second target frame image.

Taking FIG. 17 as an example, FIG. 8 exemplifies an example in which the exposed frame image is the first target frame image and the second target frame image.

The method application shown in this embodiment can be applied to a global shutter global shutter mechanism, taking the first target frame image formed by the sensor as an example, and the initial exposure time of each pixel row of the first target frame image. The same is the same, and the exposure end time of each pixel row of the first target frame image is the same, as shown in FIG. 17, the timing chart of the row exposure of the first target frame and the second target frame is rectangular. structure.

For the description of other parameters of the first target frame image, please refer to FIG. 8 , and details are not described herein.

As shown in FIG. 17, the exposure time of the first target frame image is T1, and the target sampling time point is located in the time period of T1.

As shown in FIG. 17, the sampling time points t1 and t2 shown in this embodiment are located within the exposure time T1 of the first target frame image.

Then, the sampling time points t1 and t2 shown in this embodiment are the target sampling time points.

Step 1602, determining a target pixel row.

Because the initial exposure time of each pixel row is the same, and the exposure end time of each pixel row is also the same, the target pixel row shown in this embodiment may be the first target frame image. Any line included.

Step 1603, determining a target pixel in the target pixel row.

For details, please refer to step 703 for details.

Step 1604, determining target coordinates of the target pixel.

The acquisition process of the PSF1 is shown in the embodiment 704 shown in FIG. 7 , and details are not described herein.

Specifically, the target pixel is taken as the A-th target pixel in the target pixel row, and the A-th target pixel is any target pixel included in the target pixel row, and the lime is the The time interval between the time when the target pixel row starts to be exposed and the exposure time of the A target pixel, and if the A target pixel is not the last pixel in the target pixel row, then limx is A*s, if The A target pixel is the last pixel in the target pixel row, and limx is the exposure end time ex-time of the target pixel row.

Specifically, the sensor shown in this embodiment acquires corresponding jitter between the moments of lime and limx. For the specific acquisition process of data and jitter data, please refer to the above embodiment for details.

More specifically, taking the example shown in FIG. 17, for the target pixel row line1, the sensor can acquire the first jitter data x(t) at the target sampling points t1 and t2, respectively.

At the target sampling point t2, for the last target pixel P2 in the target pixel row line1, the first jitter data acquired by the sensor x(t)=PSF1, x(t)=PSF1, s<t≤ex-time .

More specifically, for the target pixel row line1, the sensor may acquire the second jitter data y(t) at the target sampling points t1 and t2, respectively.

At the target sampling point t2, for the last target pixel P2 in the target pixel row line1, the second jitter data y(t)=PSF2, s<t≤ex-time acquired by the sensor.

The sampling data acquired by the electronic device at the target sampling point t2 is Data2, and the Data2 includes Data2x and Data2y, where Data2x is x(t)=PSF1, s<t≤ex-time; Data2y is y(t )=PSF2,s<t≤ex-time;

Specifically, the first coordinate data

For details of Data1x, please refer to the above, please do not repeat them.

At the target sampling point t2, for the second target pixel P2 in the target pixel row line1, the first coordinate data acquired by the sensor x(t)=S*Data1x+t*Data2x, s<t≤ex-time ;

More specifically, at the target sampling point t1, for the first target pixel in the target pixel row line1 P1, the second coordinate data acquired by the sensor y(t)=t*Data1y, 0<t≤S.

For details of Data1y, please refer to the above, please do not repeat them.

At the target sampling point t2, for the second target pixel P2 in the target pixel row line1, the second coordinate data acquired by the sensor y(t)=S*Data1y+t*Data2y, s<t≤ex-time ;

Then, in the target pixel row line1, the target coordinates of the target pixel P1 are (x(t)=t*Data1x, y(t)=t*Data1y), in the target pixel row line1, the target pixel P2 The target coordinates are (x(t)=S*Data1x+t*Data2x, y(t)=S*Data1y+t*Data2y).

Step 1605: Calculate the target jitter amount.

In the specific process of determining the target jitter amount in this embodiment, please refer to the specific process of determining the sub-target jitter amount shown in step 705 shown in FIG. 7 .

In this embodiment, the first target frame image has a rectangular structure, and the same jitter is consistent with the application of the pixel row of the first target frame image, and the first target frame image shown in this embodiment is different. The pixel rows have the same amount of jitter. In this embodiment, the jitter amount of any row of the first target frame image may be used as the jitter amount of the entire first target frame image.

Step 1606: Determine whether the first target jitter amount is less than or equal to a preset value. If yes, go to step 1607. If no, go to step 1608.

Step 1607: Output the first target frame image.

Step 1608, determining a second target frame image.

Step 1609: Determine whether the second target jitter amount is less than or equal to the preset value. If yes, execute step 1610. If no, return to step 1608 or step 1611.

Step 1610: Output the second target frame image.

Step 1611: Output a third target frame image.

For the specific implementation process of the steps 1606 to 1611 shown in this embodiment, please refer to the steps 707 to 712 shown in FIG. 7 , and details are not described herein.

The electronic device does not need to calculate the contrast of all acquired frame images in the frame image sequence, and only needs to calculate the jitter amount of the frame images located in the frame image sequence in the order of the exposure end time, if the current calculation is calculated The jitter of the frame image is less than or equal to the preset value, then directly The current frame image is output without calculating the frame image after the current frame image by the exposure end time, thereby saving the time taken for calculating the frame image and ensuring the clarity of the output image of the electronic device. The efficiency of the output image is improved.

The specific structure of the electronic device capable of realizing the image output method shown in FIG. 7 will be described in detail from the perspective of the functional module, as shown in FIG.

The process of performing the image output by the electronic device shown in this embodiment is shown in the embodiment shown in FIG. 7 , and is not described in detail in this embodiment.

As shown in FIG. 15, the electronic device includes:

a second acquiring unit 1501, configured to acquire a time when any row of pixels included in the first target frame image starts to be exposed;

The second determining unit 1502 is configured to determine the target pixel row, wherein a time when the target pixel row starts to be exposed is the target sampling time point.

a first acquiring unit 1503, configured to acquire sampling data corresponding to a target sampling time point, where the target sampling time point is any sampling time point of at least one sampling time point of an exposure time of the first target frame image, The sampled data is jitter data of a pixel corresponding to the target sampling time point in the first target frame image;

The first obtaining unit 1503 is further configured to acquire target sampling data of the target pixel, where the target pixel is any pixel located in the target pixel row, and an exposure time of the target pixel is the target sampling time point. And the target pixel is performed by any pixel row included in the first target frame image, and the target sampling data is jitter data of the target pixel at the target sampling time point.

a first calculating unit 1504, configured to calculate a sub-target jitter amount of the target pixel row according to the target sampling time point and the target sampling data;

a third determining unit 1505, configured to determine a number of the target pixel rows;

a second calculating unit 1506, configured to: if the number of the target pixel rows is 1, the first target jitter amount is equal to the sub-target jitter amount; if the target pixel row number is a natural number greater than 1, All of the sub-target shake amounts are calculated by an averaging algorithm to obtain the first target shake amount.

Specifically, the second calculating unit 1506 includes:

a calculation module 15061, configured to calculate target coordinates of any target pixel located in the target pixel row according to the target sampling time point and the target sampling data;

The first determining module 15062 is configured to: if the number of the target pixels located in the target pixel row is one, the sub-target jitter amount is a distance between the target coordinate and the origin coordinate;

a second determining module 15063, configured to set a target set if the number of the target pixels located in the target pixel row is at least two, the target set includes a plurality of target distances, and the target distance is all the a distance between any two of the target coordinates in the target coordinate, and the target distance is also a distance between any of the target coordinates and the origin coordinate;

The third determining module 15064 is configured to acquire the sub-target jitter amount, where the sub-target jitter amount is a maximum value of all the target distances located in the target set.

More specifically, the calculation module 15061 includes:

a first obtaining sub-module 150611, configured to acquire first jitter data that is located on the X-axis of any target pixel in the target pixel row at the target sampling time point;

a first calculation sub-module 150612, configured to perform an integration operation on the first jitter data to obtain first coordinate data;

a second obtaining sub-module 150613, configured to acquire second jitter data that is located on the Y-axis of any target pixel in the target pixel row at the target sampling time point;

a second calculation sub-module 150614, configured to perform an integration operation on the second jitter data to obtain second coordinate data;

Determining a sub-module 150615, the target coordinates for any target pixel in the target pixel row include a target abscissa and a target ordinate, and determining the target abscissa as the first coordinate data, the target ordinate is a The second coordinate data is described.

The first determining unit 1507 is configured to determine whether the first target jitter amount is less than or equal to a preset value, where the first target jitter amount is a first target frame image determined according to the target sampling time point and the sampling data. Amount of jitter

The first output unit 1508 is configured to output the first target frame image if the first target jitter amount is less than or equal to the preset value.

a first determining unit 1509, configured to determine a second target frame image if the first target jitter amount is greater than the preset value, where an exposure end time of the second target frame image is later than the first target frame An exposure end time of the image, and an N target frame image is spaced between the first target frame image and the second target frame image, wherein the N is a natural number greater than or equal to 0;

The second determining unit 1510 is configured to determine whether the second target jitter amount is less than or equal to the preset value, where the second target jitter amount is a jitter amount of the second target frame image;

The second output unit 1511 is configured to output the second target image frame if the second target jitter amount is less than or equal to the preset value.

The second output unit 1511 is further configured to: if the second target jitter amount is greater than the preset value, output a third target frame image, where the third target frame image is any one of the frame image sequences a frame image, the frame image sequence including the first target frame image and the second target frame image, and the third target frame image has a jitter amount that is all frame images in the frame image sequence The minimum amount of jitter that is present.

The beneficial effects of using the electronic device shown in this embodiment are as follows:

15 illustrates the structure of the electronic device from the perspective of the functional module, and the structure of the physical hardware angle of the electronic device will be further described below in conjunction with FIG.

The electronic device includes one or more microcomputers 110, an image memory 104, a bus system, and one or more programs, and the microcomputer 110 and the image memory 104 are connected by the bus system;

Wherein the one or more programs are stored in the image memory 104, the one or more programs comprising instructions that, when executed by the electronic device, cause the electronic device to perform as shown in FIG. Image output method.

The specific process of the image output method of the electronic device shown in this embodiment is shown in FIG. 7 , which is not described in detail in this embodiment.

The specific structure of the electronic device in this embodiment can also be seen in the foregoing embodiment, specifically in the present embodiment. It will not be repeated in the example.

Specifically, in this embodiment, the one or more programs include instructions that, when executed by the electronic device, cause the electronic device to perform an image output method as shown in FIG. 7, the instructions executing the image The specific process of the output method is shown in FIG. 7 , and details are not described in this embodiment.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. And the foregoing The storage medium includes: a U disk, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes.

The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the embodiments are modified, or the equivalents of the technical features are replaced by the equivalents of the technical solutions of the embodiments of the present invention.

Claims

An image output method, comprising:

Acquiring sampling data corresponding to a target sampling time point, where the target sampling time point is any sampling time point of at least one sampling time point located in an exposure time of the first target frame image, wherein the sampling data is the Jitter data of a pixel corresponding to the target sampling time point in a target frame image;

Determining whether the first target jitter amount is less than or equal to a preset value, the first target jitter amount being a jitter amount of the first target frame image determined according to the target sampling time point and the sampling data;

If the first target jitter amount is less than or equal to the preset value, outputting the first target frame image.
The method according to claim 1, wherein after the determining whether the first target amount of jitter is less than or equal to a preset value, the method further comprises:

If the first target shake amount is greater than the preset value, determining a second target frame image, an exposure end time of the second target frame image is later than an exposure end time of the first target frame image, and There are N target frame images between the first target frame image and the second target frame image, and the N is a natural number greater than or equal to 0;

Determining whether the second target jitter amount is less than or equal to the preset value, and the second target jitter amount is a jitter amount of the second target frame image;

And if the second target jitter amount is less than or equal to the preset value, outputting the second target image frame.
The method according to claim 2, wherein after the determining whether the second target amount of jitter is less than or equal to the preset value, the method further comprises:

If the second target jitter amount is greater than the preset value, outputting a third target frame image, where the third target frame image is any frame image in the frame image sequence, and the frame image sequence includes the first a target frame image and the second target frame image, and the third target frame image has a jitter amount which is a minimum value of a jitter amount of all frame images in the frame image sequence.
The method according to any one of claims 1 to 3, wherein the acquiring sampling data corresponding to a target sampling time point comprises:

Obtaining target sample data of the target pixel, the target pixel being any one of the target pixel rows a pixel, and an exposure time of the target pixel is the target sampling time point, the target pixel acts on any pixel row included in the first target frame image, and the target sampling data is the target pixel in the The jitter data of the target sampling time point.
The method according to claim 4, wherein before the acquiring the target sample data of the target pixel, the method further comprises:

Obtaining a time when any row of pixels included in the image of the first target frame starts to be exposed;

Determining the target pixel row, wherein a time at which the target pixel row starts to be exposed is the target sampling time point.
The method according to claim 4 or 5, wherein the method further comprises: before determining whether the first target amount of jitter is less than or equal to a preset value, the method further comprising:

Calculating a sub-target jitter amount of the target pixel row according to the target sampling time point and the target sampling data;

Determining the number of the target pixel rows;

If the number of the target pixel rows is 1, the first target jitter amount is equal to the sub-target jitter amount;

If the number of the target pixel rows is a natural number greater than 1, all of the sub-target jitter amounts are calculated by an averaging algorithm to obtain the first target jitter amount.
The method according to claim 6, wherein the calculating the sub-target jitter amount of the target pixel row according to the target sampling time point and the target sampling data comprises:

Calculating target coordinates of any target pixel located in the target pixel row according to the target sampling time point and the target sampling data;

If the number of the target pixels located in the target pixel row is one, the sub-target shake amount is a distance between the target coordinate and the origin coordinate;

And if the number of the target pixels located in the target pixel row is at least two, setting a target set, where the target set includes a plurality of target distances, where the target distance is any two of all the target coordinates a distance between the target coordinates, and the target distance is also a distance between any of the target coordinates and the origin coordinates;

Obtaining the sub-target jitter amount, the sub-target jitter amount being a maximum of all of the target distances within the target set.
The method according to claim 7, wherein the calculating target coordinates of any target pixel located in the target pixel row according to the target sampling time point and the target sampling data comprises:

Obtaining first jitter data that is located along the X axis of any target pixel in the target pixel row at the target sampling time point;

Performing an integration operation on the first jitter data to obtain first coordinate data;

Obtaining second jitter data that is located in the target pixel row and that is translated along the Y axis at the target sampling time point;

Performing an integration operation on the second jitter data to obtain second coordinate data;

The target coordinates of any target pixel located in the target pixel row include a target abscissa and a target ordinate, and the target abscissa is determined as the first coordinate data, and the target ordinate is the second coordinate data.
An electronic device, comprising:

a first acquiring unit, configured to acquire sampling data corresponding to a target sampling time point, where the target sampling time point is any sampling time point located in at least one sampling time point of an exposure time of the first target frame image, The sampled data is jitter data of a pixel corresponding to the target sampling time point in the first target frame image;

a first determining unit, configured to determine whether the first target jitter amount is less than or equal to a preset value, where the first target jitter amount is a first target frame image determined according to the target sampling time point and the sampling data Amount of jitter;

And a first output unit, configured to output the first target frame image if the first target jitter amount is less than or equal to the preset value.
The electronic device according to claim 9, wherein the electronic device further comprises:

a first determining unit, configured to determine a second target frame image if the first target shake amount is greater than the preset value, and an exposure end time of the second target frame image is later than the first target frame image Exposure end time, and there are N target frame images between the first target frame image and the second target frame image, the N being a natural number greater than or equal to 0;

a second determining unit, configured to determine whether the second target jitter amount is less than or equal to the preset value, where the second target jitter amount is a jitter amount of the second target frame image;

And a second output unit, configured to output the second target image frame if the second target jitter amount is less than or equal to the preset value.
The electronic device according to claim 10, wherein the second output unit is further configured to output a third target frame image if the second target jitter amount is greater than the preset value, The three target frame image is any frame image in the frame image sequence, and the frame image sequence includes the first target frame image and the second target frame image, and the third target frame image has a jitter amount Is the minimum value of the amount of jitter that all of the frame images in the sequence of frame images have.
The electronic device according to any one of claims 9 to 11, wherein the first obtaining unit is further configured to acquire target sampling data of the target pixel, where the target pixel is any pixel located in the target pixel row. And the exposure time of the target pixel is the target sampling time point, the target pixel acts on any pixel row included in the first target frame image, and the target sampling data is the target pixel in the Jitter data at the target sampling time point.
The electronic device according to claim 12, wherein the electronic device further comprises:

a second acquiring unit, configured to acquire a time when any row of pixels included in the first target frame image starts to be exposed;

a second determining unit, configured to determine the target pixel row, wherein a time when the target pixel row starts to be exposed is the target sampling time point.
The electronic device according to claim 12 or 13, wherein the electronic device further comprises:

a first calculating unit, configured to calculate a sub-target jitter amount of the target pixel row according to the target sampling time point and the target sampling data;

a third determining unit, configured to determine a number of the target pixel rows;

a second calculating unit, configured to: if the number of the target pixel rows is 1, the first target jitter amount is equal to the sub-target jitter amount; if the target pixel row number is a natural number greater than 1, All of the sub-target shake amounts are calculated by an averaging algorithm to obtain the first target shake amount.
The electronic device according to claim 14, wherein the second calculating unit comprises:

a calculation module, configured to calculate a location based on the target sampling time point and the target sampling data a target coordinate of any target pixel in the target pixel row;

a first determining module, configured to: if the number of the target pixels located in the target pixel row is one, the sub-target jitter amount is a distance between the target coordinate and the origin coordinate;

a second determining module, configured to set a target set if the number of the target pixels located in the target pixel row is at least two, the target set includes a plurality of target distances, and the target distance is all the targets a distance between any two of the target coordinates in the coordinate, and the target distance is also a distance between any of the target coordinates and the origin coordinate;

And a third determining module, configured to acquire the sub-target jitter amount, where the sub-target jitter amount is a maximum value of all the target distances located in the target set.
The electronic device according to claim 15, wherein the calculation module comprises:

a first acquiring sub-module, configured to acquire first jitter data that is located on the X-axis of any target pixel in the target pixel row at the target sampling time point;

a first calculation submodule, configured to perform an integration operation on the first jitter data to obtain first coordinate data;

a second acquiring sub-module, configured to acquire second jitter data that is located on the Y-axis of any target pixel in the target pixel row at the target sampling time point;

a second calculation submodule, configured to perform an integration operation on the second jitter data to obtain second coordinate data;

Determining a sub-module, wherein target coordinates for any target pixel located in the target pixel row include a target abscissa and a target ordinate, determining that the target abscissa is the first coordinate data, and the target ordinate is the Second coordinate data.
An electronic device, comprising:

One or more microcomputers, image memories, bus systems, and one or more programs, the microcomputers and the image memory being connected by the bus system;

Wherein the one or more programs are stored in the image memory, the one or more programs comprising instructions that, when executed by the electronic device, cause the electronic device to perform as claimed in claims 1 to 8 The method of any of the preceding claims.
A computer readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by an electronic device, cause the electronic device to execute A method as claimed in any one of claims 1 to 8.