WO2018161640A1

WO2018161640A1 - Long-exposure photographing method and device

Info

Publication number: WO2018161640A1
Application number: PCT/CN2017/112433
Authority: WO
Inventors: 罗义军
Original assignee: 中兴通讯股份有限公司
Priority date: 2017-03-06
Filing date: 2017-11-22
Publication date: 2018-09-13
Also published as: CN108540728A

Abstract

Provided are a long-exposure photographing method and device. The method comprises: performing, within a long-exposure period, multiple exposures to obtain multiple frame data items; and performing adjustment of all or some available frame data items of the multiple frame data items, combining the multiple adjusted frame data items to form an image, and taking the image as a resulting image of a current long-exposure photographing operation. In the above technical solution, multiple frame data items are adjusted and then combined to form an image, thereby effectively solving a problem in the prior art of a direct output of a blurry long-exposure image, namely a blurry image resulting from a long-exposure photographing operation, and providing a clearer long-exposure image.

Description

Long exposure photographing method and device

Technical field

The present application relates to the field of communications, for example, to a long exposure photographing method and apparatus.

Background technique

In the related art, the mobile phone camera is limited by the sensitivity sensor, and the problem of low-light scenes such as night scenes is generally poor. The most effective way to improve this problem is to increase the exposure time, but the exposure time is too long to be blurred, you must use a tripod to shoot.

Many mobile phones in the related art have a long exposure function, but it is difficult for a user to shoot in a handheld manner, and basically the user does not use a tripod to take a photo of the mobile phone. Therefore, the long exposure function on the mobile phone is basically meaningless to the user.

In view of the related art, the problem of blurring pictures taken under long exposure conditions has not been effectively solved.

Summary of the invention

Embodiments of the present disclosure provide a long exposure photographing method and apparatus to at least solve the problem of blurring a picture taken in a long exposure situation in the related art.

According to an embodiment of the present disclosure, a long exposure photographing method is provided, including:

And performing multiple exposures in a preset first exposure time to obtain a plurality of frame data corresponding to the multiple exposures, wherein data corresponding to each exposure is used as one frame data of the plurality of frame data; The plurality of frame data is adjusted according to a preset rule, and the adjusted picture of the plurality of frame data is combined with the picture corresponding to the target frame, and the picture is output.

Optionally, performing multiple exposures in the preset first exposure time comprises: periodically performing exposure according to the second exposure time within a preset first exposure time, wherein the first exposure time is greater than the Second exposure time.

Optionally, before the exposure is periodically performed according to the second exposure time within the preset first exposure time, Determining that the sum of the second exposure times is less than the preset first exposure time.

Optionally, the adjusting the plurality of frame data according to the preset rule includes: selecting frame data in which the centralized value FV value of the plurality of frame data is greater than a preset value as reference frame data; and adjusting according to the reference frame data The plurality of frame data.

Optionally, adjusting the plurality of frame data according to the reference frame data, including: selecting a specified object area in a picture corresponding to the reference frame data, and adjusting the plurality of frame data according to the specified object area The corresponding picture.

Optionally, selecting the specified object area in the picture corresponding to the reference frame data includes: selecting the specified object area within a predetermined range around the focus frame data of the reference frame data.

Optionally, selecting the specified object area in the picture corresponding to the reference frame data includes: dividing the picture corresponding to the reference frame data into M*N pixel groups, and the color values of the first pixel group and surrounding If the difference between the color values of the pixel group is greater than a preset value, determining that the first pixel group is a clear pixel group, or that the difference between the brightness value of the first pixel group and the brightness value of the surrounding pixel group is greater than a pre- In the case of setting a value, determining that the first pixel group is a clear pixel group, wherein the M and N are natural numbers; and in a case where the picture has a specified area including a plurality of consecutive clear pixel groups, It is determined that the designated area is the specified object area.

Optionally, adjusting the picture corresponding to the multiple frame data according to the specified target area, including: selecting four the specified objects in a predetermined range around four corners of the picture corresponding to the reference frame a region, the center of the four specified object regions is connected to form a reference pattern, and a plurality of graphics to be compared corresponding to the reference graphics are acquired in the plurality of frame data according to the reference graphics; and the graphics to be compared are adjusted. The graphics to be compared corresponding to the plurality of frames are coincident with the reference graphics.

The picture corresponding to the frame data of the graphic to be compared is moved synchronously with the graphic to be compared.

Optionally, adjusting the graphic to be compared includes: comparing four boundary lengths or four corner angles of the graphic to be compared and the reference graphic, wherein, in the four boundaries or the four corners In a case where the at least one boundary length difference is greater than the first preset value or the corner angle difference is greater than the second preset value, the shape to be compared is adjusted according to the reference pattern.

Optionally, after comparing the four boundary lengths or the four corner angles of the to-be-compared graphic and the reference graphic, the method further includes: comparing the four boundary length differences in the comparison to be smaller than the first preset If the value, or the difference of the four corner angles is smaller than the second preset value, determining that the picture corresponding to the frame data of the graphic to be compared does not need to be adjusted.

Optionally, the adjusting the graphics to be compared includes: rotating a specified boundary of the graphics to be compared to be parallel to a boundary corresponding to the specified boundary in the reference graphics, where the multiple frame data corresponds to The picture is rotated in synchronization with the graphic to be compared.

Optionally, the adjusting the graphic to be compared includes: moving a geometric center of the graphic to be compared to a same position as a geometric center of the reference graphic, wherein a picture and a corresponding image of the frame data of the graphic to be compared Tells the comparison graph to move synchronously.

Optionally, before the adjusting the plurality of frame data according to the preset rule, adjusting a display effect of the picture corresponding to each frame data of the plurality of frame data; or, in the picture of the plurality of frame data to be adjusted After the picture corresponding to the target frame is synthesized, the display effect of the picture corresponding to the composite target frame is adjusted.

According to another embodiment of the present disclosure, a long exposure photographing apparatus is provided, which is applied to a photographing apparatus, including: an acquisition module configured to perform multiple exposures in a preset first exposure time, and acquire the plurality of a plurality of frame data corresponding to the second exposure, wherein the data corresponding to each exposure is used as one frame data of the plurality of frame data; and the adjusting module is configured to adjust the plurality of frame data according to a preset rule, The picture of the adjusted plurality of frame data is combined with the picture corresponding to the target frame, and the picture is output.

Optionally, the obtaining module is further configured to periodically perform exposure according to a second exposure time within a preset first exposure time, wherein the first exposure time is greater than the second exposure time.

Optionally, before the exposure is periodically performed according to the second exposure time in the preset first exposure time, determining that the sum of the second exposure times is less than the preset first exposure time.

Optionally, the adjusting module is further configured to: select, as the reference frame data, the first frame data in which the centralized value FV value of the plurality of frame data is greater than a preset value; and adjust the multiple according to the reference frame data. Frame data.

Optionally, the adjusting module is further configured to: select a specified object area in a picture corresponding to the reference frame data, and adjust the designation of the picture corresponding to the multiple frame data according to the specified target area The object area.

Embodiments of the present disclosure also provide a computer readable storage medium storing computer executable instructions arranged to perform the above method.

An embodiment of the present disclosure further provides an electronic device, including:

At least one processor;

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to cause the at least one processor to perform the method described above.

Through the disclosure, multiple exposures are performed during a long exposure time to obtain a plurality of frame data, and all or part of the available frame data of the plurality of frame data are adjusted, and the adjusted plurality of frame data is combined into one. Picture, take this picture as a photo of this long exposure photo. By adopting the above technical solution, a plurality of frame data are adjusted and then combined into one picture, which effectively solves the problem that the long exposure photography in the related art directly obtains a blurred photo, that is, the picture taken in the case of long exposure is blurred, so that the long exposure shooting is performed. The photo is clearer.

BRIEF abstract

The drawings described herein are intended to provide an understanding of the present disclosure, and are intended to be a part of the present disclosure. In the drawing:

1 is a block diagram showing the hardware structure of a mobile terminal of a long exposure photographing method according to an embodiment of the present disclosure;

2 is a flow chart of a long exposure photographing method in accordance with an embodiment of the present disclosure;

3 is a flow chart of long exposure photographing in accordance with an embodiment of the present disclosure;

4 is a flow diagram of selecting a reference frame and a reference point in accordance with an embodiment of the present disclosure;

5 is a schematic diagram of a reference point selection of a reference frame in accordance with an embodiment of the present disclosure;

6 is a schematic diagram of selection of reference points in other frame data in accordance with an embodiment of the present disclosure;

7 is a schematic diagram 1 of a connection of reference points of a reference frame according to an embodiment of the present disclosure;

8 is a second schematic diagram of a connection of reference points of a reference frame in accordance with an embodiment of the present disclosure;

9 is a flow chart of a method of performing another method of long exposure photographing according to an embodiment of the present disclosure;

FIG. 10 is a block diagram showing the structure of a long exposure photographing apparatus according to an embodiment of the present disclosure.

detailed description

The present disclosure will be described in detail below with reference to the drawings in conjunction with the embodiments. The embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

The terms "first", "second" and the like in the specification and claims of the present disclosure and the above-mentioned figures are used to distinguish similar objects, and are not necessarily used to describe a particular order or order.

Example 1

The method embodiment provided in Embodiment 1 of the present application can be executed in a device such as a camera or a mobile terminal.

Wherein, the device may include:

At least one processor;

a memory communicatively coupled to the at least one processor; wherein

Taking a mobile terminal as an example, FIG. 1 is a hardware structural block diagram of a mobile terminal of a long exposure photographing method according to an embodiment of the present disclosure. As shown in FIG. 1, the mobile terminal 10 may include one or more (only one shown) processor 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA). A memory 104 configured to store data, and a transmission device 106 configured as a communication function. It will be understood by those skilled in the art that the structure shown in FIG. 1 is merely illustrative and does not limit the structure of the above electronic device. For example, the mobile terminal 10 may also include more or fewer components than those shown in FIG. 1, or have a different configuration than that shown in FIG.

The memory 104 can be configured as a software program and a module for storing application software, such as a program instruction/module corresponding to a long exposure photographing method in the embodiment of the present disclosure, and the processor 102 is stored by running The software program and modules within the memory 104 perform various functional applications and data processing, i.e., implement the methods described above. Memory 104 may include high speed random access memory, and may also include non-volatile memory such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, memory 104 can include memory remotely located relative to processor 102, which can be connected to mobile terminal 10 over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

Transmission device 106 is configured to receive or transmit data via a network. The network instance described above may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network Interface Controller (NIC) that can be connected to other network devices through a base station to communicate with the Internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module configured to communicate with the Internet wirelessly.

In the embodiment, a long exposure photographing method running on the mobile terminal is provided. FIG. 2 is a flowchart of a long exposure photographing method according to an embodiment of the present disclosure. As shown in FIG. 2, the flow includes the following steps. :

Step S202, performing multiple exposures in a preset first exposure time, and acquiring a plurality of frame data corresponding to the multiple exposures, wherein the data corresponding to each exposure is used as one frame data of the plurality of frame data. The first exposure time of the place is the long exposure photo set in the camera. During this time period, multiple exposures may also be called performing multiple ordinary photographs.

In step S204, the plurality of frame data is adjusted according to the preset rule, and the adjusted picture of the plurality of frame data is combined with the picture corresponding to the target frame, and the picture is output. The sequence of the above steps does not limit the execution order of the technical solution, that is, in the process of acquiring multiple frame data, the frame data that has been acquired can be adjusted at the same time, the new frame data is continuously acquired, and the new frame data is continuously adjusted. It saves the processing time of the process. Finally, when the new frame data is no longer acquired, all the frame data may be adjusted accordingly, and then the composition is unified, or the adjustment of one piece can be adjusted. Zhang, in the synthesis of a new one.

Through the above steps, multiple exposures are performed during a long exposure time to obtain a plurality of frame data, and all or part of the available frame data of the plurality of frame data are adjusted, and the adjusted plurality of frame data is combined into one. Picture, take this picture as a photo of this long exposure photo. By adopting the above technical solution, a plurality of frame data are adjusted and then combined into one picture, which effectively solves the long exposure photography in the related art. Directly get a blurred photo, that is, the problem of blurring the picture taken under long exposure, making the photos taken by long exposure more clear.

Optionally, the exposure is periodically performed according to the second exposure time within a preset first exposure time, wherein the first exposure time is greater than the second exposure time.

Optionally, before the exposure is periodically performed according to the second exposure time in the preset first exposure time, determining that the sum of the second exposure time is less than the preset first exposure time.

Optionally, adjusting the multiple frame data according to the preset rule, including: selecting frame data in which the centralized value FV value of the plurality of frame data is greater than a preset value as the reference frame data; and adjusting the multiple according to the reference frame data. Frame data. There may be multiple ways to select a reference frame. You can select the Nth frame data that can be used in the frame data as the reference frame. You can specify the frame corresponding to the frame data by using some preset image related parameters. of. It is also possible to select a photo with a good position of the photographing object in the plurality of frame data as a reference frame, that is, a photograph in which a person or an object is in an intermediate position in the photograph can be used as a reference frame. Generally, the selection of the reference frame provides a good basis for synthesizing a plurality of frame data. A good reference is not limited to the content in the above embodiment.

Optionally, the specified object area is selected in the picture corresponding to the reference frame data, and the picture corresponding to the plurality of frame data is adjusted according to the specified object area. After selecting the reference frame, for more precise adjustment, you can select some specified object areas, that is, the key areas in the photo, for example, portraits, portraits and portraits around can be the specified object area, as for the importance of other photo positions. Relatively low, this can be more precise and more prominent.

Optionally, an area within a predetermined range around the focus area of the picture corresponding to the reference frame data is selected within the predetermined range around the focus area of the reference frame data as the designated object area;

Or dividing the picture corresponding to the reference frame data into M*N pixel groups, and determining the first when the difference between the color value of the first pixel group and the color value of the surrounding pixel group is greater than a preset value. The pixel group is a clear pixel group, or, in a case where a difference between a luminance value of the first pixel group and a luminance value of the surrounding pixel group is greater than a preset value, determining that the first pixel group is a clear pixel group, wherein the M and N are natural numbers; in the case where there are a plurality of consecutive designated areas of the clear pixel group in the designated area of the picture, it is determined that the designated area is the designated object area. The method of selecting a specified object area is the same as the concept of selecting a reference frame in a plurality of frame data, and an area with a clear photographing effect can be selected as the designated object area.

Optionally, four are selected within a predetermined range around the four corners of the picture corresponding to the reference frame. The designated object area is connected to the center of the four specified object areas to form a reference pattern; and the plurality of to-be-compared patterns corresponding to the reference pattern are acquired in the plurality of frame data according to the reference pattern;

The graphics to be compared are adjusted until the graphics to be compared corresponding to the plurality of frames overlap with the reference graphics, and the image corresponding to the frame data of the graphics to be compared is moved synchronously with the graphics to be compared. The two figures cannot be completely coincident and there can be a margin of error.

Optionally, comparing four boundary lengths and four corner angles of the to-be-compared pattern and the reference pattern, wherein at least one of the four boundaries or the four corners has a difference in length of the boundary greater than a first preset value or When the corner angle difference is greater than the second preset value, the shape of the pattern to be compared is adjusted according to the reference pattern. What is described in this embodiment is the adjustment of the shape of the picture corresponding to the frame data. In the process of adjusting the shape of the picture to be compared, the picture of the picture to be compared will undergo some deformation correspondingly, some parts of the picture will be compressed, and some parts will be Stretching.

Optionally, after comparing the four boundary lengths and the four corner angles of the to-be-compared pattern and the reference pattern, the comparison of the four boundary length differences is less than a first preset value, or the four corner angles. When the difference is smaller than the second preset value, determining the picture corresponding to the frame data of the to-be-compared graphic does not need to be adjusted in shape.

Optionally, the specified boundary of the graphic to be compared is rotated to be parallel with a boundary corresponding to the specified boundary in the reference graphic, wherein a picture corresponding to the plurality of frame data is rotated synchronously with the graphic to be compared. It is described in the embodiment that the sides or corners of the two figures are the same, but the pattern to be compared may be somewhat inclined, and the pattern to be compared may be rotated at this moment, so that the two figures can be coincident by parallel movement.

Optionally, the geometric center of the graphic to be compared is moved to the same position as the geometric center of the reference graphic, and the image corresponding to the frame data of the graphic to be compared is moved synchronously with the graphic to be compared. The technical solution described in the present embodiment is the simplest adjustment and movement adjustment after the above-described deformation adjustment and rotation adjustment. Applies to the fact that the two graphics are almost identical, but the position of the graphic to be compared is somewhat deviated, and the offset photo can be pulled back to the position of the reference graphic. The above three adjustment methods can be used in combination or in a single use, and the order of use is not limited.

Optionally, before the exposure is periodically performed according to the second exposure time in the preset first exposure time, determining that the sum of the second exposure time is less than the preset first exposure time. If the second exposure is performed multiple times and the time exceeds the first exposure time, the photo is no longer taken, and the new frame data is no longer acquired. The exposure photo ends here.

Optionally, before the adjusting the plurality of frame data according to the preset rule, adjusting a display effect of the picture corresponding to each frame data of the plurality of frame data;

Alternatively, after the pictures of the adjusted plurality of frame data are combined into a picture corresponding to the target frame, the display effect of the picture corresponding to the compositing target frame is adjusted.

The following is a detailed description in conjunction with the embodiments of the present disclosure.

In the embodiment of the present disclosure, by performing the comparison adjustment method in the shooting target area, the picture can be more accurately adjusted to make the taken picture clearer.

In the embodiment of the present disclosure, the following technical solutions may be adopted:

When setting the long exposure photo, the exposure is performed multiple times according to the normal exposure time; each exposure data is used as the picture corresponding to one frame of data; comparing the data information of each frame, the picture corresponding to the multi-frame data is selected for adjustment, and after adjustment, the multi-frame is adjusted. The picture corresponding to the data is combined into a long exposure picture of one frame.

Optionally, when the picture corresponding to the frame data is adjusted, a frame in which the data difference between the other frame data is in the middle may be selected as the reference frame, and the picture corresponding to the other frame data is adjusted according to the reference frame. The technical solution in this embodiment is that the selected reference frame satisfies the following conditions, and other frames can be adjusted to the position of the reference frame by performing small adjustment.

Optionally, when the picture corresponding to the frame data is adjusted, the first one of the plurality of frame data may be selected to have high definition, and the frame data of the reference frame may be used as the reference frame.

Optionally, when comparing picture information of each frame, one or more object areas in the frame data may be selected for comparison. Optionally, when the object area is selected, the object area may refer to the size of the photographing object; if the portrait is large, the corresponding set object area may include a portrait, or the object area may be set to any size.

Alternatively, the selected object area, the area near the focus area, or the area with sharp edges in the photo may be set as the designated object area.

Alternatively, when the picture corresponding to the frame data is adjusted, the adjustment may be completed by partially or integrally shifting or scaling or enlarging or stretching or squeezing. That is, it corresponds to the technical solution of the deformation adjustment in the subsequent embodiment.

Optionally, when the picture corresponding to the frame data is adjusted, the priority may be adjusted according to different weights, and the picture area with a large weight is adjusted.

Optionally, when the object area is selected and the frame data is adjusted, the brightness or contrast of the picture may be increased to facilitate selection of the object area and adjustment of the frame data, and the previous data needs to be restored after the adjustment.

Alternatively, frame data adjustments can be made simultaneously during long exposures.

Alternatively, the frame data whose data difference is too large or unclear may be discarded, and only part of the frame data of the plurality of frame data captured is selected as the adjustment object.

Optionally, when combining the pictures corresponding to the multiple frame data into one frame long exposure picture, the picture edge information may be cropped due to the missing picture edge information caused by the frame data adjustment.

Optionally, the state of the mobile phone can be detected according to a sensor such as a gyroscope or an acceleration, and the adjusted picture can refer to the detected mobile phone movement state. That is, during the shooting process, if the camera moves laterally, the corresponding shooting object is more and more rightward in the position of the photo. Later, when adjusting the frame data, the camera moving state can be referred to, and the image corresponding to the frame data to be adjusted is directed to Move some left to close to the reference frame.

Optionally, the frame data may be processed by an image to synthesize a long exposure image, or the frame data may be used to synthesize the original long exposure data, and then image processing is performed.

Optionally, image processing refers to Image Signal Processor (ISP) or platform processing. The platform processing means that the processor manufacturer such as Qualcomm performs some display effect processing on the picture corresponding to the acquired frame data, for example, definition, white balance, and the like.

3 is a flow chart of a long exposure photographing according to an embodiment of the present disclosure. As shown in FIG. 3, the flow includes the following steps:

Step S301, starting a long exposure function;

Step S302, setting a long exposure time;

Step S303, exposing according to a normal exposure time;

Step S304, reading frame data;

Step S305, determining whether the total exposure time is greater than a set long exposure time;

Step S306, after determining that the total exposure time is greater than the set long exposure time, completing the exposure data synthesis;

Step S307, picture effect processing

Step S308, long exposure picture output.

The steps of adjusting the frame data and synthesizing the target frame are performed correspondingly in performing the above steps.

The process corresponding to each step in Figure 3 is as follows:

Step S302, setting an exposure time

When the user performs long exposure shooting, the long exposure time (corresponding to the first exposure time in the above embodiment) is first set. Since the long exposure time is the sum of all exposure times (corresponding to the sum of the second exposure times in the above embodiment), there is an intermittent time between frame exposures, and in addition, frame synthesis and picture processing take time. So the shooting process will be slightly larger than the set long exposure time.

In order to make the brightness of the last long exposure picture reasonable, the exposure gain value can be calculated according to the set long exposure time. In the related art, the longer the long exposure time, the lower the gain value, the smaller the noise, and the better the picture quality. Based on the picture effect and user experience, the user sets the long exposure time range to 1/4 s-4s.

Step S303, according to the normal exposure time exposure (corresponding to the multiple exposure in the above embodiment, or the second exposure time), the current low-light scene exposure time of the mobile phone is generally set between 1/10s-1/20s, when the exposure time At 1/10s, the picture is easily blurred. In this embodiment, the frame exposure time is set to 1/20 s, and the image blur caused by hand shake is minimized.

Step S304, reading frame data

Read a plurality of frame data, save separately for subsequent adjustment and synthesis, determine whether the total exposure time is greater than the set long exposure time, and determine the mode, multiply the frame exposure by the current total number of frames as the total exposure time, and set the length Exposure time comparison, if the total exposure time is less than the set long exposure time, the frame exposure is continued; if the total exposure time is greater than or equal to the set long exposure time, the exposure is completed. Carry out the next steps.

Step S307, picture effect processing

The effect of the synthesized long exposure image processing, such as ISP processing, platform processing. In addition, since the frame adjustment may cause the edge of the frame data portion to be missing, the affected edge is cropped.

The following describes how to adjust the frame data.

Selecting a reference frame and selecting an object area with a clear boundary in one or more reference frames as an adjusted reference point (corresponding to the specified target area in the above embodiment); when adjusting other frame data, selecting other frame data and the reference frame The area corresponding to the reference point in the middle is used as the adjustment reference area, and the frame data is translated, Stretch, scale, deform, twist, etc., so that the adjustment reference area is aligned with the reference point.

4 is a flow chart of selecting a reference frame and a reference point in accordance with an embodiment of the present disclosure, as described in FIG. 4, including the following steps:

Step S401, sequentially detecting frame image image sharpness;

Step S402, whether the frame data sharpness is greater than a set threshold;

Step S403, in the case that it is determined that the frame data sharpness is greater than a set threshold, the frame is selected as a reference frame for other frame adjustment;

Step S404, detecting an object area with a clear boundary in the reference frame;

Step S405, the object area is selected as an adjustment base point.

Each step in FIG. 4 will be described in detail below.

Step S401, sequentially detecting frame image image clarity:

Judging the picture sharpness in a well-known manner, checking the value of the Focus Value (FV). Starting from the first frame, if the FV value is less than the set threshold, the frame is discarded, and the next frame is continuously checked; if the FV value is greater than or equal to the set threshold, the frame is used as the reference frame.

Step S404, detecting an object area with a clear boundary in the reference frame:

Divide the frame data into m*n pixel groups, compare the pixel group color value (RGB) or brightness (Y) value, and the boundary between the adjacent or similar pixel group color value (RGB) or brightness (Y) value is the boundary. Clear, such that a continuous group of pixels is considered to be a clear boundary area when it is larger than a certain number of sets.

Step S405, selecting the object area as an adjustment base point

When you choose to adjust the base point, the clearer the edge, the higher the priority. In this embodiment, five reference point area adjustments are selected, and a clear boundary area of the vicinity of one picture center and four picture corner attachments is selected as the reference point area. FIG. 5 is a schematic diagram of a reference point selection of a reference frame according to an embodiment of the present disclosure. As shown in FIG. 5, ABCDE is a selected five boundary clear objects. (Boundary objects are represented by geometry).

6 is a schematic diagram of selection of reference points in other frame data according to an embodiment of the present disclosure. As shown in FIG. 6, the dotted rectangular areas Za, Zb, Zc, Zd, and Ze are respectively corresponding reference point areas.

After selecting the reference points in the above reference frame and other frame data, the corresponding adjustment method is as follows. There are deformation adjustment, rotation adjustment, movement adjustment:

It is assumed that the reference point regions Za, Zb, Zc, Zd, and Ze in the other frame data correspond to the reference points in the reference frame as Ca, Cb, Cc, Cd, and Ce, respectively.

Deformation adjustment

The coordinate system is established by the horizontal direction of the frame image as the X axis and the vertical direction being the Y axis, and the lower left fixed point being the far point O.

The lengths in the images of the four line segments CbCc, CcCd, CdCe, and CeCb in the reference frame image and the slopes K1, K2, K3, and K4 in the above coordinate system are calculated. FIG. 7 is a first schematic diagram of the connection of reference points of a reference frame according to an embodiment of the present disclosure. As shown in FIG. 7, K1, K2, K3, and K4 are shown.

FIG. 8 is a schematic diagram 2 of connection of reference points of a reference frame according to an embodiment of the present disclosure. As shown in FIG. 8 , the angles of four line segments of CbCc, CcCd, CdCe, and CeCb are respectively shown as θ1, θ2, θ3, and θ4.

The angle between the four segments in Figure 8 is calculated:

Θ1=180°-arctgK1+arctgK4;

Θ2=arctgK1-arctgK2;

Θ3=180°-arctgK3+arctgK2;

Θ4=arctgK3-arctgK4.

Similarly, the length in the image of the four line segments Cb'Cc', Cc'Cd', Cd'Ce', CeCb' of the corresponding reference point region in the frame image and the slope K1' in the above coordinate system are calculated. K2', K3', K4'. And four corner segments θ1', θ2', θ3', θ4' of Cb'Cc', Cc'Cd', Cd'Ce', and CeCb'.

After obtaining the above boundaries and angles, the CbCc and Cb'Cc', CcCd and Cc'Cd' and Cd'Ce', CdCe, CeCb and CeCb', CbCd and Cb'Cd', CcCe and Cc'Ce are compared in length, If the length difference is less than a certain threshold, and the difference between θ1 and θ1', θ2, and θ2' is less than a certain threshold, it indicates that the adjustment frame is substantially free from deformation compared with the reference frame, and deformation adjustment is not required.

If the length difference corresponding to a certain boundary is greater than a certain threshold or θ1 and θ1', θ2, and θ2' differ by more than a certain threshold, the deformation adjustment is performed. A certain threshold is preset, which is equivalent to the first preset value and the second preset value in the foregoing embodiment.

In the case where it is determined that adjustment is to be made, it is detected that the positions of the frame reference point region centers Ca', Cb', Cc', Cd', Ce' in the above coordinate system and the reference frame reference point region centers Ca, Cb, Cc are adjusted. , Cd, Ce Position in the above coordinate system; find the center of the reference point area where the adjustment frame (ie other frame) reference point area center and the reference frame reference point area center deviation are the smallest in the reference frame reference point near the four corners; assumed to be Cb' .

Then, Cb, Cd, and Ce are fixed points, Cc is the adjustment point, and the frame image is adjusted by using the deformation adjustment, and K1 is kept unchanged, so that CbCc and Cb'Cc' are equal.

The image deformation algorithm can adopt an algorithm such as a deformation algorithm in photoshop.

Next, Cb, Cc, and Cd are fixed points, Ce is an adjustment point, and the frame image is adjusted by using the deformation adjustment so that CbCe and Cb'Ce' are equal and θ1 and θ1' are equal.

Finally, Cb, Cc, and Ce are fixed points, Cd is the adjustment point, and the frame image is adjusted by using the deformation adjustment so that CcCd and Cc'Cd' are equal and θ2 and θ2' are equal.

If the center of the reference point region where the center deviation of the frame reference point region and the center of the reference frame reference point region are minimized in the reference frame reference point near the four corners is Cc', Cd', and Ce', the above adjustment method is similar.

2. Rotate adjustment

The reference point region center Cb' in which the center of the frame reference point region and the center of the reference frame reference point region are minimized in the reference frame reference point near the four corners of the above-mentioned deformation adjustment is the picture rotation adjustment center, and the entire frame image is adjusted by rotation. K1=K1'.

If the center of the reference point region where the center deviation of the center of the frame reference point region and the center of the reference frame reference point is minimized in the reference frame reference point near the four corners is Cc', Cd', and Ce', the corresponding Cc' or Cd', Ce 'Turn the adjustment center for the picture so that K2=K2' or K3=K3', K4=K4'.

3. Mobile adjustment

To move left and right or up and down, the frame image needs to be adjusted so that the center point Ca' of the reference point area near the center in the adjustment frame and Ca' in the reference frame are in the above coordinate system.

Finally, documenting the synthesis of multiple frame data into the target frame

The target frame is used to store the composite picture, the target frame is the initial value of the reference frame, and the adjusted frame data is added according to the corresponding pixel data.

The method steps in the above embodiments can be applied to the following scenarios

The user selects the long exposure mode to take a photo, sets the long exposure time, performs shooting, and the shooting is completed and automatically Store long exposure images.

FIG. 9 is a flowchart of another method for performing long exposure photographing according to an embodiment of the present disclosure. As shown in FIG. 9 , the method flow is similar to the method flow in FIG. 3 , and the flow includes the following steps:

Step S901, starting a long exposure function;

Step S902, setting a long exposure time;

Step S903, exposing according to a normal exposure time;

Step S904, reading frame data;

Step S905, determining whether the total exposure time is greater than the set long exposure time;

Step S906, after determining that the total exposure time is greater than the set long exposure time, completing the exposure data synthesis;

In step S907, the long exposure picture is output.

Compared with the flow in FIG. 3, the difference is that in FIG. 9, the frame data (picture) is processed partially or completely, and then the data is adjusted and synthesized. With the above scheme, it takes a longer time than the flow in Fig. 3, but it is more accurate in distinguishing between sharpness and clear boundary.

The technical solution in the embodiments of the present disclosure can greatly improve the photographing quality of the mobile phone in low-light scenes such as night scenes, and improve the competitiveness of the mobile phone.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the foregoing embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on such understanding, the technical solution of the present disclosure, which is essential or contributes to the related art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The instructions include a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present disclosure.

Example 2

In the embodiment, a long-exposure photographing device is also provided, which can be applied to a photographing device, and the device is configured to implement the above-mentioned embodiments and implementation manners, and the detailed description thereof has been omitted. As below As used, the term "module" can implement a combination of software and/or hardware for a predetermined function. Although the devices described in the following embodiments may be implemented by software, hardware, or a combination of software and hardware, is also possible and conceivable.

FIG. 10 is a structural block diagram of a long exposure photographing apparatus according to an embodiment of the present disclosure. As shown in FIG. 10, the apparatus includes:

The obtaining module 1002 is configured to perform multiple exposures in a preset first exposure time to acquire a plurality of frame data corresponding to the multiple exposures, wherein data corresponding to each exposure is used as the multiple frames One frame of data in the data;

The adjustment module 1004 is connected to the acquisition module 1002 and configured to adjust the plurality of frame data according to a preset rule, and synthesize the adjusted image of the plurality of frame data into a picture corresponding to the target frame, and output the picture.

Optionally, the obtaining module 1002 is further configured to periodically perform exposure according to a second exposure time within a preset first exposure time, wherein the first exposure time is greater than the second exposure time.

Optionally, the adjusting module 1004 is further configured to: select, as the reference frame data, the first frame data in which the centralized value FV value of the plurality of frame data is greater than a preset value; and adjust the according to the reference frame data. Multiple frame data.

Optionally, the adjusting module 1004 is further configured to: select a specified object area in a picture corresponding to the reference frame data, and adjust the picture of the picture corresponding to the multiple frame data according to the specified object area. Specify the object area.

Optionally, the adjustment module 1004 is further configured as one of the following situations:

And selecting an area within a predetermined range around the focus area of the picture corresponding to the reference frame data as the designated object area;

And dividing the picture corresponding to the reference frame data into M*N pixel groups, and determining, in a case where a difference between a color value of the first pixel group and a color value of the surrounding pixel group is greater than a preset value, determining the first The pixel group is a clear pixel group, or, in a case where a difference between a luminance value of the first pixel group and a luminance value of the surrounding pixel group is greater than a preset value, determining that the first pixel group is a clear pixel group,

In a case where a plurality of the clear pixel groups exist in a designated area of the picture, it is determined that the designated area is the designated object area.

Optionally, the adjusting module 1004 is further configured to select four the specified object areas respectively within a predetermined range around four corners of the picture corresponding to the reference frame, and connect the centers of the four specified object areas Forming a reference pattern, wherein a picture center of the reference frame is a center of the reference pattern; and a plurality of to-be-compared patterns corresponding to the reference pattern are acquired in the plurality of frame data according to the reference pattern;

The adjustment module 1004 is further configured to adjust the graphic to be compared until the graphic to be compared coincides with the reference graphic.

Optionally, the adjusting module 1004 is further configured to compare four boundary lengths and four corner angles of the graphic to be compared and the reference graphic, wherein in the four boundaries and the four corners In a case where the at least one boundary length difference is greater than the first preset value or the corner angle difference is greater than the second preset value, the shape to be compared is adjusted according to the reference pattern.

Optionally, the adjustment module 1004 is further configured to rotate a specified boundary of the graphic to be compared to be parallel to a boundary corresponding to the specified boundary in the reference graphic, wherein the plurality of frame data correspond to The picture is rotated in synchronization with the graphic to be compared.

Optionally, the adjusting module 1004 is further configured to move a geometric center of the graphic to be compared to a same position as a geometric center of the reference graphic, wherein a picture and a corresponding image of the frame data of the graphic to be compared Tells the comparison graph to move synchronously.

Optionally, the acquiring module 1002 is further configured to: before adjusting the plurality of frame data according to the preset rule, adjust a display effect of the picture corresponding to each frame data of the multiple frame data;

Alternatively, the adjustment module 1004 is further configured to adjust a display effect of the picture corresponding to the compositing target frame after synthesizing the pictures of the adjusted plurality of frame data into the picture corresponding to the target frame.

The above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the above modules are all located in the same processor; or, the above modules are respectively located in different combinations. In the processor.

Example 3

Embodiments of the present disclosure also provide a storage medium. For example, a computer readable storage medium storing computer executable instructions arranged to perform the method of any of the above embodiments. The computer readable storage medium may be a transitory computer readable storage medium, or A non-transitory computer readable storage medium. Optionally, in the embodiment, the foregoing storage medium may be configured to store program code for performing the following steps:

S1, performing multiple exposures in a preset first exposure time, acquiring a plurality of frame data corresponding to the multiple exposures, wherein data corresponding to each exposure is used as one frame of the plurality of frame data data;

S2: The plurality of frame data is adjusted according to a preset rule, and the adjusted picture of the plurality of frame data is combined with the picture corresponding to the target frame, and the picture is output.

Optionally, in this embodiment, the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory. A variety of media that can store program code, such as a disc or a disc.

Optionally, in this embodiment, the processor performs the method steps in the foregoing embodiments according to the stored program code in the storage medium.

For example, the examples in this embodiment may refer to the examples described in the foregoing embodiments and the optional embodiments, and details are not described herein again.

It will be apparent to those skilled in the art that the various modules or steps of the present disclosure described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. As such, the disclosure is not limited to any specific combination of hardware and software.

The above description is only for the embodiments of the present disclosure, and is not intended to limit the disclosure, and various changes and modifications may be made to the present disclosure. Any modifications, equivalent substitutions, improvements, etc., made within the scope of the present disclosure are intended to be included within the scope of the present disclosure.

Industrial applicability

The long exposure photographing method and device provided by the application effectively solve the problem that the long exposure photograph in the related art directly obtains a blurred photograph, that is, the blur of the photograph taken under the long exposure, so that the long exposure The photos taken are clearer.

Claims

A long exposure photographing method comprising:

And performing multiple exposures in a preset first exposure time to obtain a plurality of frame data corresponding to the multiple exposures, wherein data corresponding to each exposure is used as one frame data of the plurality of frame data;

The plurality of frame data is adjusted according to a preset rule, and the adjusted picture of the plurality of frame data is combined with the picture corresponding to the target frame, and the picture is output.
The method of claim 1 wherein performing multiple exposures within a predetermined first exposure time comprises:

The exposure is periodically performed according to the second exposure time within a preset first exposure time, wherein the first exposure time is greater than the second exposure time.
The method according to claim 2, wherein, before the exposure is periodically performed according to the second exposure time within the preset first exposure time, determining that the sum of the second exposure times is smaller than the preset first Exposure time.
The method of claim 1, wherein the adjusting the plurality of frame data according to a preset rule comprises:

And selecting, as the reference frame data, frame data in which the concentrated value FV value of the plurality of frame data is greater than a preset value;

Adjusting the plurality of frame data according to the reference frame data.
The method of claim 4, wherein the adjusting the plurality of frame data according to the reference frame data comprises:

Selecting a specified object area in the picture corresponding to the reference frame data, and adjusting a picture corresponding to the plurality of frame data according to the specified object area.
The method according to claim 5, wherein the selecting the specified object area in the picture corresponding to the reference frame data comprises:

The specified object area is selected within a predetermined range around the focus frame area of the reference frame data.
The method according to claim 5, wherein the selecting the specified object area in the picture corresponding to the reference frame data comprises:

And dividing the picture corresponding to the reference frame data into M*N pixel groups, and determining, in a case where a difference between a color value of the first pixel group and a color value of the surrounding pixel group is greater than a preset value, determining the first pixel The group is a clear pixel group, or, in a case where a difference between a luminance value of the first pixel group and a luminance value of the surrounding pixel group is greater than a preset value, determining that the first pixel group is a clear pixel group, wherein the M and N are natural numbers;

In a case where the picture has a designated area including a plurality of consecutive clear pixel groups, the designated area is determined to be the specified object area.
The method according to claim 7, wherein the adjusting the picture corresponding to the plurality of frame data according to the specified object area comprises:

Selecting four specified object areas in a predetermined range around four corners of the picture corresponding to the reference frame, and connecting the centers of the four specified object areas to form a reference pattern, according to the reference pattern Obtaining a plurality of graphics to be compared corresponding to the reference graphics in the frame data;

The graphics to be compared are adjusted until the graphics to be compared corresponding to the plurality of frames overlap with the reference graphics, wherein the image corresponding to the frame data of the graphics to be compared moves synchronously with the graphics to be compared.
The method of claim 8 wherein adjusting the graphics to be compared comprises:

Comparing the four boundary lengths or four corner angles of the graphic to be compared with the reference graphic, And in the case that the at least one boundary length difference of the four boundaries or the four corners is greater than a first preset value or the corner angle difference is greater than a second preset value, according to the reference pattern The comparison graph is described to adjust the shape.
The method according to claim 9, wherein after comparing the four boundary lengths or the four corner angles of the graphic to be compared with the reference graphic, the method further comprises:

Determining, corresponding to the frame data of the graphic to be compared, in the case that the compared four boundary length differences are smaller than the first preset value, or the four corner angle differences are smaller than the second preset value The image does not need to be adjusted in shape.
The method of claim 8 wherein adjusting the graphics to be compared comprises:

Rotating a specified boundary of the graphic to be compared to a boundary corresponding to the specified boundary in the reference graphic, wherein a picture corresponding to the plurality of frame data is rotated synchronously with the graphic to be compared.
The method of claim 8 wherein adjusting the graphics to be compared comprises:

Moving the geometric center of the graphic to be compared to the same position as the geometric center of the reference graphic, wherein the picture corresponding to the frame data of the graphic to be compared moves synchronously with the graphic to be compared.
The method according to claim 1, wherein the display effect of the corresponding picture of each of the plurality of frame data is adjusted before the plurality of frame data is adjusted according to the preset rule;

Alternatively, after the pictures of the adjusted plurality of frame data are combined into a picture corresponding to the target frame, the display effect of the picture corresponding to the compositing target frame is adjusted.
A long exposure photographing device applied to a photographing device, comprising:

The acquiring module is configured to perform multiple exposures in a preset first exposure time to acquire a plurality of frame data corresponding to the multiple exposures, wherein data corresponding to each exposure is used as the plurality of frame data One frame of data;

The adjustment module is configured to adjust the plurality of frame data according to a preset rule, and synthesize the image of the adjusted plurality of frame data into a picture corresponding to the target frame, and output the picture.
The apparatus according to claim 14, wherein the acquisition module is further configured to periodically perform exposure according to a second exposure time within a preset first exposure time, wherein the first exposure time is greater than the first Two exposure times.
The apparatus according to claim 14, wherein the sum of the second exposure times is determined to be smaller than the preset first before the exposure is periodically performed according to the second exposure time within the preset first exposure time Exposure time.
The apparatus according to claim 14, wherein the adjustment module is further configured to select, as the reference frame data, the first frame data of the plurality of frame data whose concentration value FV value is greater than a preset value; The reference frame data adjusts the plurality of frame data.
The apparatus according to claim 17, wherein the adjustment module is further configured to select a specified object area in a picture corresponding to the reference frame data, and adjust the plurality of frame data according to the specified object area. The specified object area of the corresponding picture.
A computer readable storage medium storing computer executable instructions arranged to perform the method of any of claims 1-13.