WO2016169488A1

WO2016169488A1 - Image processing method and apparatus, computer storage medium and terminal

Info

Publication number: WO2016169488A1
Application number: PCT/CN2016/079840
Authority: WO
Inventors: 裴珺
Original assignee: 努比亚技术有限公司
Priority date: 2015-04-22
Filing date: 2016-04-21
Publication date: 2016-10-27
Also published as: CN104869307B; CN104869307A

Abstract

An image processing method and apparatus, a computer storage medium and a terminal. The method comprises: presetting an alternate exposure time for photosensitive devices, wherein there are at least two or more photosensitive devices; switching the plurality of photosensitive devices according to the preset alternate exposure time, and each photosensitive device collecting images in sequence according to the alternate exposure time; and synthesizing the images collected by the plurality of photosensitive devices.

Description

Image processing method, device, computer storage medium and terminal

Technical field

The present invention relates to the field of information technology, and in particular, to a method and apparatus for processing a captured image, a computer storage medium, and a terminal.

Background technique

When using multiple compositing techniques to shoot long-term motion trajectories, you need to take a group of tens, hundreds, or even thousands of photos, and then post-software processing, photo overlay, and generate complete motion trajectory maps, such as star tracks. In the actual shooting process, when shooting multiple images, a long time interval will occur between the two photos. In the process of post-synthesis, there will be a problem that the motion trajectory is discontinuous. The longer the time interval, the more serious the trajectory discontinuity problem. At the same time, due to the long-time shooting motion trajectory, the photosensitive device works for a long time, and the temperature of the device rises, which leads to an increase in thermal noise and affects the picture quality.

Summary of the invention

Embodiments of the present invention are directed to provide an image processing method, apparatus, computer storage medium, and terminal that at least partially solve the problem of poor motion photographic shooting.

The embodiment of the invention provides a method for processing a beat image, comprising:

Presetting the exposure time of the photosensitive device, the number of the photosensitive devices being two or more;

And switching the plurality of photosensitive devices according to the preset alternate exposure time, and each of the photosensitive devices sequentially performs image acquisition according to the alternating exposure time;

The images acquired by the plurality of photosensitive devices are synthesized.

Optionally, the alternate exposure time of the preset photosensitive device includes:

The plurality of photosensitive device alternate exposure times S are set according to the photosensitive time s and the reading time t of the photosensitive device.

Optionally, the plurality of photosensitive devices are switched according to the preset exposure time, and each of the photosensitive devices sequentially performs image collection according to the alternating exposure time, and further includes:

The plurality of photosensitive devices are alternately exposed by rotating the plane mirror in the image pickup element by a mechanical rotating shaft.

Optionally, the synthesizing the images collected by the plurality of photosensitive devices comprises:

After the shooting is completed, the images collected by the plurality of photosensitive devices are image-combined according to the brightness information thereof to generate a composite image;

Alternatively, the images acquired by the plurality of photosensitive devices are continuously read, real-time image synthesis is performed according to the brightness information thereof, and the synthesized images are displayed in real time.

Optionally, when the number of the plurality of photosensitive devices is two, the alternate exposure time S of the plurality of photosensitive devices is set according to the photosensitive time s and the reading time t of the photosensitive device, including:

When the two photosensitive devices are identical photosensitive devices, the time for alternately exposing the two photosensitive devices is S, then t<S<s;

When the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, the reading time is t2, and the two are preset. The time when the photosensitive device is alternately exposed is S; when s1 < s2, t1 < t2, then t2 < S < s1; when s1 < s2, t1 > t2, then t1 < S < s1;

When the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, and the reading time is t2; wherein, s1<s2 The time during which the two photosensitive devices are alternately exposed is different. The exposure time of the first photosensitive device is S1, then t2<S1<s1; the exposure time of the second photosensitive device is S2, then t2<S2<s2.

Optionally, the photosensitive device comprises a first photosensitive device and a second photosensitive device;

The rotating the mirror in the image pickup device by the mechanical rotating shaft to alternately expose the plurality of photosensitive devices, including:

When the first photosensitive device performs image acquisition, rotating the plane mirror to reflect light onto the first photosensitive device, the first photosensitive device starts to expose the captured image information, and the second photosensitive device is in an inoperative state;

When the exposure time of the first photosensitive device is about to end, the plane mirror is rotated to reflect light onto the second photosensitive device, and the second photosensitive device starts to expose image information, and the first photosensitive device is not working. status.

The N-1th image is combined with the currently acquired image as the Nth image; wherein N is an integer not less than 2.

Determining an initial base image; wherein the initial base image may be a terminal loaded image or a first captured image.

An embodiment of the present invention further provides an image processing apparatus including an image pickup element, a plane mirror, a microcomputer, an image processor, and a mechanical rotating shaft, wherein:

The imaging element includes a plurality of photosensitive devices configured to receive light for photoelectric conversion;

a microcomputer, configured to preset an alternate exposure time of the plurality of photosensitive devices;

a plane mirror configured to reflect light to the imaging element;

a mechanical shaft configured to rotate the plane mirror;

The image processor is further configured to synthesize images acquired by the plurality of photosensitive devices.

Optionally, the microcomputer is further configured to preset alternate exposure times of the photosensitive device, including:

Optionally, the mechanical rotating shaft is configured as the rotating plane mirror, and includes:

The plane mirror is rotated according to the preset exposure time of the microcomputer, so that the direction of the light is changed and reflected onto the image pickup element, so that the plurality of photosensitive devices are alternately exposed.

Optionally, the image sensing device is further configured to synthesize images collected by the plurality of photosensitive devices, including:

After the shooting is completed, images collected by the plurality of photosensitive devices are image-combined according to the brightness information thereof to generate a composite image;

Optionally, the microcomputer is configured to perform at least one of the following:

The mechanical rotating shaft is configured to rotate the plane mirror to reflect light onto the first photosensitive device when the first photosensitive device performs image acquisition, the first photosensitive device starts to expose image information, and the second photosensitive device In an inoperative state; when the exposure time of the first photosensitive device is about to end, rotating the plane mirror to reflect light onto the second photosensitive device, the second photosensitive device starts to expose image information, the first The sensor is not working.

Optionally, the image processor is configured to combine the N-1th image as a base image and the currently acquired image into an Nth image; wherein the N is an integer not less than 2.

Optionally, the image processor is configured to determine an initial base image; wherein the initial base image may be a terminal loaded image or a first captured image.

A third aspect of the embodiments of the present invention further provides a computer storage medium, where the computer storage medium stores computer executable instructions, and the computer executable instructions are used to perform the foregoing image processing.

Optionally, the computer storage medium comprises a non-transitory storage medium.

The embodiment of the invention further provides a terminal, comprising: the image processing device according to any of the above items.

Optionally, the terminal is a mobile terminal.

An image processing method and device, a computer storage medium and a terminal provided by an embodiment of the present invention, by setting a plurality of photosensitive devices to work in a time-sharing manner, a plurality of photosensitive devices are alternately exposed, and no omission of optical information occurs, thereby realizing information not Intermittent acquisition can effectively eliminate the gap between the motion trajectories. At the same time, multiple photosensitive devices work in a time-sharing manner, effectively reducing the thermal noise of the photosensitive device, improving the picture quality and improving the user experience.

DRAWINGS

1 is a schematic block diagram of a terminal according to an embodiment of the present invention;

2 is a schematic block diagram of a first embodiment of an image capturing apparatus according to an embodiment of the present invention;

3 is a schematic diagram showing alternating exposure of the photosensitive device according to the first embodiment of the image capturing apparatus of the embodiment of the present invention;

4 is a schematic view showing the working state of the first embodiment of the photographing apparatus according to the embodiment of the present invention;

FIG. 5 is a flowchart of a first embodiment of an image processing method according to an embodiment of the present invention.

detailed description

The preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.

A schematic block diagram of a physical structure of a terminal 1100 is provided in the embodiment of the present invention. As shown in FIG. 1 , the terminal 1100 includes:

1 is a block diagram showing a main electrical configuration of a camera according to an embodiment of the present invention. Photographic lens The 101 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens or a zoom lens. The photographic lens 101 can be moved in the optical axis direction by the lens driving unit 111, and controls the focus position of the taking lens 101 based on the control signal from the lens driving control unit 112, and also controls the focus distance in the case of the zoom lens. The lens drive control circuit 112 performs drive control of the lens drive unit 111 in accordance with a control command from the microcomputer 107.

An imaging element 102 is disposed in the vicinity of a position where the subject image is formed by the photographing lens 101 on the optical axis of the photographing lens 101. The imaging element 102 functions as an imaging unit that captures a subject image and acquires captured image data. Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the imaging element 102. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode. The front surface of each pixel is provided with a Bayer array of RGB color filters.

The imaging element 102 is connected to an imaging circuit 103 that performs charge accumulation control and image signal readout control in the imaging element 102, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level. The imaging circuit 103 is connected to the A/D conversion unit 104, which performs analog-to-digital conversion on the analog image signal, and outputs a digital image signal (hereinafter referred to as image data) to the bus 199.

The bus 199 is a transmission path for transmitting various data read or generated inside the camera. The A/D conversion unit 104 is connected to the bus 199, and an image processor 105, a JPEG processor 106, a microcomputer 107, a SDRAM (Synchronous DRAM) 108, and a memory interface (hereinafter referred to as a memory I/F) are connected. 109. LCD (Liquid Crystal Display) driver 110.

The image processor 105 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 102. deal with. When the image data is recorded on the recording medium 115, the JPEG processor 106 compresses the image data read out from the SDRAM 108 in accordance with the JPEG compression method. Further, the JPEG processor 106 performs decompression of JPEG image data for image reproduction display. Decompress At this time, the file recorded in the recording medium 115 is read, and after the compression processing is performed in the JPEG processor 106, the decompressed image data is temporarily stored in the SDRAM 108 and displayed on the LCD 116. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.

The microcomputer 107 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 107 is connected to the operation unit 113 and the flash memory 114.

The operation unit 113 includes but is not limited to a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, and an enlarge button. The operation members such as various input buttons and various input keys are detected, and the operation states of these operation members are detected.

The detection result is output to the microcomputer 107. Further, a touch panel is provided on the front surface of the LCD 116 as a display portion, and the touch position of the user is detected, and the touch position is output to the microcomputer 107. The microcomputer 107 executes various processing sequences corresponding to the operation of the user based on the detection result of the operation member from the operation unit 113. (Similarly, this place can be changed to the computer 107 to execute various processing sequences corresponding to the user's operation based on the detection result of the touch panel on the front of the LCD 116.)

The flash memory 114 stores programs for executing various processing sequences of the microcomputer 107. The microcomputer 107 performs overall control of the camera in accordance with the program. Further, the flash memory 114 stores various adjustment values of the camera, and the microcomputer 107 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value. The SDRAM 108 is an electrically rewritable volatile memory for temporarily storing image data or the like. The SDRAM 108 temporarily stores image data output from the A/D conversion unit 104 and image data processed in the image processor 105, the JPEG processor 106, and the like.

The memory interface 109 is connected to the recording medium 115, and performs control for writing image data and a file header attached to the image data to the recording medium 115 and reading from the recording medium 115. The recording medium 115 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body, but is not limited thereto. It is a hard disk built in the main body of the camera.

The LCD driver 110 is connected to the LCD 116, and stores image data processed by the image processor 105 in the SDRAM. When display is required, the image data stored in the SDRAM is read and displayed on the LCD 116, or the image data stored in the JPEG processor 106 is compressed. In the SDRAM, when display is required, the JPEG processor 106 reads the compressed image data of the SDRAM, decompresses it, and displays the decompressed image data on the LCD 116.

The LCD 116 is disposed on the back surface of the camera body or the like to perform image display. The LCD 116 is provided with a touch panel that detects a user's touch operation. Further, in the present embodiment, the liquid crystal display panel (LCD 116) is disposed as the display portion. However, the present invention is not limited thereto, and various display panels such as an organic EL may be employed.

Referring to Fig. 2, a second embodiment of the photographing apparatus of the present invention is proposed. This embodiment modifies the image pickup element 102' based on the first embodiment, and the plane mirror 117 and the mechanical rotary shaft 118 are added.

The image pickup element 102' is configured to receive light in a time division for photoelectric conversion, and the image pickup element includes two or more light sensing devices.

The imaging element may be a CMOS (Complementary Metal Oxide Semiconductor), a CCD (Charge Coupled Device), or the like.

For example, when a CMOS sensor is in operation, it needs to be reset before sampling. Under the illumination, the diode first converts the optical signal into an electrical signal, and then the original image data can be obtained by reading the voltage value, sampling, encoding, and converting the electrical signal into a digital signal. It can be known from the working principle of CMOS that CMOS needs to repeat the process of resetting, sensitizing and reading electrical signals. When resetting and reading electrical signals, CMOS can no longer receive light, which causes continuous synthesis when shooting motion pictures. Continuous, especially when shooting motion tracks such as the star track, there is a problem of disconnection. Similarly, the CCD device also has this problem in capturing synthetic motion trajectories.

Further, the microcomputer 107 is further configured to preset alternate exposure times of the plurality of photosensitive devices.

Taking the image pickup element 102' including two photosensitive devices as an example:

As shown in FIG. 3, two photosensitive devices are used to receive light in a time-sharing manner, that is, time-division exposure. Adoption A photosensitive device and a second photosensitive device perform time-division exposure. Different photosensitive devices have different photographic properties due to their different processes, so the maximum sensitization time supported may be different. Similarly, different cameras have different times for reading sensitized data due to different processes. Assuming that the photosensitive device performs photoelectric conversion, the maximum time for sensitization is s; the time for reading the charge is t; and for the time-sensitive sensitization, the exposure time of a single photosensitive device is S, then t<S<s.

Optionally, when the two photosensitive devices are identical photosensitive devices, the time for alternately exposing the two photosensitive devices is S, then t<S<s;

Optionally, when the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, and the reading time is t2, and the preset time is The time when the two photosensitive devices are alternately exposed is S; when s1 < s2, t1 < t2, then t2 < S < s1; when s1 < s2, t1 > t2, then t1 < S < s1;

Optionally, when the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, and the reading time is t2; wherein, s1 <s2, pre-exposure time of the two photosensitive devices is different, the exposure time of the first photosensitive device is S1, then t2<S1<s1; the exposure time of the second photosensitive device is S2, then t2<S2< S2.

The plane mirror 117 is configured to reflect the light received by the photographic lens 101 to a plurality of photosensitive devices.

The mechanical rotating shaft 118 is configured to rotate the plane mirror 117 according to the exposure time preset by the microcomputer 107, so that the direction of the light is changed and reflected onto the image pickup element, so that the plurality of photosensitive members are alternately exposed.

When the first photosensitive device performs image acquisition, the plane mirror 117 is rotated to the position shown in FIG. The light is reflected onto the first photosensitive device, and the first photosensitive device starts to be exposed to acquire image information. The second photosensitive device is in an inoperative state.

When the exposure time of the first photosensitive device is about to end, the second photosensitive device is turned on.

When the first photosensitive device exposure time is over, the mirror is immediately rotated to the position shown in FIG. The second photosensitive device starts image acquisition. At the same time, the image processor 105 holds the acquired image of the first photosensitive device, and the microcomputer 107 turns off the first photosensitive device.

When the exposure time of the second photosensitive device is about to end, the first photosensitive device is turned on.

When the second photosensitive device exposure time is over, the plane mirror 117 is immediately rotated to the position shown in FIG. The first photosensitive device starts image acquisition. At the same time, the image processor 105 holds the acquired image of the second photosensitive device, and the microcomputer 107 turns off the second photosensitive device.

The process of alternately exposing the above first photosensitive device and second photosensitive device is repeated until the operation unit 113 receives the termination shooting instruction.

The image processor 105 is further configured to synthesize images collected by the plurality of photosensitive devices.

The A/D converter 104 takes an image acquired by a plurality of photosensitive devices and performs image synthesis. When performing shooting on a star track or the like, the image is synthesized by determining whether the brightness of the pixel in the current image at the same position is greater than the brightness of the pixel in the past image; if so, replacing the pixel in the image past the same position with The pixels in the current image are used for image synthesis. When performing photographing such as lithography, the image is synthesized in such a manner that pixels from the plurality of photosensitive devices are selected, pixels that satisfy the preset condition are selected, and addition is performed on the pixels at the same position. First, determining whether the pixel is a mutant pixel; if it is a mutant pixel, calculating an average value of brightness parameters of a preset number of pixels around the abrupt pixel, and determining whether the average value is greater than a threshold, and if greater than the threshold, determining the The mutated pixel satisfies a preset condition, and the mutated pixel is selected; if it is not a mutated pixel, it is further determined whether the brightness parameter of the pixel is greater than a threshold, and if it is greater than the threshold, determining that the pixel satisfies a preset condition, and selecting the pixel .

Alternatively, the image may be synthesized in RAW format, or the RAW format may be converted to the YUA format and then synthesized. The specific format of image synthesis is not limited here.

Further, after the photographing device completes the photographing, the images collected by the plurality of light-sensing devices are image-combined according to the brightness information to generate a composite image. The images collected by the plurality of photosensitive devices are separately synthesized, and the synthesis manner is the replacement of the pixel brightness values at the same position or the addition of the brightness values of the pixels at the same position. The image data synthesized by each of the plurality of photosensitive devices is further synthesized by synthesizing the image brightness data of the same position of the image data synthesized by the plurality of photosensitive devices, and then dividing by 2, when the composite image is synthesized When a pixel brightness value is greater than 255, the pixel brightness value is set. Is 255.

Optionally, the A/D converter 104 continuously reads the images collected by the plurality of photosensitive devices, performs real-time image synthesis according to the brightness information thereof, and displays the synthesized images in real time.

Further, when synthesizing the first composite image, an initial base image needs to be determined, the mobile terminal may load a picture as an initial base image, or the first image acquired may be used as an initial base image. Usually, when the first image is generated at the beginning of the shooting, no base image is synthesized with the currently acquired image. When the second image is generated, the first image is used as the initial base image, and the currently acquired image is synthesized to generate the second image, and so on, with the N-1th image as the base image and the current image. The acquired images are combined into an Nth image. At the same time, each image synthesized in real time is displayed on the screen, and the user can view his own shooting effect in real time. Before the start of shooting or during shooting, the user can load a picture as a base image at any time for image synthesis. For example, before the start of shooting, the user loads a background image from the local storage as the initial base image. After starting the shooting, the camera will capture the currently acquired image with the current base image (the initial base image, ie loaded) The picture is synthesized into the first composite image, and the composite image is used as a base image for synthesizing the second composite image and displayed in real time.

Alternatively, the image sensing device may combine images acquired by a plurality of photosensitive devices into one photo, may also synthesize video, and may be used for other image processing. The specific use of images acquired by a plurality of photosensitive devices is not limited herein.

In the apparatus for photographing of the embodiment, by setting a plurality of photosensitive devices to work in a time-sharing manner, a plurality of photosensitive devices are alternately exposed, and no omission of optical information occurs, thereby realizing uninterrupted collection of information, and effectively eliminating gaps between motion traces. . At the same time, multiple photosensitive devices work in a time-sharing manner, effectively reducing the thermal noise of the photosensitive device, improving the picture quality and improving the user experience.

In another embodiment, the recording medium 115 is used to store images captured by the imaging element 102, and further, to store images synthesized by the image processor 105.

It should be noted that the photographing apparatus provided in the above embodiment only uses the above functions when performing photographing. The division of the modules is exemplified. In practical applications, the above function assignments can be completed by different functional modules as needed.

The photographing apparatus according to the present embodiment has been described in detail above with reference to FIGS. 1 to 4, and a photographing method according to an embodiment of the present invention will be described in detail below with reference to FIGS. 5 and 6.

S10: preset exposure time of the photosensitive device, the photosensitive device is two, respectively a first photosensitive device and a second photosensitive device;

The photosensitive device may be a CMOS (Complementary Metal Oxide Semiconductor), a CCD (Charge Coupled Device), or the like.

Take the imaging element including two photosensitive devices as an example:

As shown in FIG. 3, two photosensitive devices are used to receive light in a time-sharing manner, that is, time-division exposure. The first photosensitive device and the second photosensitive device are used for time-division exposure. Different photosensitive devices have different photographic properties due to their different processes, so the maximum sensitization time supported may be different. Similarly, different cameras have different times for reading sensitized data due to different processes. Assuming that the photosensitive device performs photoelectric conversion, the maximum time for sensitization is s; the time for reading the charge is t; and for the time-sensitive sensitization, the exposure time of a single photosensitive device is S, then t<S<s.

Optionally, when the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, The reading time is t1, the photosensitive time of the second photosensitive device is s2, the reading time is t2, and the time for alternately exposing the two photosensitive devices is S; when s1<s2, t1<t2, then t2< S<s1; when s1<s2, t1>t2, then t1<S<s1;

S20: switching the first photosensitive device and the second photosensitive device to perform image acquisition according to the preset exposure time;

As shown in FIG. 1, the first photosensitive device and the second photosensitive device are alternately exposed by rotating the plane mirror in the image pickup element by a mechanical rotation axis according to a preset exposure time.

When the first photosensitive device performs image acquisition, the plane mirror is rotated to the position shown in FIG. The light is reflected onto the first photosensitive device, and the first photosensitive device starts to be exposed to acquire image information. The second photosensitive device is in an inoperative state.

When the first photosensitive device exposure time is over, the mirror is immediately rotated to the position shown in the figure. The second photosensitive device starts image acquisition. At the same time, the processor saves the acquired image of the first photosensitive device and turns off the first photosensitive device.

When the second photosensitive device exposure time is over, the mirror is immediately rotated to the position shown in FIG. The first photosensitive device starts image acquisition. At the same time, the processor saves the photo of the second photosensitive device and turns off the second photosensitive device.

The process of alternately exposing the above first photosensitive device and second photosensitive device is repeated until a termination shooting instruction is received.

S30: synthesizing images acquired by the first photosensitive device and the second photosensitive device.

The A/D converter 104 reads an image acquired by a plurality of photosensitive devices, and performs image synthesis in the image processor 105. When performing shooting on a star track or the like, the image is synthesized by determining whether the brightness of the pixel in the current image at the same position is greater than the brightness of the pixel in the past image; if so, replacing the pixel in the image past the same position with The pixels in the current image are used for image synthesis. When performing photographing such as lithography, the image is synthesized in such a manner that pixels from the plurality of photosensitive devices are selected, pixels that satisfy the preset condition are selected, and addition is performed on the pixels at the same position. First, determining whether the pixel is a mutant pixel; if it is a mutant pixel, calculating an average value of brightness parameters of a preset number of pixels around the abrupt pixel, and determining whether the average value is greater than a threshold, and if greater than the threshold, determining the The mutated pixel satisfies a preset condition, and the mutated pixel is selected; if it is not a mutated pixel, it is further determined whether the brightness parameter of the pixel is greater than a threshold, and if it is greater than the threshold, determining that the pixel satisfies a preset condition, and selecting the pixel .

Further, after the photographing device completes the photographing, the images collected by the plurality of light-sensing devices are image-combined according to the brightness information to generate a composite image. The images collected by the plurality of photosensitive devices are separately synthesized, and the synthesis manner is the replacement of the pixel brightness values at the same position or the addition of the brightness values of the pixels at the same position. The image data synthesized by each of the plurality of photosensitive devices is further synthesized by synthesizing the image brightness data of the same position of the image data synthesized by the plurality of photosensitive devices, and then dividing by 2, when the composite image is synthesized When a pixel brightness value is greater than 255, the pixel brightness value is set to 255.

Further, when synthesizing the first composite image, an initial base image needs to be determined, the mobile terminal may load a picture as an initial base image, or the first image acquired may be used as an initial base image. Usually, when the first image is generated at the beginning of the shooting, no base image is synthesized with the currently acquired image. When the second image is generated, the first image is taken as the initial base image, and The currently acquired image is synthesized to generate the second image, and so on, and the N-1th image is used as the base image and the currently acquired image is combined into the Nth image. At the same time, each image synthesized in real time is displayed on the screen, and the user can view his own shooting effect in real time. Before the start of shooting or during shooting, the user can load a picture as a base image at any time for image synthesis. For example, before the start of shooting, the user loads a background image from the local storage as the initial base image. After starting the shooting, the camera will capture the currently acquired image with the current base image (the initial base image, ie loaded) The picture is synthesized into the first composite image, and the composite image is used as a base image for synthesizing the second composite image and displayed in real time.

Therefore, in the photographing method of the embodiment, by setting a plurality of photosensitive devices to work in a time-sharing manner, a plurality of photosensitive devices are alternately exposed, and no omission of optical information occurs, thereby realizing uninterrupted collection of information, which can effectively eliminate motion between tracks. Void. At the same time, multiple photosensitive devices work in a time-sharing manner, effectively reducing the thermal noise of the photosensitive device, improving the picture quality and improving the user experience.

The embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used in the image processing method provided by any one of the foregoing embodiments, for example, as shown in FIG. 5 The method shown. The computer storage medium may be a storage medium such as an optical disk, a magnetic tape, a mobile hard disk, or the like, and may be a non-transitory storage medium.

An embodiment of the present invention further provides a terminal, which may include the image processing apparatus provided by the foregoing claims. Optionally, the terminal in this embodiment may be a mobile terminal, for example, a mobile terminal, a tablet computer or a camera, and the like.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, apparatus (device), or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention may be packaged in one or more of them Computers containing computer usable program code may be in the form of a computer program product embodied on a storage medium, including but not limited to disk storage, CD-ROM, optical storage, and the like.

It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

It is to be understood that the above are only the preferred embodiments of the present invention, and the scope of the invention is not limited thereby, and modifications made in accordance with the principles of the invention are understood to fall within the scope of the invention.

Claims

An image processing method comprising:

Presetting the exposure time of the photosensitive device, the number of the photosensitive devices being two or more;

And switching the plurality of photosensitive devices according to the preset alternate exposure time, and each of the photosensitive devices sequentially performs image acquisition according to the alternating exposure time;

The images acquired by the plurality of photosensitive devices are synthesized.
The method of claim 1 wherein said alternating exposure time of said predetermined photosensitive device comprises:

The plurality of photosensitive device alternate exposure times S are set according to the photosensitive time s and the reading time t of the photosensitive device.
The method according to claim 2, wherein when said number of said plurality of photosensitive devices is two, said plurality of photosensitive devices are disposed according to a photosensitive time s and a reading time t of said photosensitive device Alternate exposure time S, including at least one of the following:

When the two photosensitive devices are identical photosensitive devices, the time for alternately exposing the two photosensitive devices is S, then t<S<s;

When the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, the reading time is t2, and the two are preset. The time when the photosensitive device is alternately exposed is S; when s1 < s2, t1 < t2, then t2 < S < s1; when s1 < s2, t1 > t2, then t1 < S < s1;

When the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, and the reading time is t2; wherein, s1<s2 The time during which the two photosensitive devices are alternately exposed is different. The exposure time of the first photosensitive device is S1, then t2<S1<s1; the exposure time of the second photosensitive device is S2, then t2<S2<s2.
The method of claim 3, wherein the synthesizing the images acquired by the plurality of photosensitive devices comprises:

After the shooting is completed, the images collected by the plurality of photosensitive devices are image-combined according to the brightness information thereof to generate a composite image;

Alternatively, the images acquired by the plurality of photosensitive devices are continuously read, real-time image synthesis is performed according to the brightness information thereof, and the synthesized images are displayed in real time.
The method according to claim 1, wherein said switching said plurality of photosensitive devices according to said preset exposure time, and wherein each photosensitive device sequentially performs image acquisition according to said alternate exposure time, further comprising:

The plurality of photosensitive devices are alternately exposed by rotating the plane mirror in the image pickup element by a mechanical rotating shaft.
The method of claim 1 wherein

The photosensitive device includes a first photosensitive device and a second photosensitive device;

The rotating the mirror in the image pickup device by the mechanical rotating shaft to alternately expose the plurality of photosensitive devices, including:

When the first photosensitive device performs image acquisition, rotating the plane mirror to reflect light onto the first photosensitive device, the first photosensitive device starts to expose the captured image information, and the second photosensitive device is in an inoperative state;

When the exposure time of the first photosensitive device is about to end, the plane mirror is rotated to reflect light onto the second photosensitive device, and the second photosensitive device starts to expose image information, and the first photosensitive device is not working. status.
The method of claim 1 wherein

The synthesizing the images collected by the plurality of photosensitive devices comprises:

The N-1th image is combined with the currently acquired image as the Nth image; wherein N is an integer not less than 2.
The method according to claim 1 or 7, wherein

The synthesizing the images collected by the plurality of photosensitive devices comprises:

Determining an initial base image; wherein the initial base image may be a terminal loaded image or a first captured image.
An image processing apparatus comprising an image pickup element, a plane mirror, a microcomputer, an image processor, and a mechanical rotating shaft, wherein:

The imaging element includes a plurality of photosensitive devices configured to receive light for photoelectric conversion;

a microcomputer, further configured to preset alternate exposure times of the plurality of photosensitive devices;

a plane mirror configured to reflect light to the imaging element;

a mechanical shaft configured to rotate the plane mirror;

The image processor is further configured to synthesize images acquired by the plurality of photosensitive devices.
The apparatus according to claim 9, wherein said microcomputer is further configured to preset alternate exposure times of said photosensitive devices, comprising:

The plurality of photosensitive device alternate exposure times S are set according to the photosensitive time s and the reading time t of the photosensitive device.
The apparatus of claim 10, wherein the microcomputer is configured to perform at least one of the following:

When the two photosensitive devices are identical photosensitive devices, the time for alternately exposing the two photosensitive devices is S, then t<S<s;

When the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, the reading time is t2, and the two are preset. The time when the photosensitive device is alternately exposed is S; when s1 < s2, t1 < t2, then t2 < S < s1; when s1 < s2, t1 > t2, then t1 < S < s1;

When the two photosensitive devices are different photosensitive devices, the photosensitive time of the first photosensitive device is s1, the reading time is t1, the photosensitive time of the second photosensitive device is s2, and the reading time is t2; wherein, s1<s2 The time during which the two photosensitive devices are alternately exposed is different. The exposure time of the first photosensitive device is S1, then t2<S1<s1; the exposure time of the second photosensitive device is S2, then t2<S2<s2.
The apparatus according to claim 9, wherein said mechanical rotating shaft is configured to rotate said plane mirror according to an exposure time preset by said microcomputer to change a direction of light to be reflected on said image pickup element, thereby The plurality of photosensitive devices are alternately exposed.
The apparatus according to claim 9, wherein

The image sensing device is further configured to, after completing the shooting, image the images collected by the plurality of photosensitive devices according to the brightness information thereof to generate a composite image; or continuously read the plurality of photosensitive devices. The image is subjected to real-time image synthesis according to its brightness information, and the synthesized image is displayed in real time.
The apparatus according to claim 9, wherein

The photosensitive device includes a first photosensitive device and a second photosensitive device;

The mechanical rotating shaft is configured to rotate the plane mirror to reflect light onto the first photosensitive device when the first photosensitive device performs image acquisition, the first photosensitive device starts to expose image information, and the second photosensitive device In an inoperative state; when the exposure time of the first photosensitive device is about to end, rotating the plane mirror to reflect light onto the second photosensitive device, the second photosensitive device starts to expose image information, the first The sensor is not working.
The apparatus according to claim 9, wherein

The image processor is configured to combine the N-1th image as a base image and the currently acquired image into an Nth image; wherein the N is an integer not less than 2.
The device according to claim 9 or 15, wherein

The image processor is configured to determine an initial base image; wherein the initial base image may be a terminal loaded image or a first captured image.
A computer storage medium having stored therein computer executable instructions for performing the method of any one of claims 1 to 9.
The computer storage medium of claim 17, wherein the computer storage medium comprises a non-transitory storage medium.
A terminal comprising: the image processing apparatus according to any one of claims 9 to 16.
The terminal according to claim 19, wherein

The terminal is a mobile terminal.