CN115866377A - Method and device for shooting video stream through inter-mirror shutter - Google Patents

Abstract

The invention discloses a method and a device for shooting video stream through an inter-mirror shutter, wherein the method comprises the following steps: after receiving an instruction of a user for starting recording a video, the processor controls the motor part to work according to a first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal; the image sensor is triggered by the image sensor control unit to acquire an image through the inter-mirror shutter according to a second periodic signal; the first periodic signal and the second periodic signal are synchronous signals; finally, after receiving an instruction of stopping recording the video by the user, the processor; and controlling the motor part to stop working and controlling the image sensor to stop collecting images. The first periodic signal of the periodic opening and closing of the inter-mirror shutter is synchronous with the second periodic signal of the image sensor, so that the function of shooting the video stream is realized, the problem that the object is inclined easily when the object moving at high speed is shot is avoided, and the quality of shooting the video stream by the shooting device is improved.

Description

Method and device for shooting video stream through inter-mirror shutter

Technical Field

The invention relates to the technical field of image processing, in particular to a method and a device for shooting video streams through an inter-mirror shutter.

Background

Many existing mobile terminals (for example, security surveillance cameras) have shutter structures for controlling exposure time, the shutters can be divided into mechanical shutters and electronic shutters according to the structural characteristics of the shutters, and the mechanical shutters are widely used due to the problems of large driving voltage, complex driving circuits and the like of the electronic shutters.

The mechanical shutter is a shutter structure formed by arranging a set of light shielding curtains or blades driven by a mechanical part in front of a photosensitive element. Specifically, the mechanical shutter can be divided into a focal plane shutter and an inter-mirror shutter, the focal plane shutter opens the exposure in a way of a gap from top to bottom, and the exposure mode determines that the focal plane shutter can generate a tilting phenomenon when a high-speed moving object is shot. The inter-mirror shutter is similar to an aperture, opening and closing of the shutter are controlled by contraction and expansion of blades, imaging light can be uniformly distributed on the image sensor through the inter-mirror shutter, and basically, an object cannot be inclined. Therefore, the inter-mirror shutter is more suitable for shooting objects moving at high speed, but the current inter-mirror shutter can only shoot a single picture, and the function of shooting a video stream is not realized.

Disclosure of Invention

The embodiment of the invention provides a method and a device for shooting a video stream through an inter-mirror shutter, which are used for improving the quality of the video stream shot by a shooting device.

The first aspect of the embodiments of the present invention provides a method for implementing shooting of a video stream through an inter-mirror shutter, where the method includes:

after receiving an instruction of starting recording a video by a user, the processor controls the motor part to work according to a first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal;

the image sensor is triggered by the image sensor control unit to acquire an image through the inter-mirror shutter according to a second periodic signal; wherein the image sensor control unit is one of an inter-mirror shutter, a motor part, or a processor, and the first and second periodic signals are synchronization signals;

the processor receives an instruction of stopping recording the video from the user; and controlling the motor part to stop working and controlling the image sensor to stop collecting images.

In one embodiment, the processor sends a first periodic signal to the motor part and a second periodic signal to the image sensor respectively after receiving an instruction of starting recording a video by a user, and the motor part works according to the first periodic signal after receiving the first periodic signal and drives the inter-mirror shutter to open and close periodically according to the first periodic signal; and after receiving the second periodic signal, the image sensor collects an image through the inter-mirror shutter according to the second periodic signal. Therefore, the first periodic signal and the second periodic signal are sent by the same processor, and the synchronization of the first periodic signal and the second periodic signal is more favorably ensured, so that the video stream can be shot through the inter-mirror shutter, the problem of object inclination easily occurring when the object moving at high speed is shot is avoided, and the quality of shooting the video stream by the mobile terminal device is improved.

In one embodiment, after receiving an instruction of a user to start recording a video, the processor sends a first periodic signal to the motor part, the motor part drives the inter-mirror shutter to open and close periodically according to the first periodic signal, the motor part determines a second periodic signal according to the acquired first periodic signal, and sends the second periodic signal to the image sensor, so that the image sensor collects an image through the inter-mirror shutter according to the second periodic signal, and therefore synchronization of the first periodic signal and the second periodic signal is guaranteed, a video stream can be shot through the inter-mirror shutter, the problem that the object is prone to tilt when the object moving at a high speed is shot is avoided, and quality of the video stream shot by the shooting device is improved.

In one embodiment, the inter-mirror shutter includes a first sensor, the first sensor may acquire a first periodic signal of the inter-mirror shutter, the second periodic signal is determined by the first periodic signal of the inter-mirror shutter, and the second periodic signal is issued to the image sensor to trigger the image sensor to acquire the second periodic signal, and an image is acquired through the inter-mirror shutter.

In one embodiment, the motor part includes a motor driving unit and a motor, and issues a second periodic signal to the image sensor, including: the motor driving unit determines a second periodic signal according to the first periodic signal sent by the processor and sends the second periodic signal to the image sensor so that the image sensor collects images through the inter-mirror shutter according to the second periodic signal, and therefore synchronization of the first periodic signal and the second periodic signal is guaranteed, shooting of video streams can be achieved through the inter-mirror shutter, the problem that objects are prone to tilting when the objects moving at high speed are shot is avoided, and quality of the video streams shot by the mobile terminal device is improved.

In one embodiment, the motor part includes a motor driving unit and a motor, the motor includes a second sensor, and the motor part issues a second periodic signal to the image sensor, including: the second sensor in the motor acquires a first periodic signal of the motor and sends the first periodic signal of the motor to the motor driving unit, the motor driving unit determines a second periodic signal based on the first periodic signal of the motor and sends the second periodic signal to the image sensor, at the moment, the first periodic signal of the motor acquired by the second sensor is more accurate, errors between the periodic signal sent by the motor driving unit acquired by the motor and the periodic signal of actual work of the motor when the shooting device starts to be started are avoided, the synchronization of the first periodic signal and the second periodic signal is guaranteed to be more accurate, therefore, the video stream can be shot through the inter-mirror shutter, the problem that the object is prone to incline when the object moving at high speed is shot is avoided, and the quality of the video stream shot by the shooting device is improved.

The image sensor in this embodiment is a rolling shutter exposure image sensor.

In the process that the image sensor collects an image through the inter-mirror shutter according to the second periodic signal, the image sensor controls all accumulated exposure of each row of the image sensor to be cleared at a first time (global reset starting time) and controls the inter-mirror shutter to be closed at a second time for any collected frame; the first moment is not earlier than the exposure starting time of the last line of the image sensor, and the second moment is not later than the exposure ending time of the first line of the image sensor, so that the exposure time of all lines of the image sensor can be ensured to be the same, the common roller shutter exposure image sensor can realize the global exposure function, and the imaging effect of the shooting device is improved.

The second aspect of the embodiments of the present invention further provides an apparatus for capturing a video stream through an inter-mirror shutter, where the apparatus includes: an inter-mirror shutter, a motor part, an image sensor, and a processor; wherein,

the processor is used for responding to a command of starting recording videos of a user and transmitting a first periodic signal to the motor part; responding to a command of stopping recording the video of a user, and controlling the motor part to stop rotating;

the motor part is used for receiving a first periodic signal of the processor and working according to the first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal;

the image sensor is used for receiving a second periodic signal of the image sensor control unit and acquiring an image through the inter-mirror shutter according to the second periodic signal; wherein the image sensor control unit is one of an inter-mirror shutter, a motor part, or a processor, and the first and second periodic signals are synchronization signals.

In one embodiment, the processor is further configured to issue a second periodic signal to the image sensor to trigger the image sensor to acquire an image through the inter-mirror shutter with the second periodic signal; or

The motor part is used for sending a second periodic signal to the image sensor so that the image sensor collects an image through the inter-mirror shutter according to the second periodic signal; or

The first sensor in the inter-mirror shutter is used for acquiring a first periodic signal of the open and close of the inter-mirror shutter, determining a second periodic signal according to the first periodic signal of the open and close of the inter-mirror shutter, and issuing the second periodic signal to the image sensor so as to trigger the image sensor to acquire an image through the inter-mirror shutter with the second periodic signal.

In one embodiment, the motor part includes a motor driving unit and a motor; the motor driving unit is used for acquiring a first periodic signal issued by the processor, determining a second periodic signal according to the first periodic signal, and issuing the second periodic signal to the image sensor; or

The second sensor in the motor is used for acquiring a first periodic signal of the motor and sending the first periodic signal of the motor to the motor driving unit; the motor driving unit determines a second periodic signal based on the first periodic signal of the motor and issues the second periodic signal to the image sensor.

In one embodiment, the image sensor is a rolling shutter exposure image sensor.

In one embodiment, the image sensor is further configured to:

controlling all exposure of each row of the image sensor to be zero cleared at a first moment, and controlling the inter-mirror shutter to be closed at a second moment;

wherein the first time is not earlier than the time when the last line of the image sensor starts to be exposed; the second time is not later than the exposure end time of the first row of the image sensor.

The shutter between mirrors provided by the embodiment of the invention has the characteristic that imaging light rays are uniformly distributed on the image sensor, and uniform exposure of the image sensor can be ensured, so that the problem that a traditional curtain type mechanical shutter is easy to incline when a fast moving object is shot is avoided, and the quality of the shot image of the shooting device is improved. The inter-mirror shutter provided by the embodiment of the invention is connected with the motor part through a mechanical structure, and the inter-mirror shutter periodically rotates at a high speed to open and close under the control of the motor part; the image sensor is triggered by the image sensor control unit to periodically expose and acquire images; the opening and closing period (namely, the first period signal) of the inter-mirror shutter is synchronous with the exposure acquisition period (the second period signal) of the image sensor, so that the function of shooting the video stream through the inter-mirror shutter is realized.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic flowchart illustrating a method for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention;

FIG. 2a is a schematic diagram illustrating a synchronization relationship between a first periodic signal and a second periodic signal according to an embodiment of the present invention;

FIG. 2b is a second schematic diagram illustrating a synchronization relationship between a first periodic signal and a second periodic signal according to an embodiment of the present invention;

FIG. 2c is a third schematic diagram illustrating a synchronization relationship between a first periodic signal and a second periodic signal according to an embodiment of the present invention;

fig. 3 is a second flowchart illustrating a method for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention;

fig. 4 is a third schematic flowchart illustrating a method for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention;

FIG. 5 is a fourth flowchart illustrating a method for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention;

fig. 6 is a schematic diagram illustrating a rolling shutter exposure image sensor according to an embodiment of the present invention to implement global exposure;

fig. 7a is a schematic diagram of a process of acquiring any frame of image according to an embodiment of the present invention;

FIG. 7b is a second schematic diagram illustrating a process of acquiring any one frame of image according to the embodiment of the present invention;

fig. 7c is a third schematic diagram illustrating a process of acquiring any one frame of image according to the embodiment of the present invention;

fig. 8 is a schematic view of an exposure collecting process of a rolling shutter exposure image sensor according to an embodiment of the present invention;

FIG. 9a is a schematic structural diagram of an apparatus for capturing a video stream by an inter-mirror shutter according to an embodiment of the present invention;

FIG. 9b is a second schematic structural diagram of an apparatus for capturing a video stream by an inter-mirror shutter according to an embodiment of the present invention;

FIG. 9c is a third schematic structural diagram of an apparatus for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention;

FIG. 9d is a fourth schematic diagram illustrating an apparatus for capturing a video stream by an inter-mirror shutter according to an embodiment of the present invention;

fig. 9e is a fifth schematic structural diagram of an apparatus for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the attached drawings, and it should be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.

The embodiment of the invention provides a method and a device for shooting video streams through an inter-mirror shutter, which solve the problem that objects are easy to incline when shooting objects moving at high speed, thereby improving the quality of the video streams shot by a mobile terminal device.

Referring to fig. 1, an embodiment of the present invention provides a method for capturing a video stream through an inter-mirror shutter, where the method includes:

s101, a processor receives a command of starting recording of a video by a user;

s102, the processor controls the motor part to work according to a first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal; the image sensor is triggered by the image sensor control unit to acquire an image through the inter-mirror shutter according to a second periodic signal; wherein the image sensor control unit is one of an inter-mirror shutter, a motor part, or a processor, and the first periodic signal and the second periodic signal are synchronization signals;

s103, after receiving an instruction of stopping recording the video by the user, the processor; and controlling the motor part to stop working and controlling the image sensor to stop collecting images.

The inter-mirror shutter provided by the embodiment of the invention consists of a series of thin steel blades. The shutter between the mirrors has the characteristic that imaging light rays are uniformly distributed on the image sensor, so that the uniform exposure of the image sensor can be ensured, the problem that an object is inclined easily when a traditional curtain type mechanical shutter shoots a fast moving object is solved, and the quality of the shot image of the shooting device is improved. The inter-mirror shutter provided by the embodiment of the invention is connected with the motor part through a mechanical structure, and the inter-mirror shutter periodically rotates at a high speed to open and close under the control of the motor part; the image sensor is triggered by the image sensor control unit to periodically expose and acquire images; wherein, the open-close period (i.e. the first periodic signal) of the inter-mirror shutter is synchronized with the exposure capture period (the second periodic signal) of the image sensor, thereby realizing the function of shooting the video stream through the inter-mirror shutter.

In the embodiments provided by the present invention, the exposure time can be adjusted by controlling the ratio of the opening and closing times of the inter-mirror shutter; the exposure time can be controlled by controlling the size of the maximum opening window of the inter-mirror shutter, so that the synchronization of the first periodic signal and the second periodic signal is ensured.

Specifically, in the embodiments provided by the present invention, one on and one period of the inter-mirror shutter are "off-on-off"; in the following, it is further explained that "the opening and closing period of the inter-mirror shutter (i.e. the first period signal) is synchronized with the exposure acquisition period of the image sensor" in the embodiment of the present invention, the opening and closing period of the inter-mirror shutter (i.e. the first period signal) is synchronized with the exposure acquisition period of the image sensor "(the second period signal)":

referring to fig. 2a to 2c, in the embodiment of the present invention, one opening and closing period of the inter-mirror shutter is S1 to S2, and an exposure capture period of the image sensor is H1 to H2. Referring to fig. 2a, an opening time S1 of the inter-mirror shutter provided in the embodiment of the present invention is the same as a time H1 when the first row a of the image sensor starts exposure capture, and a closing time S2 of the inter-mirror shutter is the same as a time when the first row a of the image sensor finishes exposure capture; or, referring to fig. 2b, the opening time S1 of the inter-mirror shutter provided in the embodiment of the present invention is the same as the time when the last row z of the image sensor starts exposure capture, and the closing time S2 of the inter-mirror shutter is the same as the time when the first row a of the image sensor finishes exposure capture; alternatively, referring to fig. 2c, the opening time S1 of the inter-mirror shutter provided in the embodiment of the present invention is between the first row a to the last row z of the image sensor at any time point between the start of the exposure capture, and the closing time S2 of the inter-mirror shutter is the same as the end of the exposure capture in the first row a of the image sensor. Therefore, in the embodiment provided by the present invention, as long as it is ensured that in any period, the interval between the opening time S1 of the inter-mirror shutter and the time when the first row a of the image sensor starts exposure capture is a fixed duration, and the interval between the closing time S2 of the inter-mirror shutter and the time when the last row z of the image sensor finishes exposure capture is a fixed duration, that is, the opening and closing period (i.e., the first period signal) of the inter-mirror shutter according to the embodiment of the present invention is synchronized with the exposure capture period (the second period signal) of the image sensor.

Specifically, the first embodiment:

referring to fig. 3, a method for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention includes:

s201, a processor receives a command of starting recording of a video by a user;

s202, the processor controls the motor part to work according to a first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal; meanwhile, the processor issues a second periodic signal to the image sensor to trigger the image sensor to acquire an image through the inter-mirror shutter in the second periodic signal;

the first periodic signal and the second periodic signal are synchronous signals;

s203, after receiving an instruction of stopping recording the video by the user, the processor; and controlling the motor part to stop working and controlling the image sensor to stop collecting images.

Specifically, in the embodiment provided by the invention, after receiving an instruction of a user to start recording a video, a processor respectively issues a first periodic signal to a motor part and a second periodic signal to an image sensor, and after receiving the first periodic signal, the motor part works according to the first periodic signal to drive an inter-mirror shutter to open and close periodically according to the first periodic signal; and after receiving the second periodic signal, the image sensor collects an image through the inter-mirror shutter according to the second periodic signal. Therefore, the first periodic signal and the second periodic signal are sent by the same processor, and the synchronization of the first periodic signal and the second periodic signal is more favorably ensured, so that the video stream can be shot through the inter-mirror shutter, the problem of object inclination easily occurring when the object moving at high speed is shot is avoided, and the quality of shooting the video stream by the mobile terminal device is improved.

Example two:

referring to fig. 4, a method for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention includes:

s301, a processor receives a command of starting recording of a video by a user;

s302, the processor sends a first periodic signal to the motor part, and the motor part is controlled to work according to the first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal; the motor part determines a second periodic signal by the first periodic signal issued by the processor and issues the second periodic signal to the image sensor so that the image sensor acquires an image through the inter-mirror shutter according to the second periodic signal;

the first periodic signal and the second periodic signal are synchronous signals;

s303, after receiving an instruction of stopping recording the video by the user, the processor; and controlling the motor part to stop working and controlling the image sensor to stop collecting images.

Specifically, after receiving an instruction of a user to start recording a video, the processor issues a first periodic signal to the motor part, the motor part drives the inter-mirror shutter to open and close periodically according to the first periodic signal, the motor part determines a second periodic signal according to the acquired first periodic signal, and issues the second periodic signal to the image sensor, so that the image sensor collects an image through the inter-mirror shutter according to the second periodic signal, and therefore synchronization of the first periodic signal and the second periodic signal is guaranteed, a video stream can be shot through the inter-mirror shutter, the problem that the object is inclined when the object moving at a high speed is shot is avoided, and quality of the video stream shot by the shooting device is improved.

Example three:

referring to fig. 5, a method for capturing a video stream through an inter-mirror shutter according to an embodiment of the present invention includes:

s401, a processor receives a command of starting recording of a video by a user;

s402, the processor controls the motor part to work according to a first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal; a first sensor in the inter-mirror shutter acquires a first periodic signal of the open and close of the inter-mirror shutter, a second periodic signal is determined by the first periodic signal of the open and close of the inter-mirror shutter, and the second periodic signal is issued to an image sensor to trigger the image sensor to acquire an image through the inter-mirror shutter;

the first periodic signal and the second periodic signal are synchronous signals;

s403, after the processor receives an instruction of stopping recording the video by the user; and controlling the motor part to stop working and controlling the image sensor to stop collecting images.

Specifically, the inter-mirror shutter comprises a first sensor, the first sensor can acquire a first periodic signal of the open/close of the inter-mirror shutter, a second periodic signal is determined by the first periodic signal of the open/close of the inter-mirror shutter, the second periodic signal is sent to the image sensor to trigger the image sensor to acquire the second periodic signal, and an image is acquired through the inter-mirror shutter.

The first sensor provided in the embodiment of the present invention may be a photo interrupter or other sensors, as long as it is ensured that the first sensor can acquire a first periodic signal of opening and closing of an inter-mirror shutter in real time, and send the first periodic signal to other components, and the specific type of the sensor is not limited herein.

Further, the motor part provided by the second embodiment of the present invention includes a motor driving unit and a motor, and the motor part issues a second periodic signal to the image sensor, and includes: the motor driving unit determines a second periodic signal according to the first periodic signal sent by the processor and sends the second periodic signal to the image sensor so that the image sensor collects images through the inter-mirror shutter according to the second periodic signal, and therefore synchronization of the first periodic signal and the second periodic signal is guaranteed, shooting of video streams can be achieved through the inter-mirror shutter, the problem that objects are prone to tilting when the objects moving at high speed are shot is avoided, and quality of the video streams shot by the mobile terminal device is improved.

Another motor unit provided in the second embodiment of the present invention includes a motor driving unit and a motor, the motor includes a second sensor, and the motor unit issues a second periodic signal to the image sensor, and the motor unit includes: the second sensor in the motor acquires a first periodic signal of the motor and sends the first periodic signal of the motor to the motor driving unit, the motor driving unit determines a second periodic signal based on the first periodic signal of the motor and sends the second periodic signal to the image sensor, at the moment, the first periodic signal of the motor acquired by the second sensor is more accurate, errors between the periodic signal sent by the motor driving unit acquired by the motor and the periodic signal of actual work of the motor when the shooting device starts to be started are avoided, the synchronization of the first periodic signal and the second periodic signal is guaranteed to be more accurate, therefore, the video stream can be shot through the inter-mirror shutter, the problem that the object is prone to incline when the object moving at high speed is shot is avoided, and the quality of the video stream shot by the shooting device is improved.

In the embodiment provided by the invention, the motor driving unit controls the motor in a sensible or non-sensible mode, so that the constant rotating speed of the motor is ensured, and the periodic opening and closing of the inter-mirror shutter is ensured. The motor is controlled in a sensible mode, for example, the motor is driven in a feedback mode by adopting an encoder, or the motor is driven in a feedback mode by adopting a Hall sensor and the like, and the speed of the motor is ensured to be basically constant by adopting a PID algorithm. The driving method without sense usually adopts FOC driving method. The motor driving unit may be a common motor driving chip and controlled by the processor alone, or may be a subunit with a processor to control the constant of the motor rotation speed, which is not limited herein.

The motor provided by the embodiment of the invention is a direct-current brushless motor and has a longer service life. The motor provided by the embodiment of the present invention may also be an ultrasonic motor, as long as the inter-mirror shutter can be driven to open and close periodically according to the first periodic signal, and the specific type of the motor is not limited herein.

At present, two types of image sensors, namely a CCD image sensor and a CMOS image sensor, are mainly used in the field of image sensors, and the CCD image sensor is basically unattended due to higher cost, complex driving circuit and higher power consumption. The CMOS image sensor is inexpensive, has a simple circuit, and is widely used. Most of the CMOS image sensors adopt a rolling exposure method, and when a moving object is photographed, the exposure time of different rows is not the same time, so that the image is distorted, which is called "jelly effect". In order to solve the problem, part of image sensor manufacturers invent a global exposure CMOS image sensor, and the principle is to add a charge buffer unit to ensure that all pixel points are exposed at the same time, because the buffer unit exists, the cost of the CMOS image sensor is also increased sharply, and because the area in a semiconductor silicon wafer is limited, the existence of the buffer unit can influence the imaging area of effective pixels, thereby influencing the imaging effect.

In view of this, embodiments of the present invention provide a method for implementing global exposure by using a common rolling shutter exposure image sensor without adding a charge buffer unit, so as to improve an imaging effect of a camera.

In an embodiment, the image sensor is a rolling shutter exposure image sensor supporting a global reset mode. The rolling shutter exposure image sensor supporting the global reset mode can completely clear the accumulated exposure of each line of the image sensor in the global reset mode. Referring to fig. 6, in order to ensure that the exposure time of all rows of the image sensor is the same, in the process that the image sensor acquires an image through the inter-mirror shutter with the second periodic signal L2, for any acquired frame, the image sensor controls all the accumulated exposures of each row of the image sensor to be cleared at a first time E1 (global reset start time), and controls the inter-mirror shutter to be closed at a second time E2; the first time E1 is not earlier than the exposure starting time of the last line z of the image sensor, and the second time E2 is not later than the exposure ending time of the first line a of the image sensor, so that the exposure time of all lines of the image sensor can be ensured to be the same, the common roller shutter exposure image sensor can realize the global exposure function, and the imaging effect of the shooting device is improved.

Specifically, referring to fig. 7a, in the embodiment of the present invention, during the process that the image sensor acquires an image through the inter-mirror shutter with the second periodic signal L2, for any one acquired frame, the opening time S1 of the inter-mirror shutter starts at the same time as the start operating time H1 of the image sensor, and the image sensor starts line-by-line exposure; when the last line z of the image sensor starts exposure, the image sensor controls all the exposure of each line of the image sensor to be zero (at this time, the first time E1 is the time when the last line z of the image sensor starts exposure), and the inter-mirror shutter is closed when the first line a (the image sensor starts exposure) of the image sensor is exposed (at this time, the second time E2 is the closing time S2 of the inter-mirror shutter), so that the acquisition of one frame of image is completed. Although the image sensor still works after the inter-mirror shutter is closed, and no exposure exists, so that the exposure time of all rows of the image sensor can be ensured to be the same (namely the first time E1 to the second time E2), and the imaging effect of the shooting device is improved.

Referring to fig. 7b, in another embodiment of the present invention, in a process that the image sensor acquires an image through the inter-mirror shutter with the second periodic signal L2, for any one acquired frame, the image sensor starts to operate (the start operating time of the image sensor is H1), when the image sensor performs line-by-line exposure until the last line z starts to expose, the inter-mirror shutter is opened (the opening time of the inter-mirror shutter is S1), and the inter-mirror shutter is closed while the first line a (the first line of exposure of the image sensor) of the image sensor is finished (at this time, the second time E2 is the closing time S2 of the inter-mirror shutter), thereby completing the acquisition of one frame of image. After the inter-mirror shutter is closed, although the image sensor still works, the inter-mirror shutter is closed, and no exposure is available. Since there is no exposure amount before the inter-mirror shutter is opened, in the process of any one frame of the above acquisition, the starting time of the global reset of the rolling shutter exposure image sensor can be any time before the last row z of the image sensor starts exposure, so that the exposure time of all rows of the image sensor can be ensured to be the same (i.e. the opening time S1 of the inter-mirror shutter to the closing time S2 of the inter-mirror shutter), thereby improving the imaging effect of the shooting device.

In addition, because the inter-lens shutter is opened only when the last line of the image sensor starts exposure, and the exposure of the image sensor is zero before the inter-lens shutter is opened, the rolling shutter exposure image sensor at this time can also be a rolling shutter exposure image sensor which does not support a global reset mode. In addition, the rolling shutter exposure image sensor which does not support the global reset mode reduces the manufacturing cost, and the driving circuit is simpler.

Referring to fig. 7c, in another embodiment of the present invention, since the image sensor is a rolling exposure image sensor, in order to improve the efficiency of image acquisition, the next image acquisition cycle may be started at the same time when the first line a of the image sensor is exposed. In the process that the image sensor collects images through the inter-mirror shutter according to the second periodic signal L2, for any collected frame, the image sensor starts to work (the starting working time of the image sensor is H1), when the image sensor is exposed line by line to the last line z and starts to be exposed, the inter-mirror shutter is opened (the opening time of the inter-mirror shutter is S1), and when the exposure of the first line a (the initial exposure of the image sensor) of the image sensor is finished, the inter-mirror shutter is closed, so that the collection of the image of the frame is completed. Further, the next cycle of the image sensor starts at the same time when the exposure of the first line a of the image sensor ends, whereby the efficiency of the capturing of the image can be improved.

The first row a or the last row z in the embodiment of the present invention is not limited to one row, and as shown in fig. 8, multiple rows may start exposure simultaneously, and the specific number of the simultaneous exposure rows depends on different requirements of different cameras, which is not limited herein.

Based on the same conception, the embodiment of the invention provides a device for shooting video stream through an inter-mirror shutter, which comprises the inter-mirror shutter, a motor part, an image sensor and a processor; wherein:

the processor is used for responding to a command of starting recording videos of a user and transmitting a first periodic signal to the motor part; responding to a command of stopping recording the video of a user, and controlling the motor part to stop rotating;

the motor part is used for receiving a first periodic signal of the processor and working according to the first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal;

the image sensor is used for receiving a second periodic signal of the image sensor control unit and acquiring an image through the inter-mirror shutter according to the second periodic signal; wherein the image sensor control unit is one of an inter-mirror shutter, a motor part, or a processor, and the first and second periodic signals are synchronization signals.

Specifically, in the embodiment provided by the present invention, the processor is further configured to issue a second periodic signal to the image sensor, so as to trigger the image sensor to acquire an image through the inter-mirror shutter with the second periodic signal. Referring to fig. 9a, the steps provided in the embodiment of the present invention for capturing a video stream through an inter-mirror shutter are: after receiving an instruction of a user to start recording a video, the processor 11 respectively issues a first periodic signal to the motor part 12 and a second periodic signal to the image sensor 13, and after receiving the first periodic signal, the motor part 12 operates according to the first periodic signal to drive the inter-mirror shutter 14 to open and close periodically according to the first periodic signal; after receiving the second periodic signal, the image sensor 13 acquires an image through the inter-mirror shutter 14 according to the second periodic signal, and the image sensor 13 returns acquired video information to the processor 11 for processing, so as to generate a video stream, and finally complete the shooting of the video stream.

In another embodiment of the present invention, the first sensor in the inter-mirror shutter is configured to acquire a first periodic signal of the open/close of the inter-mirror shutter, determine a second periodic signal according to the first periodic signal of the open/close of the inter-mirror shutter, and issue the second periodic signal to the image sensor, so as to trigger the image sensor to acquire an image through the inter-mirror shutter with the second periodic signal. Referring to fig. 9b, the step of capturing a video stream through an inter-mirror shutter according to the embodiment of the present invention is: after receiving an instruction of a user to start recording a video, the processor 11 issues a first periodic signal to the motor part 12, and the motor part 12 drives the inter-mirror shutter 14 to open and close periodically according to the first periodic signal; the inter-mirror shutter 14 includes a first sensor 141, the first sensor 141 may acquire a first periodic signal of the open/close of the inter-mirror shutter 14, determine a second periodic signal according to the first periodic signal of the open/close of the inter-mirror shutter 14, issue the second periodic signal to the image sensor 13 to trigger the image sensor 13 to acquire an image with the second periodic signal, acquire the image through the inter-mirror shutter 14, and the image sensor 13 returns acquired video information to the processor 11 for processing, so as to generate a video stream, and finally complete shooting of the video stream.

In another embodiment of the present invention, the motor unit is further configured to send a second periodic signal to the image sensor, so that the image sensor collects an image through the inter-mirror shutter according to the second periodic signal; referring to fig. 9c, the step of capturing a video stream through an inter-mirror shutter according to the embodiment of the present invention is: after receiving an instruction of a user to start recording a video, the processor 11 sends a first periodic signal to the motor part 12, the motor part drives the inter-mirror shutter 14 to open and close periodically according to the first periodic signal, the motor part 12 determines a second periodic signal according to the acquired first periodic signal and sends the second periodic signal to the image sensor 13, so that the image sensor 13 collects an image through the inter-mirror shutter 14 according to the second periodic signal, the image sensor 13 returns collected video information to the processor 11 for processing, a video stream is generated, and finally shooting of the video stream is completed.

Specifically, in the embodiment provided by the present invention, the motor part includes a motor driving unit and a motor 122; the motor driving unit is used for acquiring a first periodic signal issued by the processor, determining a second periodic signal according to the first periodic signal and issuing the second periodic signal to the image sensor; referring to fig. 9d, the step of capturing a video stream through an inter-mirror shutter according to the embodiment of the present invention is: after receiving an instruction of a user to start recording a video, the processor 11 issues a first periodic signal to the motor driving unit 121, the motor driving unit 121 controls the motor 122 to drive the inter-mirror shutter 14 to open and close periodically according to the first periodic signal, and at the same time, the motor driving unit 121 determines a second periodic signal from the first periodic signal and issues the second periodic signal to the image sensor 13, so that the image sensor 13 acquires an image through the inter-mirror shutter 14 with the second periodic signal, and the image sensor 13 returns acquired video information to the processor 11 for processing, generates a video stream, and finally completes shooting of the video stream.

In another embodiment provided by the present invention, the motor part includes a motor driving unit and a motor, the motor further includes a second sensor, the second sensor is configured to acquire a first periodic signal of the motor and send the first periodic signal of the motor to the motor driving unit, and the motor driving unit determines a second periodic signal based on the first periodic signal of the motor and sends the second periodic signal to the image sensor. Referring to fig. 9e, the step of capturing a video stream through an inter-mirror shutter according to the embodiment of the present invention is: after receiving an instruction of a user to start recording a video, the processor 11 issues a first periodic signal to the motor driving unit 121, the motor driving unit 121 controls the motor 122 to drive the inter-mirror shutter 14 to open and close periodically according to the first periodic signal, at the same time, the second sensor 1220 in the motor 122 acquires the first periodic signal of the motor 122 and issues the first periodic signal of the motor to the motor driving unit 121, the motor driving unit 121 determines a second periodic signal based on the first periodic signal of the motor 122 and issues the second periodic signal to the image sensor 13, so that the image sensor 13 acquires an image through the inter-mirror shutter 14 according to the second periodic signal, the image sensor 13 returns the acquired video information to the processor 11 for processing, a video stream is generated, and finally, shooting of the video stream is completed.

Optionally, the image sensor is a rolling shutter exposure image sensor.

Optionally, the image sensor is further configured to:

controlling all exposure of each row of the image sensor to be cleared at a first moment, and controlling the inter-mirror shutter to be closed at a second moment;

wherein, the first time is not earlier than the time of starting exposure of the last line of the image sensor; the second time is not later than the exposure end time of the first row of the image sensor.

In summary, the method for capturing a video stream through an inter-mirror shutter according to the embodiments of the present invention includes: after receiving an instruction of a user for starting recording a video, the processor controls the motor part to work according to a first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal; the image sensor is triggered by the image sensor control unit to acquire an image through the inter-mirror shutter according to a second periodic signal; wherein the image sensor control unit is one of an inter-mirror shutter, a motor part, or a processor, and the first periodic signal and the second periodic signal are synchronization signals; finally, after receiving an instruction of stopping recording the video by the user, the processor; and controlling the motor part to stop working and controlling the image sensor to stop collecting images. Therefore, the embodiment of the invention synchronizes the first periodic signal of the periodic opening and closing of the inter-mirror shutter with the second periodic signal of the image sensor, realizes a method for shooting a video stream through the inter-mirror shutter, avoids the problem that the object is easy to incline when shooting an object moving at a high speed, and improves the quality of shooting the video stream by the mobile terminal device.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims (10)

1. A method for capturing a video stream via an inter-mirror shutter, the method comprising:

the processor receives an instruction of starting recording a video from a user;

the processor controls the motor part to work according to a first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal; the image sensor is triggered by the image sensor control unit, and acquires an image through the inter-mirror shutter according to a second periodic signal; wherein the image sensor control unit is one of an inter-mirror shutter, a motor part, or a processor, and the first and second periodic signals are synchronous signals;

the processor receives an instruction of stopping recording the video from the user; and controlling the motor part to stop working, and controlling the image sensor to stop collecting images.

2. The method of claim 1, wherein the image sensor acquiring the image through the inter-mirror shutter with the second periodic signal triggered by the image sensor control unit comprises:

the processor issues a second periodic signal to the image sensor to trigger the image sensor to acquire an image through the inter-mirror shutter in the second periodic signal; or

The motor part issues a second periodic signal to the image sensor so that the image sensor collects images through the inter-mirror shutter according to the second periodic signal; or

The method comprises the steps that a first sensor in the inter-mirror shutter obtains a first periodic signal of the open and close of the inter-mirror shutter, the second periodic signal is determined according to the first periodic signal of the open and close of the inter-mirror shutter, the second periodic signal is issued to an image sensor to trigger the image sensor to acquire an image through the inter-mirror shutter according to the second periodic signal.

3. The method of claim 2, wherein the motor components include a motor drive unit and a motor;

the motor part issues a second periodic signal to the image sensor, including:

the motor driving unit determines a second periodic signal according to the first periodic signal issued by the processor and issues the second periodic signal to the image sensor; or

A second sensor in the motor acquires a first periodic signal of the motor and sends the first periodic signal of the motor to the motor driving unit; the motor driving unit determines a second periodic signal based on the first periodic signal of the motor and issues the second periodic signal to the image sensor.

4. The method of any of claims 1-3, wherein the image sensor is a rolling-shutter exposure image sensor.

5. The method of claim 4, wherein the method further comprises:

in the process that the image sensor collects images through the inter-mirror shutter according to a second periodic signal, aiming at any collected frame, the image sensor controls the exposure of each row of the image sensor to be completely cleared at a first moment and controls the inter-mirror shutter to be closed at a second moment;

wherein the first time is no earlier than the time when the last line of the image sensor starts to be exposed; the second time is not later than the exposure end time of the first row of the image sensor.

6. An apparatus for capturing a video stream via an inter-mirror shutter, comprising: an inter-mirror shutter, a motor part, an image sensor, and a processor; wherein,

the processor is used for responding to a command of starting recording videos of a user and transmitting a first periodic signal to the motor part; responding to a command of stopping recording the video of a user, and controlling the motor part to stop rotating;

the motor part is used for receiving a first periodic signal of the processor and working according to the first periodic signal so as to drive the inter-mirror shutter to open and close periodically according to the first periodic signal;

the image sensor is used for receiving a second periodic signal of the image sensor control unit and acquiring an image through the inter-mirror shutter according to the second periodic signal; wherein the image sensor control unit is one of an inter-mirror shutter, a motor part, or a processor, and the first and second periodic signals are synchronization signals.

7. The apparatus of claim 6, wherein the processor is further configured to issue a second periodic signal to the image sensor to trigger the image sensor to capture an image through the inter-mirror shutter with the second periodic signal; or

The motor part is used for sending a second periodic signal to the image sensor so that the image sensor collects an image through the inter-mirror shutter according to the second periodic signal; or

The first sensor in the inter-mirror shutter is used for acquiring a first periodic signal of the open and close of the inter-mirror shutter, determining a second periodic signal according to the first periodic signal of the open and close of the inter-mirror shutter, and issuing the second periodic signal to the image sensor so as to trigger the image sensor to acquire an image through the inter-mirror shutter with the second periodic signal.

8. The apparatus of claim 7, wherein the motor means comprises a motor drive unit and a motor; the motor driving unit is used for acquiring a first periodic signal issued by the processor, determining a second periodic signal according to the first periodic signal and issuing the second periodic signal to the image sensor; or

The second sensor in the motor is used for acquiring a first periodic signal of the motor and sending the first periodic signal of the motor to the motor driving unit; the motor driving unit determines a second periodic signal based on the first periodic signal of the motor, and issues the second periodic signal to the image sensor.

9. The apparatus of any of claims 6-8, wherein the image sensor is a rolling exposure image sensor.

10. The apparatus of claim 9, wherein the image sensor is further to:

controlling the exposure of each row of the image sensor to be completely cleared at a first moment, and controlling the inter-mirror shutter to be closed at a second moment;

wherein the first time is no earlier than the time when the last line of the image sensor starts to be exposed; the second time is not later than the exposure end time of the first row of the image sensor.

Images