CN110858873B

CN110858873B - Electronic device and photographing method

Info

Publication number: CN110858873B
Application number: CN201810967773.5A
Authority: CN
Inventors: 孙恒
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2018-08-23
Filing date: 2018-08-23
Publication date: 2021-06-29
Anticipated expiration: 2038-08-23
Also published as: CN110858873A

Abstract

The disclosure relates to an electronic device and a shooting method, and belongs to the technical field of electronics. The electronic equipment comprises a gyroscope, a lens, an image sensor, an optical anti-shake module and a processor, wherein the processor comprises the electronic anti-shake module, and the lens is connected with the image sensor and the optical anti-shake module respectively. In the electronic equipment provided by the disclosure, when the image sensor collects multiple groups of image data of a current frame image, multiple groups of jitter data and multiple groups of compensation data can be quickly acquired through the second link and the third link, and the multiple groups of jitter data, the multiple groups of compensation data and the multiple groups of image data are correspondingly stored so as to be subsequently provided for the processor.

Description

Electronic device and photographing method

Technical Field

The present disclosure relates to the field of electronic technologies, and in particular, to an electronic device and a shooting method.

Background

With the continuous development of terminal technology, electronic devices such as mobile phones and tablet computers have strong processing capability, and are deeply integrated into the work and life of people. At present, people increasingly use electronic devices to shoot videos in daily life. In the shooting process, people often blur the shot image due to hand shake or lens shake, so that anti-shake processing is required to be performed during shooting to improve the image quality.

In the related art, referring to fig. 1, in general, an electronic device includes a gyroscope, a lens, an image sensor, an optical anti-shake module, and a processor, where the processor includes the electronic anti-shake module, the processor is respectively connected to the gyroscope, the image sensor, and the optical anti-shake module, the lens is respectively connected to the image sensor and the optical anti-shake module, and the image sensor is connected to the gyroscope. In the process of shooting a video, the gyroscope is used for detecting multiple groups of shaking data when the image sensor collects a current frame image, the optical anti-shaking module is used for acquiring the multiple groups of shaking data, the optical shaking compensation is carried out on the lens for multiple times according to the multiple groups of shaking data to obtain multiple groups of compensation data, and the image sensor is used for collecting the multiple groups of image data of the current frame image. And the processor sends a first data reading instruction to the gyroscope to acquire the multiple groups of jitter data, sends a second data reading instruction to the optical anti-shake module to acquire the multiple groups of compensation data, and sends a third data reading instruction to the image sensor to acquire the multiple groups of image data. Therefore, the processor can obtain the multiple groups of shaking data, the multiple groups of compensation data and the multiple groups of image data, and the electronic anti-shaking module can electronically compensate the multiple groups of image data according to the multiple groups of shaking data and the multiple groups of compensation data which correspond to each other.

Disclosure of Invention

The present disclosure provides an electronic device and a photographing method, which can solve the problems in the related art.

According to a first aspect of the embodiments of the present disclosure, an electronic device is provided, the electronic device includes a gyroscope, a lens, an image sensor, an optical anti-shake module, and a processor, the processor includes the electronic anti-shake module, and the lens is respectively connected to the gyroscope, the image sensor, and the optical anti-shake module;

the gyroscope is connected with the optical anti-shake module through a first link, the gyroscope is connected with the image sensor through a second link, the image sensor is connected with the optical anti-shake module through a third link, and the image sensor is connected with the processor through a fourth link;

the gyroscope is used for detecting multiple groups of shaking data of the lens in the process of shooting a current frame image, sending the multiple groups of shaking data to the optical anti-shaking module through the first link, and sending the multiple groups of shaking data to the image sensor through the second link;

the optical anti-shake module is used for receiving the multiple groups of shake data sent by the gyroscope, performing optical compensation according to the multiple groups of shake data to obtain multiple groups of compensation data, and sending the multiple groups of compensation data to the image sensor through the third link;

the image sensor is used for acquiring a plurality of groups of image data of a current frame image, receiving the plurality of groups of shake data and the plurality of groups of compensation data, and correspondingly storing the plurality of groups of shake data, the plurality of groups of compensation data and the plurality of groups of image data;

the processor is used for acquiring the correspondingly stored multiple groups of jitter data, compensation data and image data from the image sensor through the third link, so that the electronic anti-shake module performs electronic compensation on the multiple groups of image data according to the multiple groups of jitter data, the compensation data and the jitter data acquired when shooting the previous frame of image.

In a possible implementation manner, the image sensor and the optical anti-shake module are further connected by a fifth link, and the image sensor is configured to send a first specific signal to the gyroscope through the second link and send the first specific signal to the optical anti-shake module through the fifth link when the acquisition of the multiple sets of image data is started;

the gyroscope is further used for sending the multiple groups of jitter data to the image sensor through the second link when the first specified signal is received;

the optical anti-shake module is further configured to send the plurality of sets of compensation data to the image sensor through the third link when receiving the first specific signal.

In a possible implementation manner, the image sensor is further configured to send a second specified signal to the gyroscope through the second link and send the second specified signal to the optical anti-shake module through the fifth link when starting to acquire each line of image data of the plurality of sets of image data;

the gyroscope is further used for sending jitter data of image data corresponding to the row indicated by the second specified signal to the image sensor through the second link when the second specified signal is received;

and the optical anti-shake module is used for sending compensation data of image data corresponding to the row indicated by the second specified signal to the image sensor through the third link when the second specified signal is received.

In a possible implementation manner, the multiple sets of jitter data and the multiple sets of compensation data both carry timestamp information when received by the image sensor, and the multiple sets of image data carry timestamp information when acquired by the image sensor;

the image sensor is further configured to, when receiving the multiple sets of shake data and the multiple sets of compensation data, determine, for each of the multiple sets of shake data, compensation data that is the same as timestamp information carried by the shake data from the multiple sets of compensation data, determine, from the multiple sets of image data, image data that is the same as the timestamp information, and store the shake data, the compensation data, and the image data in a corresponding manner.

In a possible implementation manner, the processor and the image sensor are further connected through the sixth link, and the processor is configured to send a data acquisition instruction to the image sensor through the sixth link, where the data acquisition instruction is configured to instruct the image sensor to send the correspondingly stored multiple sets of jitter data, multiple sets of compensation data, and multiple sets of image data to the processor through the fourth link;

the image sensor is further configured to feed back a sending completion signal to the processor through the sixth link after the sending of the plurality of sets of shaking data, the plurality of sets of compensation data, and the plurality of sets of image data is completed.

According to a second aspect of the embodiments of the present disclosure, there is provided a shooting method applied to the electronic device of the first aspect; the method comprises the following steps:

the gyroscope detects multiple groups of jitter data of the lens in the process of shooting a current frame image, sends the multiple groups of jitter data to the optical anti-shake module through the first link, and sends the multiple groups of jitter data to the image sensor through the second link;

the optical anti-shake module receives the multiple groups of shake data sent by the gyroscope, performs optical compensation according to the multiple groups of shake data to obtain multiple groups of compensation data, and sends the multiple groups of compensation data to the image sensor through the third link;

the image sensor collects multiple groups of image data of a current frame image, receives the multiple groups of jitter data and the multiple groups of compensation data, and correspondingly stores the multiple groups of jitter data, the multiple groups of compensation data and the multiple groups of image data;

the processor acquires the correspondingly stored multiple groups of jitter data, compensation data and image data from the image sensor through the third link, so that the electronic anti-shake module performs electronic compensation on the multiple groups of image data according to the multiple groups of jitter data, the compensation data and the jitter data acquired when shooting the previous frame of image.

In a possible implementation manner, the image sensor and the optical anti-shake module are further connected through a fifth link, and before the image sensor receives the plurality of sets of shake data and the plurality of sets of compensation data, the method further includes:

when the image sensor starts to collect the multiple groups of image data, a first specified signal is sent to the gyroscope through the second link, so that the gyroscope sends the multiple groups of jitter data to the image sensor through the second link when receiving the first specified signal;

and sending the first specified signal to the optical anti-shake module through the fifth link, so that the optical anti-shake module sends the multiple sets of compensation data to the image sensor through the third link when receiving the first specified signal.

In one possible implementation, the method further includes:

when the image sensor starts to collect image data of each line of the multiple groups of image data, sending a second specified signal to the gyroscope through the second link, so that when the gyroscope receives the second specified signal, sending jitter data of the image data corresponding to the line indicated by the second specified signal to the image sensor through the second link;

and sending the second specified signal to the optical anti-shake module through the fifth link, so that the optical anti-shake module sends compensation data of image data corresponding to the row indicated by the second specified signal to the image sensor through the third link when receiving the second specified signal.

In a possible implementation manner, the multiple sets of jitter data and the multiple sets of compensation data both carry timestamp information when received by the image sensor, and the multiple sets of image data carry timestamp information when acquired by the image sensor; the image sensor correspondingly stores the plurality of groups of shaking data, the plurality of groups of compensation data and the plurality of groups of image data, and the method comprises the following steps:

when the image sensor receives the multiple groups of shake data and the multiple groups of compensation data, for each group of shake data in the multiple groups of shake data, the compensation data which is the same as the time stamp information carried by the shake data is determined from the multiple groups of compensation data, the image data which is the same as the time stamp information is determined from the multiple groups of image data, and the shake data, the compensation data and the image data are correspondingly stored.

In one possible implementation, before the processor and the image sensor are further connected through the sixth link, and the processor acquires the corresponding stored multiple sets of jitter data, multiple sets of compensation data, and multiple sets of image data from the image sensor through the third link, the method further includes:

sending a data acquisition instruction to the image sensor through the sixth link, wherein the data acquisition instruction is used for instructing the image sensor to send the correspondingly stored multiple sets of jitter data, multiple sets of compensation data and multiple sets of image data to the processor through the fourth link;

the image sensor is configured to feed back a transmission completion signal to the processor through the sixth link after the transmission of the plurality of sets of shake data, the plurality of sets of compensation data, and the plurality of sets of image data is completed.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

in the electronic device provided by the disclosure, the image sensor can acquire multiple groups of image data of a current frame image and simultaneously acquire multiple groups of jitter data and multiple groups of compensation data through the second link and the third link, and correspondingly store the multiple groups of jitter data, the multiple groups of compensation data and the multiple groups of image data for subsequent supply to the processor, and the electronic anti-shake module in the processor performs electronic compensation. Therefore, the synchronism among the jitter data, the compensation data and the image data can be ensured, the problem that when the jitter data and the compensation data are acquired by issuing a data reading instruction through the processor, the data are lost or the electronic compensation effect is poor due to the fact that the processor cannot issue the data reading instruction in time is avoided, and meanwhile the problem that the received jitter data and the received compensation data are asynchronous due to the fact that long time is consumed is also avoided.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a schematic structural diagram of an electronic device in the related art according to an embodiment of the present disclosure.

Fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

Fig. 3 is a flowchart illustrating a photographing method according to an embodiment of the present disclosure.

Fig. 4 is a schematic structural diagram of another electronic device shown in the embodiment of the present disclosure.

Fig. 5 is a schematic structural diagram of another electronic device shown in the embodiment of the present disclosure.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

For convenience of understanding, before explaining the embodiments of the present disclosure in detail, an application scenario related to the embodiments of the present disclosure will be described.

At present, when an image is shot by using an electronic device, the shot image is blurred due to hand shake or lens shake in the shooting process, so that the image can be shot by the shooting method provided by the embodiment of the disclosure, anti-shake processing can be performed during shooting, and the shooting quality is improved.

For example, when a user takes a video through a mobile phone, the camera easily shakes due to hand shake, so that the taken image is not clear. In order to avoid this situation, shooting can be performed by the shooting method provided by the embodiments of the present disclosure, so that the shake of the lens can be compensated, and a clear image can be shot.

For another example, when a user takes an image with a camera, the camera may shake due to collision of external factors, and at this time, the shooting method provided by the embodiment of the present disclosure may be used to take a picture to eliminate the influence caused by the shake of the camera, so as to take a high-quality image.

Of course, the embodiments of the present disclosure may be applied to not only the two application scenarios, but also other application scenarios, and the embodiments of the present disclosure do not list other application scenarios one by one.

In the related art, when the electronic anti-shake module performs electronic compensation, the processor is required to send a data acquisition instruction to acquire shake data, compensation data and image data from the gyroscope, the optical anti-shake module and the image sensor, so that the time consumption is long, and finally the shake data, the compensation data and the image data received by the processor are asynchronous, which affects the effect of the electronic compensation. And when the processor is in a busy state, the data instruction may not be issued in time, and related data cannot be acquired in time, which is easy to cause data loss or cause that electronic compensation cannot be performed normally.

Therefore, the present disclosure provides an electronic device, in which links are added between a gyroscope and an image sensor and between the image sensor and an optical anti-shake module, so that the image sensor can rapidly acquire shake data and compensation data when acquiring image data of a current frame image, and correspondingly store the shake data, the compensation data and the image data for subsequent electronic compensation, thereby solving the problems in the related art. The photographing method proposed by the present disclosure will be explained below.

Fig. 2 is a schematic structural diagram of an electronic device shown in an embodiment of the present disclosure, and as shown in fig. 2, the electronic device includes a gyroscope 201, a lens 202, an image sensor 203, an optical anti-shake module 204, and a processor 205, the processor includes an electronic anti-shake module 2051, and the lens 202 is connected to the gyroscope 201, the image sensor 203, and the optical anti-shake module 204, respectively.

The gyroscope 201 is connected with the optical anti-shake module 204 through a first link, the gyroscope 201 is connected with the image sensor 203 through a second link, the image sensor 203 is connected with the optical anti-shake module 204 through a third link, and the image sensor 203 is connected with the processor 205 through a fourth link;

the gyroscope 201 is used for detecting multiple groups of jitter data of the lens 202 in the process of shooting the current frame image, sending the multiple groups of jitter data to the optical anti-shake module 204 through a first link, and sending the multiple groups of jitter data to the image sensor 203 through a second link;

the optical anti-shake module 204 is configured to receive the multiple sets of shake data sent by the gyroscope 201, perform optical compensation according to the multiple sets of shake data to obtain multiple sets of compensation data, and send the multiple sets of compensation data to the image sensor 203 through a third link;

the image sensor 203 is configured to acquire multiple sets of image data of a current frame image, receive the multiple sets of shake data and the multiple sets of compensation data, and store the multiple sets of shake data, the multiple sets of compensation data, and the multiple sets of image data correspondingly;

the processor 205 is configured to obtain the plurality of sets of shaking data, the plurality of sets of compensation data, and the plurality of sets of image data stored correspondingly from the image sensor 203 through the third link, so that the electronic anti-shake module 2051 performs electronic compensation on the plurality of sets of image data according to the plurality of sets of shaking data, the plurality of sets of compensation data, and the plurality of sets of shaking data obtained when capturing the previous frame of image.

In the electronic device provided by the embodiment of the disclosure, when the image sensor collects multiple sets of image data of a current frame image, multiple sets of jitter data and multiple sets of compensation data can be quickly acquired through the second link and the third link, and the multiple sets of jitter data, the multiple sets of compensation data and the multiple sets of image data are correspondingly stored so as to be subsequently provided to the processor.

In a possible implementation manner, the image sensor 203 and the optical anti-shake module 204 are further connected by a fifth link, and the image sensor 203 is configured to send a first specific signal to the gyroscope 201 through the second link and send the first specific signal to the optical anti-shake module 204 through the fifth link when the multiple sets of image data start to be acquired;

the gyroscope 201 is further configured to send the plurality of sets of jitter data to the image sensor 203 through the second link when receiving the first specific signal;

the optical anti-shake module 204 is further configured to send the plurality of sets of compensation data to the image sensor 203 through the third link when receiving the first specific signal.

In a possible implementation manner, the image sensor 203 is further configured to send a second specified signal to the gyroscope 201 through a second link and send the second specified signal to the optical anti-shake module 204 through a fifth link when starting to acquire each line of image data of the plurality of sets of image data;

the gyroscope 201 is further configured to send, when receiving the second specifying signal, jitter data of image data corresponding to the row indicated by the second specifying signal to the image sensor 203 through the second link;

the optical anti-shake module 204 is configured to send compensation data of the image data corresponding to the row indicated by the second designation signal to the image sensor 203 through the third link when receiving the second designation signal.

In one possible implementation manner, the multiple sets of jitter data and the multiple sets of compensation data both carry timestamp information when received by the image sensor 203, and the multiple sets of image data carry timestamp information when collected by the image sensor 203;

the image sensor 203 is further configured to, when receiving the plurality of sets of shake data and the plurality of sets of compensation data, determine, for each of the plurality of sets of shake data, compensation data that is identical to time stamp information carried by the shake data from the plurality of sets of compensation data, determine, from the plurality of sets of image data, image data that is identical to the time stamp information, and store the shake data, the compensation data, and the image data in association with each other.

In a possible implementation manner, the processor 205 and the image sensor 203 are further connected through a sixth link, and the processor 205 is configured to send a data acquisition instruction to the image sensor 203 through the sixth link, where the data acquisition instruction is configured to instruct the image sensor 203 to send the correspondingly stored multiple sets of jitter data, the multiple sets of compensation data, and the multiple sets of image data to the processor 205 through a fourth link;

the image sensor 203 is further configured to feed back a transmission completion signal to the processor 205 through the sixth link after the transmission of the plurality of sets of jitter data, the plurality of sets of compensation data, and the plurality of sets of image data is completed.

All the above optional technical solutions can be combined arbitrarily to form optional embodiments of the present disclosure, and the embodiments of the present disclosure are not described in detail again.

Fig. 3 is a flowchart illustrating a shooting method according to an embodiment of the present disclosure, which is applied to the electronic device illustrated in the above embodiment. As shown in fig. 3, the method comprises the steps of:

in step 301, the gyroscope detects multiple sets of shake data of the lens during capturing of the current frame image, sends the multiple sets of shake data to the optical anti-shake module through the first link, and sends the multiple sets of shake data to the image sensor through the second link.

The gyroscope is an angular motion detection device, and is used for detecting the shaking condition of the lens in the process of shooting the current frame image and outputting the shaking data of the lens, wherein the shaking data detected by the gyroscope comprises the shaking direction and the angular velocity of the lens, and the angular velocity is used for indicating the shaking angle of the lens in unit time.

The gyroscope and the optical anti-shake module are connected through a first link, the gyroscope and the image sensor are connected through a second link, the first link and the second link may be SPI (Serial Peripheral Interface) links, or of course, may also be other links, and the types of the first link and the second link may be the same or different, which is not limited in the embodiment of the present disclosure.

Generally, when a video is shot, multiple frames of images need to be shot, the multiple frames of images form the video, and when a lens shakes for multiple times in the process of shooting one frame of image, the gyroscope detects the multiple groups of shaking data. The gyroscope can send multiple groups of currently detected jitter data to the optical anti-shake module according to the requirement of the optical anti-shake module so as to supply the optical anti-shake module to perform subsequent optical compensation. And simultaneously, the gyroscope sends the multiple groups of jitter data to the image sensor according to the requirement of the image sensor so as to be stored by the image sensor subsequently.

It should be noted that the gyroscope detects the shake condition of the lens according to a first preset frequency, and sends a group of shake data to the optical anti-shake module and the image sensor every time the group of shake data is detected.

In step 302, the optical anti-shake module receives the multiple sets of shake data sent by the gyroscope, performs optical compensation according to the multiple sets of shake data to obtain multiple sets of compensation data, and sends the multiple sets of compensation data to the image sensor through the third link.

The image sensor and the optical anti-shake module are connected by a third link, where the third link may be an IIC (Inter-Integrated Circuit) link, and of course, may also be another link, which is not limited in this disclosure.

When the optical anti-shake module performs multiple optical compensation, the position of the compensation lens group in the lens can be adjusted according to one group of shake data in the multiple groups of shake data to perform one optical compensation to obtain one group of compensation data, so that the position of the compensation lens group is adjusted multiple times according to the multiple groups of shake data to perform multiple optical compensation to obtain multiple groups of compensation data.

It should be noted that the compensating lens set is a movable lens set located in the lens. During shooting, the captured image becomes blurred because the light collected by the lens when it shakes is inclined. Then, in order to improve the shooting quality, the electronic device can adjust the collected light by moving the compensation lens group, so that the stability of the light path is kept, and the shooting effect is ensured.

For each group of jitter data in the multiple groups of jitter data, the optical anti-shake module may determine a target position of the compensation lens group according to the jitter data, and then adjust the position of the compensation lens group, so that the compensation lens group is located at the target position. At this time, the compensation lens group located at the target position can correct the collected light, so that primary optical compensation is performed on the light path with the shake, and the situation that the shot image is fuzzy in the shooting process is prevented.

Wherein the target position determined each time the optical compensation is performed can be calculated from the shake data detected this time. In fact, the angle of the lens shake in the detection period of the gyroscope may be obtained according to the angular velocity obtained from the gyroscope and the detection period of the gyroscope, and then the angle is multiplied by the focal length of the compensation lens group to obtain the displacement corresponding to the angular velocity. The target position can then be determined from the shake direction of the lens and the resulting amount of displacement.

It should be noted that the optical anti-shake module performs optical compensation according to the second preset frequency, and sends a set of compensation data to the image sensor every time a set of compensation data is obtained. The second preset frequency may be the same as or different from the first preset frequency for detecting the lens shake data by the gyroscope, for example, the second preset frequency is smaller than the first preset frequency. The first predetermined frequency and the second predetermined frequency are the same as an example in the embodiment of the present disclosure.

In step 303, the image sensor collects multiple sets of image data of the current frame image, receives the multiple sets of shaking data and the multiple sets of compensation data, and stores the multiple sets of shaking data, the multiple sets of compensation data, and the multiple sets of image data correspondingly.

The image sensor is connected with the lens, when the lens shoots the current frame image, the image sensor collects multiple groups of image data of the current frame image, the image sensor can receive the multiple groups of shake data and the multiple groups of compensation data while collecting the multiple groups of image data, and then the received multiple groups of shake data, the multiple groups of compensation data and the collected multiple groups of image data are correspondingly stored.

It should be noted that the image data of the current frame image may be divided into multiple lines of image data, and the image sensor may collect the image data of the current frame image line by line. Each line of image data may be used as a set of image data, or each line of image data may be divided into a plurality of sets of image data according to the time length for acquiring each line of image data, or multiple lines of image data may be used as a set of image data. The disclosed embodiments are not limited thereto.

The sampling rate of the image sensor when acquiring the multiple sets of image data is usually not less than a first preset frequency when the gyroscope detects shaking data of the lens and a second preset frequency when the optical anti-shaking module performs optical compensation. The sampling rate determines whether each set of image data corresponds to a set of shaking data and compensation data or to a plurality of sets of compensation data and a plurality of sets of shaking data. When the sampling rate is the same as the first preset frequency and the second preset frequency, one group of image data corresponds to one group of jitter data and one group of compensation data; when the sampling rate is less than the first preset frequency and the second preset frequency, one group of image data corresponds to a plurality of groups of jitter data and a plurality of groups of compensation data. In the following embodiments of the present disclosure, the sampling rate of the image sensor acquiring the sets of image data is consistent with the first preset frequency and the second preset frequency.

In a possible implementation manner, the image sensor is further connected with the optical anti-shake module through a fifth link, and when the image sensor starts to collect the multiple sets of image data, the image sensor sends a first specified signal to the gyroscope through the second link, so that when the gyroscope receives the first specified signal, the multiple sets of shake data are sent to the image sensor through the second link; the image sensor sends a first specified signal to the optical anti-shake module through a fifth link, so that the optical anti-shake module sends the multiple groups of compensation data to the image sensor through a third link when receiving the first specified signal.

The fifth link may be a PIO (Programming Input/Output) link, and of course, may also be other links, which is not limited to the embodiment of the present disclosure.

The first designation signal is sent when the image sensor starts to collect the image data of the current frame image, that is, the first designation signal is sent once before the image sensor collects the image data of each frame image. The first specific signal may be a VSync (Vertical Synchronization) signal, i.e., a frame Synchronization signal, but the first specific signal may also be other signals, which is not limited by the embodiment of the present disclosure.

When the image sensor starts to collect the multiple groups of image data, a first designated signal is sent to the gyroscope and the optical anti-shake module, and when the gyroscope receives the first designated signal, the image sensor detects shake data of the current lens. And when the optical anti-shake module receives the first designated signal, acquiring the group of shake data to perform optical compensation to obtain a group of compensation data. Simultaneously, the image sensor acquires a set of image data. Therefore, it can be considered that the set of image data is currently acquired by the image sensor, the set of shake data detected by the gyroscope and the set of compensation data obtained by the optical anti-shake module are generated simultaneously. It is therefore necessary to store the set of shake data, the set of compensation data, and the set of image data, which are generated simultaneously, in correspondence. As time goes on, the image sensor performs corresponding storage a plurality of times, so that a plurality of sets of shake data, a plurality of sets of compensation data, and a plurality of sets of image data are stored correspondingly. Therefore, the synchronism of the multiple groups of jitter data, the multiple groups of compensation data and the multiple groups of image data can be ensured, and a good foundation is laid for subsequent electronic compensation.

It should be noted that, the image sensor acquires the multiple sets of shake data and the multiple sets of compensation data by sending the first specific signal to the gyroscope and the optical anti-shake module, and due to the fact that the acquired data amount is large, errors may occur in synchronization among the shake data, the compensation data and the image data.

In a possible implementation manner, when the image sensor starts to acquire each line of image data of the multiple sets of image data, the image sensor sends a second specified signal to the gyroscope through the second link, so that when the gyroscope receives the second specified signal, the gyroscope sends jitter data of the image data corresponding to the line indicated by the second specified signal to the image sensor through the second link; and the image sensor sends a second specified signal to the optical anti-shake module through a fifth link, so that the optical anti-shake module sends compensation data of the image data corresponding to the row indicated by the second specified signal to the image sensor through a third link when receiving the second specified signal.

When the image sensor starts to collect the next line of image data, sending a second specified signal to the gyroscope through a second link so as to obtain the jitter data of the line of image data from the gyroscope; and the image sensor sends a second specified signal to the optical anti-shake module through a fifth link to obtain the compensation data of the line of image data from the optical anti-shake module. That is, when the image sensor starts to collect image data of each line, a second specified signal is sent to the gyroscope and the optical anti-shake module to obtain shake data and compensation data of the image data of each line.

The second specifying signal is sent when the image sensor collects image data of each line of the current frame image, the second specifying signal is sent once before the image sensor collects image data of each line of the current frame image, and the second specifying signal may be a Horizontal Synchronization (HSync) signal, that is, a line Synchronization signal. Of course, the second specific signal may be other signals, which is not limited to the embodiment of the disclosure.

In another possible implementation manner, the multiple sets of jitter data and the multiple sets of compensation data both carry timestamp information when received by the image sensor, and the multiple sets of image data carry timestamp information when acquired by the image sensor; when the image sensor receives the plurality of sets of shake data and the plurality of sets of compensation data, for each set of shake data in the plurality of sets of shake data, compensation data identical to time stamp information carried by the shake data is determined from the plurality of sets of compensation data, image data identical to the time stamp information is determined from the plurality of sets of image data, and the shake data, the compensation data and the image data are correspondingly stored.

When receiving any one set of shake data, the image sensor generates time stamp information of the set of shake data according to the current time, and carries the time stamp in the set of shake data. When the image sensor receives any one group of compensation data, time stamp information of the group of compensation data is generated according to the current time, and the time stamp is carried in the group of compensation data. When the image sensor collects any group of image data, time stamp information of the group of image data is generated according to the current time, and the time stamp is carried in the group of image data.

Because the image sensor, the gyroscope and the optical anti-shake module are connected through the link, the data sending speed through the link is high, the consumed time is almost negligible, the image sensor receives the multiple groups of shake data and the multiple groups of compensation data and is almost synchronous with the collected multiple groups of image data, namely, the time stamp information of the multiple groups of shake data, the multiple groups of compensation data and the multiple groups of image data is corresponding, and each group of shake data, each group of compensation data and each group of image data with the same time stamp information are correspondingly stored, so that the correspondence among the shake data, the compensation data and the image data is more accurate, and the effect of subsequent electronic compensation can be improved.

In step 304, the processor obtains the plurality of sets of shaking data, the plurality of sets of compensation data and the plurality of sets of image data from the image sensor through the third link, so that the electronic anti-shake module electronically compensates the plurality of sets of image data according to the plurality of sets of shaking data, the plurality of sets of compensation data and the plurality of sets of shaking data obtained when the last frame of image was captured.

The third link may be an MIPI (Mobile Industry Processor Interface) link, and of course, may also be other links, which is not limited to the embodiment of the present disclosure.

It should be noted that in the shooting method provided by the embodiment of the present disclosure, when the gyroscope detects a set of shake data of the lens during shooting of the current frame image, the set of shake data is sent to the image sensor. And the optical anti-shake module acquires the group of shake data to perform optical compensation, and sends the group of compensation data to the image sensor when acquiring a group of compensation data. The image sensor collects a group of image data, receives the group of shaking data sent by the gyroscope and the compensation data sent by the optical anti-shaking module, and correspondingly stores the group of shaking data, the group of compensation data and the group of image data. Over time, the image sensor may correspondingly store a plurality of sets of shaking data, a plurality of sets of compensation data, and a plurality of sets of image data of the current frame image. The processor acquires shake data, compensation data and image data which are correspondingly stored by the image sensor, and for any group of image data, the electronic anti-shake module performs electronic compensation on the group of image data according to a group of shake data, a group of compensation data and a group of shake data acquired when a previous frame of image is shot, wherein the group of shake data corresponds to the group of image data, and the group of compensation data is acquired when the previous frame of image is shot until the electronic compensation is completed on each group of image data, and at the moment, the electronic compensation on the current frame of image is completed. And then processing the next frame of image according to the process until the electronic compensation is completed on the whole shot video.

In a possible implementation manner, when the processor receives the multiple sets of shake data, the multiple sets of compensation data, and the multiple sets of image data, an electronic anti-shake module in the processor may calculate a relative motion vector between the multiple sets of image data and the multiple sets of image data of the previous frame image according to the multiple sets of compensation data, the multiple sets of shake data, and the multiple sets of shake data obtained when the previous frame image is captured, and adjust the multiple sets of image data according to the relative motion vector to perform electronic compensation on the multiple sets of image data of the current frame image.

In the related art, it takes a long time for the processor gyroscope and the optical anti-shake module to issue a data reading instruction to acquire shake data and compensation data, the compensation data is usually transmitted between the processor and the optical anti-shake module through an IIC link, and the processor also sends control information to the image sensor through the IIC link. Therefore, in order not to affect the transmission of the control information, only a limited bandwidth can be used when the compensation data is transmitted, but the data size of the compensation data is large, and a long time is required for transmission, so that the timestamp information of the compensation data received by the processor is affected, the jitter data, the compensation data and the image data are not synchronized, and the sampling rate of the jitter data and the compensation data acquired by the processor is low.

In addition, when the processor is in a busy state, a data reading instruction may not be issued in time, and then the jitter data detected by the current gyroscope and the compensation data obtained by the optical anti-jitter module may not be obtained in time. When the gyroscope and the optical anti-shake module receive a data reading instruction, the previous shake data and compensation data may be lost, and at this time, the shake data and the compensation data may not be acquired, or the acquired shake data and the compensation data are shake data and compensation data corresponding to image data acquired later, but not shake data and compensation data corresponding to the current frame image. If the electronic compensation is performed by using the shake data and the compensation data, the image data of the current frame image is not electronically compensated, resulting in poor compensation effect.

The embodiment of the disclosure directly and quickly obtains multiple groups of jitter data and multiple groups of compensation data through the second link and the third link when the image sensor collects multiple groups of image data of a current frame image, the data transmission speed is fast and can be ignored, so that the sampling rate of the image sensor for obtaining the jitter data and the compensation data can be ensured, and the problem that the jitter data and the compensation data are not synchronous due to long time consumption when the processor issues a data reading instruction to obtain the jitter data and the compensation data in the related technology is avoided.

The image sensor correspondingly stores the multiple groups of shake data, the multiple groups of compensation data and the multiple groups of image data, and the subsequent processor directly acquires the multiple groups of compensation data, the multiple groups of shake data and the multiple groups of image data which are correspondingly stored from the image sensor.

In a possible implementation manner, the processor is further connected with the image sensor through a sixth link, the processor sends a data acquisition instruction to the image sensor through the sixth link, and the data acquisition instruction is used for instructing the image sensor to send the correspondingly stored multiple sets of jitter data, multiple sets of compensation data and multiple sets of image data to the processor through a fourth link; after the image sensor finishes sending the multiple groups of jitter data, the multiple groups of compensation data and the multiple groups of image data, a sending finish signal is fed back to the processor through a sixth link.

The sixth link may be an IIC link, and certainly, may also be another link, which is not limited to this embodiment of the present disclosure.

When the processor is not fully occupied, a data acquisition instruction can be sent to the image sensor through the sixth link, so that the image sensor feeds back the multiple sets of correspondingly stored shake data, the multiple sets of compensation data and the multiple sets of image data through the fourth link, and the electronic anti-shake module in the processor can respectively perform electronic compensation on the multiple sets of image data according to the multiple sets of shake data, the multiple sets of compensation data and the multiple sets of shake data acquired when the last frame of image is shot, so that the electronic compensation on the current frame of image is realized, and the quality of the shot video is improved.

In a possible implementation manner, after the image sensor sends the correspondingly stored multiple sets of jitter data, compensation data and image data to the processor through the fourth link, the image sensor may feed back a sending completion signal to the processor through the sixth link to prompt the processor that the data sending is successful.

To sum up, in the shooting method provided by the embodiment of the present disclosure, multiple sets of shake data of the lens during shooting of the current frame image are detected by the gyroscope, the multiple sets of shake data are sent to the optical anti-shake module through the first link, and the multiple sets of shake data are sent to the image sensor through the second link. The optical anti-shake module receives the multiple groups of shake data sent by the gyroscope, performs optical compensation according to the multiple groups of shake data to obtain multiple groups of compensation data, and sends the multiple groups of compensation data to the image sensor through a third link. The image sensor collects multiple groups of image data of a current frame image, receives the multiple groups of shaking data and the multiple groups of compensation data, and correspondingly stores the multiple groups of shaking data, the multiple groups of compensation data and the multiple groups of image data. Because the speed of sending data through the link is high, the image sensor directly obtains the jitter data and the compensation data through the second link and the third link, the consumed time is almost negligible, the frequency of obtaining the jitter data and the compensation data can be ensured, and the problem of data loss caused by the fact that a processor cannot issue a data reading instruction in time in the related art is solved. And the image sensor receives the multiple groups of shake data and the multiple groups of compensation data while collecting the multiple groups of image data of the current image, so that the synchronism among the shake data, the compensation data and the image data is ensured, and the problem of unsynchronization of the received shake data and the compensation data caused by long time consumption when the shake data and the compensation data are acquired by issuing a data reading instruction through the processor is avoided. And then, the processor acquires the correspondingly stored multiple groups of jitter data, compensation data and image data from the image sensor through a third link, so that the electronic anti-shake module performs electronic compensation on the multiple groups of image data according to the multiple groups of jitter data, the compensation data and the jitter data acquired when the last frame of image is shot. The electronic compensation is performed by directly acquiring the synchronous jitter data, the compensation data and the image data stored in the image sensor, so that the electronic compensation effect is enhanced, and the problem of poor compensation effect caused by the fact that a processor cannot issue a data reading instruction in time in the related art is solved.

For ease of understanding, the shooting method provided by the above embodiment is exemplified next with reference to the electronic apparatus shown in fig. 4.

1. When the image sensor 403 starts to acquire image data of the current frame image, the first specific signal is sent to the gyroscope 401 through the second link, and the first specific signal is sent to the optical anti-shake module 404 through the fifth link.

2. The gyroscope 401, upon receiving the first designation signal, transmits sets of shake data of the lens in the process of capturing the current frame image to the image sensor 403 through the second link.

3. The optical anti-shake module 404 transmits a plurality of sets of compensation data to the image sensor 403 through the third link upon receiving the first designation signal.

The plurality of sets of compensation data are obtained by performing optical compensation on the plurality of sets of jitter data, and the plurality of sets of jitter data are obtained from the gyroscope 401 through the first link.

4. The image sensor 403 acquires a plurality of sets of image data of the current frame image, receives the plurality of sets of shaking data and the plurality of sets of compensation data at the same time, and then stores the plurality of sets of shaking data, the plurality of sets of compensation data, and the plurality of sets of image data correspondingly.

5. The processor 405 sends a data acquisition instruction to the image sensor 403 through the sixth link, when the image sensor 403 receives the data reading instruction, the image sensor sends the correspondingly stored multiple sets of shake data, the multiple sets of compensation data and the multiple sets of image data to the processor 405 through the fourth link, and the electronic anti-shake module 4051 in the processor 405 electronically compensates the multiple sets of image data according to the multiple sets of shake data, the multiple sets of compensation data and the multiple sets of shake data acquired when shooting the previous frame of image.

Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. For example, the electronic device 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 5, the electronic device 500 may include one or more of the following components: processing component 502, memory 504, power component 506, multimedia component 508, audio component 510, input/output (I/O) interface 512, sensor component 514, and communication component 516.

The processing component 502 generally controls overall operation of the electronic device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 502 may include one or more processors 520 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.

The memory 504 is configured to store various types of data to support operations at the electronic device 500. Examples of such data include instructions for any application or method operating on the electronic device 500, contact data, phonebook data, messages, pictures, videos, and the like. The memory 504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 506 provides power to the various components of the electronic device 500. The power components 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power supplies for the electronic device 500.

The multimedia component 508 includes a screen that provides an output interface between the electronic device 500 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 500 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 500 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 504 or transmitted via the communication component 516. In some embodiments, audio component 510 further includes a speaker for outputting audio signals.

The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the electronic device 500. For example, the sensor assembly 514 may detect an open/closed status of the electronic device 500, the relative positioning of components, such as a display and keypad of the electronic device 500, the sensor assembly 514 may also detect a change in the position of the electronic device 500 or a component of the electronic device 500, the presence or absence of user contact with the electronic device 500, the orientation or acceleration/deceleration of the electronic device 500, and a change in the temperature of the electronic device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 516 is configured to facilitate wired or wireless communication between the electronic device 500 and other devices. The electronic device 500 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the methods provided by the embodiments illustrated in fig. 3 and described above.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 504 comprising instructions, executable by the processor 520 of the electronic device 500 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An electronic device is characterized by comprising a gyroscope, a lens, an image sensor, an optical anti-shake module and a processor, wherein the processor comprises the electronic anti-shake module, and the lens is respectively connected with the gyroscope, the image sensor and the optical anti-shake module;

the processor is used for acquiring the correspondingly stored multiple groups of jitter data, compensation data and image data from the image sensor through the fourth link, so that the electronic anti-shake module performs electronic compensation on the multiple groups of image data according to the multiple groups of jitter data, the compensation data and the jitter data acquired when shooting the previous frame of image.

2. The electronic device of claim 1, wherein the image sensor and the optical anti-shake module are further connected by a fifth link, and the image sensor is configured to send a first designation signal to the gyroscope through the second link and send the first designation signal to the optical anti-shake module through the fifth link when the acquisition of the plurality of sets of image data is started;

3. The electronic device of claim 2, wherein the image sensor is further configured to send a second designated signal to the gyroscope via the second link and send the second designated signal to the optical anti-shake module via the fifth link when beginning to acquire each line of image data of the plurality of sets of image data;

4. The electronic device of claim 1, wherein the plurality of sets of jitter data and the plurality of sets of compensation data each carry timestamp information when received by an image sensor, the plurality of sets of image data carrying timestamp information when acquired by the image sensor;

5. The electronic device of claim 1, wherein the processor is further connected to the image sensor via a sixth link, the processor being configured to send data acquisition instructions to the image sensor via the sixth link, the data acquisition instructions being configured to instruct the image sensor to send the correspondingly stored sets of jitter data, the sets of compensation data, and the sets of image data to the processor via the fourth link;

6. A photographing method applied to an electronic apparatus according to any one of claims 1 to 5, the method comprising:

the processor acquires the correspondingly stored multiple groups of jitter data, compensation data and image data from the image sensor through the fourth link, so that the electronic anti-shake module performs electronic compensation on the multiple groups of image data according to the multiple groups of jitter data, the compensation data and the jitter data acquired when shooting the previous frame of image.

7. The method of claim 6, wherein the image sensor and the optical anti-shake module are further connected by a fifth link, the method further comprising, before the image sensor receives the plurality of sets of shake data and the plurality of sets of compensation data:

8. The method of claim 7, wherein the method further comprises:

9. The method of claim 6, wherein the plurality of sets of jitter data and the plurality of sets of compensation data each carry timestamp information when received by an image sensor, the plurality of sets of image data carrying timestamp information when acquired by the image sensor; the image sensor correspondingly stores the plurality of groups of shaking data, the plurality of groups of compensation data and the plurality of groups of image data, and the method comprises the following steps:

10. The method of claim 6, wherein the processor is further connected to the image sensor via a sixth link, the method further comprising, prior to the processor obtaining the corresponding stored sets of jitter data, compensation data, and image data from the image sensor via the third link: