WO2023005424A1

WO2023005424A1 - Electronic device, information synchronization method, and computer readable storage medium

Info

Publication number: WO2023005424A1
Application number: PCT/CN2022/096942
Authority: WO
Inventors: 胡攀
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-07-29
Filing date: 2022-06-02
Publication date: 2023-02-02
Also published as: CN113489880A

Abstract

An electronic device, an information synchronization method, and a storage medium. The electronic device comprises an attitude sensor, an image sensor, and a driver chip; the attitude sensor is configured to collect attitude information; the image sensor is configured to collect image information; the driver chip is connected to the attitude sensor and the image sensor, respectively; the driver chip is configured to obtain synchronization signals of the attitude information and the image information, and synchronize the synchronization signals of the attitude information and the image information to obtain synchronized attitude information.

Description

Electronic device, information synchronization method, and computer-readable storage medium

This application claims the priority of the Chinese patent application with the application number 202110866304.6 and the title of the invention "electronic device, information synchronization method, and computer-readable storage medium" submitted to the China Patent Office on July 29, 2021, the entire contents of which are incorporated by reference incorporated in this application.

technical field

The present application relates to the technical field of image processing, and in particular to an electronic device, an information synchronization method, and a computer-readable storage medium.

Background technique

At present, electronic devices such as mobile phones and tablet computers are usually equipped with cameras, so as to provide users with a camera function, so that users can record what is happening around them, the scenery they see, etc. anytime and anywhere through these electronic devices. However, because the user usually holds the electronic device for shooting, and the electronic device held by the user will introduce different degrees of shaking and affect the stability of the shooting of the electronic device, resulting in poor quality of the captured image. In this case, the image needs to be compensated by means of electronic image stabilization and/or optical image stabilization.

Contents of the invention

Embodiments of the present application provide an electronic device, an information synchronization method, and a computer-readable storage medium, which can improve the accuracy of synchronization between image information and posture information.

An embodiment of the present application provides an electronic device, and the electronic device includes:

Attitude sensor for collecting attitude information;

An image sensor for collecting image information;

A driver chip, connected to the attitude sensor and the image sensor respectively, the driver chip is used to obtain the attitude information and the synchronization signal of the image information, and perform the synchronization signal of the attitude information and the image information Synchronize to obtain the synchronized attitude information.

An embodiment of the present application provides an information synchronization method, which is applied to an electronic device. The electronic device includes a driver chip, an image sensor, and an attitude sensor. The information synchronization method includes:

collecting attitude information through the attitude sensor;

Collect image information through the image sensor;

Obtaining the attitude information and the synchronization signal of the image information through the driving chip;

Synchronizing the posture information and the synchronization signal of the image information to obtain synchronized posture information.

An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the information synchronization method described above are implemented.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings that need to be used in the description of the embodiments.

FIG. 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Fig. 2 is a structural block diagram of an electronic device provided by an embodiment of the present application.

Fig. 3 is a structural block diagram of an electronic device provided by an embodiment of the present application.

Fig. 4 is a structural block diagram of an electronic device provided by an embodiment of the present application.

FIG. 5 is a schematic diagram of progressive exposure of an image sensor provided by an embodiment of the present application.

FIG. 6 is a timing diagram between frames of an image sensor provided by an embodiment of the present application.

FIG. 7 is a schematic diagram of the internal design and external wiring of the driver chip provided by an embodiment of the present application.

FIG. 8 is a schematic flowchart of an information synchronization method provided by an embodiment of the present application.

FIG. 9 is a schematic flowchart of an information synchronization method provided by an embodiment of the present application.

Fig. 10 is a structural block diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

It should be noted that the terms "first", "second" and "third" in this application are used to distinguish different objects, rather than to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or modules is not limited to the listed steps or modules, but some embodiments also include steps or modules that are not listed, or some embodiments Other steps or modules inherent to these processes, methods, products or devices are also included.

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.

Attitude sensor for collecting attitude information;

An image sensor for collecting image information;

A driver chip, connected to the attitude sensor and the image sensor respectively, the driver chip is used to obtain the attitude information and the synchronization signal of the image information, and transfer the attitude information and the synchronization signal of the image information Synchronize to obtain the synchronized attitude information.

In an optional embodiment of the present application, the driver chip includes a buffer memory and a register, the register is connected to the attitude sensor, the register is used to register the attitude information obtained from the attitude sensor, and the buffer The memory is respectively connected to the register and the image sensor, and the buffer memory is used to acquire the attitude information from the register and the synchronization signal of the image information from the image sensor, so as to transfer the acquired The gesture information is synchronized with the synchronization signal of the image information.

In an optional embodiment of the present application, the buffer memory is connected to the image sensor through a GPIO interface, and is used to obtain a synchronization signal of the image information.

In an optional embodiment of the present application, the buffer memory is further connected to the image sensor through a first SPI interface, and is configured to send the synchronized posture information to the image sensor.

In an optional embodiment of the present application, the register is connected to the attitude sensor through a second SPI interface, and is used to acquire the attitude information.

In an optional embodiment of the present application, the synchronous signal of the image information includes a frame synchronous signal and an exposure line synchronous signal, and the image sensor is used to send the frame synchronous signal and the exposure line synchronous signal to the driver chip, the drive chip is used to assign a value to the acquired attitude information according to the frame synchronization signal and the exposure line synchronization signal when the attitude information is acquired.

In an optional embodiment of the present application, the driver chip is used to obtain a frame interruption signal according to the frame synchronization signal, obtain a row interruption signal according to the exposure row synchronization signal, and obtain a row interruption signal according to the frame interruption signal and the row The interrupt signal assigns a value to the acquired attitude information.

In an optional embodiment of the present application, the electronic device further includes a driving motor and a lens, and the driving chip is connected to the driving motor;

The drive chip is also used to calculate first compensation data according to the acquired posture information, and the drive motor is used to drive the lens and/or the image sensor to move according to the first compensation data to achieve optical anti-shake.

The driving chip is further used to receive second compensation data, and the driving motor is used to drive the lens and/or the image sensor to move according to the second compensation data to achieve optical anti-shake.

In an optional embodiment of the present application, the electronic device further includes a drive motor, the drive chip is connected to the drive motor, and the drive chip is also used to determine the target from the synchronization signal of the image information signal, the drive chip turns off the control function of the drive motor according to the target signal.

In an optional embodiment of the present application, the electronic device further includes an application processor, and the application processor is configured to obtain the synchronized posture information, so as to implement electronic anti-shake and / or optical image stabilization.

In an optional embodiment of the present application, the attitude sensor includes one or more of an accelerometer, a Hall sensor, a gyroscope, a magnetometer, and a gravimeter.

The present application also provides an information synchronization method, which is applied to an electronic device, and the electronic device includes a driver chip, an image sensor, and an attitude sensor, and the information synchronization method includes:

collecting attitude information through the attitude sensor;

Collect image information through the image sensor;

In an optional embodiment of the present application, the driver chip includes a buffer memory and a register, and the acquisition of the synchronization signal of the posture information and the image information through the driver chip includes:

Obtaining the attitude information through the register;

acquiring a synchronization signal of the image information through the buffer memory;

The register buffers the attitude information to the buffer memory when the attitude information is acquired;

When the buffer memory buffers the posture information, the received synchronization signal of the image information is synchronized with the buffered posture information.

In an optional embodiment of the present application, the synchronization signal of the image information includes a frame synchronization signal and an exposure line synchronization signal, and the synchronizing the posture information and the synchronization signal of the image information includes:

When the drive chip acquires the attitude information, it assigns a value to the acquired attitude information according to the frame synchronization signal and the exposure row synchronization signal.

In an optional embodiment of the present application, the assigning the acquired posture information according to the frame synchronization signal and the exposure line synchronization signal includes:

obtaining a frame interruption signal according to the frame synchronization signal;

Obtaining a line interruption signal according to the exposure line synchronization signal;

Assigning the acquired attitude information according to the frame interruption signal and the line interruption signal.

In an optional embodiment of the present application, the electronic device further includes a drive motor and a lens, and the information synchronization method further includes:

Using the drive chip to calculate first compensation data according to the acquired attitude information, and using the drive motor to drive the lens and/or the image sensor to move according to the first compensation data to achieve optical anti-shake; or

The second compensation data is received by the drive chip, and the lens and/or the image sensor are driven to move by the drive motor according to the second compensation data to achieve optical anti-shake.

In an optional embodiment of the present application, the method further includes:

The drive chip determines the target signal from the synchronization signal of the image information;

The driving motor is controlled to stop driving the lens and/or the image sensor according to the target signal.

In an optional embodiment of the present application, the electronic device further includes an application processor, and after the synchronized posture information is obtained, the information synchronization method further includes:

sending the synchronized attitude information to the image sensor;

The image sensor sends the synchronized attitude information to the application processor;

The application processor implements electronic anti-shake and/or optical anti-shake according to the synchronized attitude information.

An embodiment of the present application provides an electronic device, an information synchronization method, and a computer-readable storage medium, wherein the execution body of the information synchronization method may be the electronic device provided in the embodiment of the present application, wherein the electronic device may be a smart phone, a tablet computer, Handheld computers, notebook computers and other devices equipped with processors and capable of data processing.

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings. Apparently, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts belong to the scope of protection of this application.

Please refer to Figure 1 and Figure 2, Figure 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application, Figure 2 is a structural block diagram of an electronic device provided by an embodiment of the present application, the electronic device 10 includes: an image sensor 110, a gesture The sensor 120 and the driver chip 130 , the electronic device 10 can be a smart phone with a camera function, wherein the image sensor 110 is used to collect image information when the electronic device 10 is shooting, and the attitude sensor is used to collect the attitude information of the electronic device 10 . The driver chip 130 is connected with the image sensor 110 and the attitude sensor 120 respectively, and the driver chip 130 is used to obtain the synchronization signal of the attitude information and the image information, and synchronize the attitude information and the synchronization signal of the image information to obtain the synchronized attitude information .

Wherein, the image sensor 110 can use the photoelectric conversion function of the photoelectric device to convert the light image on the photosensitive surface into an electrical signal proportional to the light image. The image sensor can collect image information, and can generate a synchronous signal while collecting the image information, wherein the synchronous signal can be a synchronous signal that provides a time reference and is generated when the image information is collected.

Wherein, the posture sensor 120 can collect posture information of the electronic device, and the posture information can reflect the movement change and position change of the electronic device, and the posture sensor can collect posture information after receiving the collection signal, for example, when the electronic device is in the shooting state, The attitude sensor sends a collection signal, and the attitude sensor collects attitude information of the electronic device. The attitude sensor can also collect attitude information in real time after the electronic equipment is powered on, for example, after the electronic equipment is turned on, the attitude sensor collects the attitude information of the electronic equipment.

Among them, the driver chip 130 is often used to achieve optical image stabilization. When the image sensor collects image signals, the optical components are driven according to the acquired attitude information of the attitude sensor, so as to avoid or reduce the occurrence of the image sensor in the process of capturing optical signals. Jitter phenomenon, thereby improving image quality. The driver chip provided in the embodiment of the present application is also used to realize the synchronization of posture information, and obtain the synchronized posture information, which is used to realize electronic anti-shake.

In related technologies, software is often used to generate time stamps for image information and attitude information, and to synchronize image information and attitude information through time alignment. Due to different clock sources in different hardware structures, it is easy to cause synchronization errors.

Compared with the software synchronization method that synchronizes image information and attitude information through time stamps, which may cause errors, the electronic device provided in the embodiment of the present application uses a driver chip to synchronize the synchronization signal of image information with attitude information, and through hardware synchronization. , which can improve the accuracy of synchronization between pose information and image information.

In some embodiments, the electronic device further includes a lens, a driving motor, and an application processor. Please refer to FIG. 3 , which is a structural block diagram of an electronic device provided by an embodiment of the present application.

The attitude sensor can collect attitude information of the electronic device, and the attitude sensor can include one or more of a Hall sensor (Hall), a gyroscope (Gyro), an accelerometer (Acc), a magnetometer (Magenatic) and a gravity meter (Gravity). Of course, it can also include other types of attitude sensors. The attitude information can reflect the movement and position changes of the electronic device. The attitude sensor can collect the attitude information after receiving the acquisition signal. The sensor sends a collection signal, and the attitude sensor collects attitude information of the electronic device. The attitude sensor can also collect attitude information in real time after the electronic device is powered on, for example, after the electronic device is turned on, the attitude sensor collects the attitude information of the electronic device.

The drive chip is connected to the attitude sensor and the drive motor respectively, and the drive motor can drive the lens and/or the image sensor to move to achieve optical image stabilization. Exemplarily, the drive chip can be used as a control module for the drive motor, and the drive motor can include controlling the focus of the lens motors, motors that control lens motion for optical compensation, and/or motors that control image sensor motion. As a control module, the drive chip can include a control algorithm based on optical compensation. The drive chip can calculate the drive amount of the drive motor according to the read attitude information, so that the drive motor can drive the lens and/or the image sensor to move, so as to realize optical compensation. anti-shake. In some embodiments, the control logic for the driver chip to implement optical image stabilization may be as follows:

After the driver chip reads the attitude information of the attitude sensor (Gyro, Acc, Mag and/or Gravity), it performs a filtering operation on the read attitude information to obtain the filtered attitude information, and integrates and gains the filtered attitude information Operation, used to calculate the amount of shaking of the electronic device, the driver chip obtains the position information of the current lens and/or image sensor through the Hall sensor (Hall), whether it is the position information of the lens or the position information of the image sensor, or the position information of the lens And the position of the image sensor is related to the number and position of the Hall sensor. The drive chip calculates the optical compensation data (such as first compensation data) of the lens and/or image sensor according to the shake amount of the electronic device and the current position information of the lens and/or image sensor, and sends a drive signal to the drive motor according to the first compensation data , to enable the drive motor to drive the lens and/or the image sensor to move to a target position, so as to achieve optical image stabilization. Among them, the realization of optical image stabilization through the drive chip is a real-time high-frequency feedback control process, and the drive motor can stably drive the lens and/or image sensor to the target position through PID (Proportion Integral Differential) control.

In the related optical anti-shake technology, the driver chip only needs to continuously adjust the position of the lens and/or image sensor in real time according to the current shaking situation of the electronic device. However, the factors that affect the imaging effect of the image are only the time when the image sensor is exposed. Jitter, for the jitter in other non-exposure time, since the image sensor has no imaging, it has no effect. The relevant optical image stabilization technology needs to continuously adjust the lens and/or the image sensor, resulting in unnecessary overhead for electronic equipment.

Based on this, in order to reduce the unnecessary overhead of electronic equipment and reduce the power consumption of electronic equipment, the driver chip can synchronize the attitude information with the synchronization signal of the collected image information, and dynamically control the drive motor according to the synchronized attitude information, thereby avoiding Overhead of image sensor non-exposure time, reducing power consumption of electronic devices.

The driver chip is also connected to the image sensor for obtaining the synchronization signal of the image information collected by the image sensor, generating the synchronization signal of the image information when the image sensor collects the image signal, and sending the synchronization signal of the image information to the driver chip, and the driver chip receives After the synchronization signal of the image information, the current attitude information obtained from the attitude sensor is synchronized with the synchronization signal of the image information to obtain the synchronized attitude information, and the drive chip dynamically controls the drive motor through the above method according to the synchronized attitude information, so that the drive The chip and drive motor achieve optical image stabilization during the exposure time of the image sensor.

In some embodiments, after the driver chip obtains the synchronized posture information, it sends the synchronized posture information to the image sensor, and the image sensor sends the synchronized posture information to the application processor, and the application processor sends the synchronized posture information to the application processor according to the synchronized posture information. Information realizes electronic anti-shake, and electronic anti-shake processing refers to anti-shake processing that uses edge images for compensation. Specifically, EIS (Electric Image Stabilization, Electronic Image Stabilization) needs to rely on the attitude information of the electronic device to synchronize with the collected image information, and needs to correspond to the attitude of the electronic device when it is shot corresponding to each frame of image information. After acquiring the synchronized attitude information, the application processor processes the collected image information through an algorithm according to the synchronized attitude information.

Please continue to refer to FIG. 4 , which is a structural block diagram of an electronic device provided by an embodiment of the present application. The driver chip can be connected to the attitude sensor through a serial peripheral interface (SPI interface) to obtain the attitude information collected by the attitude sensor. The driver chip can be connected to the image sensor through a general-purpose input and output interface (GPIO interface). A synchronous signal generated when the image sensor collects image information is acquired, wherein the synchronous signal may be a synchronous signal generated when the image sensor collects image information, and the synchronous signal may include a frame synchronous signal and an exposure line synchronous signal.

For example, the image sensor can collect image information by row-by-row exposure, and the image sensor can collect image information by row-by-row exposure through the rolling shutter. One line is exposed sequentially, so when collecting each line of image information, the attitude information of the electronic device can be the same or different. For each line of image information, the corresponding attitude information is the attitude sensor within the exposure time period of the line. The collected attitude information, wherein, due to the timing of the image frame that is independently controlled inside the image sensor, the frame synchronization signal can refer to a vertical synchronization pulse signal (Vertical synchronization, Vsync), and the image sensor generates once every time the image sensor acquires image frame data Frame synchronization signal, the frame synchronization signal reflects the frame number of the current exposure image frame of the image sensor. When one line of image frames is used, an exposure line synchronous signal is generated once, and the exposure line synchronous signal reflects the line number of the image sensor currently exposing the image frame.

Please continue to refer to FIG. 5 , which is a schematic diagram of progressive exposure of an image sensor provided by an embodiment of the present application. Among them, Exposure Time is the exposure time period, SOF is the time point for data readout, Read out Time is the time period required for data readout, Hsync represents the line synchronization signal generated at the time point when each row is half exposed, and Vsync represents It is the frame synchronization signal generated at the time point when the whole frame image is exposed to the middle line when the exposure is halfway through.

When the image sensor starts to expose and collect image signals row by row, the frame sync signal and exposure row sync signal are sent to the driver chip every time the frame sync signal (Vsync) and exposure row sync signal (Hsync) are generated, and the GPIO interface of the driver chip receives When the image sensor sends a frame synchronization signal, a corresponding frame interruption signal is generated. When the GPIO interface receives the line synchronization signal sent by the image sensor, a corresponding line interruption signal is generated. For example, when the image sensor exposes the first line of the first frame image, it sends a frame synchronization signal and an exposure line synchronization signal to the driver chip, and the GPIO interface of the driver chip generates the first frame image after receiving the frame synchronization signal Corresponding to the frame interruption signal, the GPIO of the driver chip generates the line interruption signal corresponding to the first row of the first frame image after receiving the exposure line synchronization signal, and the first attitude information obtained from the attitude sensor is compared according to the frame interruption signal and the line interruption signal. For assignment, the frame interrupt signal and line interrupt signal can reflect the corresponding frame number and line number, so as to establish the mapping relationship between the frame number, line number and the first attitude information, and obtain the synchronized attitude information, which can be followed by the first The frame number of the frame image information and the line number of the first line are aligned to the first pose information. For another example, when the image sensor exposes the second row of the first frame image, it sends a frame synchronization signal and an exposure line synchronization signal to the driver chip, and the GPIO interface of the driver chip generates a frame interrupt signal corresponding to the first frame image after receiving the frame synchronization signal , the GPIO interface of the driver chip receives the exposure line synchronization signal and generates the line interruption signal corresponding to the second line of the first frame image, and assigns the second attitude information obtained from the attitude sensor according to the frame interruption signal and the line interruption signal. The interrupt signal and line interrupt signal can reflect the corresponding frame number and line number, so as to establish the mapping relationship between the frame number, line number and the second attitude information, and obtain the synchronized attitude information, which can be followed by the first frame of image information. The frame number and the row number of the second row are aligned to the second pose information.

In some embodiments, due to the difference in sampling frequency, the row-by-row exposure speed is faster, and one attitude information can correspond to multiple rows of exposure image information. For example, when the driver chip receives the third attitude information sent from the attitude sensor, the driver chip from The image sensor acquires the frame interruption signal representing the exposure of the first frame of image and the line interruption signal of exposing the 20th to 30th lines, and establishes the mapping relationship between the third posture data, the frame number and the exposure line number. When receiving the fourth attitude information sent from the attitude sensor, the driver chip received the line interrupt signal indicating the exposure of the first frame image from the 31st line to the forty line, but did not receive the frame interruption signal indicating the exposure of the second frame image signal to establish a mapping relationship between the fourth pose data, frame number and exposure line number. It can be understood that the frame number and the row number may be data identifiers generated by the internal counter of the driver chip after receiving the frame interrupt signal and the row interrupt signal. The data identifier can be a specific regular value or other irregular value. It should be noted that the above synchronization method is only exemplary, and the driver chip can also realize the synchronization of attitude information through other hardware synchronization methods.

It can be understood that when the driver chip acquires the posture information, the posture information is synchronized according to the line interruption signal and the frame interruption signal, and the posture information corresponding to each exposure line image information can be SOF+Readout_per_line*Line_number–Exposure_time/2 The image information between the time point and the time point of Readout_per_line*(Line_number+1)–Exposure_time/2 is synchronized, wherein, Readout_per_line is the time period required for reading each line of data, Line_number is the number of lines, and Line_number is a natural number. The attitude information obtained between the above two time points can be assigned to the corresponding line number, and the image sensor can control the exposure time and timing, and also control the readout timing of each line of exposure, so it can be accurate at the time when a line is half exposed Send the frame synchronization signal to the driver chip when the exposure line synchronization signal and the entire frame image are exposed to the middle row. The driver chip realizes the synchronization of attitude information according to the exposure line synchronization signal and the frame synchronization signal.

Please combine FIG. 5 and FIG. 6 , and FIG. 6 is an inter-frame timing diagram of an image sensor provided by an embodiment of the present application. When the image sensor collects image frame (Frame) information, the shutter (Shuttr) is opened to generate Hsync and Vsync. Among them, when the exposure reaches the middle position of each row, Hsync is generated and read out and sent to the driver chip, and half of the exposure is performed when the exposure reaches the middle row. The time point is read out (Reaout) and sent to the driver chip. Since the Vsync driver chip of each frame of the image sensor can receive it, the attitude information obtained between two adjacent Vsyncs can be used as the attitude information of this frame, and the received Hsync represents the position of each line in each frame. attitude information. Vsync can identify the first attitude information of this frame until the target signal (Hsync) that is exposed to the last line of this frame is identified to identify the last attitude information of this frame. The control function of the drive chip for the drive motor can be turned off when the target signal of the last line of each frame is received and the exposure is stopped, and the control function of the drive chip for the drive motor can be turned on when the exposure of the first line of each frame starts, so that the drive chip can only be in the It only works when the frame image is exposed, so that the power consumption of the overall system can be reduced.

Please continue to refer to Figure 4. After the attitude information is synchronized, the driver chip can be connected to the image sensor through the SPI interface, and the synchronized attitude information can be sent to the image sensor through the SPI interface, so that the image sensor can compare the image frame data with the synchronized The attitude information is packaged to form synchronized information, and the image sensor sends the synchronized information to the application processor, wherein the image sensor can be connected to the application processor through a mobile industry processor interface (MIPI interface). Receive the synchronized attitude information through the image processor and then package it with the image frame data and send it to the application processor, which can not only improve the accuracy of the time synchronization between the attitude information and the image frame data, but also realize the synchronization of different data streams in the whole system Obtaining from the same source can then integrate two kinds of data in one thread, which can avoid synchronous waiting for processing due to the time difference between obtaining different data through asynchronous threads, reduce system complexity, and improve system stability.

The application processor splits the packaged data after receiving it, and sends the image frame data to the image processor. The image processor can implement electronic anti-shake for the collected image information according to the algorithm and the synchronized attitude information, for example, according to the synchronization The post-posture information performs pose estimation, pose filtering, and image torsion processing on the image frame data to achieve electronic anti-shake. The application processor can also perform feedback adjustment to the driver chip according to the synchronized pose information. The synchronized attitude information obtains the reset information of the lens and/or image sensor, and sends the reset information to the driver chip, and the driver chip resets the optically stabilized lens and/or image sensor according to the reset information to complete the optical image stabilizer.

In some embodiments, in order to reduce the data processing amount of the driver chip, the application processor may include an optical anti-shake algorithm, the application processor may obtain the attitude information of the attitude sensor, and calculate the optical compensation data according to the attitude information and the optical anti-shake algorithm ( Such as the second compensation data), the second compensation data is sent to the driver chip, and the driver chip enables the drive motor to drive the lens and/or the image sensor to move to the target position according to the second compensation data, so as to achieve optical anti-shake, and the driver chip Only the synchronization of attitude information, the driving of the lens and the driving of the image sensor need to be performed, and the algorithm related to optical image stabilization can be executed in the application processor, which can reduce the data processing amount of the driver chip.

Please continue to refer to FIG. 7 , which is a schematic diagram of the internal design and external wiring of the driver chip provided by an embodiment of the present application. The driver chip can include a buffer memory and a register, the register is connected to the attitude sensor, the register is used to store the attitude information obtained from the attitude sensor, the buffer memory is connected to the register and the image sensor respectively, and the buffer memory is used to obtain the attitude information from the register and from the image sensor A synchronization signal of the image information is acquired to synchronize the acquired attitude information with the synchronization signal of the image information.

Wherein, the buffer memory can be a first-in-first-out (First Input First Output, FIFO) register, and the buffer memory can be provided with two GPIO interfaces, one GPIO interface is used to receive the interrupt signal of the frame synchronization signal (Vsync) sent by the image sensor, one The GPIO interface is used to receive the interrupt signal of the exposure line synchronization signal (Hsync) sent by the image sensor. The buffer memory is also provided with a first SPI interface, the first SPI interface can include nSC, SDO, SPC and SOI pins, and correspondingly, the image sensor can include an nSC pin connected to the driver chip nSC pin, and an SDO pin connected to the driver chip. The SDI pin connected to the pin, the SPC pin connected to the SPC pin of the driver chip, and the SDO pin connected to the SOI pin of the driver chip send the synchronized attitude information to the image sensor through the first SPI interface.

Wherein, the register is provided with a second SPI interface, and the second SPI interface can include a plurality of pins, such as CS1, CS2 ... CSn pins, SDO pins, SPC pins and SOI pins, and the attitude sensor can include accelerometers, For gyroscopes, magnetometers, etc., the attitude sensor is provided with pins corresponding to the register pins. By connecting the pins on the attitude sensor to the pins on the register, the register can obtain the attitude information collected by the attitude sensor.

In a specific application scenario, the register continuously acquires the attitude information collected by the attitude sensor through the second SPI interface, stores the acquired attitude information into the register, the FIFO memory reads the attitude information in the register, and the FIFO memory receives the Vsync interrupt signal and The interrupt signal of Hsync assigns the attitude information read according to the interrupt signal of Vsync and Hsync. The assignment method can adopt the above-mentioned assignment method to obtain the synchronized attitude information. The SPI interface is sent to the image sensor, so that the image sensor packages the attitude information and image frame data, and sends it to the application processor, so that the application processor can realize electronic anti-shake and/or optical anti-shake according to the synchronized attitude information.

When the drive chip and the image sensor were connected by the first SPI interface, the first SPI interface of the drive chip was in slave mode (slave mode), the SPI interface of the image sensor was in master mode (master mode), and the SPI interface of the image sensor was in master mode. To receive the synchronized attitude information transmitted by the first SPI interface of the driver chip in slave mode.

When the driver chip and the attitude sensor were connected through the second SPI interface, the second SPI interface of the register of the driver chip was in the master mode (master mode) and the SPI interface of the attitude sensor was in the slave mode (slave mode), and the second SPI interface of the register was in the master mode. The SPI interface is used to receive the attitude information transmitted by the SPI interface of the attitude sensor in the slave mode, and the second SPI interface in the master mode can also pass the chip selection signal (CS1, CS2... CSn pin obtained signal) from the multi-channel attitude sensor By reading the data, the attitude information of the attitude sensor can be obtained according to the actual needs. Through the design of the master-slave mode of the driver chip, the data transmission between the driver chip and the peripheral can be made selective and reliable.

The embodiment of the present application provides an electronic device, which realizes the synchronization of posture information through a driver chip, and greatly improves the synchronization accuracy of image frame data and posture information and the consistency of information processing through hardware synchronization, and reduces the gap between different devices. The difference between them can also reduce the overall system power consumption.

The driver chip provided by this application can control the drive motor to drive the lens and/or the image sensor to move according to the synchronization signal of the image information when the image sensor is exposed, so as to realize the optical anti-shake. During the exposure period, stopping the movement of the lens and/or the image sensor can reduce the power consumption of the system when optical image stabilization is implemented.

For the application of electronic anti-shake, the synchronization of the attitude information is realized through the driver chip according to the synchronization signal of the image information and the acquired attitude information. Compared with the synchronization of the image information and the attitude information through the time stamp, the synchronization method of the hardware will The way of software synchronization that causes errors can improve the accuracy of synchronization between attitude information and image information. Further, the accuracy of electronic anti-shake processing image frame data according to the synchronized posture information is improved.

For the application of optical anti-shake + electronic anti-shake (that is, further anti-shake processing of electronic anti-shake on the module with optical anti-shake function), it can not only reduce the power consumption of the optical anti-shake module, but also improve Accuracy of electronic image stabilization data processing.

The embodiment of the present application also provides an information synchronization method. Please refer to FIG. 8. FIG. 8 is a schematic flow chart of the information synchronization method provided by an embodiment of the present application. The information synchronization method is applied to electronic equipment, and the electronic equipment includes a driver chip and an image sensor. As well as attitude sensors, information synchronization methods include:

101. Collect attitude information by using an attitude sensor.

Wherein, the attitude sensor can collect the attitude information of the electronic device, and the attitude sensor can include one of a Hall sensor (Hall), a gyroscope (Gyro), an accelerometer (Acc), a magnetometer (Magenatic) and a gravimeter (Gravity). Or more, of course, can also include other types of attitude sensors. The attitude information can reflect the movement changes and position changes of the electronic equipment. The attitude sensor can collect the attitude information after receiving the collection signal. For example, when the electronic equipment is in the shooting state, The acquisition signal is sent to the attitude sensor, and the attitude sensor collects attitude information. Another example is that the attitude sensor collects attitude information in real time when the electronic device is in a power-on state.

102. Collect image information by using an image sensor.

The image sensor can use the photoelectric conversion function of the photoelectric device to convert the light image on the photosensitive surface into an electrical signal proportional to the light image. The image sensor can collect image information. For example, the image sensor can collect image information through progressive exposure, and collect image information through progressive exposure through the rolling shutter. Each line of the frame image is sequentially exposed, so when collecting each line of image information, the attitude information of the electronic device can be the same or different. For each line of image information, the corresponding attitude information is the exposure time of the line The attitude information collected by the attitude sensor in the segment.

103. Obtain the attitude information and the synchronization signal of the image information through the driver chip.

The driver chip is connected to the attitude sensor and the image sensor respectively, and the image sensor can generate a synchronization signal while collecting image information, wherein the synchronization signal can be a synchronization signal that provides a time reference generated when collecting the image information, for example, the image sensor passes line by line The frame synchronization signal and the exposure line synchronization signal can be generated when the exposure method collects image information. When the synchronization signal is generated, the synchronization signal is sent to the driver chip. After the attitude sensor collects the attitude information, it sends the attitude information to the driver chip. The driver chip The synchronization signal of attitude information sent by the attitude sensor and image information sent by the image sensor is received.

104. Synchronize the attitude information and the synchronization signal of the image information to obtain synchronized attitude information.

The information synchronization method provided by the embodiment of the present application can realize the synchronization of attitude information through the driver chip, and the accuracy of the synchronization of attitude information and image information can be improved through hardware synchronization, compared with software synchronization through time stamps.

The embodiment of the present application also provides an information synchronization method. Please continue to refer to FIG. 9. FIG. 9 is a schematic flow diagram of the information synchronization method provided in an embodiment of the present application. Sensors and attitude sensors, information synchronization methods include:

201. Collect attitude information by using an attitude sensor.

Wherein, the attitude sensor can collect the attitude information of the electronic device, and the attitude sensor can include one of a Hall sensor (Hall), a gyroscope (Gyro), an accelerometer (Acc), a magnetometer (Magenatic) and a gravimeter (Gravity). Or more, attitude information can include the Hall value obtained by the Hall sensor (Hall), the angular velocity value obtained by the gyroscope (Gyro), the acceleration value obtained by the accelerometer (Acc), the magnetic force value obtained by the magnetometer (Magentic) and The gravity value obtained by the gravimeter (Gravity) can also include other types of attitude sensors, of course. The attitude information can reflect the movement and position changes of the electronic device. The attitude sensor can collect the attitude information after receiving the acquisition signal, for example, in When the electronic device is in the shooting state, it sends a collection signal to the attitude sensor, and the attitude sensor collects attitude information. Another example is that the attitude sensor collects attitude information in real time when the electronic device is in a power-on state.

202. Collect image information by using an image sensor.

203. Acquire posture information and a synchronization signal of image information through the drive chip, where the synchronization signal of image information includes a frame synchronization signal and an exposure line synchronization signal.

Wherein, since there is an autonomously controlled image frame timing inside the image sensor, the frame synchronization signal may refer to a vertical synchronization pulse signal (Vertical synchronization, Vsync). Every time the image sensor acquires image frame data, a frame synchronization signal is generated. The signal reflects the frame number of the currently exposed image frame of the image sensor. The exposure line synchronization signal may refer to a horizontal synchronization pulse signal (Horizontal synchronization, Hsync). The image sensor collects image information by means of line-by-line exposure. An exposure line synchronization signal is generated once, and the exposure line synchronization signal reflects the line number of the image sensor currently exposing the image frame.

When the image sensor starts exposure and acquisition of image signals row by row, the frame sync signal (Vsync) and the exposure row sync signal (Hsync) are generated and sent to the driver chip each time. The driving chip receives the frame synchronous signal and the exposure line synchronous signal.

204. When the driver chip acquires the attitude information, assign a value to the acquired attitude information according to the frame synchronization signal and the exposure line synchronization signal.

For example, when the image sensor is currently exposing the first frame image, it generates a frame synchronization signal reflecting the frame number. When it is exposed to the first line of the first frame image, it will generate an exposure line synchronization signal reflecting the exposure line number. The exposure row synchronization signal is sent to the driver chip, and at the same time, the driver chip receives the first posture information sent by the posture sensor. After the driver chip receives the frame synchronization signal of the first frame image and the exposure row synchronization signal generated by exposing the first row of image data , assign the frame number of the first frame image and the line number of the first line to the first attitude information according to the frame synchronization signal and the exposure line synchronization signal, establish the mapping relationship between the frame number, line number and the first attitude information, and obtain The synchronized first pose information can be subsequently aligned to the first pose information through the frame number of the first frame and the line number of the first line. The attitude information obtained when exposing to the second line in the same way is the second attitude information, assign the frame number of the first frame image and the line number of the second line to the second attitude information, and establish the frame number, line number and The mapping relationship between the second attitude information is to obtain the synchronized second attitude information, which can be subsequently aligned to the second attitude information through the frame number of the first frame and the line number of the second line.

In some embodiments, due to the difference in sampling frequency, the row-by-row exposure speed is faster, and one pose information may correspond to multiple rows of exposure image information.

It can be understood that the frame number and row number may be data identifiers generated by an internal evaluator or counter of the image sensor upon receiving a corresponding frame synchronization signal and row synchronization signal. The data identifier can be a specific regular value or other irregular value.

In some embodiments, assigning the acquired attitude information according to the frame synchronization signal and the exposure line synchronization signal may include:

Obtain a frame interruption signal according to the frame synchronization signal;

Obtain a line interruption signal according to the exposure line synchronization signal;

Among them, when the GPIO interface of the driver chip receives the frame synchronization signal sent by the image sensor, it generates a corresponding frame interruption signal. When the GPIO interface receives the line synchronization signal sent by the image sensor, it generates a corresponding line interruption signal. The interrupt signal assigns a value to the attitude information obtained from the attitude sensor. For example, when the driver chip exposes the first line of the first frame image, it sends a frame synchronization signal and an exposure row synchronization signal to the driver chip, and the GPIO interface of the driver chip receives the frame After the synchronization signal, the frame interrupt signal corresponding to the first frame image is generated, and the GPIO of the driver chip generates the row interrupt signal corresponding to the first line of the first frame image after receiving the exposure line sync signal, and the slave attitude is determined according to the frame interrupt signal and the row interrupt signal. The first attitude information acquired by the sensor is assigned, and the frame interrupt signal and line interrupt signal can reflect the corresponding frame number and line number, so as to establish the mapping relationship between the frame number, line number and the first attitude information, and obtain the synchronized The attitude information can be subsequently aligned to the first attitude information through the frame number of the first frame of image information and the line number of the first line. For another example, when the driver chip exposes the second line of the first frame image, it sends a frame synchronization signal and an exposure row synchronization signal to the driver chip, and the GPIO interface of the driver chip generates a frame interrupt signal corresponding to the first frame image after receiving the frame synchronization signal , the GPIO interface of the driver chip receives the exposure line synchronization signal and generates the line interruption signal corresponding to the second line of the first frame image, and assigns the second attitude information obtained from the attitude sensor according to the frame interruption signal and the line interruption signal. The interrupt signal and line interrupt signal can reflect the corresponding frame number and line number, so as to establish the mapping relationship between the frame number, line number and the second attitude information, and obtain the synchronized attitude information, which can be followed by the first frame of image information. The frame number and the row number of the second row are aligned to the second pose information.

In some embodiments, the driver chip includes a buffer memory and a register, and obtaining the synchronization signal of the posture information and the image information through the driver chip includes:

Obtain attitude information through registers;

Acquiring the synchronous signal of the image information through the buffer memory;

When the attitude information is buffered in the buffer memory, the synchronization signal of the received image information is synchronized with the buffered attitude information.

Wherein, synchronizing the synchronization signal of the received image information with the buffered posture information can be realized through the above synchronization method.

206. Send the synchronized attitude information to the image sensor.

207. The image sensor sends the synchronized attitude information to the application processor.

208. The application processor implements electronic image stabilization and/or optical image stabilization according to the synchronized attitude information.

Regarding steps 206-208:

The image sensor and the driver chip can be connected through the SPI interface, and the driver chip is used to send the synchronized attitude information to the image sensor through the SPI interface, so that the image sensor packages the image frame data and the synchronized attitude information to form synchronized information, The image sensor sends the synchronized information to the application processor, where the image sensor can be connected to the application processor through a mobile industry processor interface (MIPI interface). Receive the synchronized attitude information through the image processor and then package it with the image frame data and send it to the application processor, which can not only improve the accuracy of the time synchronization between the attitude information and the image frame data, but also realize the synchronization of different data streams in the whole system Obtaining from the same source can then integrate two kinds of data in one thread, which can avoid synchronous waiting for processing due to the time difference between obtaining different data through asynchronous threads, reduce system complexity, and improve system stability.

In the scenario where an electronic device implements optical image stabilization, the electronic device also includes a drive motor and a lens, and the information synchronization method also includes:

calculating the first compensation data according to the acquired posture information by driving the chip, and driving the lens and/or the image sensor to move according to the first compensation data by the driving motor to achieve optical anti-shake; or

The second compensation data is received by the driving chip, and the lens and/or the image sensor are driven to move by the driving motor according to the second compensation data to realize optical anti-shake.

Wherein, the driver chip can be integrated with an optical anti-shake algorithm. After receiving the attitude information, the first compensation data is calculated according to the optical anti-shake algorithm. The driver chip sends the first compensation data to the drive motor, enabling the drive motor to drive the lens and/or Or image sensor movement, the logic of driving the chip to achieve optical image stabilization can be as follows:

After the driver chip reads the attitude information of the attitude sensor (Gyro, Acc, Mag and/or Gravity), it performs a filtering operation on the read attitude information to obtain the filtered attitude information, and integrates and gains the filtered attitude information Operation, used to calculate the amount of shaking of the electronic device, the driver chip obtains the position information of the current lens and/or image sensor through the Hall sensor (Hall), whether it is the position information of the lens or the position information of the image sensor, or the position information of the lens And the position of the image sensor is related to the number and position of the Hall sensor. The drive chip calculates the optical compensation data (such as the first compensation data) of the lens and/or image sensor according to the shaking amount of the electronic device and the current position information of the lens and/or image sensor, and sends a drive signal to the drive motor according to the optical compensation data, To enable the drive motor to drive the lens and/or the image sensor to move to a target position to achieve optical image stabilization. Among them, the realization of optical image stabilization through the drive chip is a real-time high-frequency feedback control process, and the drive motor can stably drive the lens and/or image sensor to the target position through PID (Proportion Integral Differential) control.

Or, it is also possible to integrate some optical anti-shake algorithms into the application processor, and the application processor can obtain the attitude information of the attitude sensor, and calculate the optical compensation data (such as the second compensation data) according to the attitude information and the optical anti-shake algorithm, The application processor sends the second compensation data to the driver chip, and the driver chip sends a drive signal to the drive motor according to the optical compensation data, so as to enable the drive motor to drive the lens and/or the image sensor to move to the target position, so as to achieve optical anti-shake , the algorithms related to optical image stabilization can be executed in the application processor, which can reduce the data processing amount of the driver chip.

Based on this, in order to reduce the unnecessary overhead of electronic equipment and reduce the power consumption of electronic equipment, the driver chip can synchronize the attitude information with the synchronization signal of the collected image information, and dynamically control the drive motor according to the synchronized attitude information, thereby avoiding Overhead of image sensor non-exposure time, reducing power consumption of electronic devices. For example, the driving chip determines the target signal from the synchronous signal of the image information; according to the target signal, the driving motor is controlled to stop driving the lens and/or the image sensor to move. Specifically, when the driver chip receives the horizontal synchronous signal (target signal) of the last row of each frame to stop the exposure, it turns off the control function of the driver chip for the drive motor, and when it receives the horizontal synchronous signal of the first row of each frame to start exposure, it turns on the drive chip. The chip's control function for the drive motor can make the drive chip work only when the frame image is exposed, thereby reducing the power consumption of the overall system.

The information synchronization method provided by an embodiment of the present application, for the application of optical anti-shake, can control the drive motor to drive the lens and/or the movement of the image sensor according to the synchronization signal of the image information when the image sensor is exposed, so as to realize the optical anti-shake. The image sensor is in the non-exposure time period, and the driving lens and/or the movement of the image sensor is stopped, which can reduce the power consumption of the system when optical image stabilization is implemented. For the application of electronic anti-shake, the synchronization of the attitude information is realized through the driver chip according to the synchronization signal of the image information and the acquired attitude information. Compared with the synchronization of the image information and the attitude information through the time stamp, the synchronization method of the hardware will The way of software synchronization that causes errors can improve the accuracy of synchronization between attitude information and image information. Further, the accuracy of electronic anti-shake processing image frame data according to the synchronized posture information is improved. For the application of optical anti-shake + electronic anti-shake (that is, further anti-shake processing of electronic anti-shake on the module with optical anti-shake function), it can not only reduce the power consumption of the optical anti-shake module, but also improve Electronic anti-shake data processing is accurate.

Please continue to refer to FIG. 10. FIG. 10 is a structural block diagram of an electronic device provided by an embodiment of the present application. The electronic device provided by the present application may also include: a display screen 140, a radio frequency circuit 150, an audio circuit 160, an input unit 170, and a power supply 180 . Those skilled in the art can understand that the structure of the computer device shown in FIG. 10 does not constitute a limitation on the computer device, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

The display screen 140 can be used for displaying a graphical user interface and receiving operation instructions generated by a user acting on the graphical user interface. The display screen 140 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by or provided to the user and various graphical user interfaces of the computer equipment. These graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-Emitting Diode), or the like. The touch panel can be used to collect user's touch operations on or near it, and generate corresponding operation instructions, and the operation instructions execute corresponding programs.

The radio frequency circuit 150 can be used to send and receive radio frequency signals to establish wireless communication with network equipment or other computer equipment through wireless communication, and to send and receive signals with network equipment or other computer equipment.

The audio circuit 160 may be used to provide an audio interface between the user and the computer device through speakers, microphones. The audio circuit 160 can transmit the electrical signal converted from the received audio data to the speaker, and the speaker converts it into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is converted by the audio circuit 160 After the audio data is output and processed, the audio data is sent to another computer device through the radio frequency circuit 150 . Audio circuitry 160 may also include an earphone jack to provide communication of peripheral headphones with the computer device.

The input unit 170 can be used to receive input numbers, character information or user characteristic information (such as fingerprints, irises, face information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control .

The power supply 180 is used to supply power to various components of the computer device 400 . Optionally, the power supply 180 may be logically connected to various electronic components through a power management system, so as to implement functions such as management of charging, discharging, and power consumption through the power management system. The power supply 180 may also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

Although not shown in FIG. 10 , the computer device 400 may also include a sensor, a Wi-Fi module, a Bluetooth module, etc., which will not be repeated here.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

The embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored, and the computer program can be loaded by a processor to execute the steps in any one of the information synchronization methods provided in the embodiments of the present application.

Wherein, the storage medium may include: a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and the like.

Because the computer program stored in the computer-readable storage medium can execute the steps in any information synchronization method provided by the embodiment of the application, therefore, any information synchronization provided by the embodiment of the application can be realized For the beneficial effects that can be achieved by the method, refer to the previous embodiments for details, and will not be repeated here.

The information synchronization method, electronic device, and computer-readable storage medium provided in the embodiments of the present application have been introduced in detail above. In this paper, specific examples are used to illustrate the principles and implementation methods of the present application, and the descriptions of the above embodiments are only used to help understand the present application. At the same time, for those skilled in the art, based on the idea of this application, there will be changes in the specific implementation and application scope. In summary, the content of this specification should not be construed as limiting the application.

Claims

An electronic device, wherein the electronic device includes:

Attitude sensor for collecting attitude information;

An image sensor for collecting image information;

A driver chip, connected to the attitude sensor and the image sensor respectively, the driver chip is used to obtain the attitude information and the synchronization signal of the image information, and transfer the attitude information and the synchronization signal of the image information Synchronize to obtain the synchronized attitude information.
The electronic device according to claim 1, wherein the driver chip includes a buffer memory and a register, the register is connected to the attitude sensor, the register is used to register the attitude information obtained from the attitude sensor, the The buffer memory is respectively connected with the register and the image sensor, and the buffer memory is used to obtain the attitude information from the register and the synchronization signal of the image information from the image sensor, so as to transfer the acquired The gesture information and the synchronization signal of the image information are synchronized.
The electronic device according to claim 2, wherein the buffer memory is connected to the image sensor through a GPIO interface, and is used to obtain a synchronization signal of the image information.
The electronic device according to claim 3, wherein the buffer memory is further connected to the image sensor through a first SPI interface, for sending the synchronized attitude information to the image sensor.
The electronic device according to claim 2, wherein the register is connected to the attitude sensor through a second SPI interface for obtaining the attitude information.
The electronic device according to claim 1, wherein the synchronous signal of the image information includes a frame synchronous signal and an exposure line synchronous signal, and the image sensor is used to send the frame synchronous signal and the exposure line synchronous signal to the A driving chip, where the driving chip is configured to assign a value to the acquired attitude information according to the frame synchronization signal and the exposure line synchronization signal when the attitude information is acquired.
The electronic device according to claim 6, wherein the driver chip is used to obtain a frame interruption signal according to the frame synchronization signal, obtain a line interruption signal according to the exposure line synchronization signal, and obtain a line interruption signal according to the frame interruption signal and the The line interrupt signal assigns a value to the acquired attitude information.
The electronic device according to any one of claims 1-7, wherein the electronic device further comprises a driving motor and a lens, and the driving chip is connected to the driving motor;

The drive chip is also used to calculate first compensation data according to the acquired posture information, and the drive motor is used to drive the lens and/or the image sensor to move according to the first compensation data to achieve optical anti-shake.
The electronic device according to any one of claims 1-7, wherein the electronic device further comprises a driving motor and a lens, and the driving chip is connected to the driving motor;

The driving chip is further used to receive second compensation data, and the driving motor is used to drive the lens and/or the image sensor to move according to the second compensation data to achieve optical anti-shake.
The electronic device according to any one of claims 1-7, wherein the electronic device further comprises a driving motor, the driving chip is connected to the driving motor, and the driving chip is also used to obtain the information from the image information A target signal is determined from the synchronous signal, and the drive chip turns off the control function of the drive motor according to the target signal.
The electronic device according to any one of claims 1-7, wherein the electronic device further comprises an application processor, the application processor is configured to obtain the synchronized posture information, and to The information implements electronic anti-shake and/or optical anti-shake.
The electronic device according to any one of claims 1-7, wherein the attitude sensor comprises one or more of an accelerometer, a Hall sensor, a gyroscope, a magnetometer and a gravimeter.
An information synchronization method, which is applied to an electronic device, the electronic device includes a driver chip, an image sensor, and an attitude sensor, and the information synchronization method includes:

collecting attitude information through the attitude sensor;

Collect image information through the image sensor;

Obtaining the attitude information and the synchronization signal of the image information through the driving chip;

Synchronizing the posture information and the synchronization signal of the image information to obtain synchronized posture information.
The information synchronization method according to claim 13, wherein the driver chip includes a buffer memory and a register, and the acquisition of the synchronization signal of the posture information and the image information by the driver chip includes:

Obtaining the attitude information through the register;

acquiring a synchronization signal of the image information through the buffer memory;

The register buffers the attitude information to the buffer memory when the attitude information is acquired;

When the buffer memory buffers the posture information, the received synchronization signal of the image information is synchronized with the buffered posture information.
The information synchronization method according to claim 13, wherein the synchronization signal of the image information includes a frame synchronization signal and an exposure line synchronization signal, and the synchronization of the posture information and the synchronization signal of the image information includes:

When the drive chip acquires the attitude information, it assigns a value to the acquired attitude information according to the frame synchronization signal and the exposure line synchronization signal.
The information synchronization method according to claim 15, wherein said assigning the acquired posture information according to the frame synchronization signal and the exposure row synchronization signal comprises:

obtaining a frame interruption signal according to the frame synchronization signal;

Obtaining a line interruption signal according to the exposure line synchronization signal;

Assigning the acquired attitude information according to the frame interruption signal and the line interruption signal.
The information synchronization method according to any one of claims 13 to 16, wherein the electronic device further includes a drive motor and a lens, and the information synchronization method further includes:

Using the drive chip to calculate first compensation data according to the acquired attitude information, and using the drive motor to drive the lens and/or the image sensor to move according to the first compensation data to achieve optical anti-shake; or

The second compensation data is received by the drive chip, and the lens and/or the image sensor are driven to move by the drive motor according to the second compensation data to achieve optical anti-shake.
The information synchronization method according to claim 17, wherein the method further comprises:

The drive chip determines the target signal from the synchronization signal of the image information;

The driving motor is controlled to stop driving the lens and/or the image sensor according to the target signal.
The information synchronization method according to any one of claims 13 to 16, wherein the electronic device further includes an application processor, and after obtaining the synchronized posture information, the information synchronization method further includes:

sending the synchronized attitude information to the image sensor;

The image sensor sends the synchronized attitude information to the application processor;

The application processor implements electronic anti-shake and/or optical anti-shake according to the synchronized attitude information.
A computer-readable storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the steps of the information synchronization method according to any one of claims 13 to 19 are realized.