WO2020042090A1 - Image display method and apparatus, and image processing device - Google Patents

Abstract

An image display method and apparatus in an image processing system, and an image processing device. The image processing system comprises a collection apparatus and a display apparatus, wherein the collection apparatus is connected to the display apparatus, and the collection apparatus is used to collect image data. The image display method comprises: the display apparatus receiving a collection synchronization signal (S201), and generating, according to the received collection synchronization signal, a display synchronization signal for instructing the display apparatus to display the image data, so that the display apparatus displays the image data (S202). By using the method, an image collected by a collection apparatus and an image displayed by a display apparatus being out-of-step can be avoided, thereby achieving accurate synchronization.

Description

Image display method, device and image processing equipment Technical field

The present invention relates to the field of image processing technology, and in particular, to an image display method, device, and image processing device.

Background technique

Drones are unmanned aircrafts controlled by radio remote control equipment and self-provided program control devices. Drones were originally designed for use in wars. With the development of the information age, more advanced information processing and communication technologies have been adopted. Used in drones, the types of drones are increasing. Therefore, the current drones can be applied in many fields such as aerial photography, miniature selfies, wildlife observation, news reporting, power inspection, film and television shooting, and many other fields.

Among them, in applications such as aerial photography and miniature self-timer, image data must be collected and displayed, so an image display system needs to be configured on the drone. A general image system includes an image acquisition module and an image display module. The image acquisition module is responsible for collecting image data, and the image display module is responsible for displaying image data. Because the display system scheduling is implemented by software control, in practical applications, it is difficult to achieve synchronization between the image acquisition module and the image display module, which results in the out-of-sync phenomenon of the acquired and displayed images.

Summary of the Invention

Embodiments of the present invention provide an image display method, device, and image processing device, which can accurately synchronize an image acquisition device and an image display device.

In one aspect, an embodiment of the present invention provides an image display method in an image processing system. The image processing system includes an acquisition device and a display device, the acquisition device is connected to the display device, and the acquisition device is used to acquire image data, including:

Receiving, by the display device, the acquisition synchronization signal, and the acquisition synchronization signal corresponds to image data collected by the acquisition device;

The display device generates a display synchronization signal based on the acquisition synchronization signal to display image data.

On the other hand, an embodiment of the present invention further provides an image display device. The image display device is configured in an image processing system. The image processing system further includes a capture device, and the capture device is connected to the image display device. The acquisition device is used to acquire image data, and the image display device includes:

A receiving unit, configured to receive the acquisition synchronization signal, where the acquisition synchronization signal corresponds to image data collected by the acquisition device;

A processing unit, configured to generate a display synchronization signal based on the acquisition synchronization signal to display image data.

In yet another aspect, an embodiment of the present invention provides an image processing device. The image processing device includes an acquisition device and a display device. The acquisition device is connected to the display device. The acquisition device is used to acquire image data. The display device includes a display processor and a display screen. The display processor includes a frame synchronization controller and a display controller. The frame synchronization controller is configured to:

Receiving the acquisition synchronization signal, where the acquisition synchronization signal and the image data collected by the acquisition device correspond to each other;

A display synchronization signal is generated based on the acquisition synchronization signal to display image data. In another aspect, an embodiment of the present invention provides a computer storage medium. The computer storage medium stores computer program instructions, and when the computer program instructions are executed, they are used to implement the image display method in the image processing system.

The image display method in the embodiment of the present invention may be applied to an image processing system including a capture device and a display device. The capture device is connected to the display device in the image processing system, and the capture device is mainly used to capture image data. When the display device receives the acquisition synchronization signal sent by the acquisition device, the display device generates a display synchronization signal based on the acquisition synchronization signal, so as to display image data according to the display synchronization signal, and generates a display of the display device by using the acquisition synchronization signal of the acquisition device. The synchronization signal can avoid the step loss between the image captured by the acquisition device and the image displayed by the display device, and achieve accurate synchronization.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without paying creative labor.

FIG. 1 is a result diagram of an image processing system provided by an embodiment of the present invention; FIG.

2 is a flowchart of an image display method according to an embodiment of the present invention;

3 is a schematic diagram of a method for determining a time point when triggering image display is provided according to an embodiment of the present invention;

4 is a schematic diagram of a method for determining an initial time point according to an embodiment of the present invention;

5 is a flowchart of a method for generating a display synchronization signal based on acquiring a synchronization signal according to an embodiment of the present invention;

6a is a schematic diagram of a method for finding and collecting a synchronization signal according to an embodiment of the present invention;

6b is a schematic diagram of another method for finding and collecting a synchronization signal according to an embodiment of the present invention;

7 is a flowchart of another method for acquiring a synchronization signal and generating a display synchronization signal according to an embodiment of the present invention;

8 is a schematic structural diagram of an image display device according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a result of an image processing device provided by an embodiment of the present invention.

detailed description

An embodiment of the present invention provides an image display method for an image processing system, and the image processing system may be configured in an image processing device such as a drone, an aerial photography aircraft, and a camera that needs to collect and display images. In one embodiment, the image processing system may include an acquisition device and a display device. The acquisition device is connected to the display device. The acquisition device is used to trigger the acquisition of image data when the acquisition synchronization signal is detected. The display device is used to display the image data. The image data displayed by the device is processed image data collected by the acquisition device.

In one embodiment, during the image acquisition, the acquisition device corresponds to an acquisition synchronization signal for each frame of the image, that is, each acquisition of image data is accompanied by an acquisition synchronization signal, and the acquisition synchronization signal is the same as the image data. Correspondingly, the acquisition synchronization signal described herein may be generated by the acquisition device, or may also be generated by a control device (such as a control chip) related to the acquisition device. The acquisition device may include an image acquisition module and an image signal processing module, and the image acquisition module is connected to the image signal processing module. In one embodiment, the image acquisition module may be an image acquisition device configured with an image sensor, such as a camera. The image data collected by the image acquisition module is the original image, and its format is RAW. RAW images record some raw data when the image acquisition module collects image data. For example, if the image acquisition mode is a camera, the raw information of the camera sensor is recorded in the RAW format original image, and the ISO setting, shutter speed, aperture value, white balance, etc. of the image data captured by the camera are also recorded. The image acquisition module sends the collected original image to the image signal processing module. The image signal processing module processes the original image. The processing process includes, but is not limited to, black level correction, lens distortion correction, RAW domain noise reduction processing, and RAW domain conversion. For the RGB domain and color compensation, the image data processed by the image signal processing module is the image data to be displayed by the display device. In one embodiment, the image signal processing module stores the processed image in a memory of the image display device.

In one embodiment, when the display device displays the image data, it first generates a display synchronization signal, and then displays the image data based on the indication of the display synchronization signal. The display device may include a display processor and a display screen, and the display processor may further include a frame synchronization controller and a display controller. The frame synchronization controller is mainly used to generate a display synchronization signal and send the display synchronization signal to the display controller; The display controller controls the display device to display image data based on the display synchronization signal. In an embodiment, the display device displaying the image data based on the indication of the display synchronization signal may refer to: after the frame synchronization controller generates the display synchronization signal, the display synchronization signal is passed to the display controller, and the display controller receives the display synchronization signal After that, the processed image data collected by the acquisition device is acquired from the memory of the image processing device, and the image data here is sent to the display screen so that the display screen can display the image data display screen. The display image data is completed.

1 is a structural diagram of an image processing system according to an embodiment of the present invention. The image processing system shown in FIG. 1 includes an acquisition device and a display device. The acquisition device includes an image acquisition module, an image processing module, and a display device. The display processor includes a display processor and a display screen. The display processor includes a frame synchronization controller and a display controller. The image acquisition module of the acquisition device is connected to the display processor of the display device. In one embodiment, the image acquisition module of the acquisition device and the display processor of the display device may be connected by a hard wire. In other embodiments, the image acquisition module and the display processor may be connected by other means.

In one embodiment, the image acquisition module of the acquisition device is used to acquire image data; the image processing module of the acquisition device is used to process the image data collected by the image acquisition module, and send the processed image data to the image processing The device's memory. In still another embodiment, when generating image data, a corresponding acquisition synchronization signal is generated. The acquisition synchronization signal may be sent to the display device through the acquisition device, so that the display device displays the image data based on the acquisition synchronization signal, which can ensure the acquisition. The device captures the image and the display device displays the image in synchronization.

In one embodiment, the acquisition synchronization signal generated in the acquisition device may be generated according to the acquisition frequency of the acquisition device. Assuming that the acquisition frequency of the acquisition device is 30 FPS, the acquisition device generates an acquisition synchronization signal every 1/30 second. In another embodiment, the acquisition synchronization signal generated by the acquisition device may also be generated according to the acquisition speed of the acquisition device. In practical applications, an appropriate method may be selected to generate the acquisition synchronization signal according to different application scenarios. In the embodiment of the present invention, Not specifically limited.

In one embodiment, the display processor of the display device shown in FIG. 1 is connected to the image acquisition module of the acquisition device, so that the acquisition device can transmit the acquisition synchronization signal to the display processor, and the frame synchronization controller in the display processor A display synchronization signal is generated according to the acquired synchronization signal, and then the generated display synchronization signal is transmitted to a display controller, so that the display controller controls the display screen to display image data.

Please refer to FIG. 2, which is an image display method according to an embodiment of the present invention. The image display method can be applied to the image processing system shown in FIG. 1. The image processing system can be configured in any image acquisition and display system. In image processing equipment, such as drones, aerial vehicles and cameras. The image display method shown in FIG. 2 will be specifically described below with reference to the architecture diagram of the image display system shown in FIG. 1. In one embodiment, the image display method described in FIG. 2 is applied in a case where the acquisition frequency of the acquisition device and the display frame rate of the display device are different.

In the image display method shown in FIG. 2, the display device receives the acquisition synchronization signal sent by the acquisition device in S201. The acquisition synchronization signal herein may be generated by the acquisition device or generated by a control device (such as a control chip) related to the acquisition device. In one embodiment, the acquisition synchronization signal received by the display device may be transmitted through a hard wire connected to the acquisition device, or may be transmitted by other means.

After the display device receives the acquisition synchronization signal, it generates a display synchronization signal based on the acquisition synchronization signal in S202 to display image data. The display synchronization signal is used to instruct the display device to display image data. The display device generates the display synchronization signal for displaying the image data based on the acquisition synchronization signal. It can be understood that: to ensure the display device and the acquisition device achieve accurate synchronization, the display device must Based on the acquisition synchronization signal of the acquisition device, it is determined when the display synchronization signal is generated to display the image data.

In one embodiment, before the acquisition device in FIG. 1 sends an acquisition synchronization signal to the display device, it may first send an acquisition reference synchronization signal to the display device. After receiving the acquisition reference synchronization signal, the display device generates a display reference synchronization signal for triggering the start of image display. The acquisition reference synchronization signal is used to indicate when the acquisition device starts to collect the first frame of image data, and the display reference synchronization signal is used to indicate when the display device starts to display the first frame of image data. It can also be understood that the collection reference synchronization signal is used to indicate when the collection device starts to work, and the display reference synchronization signal is used to indicate when the display device starts to work.

In an embodiment, after the display device receives the acquisition reference synchronization signal sent by the acquisition device, the display device may generate a display reference synchronization signal for triggering the image display to start: the display device may use the acquisition reference synchronization signal according to the acquisition reference synchronization signal. And image data processing delay, determining a time point when triggering image display is triggered; and the display device generates the display reference synchronization signal at the determined time point. The image data processing delay may refer to the time between the acquisition of the original image data by the acquisition device and the processing of the original image data to obtain the image data that can be used for display.

In one embodiment, the image data processing delay can be set according to the time required for the image processing module in the acquisition device to process the original image data collected by the image acquisition module. For example, if the time required for the image processing module to process the original image data is 5 seconds, the image processing delay can be set to 5 seconds, or the image processing delay can be set to be greater than 5 seconds, such as 8 seconds. Understandably, setting a larger image processing delay can ensure that during the image data processing process, if the original image processing error or the original image is damaged, the original image data will be re-acquired and processed in a timely manner without affecting. The display device normally displays image data. The display device determines the display reference synchronization signal according to the acquisition reference synchronization signal and the image processing delay, which effectively solves the problem of the time consuming of the image data from the acquisition device to the display device, and further ensures that the acquisition device and the display device achieve accurate synchronization.

In one embodiment, the display device may determine the time point when triggering the image display according to the acquisition reference synchronization signal and the image processing delay by: determining the time point when the acquisition device generates the acquisition reference synchronization signal; The time point of collecting the reference synchronization signal is delayed backward by the time length indicated by the image data delay, and the time point obtained after the delay is determined as the time point when the display device triggers to start image display. For example, as shown in FIG. 3, it is a schematic diagram of determining a time point when triggering image display is provided according to an embodiment of the present invention. In FIG. 3, assuming that the time point t represents the time point when the acquisition device generates the acquisition reference synchronization signal, and the image processing delay is set to 5 seconds, then the time point t + 5 represents the time point when the display device triggers to start image display.

In one embodiment, the implementation manner that the S202 generates the display synchronization signal based on the acquisition synchronization signal may be: according to the time point when the display device originally generates the display synchronization signal and the time when the synchronization signal is collected, at the time when the display synchronization signal was originally generated Look for the acquisition synchronization signal within a preset time range, and generate a display synchronization signal at the time point when the acquisition synchronization signal is found. In this way, as soon as the acquisition device acquires image data, the display device can display the newly acquired The image data enables accurate synchronization between the acquisition device and the display device.

In one embodiment, the step S202 of generating a display synchronization signal based on the acquisition synchronization signal includes: determining, by the display device, an initial time point for displaying image data based on a display frame rate; and the display device according to the initial time point and the Collecting a synchronization signal generates a display synchronization signal. The display frame rate refers to the number of frames displayed per second on the display screen. For example, 30FPS refers to displaying 30 frames of image data per second, and 60FPS refers to displaying 60 frames of image data per second. The initial time point refers to a time point when the display device should originally generate a display synchronization signal and display an image.

In an embodiment, the determining the initial time point of the display image data based on the display frame rate may include: the display device determines a refresh time interval of the display image data according to the display frame rate; and the display device generates a display reference based on The time point and refresh interval of the synchronization signal determine the initial time point. The time point when the display reference synchronization signal is generated refers to the time point when the display device starts to display the first frame of image data. The display frame rate refers to the number of frames of image data displayed per second. The time interval between each frame of image data can be calculated by 1 / frame rate. For example, the display frame rate is 30FPS, which means that 30 frames of image data are displayed in one second. , The time interval for displaying image data every two frames, that is, the refresh interval for displaying image data is 1/30 = 0.033 seconds, that is, the display device displays one frame of image data every 0.033 seconds. Further, according to the time interval of displaying the image data of every two frames, if the time point at which the image data is displayed is known, the initial time point of any one frame of image data can be determined. For example, assuming that the time point when the display device generates the reference synchronization signal is 0.02 seconds and the display frame rate of the display device is 30 FPS, the refresh time interval of the display device to display the image data is calculated to be 0.033 seconds. The time point of the frame image data is 0.02 + 0.033 = 0.053 seconds.

In an embodiment, the manner in which the display device determines the initial time point based on the time point at which the display reference synchronization signal is generated and the refresh time interval may be: first determine that the image data to be displayed is the frame data Based on the current frame of image data, the time difference between the time point when the current image data was originally displayed and the time point when the reference synchronization signal is generated is finally determined. Finally, the time difference is added to the time point when the reference synchronization signal is generated. The time point is the time point at which the current image data was originally displayed, that is, the initial time point.

A simple example, as shown in Figure 4, is a method for determining the initial time point. Assuming that the display frame rate of the display device is 60 FPS, the refresh interval for the display device to display image data is 0.0167 seconds. Assume that the current image to be displayed The data is the image data of the third frame, so the time difference between the original display of the image data of the third frame and the time point when the reference synchronization signal is generated is 2 * 0.0167 = 0.034 seconds; assuming that the time point when the display device generates the reference synchronization signal is 0.1 second Here, based on the above assumption, the display device may determine that the initial time point for displaying the image data of the third frame is 0.1 + 0.034 = 0.134 seconds.

Referring to FIG. 5, a flowchart of a method for generating a display synchronization signal according to an initial time point and acquiring a synchronization signal according to an embodiment of the present invention is shown. In the method for generating a display synchronization signal according to the initial time point and the acquisition synchronization signal shown in FIG. 5, the display device first searches for the acquisition synchronization signal according to the initial time point in S501. In order to ensure that each time a frame of data is collected by the acquisition device, the display device can display one frame of data. The time point when the acquisition device generates the synchronization signal and the time when the display device generates the synchronization signal should be the same, or the time difference between the two. The value is within a preset small time range. In S501, the initial time point is the time point when the display device originally generates the display synchronization signal, and the acquisition synchronization signal is searched for according to the initial time point, so that the display can adjust the time point when the display synchronization signal was originally generated according to the acquisition synchronization signal, and realize Accurate synchronization of acquisition device and display device.

In an embodiment, the implementation manner of the display device searching for and acquiring the synchronization signal according to the initial time point in S501 may be: using the initial time point as a reference time point, at a time indicated by the configured frame synchronization time window Look for acquisition synchronization signals within range. The frame synchronization time window may be pre-configured by the display device. The time range indicated by the frame synchronization time window refers to the initial time point as the reference time point and the window length of the frame synchronization window as the maximum time length for which the synchronization signal can be found. A certain time range before or after the reference time point. In order to avoid the influence between the image data of each frame, the window length of the frame synchronization time window should be shorter than the refresh time interval of the image display of the display device. For example, if the display frame rate of the display device is 30 FPS, the refresh interval of the display image data is 0.033 seconds, and the window length of the frame synchronization window should be between 0 and 0.033 seconds, for example, it can be 0.01 seconds.

For example, referring to FIG. 6a, a schematic diagram of searching for and acquiring a synchronization signal according to an embodiment of the present invention is provided. In FIG. 6a, it is assumed that the display frame rate is 60 FPS, and the window length of the frame synchronization window is set to less than 0.0167. The time range indicated by the frame synchronization window can be any time period between a and b, a indicates that the frame synchronization window is forward. The minimum time point at which the frame can be moved. The maximum time point at which the frame synchronization window can be moved backward at point b. If the window length of the frame synchronization window is too long, for example, 0.0167 seconds, when the frame synchronization window is moved to points d and c, a situation as shown in FIG. 6b may occur, which may affect each other.

In one embodiment, if the acquisition synchronization signal is found in S502, the time point when the acquisition synchronization signal is found is determined as the target time point, and the display device generates the display synchronization signal at the target time point in S503. S503 can be understood as The display device adjusts the time point at which the image of the current frame should be displayed according to the acquisition synchronization signal of the acquisition device, thereby achieving synchronization between the acquisition device and the display device.

For example, referring to FIG. 7 is a schematic diagram of a display device generating a display synchronization signal according to an acquisition synchronization signal according to an embodiment of the present invention. In FIG. 7, it is assumed that the image processing delay is 0.01 second, the time point at which the display device generates the display reference synchronization signal is 0.01 second, it is assumed that the acquisition frequency of the acquisition device is 30 FPS, the display frame rate of the display device is 60 FPS, and then frame synchronization is assumed. The window length of the window is 0.02 seconds. According to the display frame rate and the time point when the display reference synchronization signal is generated, it can be determined that the initial time point of the second frame of data is 0.01 + 0.0167 = 0.0267 second time point. Further, the display device uses the initial time point as a reference time point and The acquisition synchronization signal is searched for within the time range indicated by the synchronization time window. Assuming that the acquisition synchronization signal is found at point A, point A is determined as the target time point, and the display device generates a display synchronization signal at point A.

In another embodiment, if the display device does not find the acquisition synchronization signal, the display device generates a display synchronization signal at an initial time point. The display device did not find the acquisition synchronization signal within the time range indicated by the frame synchronization window, indicating that the time points between the time when the acquisition device acquires the image and the image displayed by the display device are quite different. In this case, it can be considered that the acquisition device and the display The device is difficult to get synchronized. The display device may not adjust the time point of generating the display synchronization signal according to the acquisition device.

The image display method provided by the embodiment of the present invention as shown in FIG. 2 is mainly applied when the acquisition frequency of the acquisition device and the display frame rate of the display device are different, that is, when the acquisition frequency and the display frame rate are different, In order to ensure that the acquisition device captures the image and the display device displays the image in synchronization, the display device according to the embodiment of the present invention uses the acquisition device's acquisition synchronization signal as a basis to adjust the time point at which the display device generates the display synchronization signal to achieve the acquisition device at which point in time When it comes to image data, at what point in time does the display device display the image data. Using the image display method shown in FIG. 2, the display device adjusts the time point of generating the display synchronization signal according to the acquisition synchronization signal. If the display frame rate is greater than the acquisition frequency, the time point at which the display synchronization signal is generated is determined as a postponed initial time point. A certain time point; if the display frame rate is less than the acquisition frame rate, the time point at which the display synchronization signal is generated is not determined to be a certain time point earlier than the initial time point. In one embodiment, if the acquisition frequency of the acquisition device and the display frame rate of the display device are the same, the display device may not make any adjustment to the time point at which the display synchronization signal is generated, that is, the display device generates the display synchronization signal at the initial time point. To display image data.

In an embodiment, the display device may display the image data in an implementation manner: when the display device is generating the display synchronization signal, reading and searching the memory corresponding to the acquisition synchronization signal and collected by the acquisition device from the memory. Image data, and display the image data.

Based on the description of the above method embodiments, in one embodiment, an embodiment of the present invention further provides an image display device as shown in FIG. 8, the image display device is configured in an image processing system, and the image processing system further The device comprises a collecting device, and the collecting device is connected with the display device. The acquisition device is used to acquire image data. The image display device includes a receiving unit 801 and a processing unit 802:

The receiving unit 801 is configured to receive a collection synchronization signal, and the collection synchronization signal and the image data collected by the collection device correspond to each other;

The processing unit 802 is configured to generate a display synchronization signal based on the acquired synchronization signal to display image data.

In one embodiment, the acquisition device is further configured to send the acquisition reference synchronization signal to the image display device, and the processing unit 802 of the image display device is further configured to generate a display reference synchronization signal for triggering the start of image display. In one embodiment, the implementation manner of the processing unit 802 for generating a display reference synchronization signal that triggers image display is: determining a time point when the trigger starts image display according to the acquisition reference synchronization signal and image data processing delay. ; Generating the display reference synchronization signal at the determined time point.

In an embodiment, the implementation manner of the processing unit 802 for generating the display synchronization signal based on the acquisition synchronization signal is: determining an initial time point of the display image data based on the display frame rate; and generating the display time signal based on the initial time point and the acquisition synchronization signal. The synchronization signal is displayed. In an embodiment, determining an initial time point of the display image data based on the display frame rate includes: determining a refresh time interval of the display image data according to the display frame rate; and based on the time point at which the display reference synchronization signal is generated and the The refresh interval determines the initial point in time.

In one embodiment, generating a display synchronization signal according to the initial time point and the acquisition synchronization signal includes: searching for the acquisition synchronization signal according to the initial time point; if the acquisition synchronization signal is found, the search is performed on the acquisition synchronization signal. A time point at which the synchronization signal is collected is determined as a target time point; a display synchronization signal is generated at the target time point to display image data. In one embodiment, the processing unit 802 is further configured to generate a display synchronization signal at the initial time point to display image data if the acquisition synchronization signal is not found according to the initial time point.

In one embodiment, searching for the acquisition synchronization signal according to the initial time point includes: using the initial time point as a reference time point, searching for the acquisition synchronization signal within a time range indicated by the configured frame synchronization time window. In one embodiment, the processing unit is configured to generate a new display synchronization height based on the acquisition synchronization signal, and an embodiment of displaying the image data is: reading from the memory and acquiring the acquisition synchronization signal corresponding to the acquisition synchronization signal And display the image data.

In the embodiment of the present invention, after the receiving unit 801 receives the acquisition synchronization signal sent by the acquisition device, the processing unit 802 generates a display synchronization signal based on the acquisition synchronization signal to display image data, which can prevent the acquisition device from collecting the image and the display device from displaying the image. There is a step loss between the two to achieve precise synchronization.

Please refer to FIG. 9, which is a schematic block diagram of a structure of an image processing device according to an embodiment of the present invention. The image processing device shown in FIG. 9 may include a collection device 901, a display device 902, and a memory 903. The display device 902 and the memory 903 are connected through a bus 904. The display device 902 may include a display processor 9021 and a display screen 9022. The display processor 9021 includes a frame synchronization controller 9021a and a display controller 9021b. The memory 903 is used to store a program. Instruction and image data.

The memory 903 may include a volatile memory, such as a random-access memory (RAM); the memory 903 may also include a non-volatile memory, such as a flash memory (flash memory, solid-state drive (SSD), etc.); the memory 903 may also be a double-rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR); the memory 903 may also include a combination of the above-mentioned types of memories.

The display processor 9021 may be a central processing unit CPU. The display processor 9021 may further include a hardware chip. The above hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or the like. The PLD may be a field-programmable gate array (FPGA), a generic array logic (GAL), or the like. The display processor 9021 may also be a combination of the above structures.

In the embodiment of the present invention, the memory 903 is configured to store a computer program. The computer program includes program instructions. The display processor 9021 includes a frame synchronization controller 9021a and a display controller 9021b. The frame synchronization controller 9021a is configured to execute the memory 903. The stored program instructions are used to implement the steps of the corresponding method in the foregoing embodiments. In one embodiment, the display controller 9021b is configured to read the image data corresponding to the acquired acquisition synchronization signal from the memory 903 when the frame synchronization controller 9021a generates a display synchronization signal; the display screen 9022 is used to display an image data.

In one embodiment, the frame synchronization controller 9021a is configured to execute when calling the program instruction: receiving the acquisition synchronization signal; and generating a display synchronization signal based on the acquisition synchronization signal to display image data.

In one embodiment, the frame synchronization controller 9021a is configured to call the program instruction and further execute: after receiving the image acquisition frame reference synchronization signal, generating a display reference synchronization signal.

In one embodiment, the frame synchronization controller 9021a is configured to call the program instruction to execute and generate a display reference synchronization signal in a specific manner: determining to generate the display according to the acquisition reference synchronization signal and image data processing delay. A time point of the reference synchronization signal; and generating the display reference synchronization signal at the time point of the display reference synchronization signal.

In one embodiment, the frame synchronization controller 9021a is configured to call the program instruction to execute a specific manner of generating a display synchronization signal based on the acquisition synchronization signal: determining an initial time point of displaying image data based on a display frame rate; The initial time point and the acquisition synchronization signal generate a display synchronization signal. In one embodiment, the specific manner of determining the initial time point of the display image data based on the display frame rate is: determining the refresh time interval of the display image data according to the display frame rate; and based on the time of generating the image display frame reference synchronization signal The point and the refresh time interval determine an initial time point.

In one embodiment, the specific manner of generating a display synchronization signal according to the initial time point and the acquisition synchronization signal is: finding the acquisition synchronization signal according to the initial time point; if the acquisition synchronization signal is found, The time point at which the synchronization signal is collected is determined as a target time point; a display synchronization signal is generated at the target time point to display image data.

In one embodiment, the specific manner of searching for the acquisition synchronization signal according to the initial time point is: using the initial time point as a reference time point to search for the acquisition synchronization signal within the time range indicated by the frame synchronization time window. In one embodiment, the frame synchronization controller 9021a is configured to execute when the program instruction is called: if no acquisition synchronization signal is found, a display synchronization signal is generated at an initial time point.

A person of ordinary skill in the art can understand that all or part of the processes in the methods of the foregoing embodiments can be implemented by using a computer program to instruct related hardware. The program can be stored in a computer-readable storage medium. The program When executed, the processes of the embodiments of the methods described above may be included. The storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM).

The above disclosure is only part of the embodiments of the present invention, and of course, the scope of rights of the present invention cannot be limited by this. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.

Claims (21)

1. An image display method in an image processing system, wherein the image processing system includes an acquisition device and a display device, the acquisition device is connected to the display device, the acquisition device is used to acquire image data, and Methods include:

   Receiving, by the display device, the acquisition synchronization signal, and the acquisition synchronization signal corresponds to image data collected by the acquisition device;

   The display device generates a display synchronization signal based on the acquisition synchronization signal to display image data.
2. The method according to claim 1, wherein the acquisition device sends an acquisition reference synchronization signal used to trigger image acquisition to the display device, and the method further comprises:

   After receiving the acquisition reference synchronization signal, the display device generates a display reference synchronization signal for triggering the start of image display.
3. The method according to claim 2, wherein the generating, by the display device, a display reference synchronization signal for triggering the start of image display comprises:

   Determining, by the display device, a time point at which triggering of image display is started according to the acquisition reference synchronization signal and image data processing delay;

   The display device generates the display reference synchronization signal at the determined time point.
4. The method according to claim 2, wherein the generating a display synchronization signal based on the acquisition synchronization signal comprises:

   Determining, by the display device, an initial time point of displaying image data based on a display frame rate;

   The display device generates a display synchronization signal according to the initial time point and the acquisition synchronization signal.
5. The method according to claim 4, wherein the determining, by the display device, an initial time point of displaying the image data based on the display frame rate comprises:

   Determining, by the display device, a refresh time interval for displaying image data according to the display frame rate;

   The display device determines an initial time point based on the time point at which the display reference synchronization signal is generated and the refresh time interval.
6. The method according to claim 4, wherein the generating, by the display device, a display synchronization signal according to the initial time point and the acquisition synchronization signal comprises:

   The display device searches for and acquires a synchronization signal according to the initial time point;

   If the acquisition synchronization signal is found, the display device determines a time point at which the acquisition synchronization signal is found as a target time point;

   The display device generates a display synchronization signal at the target time point to display image data.
7. The method according to claim 6, wherein the searching, by the display device according to the initial time point, for acquiring and synchronizing signals comprises:

   The display device uses the initial time point as a reference time point to find and acquire a synchronization signal within a time range indicated by the configured frame synchronization time window.
8. The method according to claim 4-7, wherein when determining that the acquisition frequency of the acquisition device and the display frame rate of the display device are different, the display device executes the determining display based on the display frame rate Steps for the initial time point of the image data.
9. The method of claim 6, further comprising:

   If the acquisition synchronization signal is not found, the display device generates a display synchronization signal at the initial time point.
10. The method according to claim 1, wherein the display device generating a display synchronization signal based on the acquisition synchronization signal to display image data comprises:

    When the display device generates the display synchronization signal, the display device reads from the memory the image data corresponding to the acquisition synchronization signal collected by the acquisition device, and displays the image data.
11. An image display device, characterized in that the image display device is configured in an image processing system, the image processing system further includes a collection device, the collection device is connected to the image display device, and the collection device is used for Collecting image data, the image display device includes:

    A receiving unit, configured to receive the acquisition synchronization signal, where the acquisition synchronization signal corresponds to image data collected by the acquisition device;

    A processing unit is configured to generate a display synchronization signal based on the acquisition synchronization signal to display image data.
12. An image processing device, characterized in that the image processing device includes a collection device and a display device, the collection device is connected to the display device, the collection device is used to collect image data, and the display device includes display processing And a display screen, the display processor includes a frame synchronization controller and a display controller, and the frame synchronization controller is configured to:

    Receiving the acquisition synchronization signal, where the acquisition synchronization signal and the image data collected by the acquisition device correspond to each other;

    A display synchronization signal is generated based on the acquisition synchronization signal to display image data.
13. The image processing device according to claim 12, wherein the acquisition device sends the generated acquisition reference synchronization signal to the display device, and the frame synchronization controller is further configured to:

    After receiving the image acquisition frame reference synchronization signal, a display reference synchronization signal is generated.
14. The image processing device according to claim 13, wherein the specific mode used by the frame synchronization controller to generate a display reference synchronization signal is:

    Determining the time point at which the display reference synchronization signal is generated according to the acquisition reference synchronization signal and the processing delay of the image data;

    The display reference synchronization signal is generated at a time point of the display reference synchronization signal.
15. The image processing device according to claim 13, wherein a specific manner for the frame synchronization controller to generate a display synchronization signal based on the acquisition synchronization signal is:

    Determining an initial time point of displaying image data based on a display frame rate;

    A display synchronization signal is generated according to the initial time point and the acquisition synchronization signal.
16. The image processing device according to claim 15, wherein the specific manner of determining an initial time point of displaying image data based on a display frame rate is:

    Determining a refresh time interval of display image data according to the display frame rate;

    An initial time point is determined based on the time point at which the image display frame reference synchronization signal is generated and the refresh time interval.
17. The image processing device according to claim 15, wherein the specific manner of generating a display synchronization signal according to the initial time point and the acquisition synchronization signal is:

    Find and acquire a synchronization signal according to the initial time point;

    If the acquisition synchronization signal is found, determining a time point when the acquisition synchronization signal is found as a target time point;

    A display synchronization signal is generated at the target time point to display image data.
18. The image processing device according to claim 17, wherein the specific way of finding and acquiring a synchronization signal according to the initial time point is:

    Using the initial time point as a reference time point, search and acquire a synchronization signal within a time range indicated by a frame synchronization time window.
19. The image processing device according to claim 15-17, wherein when determining that the acquisition frequency of the acquisition device and the display frame rate of the display device are different, the frame synchronization controller determines based on the display frame rate Displays the initial time point of the image data.
20. The image processing device according to claim 12, wherein the frame synchronization controller is further configured to:

    If the acquisition synchronization signal is not found, a display synchronization signal is generated at the initial time point.
21. The image processing device according to claim 12, wherein the display controller is configured to read from the memory corresponding to the acquired synchronization signal when the frame synchronization controller generates a display synchronization signal. Image data; the display screen is used to display the image data.

Images