TWI631848B - Dynamic panoramic image synchronization system and method thereof - Google Patents

Abstract

A panoramic motion image synchronization system and method thereof, including a first image capturing module, at least one second image capturing module, and an image processing module. First, the synchronization signal generating unit of the first image capturing module generates a plurality of synchronization signals in a plurality of acquisition times in a time interval, and the first image capturing module captures a first time in each capturing time. An image material. When the second image capturing module receives the synchronization signal, at least one second image data is captured at the capturing time. The image processing module receives the first image data and the second image of each capturing time, and forms a plurality of panoramic image data according to the first image data and the second image data of the capturing time, and forms a dynamic panoramic image of the time interval.

Description

Panoramic dynamic image synchronization system and method thereof

The present invention relates to a dynamic image synchronization system and a method thereof, and more particularly to a panoramic motion image synchronization system that synchronizes a captured image with a second image capture module by a synchronization signal generated by the first image capture module and Its method.

In the mid to late twentieth century, Kodak developed the first digital camera. In recent years, due to the booming of the semiconductor industry, the advent of the Charge-coupled Device (CCD) has led to the prosperity of the digital camera industry, and digital cameras have almost replaced traditional cameras that use negatives as image storage carriers.

Due to the high development of digital camera technology, people began to study the shooting technology of panoramic images. A panoramic image is formed by splicing images taken by a plurality of image capturing devices facing different angles. In addition, in order to capture a dynamic panoramic image, images are continuously captured by the image capturing device facing the different angles, and the captured image is transmitted to the image processor.

The image processor will first depend on the time of receiving the image. The images are successively displayed in sequence, thereby forming a dynamic panoramic image. However, since the time points of the images captured by the image capturing devices are not uniform, local image delays in the dynamic panoramic image may be caused.

Since the motion of the subject in the image is slow in the normal recording mode, the image delay is less noticeable in the normal video mode. In the high-speed recording mode, when the subject in the image moves faster (for example, sports related or animal ecology), the image delay condition is highlighted in the high-speed recording mode.

In order to explain the above image delay, please refer to the first to third figures. The first figure shows a schematic diagram of the image capturing module in the prior art to be captured in the first time; A schematic diagram showing a picture of the image capturing module in the prior art to be captured in a second time; the third drawing shows a correspondence between the first image and the second image in the prior art and the panoramic image in the second time .

As shown in the figure, when two of the plurality of image capturing devices capture and return two first images PAF1 and PAF1a at a first time, the other image capturing device is not in the first time. Synchronously returning the image, but returning a second image PAF2 at a second time later than the first time. The first image PAF1, the second image PAF2, and the first image PAF1a respectively correspond to three different image areas PAP1, PAP2, and PAP3 of a panoramic image PAP, and the first images PAF1, PAF1a, and the second image PAF2 are captured. The time points are not completely consistent, and thus the image areas PAP1, PAP2, and PAP3 in the panoramic image PAP are not synchronized.

In view of the prior art, since the time points of the images captured by the image capturing devices are not uniform, a partial image region in the dynamic panoramic image is delayed.

The present invention solves the problems of the prior art, and the necessary technical means adopted is to provide a panoramic dynamic image synchronization system. The panoramic motion image synchronization system includes a first image capturing module, at least one second image capturing module, and an image processing module. The first image capturing module includes a synchronization signal generating unit for generating a plurality of synchronization signals respectively for a plurality of acquisition times in a time interval, and is configured to acquire a corresponding time for each extraction time at each extraction time. The first image data is sent and each synchronization signal is sent.

The second image capturing module is electrically connected to the first image capturing module, and is configured to capture at least one second image data at each capturing time when receiving each synchronization signal, so as to capture the first image The module and the second image capturing module respectively capture the first image data and the second image data at each capturing time. The image processing module is electrically connected to the first image capturing module and the second image capturing module, and is configured to receive the first image data of each capturing time and the second image data of each capturing time, and The first image data and the second image data of each capturing time form a plurality of panoramic image data respectively corresponding to the capturing time, and form a dynamic panoramic image according to one of the time intervals of the capturing time and the panoramic image data.

The first image capturing module further includes a first timing unit and a first image capturing unit. yuan. The first timing unit is configured to generate a first time data corresponding to each extraction time. The first image capturing unit is configured to generate a first image at each capturing time. The first image capturing module forms a first image data with the first image according to the first time data of each capturing time.

The second image capturing module includes at least one second timing unit and a second image capturing unit. The second timing unit is configured to generate at least one second time data corresponding to each extraction time. The second image capturing unit is configured to generate a second image at each capturing time. The second image capturing module forms a second image data according to the second time data of each capturing time and the second image. The image processing module combines the first image and the second image of each capture time into the panoramic image data according to the first time data and the second time data of each capture time.

On the basis of the above-mentioned necessary technical means, one of the auxiliary technical means derived from the above-mentioned panoramic dynamic image synchronization system is that the first timing unit and the second timing unit are each a clock chip or a timer.

Based on the above-mentioned necessary technical means, one of the auxiliary technical means derived from the above-mentioned panoramic dynamic image synchronization system is that the panoramic dynamic image synchronization system further comprises a signal amplification module. The signal amplifying module is electrically connected to the first image capturing module and the second image capturing module for amplifying the intensity of the synchronization signal. The signal amplification module is a buffer amplifier (Buffer Amplifiers).

On the basis of the above-mentioned necessary technical means, an auxiliary technical means derived from the above-mentioned panoramic dynamic image synchronization system is that the first image capturing module and each of the second image capturing modules are complementary metal oxide semiconductors (Complementary Metal- Oxide-Semiconductor; CMOS) image capture module.

On the basis of the above-mentioned necessary technical means, one of the auxiliary technical means derived from the above-mentioned panoramic dynamic image synchronization system is that the image processing module is a graphics processing unit (GPU) and a digital signal processor (Digital Signal Processor; DSP) and one of a Central Processing Unit (CPU).

The present invention solves the problems of the prior art, and the necessary technical means adopted is to provide a panoramic dynamic image synchronization method. The panoramic motion image synchronization method is used to control the above-mentioned panoramic motion image synchronization system. First, the synchronization signal is generated by the synchronization signal generating unit, and the first image capturing module captures the first image data at each capturing time.

Then, when the second image capturing module receives the synchronization signal, the second image data is captured at each capturing time, so that the first image capturing module and the second image capturing module are synchronized in each The capture time captures the first image data and the second image data, respectively. Next, the image processing module receives the first image data and the second image data of each capture time, and forms each panoramic image data according to the first image data and the second image data of each capture time. Finally, a dynamic panoramic image of the time interval is formed according to the acquisition time and the panoramic image data.

On the basis of the above-mentioned necessary technical means, one of the auxiliary technologies derived from the above-mentioned panoramic dynamic image synchronization method is between the first image capturing module and the second image capturing module, and a signal amplifying module is provided. Increase the strength of the sync signal.

According to the above, the panoramic dynamic image provided by the present invention In the synchronization system and the method, the first image capturing module generates a synchronization signal in addition to the first image data in the capturing time, so that the second image capturing module synchronizes the capturing time. Capture the second image data. The image processing module forms a panoramic image data corresponding to each capturing time according to the first image data and the second image data of the same capturing time, and forms a dynamic panoramic image in the time interval according to the panoramic image data of each capturing time. .

Compared with the prior art, the panoramic dynamic image synchronization system and the method thereof are provided by the first image capturing module synchronously transmitting the synchronization signal while capturing the first image data during the capturing time, so that the second image is obtained. The capture module synchronously captures the second image data in the capture time, thereby solving the prior art, because the time points of the images captured by the image capture devices are not consistent, and the partial image regions in the dynamic panoramic image are delayed. The problem.

PAF1, FAF2‧‧‧ first image

PAF2‧‧‧Second image

PAP‧‧‧ panoramic image

PAP1, PAP2, PAP3‧‧‧ image area

1‧‧‧ panoramic motion image synchronization system

11‧‧‧First image capture module

111‧‧‧Synchronous signal generating unit

112‧‧‧First timing unit

113‧‧‧First image capture unit

12‧‧‧Signal amplification module

13, 13a‧‧‧Second image capture module

131, 131a‧‧‧ second timing unit

132, 132a‧‧‧second image capture unit

14‧‧‧Image Processing Module

15‧‧‧ Storage Module

16‧‧‧Display module

17‧‧‧Electronic devices

F11, F21‧‧‧ first image

F12, F12a, F22, F22a‧‧‧ second image

I1‧‧‧ first image data

I2, I2a‧‧‧ second image data

P1, P2‧‧‧ panoramic image data

P11, P12, P12a, P21, P22, P22a‧‧‧ panoramic image local area

S‧‧‧Synchronization signal

The first figure shows a schematic diagram of the image capturing module in the prior art to be captured in the first time; the second figure shows the image to be captured in the second time by the image capturing module in the prior art. The third figure shows a schematic diagram of the correspondence between the first image and the second image in the prior art and the panoramic image in the second time; the fourth figure shows the panoramic motion image synchronization system provided by the preferred embodiment of the present invention. Block diagram 5 is a flow chart showing a method for synchronizing a panoramic motion image according to a preferred embodiment of the present invention; and a sixth diagram is a system for displaying a panoramic motion image synchronization system and a method thereof according to a preferred embodiment of the present invention. A schematic diagram of a correspondence between a first image captured by a capture time and a second image and a panoramic image thereof; and a seventh diagram showing a panoramic dynamic image synchronization system and a method thereof provided by a preferred embodiment of the present invention A schematic diagram of the correspondence between the first image and the second image and the panoramic image data acquired after the second extraction time of the first extraction time.

Please refer to the fourth figure, which is a block diagram showing a panoramic dynamic image synchronization system according to a preferred embodiment of the present invention. As shown, the preferred embodiment of the present invention provides a panoramic motion image synchronization system 1. The panoramic motion image synchronization system 1 includes a first image capturing module 11 , a signal amplifying module 12 , at least one second image capturing module 13 , 13 a (described in both embodiments), and an image. The processing module 14 , a storage module 15 , a display module 16 and an electronic device 17 .

The first image capturing module 11 includes a synchronization signal generating unit 111, a first timing unit 112, and a first image capturing unit 113. In this embodiment, the first timing unit 112 can be a clock chip or a timer, but is not limited thereto in other embodiments.

In this embodiment, the first image capturing module 11 is a Complementary Metal-Oxide-Semiconductor (CMOS) image capturing module, and The first image capturing unit 113 is a CMOS active pixel sensor. In other embodiments, the first image capturing unit 113 can be a charge-coupled device (CCD). , but not limited to this.

The signal amplifying module 12 is electrically connected to the first image capturing module 11 . In this embodiment, the signal amplifying module 12 is a buffer amplifier (Buffer Amplifier), but is not limited thereto in other embodiments. The second image capturing module 13 , 13 a is electrically connected to the signal amplifying module 12 . Incidentally, in other embodiments, the second image capturing module 13 and 13a can be directly electrically connected to the first image capturing module 11 without increasing the signal strength of the synchronization signal S through the signal amplifying module 12. .

The second image capturing modules 13 and 13a each include a second timing unit 131, 131a and a second image capturing unit 132, 132a. In this embodiment, the second timing unit 131, 131a may be a clock chip or a timer, but is not limited thereto in other embodiments.

In this embodiment, the second image capturing module 13 and 13a are complementary metal-oxide-emitting diode (CMOS) image capturing modules, and the second image capturing units 132 and 132a are In other embodiments, the second image capturing unit 132, 132a may be a charge-coupled device (CCD), but not limit.

The image processing module 14 is electrically connected to the first image capturing module 11 and the second image capturing module 13 and 13a. In this embodiment, the image processing module can be a graphics processor (Graphics) A processing unit (GPU), a central processing unit (CPU), a digital signal processor (DSP), or a microprocessor, but is not limited in other embodiments.

The storage module 15 is electrically connected to the image processing module 14 . In this embodiment, the storage module 15 can be a hard disk drive, a solid state disk, or a flash memory, but is not limited thereto. The display module 16 is electrically connected to the image processing module 14 . In this embodiment, the display module 16 can be an organic electroluminescence display (OELD), a projection display, a light emitting diode display, or a liquid crystal display, but is not limited thereto. The electronic device 17 is communicatively coupled to the image processing module 14. In this embodiment, the electronic device 17 can be a smart phone, a personal computer, or a tablet, but is not limited thereto.

Please refer to FIG. 4 to FIG. 7 together. FIG. 5 is a flowchart showing a method for synchronizing panoramic motion images according to a preferred embodiment of the present invention; and FIG. 6 is a view showing a preferred embodiment of the present invention. A schematic diagram of a corresponding relationship between a first image and a second image captured by a panoramic motion image synchronization system and a method thereof in a first acquisition time; and a seventh diagram showing the preferred embodiment of the present invention The panoramic dynamic image synchronization system and the method thereof are schematic diagrams of the correspondence between the first image and the second image and the panoramic image data acquired by the second extraction time of the first extraction time.

As shown, a preferred embodiment of the present invention provides a Panoramic motion image synchronization method. First, the synchronization signal generating unit 111 generates a plurality of synchronization signals S in a plurality of acquisition times in a time interval, and the first image capturing module 11 captures a first image data I1 at each capturing time (ie, Step S1).

The first image data I1 is generated by the first image capturing module 11 according to the first time unit corresponding to each of the capturing time and the first image capturing unit 113 according to the first timing unit 112. The first images F11 and F21 are generated. Next, the signal amplifying module 12 enhances the strength of the synchronization signal S (ie, step S2). Generally, the time interval between each capture time is 1/30 second. If the image capture is to be performed in the high speed photography mode, the time interval between each capture time may be less than 1/30 second.

Then, when the second image capturing module 13 and 13a receive the synchronization signal S, the two second image data I2 and I2a are respectively extracted during the capturing time (in the present embodiment, both are explained) (ie, the steps) S3). The second image data I2 and I2a are the second image capturing modules 13 and 13a. When the second image capturing module 13 and 13a receive the synchronization signal S, the second timing units 131 and 131a generate two. The second time data corresponding to each of the extraction times and the second image capturing units 132 and 132a are formed by generating second images F12, F12a, F22, and F22a at respective extraction times.

Next, the image processing module 14 receives the first image data I1 and the second image data I2 and I2a of each capture time, and forms a plurality of first image data I1 and second image data I2 and I2a according to the acquisition time. Panoramic image data P1, P2 (ie, step S4).

Wherein, since the second image capturing module 13, 13a is The image data (ie, the first image data I1 and the second image data I2) are captured at each capturing time in synchronization with the first image capturing module 11 according to the synchronization signal S sent by the first image capturing module 11 I2a). The image processing module 14 compares the first time data of each of the first image data I1 with the second time data of each of the second image data I2 and I2a, and captures the first image of the first image data I1 with the same time. The second images F12, F12a, F22, and F22a of F11 and F21 and the second image data I2 and I2a are joined to the panoramic image data P1 and P2.

For example, in a first capture time, the first image capturing unit 113 captures the first image F11, and generates and transmits the synchronization signal S to the second image capturing module by the synchronization signal generating unit 111. 13, 13a. When receiving the synchronization signal S, the second image capturing modules 13 and 13a cause the second image capturing units 132 and 132a to capture the second images F12 and F12a. The image processing module 14 stitches the first image F11 and the second images F12 and F12a to form a panoramic image data P1.

The panoramic image data P1 includes a plurality of panoramic image local areas P11, P12, and P12a. The first image F11 corresponds to the panoramic image local area P11, the second image F12 corresponds to the panoramic image local area P12, and the second image F12a corresponds to the panoramic image. Image local area P12a.

Then, the first image capturing unit 113 captures the first image F21, and generates and transmits the synchronization signal by the synchronization signal generating unit 111, at another second capturing time of the first capturing time. S to the second image capturing module 13, 13a. When receiving the synchronization signal S, the second image capturing modules 13 and 13a cause the second image capturing units 132 and 132a to capture the second images F22 and F22a. Image processing module 14 will be the first The image F21 is stitched with the second images F22 and F22a to form a panoramic image data P2.

The panoramic image data P2 includes a plurality of panoramic image local regions P21, P22, and P22a. The first image F21 corresponds to the panoramic image local region P21, the second image F22 corresponds to the panoramic image local region P22, and the second image F22a corresponds to the panoramic image. Image local area P22a.

Finally, a dynamic panoramic image of the time interval is formed according to the capture time and the panoramic image data P1, P2 (ie, step S5). That is to say, the image processing module 14 forms the panoramic image data P1 and P2 into a dynamic panoramic image according to the order of the capturing time corresponding to each of the panoramic image data P1 and P2. Then, the image processing module 14 transmits the dynamic panoramic image to the storage module 15 for storage. In addition, the image processing module 14 transmits the dynamic panoramic image to the display module 16 and displays the dynamic panoramic image on the display module 16 .

In addition, the image processing module 14 can also transmit the dynamic panoramic image to the electronic device 17 through wireless or wired transmission. The wireless transmission method can transmit the dynamic panoramic image by using a ZigBee transmission module, an EnOcean transmission module, a 3G/4G transmission module, a Bluetooth transmission module or a WIFI transmission module, but Not limited to this.

In summary, in the panoramic dynamic image synchronization system and the method provided by the preferred embodiment of the present invention, the first image capturing module captures the first image at each capturing time, according to the first image and the first image. The time data forms the first image data. The first image capturing module generates a synchronization signal and transmits the same image while capturing the first image at each capturing time. To the second image capture module.

The second image capturing module captures the second image at each capturing time when receiving the synchronization signal, and forms the second image data according to the second image and the second time data. The image processing module forms a panoramic image data according to the first image data and the second image data of each capturing time, and forms a dynamic panoramic image of the time interval according to the panoramic image data of each capturing time.

Compared with the prior art, the panoramic dynamic image synchronization system and the method provided by the preferred embodiment of the present invention are configured to: when the first image capturing module captures the first image at each capturing time, the synchronization signal is sent. The second image capturing module captures the second image in synchronization with each other, so that the first image capturing module and the second image capturing module capture the image in synchronization. Thereby, the problem that the time points of the images captured by the image capturing devices are inconsistent in the prior art and the partial image regions in the dynamic panoramic images are delayed is solved.

The features and spirit of the present invention will be more apparent from the detailed description of the preferred embodiments. On the contrary, the intention is to cover various modifications and equivalents within the scope of the invention as claimed.

Claims (9)

A panoramic motion image synchronization system includes: a first image capturing module, configured to capture a first image data corresponding to each of the capturing times at a plurality of capturing times, and send each of the image data The synchronization signal includes: a synchronization signal generating unit configured to generate a plurality of synchronization signals respectively at the acquisition times in a time interval; a first timing unit configured to generate a corresponding time for each of the acquisition times And the first image capturing unit is configured to generate a first image at each of the capturing times, and the first time data and the first image system form the first image data; The at least one second image capturing module is electrically connected to the first image capturing module, and is configured to capture at least one second image at each of the capturing times when receiving the synchronization signals. The first image capturing module and the at least one second image capturing module respectively capture the first image data and the at least one second image data in synchronization with the at least one second image capturing module, including : at least one second timing unit And generating, by the at least one second image capturing unit, the at least one second image is generated at each of the capturing times, and the Forming the at least one second image data with the at least one second time data and the at least one second image system; An image processing module is electrically connected to the first image capturing module and the at least one second image capturing module for receiving the first image data of each of the capturing times and each of the plurality of image capturing modules Taking at least one second image data of the time, and forming, by the first image data of each of the capturing times, the plurality of panoramic image data respectively corresponding to the capturing time And forming a dynamic panoramic image of the time interval according to the capturing time and the panoramic image data. The panoramic motion picture synchronization system of claim 1, wherein the first timing unit and the at least one second timing unit are each one of a clock chip and a timer. The panoramic motion image synchronization system of claim 1, further comprising a signal amplification module, wherein the signal amplification module is electrically connected to the first image capturing module and the at least one second image capturing system A module for amplifying the strength of the synchronization signals. The panoramic motion picture synchronization system according to claim 3, wherein the signal amplification module is a buffer amplifier (Buffer Amplifiers). The panoramic motion image synchronization system of claim 1, wherein the first image capturing module is a complementary metal An oxide semiconductor (Complementary Metal-Oxide-Semiconductor; CMOS) image capture module. The panoramic motion image synchronization system of claim 1, wherein each of the at least one second image capturing module is a complementary metal-oxide-semiconductor (CMOS) image capture system. Module. The panoramic motion picture synchronization system according to claim 1, wherein the image processing module is a graphics processing unit (GPU), a digital signal processor (DSP), and a One of the Central Processing Units (CPUs). A panoramic motion image synchronization method for controlling a panoramic motion image synchronization system according to claim 1, and comprising the steps of: (a) generating, by the synchronization signal generating unit at the acquisition times The synchronization signal is obtained, and the first image capturing module captures the first image data at each of the capturing times; (b) when the at least one second image capturing module receives the synchronization signals The at least one second image data is captured in the capture time, so that the first image capture module and the at least one second image capture module are respectively synchronized in each of the capture times. Taking the first image data and the at least one second image data; (c) the image processing module receives the first image data and the at least one second image data of each of the capture times, and the first image data and the at least one And (d) forming the dynamic panoramic image of the time interval according to the capturing time and the panoramic image data. The panoramic dynamic image synchronization method according to claim 8, wherein the step (a) and the step (b) further comprise a step (e), wherein the step (e) is performed by a signal The amplification module enhances the strength of the synchronization signals.