TWM541406U - Vehicular image integration system - Google Patents

Description

Vehicle image integration system

This creation is about an image integration system, and in particular, a vehicle image integration system for integrating images captured by various image sensors of a vehicle.

Since the industrial revolution, vehicles that have been improved so far, such as cars, trucks, and other motor-driven vehicles, have become indispensable means of transportation in modern society, and have been documented for safety or in the event of a driving dispute. For auxiliary parking, vehicles in recent years are often equipped with one or more cameras that capture images of the surrounding environment. For example, a driving recorder is permanently placed in a vehicle to capture and record images in front of the vehicle, or a camera for panoramic photography, which can be mounted on each side of the vehicle and used to capture images of the surroundings of the vehicle. In order to grasp the situation of all parties in the vehicle, such as reversing.

However, the driving recorder and the panoramic camera system are two independently operated systems, and the images captured by each other cannot be utilized by each other. Therefore, if there is an image integration system, the images captured by the cameras of the storage vehicle can be collected to help the driver obtain a record of the environmental conditions surrounding the vehicle when necessary.

In view of the above-mentioned problems, the purpose of the present invention is to provide a vehicle image integration system that can integrate images captured by various image sensors of a vehicle.

According to the above purpose, the present invention proposes a vehicle image integration system suitable for a vehicle, which comprises a surround image module and a driving record module. The surround image module includes a plurality of first image sensors, a first processor, and a first image transmission interface. A plurality of first image sensors are disposed at different positions of the vehicle to capture images of the environment surrounding the vehicle to generate a plurality of first image information. The first processor is coupled to the plurality of first image sensors, receives and processes the plurality of first image information, and correspondingly generates a plurality of first compressed image information. The first image transmission interface is connected to the first processor and transmits at least one of the plurality of first compressed image information by a communication protocol. The driving record module includes a second image transmission interface, a second processor, and a storage unit. The second image transmission interface connects the driving record module and the landscape image module through a communication protocol to receive at least one first compressed image information. The second processor is connected to the second image transmission interface, and the second processor receives the first compressed image information through the second image transmission interface. The storage unit is connected to the second processor to receive and store the first compressed image information.

Preferably, the driving record module further includes a second image sensor, wherein the second image sensor captures an image of the environment surrounding the vehicle to generate second image information, and the second image sensor is connected to the second image. The second processor receives the second image information and stores it in the storage unit.

Preferably, the surround view image module further includes an image processing unit coupled to the first processor, and the image processing unit can display the at least one of the plurality of first image information in a spaced arrangement on the display device.

Preferably, the second processor of the driving record module can further compress the second image information to generate the second compressed image information, and transmit the second compressed image information to the panoramic image mode through the second image transmission interface by using a communication protocol. group. The image capturing unit receives the second compressed image information through the first image transmission interface, and the image processing unit displays the second compressed image information and the at least one plurality of first image information in a spaced manner on the display device.

Preferably, the image processing unit receives an image capturing instruction from an input end, and the image processing unit captures the first compressed image information or the second image information according to the image capturing instruction, and generates image information, and stores the image information. In the storage unit.

Preferably, the driving record module further includes an information transmission interface, the information transmission interface is connected to the second processor, and the second processor transmits the information stored in the storage unit to the external device through the information transmission interface.

The vehicle image integration system of the present invention has the following advantages: (1) The image captured by the surround image module can be transmitted to the driving record module and stored; the image captured by the driving record module It can also be transmitted to the surround image module as needed. (2) The image captured by the surround image module is compressed to meet the demand for transmitting images captured by the plurality of image sensors to the driving record module under the Ethernet bandwidth of the vehicle, so that Can be stored in the storage unit for easy viewing when needed.

Please refer to FIG. 1 , which is a first block diagram of an embodiment of the present vehicle image integration system. As shown in the figure, in the present embodiment, the vehicle image integration system of the present invention includes a surround image module 11 and a driving record module 12. The vehicle image integration system is suitable for a vehicle, and is particularly applicable to an automobile vehicle, and is installed and installed on an automobile vehicle.

In this embodiment, the ring image module 11 includes a plurality of first image sensors 111a, 111b, 111c, 111d, a first processor 112, and a first image transmission interface 113. A plurality of first image sensors 111a, 111b, 111c, and 111d are disposed at different positions of the vehicle to capture an image of the environment surrounding the vehicle, and each of the first image sensors 111a, 111b, 111c, and 111d is captured according to the captured image. The image produces the first image information. The plurality of first image sensors 111a, 111b, 111c, and 111d may be disposed at the left, right, rear, front, and the like of the vehicle, but the sides are not limited to providing one first image sensor. Moreover, in the present specification, four first image sensors are taken as an example, but the surround image module 11 which does not represent the photographic image integration system of the present invention can only include four first image sensors.

It is worth mentioning that, although in the block diagrams, a plurality of first image sensors 111a, 111b, 111c, 111d are included in the ring image module 11, however, this does not represent the first image sense. The detector, the first processor 112 and the first image transmission interface 113 are physically disposed at the same place, but may be disposed at different positions. In a preferred embodiment, the plurality of first image sensors 111a, 111b, 111c, 111d should be disposed at different positions of the vehicle as described above, and the first processor 112 and the first image transmission interface 113 They can be placed in the same place (for example, in the same circuit configuration).

Next, the first processor 112 is connected to the plurality of first image sensors 111a, 111b, 111c, and 111d to receive a plurality of first image information. The first processor includes a compression unit 1121, and the compression unit 1121 can process the plurality of first image information, and correspondingly generate a plurality of first compressed image information. More specifically, the first image information of the image captured by each of the first image sensors 111a, 111b, 111c, and 111d is transmitted to the first processor 112, and the compression unit 1121 converts the plurality of first images. The information is compressed to reduce the required storage space, and correspondingly generate a plurality of first compressed image information. The first video transmission interface 113 is connected to the first processor 112, and is used as a unit for transmitting between the ring image module 11 and other components, and performs at least one of the plurality of first compressed image information by using a communication protocol. transmission. It is worth mentioning that the compression processing of the first image information should be within a range that enables the first compressed image information to be displayed while still displaying a clear image.

In one embodiment, the compression unit 1121 of the first processor 112 can be an H.264 Engine with a processing capability of approximately 124 Mpixel/sec. Table 1 is the image of three first image sensors transmitted at the same time. With a frame rate of 30, the transmission rate of the image pixels and the original image per second (1) and each compression by the compression unit 1121 Relational data of the second data transmission rate (2). As shown in Table 1, after the compression by the compression unit 1121, the data transmission rate (2) is lowered, which can effectively control the size of the data when the data is transmitted on the automobile.

Table I         <TABLE border="1" borderColor="#000000" width="_0001"><TBODY><tr><td> image width (pixels) </td><td> image height (pixels) </td>< Td> pixel transfer rate (bps)(1) </td><td> data transfer rate (bps)(2) </td></tr><tr><td> 1280 </td><td> 720 </td><td> 81M </td><td> 26M </td></tr><tr><td> 752 </td><td> 520 </td><td> 34M </td ><td> 11M </td></tr></TBODY></TABLE>

Furthermore, the driving record module 12 includes a second image transmission interface 123, a second processor 122, and a storage unit 124. The driving record module 12 can be a commonly known driving recorder.

The second image transmission interface 123 can connect the driving record module 12 and the ring image module 11 through a communication protocol to receive at least one first compressed image information. In other words, the first image transmission interface 113 and the second image transmission interface 123 are connected and transmitted through a communication protocol, so that the scenery image module 11 and the driving record module 12 can transmit information between each other. The first image transmission interface 113 and the second image transmission interface 123 are transmitted through the Ethernet network, and the transmission rate is 100 Mbit/s. Therefore, the driving record module 12 can receive the compressed plurality of first compressed image information from the ring image module 11.

The second processor 122 is connected to the second image transmission interface 123, and the second processor 122 receives the first compressed image information through the second image transmission interface 123. Moreover, the second processor 122 is connected to the storage unit 124, which can transmit the received first compressed image information to the storage unit 124, and the storage unit 124 receives and stores the first compressed image information.

Therefore, in a short form, in the panoramic image module 11, each of the first image sensors 111a, 111b, 111c, and 111d that captures the image of the surrounding area of the automobile can transmit the first image information captured by the image information. The first processor 112 performs compression processing, and the compressed first compressed image information can be transmitted to the driving record module 12 (driving recorder) and stored in the storage unit 124 of the driving record module 12.

In this way, by the compression processing performed by the surround image module 11, the images captured by the image sensors installed in the automobile can conform to the transmission limitation of the Ethernet network of the vehicle, and are digitally It is stored in the driving record module 12, and achieves the effect of integrating the images captured by the image sensors of the automobile vehicle. The user can read the desired image information from the driving record module 12 when needed.

Continuing to refer to Figures 2 to 4, Figure 2 is the second block diagram of the embodiment of the vehicle image integration system of the present invention; Figure 3 is the first display screen of the vehicle image integration system of the present invention. Schematic diagram; Figure 4 is the second schematic diagram of the display screen of the vehicle image integration system of the present invention. As shown in the figure, in the embodiment of the photographic image integration system of the present invention, the display device 13 may be included, and the first processor 112 may further include an image processing unit 1122, and the driving record module 12 may further include a second image. The sensor 121 and the information transmission interface 126.

The second image sensor 121 can capture an image of the environment surrounding the vehicle and generate second image information according to the captured image. The second image sensor 121 is connected to the second processor 122, and the second processor 122 receives the second image information and stores it in the storage unit 124. That is, the second image information is stored in the storage unit 124 of the driving record module 12 together with the first compressed image information from the panoramic image module 11. Wherein, the driving record module 12 is a driving recorder, and the second image sensor 121 is a camera of the driving recorder.

Similarly, although the second image sensor 121 is included in the driving record module 12 in the block diagram, this does not mean that the components in the driving record module 12 are physically disposed at the same place. It can be set in different locations. In a preferred embodiment, the second image sensor 121 can be disposed at the windshield of the vehicle, and other components of the driving record module 12 can be disposed at the same place (for example, in the same circuit configuration). .

The image processing unit 1122 in the first processor 112 can display at least one of the plurality of first image information on the display device 13 in a spaced arrangement. More specifically, the image processing unit 1122 can transmit the first image information to the display device 13 disposed on the vehicle, and display the device 13 to enable the driver to grasp the image through the image displayed by the display device 13. The situation around.

Moreover, the image processing unit 1122 can simultaneously transmit some of the plurality of first image information to the display device 13, that is, the display device 13 not only displays the first image information captured by the first image sensor. At the same time, the image processing unit 1122 can zoom and position a plurality of first image information, so that the plurality of first image information are displayed in a spaced arrangement when displayed on the display device 13, and have better effects, such as the third. The figure shows.

The second processor 122 of the driving record module 12 can further compress the second image information to generate the second compressed image information, and transmit the second compressed image information to the surrounding area through the second image transmission interface 123 by using a communication protocol. Image module 11. The image capturing unit 11 receives the second compressed image information through the first image transmission interface 113, so that the image processing unit 1122 can perform the received second compressed image information together with the at least one plurality of first image information. The display of the description.

Fig. 3 is a view showing a screen displayed by the display device 13 as described above. In FIG. 3, the display device 13 displays the image of the joint image 50 that has been scaled and positionally processed by the image processing unit 1122. Each of the images may be, for example, an image 511a of the first image sensor on the left side, an image 511b of the first image sensor on the right side, an image 511c of the first image sensor on the rear side, and an image 521c of the second image sensor. Etc., each image is displayed in a 2X2 separated arrangement in FIG. The displayed joint image 50 can also be switched to a different partition display manner, for example, an image of one image sensor is displayed on the left and right, and is not limited to the schematic 2X2 arrangement. The image display described herein is for immediate processing, that is, the image displayed by the display device 13 is the surrounding environment of the current vehicle.

In addition, although a plurality of images are used as an example of display here, an image of a single image sensor may be displayed. Moreover, in addition to the surround view image module 11, the drive record module 12 can also be connected to the display device 13 and transmit the stored image to the display device 13 for display.

In addition, the image processing unit 1122 may perform splicing processing on the plurality of first image information, and generate spliced image information. More specifically, the image processing unit 1122 may perform image processing on each of the first image information, for example, The cropping of the repeated portions of the image boundary, the image joint or the fisheye processing are spliced into a complete panoramic image. In addition, the manner of splicing is not limited to the above examples, and there may be various splicing methods.

Fig. 4 is a view showing a screen displayed by the display device 13. In the fourth embodiment, the display device 13 displays the stitched image 40 processed by the image processing unit 1122, which may be the first image information captured by the plurality of first image sensors 111a, 111b, 111c, and 111d. The image processed by the scene stitching process can grasp the condition of the surrounding environment of the vehicle by the stitching image 40.

Moreover, the driving record module 12 can further include an information transmission interface 126 connected to the second processor 122. The second processor 122 can transmit the information stored in the storage unit 124 to the external device 20 through the information transmission interface 126. The information transmission interface 126 may be, for example, a USB connection interface as an input/output interface of the driving record module 12 and the external device 20. The external device 20 may be a device having a storage function, such as a notebook computer, a smart phone, or a tablet computer, but is not limited thereto.

That is to say, the driving record module 12 can be connected to the external device 20 through the information transmission interface 126 and transmit information. The second processor 122 can transmit the first compressed image information and the second image information stored in the storage unit 124 to the external device 20 via the information transmission interface 126. In this way, the driver can take out the information stored in the driving record module 12 for other purposes when needed.

Furthermore, the image processing unit 1122 of the first processor 112 in the panoramic image module 11 receives an image capture command from an input. The input end of the image capturing command may be a display device 13 (touch screen) on the vehicle, or an external device (smart phone, computer, etc.) connected to the panoramic image module 11, that is, A device that can perform an operation to generate an instruction.

When the image capture unit 11 receives the image capture command, the image processing unit 1122 captures the first compressed image information according to the image capture command, and generates the image information, and stores the image information in the storage unit 124. In other words, the image processing unit 1122 can store any of the first compressed image information and store the image file generated by the screenshot in the storage unit 124 via the two image transmission interfaces and the second processor 122.

In addition, it is worth mentioning that the surround image module 11 can also be additionally equipped with a storage function component, such as a SD card (Secure Digital Memory Card), etc., and the information stored in the storage unit 124 can be transmitted through the scenery. The image module 11 is stored for more applicability.

The vehicle image integration system of the present invention compresses a plurality of first image information by using a surround image module, and transmits various image information or compressed image information with the driving record module to achieve integration. Store the effect of each image information. And the image is displayed by the image processing unit, so that the driver can simultaneously grasp the condition of the surrounding environment of each position of the vehicle, and can also take a screenshot of the image around the vehicle. And the information transmission interface can be used to connect with an external device, so that the external device can acquire images around the vehicle.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of this creation shall be included in the scope of the appended patent application.

11‧‧‧Outdoor Image Module
111a, 111b, 111c, 111d‧‧‧ first image sensor
112‧‧‧First processor
1121‧‧‧Compression unit
1122‧‧‧Image Processing Unit
113‧‧‧First image transmission interface
12‧‧‧ Driving Recording Module
121‧‧‧Second image sensor
122‧‧‧second processor
123‧‧‧Second image transmission interface
124‧‧‧ storage unit
126‧‧‧Information transmission interface
13‧‧‧Display device
20‧‧‧External devices
40‧‧‧Spliced image
50‧‧‧Join image
511a, 511b, 511c, 521‧‧ images

Figure 1 is a first block diagram of an embodiment of the vehicle image integration system of the present invention. Figure 2 is a second block diagram of an embodiment of the vehicle image integration system of the present invention. The third figure is the first schematic diagram of the display screen of the vehicle image integration system of the present invention. Figure 4 is a second schematic diagram of the display screen of the vehicle image integration system of the present invention.

10‧‧‧Car image integration system

11‧‧‧Outdoor Image Module

111a, 111b, 111c, 111d‧‧‧ first image sensor

112‧‧‧First processor

1121‧‧‧Compression unit

1122‧‧‧Image Processing Unit

113‧‧‧First image transmission interface

12‧‧‧ Driving Recording Module

121‧‧‧Second image sensor

122‧‧‧second processor

123‧‧‧Second image transmission interface

124‧‧‧ storage unit

126‧‧‧Information transmission interface

13‧‧‧Display device

20‧‧‧External devices

Claims (6)

A vehicle image integration system is applicable to a vehicle, comprising: a ring image module, comprising: a plurality of first image sensors disposed at different positions of the vehicle, capturing images of the surroundings of the vehicle The first processor is connected to the plurality of first image sensors to receive the plurality of first image information, the first processor includes a compression unit, and the compression The unit processes the plurality of first image information and correspondingly generates a plurality of first compressed image information; and a first image transmission interface is connected to the first processor, and transmits the plurality of firsts in a communication protocol And at least one of the compressed image information; and a row of vehicle recording module, comprising: a second image transmission interface, wherein the driving record module is connected to the ring image module through the communication protocol to receive at least one The second compressed image is connected to the second image transmission interface, and the second processor receives the first through the second image transmission interface And compressing the image information; and a storage unit connected to the second processor to receive and store the first compressed image information. The vehicle image integration system of claim 1, wherein the driving record module further comprises a second image sensor, wherein the second image sensor captures an image of a surrounding environment of the vehicle to generate a The second image sensor is connected to the second processor, and the second processor receives the second image information and stores the second image information in the storage unit. The vehicular image integration system of claim 2, wherein the first processor further comprises an image processing unit, wherein the image processing unit displays at least one of the plurality of first image information in a spaced arrangement A display device. The vehicular image integration system of claim 3, wherein the second processor of the driving record module further compresses the second image information to generate a second compressed image information and transmits the second image The second compressed image information is transmitted to the surround image module by the communication interface; the surround image module receives the second compressed image information through the first image transmission interface, and the image processing unit The second compressed image information is displayed on the display device in a manner that at least one of the plurality of first image information is arranged in a spaced relationship. The image processing unit of the vehicle of claim 3, wherein the image processing unit receives an image capture command from an input terminal, and the image processing unit captures the first compression according to the image capture command. Image information, and generate an image information and store it in the storage unit. The vehicle image integration system of claim 1, wherein the driving record module further comprises an information transmission interface, the information transmission interface is connected to the second processor, and the second processor transmits the information through the information The interface transmits information stored in the storage unit to an external device.