JP2002063681A - On-vehicle image display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To record information such as the data of an image around a vehicle in the case of accident or vehicle traveling state effective for investigating the cause of the accident. SOLUTION: Different directions around the vehicle are photographed by plural on-vehicle cameras 121-124. The images of the respective cameras are transferred through an on-vehicle information LAN and displayed on a monitor 102. A plurality of image data and handle angle information are synthesized by a synthesizing part 112 and one of synthetic image data is generated. When impulse is detected by a collision deciding part 105 or in the case of falling or sudden braking, the synthetic image data are recorded in a recording part 114. Video around the vehicle in the cage of vehicle collision or the like and the handle angle information can be recorded and effectively utilized for investigating the cause of the accident.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an in-vehicle image display device, and more particularly to an in-vehicle image display device that transfers images of a plurality of in-vehicle cameras for photographing different directions around a vehicle to a display device via an in-vehicle network and displays the images. The present invention relates to an image display device.

[0002]

2. Description of the Related Art Conventionally, as a device for carrying out cruise control by mounting a camera on a vehicle, there is a vehicle synchronization control device disclosed in Japanese Patent Application Laid-Open No. 11-144199. In FIG.
1 shows a conventional vehicle synchronization control device.

In FIG. 6, an operation command input device 601 comprises:
This is a means by which a driver inputs an operation command to the device.
The distance measuring device 602 is means for measuring the distance to an object located ahead of the host vehicle. The imaging device 603 is a unit that captures an image of the front of the host vehicle. Brake controller 608
Is a controller for controlling the brake. The cruise controller 609 is a means for controlling the drive mechanism of the own vehicle so as to travel while keeping the vehicle speed or the inter-vehicle distance constant. The recording unit 610 stores the image and the cruise controller 609.
This is a means for recording the internal information. The display unit 611 is a unit that displays an image and internal information of the cruise controller 609.

[0004] The image generation unit 607 is a means for generating an image or the like for displaying a vehicle that can follow the vehicle, in accordance with data from the distance measurement device 602 and the imaging device 603. The vehicle selection unit 605 selects one of the displayed followable vehicles,
This is a means for selecting the target vehicle to be followed in response to a command from the operation command input device 601 regarding the selection of the target vehicle to be followed. The control unit 606 is a unit that controls the cruise controller 609 so that the selected vehicle becomes the target vehicle to be followed. The tracking target vehicle determination device 604 includes a vehicle selection unit 605.
And the control unit 606 and the image generation unit 607 as a whole.

[0005] The operation of the vehicle synchronization control device configured as described above will be described. From the imaging device 603, the image generation unit 607
, Image data obtained by photographing the front of the host vehicle. The image generation unit 607 includes the image data and the cruise controller 609.
Is transferred to the recording unit 610 and the display unit 611. Display 61
1 displays the data obtained from the image generation unit 607 on the screen. The recording unit 610 records the data obtained from the image generation unit 607.

[0006] On the basis of information obtained from the operation command input device 601, a vehicle selection unit 605 selects a target vehicle to be followed. The distance measurement device 602 measures the inter-vehicle distance for the target vehicle indicated by the vehicle selection unit 605. Distance measuring device 602
If the inter-vehicle distance obtained from is smaller than a preset threshold value, the cruise controller 609 is notified that the inter-vehicle distance is insufficient. Conversely, if the inter-vehicle distance is longer than a preset threshold, the cruise controller 609 is notified that the inter-vehicle distance is too long.

[0007] The cruise controller 609 sends a signal to the brake controller 608 in accordance with the information from the control unit 606.
By instructing the brake on / off, the vehicle follows the preceding vehicle while adjusting the speed of the vehicle.

[0008]

However, in the above-mentioned conventional synchronous control device for a vehicle, since only the image data and the inter-vehicle distance data are recorded, there is no means for reliably recording the data before and after the occurrence of the accident. There is a problem that information about the investigation cannot be reliably obtained.

In addition, since there is only one camera, the situation in all directions of the vehicle cannot be known, and there is a problem that the recorded data of the situation around the vehicle at the time of an accident is insufficient.

[0010] The present invention solves the above-mentioned conventional problems and records information useful for investigating the cause of an accident by recording image data at the time of an accident and information such as a running speed and a vehicle position. The purpose is to provide.

[0011]

In order to solve the above problems,
According to the present invention, an in-vehicle image display apparatus displays a plurality of in-vehicle cameras for photographing different directions around a vehicle, an in-vehicle network to which the in-vehicle cameras are connected, and image data received from the in-vehicle cameras via the in-vehicle network. Display means for receiving, extracting means for receiving and extracting image data from a vehicle-mounted camera via a vehicle-mounted network, synthesizing means for synthesizing a plurality of extracted image data to generate synthesized image data, and detecting a vehicle collision. And a recording unit that records the composite image data, and a unit that records the composite image data in the recording unit according to a predetermined time interval signal or the collision signal.

With this configuration, when a vehicle collision occurs, the situation around the vehicle can be recorded.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below in detail with reference to FIGS.

(First Embodiment) In a first embodiment of the present invention, a plurality of in-vehicle cameras photograph and display different directions around the vehicle, and a plurality of image data are synthesized and compressed. This is an in-vehicle image display device that records the composite image data, the selected image data, and the steering angle at the time of an external instruction or at a predetermined time interval or at the time of a collision, a fall, or a slip, and prohibits writing after the writing is completed.

FIG. 1 is a functional block diagram showing a basic configuration of an on-vehicle image display device according to a first embodiment of the present invention. In FIG. 1, a CPU 101 is means for controlling the system. The monitor 102 is a unit that displays characters and images. The ROM 103 is a ROM (Read Only Memory) in which a program indicating a control procedure of the CPU 101 is recorded. The RAM 104 is a data storage element that stores a calculation result of the CPU 101. The collision determination unit 105 is a unit that determines that a vehicle collision has occurred. Fall sensor unit 106
Is means for determining that the vehicle has fallen. A
The BS detection unit 107 has an anti-
This is a means for detecting that the lock / brake system is operating. The steering angle detection unit 108 is means for measuring an angle at which the steering wheel is steered.

The communication unit 109 includes OSI reference models 1 to 7
It has a function equivalent to a layer and is a means for transmitting and receiving data packets to and from the onboard information LAN. The extraction unit 110 is a unit that extracts only image data from communication data from the communication unit 109. The selection unit 111 is a unit that selects several images from the image data from the extraction unit 110. The combining unit 112 includes a selection unit 111
Is a means for converting several pieces of image data from the image data into one piece of image data. The compression unit 113 is a unit that compresses the image data from the selection unit 111. The recording unit 114 is a unit that records image data. The writing stop unit 115 is a unit that stops recording image data from the combining unit 112 and the compression unit 113 on the recording unit 114. The wireless communication unit 116 is a means for communicating with the outside using wireless. Recording start instruction unit 117
Is means for instructing image recording start and stop according to communication data from the wireless communication unit 116.

The CPU 101 to the recording start instruction unit 117
Each block can share data with each other because 101 is connected to the system bus to be monitored.
The cameras 121, 122, 123, and 124 are cameras connected to the in-vehicle information LAN, and are arranged on four sides of the vehicle. The in-vehicle image display device and the cameras 121 to 124 provide in-vehicle information L
Forming an AN system. Note that the connection topology may be any of a bus type, a star type, and a tree type. computer
Reference numeral 130 denotes a personal computer that is used by the user to control the vehicle-mounted image display device and is independent of the vehicle-mounted information network.

FIG. 2 is a flowchart showing a detailed control procedure of the vehicle-mounted image display device.

The signal flow of the vehicle-mounted image display device according to the first embodiment of the present invention configured as described above will be described. An example will be described in which the images of the cameras 121, 122, and 123 are combined into one image, and the image of the camera 124 is compressed into compressed image data and then written to the recording unit 114.

The cameras 121, 122, 123, and 124 divide the image data into packets according to the LAN protocol and transfer the packet data to the LAN. The packet data is passed to the communication unit 109 via the onboard information LAN. Communication unit 109
Reconstructs the received packet data into communication data for each camera and transfers the data to the extraction unit 110. Upon receiving the communication data from the communication unit 109, the extraction unit 110 extracts the image data of each camera from the communication data, and selects the extracted image data in the selection unit.
Transfer to 111.

CPU 1 operated by a program in ROM 103
01 uses the RAM 104 as a storage element for storing the operation result. The selection unit 111 is instructed to transfer only the screens of the cameras 121, 122, and 123 which are programmed and determined in advance, to the synthesizing unit 112, and to transfer the image of the camera 124 to the compression unit 113. The selecting unit 111 transfers the image data to the synthesizing unit 112 and the compressing unit 113 according to the instruction. The steering angle detecting unit 108 transfers the steering wheel angle data to the combining unit 112.

The synthesizing unit 112 converts the image data of the cameras 121, 122 and 123 and the steering angle data into one piece of image data, and transfers it to the writing stop unit 115. Compression unit 113
Compresses the image data of the camera 124 and transfers it to the writing stop unit 115.

The writing stop unit 115 is provided by the CPU 101 to the recording unit 11.
After confirming that no write-protection has been commanded, the image data from the synthesizing unit 112 and the compression unit 113 are repeatedly recorded on the recording unit 114 at regular time intervals. Recording unit 1 from CPU 101
When write-protection is instructed to 14, the write stop unit
The image data from the compression unit 113 and the compression unit 113 are recorded in the recording unit 114, and after a certain period of time, writing is stopped.

The CPU 101 extracts image data from the recording unit 114, transfers the image data to the monitor 102, and displays the selected camera image. The CPU 101 converts the internal state of the vehicle-mounted image display device into characters, and transfers the character data to the monitor 102, thereby displaying the internal state of the vehicle-mounted image display device.

The personal computer 130 performs wireless communication with the wireless communication unit 116 of the vehicle-mounted image control device. PC 130
Command data for starting data recording and stopping data recording can be transferred to the wireless communication unit 116. The wireless communication unit 116 is a personal computer 130
Wireless communication is performed, and the communication data is transferred to the recording start instruction unit 117. The recording start instructing unit 117 extracts recording start and recording stop instruction data from the data from the wireless communication unit 116 and transfers the instruction data to the CPU 101. The CPU 101 starts or stops recording on the recording unit 114 by instructing the writing stop unit to start or stop recording in accordance with the instruction from the recording start instruction unit 117.

The CPU 101 repeatedly accesses each of them at regular time intervals in order to grasp the states of the collision determination unit 105, the fall sensor unit 106, and the ABS detection unit 107. CPU
After the collision determination unit 105 determines that “collision has occurred”, the 101 instructs the write stop unit 115 to stop writing. After receiving the write stop, the write stop unit 115 stops writing to the recording unit 114 after recording for a certain period of time. CPU1
In the case of 01, after determining that the falling sensor unit 106 indicates “fall has occurred”, the writing stop unit 115 is instructed to stop writing. After receiving the write stop, the write stop unit 115 stops writing to the recording unit 114 after recording for a certain period of time.
After determining that the ABS detection unit 107 indicates “ABS operation”, the CPU 101 instructs the writing stop unit 115 to stop writing. After receiving the write stop, the write stop unit 115 stops writing to the recording unit 114 after recording for a certain period of time.

Next, a detailed control procedure of the in-vehicle image display device shown in FIG. 1 will be described with reference to a flowchart shown in FIG. First, the CPU 101 determines whether or not there is a recording start instruction from the recording start instruction unit 117 (S101). If the recording start instruction unit 117 does not indicate a recording start instruction, the process returns to S101.

If the recording start instruction section 117 indicates a recording start instruction, the recording start is stopped by the write stop section 115.
(S102). The selection information of the camera image to be recorded and the selection information of the camera image to be combined are obtained from the recording start instruction unit 117, and the information is sent to the selection unit 111 (S10).
3). The collision determination unit 105 determines whether a collision has occurred (S104).

When the collision judging section 105 judges that a collision has occurred, it instructs the writing stopping section 115 to stop recording (S109). If the collision determination unit 105 determines that a collision has not occurred, the fall sensor unit 106 determines whether a fall has occurred (S105).

When the fall sensor unit 106 determines that a fall has occurred, it instructs the write stop unit 115 to stop recording (S109). If the fall sensor unit 106 determines that a fall has not occurred, the ABS detector 107
In, it is determined whether a vehicle slip has occurred (S106).

When the ABS detection unit 107 determines that the ABS operation has been performed, the writing stop unit 115 is instructed to stop recording.
(S109). If the ABS detection unit 107 determines that the operation is not the ABS operation, the image data is extracted from the recording unit 114 and transferred to the monitor 102 to display an arbitrary camera image (S107). The recording start instructing section 117 determines whether or not there is a recording stop instruction from the recording start instructing section 117 (S108). If the instruction to stop recording is not given, the process returns to S103. If the instruction to stop recording is indicated, the recording stop unit 115 is instructed to stop recording (S10
9).

In this way, when a vehicle crashes, falls,
When the BS is operating, the situation around the vehicle can be recorded. The image data and the steering wheel angle data can be simultaneously recorded in the recording means. Since the recording is stopped after the impact is detected, it is possible to prevent the recording from being lost even when the apparatus does not operate normally. By simultaneously recording the composite image data and the arbitrary image data on the recording unit, an image of an arbitrary camera can be recorded on the recording unit, and the data capacity of the recording unit can be reduced.

Although the example in which the image data and the steering wheel angle data are simultaneously recorded has been described, the vehicle state information such as the speedometer, the tachometer, the fuel gauge, the thermometer, the oil pressure gauge, the brake, the accelerator, the gear, etc. is simultaneously recorded. Is also good.

The control method of the in-vehicle image display device is as follows: magnetic disk, magneto-optical disk, IC card, PD, DVD-R
The program can be recorded on a recording medium such as an OM, a DVD-RAM, a ROM, and a RAM. By reading this recording medium by the computer of the network monitoring device, it is possible to realize the same function as the in-vehicle image display device.

As described above, in the first embodiment of the present invention, the in-vehicle image display device captures and displays different directions around the vehicle with a plurality of in-vehicle cameras, and synthesizes a plurality of image data. The system is configured to record the combined image data, selected image data and steering angle at the time of external command or at a predetermined time interval or at the time of collision, fall or ABS operation, and to prohibit writing after the end of writing. Can be used to determine the cause after an accident.

(Second Embodiment) In a second embodiment of the present invention, a traveling locus is obtained by calculating a position by GPS, and during traveling, synthetic image data, position data, and traveling locus data are periodically updated. This is an in-vehicle image display device that records the data to a designated server on the Internet in the event of a collision.

FIG. 3 is a functional block diagram showing a basic configuration of a vehicle-mounted image display device according to the second embodiment of the present invention. In FIG. 2, a CPU 201 is a means for controlling the system. The monitor 202 is a unit that displays characters and images. The ROM 203 is a ROM in which a program describing a control procedure of the CPU 201 is recorded. RAM 204 is C
It is a data storage element that stores the operation result of PU201.
The collision determination unit 205 is means for determining a vehicle collision. G
The PS receiver 206 is a unit that receives a radio wave from a GPS satellite. The position detection unit 207 is a unit that calculates a position based on data from the GPS reception unit 206. Travel locus recording unit
Reference numeral 208 denotes a unit that superimposes and records the vehicle position as a movement locus on the map data.

The communication unit 209 is provided with OSI reference models 1 to 7
It has a function equivalent to a layer and is a means for transmitting and receiving data packets to and from the onboard information LAN. The extraction unit 210 is a unit that extracts only image data from communication data from the communication unit 209. The selection unit 211 is a unit that selects several images from the image data from the extraction unit 210. The synthesis unit 212 includes a selection unit 211
Is a means for converting several pieces of image data from the image data into one piece of image data. The compression unit 213 is means for compressing the image data from the selection unit 211. The recording unit 214 is a unit that records image data. The writing stop unit 215 is a unit that stops writing after recording image data from the combining unit 212 and the compression unit 213 and position information from the position detection unit 207 in the recording unit 214 for a certain period of time. The wireless communication unit 216 is means for wirelessly transferring data to a database server specified in advance on the Internet. The gear movement detection unit 217 is a unit that detects the gear input of the vehicle.

The CPU 201 to the gear movement detection unit 217
Each block can share data with each other because it is connected to the system bus monitored by 201.
The cameras 221, 222, 223, and 224 are cameras connected to the in-vehicle information LAN, and are arranged on four sides of the vehicle. The in-vehicle information display system and the cameras 221, 222, 223, and 224 form an in-vehicle information LAN system. Note that the connection topology may be any of a bus type, a star type, and a tree type.
The database server 225 is a database server connected to the Internet.

The signal flow of the vehicle-mounted image display device according to the second embodiment of the present invention configured as described above will be described. Note that an example will be described in which the images of the camera 221, the camera 222, and the camera 223 are combined into one image, and the image of the camera 224 is compressed and written to the recording unit 214.

The cameras 221, 222, 223 and 224 divide the image data into packets according to the LAN protocol and transfer the packet data to the LAN. Packet data is
The information is passed to the communication unit 209 via the in-vehicle information LAN. The communication unit 209 reconstructs the received packet data into communication data for each camera, and transfers the data to the extraction unit 210. The extraction unit 210 that has received the communication data from the communication unit 209 extracts the image data of each camera from the communication data, and transfers the image data to the selection unit 211.

CPU 2 operated by a program in ROM 203
01 uses the RAM 204 as a storage element for storing the operation result. The selection unit 21 transfers only the predetermined screens of the cameras 221, 222, and 223 to the synthesizing unit 212, and transfers the image of the camera 224 to the compression unit 213.
Command to 1. The selecting unit 211, in accordance with the instruction,
2 and the image data is transferred to the compression unit 213. The synthesis unit 212
The image data of the camera 221, the camera 222, and the camera 223 are converted into one piece of image data, and the image data is
Transfer to 5. The compression unit 213 compresses the image data of the camera 224 and transfers it to the writing stop unit 215.

The GPS receiver 206 that has received the radio wave from the GPS satellite transfers the received data to the position detector 207.
The position detecting unit 207 calculates the position from the data from the GPS receiving unit 206, and transfers the position data to the traveling locus recording unit 208 and the writing stopping unit 215. The traveling trajectory recording unit 208 superimposes the vehicle position on the map data and records it as a traveling trajectory from the start of the engine. The map data is transferred to the writing stop unit 215.

The writing stop unit 215 is provided by the CPU 201 to the recording unit 21.
After confirming that a write-protection instruction has not been issued, the image data from the combination unit 212 and the compression unit 213 and the position detection unit 207
And the map data from the traveling locus recording unit 208 are repeatedly recorded in the recording unit 214 at regular time intervals. When the CPU 201 instructs the recording unit 214 to prohibit writing, the writing stop unit 215 includes the image data from the synthesizing unit 212 and the compression unit 213, the position data from the position detection unit 207, and the traveling locus recording unit 208. After the map data from is recorded in the recording unit 214 for a certain period of time, the writing is stopped.

The CPU 201 extracts the image data from the recording unit 214, transfers the image data to the monitor 202, and displays the selected camera image. The CPU 201 checks the state of the gear movement detecting unit 217, and when determining that the gear is moving from stop to start, instructs the write stop unit 215 to record.

The wireless communication unit 216 performs wireless communication with a database server 225 on the Internet according to the Internet protocol. The data of the recording unit 214 is transferred to the database server 225 at a predetermined cycle.

When the collision judging unit 205 indicates “occurrence of collision”, the CPU 201 instructs the writing stop unit 215 to stop writing.
After receiving the write stop, the write stop unit 215 stops writing to the recording unit 214 after performing recording for a certain period of time. Further, the data in the recording unit 214 is transferred to the database server 225.

As described above, during traveling, the composite image data is recorded at regular intervals. When a collision is detected, the combined image data, the position data, and the travel trajectory data are transferred to a designated server on the Internet by wireless means.

As described above, in the second embodiment of the present invention, the in-vehicle image display device calculates the position by the GPS to determine the traveling locus, and at the time of traveling, the synthesized image data, the position data, and the traveling locus data are obtained. Is recorded periodically, and in the event of a collision, each data is transferred to a designated server on the Internet. Therefore, the image data and traveling information at the time of the accident are recorded and transmitted, which can be used for investigating the cause of the accident.

(Third Embodiment) In a third embodiment of the present invention, the running condition of a vehicle is detected and recorded from the amount of change in the white line image between running lanes, and the license plate image of the preceding vehicle is recorded. This is an in-vehicle image display device that detects a change in the inter-vehicle distance from the change amount of the vehicle, and issues a warning sound and applies a brake when the inter-vehicle distance is suddenly shortened.

FIG. 4 is a functional block diagram showing the basic configuration of the vehicle-mounted image display device according to the third embodiment of the present invention. In FIG. 4, a CPU 301 is a means for controlling the system. The monitor 302 is a unit that displays characters and images. The ROM 303 is a ROM in which a program describing a control procedure of the CPU 301 is recorded. RAM 304 is C
It is a data storage element that stores the operation result of PU301.
The instruction unit 305 is means for selecting an arbitrary image from some image data. The printing unit 306 is a unit that prints image data on paper. PCMCIA307 is PCMC
This is an IA card interface unit. The memory card 308 is a card containing a large-capacity storage element.

The communication unit 309 includes OSI reference models 1 to 7
It has a function equivalent to a layer and is a means for transmitting and receiving data packets to and from the onboard information LAN. The extracting unit 310 is a unit that extracts only image data from communication data from the communication unit 309. The selection unit 311 is a unit that selects several images from the image data from the extraction unit 310. The synthesis unit 312 includes a selection unit 311
Is a means for converting several pieces of image data from the image data into one piece of image data. The luminance detecting unit 313 is a unit that detects a portion having higher luminance than the image data obtained from the selecting unit 311. The white line recognition unit 314 is means for recognizing a white line from the image data of the luminance detection unit 313.

The A recording unit 315 is means for repeatedly recording the image data of the white line recognizing unit 314 at regular time intervals. The direction detecting unit 316 is a unit that detects a traveling state of the vehicle. The plate recognition unit 317 is means for recognizing a license plate from the image data of the luminance detection unit 313. B recording unit 318
Is means for repeatedly recording the image data of the plate recognizing unit 317 at regular time intervals. The distance calculation unit 319 is a unit that detects an inter-vehicle distance and its change. The sound source section 320
This is a means for generating a warning sound. The brake unit 321 is means for applying a brake according to the following distance information. The C recording unit 322 is a unit that simultaneously records data from the direction detecting unit 316, the distance calculating unit 319, and the combining unit 312. Write stop
A unit 323 records image data from the synthesizing unit 312, running conditions and inter-vehicle distance information from the direction detecting unit 316 and the distance calculating unit 319 in the C recording unit 322 for a certain period of time, and then stops writing.

Since the CPUs 301 to C recording unit 322 are connected to the system bus monitored by the CPU 301, the blocks can share data with each other. camera
Reference numerals 351, 352, 353, and 354 denote cameras connected to the in-vehicle information LAN, which are arranged on four sides of the vehicle. The in-vehicle image display device and the cameras 351, 352, 353, 354 allow the in-vehicle information L
Forming an AN system. Note that the connection topology may be any of a bus type, a star type, and a tree type.

The signal flow of the vehicle-mounted image display device according to the third embodiment of the present invention configured as described above will be described. An example in which the images of the cameras 351 to 354 are combined into one image and the image data is written to the C recording unit 322 will be described.

The cameras 351 to 354 divide the image data into packets according to the LAN protocol and transfer the packet data to the LAN. Packet data is onboard information LAN
Is passed to the communication unit 309 via. The communication unit 309 reconstructs the received packet data into communication data for each camera, and transfers the data to the extraction unit 310. The extraction unit 310 that has received the communication data from the communication unit 309 extracts the image data of each camera from the communication data, and transfers the image data to the selection unit 311.

The user sets with the instruction unit 305 so that the images of the cameras 351 to 354 are combined. To start printing, the instruction unit 305 gives an instruction. Further, when the desired image data is printed from the printing unit 306, a print stop is instructed by the instruction unit 305.
Instruct.

CPU 3 operated by a program in ROM 303
01 uses the RAM 304 as a storage element for storing the operation result. Based on the information of the instruction unit 305, the selection unit 311 is instructed to transfer the designated camera image to the synthesis unit 312. Based on the information of the instruction unit 305, the printing unit 306 is instructed to start and stop printing. The printing unit 306 starts or stops printing according to a command from the CPU 301. The selection unit 311 determines that the CP
The image data is transferred to the combining unit 312 and the luminance detecting unit 313 according to the instruction of U301. The combining unit 312 converts the image data of each camera into one image data, and transfers the image data to the writing stop unit 323.

The luminance detecting section 313 detects a high luminance portion from the image data obtained from the selecting section 311 and passes the image data of the high luminance portion to the white line recognition section 314. The white line recognition unit 314 recognizes, as a white line, a portion in the image data of the high luminance portion from the luminance detection unit 313 that has a luminance higher than a predetermined threshold value and matches a condition of a white line that separates a driving lane. The data is recorded in the A recording unit. The direction detection unit 316 compares the image data of the A recording unit 315 with the image data of the white line recognition unit 314,
From the shooting time interval and the amount of change in the white line image, calculate which position in the traveling lane the vehicle is traveling in which direction,
The vehicle traveling state information is transferred to the writing stop unit 323.

The plate recognizing unit 317 recognizes a portion of the image data of the high luminance portion from the luminance detecting unit 313, which is an image photographed in front of the vehicle and has a luminance higher than a predetermined threshold value, as a license plate. The image data is stored in the B recording unit 318.
To record. Distance calculating section 319 calculates the inter-vehicle distance from the image size of the license plate. Also, the B recording unit 318
Comparing the image data of the license plate with the image data of the plate recognition unit 317,
Calculate the change in inter-vehicle distance. This distance information is
The data is transferred to the write stop unit 323, the brake unit 321, and the sound source unit 320. The brake unit 321 applies a brake when the inter-vehicle distance is shorter than a predetermined threshold value or when the inter-vehicle distance is suddenly reduced. When the inter-vehicle distance is shorter than a predetermined threshold value or when the inter-vehicle distance is suddenly reduced, the sound source unit 320 generates a warning sound to warn the driver. In the case of a green number, a change in the inter-vehicle distance can be detected by detecting a green portion of the image data and performing the same processing.

The write stop unit 323 is provided by the CPU 301 to the C recording unit.
After confirming that writing prohibition to 322 has not been commanded, the C recording unit 322 stores the image data from the combining unit 312, the travel information from the direction detection unit 316, and the inter-vehicle distance information from the distance calculation unit 319. At regular intervals. When the CPU 301 instructs the recording unit 322 to write-protect, the writing stop unit 3
23 records the image data from the synthesizing unit 312, the speed information from the direction detecting unit 316, and the inter-vehicle distance information from the distance calculating unit 319 in the C recording unit 322, and stops writing after a predetermined time has elapsed. I do.

The CPU 301 extracts the image data from the C recording unit 322, transfers the image data to the monitor 302, and displays the selected camera image. The CPU 301 is a C recording unit 3
The image data is extracted from 22 and transferred to the PCMCIA 307. PCMCIA 307 is a memory card 3
Record the image data in 08.

In this way, it is possible to detect and record the running condition of the vehicle with respect to the running lane based on the image data in front of the vehicle, detect the inter-vehicle distance and its change, and apply a brake to prevent a collision. Also, a warning sound can be generated to alert the driver. It is also possible to print a composite image around the vehicle desired by the user, or remove the data recording medium and use it by connecting it to a personal computer compliant with the PCMCIA standard of the world standard.

As described above, in the third embodiment of the present invention, the in-vehicle image display device detects and records the traveling state of the vehicle from the amount of change in the white line image between the traveling lanes, and records the traveling state of the preceding vehicle. The system detects changes in the distance from the license plate image based on the amount of change in the license plate image and, when the distance between the vehicles suddenly becomes short, emits a warning sound and applies the brake. As a result, the cause of the accident can be investigated and the accident can be prevented.

(Fourth Embodiment) In a fourth embodiment of the present invention, a vehicle number is extracted by character recognition from a license plate in an image photographed around the vehicle, and is recorded together with an image around the vehicle. This is an in-vehicle image display device that transfers the information to a designated server on the Internet, and compares it with the stored vehicle number.

FIG. 5 is a functional block diagram showing a basic configuration of a vehicle-mounted image display device according to the fourth embodiment of the present invention. In FIG. 5, a CPU 401 is a means for controlling the system. The monitor 402 is a unit that displays characters and images. The ROM 403 is a ROM in which a program describing a control procedure of the CPU 401 is recorded. RAM 404 is C
It is a data storage element that stores the operation result of PU401.
The communication unit 405 has a function corresponding to seven layers from the OSI reference model 1, and is a means for transmitting and receiving data packets to and from the onboard information LAN. The extraction unit 406 is a unit that extracts only image data from communication data from the communication unit 405. Selector 407
Is means for selecting several images from the image data from the extraction unit 406. The synthesizing unit 408 is means for converting several pieces of image data from the selecting unit 407 into one piece of image data.

The luminance detecting section 409 is a means for detecting a portion having higher luminance than the image data obtained from the selecting section 407 and outputting image data of a high luminance portion. Plate recognition unit 410
Is means for recognizing a license plate from the image data of the luminance detection unit 409 and outputting image data of the license plate portion. The number extracting unit 411 is means for extracting a vehicle number from image data of a license plate portion by character recognition. The number registration unit 412 is a means for registering a vehicle number and an owner name. Collation unit 413
Is means for collating the data of the number extraction unit 411 with the data of the number registration unit 412. The recording unit 416 is means for simultaneously recording data from the combination unit 408 and the number extraction unit 411. The writing stop unit 414 is a unit that stops writing after recording the image data from the combining unit 408 and the character information from the number extracting unit 411 in the recording unit 416 for a certain period of time. The wireless communication unit 415 is a unit that wirelessly transfers data to a database server specified in advance on the Internet.

Since the CPU 401 to the recording unit 416 are connected to the system bus monitored by the CPU 401, each block can share data with each other. Camera 45
1,452,453,454 are cameras connected to the in-vehicle information LAN, which are respectively arranged on four sides of the vehicle. In-vehicle image display device and camera 451, 452, 453, 454, in-vehicle information LA
N system. Note that the connection topology may be any of a bus type, a star type, and a tree type. The database server 455 is a database server connected to the Internet.

The signal flow of the vehicle-mounted image display device according to the fourth embodiment of the present invention configured as described above will be described. Note that a case where the images of the cameras 451 to 453 are combined into one image and image data is written to the recording unit 416 will be described as an example.

The cameras 451 to 454 divide the image data into packets according to the LAN protocol and transfer the data to the LAN. The packet data is passed to the communication unit 405 via the onboard information LAN. The communication unit 405 reconstructs the received packet data into communication data for each camera, and transfers the communication data to the extraction unit 406. The extraction unit 406 that has received the communication data from the communication unit 405 extracts the image data of each camera from the communication data, and transfers the image data to the selection unit 407.

CPU 4 operated by the program in ROM 403
01 uses the RAM 404 as a storage element for storing the operation result. It instructs the selection unit 407 to transfer only the predetermined screens of the cameras 451, 452, and 453 to the synthesizing unit 408 and the luminance detecting unit 409. Selection section
The 407 transfers the image data to the synthesizing unit 408 and the luminance detecting unit 409 according to the instruction. The combining unit 408 converts the image data of the camera 451, the camera 452, and the camera 453 into one piece of image data, and transfers the image data to the writing stop unit 414. Which camera image is selected can be set arbitrarily.

The luminance detecting section 409 detects a portion having a higher luminance than the image data obtained from the selecting section 407, and transfers the image data of the high luminance section to the plate recognizing section 410. The plate recognizing unit 410 recognizes, from the image data of the luminance detecting unit 409, a portion whose luminance is higher than a preset threshold value as a license plate, and transfers the image data of the license plate to the number extracting unit 411. Number extractor 411
Extracts character data from the image data of the license plate by character recognition, and stores the character data in the writing stop unit 41.
4 and transferred to the matching unit 413.

The writing stop unit 414 is provided by the CPU 401 to the recording unit 41.
After confirming that the write-protection to 6 has not been instructed, the image data from the synthesizing unit 408 and the character data of the number extracting unit 411 are repeatedly recorded on the recording unit 416 at regular time intervals.
When a write inhibit command is issued from the CPU 401 to the recording unit 416,
The writing stop unit 414 records the image data from the synthesizing unit 408 and the character data of the number extracting unit 411 in the recording unit 416, and stops recording after a certain period of time has elapsed.

Radio communication section 415 performs radio communication with database server 455 on the Internet according to the Internet protocol. The data of the recording unit 416 is stored in a database server at a preset cycle.
Transfer to 455.

The collating unit 413 collates the character data of the number registering unit 412 with the character data of the number extracting unit 411 to determine whether the character data matches, and compares the result with the C data.
Transfer to PU401. The CPU 401 retrieves the image data from the recording unit 416, and transfers the image data and the character data to the monitor 402 in accordance with the image data and the collation result of the number from the collation unit 413. The monitor 402 displays the result of the comparison between the selected camera image and the number.

In this manner, the vehicle number can be extracted from the license plate of the image data around the vehicle, and the character data can be transferred to the designated server on the Internet together with the image data around the vehicle. Further, it is possible to recognize that the vehicle traveling around the vehicle is a vehicle registered in the registration means.

As described above, in the fourth embodiment of the present invention, the vehicle-mounted image display device extracts the vehicle number by character recognition from the license plate in the image around the vehicle and extracts the vehicle number together with the image around the vehicle. Recorded, transferred to a designated server on the Internet, and collated with the vehicle number held, it is possible to search for witnesses at the time of the accident from the vehicle number, and to help identify the cause of the accident, This can be used for searching for a search target vehicle such as a stolen vehicle.

[0078]

As is apparent from the above description, according to the present invention, an in-vehicle image display apparatus is provided with a plurality of in-vehicle cameras for photographing different directions around a vehicle, an in-vehicle network to which the in-vehicle cameras are connected, Display means for receiving and displaying image data from the vehicle-mounted camera via the network, extraction means for receiving and extracting image data from the vehicle-mounted camera via the vehicle-mounted network, and combining and combining a plurality of extracted image data Synthesizing means for generating image data, collision judging means for detecting a vehicle collision and outputting a collision signal, recording means for recording synthetic image data, and synthesizing image to recording means in response to a predetermined time interval signal or collision signal And means for recording data, so that when a vehicle collision occurs, the situation around the vehicle can be recorded as image data, The effect is obtained that can be useful to the investigation.

Further, since the vehicle is provided with a fall detecting means for detecting that the vehicle has fallen and outputting a fall signal, and a means for recording the combined image data in the recording means in accordance with the fall signal,
When the vehicle falls, the surroundings of the vehicle can be recorded as image data, which can be used to determine the cause of the accident.

Further, an anti-slip device for preventing the vehicle from slipping.
The system is provided with ABS detecting means for detecting that the lock / brake system is operating and outputting an ABS signal, and means for recording the combined image data in the recording means in response to the ABS signal, so that the sudden braking was applied. At this time, the situation around the vehicle can be recorded as image data, and the effect that the cause of the accident can be investigated can be obtained.

Further, since the steering angle detecting means for detecting the steering angle of the steering wheel and the means for simultaneously recording the combined image data and the steering angle in the recording means are provided, it is possible to record the steering wheel angle when a vehicle accident occurs. It is possible to obtain the effect that it can be used to determine the cause of the accident.

In addition, since a wireless communication means for wirelessly connecting to the Internet for transferring the synthesized image data to a designated server on the Internet is provided, when a vehicle accident occurs,
It is possible to transmit the image data of the situation around the vehicle, and it is possible to obtain the effect that it can be used for investigating the cause of the accident.

[0083] Further, the apparatus comprises position detecting means for acquiring data from GPS satellites to calculate position data, and means for transferring combined image data and position data to a designated server in accordance with a collision signal. In the event of a vehicle collision, it is possible to transmit image data of the situation around the vehicle and the vehicle position,
This has the effect of being useful in determining the cause of the accident.

Further, a traveling locus recording means for obtaining a traveling locus from the position data and recording the traveling locus data, and a means for transferring the combined image data, the position data and the traveling locus data to a designated server in accordance with a collision signal. Thus, at the time of a vehicle collision, it is possible to transmit the image data of the situation around the vehicle and the vehicle running trajectory, and it is possible to obtain the effect that it can be used for investigating the cause of the accident.

Further, a luminance detecting means for detecting the luminance of the selected image data, a white line recognizing means for recognizing a portion where the luminance is higher than a predetermined threshold value as a white line and outputting white line image data, A means for outputting a held white line image by holding the time and a direction detecting means for detecting a traveling state of the vehicle from a change amount obtained by comparing the held white line image and the white line image data. The effect of being able to record which direction the vehicle is traveling in the position can be obtained.

Further, a luminance detecting means for detecting the luminance of the image data, a plate recognizing means for recognizing a place where the luminance is higher than a predetermined threshold value as a license plate and outputting plate image data, A holding plate image that is held for a predetermined time, a distance calculating unit that calculates the inter-vehicle distance and the change from the amount of change obtained by comparing the holding plate image with the plate image data, Since sound source means for generating a warning sound when the distance is shorter than the threshold value and when the inter-vehicle distance is suddenly shortened are provided, an effect that a danger of a rear-end collision can be warned can be obtained.

Further, the system is provided with a number extracting means for recognizing a number from the plate image data and outputting the number recognition data and a means for transferring the number recognition data to a designated server on the Internet. The effect that it can be used is obtained.

Further, since the vehicle includes the number registration means for registering the vehicle number and the owner name and the collation means for collating the number recognition data with the data of the number registration means, it can be used for finding the vehicle to be searched. The effect is obtained.

Further, since the braking means is provided when the inter-vehicle distance is shorter than the predetermined threshold value, an effect that a danger of a rear-end collision can be warned can be obtained.

[Brief description of the drawings]

FIG. 1 is a functional block diagram of a vehicle-mounted image display device according to a first embodiment of the present invention;

FIG. 2 is an operation flowchart of the vehicle-mounted image display device according to the first embodiment of the present invention;

FIG. 3 is a functional block diagram of a vehicle-mounted image display device according to a second embodiment of the present invention;

FIG. 4 is a functional block diagram of a vehicle-mounted image display device according to a third embodiment of the present invention;

FIG. 5 is a functional block diagram of a vehicle-mounted image display device according to a fourth embodiment of the present invention;

FIG. 6 is a functional block diagram of a conventional vehicle synchronous control device.

[Explanation of symbols]

 101,201,301,401 CPU 102,202,302,402 Monitor 103,203,303,403 ROM 104,204,304,404 RAM 105,205 Collision judging unit 106 Falling sensor unit 107 ABS detecting unit 108 Steering angle detecting unit 109,209,309,405 Communication unit 110,210,310,414 Extracting unit 111,211,311,407, Recording unit 112,212,311 Communication unit 117 Recording start instructing unit 121,122,123,124 Camera 221,222,223,224 Camera 351,352,353,354 Camera 451,452,453,454 Camera 130 Personal computer 206 GPS receiving unit 207 Position detecting unit 208 Traveling locus recording unit 217 Gear movement detecting unit 225 Database server 305 Instruction unit 306 Printing unit 307 PCMCIA 308 Memory card 313,409 Luminance detection unit 314 White line recognition unit 315 A recording unit 316 Direction detection unit 317,410 Plate recognition unit 318 B recording unit 319 Distance calculation unit 320 Sound source unit 321 Brake unit 322 C recording unit 411 Number extraction unit 412 Number registration Recording unit 413 Collation unit 455 Database server 601 Operation command input device 602 Distance measurement device 603 Imaging device 604 Following target vehicle determination device 605 Vehicle selection unit 606 Control unit 607 Image generation unit 608 Brake controller 609 Cruise controller 611 Display unit

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Koichi Asaka 4-3-1 Tsunashimahigashi, Kohoku-ku, Yokohama-shi, Kanagawa F-term within Matsushita Communication Industrial Co., Ltd. 5B057 AA16 AA19 BA02 BA19 BA26 BA30 CE10 CG01 DA08 DA15 DB02 DB09 DC08 DC36 5H180 AA01 BB04 BB05 BB12 BB13 BB15 CC04 CC12 CC24 DD10 FF05 FF27 FF32 LL04 LL07 LL09

Claims (22)

[Claims] 1. An in-vehicle camera for photographing different directions around a vehicle, an in-vehicle network to which the in-vehicle camera is connected, and a display for receiving and displaying image data from the in-vehicle camera via the in-vehicle network. Means for receiving and extracting image data from the vehicle-mounted camera via the vehicle-mounted network; synthesizing means for synthesizing the plurality of extracted image data to generate synthesized image data; and detecting a vehicle collision. A collision judging unit for outputting a collision signal, a recording unit for recording the composite image data, and a unit for recording the composite image data in the recording unit according to a predetermined time interval signal or the collision signal. A vehicle-mounted image display device characterized by the above-mentioned. 2. The vehicle according to claim 1, further comprising: a fall detecting unit that detects that the vehicle has fallen and outputs a fall signal, and a unit that records the composite image data in the recording unit in accordance with the fall signal. The vehicle-mounted image display device according to claim 1. 3. Detecting that an anti-lock brake system that prevents vehicle slippage is operating,
3. The in-vehicle image display device according to claim 1, further comprising: ABS detection means for outputting a BS signal; and means for recording the composite image data in the recording means in accordance with the ABS signal. 4. A writing stop means for inhibiting writing to said recording means after writing of said composite image data to said recording means in response to said collision signal. The in-vehicle image display device according to any one of the above. 5. The apparatus according to claim 1, further comprising: a steering angle detecting means for detecting a steering angle of a steering wheel; and means for simultaneously recording the combined image data and the steering angle in the recording means. An in-vehicle image display device according to any one of the above. 6. The apparatus according to claim 1, further comprising: a recording start / stop unit for instructing start and stop of image recording from outside, and a camera designating unit for designating a camera image on the vehicle-mounted network. An in-vehicle image display device according to any one of the above. 7. The apparatus according to claim 1, further comprising compression means for compressing said composite image data to generate compressed image data, and means for recording said compressed image data in said recording means. An in-vehicle image display device according to any one of the above. 8. A selecting means for selecting an arbitrary image from the image data from the extracting means and outputting selected image data, and a means for recording the compressed image data and the selected image data together in the recording means. The in-vehicle image display device according to any one of claims 1 to 7, further comprising: 9. The in-vehicle image according to claim 1, further comprising wireless communication means for wirelessly connecting to the Internet for transferring the composite image data to a designated server on the Internet. Display device. 10. A position detecting means for acquiring data from a GPS satellite to calculate position data, and a means for transferring the combined image data and the position data to the designated server in accordance with the collision signal. The in-vehicle image display device according to claim 9, comprising: 11. A travel locus recording means for obtaining a travel locus from the position data and recording travel locus data, and combining the combined image data, the position data, and the travel locus data in response to the collision signal. 11. The in-vehicle image display device according to claim 10, further comprising means for transferring the image data to a designated server. 12. A gear movement detecting means for detecting that a gear of a vehicle has moved from a stop to a start and outputting a gear movement signal, and said recording means for storing said composite image data for a predetermined time in accordance with said gear movement signal. The vehicle-mounted image display device according to any one of claims 1 to 11, further comprising means for recording the information on a vehicle. 13. A white line recognizing unit for detecting a luminance of the selected image data, a white line recognizing unit for recognizing a portion where the luminance is higher than a predetermined threshold value as a white line and outputting white line image data, Means for holding the data for a fixed time and outputting a held white line image, and direction detecting means for detecting a traveling state of the vehicle from a variation obtained by comparing the held white line image and the white line image data. The in-vehicle image display device according to claim 1, wherein: 14. A luminance detecting means for detecting luminance of the selected image data, a plate recognizing means for recognizing a place where the luminance is higher than a predetermined threshold value as a license plate and outputting plate image data, A means for holding the plate image data for a fixed time and outputting a holding plate image; a distance calculating means for calculating an inter-vehicle distance change from a change amount obtained by comparing the holding plate image with the plate image data; 14. The in-vehicle image display device according to claim 1, further comprising: a sound source unit that generates a warning sound when a change in inter-vehicle distance is larger than a predetermined threshold value. 15. The system according to claim 1, further comprising: number extracting means for recognizing a number from the plate image data and outputting number recognition data; and means for transferring the number recognition data to a designated server on the Internet. Item 15. An in-vehicle image display device according to item 14. 16. The on-vehicle vehicle according to claim 15, further comprising: a number registration unit for registering a vehicle number and an owner name; and a collation unit for collating the number recognition data with the data of the number registration unit. Image display device. 17. The on-vehicle image display device according to claim 14, further comprising means for applying a brake when said inter-vehicle distance change is larger than said predetermined threshold value. 18. An image processing apparatus according to claim 1, further comprising: an instruction unit for designating an arbitrary image in said image data; and a printing unit for printing an image selected by said instruction unit on paper. The in-vehicle image display device according to any one of the above. 19. The on-vehicle image display device according to claim 1, further comprising an interface unit for connecting a detachable auxiliary storage electronic device to transmit and receive various data. 20. The PCM according to claim 20, wherein the interface means is a PCM.
CIA (Personal Computer Memory Card International
20. The in-vehicle image display device according to claim 1, wherein the device conforms to an Association) standard. 21. A plurality of in-vehicle cameras capture images of different directions around the vehicle, and images of the cameras are displayed on a display device via an in-vehicle network that performs data communication using a wired or wireless connection. A combined image data is generated by synthesizing the image data, and the combined image data is recorded in an image recording device at predetermined time intervals or upon impact detection. 22. An in-vehicle image display program recording medium which records an in-vehicle image display program for executing the in-vehicle image display method according to claim 21 by a computer.