JP2005077596A - Multi-vision type driving training system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multi-vision type driving training system being of help to safe drive guidance at a driving school or the like by recording trainee's behavior and enabling the trainee to easily and intuitively recognize safe driving on a multi-screen. <P>SOLUTION: In the multi-vision type driving training system, five images photographed with a front camera 11, rear side camera 12, left side camera 13, right side camera 14, and driver camera 15 are composited and displayed on the multi-screen, and each of the picture on the multi-screen is inverted right and left at need. Thus, even when the front camera 11 and other cameras are installed directing backward, the right and left inverted display of the picture returns to the original state by inverting the pictures photographed with the front camera 11 and other cameras on the multi-screen. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention records the behavior of a driver (training student) who is trained in a car at a driving school, etc., and shows the record later to the trainee so that his / her driving performance can be recognized accurately, thereby driving safely. The present invention relates to a multi-vision car learning device that can be used for teaching.

  Conventionally, as this kind of car learning device, for example, as disclosed in Patent Document 1, a front camera, a rear camera, a left side camera, a right side camera, and a driver camera are provided, and is safe driving performed? In order to make it easier to confirm whether or not, these five types of images taken with the front camera, etc. are combined and displayed on a multi-screen, and various vehicle speed sensor signals, accelerator pedal depression sensor signals, brake pedal depression sensor signals, etc. There has been proposed a sensor signal that is superimposed on the multi-screen and displayed on the multi-screen.

Further, in order to detect the amount of depression of an accelerator pedal or a brake pedal, as shown in FIG. 7, a potentiometer 23 is attached to a link 22 connected to the pedal, and the angle of the pedal 20 is detected by the potentiometer 23. It was.
JP 2000-47570 A

  However, this has the following disadvantages.

  First, since the front camera is mounted backwards in front of the driver's seat so as to shoot in front of the driver, the driver's movement is displayed in reverse on the multi-screen. It is difficult to intuitively confirm safe driving. For example, if images taken with the left side camera, driver camera, and right side camera are displayed on the left, center, and right of the multi-screen, respectively, When the side mirror is viewed, on the multi-screen, the driver turns his face toward the right side, that is, the right side mirror, so that the driver feels as if he is looking at the right side mirror. This is because the rear camera does not capture the image reflected in the rearview mirror, but directly captures the rear view of the car, or the left and right side cameras capture images reflected in the left and right side mirrors. The same applies to the case of directly photographing the left and right rear backgrounds of the car.

  Secondly, the design of the link 22 for attaching the potentiometer 23 to detect the depression amount of the pedal is greatly different depending on the vehicle type. Therefore, the attachment position of the potentiometer 23 is examined for each vehicle type, and the attachment position is changed as necessary. There is a need to.

  Thirdly, superimposing images of various sensor signals as computer graphic images is a visually superior method, but if the data is to be used later, it must be analyzed from the synthesized image. The work is difficult.

  In view of such circumstances, the present invention makes it easy to intuitively confirm safe driving on a multi-screen, can detect the amount of pedal depression common to all vehicle types, and various sensor signals An object of the present invention is to provide a multi-vision vehicle learning apparatus that can easily use data based on the above.

  First, the invention according to claim 1 of the present invention includes a front camera (11) for photographing the foreground of the automobile (4), a rear camera (12) for photographing the rear background of the automobile, and a left rear of the automobile. A front side camera comprising a left side camera (13) for photographing a scene, a right side camera (14) for photographing a right rear view of the automobile, and a driver camera (15) for photographing a driver's facial expression; In the multivision-type automobile training device (1) that combines and displays five types of images captured by the rear camera, the left side camera, the right side camera, and the driver camera on the multi screen (30), An image inverting means (3) for horizontally inverting each image is provided.

  The invention according to claim 2 of the present invention is provided with superimposing means (3) for superimposing various sensor signals on the multi-screen in graphic representation.

  In the invention according to claim 3 of the present invention, an optical sensor (21) for measuring a change in the position of the tread (20a) of the pedal (20) is used as the accelerator sensor (17) or the brake sensor (18). Adopted and configured.

  Furthermore, the invention according to claim 4 of the present invention is provided with signal processing means (3) for performing a multiplexing process and a voice conversion process on various sensor signals to convert them into voice waveform data, and recording the voice waveform data. Voice data recording means (19) is provided.

  According to the first aspect of the present invention, even if the front camera, the rear camera, the left side camera, or the right side camera is installed backward, the image captured by the front camera or the like is reversed horizontally on the multi-screen. By doing so, the left-right reversed display of the image is restored, and it becomes easy to intuitively confirm safe driving on the multi-screen.

  According to the invention of claim 2 of the present invention, the display of the multi-screen is visually superior due to the superimposition of the graphic expression.

  Moreover, according to the invention which concerns on Claim 3 among this invention, the depression amount of a pedal can be detected in common with all the vehicle types.

  Furthermore, according to the invention which concerns on Claim 4 among this invention, the data based on various sensor signals can be easily utilized later.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic view showing an embodiment of a multi-vision type automobile learning apparatus according to the present invention.

  As shown in FIGS. 1 and 2, the multi-vision type automobile learning apparatus 1 is used by being mounted on an automobile 4 and has a main body case 2. The main body case 2 includes a frame synthesis circuit 3, a CPU (central processing unit) 5 for superimposing, a video output unit 6, a frame buffer 7, five video-digital conversion units 8, a photocoupler 9, and an analog unit. 10 is incorporated. Here, the CPU 5, the video output unit 6, the frame buffer 7, and each video-digital conversion unit 8 are connected to the frame synthesis circuit 3, and the photocoupler 9 and the analog unit 10 are connected to the CPU 5.

  On the other hand, a front camera 11, a rear camera 12, a left side camera 13, a right side camera 14, a driver camera 15, a vehicle speed sensor 16, an accelerator sensor 17, a brake sensor 18, and a video recording device 19 are installed outside the main body case 2. ing. Here, the front camera 11 is attached forwardly above the driver's seat and can photograph the foreground of the automobile 4. Further, the rear camera 12 is mounted rearwardly above the rear seat, and can capture the rear view of the automobile 4. The left side camera 13 is attached obliquely forward to the left side of the driver's seat and can capture an image reflected on the left side mirror of the automobile 4. The right side camera 14 is attached obliquely forward to the right side of the driver's seat and can capture an image reflected on the right side mirror of the automobile 4. Furthermore, the driver camera 15 is attached to the front of the driver's seat in a rearward direction and can photograph the driver's facial expression from the front.

  As shown in FIG. 2, the front camera 11, the rear camera 12, the left side camera 13, the right side camera 14, and the driver camera 15 are connected to each video-digital converter 8, and the vehicle speed sensor 16 is a photo sensor. It is connected to the coupler 9. The accelerator sensor 17 and the brake sensor 18 are both connected to the analog unit 10, and the video recording device 19 is connected to the video output unit 6.

  As shown in FIG. 3, an optical sensor 21 is installed on the pedal 20 of the automobile 4 so as to be able to measure a change in the position of the tread surface 20a. The optical sensor 21 is an accelerator sensor 17 and a brake sensor 18. It is used as.

  Since the multi-vision vehicle learning apparatus 1 has the above-described configuration, the camera image signals of the front camera 11, the rear camera 12, the left side camera 13, the right side camera 14, and the driver camera 15 are video-digital. As shown in FIG. 4 (a), the frame synthesis circuit 3 is input to the frame synthesis circuit 3 via the conversion unit 8, and based on the data obtained from each camera image signal, the front camera 11, the rear camera 12, and the left side. A multi-screen 30 is created by arbitrarily arranging five types of images 31, 32, 33, 34, and 35 photographed by the camera 13, the right side camera 14, and the driver camera 15, and this multi-screen 30 is temporarily stored in the frame buffer 7 Write to.

  At this time, the frame synthesizing circuit 3 is photographed by the driver camera 15 among the five types of images 31, 32, 33, 34, and 35 on the multi-screen 30 as shown in FIG. Only the performed image 35 is reversed left and right. Then, since the left / right reverse display of the driver's operation is restored, it is easy to intuitively confirm the safe driving on the multi-screen 30. That is, when the driver looks at the left side mirror for safety confirmation at the left rear, when the image 35 photographed by the driver camera 15 is not horizontally reversed on the multi-screen 30, FIG. ) On the multi-screen, the driver turns his face toward the right side, that is, the side of the image 34 photographed by the right side camera 14, so that the driver looks at the right side mirror. In contrast, when the image 35 taken by the driver camera 15 is reversed left and right on the multi-screen 30, the driver faces the multi-screen 30 as shown in FIG. 4B. Since the face is correctly directed to the left side, that is, the image 33 side photographed by the left side camera 13, it becomes easy to intuitively confirm safe driving on the multi-screen 30.

  On the other hand, the sensor signals of the vehicle speed sensor 16, the accelerator sensor 17 and the brake sensor 18 are input to the CPU 5 through the photocoupler 9 and the analog unit 10, so the CPU 5 outputs these sensor signals to the frame synthesis circuit 3.

  Then, the frame synthesis circuit 3 reads the multi-screen 30 from the frame buffer 7, superimposes the data obtained from each sensor signal on the multi-screen 30 with a graphic representation, and adds a superimpose image 36, and then The multi-screen 30 is output to the video recording device 19 via the video output unit 6 and recorded.

  Further, as shown in FIG. 6, the frame synthesizing circuit 3 synthesizes each sensor signal by multiplexing processing into serial data, modulates it by voice conversion processing and converts it into voice waveform data, and then converts this voice waveform. The data is output to the video recording device 19 via the video output unit 6 and recorded. Therefore, by reading the audio waveform data recorded in the video recording device 19, data based on various sensor signals can be easily used later.

  Since the optical sensor 21 is used as the accelerator sensor 17 and the brake sensor 18, it is not necessary to change the mounting position of the accelerator sensor 17 and the brake sensor 18 for each vehicle type, and the accelerator pedal is common to all vehicle types. And the amount of depression of the brake pedal can be detected.

  In the above-described embodiment, as shown in FIG. 4, an image 31 captured by the front camera 11 is displayed on the upper portion of the multi-screen 30, and the rear camera 12, the left side camera 13, the right side camera 14, and the driving are displayed. The case where four types of images 32, 33, 34, and 35 photographed by the person's camera 15 are displayed side by side at the bottom of the multi-screen 30 and the superimposed image 36 is displayed at the bottom of the image 31 has been described. However, the arrangement of these five types of images 31, 32, 33, 34, and 35 and the superimposed image 36 is not limited to this. For example, as shown in FIG. 5, an image 32 photographed by the rear camera 12 and an image 35 photographed by the driver camera 15 can be arranged vertically and displayed.

  In the above-described embodiment, the case where the image 35 photographed by the driver camera 15 is horizontally reversed on the multi-screen 30 has been described. However, the image 32 photographed by the rear camera 12 is horizontally reversed on the multi-screen 30. It doesn't matter if you do. That is, generally, in order to photograph the rear view of the automobile 4, a method of attaching the rear camera 12 to the rearview mirror and photographing an image reflected on the rearview mirror can be considered. The rear camera 12 is mounted rearward so that the rear view of the automobile 4 is directly attached to the vehicle 4 because it is extremely difficult to arrange it so that it can be photographed in the same way as the rear image that the driver actually confirms. In many cases, a shooting method is employed. In this case, as with the driver camera 15, the rear camera 12 has to be mounted rearward, so that the left and right are displayed on the multi-screen 30 in reverse, but the image 32 captured by the rear camera 12 is displayed on the multi-screen 30. If the left-right reversal is reversed, the left-right reversal display returns to the original, and it is easy to intuitively confirm safe driving on the multi-screen 30. Similarly, in order to photograph the left and right rear backgrounds of the automobile 4, as described above, the left side camera 13 and the right side camera 14 are attached to the left side mirror and the right side mirror, and are reflected on the left side mirror and the right side mirror. A method of taking an image is conceivable. In this method, the left side mirror and the right side mirror are apart from the driver's seat particularly in a truck, so the left side camera 13 and the right side mirror are aimed at the left side mirror and the right side mirror. Since it is difficult to install the side camera 14, the left side camera 13 and the right side camera 14 are attached to the left side mirror and the right side mirror so that they are attached to the rear side to directly shoot the left and right rear background of the car 4. May be adopted. Also in this case, since the left side camera 13 and the right side camera 14 must be attached backwards, they are displayed on the multi-screen 30 so that the left and right sides are reversed, but the left side camera 13 and the right side camera 14 photographed. If the images 33 and 34 are reversed left and right on the multi-screen 30, the left-right reversed display returns to the original, so that it is easy to intuitively confirm safe driving on the multi-screen 30.

  Furthermore, in the above-described embodiment, the multi-vision vehicle learning apparatus 1 including the video recording device 19 has been described. However, a DVD (digital versatile disc) recorder or the like is used instead of the video recording device 19. Is also possible.

It is a mimetic diagram showing one embodiment of a multivision type car lesson device concerning the present invention. It is a control block diagram of the motor vehicle learning apparatus shown in FIG. It is a schematic diagram which shows the detection method of the pedal depression amount in the motor vehicle learning apparatus shown in FIG. It is a figure which shows the 1st example of a multiscreen, Comprising: (a) is a figure when a driver | operator is facing the left, (b) is a figure when a driver | operator is facing the right. It is a figure which shows the 2nd example of a multiscreen. It is a schematic diagram which shows the recording method of the sensor signal in the motor vehicle learning apparatus shown in FIG. It is a schematic diagram which shows the detection method of the conventional pedal depression amount.

Explanation of symbols

1 …… Multi-vision car learning device 3 …… Frame composition circuit (image inversion means, superimpose means, signal processing means)
4 …… Car 11 …… Front camera 12 …… Back camera 13 …… Left side camera 14 …… Right side camera 15 …… Driver camera 17 …… Accelerator sensor 18 …… Brake sensor 19 …… Video recording device (voice Data recording means)
20 …… Pedal 20a …… Tread 30 …… Multi-screen

Claims (4)

A front camera (11) for photographing the foreground of the automobile (4), a rear camera (12) for photographing the rear background of the automobile, a left side camera (13) for photographing the left rear background of the automobile, and the automobile A right side camera (14) for photographing the right rear background of the vehicle and a driver camera (15) for photographing the expression of the driver,
In the multi-vision vehicle training device (1) that combines the five types of images taken by the front camera, the rear camera, the left side camera, the right side camera and the driver camera and displays them on the multi-screen (30).
A multivision-type automobile learning apparatus, comprising image inverting means (3) for horizontally inverting each image on the multi-screen. 2. The multi-vision vehicle learning apparatus according to claim 1, further comprising superimposing means (3) for superimposing various sensor signals on the multi-screen in graphic representation. The multi sensor according to claim 2, wherein an optical sensor (21) for measuring a change in the position of the tread surface (20a) of the pedal (20) is employed as the accelerator sensor (17) or the brake sensor (18). Vision-type car training device. A signal processing means (3) for performing multiplexing processing and voice conversion processing on various sensor signals to convert them into voice waveform data is provided,
4. The multi-vision vehicle learning apparatus according to claim 2, further comprising a voice data recording means (19) for recording the voice waveform data.

Images