JPH10215407A - Image fetching device, and drive support image fetching device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To always watch only a necessary image by selecting the original images constituting a composite image information based on the detection result of a state detection device and composing the composite image signals from the selected image signals. SOLUTION: A drive support image fetching device 1 is provided with an image processor 4 which selects the image signals sent from a main image pickup device 8 and a secondary image pickup device 9 based on the detection result of a state detection device 3 and produces the composite image signals from those selected image signals, and a recording device 5 which stores the composite image signals. The processor 4 includes a composite image processing condition input mechanism 18 which can select a partial image to be used, can lay out the partial image and also can previously set an exclusive area respectively to each original image. Then the input is received from the device 3 simultaneously with the fetching of images and these images are selected based on the detection information obtained from the device 3.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for capturing images in a plurality of directions and obtaining useful composite image information from the plurality of captured images. In the case where the trainee and the instructor ride on a training vehicle and drive on the road outside the driving school, images of the car are taken in all directions, and such captured images are reproduced after practical driving on the road. The present invention relates to an image capturing technique, which is useful for, for example, providing training for an instructor.

[0002]

2. Description of the Related Art In order to facilitate understanding, a description will be given of a device conventionally used for training an automatic operator. FIG. 4 shows a configuration example of such an apparatus. The apparatus includes a plurality of imaging devices (specifically, CCD cameras) 8, 9, and 2, and an image processing device 4 (for example, a four-divided display) that processes image information from these cameras so as to conform to a predetermined display state. And a recording device 5 (so-called video recorder) for storing the combined image information from the four-split display image processing unit. When the apparatus is used, as shown in FIG. 4A, when four imaging devices are provided, the first imaging device 8 is used to capture an image in front of the vehicle, and the second and third imaging devices are used to capture the image of the vehicle. For capturing the front images 9a and 9b, the fourth
Of the image pickup device 9c is used for picking up a driver's seat image. The obtained combined image information is such that the images recorded by the four imaging devices are combined on the same screen in four divided states as shown in FIG. At the time of reproduction, the display is always in a four-divided state as shown in FIG. On the other hand, a composite image consisting of only the front image (without image processing) has also been obtained by selection before the start of device operation.

[0003]

Accordingly, a composite image using an image in only one direction or an image in four directions is obtained from the start to the end of the operation, depending on the initial selection, to obtain a composite image. Had become. Now, for example, when a selection is made to obtain a composite image from images in four directions, the image that the instructor and the trainee can return to the driving school to play back and see is divided into two parts as shown in FIG. It is an image, and the image of this configuration is continuous from the start of road operation to the end of road operation. As a result, the user has to always see the images that they do not need to see. In addition, the instructor will make comments at various points while looking at the recorded road driving situation. It had to be done manually while sending the screen.

An object of the present invention is to solve the above-mentioned problems and to obtain an easy-to-use image capturing apparatus.

[0005]

According to a first aspect of the present invention, there is provided an image capturing apparatus capable of individually capturing images in different directions. A plurality of imaging devices, comprising a state detection device for detecting the state of the imaging environment, selecting image signals from the plurality of imaging devices based on the detection result of the state detection device, consisting of the selected image signal That is, the image processing apparatus includes an image processing device that obtains a composite image signal. This image capturing device includes a plurality of image capturing devices, and image signals in different directions are captured from the plurality of image capturing devices, respectively, and sent to an image processing device to be processed. On the other hand, the image capturing device is provided with a state detection device, and the state of the imaging environment is detected by the detection device. Various examples of the state of the imaging environment can be given. For example, in the case of a training vehicle, the running speed of the vehicle, the operation state of the brake, the sound of the surrounding environment (the sound generated by the instructor) Etc.). And in the image processing device of this device,
Based on the detection result of the state detection device, an original image that is a component of the composite image signal is selected, and a composite image signal is synthesized from the selected image signal. Therefore, in the apparatus, the composite image signal can be made to correspond to the state of the imaging environment, and a composite image corresponding to such an environmental state can be obtained. By the way, in the image capturing device having such a configuration, if this device is provided with a recording device, the composite image signal generated by the image processing device can be stored in the recording device and used for later use. it can.

According to a third aspect of the present invention, there is provided a driving assist image capturing apparatus for achieving the object of the present invention. And a sub-imaging device capable of capturing an image in a direction different from the main imaging device, including a state detection device that detects an operating state, and based on a detection result of the state detection device, the main imaging device and An image processing apparatus is provided that selects an image signal from the sub-imaging device and obtains a composite image signal including the selected image signal. The main configuration of this driving assistance image capturing device is the same as that described above, except that this is a driving object to be subjected to a driving operation, and for the purpose of learning this driving operation or such a driving operation, It is unique in that it can be used for support. This device includes a main imaging device and a sub-imaging device, and the main imaging device is configured to take an image in front of the driver's cab. Therefore, in a normal driving state, the driving state of the driving target can be visually grasped from the image signal. Further, since the device is provided with a sub-imaging device, if the imaging direction of the sub-imaging device is appropriately set, the operation state is different from the normal state, and the imaging image of the sub-imaging device is required. Thus, a composite image in a state in which this image is added can be obtained. Also in this example, the switching of the combination of the image information constituting the composite image is as follows.
By performing the operation based on the operation state of the operation target, an appropriate composite image signal can be obtained. Even in the driving assistance image capturing device having such a configuration, if the recording device is provided in this device, the combined image signal generated by the image processing device can be stored in the recording device and used for later use. Can be.

In the driving assistance image capturing apparatus as described above, the driving object is a car, and a left front sub-imaging apparatus for imaging a left front area of the car and a right front sub-imaging apparatus for imaging a right front area of the car. It is preferable to include an imaging device. In this device, in addition to the image from the main imaging device, it is possible to capture a pair of left and right front images of the car, the front image and the left and right front image,
Appropriately selected and combined synthesized image information can be obtained.

Further, it is preferable that the imaging range of the main imaging device is an area in front of the automobile as viewed from the driver's cab, including a rear image reflected on a rearview mirror. As an image in front of the automobile, if an image seen from the windshield is taken, it is possible to grasp the running state for a while, and this image can be used to obtain useful composite image information. However, for example, in the case of use for driving training, etc., the information including the rear view of the vehicle from the rearview mirror is more realistically representative of the driving situation that the driver actually experiences. Become. Therefore, a more realistic synthesized image can be obtained by capturing the image information including the rear image of the vehicle reflected on the rearview mirror by the main imaging device.

On the other hand, the driving object is an automobile, and the state detecting device is any one of a traveling speed detecting device, an accelerator operation detecting device, a brake operation detecting device, a turn signal operation detecting device, a voice detecting device, and an inter-vehicle distance detecting device. Or more than one. The information detected by these detection devices is information that can represent the driving state of the automobile in some sense, and changes in the detection information when the driver performs some driving operation. Therefore, such detection information often corresponds to a case in which information about the surroundings of the vehicle is required. By appropriately changing the configuration of generating a composite image in conjunction with the detection information, the detection information appropriately corresponds to the driving environment. The synthesized image information can be obtained.

Further, the driving object is a vehicle for driving training, and the state detecting device is a teaching point input signal detecting device for detecting the presence or absence of an input signal inputted by an instructor who rides with the driver at the time of driving training. Preferably, there is. In the apparatus of the present invention, the configuration of the recorded composite image changes. However, in the automobile training, the trainee and the instructor may ride on the training vehicle and drive on the road. The driving assistance image capture device of the present application is intended to be used in such a case, but while the instructor is next to the driver, at any time during driving, the storage mark is displayed. In some cases, it is preferable to input the information to the composite image. That is, when the instructor recognizes that a comment is necessary, for example, an audio signal is input or a mark is added to an image. Then, in a state interlocked with such an input signal of the teaching point, the teaching point input signal detection device detects the presence or absence of this signal and changes the generation state of the composite image. If you do this,
When the synthesized image obtained by the apparatus of the present application is to be reproduced later, appropriate synthesized image information can be obtained and appropriate advice can be given at the time and when the instructor deems it necessary.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows a configuration and a use state of a driving assistance image capturing device 1 for driving training of the present application, and FIG. 2 shows a composite image captured and synthesized by the image capturing device 1 of the present application. The display state is shown.

The image capturing device 1 basically selects a plurality of imaging devices 2, a state detection device 3 for detecting a state of an imaging environment, and image signals from the plurality of imaging devices 2, and selects the selected one. The image processing apparatus includes an image processing device 4 that obtains a composite image signal composed of image signals, and a recording device 5 that stores the generated composite image signal. Therefore, the difference from the prior art is that the state detection device 3 is provided, and based on the detection result of the state detection device 3, an original image forming the combined image information is selected and appropriately combined. Further, as will be described later, in the case of the present application, the composite image which has conventionally been configured to be displayed equally in four divisions is configured such that the partial image position of the original image, the occupied area, and the like can be changed. The position, occupied area, and the like of each partial image are appropriately set by the user, and a composite image signal is generated and displayed in accordance with the setting.

Further description will be made in detail with reference to FIGS. The driving assistance image capturing device 1 captures an image in a direction different from the main imaging device 8, which can capture an image of the front front as viewed from the inside of a cab 7 of a driving training car 6. And a possible auxiliary imaging device 9. More specifically, the imaging range of the main imaging device 8 is set in an area in front of the automobile 6 as viewed from the inside of the cab 7 including a rear image reflected on the rearview mirror 10. On the other hand, the sub-imaging device 9
1, as shown in FIG. 1, a left front sub-imaging device 9a for imaging the left front region of the automobile 6, a right front sub-imaging device 9b for imaging the right front region, and an image of the driving state of the driver in the driving state. A driver sub-imaging device 9c is provided. Therefore,
The image capturing device 1 of the present application is configured so that a total of four types of original images can be obtained. Next, the device 1 is provided with a state detection device 3 for detecting a driving state of the driving training vehicle 6. As this state detection device 3,
Although various devices can be adopted, in this embodiment, the so-called traveling speed detecting device 12 is configured to function as the state detecting device 3. The traveling speed of the automobile 6 is detected by the state detection device 3, and the composition of the composite image is changed according to the detected value of the traveling speed. As shown in FIG. 2, as an example of the composite image, in the present application, the standard image 11 shown in FIG.
And an option image 13 shown in FIG. Here, as shown in the figure, the standard image 11 is obtained by combining the image from the driver's auxiliary imaging device 9c with the front front image 14 of the automobile viewed from the inside of the driver's cab 7 including the rearview mirror 10 captured by the main imaging device 8. It was done. The driver image 15 is provided at the upper right of the front front image 14. On the other hand, the optional image 13 includes the left front sub-imaging device 9a on the left and right of the standard image 11,
The image from the right front sub-imaging device 9b is added. That is, the left front image 16 from the left front sub-imaging device 9a is on the left side of the standard image 11, and the right front image 17 from the right front sub-imaging device 9b is the standard image 1.
One is added to the right towards 1. The option image 13 is one in which all these partial images are combined to form one screen.

As described above, in the present application, a plurality of combining states (the first is a state in which the basic standard image 11 is combined, and the second is a state in which the optional image 13 is combined). It is set in advance. Here, of course, in this setting, the arrangement and occupation area of the original image, which is a partial image to be used, are also set to a desired state. Now, in the image capturing device 1 of the present application, the selection of the plurality of combined states is performed according to the detection information of the traveling speed detecting device 12 serving as the state detecting device 3 described above. That is, when the traveling speed is high (for example, greater than 20 km / hr), the processing for obtaining the standard image 11 described above is performed, and when the traveling speed is low (for example, 20 km / hr or less), the combined image is obtained. Is configured to perform the process of obtaining the option image 13 described above. That is, the image capturing device 1 of the present application selects the image signals from the main imaging device 8 and the sub imaging device 9 based on the detection result of the state detection device 3 and obtains an image that obtains a composite image signal including the selected image signals. It is configured to include the processing device 4. Therefore, the image processing device 4
The image signal information of the composite image in the two states described above is configured to be selectively generated. The switching between the two states is based on the detection information from the traveling speed detection device 12. That is, the image processing apparatus 4 includes a composite image processing condition input mechanism 18 capable of selecting a partial image to be used, arranging the selected partial image, and setting each occupied area in advance for each original image. In addition, image processing is performed according to the conditions input from the mechanism 18. On the other hand, the input from the state detection device 3 is performed at the same time as the image is captured, and the two states described above are selected according to the value of the detection information. Further, on the output side of the image processing device 4, there is provided a recording device 5 for storing a synthesized image signal generated by processing and synthesis according to the above conditions. Now, the driving assistance image capturing device 1 of the present application is also provided with a microphone (voice detection device) 20 that collects voice information near the driver's seat, and the microphone 20 allows the voice near the driver's seat to be transmitted in parallel with the synthesized image information. It can be imported. The voice information is configured so that the presence or absence of the voice information can be confirmed. When there is a voice input, the synthesized image is synthesized with the option image 13, and when there is no voice input, the synthesized image is maintained in the standard image 11. ing. Therefore, in this configuration, the microphone 20
Also functions as a kind of state detection device 3. In other words, the driving support image capturing device 1 includes, as the state detection device 3, a teaching point input for detecting the presence or absence of an input signal (substantially, the voice of the instructor) input by the instructor who rides with the driver during driving training. A signal detection device 21 (device for detecting the presence or absence of instructor voice information) is provided.

Hereinafter, the driving assistance image capturing apparatus 1 of the present application will be described.
The following describes an example in which is used for driving lessons.
In use, the device is used in a state where the above-described imaging devices 8 and 9 are attached to predetermined positions of the driving training vehicle 6. The device 1 is used when traveling on a road, and operates during a training operation through a certain traveling route. As described above, the synthesized image stored in the recording device 5 is the image shown in FIG. 2 during normal running (operating at a relatively high speed).
The state of the standard image 11 is as shown in FIG.
When driving at low speed or when the voice of the instructor is on,
The option image 13 shown in FIG. 2B is recorded. Then, at the point of time when the driving on the road is completed, the tape 22 as the storage medium is removed, and the separately prepared TV
(Not shown), the trainee and the instructor can see the state of driving on the road together. In this case, the composite image information recorded as described above is a mixture of two-state display images. That is, in general, when driving on the road, low-speed driving occurs when the vehicle approaches an intersection or turns, and in such a case, the situation around the vehicle is obtained again from the composite image information. In this way, appropriate instructor advice can be obtained. In such a case, it is very useful that not only the image in front of the car 6 but also information around the car 6 is recorded. Further, even in a situation where the instructor gives some instructions by voice, the present embodiment has a configuration in which the option image 13 appears. Even in such a case, usually, it is often necessary to temporarily stop or check the left and right. In such a situation, in the present application, it is possible to receive appropriate advice or the like by looking at the option image 13. By the way, during normal high-speed running, the vehicle is often running without any particular problem. In such a case, the driving condition can be sufficiently grasped only by checking the standard image 11.

[Other Embodiments] The above is one embodiment of the present application. Hereinafter, another embodiment of the present application will be described. (B) In the above-described embodiment, examples of the state detection device include a traveling speed detection device that detects a traveling speed of an automobile, and a voice detection device (an example of a teaching point input signal detection device) that detects an instructor's instruction voice. Although the case has been described, as shown in FIG. 3, such a state detection device includes an accelerator operation detection device 30, a brake operation detection device 40, a turn signal operation detection device, a mere voice detection device, an inter-vehicle distance detection device, and the like. Can be used. In these devices, the state of the image to be synthesized according to the accelerator depressed state, the brake depressed state, the presence or absence of a blinker operation, the presence or absence of an environmental sound input, and the inter-vehicle distance to a traveling vehicle running ahead, respectively. It changes. By doing so, an appropriate image can be obtained according to various situations, and can be provided for on-site use, after operation, or the like. (B) In the above-described embodiment, an example in which a front image of a vehicle is mainly obtained as an imaging device has been described, but a rear image of a vehicle is obtained as a sub-imaging device as shown in FIG. A thing may be used. (C) In the above example, the composite image is recorded once, and the recorded composite image is reproduced and provided for a predetermined use. However, the composite image is generated and sent to the display side. , May be used for a predetermined purpose. In this case, the recording device described in the present application can be omitted. (D) In the above example, an example is shown in which the driving assistance image capturing device of the present application is used for car training. (Vehicles, ships, airplanes, etc.). (E) Furthermore, in the above example, a case has been described in which the image capturing device of the present application is used to obtain composite image information in which appropriate image information has been synthesized for a driving target such as an automobile. For example, in a gas production plant,
A plurality of imaging devices are provided for the monitoring target area, and any abnormality (for example, gas leak) occurs in the monitoring target area.
In the case where there is an error, this state is detected by the state detection device (a gas detection device corresponds to this), and a composite image in which the image of this specific monitoring target area is prioritized (only the image of the monitoring target area in question has a large exclusive use) Is preferable. In this case, the image capturing device is constructed by the image capturing device, the state detecting device, and the image processing device having the specific structure described above.

[Brief description of the drawings]

FIG. 1 is a diagram showing a use state of an image capturing device of the present application.

FIG. 2 is a diagram showing a display state of a composite image signal.

FIG. 3 is an explanatory view of another embodiment of the present invention.

FIG. 4 is an explanatory view of a conventional technique.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 driving assistance image capturing device 2 imaging device 3 state detection device 4 image processing device 5 recording device 6 driving training car 7 cab 8 main imaging device 9 sub imaging device 10 rearview mirror 11 standard image 12 running speed detection device 13 optional image 21 teaching point input signal detection device 30 accelerator operation detection device 40 brake operation detection device

Claims (8)

[Claims] A plurality of image pickup devices capable of individually picking up images in different directions; and a state detection device detecting a state of an image pickup environment, wherein the plurality of image pickup devices are provided based on a detection result of the state detection device. Select the image signal from the imaging device,
An image capturing device comprising an image processing device for obtaining a composite image signal composed of selected image signals. 2. The image capturing device according to claim 1, further comprising a recording device for storing the composite image signal. 3. A driving apparatus according to claim 1, further comprising: a main imaging device capable of capturing an image in front of the driver's cab as viewed from the driver's cab; and a sub-imaging device capable of capturing an image in a direction different from the main imaging device. An image processing apparatus comprising a state detection device for detecting, selecting image signals from the main imaging device and the sub imaging device based on a detection result of the state detection device, and obtaining a composite image signal composed of the selected image signals Driving assistance image capture device equipped with 4. The driving assistance image capturing device according to claim 3, further comprising a recording device for storing the composite image signal. 5. The vehicle according to claim 3, wherein the driving target is a vehicle, and the vehicle includes a left front sub-imaging device for imaging a left front region of the vehicle, and a right front sub-imaging device for imaging a right front region of the vehicle. The driving assistance image capturing device according to the above. 6. The driving assistance image according to claim 3, wherein the imaging range of the main imaging device is an area in front of the vehicle as viewed from the driver's cab, including a rear image reflected in a rearview mirror. Capture device. 7. The driving object is an automobile, and the state detection device is a traveling speed detection device, an accelerator operation detection device, a brake operation detection device, a turn signal operation detection device,
The driving assistance image capturing device according to claim 3, wherein the device is one or more of a voice detection device and an inter-vehicle distance detection device. 8. The driving object is a car for driving driving training, and the state detecting device is a teaching point input signal detecting device for detecting the presence or absence of an input signal input by an instructor riding with a driver during driving training. The driving assistance image capturing device according to claim 3.