JP5361409B2 - Vehicle monitoring device, vehicle monitoring system, vehicle monitoring program, semiconductor device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To notify a driver of the need for information at a processing speed which is sufficient to circumvent dangers during driving, when monitoring a vehicle and the periphery of the vehicle, at all times, regardless of whether a vehicle is being driven, parked or stopped. <P>SOLUTION: An information acquisition section 34 acquires (an image pickup device images) information, and a result determined by a determination section 36 is converted into specific information, such as absolute minimum and simple general-purpose text information by a specific information generating section 38, and transmitted via a communication line 28 to a main control section 30 with the minimum data amounts. There are advantages, such that when the general-purpose text information is defined as the specific information, it can be easily treated although it is received even by a manufacturer's device, and it can be worked, as necessary. Specific information is transferred with the minimum data amounts to a main control section 30 so that it is possible to very much reduce the data processing load of the main control section 30, and that it is necessary for the main control section 30 to have only the function for controlling a warning generating part 32. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a vehicle monitoring device, a vehicle monitoring system, a vehicle monitoring program, and a semiconductor device that monitor a vehicle and an event occurring around the vehicle.

2. Description of the Related Art Conventionally, an in-vehicle camera system has been known as means for monitoring a vehicle and an event occurring around the vehicle.

  The in-vehicle camera system receives image information from a plurality of cameras provided at appropriate locations on the vehicle (for example, peripheral edges such as four corners of the vehicle), and analyzes the image information input to the main control unit. In general, the information is converted into text information by this analysis and the analysis result is notified to the driver.

  Here, in order to increase the amount of information collected for monitoring, an additional camera is required. However, when the number of cameras is increased, information (image information) input to the main control unit increases, and the burden on the main control unit increases, which may hinder rapid analysis.

For this reason, Patent Document 1 proposes that a determination function for determining whether or not the content is to be notified to the driver , that is, an analysis based on image information captured by the camera is mounted on the camera side.

According to this patent document 1, the image information is sent to the main control unit only when it is determined that the camera side informs the driver . As a result, the amount of image information input to the main control unit can be reduced.

JP 2008-207627 A

  However, in Patent Document 1, it is certain that all image information can be reduced rather than being burdened by the main control unit by determining whether the image information is sent to the main control unit on the camera side. However, in Patent Document 1 in which image information is collectively managed (analyzed) by the main control unit, the processing speed may be insufficient.

In particular, in a vehicle, an instantaneous determination is often required, and more analysis elements (input information such as image information) are better for improving the determination accuracy. Under the conditions peculiar to the vehicle, the technique of Patent Document 1 in which the main control unit uses image information as an input source has a limit in processing capability.

In consideration of the above facts, the present invention constantly monitors the vehicle and its surroundings regardless of whether the vehicle is traveling or parked, and in particular, provides necessary information at a processing speed sufficient to avoid danger during traveling. It is an object to obtain a vehicle monitoring device, a vehicle monitoring system, a vehicle monitoring program, and a semiconductor device that can notify a driver.

  The vehicle monitoring device according to the first aspect of the invention is an information acquisition unit that acquires image information of a specific visual field from a predetermined position of the vehicle, and analyzes the image information acquired by the information acquisition unit, and the analysis result is A determination means for determining whether or not it is necessary to notify the driver of the vehicle; and when it is determined that notification is required in the determination section, based on the analysis result and from the image information And specific information generating means for generating specific information with a small amount of information.

According to the first invention, the image information is acquired, the image information is analyzed, it is determined whether or not it is necessary to notify the driver of the vehicle. Since the specific information with a small amount of information is generated, for example, even when the specific information is collectively managed externally, the amount of information to be managed is smaller than the image information. In other words, for example, a quick response such as danger avoidance while the vehicle is running becomes possible.

  Note that the image information may be either a still image or a moving image.

  In the first invention, the specific information is text information having versatility that does not require a special recognition function for information recognition.

  By applying text information as specific information, in addition to reducing the amount of information, the information can be versatile.

  In the first invention, the specific information includes a determination result of necessity of notification in the determination unit.

  Since the specific information includes the determination result of the necessity of notification, for example, in the control collectively managed outside, the analysis is simplified, and prompt notification is possible.

  Furthermore, in the first invention, the information acquisition means outputs an image signal that outputs an image signal composed of at least one of a color signal, a luminance signal, and a density signal, and outputs a signal based on the temperature of the specific visual field region And an ultrasonic sensor that outputs an image signal based on a three-dimensional distance to an object existing in the specific visual field region.

  The information acquisition means can be selected based on the purpose or object to be monitored by being configured by any one of an imaging device, an infrared sensor, and an ultrasonic sensor.

  In the first invention, a plurality of pieces of image information are input to the determination means.

  The judging means analyzes and analyzes a plurality of pieces of image information. For example, when the information acquisition means is an imaging device, the information acquisition means is a single piece of information if the image acquisition time is different in the same imaging region (not limited to still images). It's okay. In addition, a plurality of information acquisition means may be installed if the image information is the same imaging time in different imaging areas.

In the first invention, the information acquisition unit further includes an adjustment unit that adjusts a function state at the time of information acquisition based on a determination result of the determination unit.

For example, if you set the criterion for determining whether to notify the driver in the determination means, in accordance with the criteria (functional states including adjustment during information acquisition execution) functional status by the information acquiring unit by adjusting the The time required for analysis and determination by the determination means can be shortened.

  The vehicle monitoring system according to the second aspect of the invention is an information acquisition unit that acquires image information of a specific visual field from a predetermined position of the vehicle, and analyzes the image information acquired by the information acquisition unit, and the analysis result is A determination means for determining whether or not it is necessary to notify the driver of the vehicle; and when it is determined that notification is required in the determination section, based on the analysis result and from the image information Specific information generating means for generating specific information with a small amount of information, alarm generating means for issuing an alarm to a driver of the vehicle, and the identification from a plurality of the monitoring modules And a control means for selecting and executing a generation form of the alarm generation means based on the specific information.

  According to the second invention, a plurality of vehicle monitoring modules are mounted on the vehicle. Each vehicle monitoring module acquires image information, analyzes this image information, determines whether or not it is necessary to notify the vehicle driver, and if necessary, the amount of information is larger than that of the image information. It generates specific information with few.

Here, the control means selects and executes the generation form of the alarm generation means based on the specific information input from the plurality of monitoring modules. As a result, the control unit can manage less information than the image information. In other words, for example, quick response (notification to the driver, etc.) such as danger avoidance while the vehicle is running becomes possible.

  Note that the image information may be either a still image or a moving image.

  In the second invention, the specific information is text information having versatility that does not require a special recognition function for information recognition.

  By applying text information as specific information, in addition to reducing the amount of information, the information can be versatile.

  Further, in the second invention, the specific information includes identification information for identifying the vehicle monitoring module and a determination result of necessity of notification in the determination unit.

  Since the specific information includes the identification information for identifying the vehicle monitoring module and the determination result on the necessity of notification in the determination unit, the analysis in the control unit is simplified and prompt notification is possible.

  Furthermore, in the second invention, the information acquisition means outputs an image signal that outputs an image signal composed of at least one of a color signal, a luminance signal, and a density signal, and outputs a signal based on the temperature of the specific visual field region And an ultrasonic sensor that outputs an image signal based on a three-dimensional distance to an object existing in the specific visual field region.

  The information acquisition means can be selected based on the purpose or object to be monitored by being configured by any one of an imaging device, an infrared sensor, and an ultrasonic sensor.

In the second invention, the alarm generation means includes display means for visually informing a driver .

As alarm generating means, direct means that directly affect driving (for example, changing the tension of the seat belt, assisting the brake, etc.) are mainly used. It is preferable to notify the person). In this case, display means for making a notification through vision is added. For example, there is a notification through hearing as a comparison target of notification through vision, but the notification content through hearing may not be heard depending on the environment (such as listening to music at a high volume) in the passenger compartment. In contrast, visual notification can be promptly notified to the driver regardless of the environment in the passenger compartment.

  Furthermore, in the second invention, a plurality of pieces of image information are input to the determination means.

  The judging means analyzes and analyzes a plurality of pieces of image information. For example, when the information acquisition means is an imaging device, the information acquisition means is a single piece of information if the image acquisition time is different in the same imaging region (not limited to still images). It's okay. In addition, a plurality of information acquisition means may be installed if the image information is the same imaging time in different imaging areas.

In addition, in the second invention, the apparatus further includes an adjusting unit that adjusts a function state at the time of information acquisition with respect to the information acquisition unit based on a determination result of the determination unit.

For example, if you set the criterion for determining whether to notify the driver in the determination means, in accordance with the criteria (functional states including adjustment during information acquisition execution) functional status by the information acquiring unit by adjusting the The time required for analysis and determination by the determination means can be shortened.

Further, in the second invention, the control means is capable of transmitting the instruction information to each unit of the plurality of the vehicle monitoring module, execution functional status during function execution of each unit of the vehicle monitoring module It is characterized by instructing.

  Of course, the control means and each vehicle monitoring module are connected to each other via a communication line so that they can transmit and receive each other, but apart from this, for each function constituting the vehicle monitoring module, the current situation where the vehicle is placed In response, the instruction information can be transmitted directly from the control means.

Further, in the second invention, the control means can transmit / receive information to / from each means of the plurality of vehicle monitoring modules, and functions from the control means to each means of the vehicle monitoring module. the adjustment of the execution functional state of runtime with fingers Shimesuru, to the control unit from the means of the vehicle monitoring module, the information other than the specific information may be sent directly as required.

  The control means and each vehicle monitoring module are naturally connected to each other via a communication line so as to be able to transmit and receive each other, but apart from this, each function constituting the vehicle monitoring module and the control means can directly transmit and receive information to and from each other. .

Thus, the control hand stage, for each function of the vehicle monitoring module, depending on the current situation in which the vehicle is placed, can transmit directly instruction information. On the other hand, the functions of the vehicle monitoring module, the control unit can be transmitted as required information directly other than the specific information.

  Furthermore, in the second invention, information transmission between the vehicle monitoring module and the control means is performed by wireless communication.

  The vehicle monitoring module is preferably provided in each part of the vehicle, and when specific information from these is collectively managed by the control means, wiring may be complicated. In this case, since the amount of specific information is reduced, wireless communication can be applied. In this case, the direct connection between the above-described control means and each function of the vehicle monitoring module may be wired as necessary for maintaining the transmission speed.

  According to a third aspect of the present invention, the computer acquires image information of a specific visual field from a predetermined position of the vehicle, analyzes the acquired image information, and determines whether or not it is necessary to notify the driver of the vehicle. When it is determined that it is necessary to notify the driver as a result of the determination, as the specific information based on the analysis result, specific information having a smaller information amount than the image information is generated, and the specific information is This is a vehicle monitoring program for selecting and executing an alarm generation form based on the above.

  4th invention acquires the image information of a specific visual field from the predetermined position of a vehicle, analyzes the acquired image information, judges whether it is necessary to notify a driver of a vehicle, As a result of the determination, when it is determined that it is necessary to notify the driver, as the specific information based on the analysis result, specific information having a smaller information amount than the image information is generated, and based on the specific information, The semiconductor device includes a storage element in which a vehicle monitoring program is stored, which is selected and executed according to an alarm generation mode.

As described above, according to the present invention, in monitoring a vehicle and its surroundings regardless of whether the vehicle is traveling or parked, the necessary information is driven at a processing speed sufficient to avoid danger during traveling. It has the outstanding effect that it can alert | report to a person.

1 is a perspective view of a vehicle equipped with a vehicle monitoring system according to a first embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 1st Embodiment. It is a front view which shows the white line recognition state by the vehicle monitoring module which monitors the vehicle front. A captured image of the engaging Luba Kkumonita to the first embodiment, (A) a person recognition state, (B) is a light vehicle detection mode. It is a flowchart which shows the flow of monitoring control of the vehicle monitoring module 24 which concerns on 1st Embodiment. It is a flowchart which shows the warning execution control routine which shows the flow from the input of specific information in the main control part 30 which concerns on 1st Embodiment to warning execution instruction. It is a control block diagram which comprises the vehicle monitoring system which concerns on 2nd Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 3rd Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 4th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 5th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 6th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 7th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 8th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 9th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 10th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 11th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 12th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 13th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 14th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 15th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 16th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 17th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 18th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 19th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 20th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 21st Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 22nd Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 23rd Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 24th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 25th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 26th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 27th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 28th Embodiment. It is a control block diagram which comprises the vehicle monitoring system which concerns on 29th Embodiment.

(First embodiment)
FIG. 1 shows a vehicle 10 on which the vehicle monitoring system according to the first embodiment is mounted.

As shown in FIG. 1, in the first embodiment, an engine hood 16, a pair of front doors 18, and a rear door 20 (not shown on the left side) are disposed on a monocoque body centered on a ceiling portion 12 via a windshield 14. In addition, the vehicle 10 having the external shape generally called “minivan” provided with the back door 22 is targeted. However, the vehicle 10 is not particularly limited to the external shape 10 (minivan).

  In the vehicle 10, a plurality of vehicle monitoring modules (collectively referred to as “vehicle monitoring module 24”) constituting a part of the vehicle monitoring system are installed at appropriate positions of the vehicle 10.

  In the first embodiment, the vehicle 10 is provided with ten vehicle monitoring modules 24 (module No. 01 to No. 10). Each module No. The names and installation locations corresponding to are as follows (Table 1).

  Ten vehicle monitoring modules 24 provided at appropriate positions of the vehicle 10 are respectively connected to a main control unit 30 mounted on the vehicle 10 by a dedicated communication line 28 (not shown in FIG. 1, refer to FIG. 2). ing. Therefore, signals from the vehicle monitoring modules 24 are collected in the main control unit 30.

  The main control unit 30 controls the alarm generation unit 32 based on the information (specific information) from each of the collected vehicle monitoring modules 24.

FIG. 2 shows details of the vehicle monitoring system including the vehicle monitoring module 24 and the main control unit 30. Since the vehicle monitoring modules 24A to 24J have the same basic configuration, one configuration will be described, and the other components will be denoted by the same reference numerals, and description of the configuration will be omitted.

  The vehicle monitoring module 24 includes an information acquisition unit 34, a determination unit 36, and a specific information generation unit 38.

  Specifically, the information acquisition unit 34 is an imaging device such as a CCD camera, or a sensor (pressure sensor, temperature sensor, infrared sensor, photoelectric conversion) in which a signal changes according to a physical change such as pressure, temperature, and distance. Sensors etc.) are typical. Further, a microphone or the like that detects sound also falls under the category of the information acquisition unit 34.

  As shown in Table 2, the monitoring items in the vehicle monitoring module 24 are theft monitoring, vandalism monitoring, dozing prevention, disturbing motion monitoring, forward danger prevention (car, person), sign recognition, headlight (up and down). White line recognition, forward danger prevention (car, person), forward danger recognition, forward car start recognition, pre-start danger prevention, back-time danger prevention, stop door rear monitoring, overtaking danger prevention.

  When the information acquisition unit 34 is an imaging device, for example, a moving image inside and outside the vehicle is captured by the imaging device.

  The information acquisition unit 34 sends the acquired specific information (captured image data in the above example) to the determination unit 36. The determination unit 36 analyzes the specific information to be input, and determines whether or not it is necessary to notify an occupant such as a driver based on a difference from a predetermined reference state.

  In the following description, it is assumed that the information acquisition unit 34 is an imaging device and the specific information is image data.

  The image data is subjected to pixel analysis to perform edge detection, motion detection, and the like to extract a unique image in the moving image. The unique image is, for example, a white line on a road whose contrast is extremely different from the surroundings, or a person whose moving speed is clearly different from other images.

  FIG. 01-No. This is an example of detecting a center line 42 that divides the running direction on the road and a side line 44 near the road shoulder among white lines provided on the road 40 when the image is taken at 03. In FIG. 3, the center line 42 and the side line 44 are detected by a chain line 46. Note that the display area of FIG. 01-No. This is different from the 03 imaging area.

  In FIG. 3, as described above, the module No. 01 (front lower module 24A), module no. 02 (front left module 24B), module no. This is an example using 03 (front right module 24C).

  The determination unit 36 (see FIG. 2) monitors whether or not the traveling direction point 48 of the vehicle 10 exists between the center line 42 and the side line 44, and the traveling direction point 48 is connected to the center line 42 and the side line 44. When it deviates from the line 44, it is determined that it is necessary to notify the passenger (driver).

  4A and 4B show module numbers. This is an example using 07 (upper rear module 24G).

  The determination unit 36 (see FIG. 2) is activated when the vehicle moves backward, extracts contours with many curves based on edge detection, and detects the person 50 (see FIG. 4A) or the light vehicle 52. When an obstacle such as (see FIG. 4B) is detected, it is determined that it is necessary to notify the occupant (driver).

As shown in FIG. 2, the determination unit 36 sends a determination result (only when it is determined that notification is necessary) to the specific information generation unit 38.

  The specific information generation unit 38 generates text information as specific information based on the information related to the determination result from the determination unit 36. The generated specific information is sent to the main control unit 30 via the communication line 28.

  Here, the fact that the specific information is text information is one that is versatile and has a small amount of information.

  As described above, specific information is sequentially input from the ten vehicle monitoring modules 24 to the main control unit 30 as necessary. Respond according to the priority.

  The importance level and the priority level are set based on the danger level in the travel of the vehicle 10, and the drowsiness detection method has higher importance and priority than the sign recognition, and the forward danger recognition method has a higher priority than the headlight direction. In addition, importance and priority may be set in advance for the monitoring items listed in Table 2 such as high importance and priority.

  An alarm generation unit 32 is connected to the main control unit 30. In FIG. 2, only one alarm generation unit 32 is described with respect to the main control unit 30, but actually, a plurality of alarm generation units 32 that can correspond to the notification forms described in Table 2 are shown. Is connected.

  Alarms (notification forms) for each notification form in Table 2 are as follows. In addition, the alerting | reporting form shown below is an example and is not limited to this. Basically, it is preferable that an alarm through hearing is used in combination for all notification modes.

(Notification Form 1) Communication to mobile phone etc. (Notification Form 2) Communication to mobile phone etc. (Notification Form 3) Seat belt tightening (Notification Form 4) Storage of imaged image data (Notification Form 5) Brake Assist (Notification Form 6) Display of the contents of the sign on the monitor (Notification Form 7) Automatic control of headlight upward and downward (Notification Form 8) Steering Assist (Notification Form 9) Brake Assist (Notification Form 10) Speed Control (Notification Form) 11) Seat belt winding (notification form 12) Start prohibition (notification form 13) Start prohibition (notification form 14) Brake assist (notification form 15) Brake assist As described above, the main control unit 30 includes a plurality of (first implementations). (In the form of 10) the specific information is received from the vehicle monitoring module 24 and the operation of the alarm generating unit 32 is controlled. Although it seems that the technology can be easily invented based on the technology of the prior art (concept of “imaging → analysis → notification”), in the prior art, humans visually recognize the content of the notification and It is assumed that some action will be taken.

On the other hand, the vehicle monitoring system according to the first embodiment requires a quick response to all of various events while the vehicle 10 is running, rather than a long response like the prior art. It is intended for cases. Naturally, if the number of events increases, the processing load on the main control unit 30 increases and the response is delayed. In the first embodiment, each vehicle monitoring module 24 determines whether or not notification is necessary, and further transmits specific information as text information to the main control unit 30 when it is determined that notification is necessary. Therefore, it is possible to reduce the response delay compared to the control burden when at least image data is input.

  The operation of this embodiment will be described below.

  First, the flow of monitoring control of the vehicle monitoring module 24 will be described according to the flowchart of FIG.

In step 100, it is determined whether or not it is an imaging start time. That is, the imaging time differs depending on the vehicle monitoring module 24. For example, what is constantly monitored, what is monitored only when the ignition key is on, what is monitored only when the ignition key is off, and only when traveling forward There are those that monitor only when traveling backward, those that monitor only when stopped, etc., each of which is determined according to the set monitoring time.

  If a negative determination is made in step 100, this routine ends. In the vehicle monitoring module 24, if there is no other control, this routine is immediately restarted.

  If an affirmative determination is made in step 100, the process proceeds to step 102 where imaging by the information acquisition unit 34 (here, an imaging device) is started, and the process proceeds to step 104.

  In step 104, the determination unit 36 performs image analysis based on the captured image data. That is, pixel analysis is performed to perform edge detection, curve detection, and the like.

In the next step 106, based on the result of the image analysis in step 104, a specific image, for example, a white line on the road 40 (center line 42, side line 44, etc.) shown in FIG. The person 50 shown and the light vehicle 52 shown in FIG. 4B are extracted from the image data, and the process proceeds to step 108.

  In step 108, the position, moving speed, and the like of the extracted image data are compared with a predetermined criterion, and then in step 110, the necessity of notification is determined based on the comparison result.

  For example, when the traveling direction point 48 deviates from the center line 42 and enters the opposite lane while traveling in front of the vehicle, it is determined that notification is necessary. Further, when there is an obstacle at the destination while the vehicle is moving backward, it is determined that notification is necessary.

  If it is determined in step 110 that notification is necessary (affirmative determination), the process proceeds to step 112 where the specific information generating unit 38 generates text information as specific information necessary for notification, and then proceeds to step 114. Then, the specific information converted into text information is sent to the main control unit 30, and the process proceeds to Step 116. If it is determined in step 110 that notification is not required (determination is negative), the process proceeds to step 116.

  In step 116, it is determined whether or not it is an imaging end time. If a negative determination is made, the process returns to step 104 and the above steps are repeated.

  On the other hand, if the determination in step 116 is affirmative, the process proceeds to step 118 to end imaging, and this routine ends.

  Next, FIG. 6 is a flowchart showing an alarm execution control routine showing a flow from input of specific information to an alarm execution instruction in the main control unit 30.

  In step 150, it is determined whether or not the specific information is input from any of the vehicle monitoring modules 24. If an affirmative determination is made, the process proceeds to step 152, and analysis processing of the input specific information is executed. Next, the process proceeds to step 154, the alarm generation unit 32 is selected based on the specific information, and the process proceeds to step 156.

  Here, since the specific information is text information, the analysis is easy, and the alarm generation unit 32 can be selected quickly.

  On the other hand, if a negative determination is made in step 150, the process proceeds to step 156.

  In step 156, it is determined whether or not there is an unprocessed alarm. If an affirmative determination is made, the process proceeds to step 158, where there is an alarm generation unit 32 selected this time, and an unprocessed alarm is generated. The importance and priority of the unit 32 are determined, the alarm generation unit 32 having the highest importance and priority is selected, and the process proceeds to step 160. The non-selected alarm generation unit 32 is put on hold.

  On the other hand, if a negative determination is made in step 156, the process proceeds to step 160.

  In step 160, an instruction to execute the selected alarm generation unit 32 (the selection target includes the current alarm generation unit 32) is issued, and this routine ends.

(About specific information)
As the specific information, the simplest is information that “a danger has occurred”. Actually, since there are a plurality of vehicle monitoring modules 24 (here, 10), it is necessary to notify which of the detected dangers, so the minimum amount of information is “module No.” and “danger has occurred”. These are two.

  Here, text information is given as a representative example of specific information because text information is highly versatile and can be processed by any device.

For example, if the recognized “position” , “size” , “speed” , “color” , “number” , “risk”, etc. are sent as texts, the text information (if you send a video) Since it is general-purpose information (not to mention that the amount of data is small), this information can be received and applied by application software at any main control unit 30 (control unit of the safe driving assistance device) developed by any manufacturer. Therefore, the merit that the specific information is text information is great.

  In addition to the alarm generation unit 32, a display unit 54 such as a monitor (see the twelfth embodiment to the fifteenth embodiment shown in FIGS. 17 to 20) may be provided.

  Among the objectives of safe driving assistance, if a danger occurs, if the speed of the vehicle 10 is slow, the occupant (driver) may want to see the image for confirmation, and the occupant (driver) needs to see it. Since there is no room, there is no room for viewing, or there is an emergency, there is a risk of causing an accident when viewing the image, and the image may not be viewed.

For example, in recent years, for example, parking assistance when the vehicle is moving backwards, there are cars that are equipped with a back camera as standard equipment for the purpose of driving assistance even if there is no danger. Actions are coming to be performed. In this case, since the speed of the vehicle is low, when a danger is about to occur, the driver can make sufficient time even if the driver checks the image on the back monitor.

However, the purpose of the alarm generation unit 32 is to reduce the number of accidents that occur urgently when the driver is inadvertently aware or distracted.

In other words, because a danger has occurred, the occupant (driver) confirms that it is happening on the in-vehicle monitor, and it occurs suddenly, which is considered to be far more than the case where the danger can be avoided by trying to brake the vehicle 10, The purpose is to reduce as much as possible the number of accidents in which the vehicle 10 must be braked without any danger to avoid danger.

  In many car accidents with large damage, there is a danger, and when it is recognized, there is little time to recognize the danger by looking at the (moving image) display device 54 to see what is happening. Of course, there are times when you want to see the display screen.

  However, the determination unit 30 of the vehicle monitoring module 24 senses the danger, and it is easy for the occupant (driver) to understand that the seat belt is tightly tightened (tightening), and the danger can be avoided in a short time. Or, it would be more effective to issue a simple alarm that is less misleading and less likely to cause the occupant (driver) to panic.

  In addition, the display device 54 is generally spread, but if it is not spread widely, an invention that requires the display device 54 is difficult to spread in the general market.

  For example, in Japan, installation type car navigation systems are widespread because they are often installed as standard equipment by car manufacturers, but installation type car navigation systems are not common in Europe and the United States.

On the other hand, in Europe, pocket-type portable car navigation devices are popular in some countries, but they are not so large and easy to see that they can be used as risk-proof display devices, and are used in mobile phones and PDAs. This is about the size of an LCD monitor. The display device 54 as the alarm generation unit 32 cannot be used at all. That is, in Europe, environmental as viewed by the driver of the display image is small.

(Effects of the first embodiment)
As described above, in practice, the information acquisition unit 34 may be a sensor device that inputs information in any form, such as sonar, radar, microphone, infrared camera, and the like. .

  In the case of general moving image recognition, for example, when an approaching object enters the screen that can become an obstacle or dangerous object when driving the vehicle 10 within the range recognized by the imaging device. In general, it recognizes as follows.

(Recognition 1) How big is it in? (Recognition 2) From which direction (Recognition 3) How it came in (Recognition 4) Which direction it is moving (Or is it stopped?)
(Recognition 5) How is it moving? (Recognition 6) Is it such a speed? (Recognition 7) What is the shape (round, square, triangular, straight? Is it close?)
(Recognition 8) How many pieces have been entered Using these pieces of recognition information, for example, the following determination is made.

(Judgment 1) Is it an object of size and movement set to be careful in advance? (Judgment 2) Is it within the preset range? (Judgment 3) It can be predicted that they will cause an accident. (Judgment 4) How much is it worth telling the driver that it is dangerous? (Judgment 5) How important is it to communicate? (Judgment 6) What should be communicated in addition to the danger information? (Judgment 7) For example, information such as the size, position, speed, number, movement, and prediction of future movement of obstacles or dangerous objects. The specific information generation unit 38 converts the information into specific information such as simple general-purpose text information (or a simple signal that is easy to understand or a coded signal) to minimize the amount of data. 8 to the main control unit 30.

  For this reason, for example, even if the number of vehicle monitoring modules 24 increases, it is necessary to use an expensive cable having a large bandwidth as required when transferring a large amount of image data at a high speed. In addition, the use of an inexpensive ordinary cable is sufficient, and a very low cost system can be constructed.

  The specific information of the minimum data amount considered in the first embodiment is only “module No.” and “danger has occurred”.

  When general-purpose text information is specified information, it can be easily handled regardless of the manufacturer's device and can be processed as necessary.

For example, if the recognized “position” , “size” , “speed” , “color” , “number” , “risk”, etc. are sent as texts, the text information (if you send a video) Since it is general-purpose information (not to mention that the amount of data is small), any control unit of an apparatus developed and manufactured by any manufacturer can easily receive this information and apply it with application software. Therefore, the merit that the specific information is text information is great.

  Further, since the minimum amount of data is transferred to the main control unit 30 as the specific information as described above, the data processing load on the main control unit 30 is extremely reduced. All you need to do is control.

  If a built-in navigation system like Japan is not popular like Europe and America, it is necessary to attach a new expensive display device as a safe driving assistance device. Is difficult.

  In other words, according to the present invention, a high-function safe driving assistance device system can be provided in a small size and at a low cost without necessarily requiring a display device. Therefore, a built-in navigation system equipped with a fine display device as in Europe and the United States can be provided. Even when it is not widely used, it is possible to reduce the occurrence of traffic accidents by spreading safe driving assistance devices.

(Embodiment)
-About the usage form of the vehicle monitoring module 24 The information acquisition unit 34 is generally an imaging device, but may be a microphone or a microphone array that can detect sound generated outside or inside the vehicle. Alternatively, a pressure sensor that detects a pressure that contacts the vehicle may be used. Further, it may be a thermometer for detecting the temperature of each part of the vehicle or a temperature distribution, or a thermometer array.
-About embodiment of the communication line 28 In FIG. 1, the communication line 28 is shown as a common path | route which the vehicle monitoring module 24 connects. In this case, when the main control unit 30 receives the specific information transferred from the vehicle monitoring module 24, it cannot be determined from which vehicle monitoring module 24 the specific information is received. (With information to inform danger), module No. Must be included.

In FIG. 1, the communication line 28 is shown as a common path to which the vehicle monitoring module 24 is connected. However, the communication line 28 does not necessarily have to be a common path. You may connect to the main control part 30 with the independent communication line.
-About embodiment of the main control part 30 When the specific information which the vehicle monitoring module 24 outputs is transferred to the main control part 30 at every period, the ranking is given to the main control part 30 based on the importance and the priority. To be able to mediate.

  However, when a plurality of specific information is transferred to the main control unit 30 within a short time, the content of the specific information is judged by the main control unit 30, and the vehicle monitoring module determined in advance within the short time A priority order different from the priority order determined for 24 can be assigned.

For example, when one vehicle monitoring module 24 is higher than another vehicle monitoring module 24 in a predetermined priority order, specific information is input to the main control unit 30 from both within a short time. Obviously, when the specific information sent from the other vehicle monitoring module 24 has a higher risk level, it is sent from the other vehicle monitoring module 24 as determined by the main control unit 30. The priority of the specific information is set high, and the alarm generation unit 32 is controlled to execute processing according to the content of the specific information .
Other embodiments of the present invention (second embodiment to 29th embodiment) will be described below. The same components as those in the first embodiment are denoted by the same reference numerals. The description of the configuration is omitted.

(Second Embodiment)
As shown in FIG. 7, in the second embodiment, the main control unit 30 is provided with a direct transmission unit 30A, and the determination unit 36 is provided with a direct reception unit 36A. Connected through.

From the control signal transfer line 56, the control signal or software information for determining the function of the determination unit 36 is directly transferred from the main control unit 30 to the determination unit 36. Thus, the function of the determination unit 36 can be changed individually. For example, when the determination of the determination unit 36 and the determination criterion of the recognition function are to be changed from a predetermined set value to a different set value, the main control unit 30 Then, the setting value change can be realized by directly transferring the setting change signal to the determination unit 36 via the control signal transfer line 56.

Similarly, when the function of the determination unit 36 is desired to be completely different, it can be realized by directly transferring new firmware from the main control unit 30 to the determination unit 36 via the control signal transfer line 56. For example, if the determination unit 36 of one vehicle monitoring module 24 has a white line recognition function and the determination unit 36 of the other vehicle monitoring module 24 detects dangerous object entry, the main control unit 30 will later the firmware of hazardous material enters the sensing to the determination unit 36 of the monitoring module 24, it is possible to exchange both functions by transferring firmware for white line recognition determination portion 36 of the other one of the vehicle monitoring module 24.

  As described above, in the second embodiment, the direct transmission unit 30A of the main control unit 30 is changed to the direct reception unit 36A constituting a part of the determination unit 36 of each vehicle monitoring module 24 via the control signal transfer line 56. Since the connection is made so that a part or all of the functions of each judgment unit 36 can be changed independently from the main control unit 30 to another function, each driver can change his / her car at that time. At any time, it can be improved to a safe driving support system that is considered necessary at that time.

  In the second embodiment, the determination unit 36 of each vehicle monitoring module 24 changes part or all of the functions by transferring information via the control signal transfer line 56 by the main control unit 30. You can do that.

  However, the function of each determination unit 36 is not necessarily realized by the information transferred by the main control unit 30 via the control signal transfer line 56, and is not changed by the information transferred by the main control unit 30. May be. For example, a terminal for inputting information from the outside exists in the determination unit 36 of each vehicle monitoring module 24, and a part or all of the functions may be changed by the information input from the terminal.

(Third embodiment)
As shown in FIG. 8, in the third embodiment, a direct transmission / reception unit 30B is provided in the main control unit 30, and a direct transmission / reception unit 36B is provided in the determination unit 36 of each vehicle monitoring module 24. The signal transfer line 56 is connected. For this reason, in the second embodiment, the signal on the control signal transfer line which is unidirectional is bidirectional.

  In the second embodiment, the function of the determination unit 36 can be individually changed from the main control unit 30 via the control signal transfer line 56, but in the third embodiment, In addition, the data itself recognized by the determination unit 36 can be directly taken out, and the main control unit 30 can receive the information via the control signal transfer line 56.

For example, in the main control unit 30, determination is made by the determination unit 36 in addition to the specific information sent from the specific information generation unit 38 (for example, information that “the vehicle monitoring module 24 of No. x has detected danger”). This is information that is used as a material for notification by the specific information generation unit 38, and is used to provide detailed warning information such as the size, position, speed, brightness, and color of the approaching object related to the danger. via the control signal transmission line 56 from the control unit 30, by instructing the determination unit 36, via a direct control signal transfer line 56 from the determination unit 36 can be transferred to the main control unit 30.

  Thereby, when necessary, a more advanced advanced alarm can be generated using the alarm generation unit 32 by transferring the information recognized and used by the determination unit 36 to the main control unit 30. A more advanced safe driving support system can be provided.

  In the third embodiment, it is not always necessary to use the separate control signal transfer line 56, and the common communication line 28 may be used.

(Fourth embodiment)
In the third embodiment, the direct transmission / reception unit 36B of the determination unit 36 included in the vehicle monitoring module 24 and the direct transmission / reception unit 30B included in the main control unit 30 are mutually connected via the control signal transfer line 56. I just communicated.

In contrast, as shown in FIG. 9, in the fourth embodiment, the information acquisition unit 34 is also provided with a direct transmission / reception unit 34 </ b> A, and the direct transmission / reception included in the main control unit 30 via the control signal transfer line 56. The main control unit 30 checks the raw signal obtained from the information acquisition unit 34 by connecting to the unit 30B, for example, the unprocessed image information obtained from the camera, while controlling the characteristics of the determination unit 36. Fine adjustment can be performed via the transfer line 56, and the function of the information acquisition unit 34 can be adjusted similarly via the control signal transfer line 56.

  For example, when the output accuracy of the determination unit 36 is low, the information acquisition unit 34 can be finely adjusted to increase the output accuracy of the determination unit 36.

  According to the fourth embodiment, when necessary, the main control unit 30 uses the output information of the information acquisition unit 34 to control the determination unit 36 or to effectively use the performance of the determination unit 36. Since the information acquisition unit 34 can be adjusted, a more detailed advanced alarm can be generated by the alarm generation unit 32.

  In the fourth embodiment, the information transfer line 56 and the communication line 28 have been described separately. However, the information transfer line 56 and the communication line 28 are not necessarily separate transfer means, and may be a common transfer means.

(Fifth embodiment)
In the third embodiment, the direct transmission / reception unit 36B of the determination unit 36 included in the vehicle monitoring module 24 and the direct transmission / reception unit 30B included in the main control unit 30 are mutually connected via the control signal transfer line 56. I just communicated.

  On the other hand, as shown in FIG. 10, in the fifth embodiment, the specific information generation unit 38 is also provided with a direct transmission / reception unit 38 </ b> A and is directly included in the main control unit 30 via the control signal transfer line 56. By connecting to the transmission / reception unit 30B, control signals, information, and the like can be transferred, and part or all of the output format of the specific information, the type of information, and the like can be individually changed.

For example, the function of the judgment unit 36 of a certain vehicle monitoring module 24 recognizes a thing larger than a certain size that enters a high speed or a medium speed from the right in the screen displayed in the front and recognizes such a thing. The specific information output from the specific information generation unit 38 currently includes “imaging device 3”, “dangerous object A”. , “Size is large” and “hazardous material B, size is medium”, then the main control unit 30 to transfer information to the specific information generation unit 38 of the vehicle monitoring module 24 from the main control unit 30 via the control signal transfer line 56, the speed of the dangerous material is also specified as the specific information. is large, the speed is fast. " And "in dangerous goods B, the size, speed fast" to transfer as that can transfer the control signal.

As described above, according to the fifth embodiment, since it is possible to customize the alarm information output format considered necessary for each driver, it is possible to provide a safer driving support system that is easier to use.

  In the fifth embodiment, the specific information generation unit 38 in each vehicle monitoring module 24 transfers a control signal via the control signal transfer line 56 by the main control unit 30, so that a part of the function or Everything can be changed.

However, the function of each particular information generating unit 38 is not necessarily being achieved by transferring the information via the control signal transmission line 56 by the main control unit 30, also, it is transferred by the main control unit 30 It does not have to be changed by information. For example, there is a terminal for inputting information from the outside in the specific information generating unit 38 of each vehicle monitoring module 24, and one of the output format of the specific information output by the information input from the terminal, the type of information, etc. You may make it change a part or all.

Further, in the fifth embodiment, it has been described that the control signal transfer line 56 controls the specific information generation unit 38 of each vehicle monitoring module 24 with a control signal transferred from the main control unit 30. That is, it is the unidirectional information transfer of the main control unit 30 → the specific information generation unit 38 of each vehicle monitoring module 24.

  However, when setting the output format, the type of information, and the like of the specific information that is actually output from the specific information generation unit 38, each setting parameter necessary for the setting of the determination unit 36 is set to the main control unit in order to perform optimal settings. It is necessary to adjust the setting while adjusting the recognition level while controlling from 30 and feeding back the operation and output data of the determination unit 36 to the main control unit 30.

  Therefore, since bidirectional information transfer may be required between the main control unit 30 and the specific information generation unit 38 of each vehicle monitoring module 24, the control signal transfer line 56 is bidirectional.

(Sixth embodiment)
As shown in FIG. 11, the sixth embodiment is a combination of the fourth embodiment described above and the fifth embodiment. That is, the direct transmission / reception unit 34B is provided in the information acquisition unit 34, the direct transmission / reception unit 36A is provided in the determination unit 36, and the direct transmission / reception unit 38A is provided in the specific information generation unit 38. The connection is made via the transfer line 56.

According to the sixth embodiment, some or all of the output format, the type of information, and the like of the specific information output from the main control unit 30 by the specific information generation unit 38 of each vehicle monitoring module 24. Since each change can be made individually, it is possible to customize the warning information output format considered necessary for each driver, thereby providing a safer driving support system that is easier to use. Accordingly, it is possible to provide an advanced safe driving support system with high accuracy.

  In the sixth embodiment, the control signal transfer line 56 is not necessarily different from the communication line 28 and may be shared.

(Seventh embodiment)
The seventh embodiment is the same as the first embodiment, but some of the ten vehicle monitoring modules 24 are assigned to one determination unit 36 as shown in FIG. Here, an example in which two information acquisition units 34 are connected is shown.

According to the seventh embodiment, in contrast to the first embodiment, one judgment unit 36 includes a plurality of information acquisition units 34 (two in the seventh embodiment). Therefore , the determination unit 36 can perform more accurate recognition using two situation determination materials.

  For example, as the information acquisition unit 34, an imaging device and an audio microphone are used together to detect the entry of a dangerous object and the approach sound at that time, and accurately send out each information to the determination unit 36. It is possible to grasp the object entry.

As a modification of the information acquisition unit 34, a combination of a visible light image sensor and a far-infrared light image sensor can be considered. With such a configuration, it can be seen that a person-like thing has entered with a visible light image sensor, and that a person with a clear body temperature has entered with a far-infrared light image sensor, By inputting both outputs to the determination unit 36 , it is possible to accurately grasp the person's approach.

  The presence of such a vehicle monitoring module 24 having a plurality of information acquisition units 34 enables more accurate recognition / judgment according to the situation, and provides a highly accurate and advanced safe driving support system.

  In the seventh embodiment, for example, all the vehicle monitoring modules 24 may be configured by a plurality of information acquisition units 34.

(Eighth embodiment)
As shown in FIG. 13, in the eighth embodiment, a recognition degree detection unit 37 that receives information from the determination unit 36 is added to the configuration of the vehicle monitoring module 24 shown in the first embodiment. The degree-of-recognition detection unit 37 is connected to the information acquisition unit 34, and feedback-corrects fine adjustment information at the time of information acquisition obtained based on information from the information acquisition unit 34 to the determination unit 36.

The characteristics of the determination unit 36 may vary greatly depending on the fine adjustment of the information acquisition unit 34. By providing the recognition degree detection unit 37 , the information acquisition unit 34 is fed back to improve the characteristics of the determination unit 36.

  According to the eighth embodiment, by providing the recognition degree detection unit 37, the information acquisition unit 34 is fed back and finely adjusted to the information acquisition characteristics of the information acquisition unit 34, thereby further determining the unit 36. Improve judgment accuracy.

  Moreover, by suppressing the automatic adjustment of the optical camera by the recognition degree detection unit 37, the function of the determination unit 36 can be kept sound.

For example, the information acquisition unit 34 is an optical camera. In the case of the first embodiment, the optical camera generally performs optical adjustments (aperture, focus control, etc.) automatically, but automatic adjustment is automatically performed by the determination unit 36 using the optical camera. In some cases, an inconvenient case occurs. As a specific example, when focusing on a certain location and adjusting the brightness and focusing on that location, the autofocus operation is automatically activated when something suddenly crosses. Because the focus at the position where the observation was concentrated and the focus deteriorated, or an object with high brightness suddenly entered the observation screen, the automatic brightness adjustment of the optical camera worked, and the observation was concentrated The brightness of the area may decrease accordingly, and the recognition level of the determination unit 36 may decrease. In such a case, the configuration of the eighth embodiment is very effective.

(Ninth embodiment)
As shown in FIG. 14, in the ninth embodiment, a direct transmission / reception unit 38 < / b> A is provided in the specific information generation unit 38 and a direct transmission / reception unit 30 < / b> B is provided in the main control unit 30 with respect to the eighth embodiment. These are configured so that they can be communicated bidirectionally via the control signal transfer line 56, and a high-performance safe driving assistance device is provided by the main control unit 30.

  That is, according to the ninth embodiment, vehicle control is performed by transferring control signals, information, and the like to the direct transmission / reception unit 38B of the specific information generation unit 38 of each vehicle monitoring module 24 via the control signal transfer line 56. Of the output format of the specific information output from the module 24, the type of information, etc., some or all of the changes can be made individually, thereby providing a more versatile safe driving assistance device.

  In the ninth embodiment, the control signal transfer line 56 is not necessarily different from the communication line 28 and may be shared.

(Tenth embodiment)
As shown in FIG. 15, in the tenth embodiment, means for controlling the determination unit 36 is provided in the configuration of the ninth embodiment.

  As shown in FIG. 15, the transmitter / receiver 36 </ b> B is added directly to the determination unit 36 and connected to the control signal transfer line 56.

  As a result, based on information exchanged between the direct transmission / reception unit 38 </ b> A included in the specific information generation unit 38 and the direct transmission / reception means 30 </ b> B included in the main control unit 30, the determination unit 36 via the control signal transfer line 56. These characteristics can be finely adjusted or set.

  For example, since the recognition function itself that changes the judgment unit 36 that was a dangerous intruder detection function to a white line recognition function can be made completely different, a highly versatile safe driving assistance device can be provided. .

  In the tenth embodiment, the control signal transfer line 56 is not necessarily different from the communication line 28 and may be shared.

(Eleventh embodiment)
As shown in FIG. 16, in the eleventh embodiment, means for controlling the information acquisition unit 34 is provided in the configuration of the tenth embodiment.

  As shown in FIG. 16, the transmission / reception unit 34 </ b> A is added directly to the information acquisition unit 34 and connected to the control signal transfer line 56.

  Thus, the information acquisition unit 34 can be controlled from the main control unit 30 in addition to being automatically controlled using the recognition degree detection unit 37.

According to the eleventh embodiment, since the information acquisition unit 34 is directly provided with the transmission / reception unit 34A and is connected to the control signal transfer line 56, the main control unit 30 uses, for example, the recognition degree detection unit 37. Not only can the information acquisition unit 34 be automatically controlled but also the information acquisition unit 34 can be forcibly controlled, so that a safe driving assistance device with higher versatility can be provided.

  In the eleventh embodiment, the control signal transfer line 56 is not necessarily different from the communication line 28, and may be shared.

(Twelfth embodiment)
As shown in FIG. 17, the twelfth embodiment is that a display unit 54 is provided in the configuration of the first embodiment. The display unit 54 overlaps with a part of the function of the alarm generation unit 32, but the purpose here is to serve as a so-called “monitoring”.

By providing the display unit 54, image information and character information that are insufficient only by the alarm generation unit 32 are displayed, and the driver is made to perceive the occurring event on the screen.

By providing the display unit 54, more information can be supplied to the driver in addition to the image information, so that a more advanced and multifunctional safe driving assistance device can be supplied.

The display unit 54, for example, mid-size for displaying a moving image may be a small LCD monitor, simple symbols, may be a LED display only displays the characters.

(Thirteenth embodiment)
As shown in FIG. 18, the thirteenth embodiment has a configuration in which a display unit 54 is added to the above-described sixth embodiment (see FIG. 11). In FIG. 18, the display unit 54 is added to the configuration of FIG. 11, but as a modification thereof, the display unit 54 is added to the second to fifth embodiments (FIGS. 7 to 10). You may make it add.

(Fourteenth embodiment)
As shown in FIG. 19, the fourteenth embodiment has a configuration in which a display unit 54 is added to the above-described eighth embodiment (see FIG. 13).

(Fifteenth embodiment)
As shown in FIG. 20, the fifteenth embodiment has a configuration in which a display unit 54 is added to the ninth embodiment (see FIG. 14) described above.

(Sixteenth embodiment)
As shown in FIG. 21, the sixteenth embodiment is based on the first embodiment, and information transmission / reception between the vehicle monitoring module 24 and the main control unit 30 is wireless communication. Is a feature.

  As shown in FIG. 21, a wireless transmission unit 58 is connected to the specific information generation unit 38 of each vehicle monitoring module 24.

  On the other hand, a wireless receiver 60 is connected to the main controller 30.

  Information is exchanged between the wireless transmission unit 58 and the wireless reception unit 60 wirelessly.

The basic operation is almost the same as in the first embodiment, but the specific information is exchanged via the wireless transmission unit 58 and the wireless reception unit 60, so there is no need to connect a cable for transfer, and installation is performed. Therefore, it is possible to provide a safe driving assistance device that is easier to use and is freed from physical constraints.

  According to the sixteenth embodiment, the specific information has a very small data amount (compared to image information) after the recognition determination is made, and the small amount of information is exchanged by wireless communication at a lower cost. There is an advantage in doing.

  For information wireless communication, Zigbee with low information transfer performance or Bluetooth with no information transfer speed can perform well.

(Seventeenth embodiment)
As shown in FIG. 22, the seventeenth embodiment is based on the first embodiment, and information transmission / reception between the vehicle monitoring module 24 and the main control unit 30 is wireless communication. Is a feature.

  As shown in FIG. 22, a wireless transmission / reception unit 62 is connected to the specific information generation unit 38 of each vehicle monitoring module 24.

  On the other hand, a radio transmission / reception unit 64 is connected to the main control unit 30.

  Information is exchanged wirelessly between the wireless transmission / reception unit 62 and the wireless transmission / reception unit 64.

The basic operation is almost the same as in the first embodiment, but the specific information is exchanged via the wireless transmission / reception unit transmission unit 62 and the wireless transmission / reception unit 64, so there is no need to connect a cable for transfer. Thus, it is possible to provide a safe driving assistance device that is free from physical restrictions for installation and that is easier to use.

  According to the seventeenth embodiment, the specific information has a very small data amount (compared to image information) after the recognition determination is made, and the small amount of information is exchanged by wireless communication at a lower cost. There is an advantage in doing.

  For information wireless communication, Zigbee with low information transfer performance or Bluetooth with no information transfer speed can perform well.

(Eighteenth embodiment)
As shown in FIG. 23, in the eighteenth embodiment, in the seventeenth embodiment, the wireless transmission / reception function enables the determination unit 36 of the vehicle monitoring module 24 to be controlled.

(Nineteenth embodiment)
As shown in FIG. 24, in the nineteenth embodiment, the information acquisition unit 34 can be controlled in the eighteenth embodiment.

(20th embodiment)
As shown in FIG. 25, the twentieth embodiment is unidirectional (unidirectional transmission of specific information from the vehicle monitoring module 24 to the main control unit 30) and wireless communication in the configuration of the eighth embodiment. It is a thing.

(Twenty-first embodiment)
As shown in FIG. 26, in the twenty-first embodiment, in the configuration of the eighth embodiment, two-way (specific information is transmitted from the vehicle monitoring module 24 to the main control unit 30 and Wireless communication in the case of transmission from the control unit 30 to the vehicle monitoring module 24).

(Twenty-second embodiment)
As shown in FIG. 27, the twenty-second embodiment enables control of the determination unit 36 of the vehicle monitoring module 24 in the twenty-first embodiment.

(Twenty-third embodiment)
As shown in FIG. 28, the twenty-third embodiment enables control of the information acquisition unit 34 of the vehicle monitoring module 24 in the twenty-second embodiment.

(24th Embodiment)
As shown in FIG. 29, the twenty-fourth embodiment is obtained by adding a display unit 56 to the sixteenth embodiment (see FIG. 21).

(25th embodiment)
As shown in FIG. 30, the twenty-fifth embodiment is obtained by adding a display unit 56 to the seventeenth embodiment (see FIG. 22).

(Twenty-sixth embodiment)
As shown in FIG. 31, the twenty-sixth embodiment is obtained by adding a display unit 56 to the nineteenth embodiment (see FIG. 24).

  As a modification, the display unit 56 may be added to the eighteenth embodiment (see FIG. 23).

(Twenty-seventh embodiment)
As shown in FIG. 32, in the twenty-seventh embodiment, a display unit 56 is added to the twentieth embodiment (see FIG. 25).

(Twenty-eighth embodiment)
As shown in FIG. 33, the twenty-eighth embodiment is obtained by adding a display unit 56 to the twenty-first embodiment (see FIG. 26).

(Twenty-ninth embodiment)
As shown in FIG. 34, the twenty-ninth embodiment is obtained by adding a display unit 56 to the twenty-third embodiment (see FIG. 28).

  As a modification, the display unit 56 may be added to the twenty-second embodiment (see FIG. 27).

DESCRIPTION OF SYMBOLS 10 Vehicle 12 Ceiling part 14 Windshield 16 Engine hood 18 Front door 20 Rear door 22 Back door 24A-J Vehicle monitoring module 26 Bumper 28 Communication line 30 Main control part 34 Information acquisition part 36 Judgment part 38 Specific information generation part 40 On-road 42 center Line 44 Side line 46 Chain line 48 Traveling direction point 50 People 52 Light vehicle

Claims (17)

Information acquisition means for acquiring image information of a specific visual field from a predetermined position of the vehicle;
A determination unit that analyzes the image information acquired by the information acquisition unit and determines whether or not the analysis result needs to be notified to a driver of the vehicle;
Specific information generating means for generating specific information based on the analysis result and having a smaller amount of information than the image information when it is determined that the determination unit needs to be notified;
A vehicle monitoring device.   The vehicle monitoring apparatus according to claim 1, wherein the specific information is text information having versatility that does not require a special recognition function for information recognition.   The vehicle monitoring apparatus according to claim 1, wherein the specific information includes a determination result of necessity of notification in the determination unit.   The information acquisition unit outputs an image signal composed of at least one of a color signal, a luminance signal, and a density signal, an infrared sensor that outputs a signal based on the temperature of the specific visual field region, and the specific visual field The vehicle monitoring device according to any one of claims 1 to 3, wherein the vehicle monitoring device is configured by any one of ultrasonic sensors that output an image signal based on a three-dimensional distance to an object existing in a region.   The vehicle monitoring apparatus according to claim 1, wherein a plurality of pieces of image information are input to the determination unit. Based on the determination result of said determination means, the vehicle monitoring apparatus according to any one of claims 1 to 5, further comprising an adjustment means for adjusting the function state when information acquisition performed on the information acquisition means . Information acquisition means for acquiring image information of a specific visual field from a predetermined position of the vehicle, and analysis of the image information acquired by the information acquisition means, and notification of the analysis result to the driver of the vehicle A determination unit that determines whether or not there is a specific information that generates specific information based on the analysis result and having a smaller amount of information than the image information when it is determined that the determination unit needs to notify A plurality of vehicle monitoring modules comprising: information generating means;
An alarm generating means for issuing an alarm to a vehicle driver;
The specific information is input from a plurality of the monitoring modules, and based on the specific information, a generation unit of the alarm generation unit is selected and executed.
A vehicle monitoring system.   The vehicle monitoring system according to claim 7, wherein the specific information is general-purpose text information that does not require a special recognition function for information recognition.   The vehicle monitoring system according to claim 7 or 8, wherein the specific information includes identification information for identifying the vehicle monitoring module and a determination result of necessity of notification in the determination unit.   The information acquisition unit outputs an image signal composed of at least one of a color signal, a luminance signal, and a density signal, an infrared sensor that outputs a signal based on the temperature of the specific visual field region, and the specific visual field The vehicle monitoring system according to any one of claims 7 to 9, comprising an ultrasonic sensor that outputs an image signal based on a three-dimensional distance to an object existing in a region. The vehicle monitoring system according to any one of claims 7 to 10, wherein the alarm generation means includes display means for visually informing a driver .   The vehicle monitoring system according to claim 7, wherein a plurality of pieces of image information are input to the determination unit. Based on the determination result of said determination means, a vehicle monitoring system according to any one of claims 7 to claim 12, further comprising adjusting means for adjusting the function state when information acquisition performed on the information acquisition means . It said control means is capable of transmitting the instruction information to each unit of the plurality of the vehicle monitoring module, according to claim 7 claim for instructing the execution functional status during function execution of each unit of the vehicle monitoring module 13. The vehicle monitoring system according to any one of items 12 . The vehicle monitoring module and communication between the control means, a vehicle monitoring system according to any one of claims 7 to claim 14 which is executed by the wireless communication. On the computer,
Obtain image information of a specific visual field from a predetermined position of the vehicle,
Analyzing the acquired image information to determine whether it is necessary to notify the vehicle driver,
As a result of the determination, when it is determined that it is necessary to notify the driver, as the specific information based on the analysis result, specific information having a smaller information amount than the image information is generated,
Based on the specific information, an alarm generation mode is selected and executed.
The vehicle monitoring program for performing the process including this . It acquires image information for a specific viewing area from a predetermined position of the vehicles,
Analyzing the acquired image information to determine whether it is necessary to notify the vehicle driver,
As a result of the determination, when it is determined that it is necessary to notify the driver, as the specific information based on the analysis result, specific information having a smaller information amount than the image information is generated,
Based on the specific information, an alarm generation mode is selected and executed.
A semiconductor device comprising a storage element storing a vehicle monitoring program for causing a computer to execute processing including the above .

Images