JP2013035399A - Luggage compartment monitoring device - Google Patents

Abstract

An object of the present invention is to efficiently present a situation in a cargo compartment of a vehicle without obstructing the driving operation of the driver.
A situation analysis unit for analyzing a situation in a cargo compartment from an image acquired by a camera and detection information of a sensor has a case where abnormal information by a sensor due to a large behavior or a large inter-frame difference exists. Now warns unconditionally, and warns minor behaviors when the cause or location is identified.
[Selection] Figure 2

Description

  Embodiments described herein relate generally to a luggage storage monitoring device such as a large truck that is difficult to check from the outside.

  Conventionally, not only the camera image installed in the cargo compartment is always displayed to the driver, but also the reference image and the latest image are displayed in a superimposed manner when it is estimated that a large shake will occur in the cargo compartment using an acceleration sensor etc. This makes it possible for the driver to check where the change has occurred in the cargo compartment.

  In addition, by using the camera image installed in the cargo compartment at the monitoring start time as a reference image, and comparing it with the latest image sequentially, it automatically detects changes in the passenger compartment and gives a warning to the driver. I am doing so.

JP-A-7-186832 JP-A-8-238976

  In the conventional technology, the system that notifies the driver of the occurrence of cargo collapse using an acceleration sensor may not cause the cargo collapse even when the acceleration sensor reacts to the shaking of the vehicle, and the displayed image in the cargo compartment The video shows no change, and the gaze operation to identify the location where the cargo collapse occurred is an obstacle to the safe driving of the driver.

  In addition, in a system that automatically detects a slight change in the video and warns the driver, it causes a false alarm, and there is a problem that the reliability of the driver with respect to the monitoring device decreases.

  In this embodiment, there is provided a cargo compartment monitoring device that informs a driver of the possibility of cargo collapse or when the cargo collapses.

  According to the embodiment, a camera that is installed in a cargo compartment of a vehicle and acquires a cargo compartment image, a sensor that detects the behavior of the cargo compartment, an image acquired by the camera and detection information of the sensor, Generate a drawing based on the analysis result obtained by the situation analysis unit for analyzing the situation, an alarm generation unit for notifying the driver of an alarm based on the analysis result in the cargo compartment obtained by the situation analysis unit, and the analysis result obtained by the situation analysis unit And an image processing unit that supplies the monitor with a monitor that informs the driver of the condition in the cargo compartment.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic system configuration diagram for explaining an embodiment related to a cargo room monitoring device. FIG. 2 is a more specific system configuration diagram of FIG. 1. It is explanatory drawing for demonstrating the arrangement | positioning state inside the vehicle in 1st Embodiment. It is explanatory drawing for demonstrating load collapse of a luggage compartment. It is a flowchart for demonstrating operation | movement of 1st Embodiment. FIG. 6 is an auxiliary explanatory diagram of the description of FIG. 5. FIG. 6 is an auxiliary explanatory diagram of the description of FIG. 5.

  Hereinafter, embodiments will be described in detail with reference to the drawings.

  1 to 4 are for explaining an embodiment relating to a cargo room monitoring device. FIG. 1 is a schematic system configuration diagram, FIG. 2 is a more specific configuration diagram of FIG. 1, and FIG. FIG. 4 is a diagram for explaining the collapse of the load in the cargo compartment.

  In FIG. 1 to FIG. 3, a lighting fixture 12 and a camera (television camera) 13 are arranged in a sealed luggage room 11 that cannot be seen from the outside. An output image is output from the output of the camera 13 via an image processing unit 14. Is displayed on the driver's seat. The image processing unit 14 acquires an image signal obtained by digitally converting the analog image signal from the camera 13 based on the control of the control circuit 16 and performs a general image conversion process or the like, thereby performing an image in the luggage compartment 11. Is displayed on the monitor 15.

  Although only one camera 13 is shown, a vehicle such as a large trailer having a large luggage compartment 11 is equipped with a plurality of cameras. The monitor 15 is, for example, a single unit, and when there are a plurality of cameras 12, a switch circuit (not shown) that periodically switches each output and connects it to the input of the monitor 15 is provided.

  Reference numeral 17 denotes a sensor that detects the behavior of the luggage compartment 11. Information detected by the sensor 17 is supplied to a situation analysis unit 18 provided in the control circuit 16 to analyze the situation of the cargo compartment 11 and is temporarily stored in the memory 21. When the sensor 17 detects that the predetermined value has been exceeded, the situation analyzing unit 18 notifies the alarm generating unit 19 that the predetermined value has been exceeded. As the alarm generation unit 19 of the alarm generation unit 19, a message is displayed on the monitor 15, a warning is given from the speaker 191 by voice, or an LED 192 is blinked.

  An operation unit 20 is further connected to the control circuit 16 for operating the lighting fixture 11 and the camera 13 and manually displaying an image of the camera 13 on the monitor 15.

  The sensor 17 as a means for detecting the behavior of the cargo compartment 11 is a vehicle speed sensor for detecting whether or not the vehicle speed condition is faster than a prestored vehicle speed condition, and the relationship between the vehicle speed and the steering wheel is faster than the prestored steering angle condition. A steering angle sensor that detects whether or not an acceleration sensor that detects whether or not an acceleration suddenly increased from a certain vehicle speed has exceeded an acceleration condition stored in advance is used.

  The control circuit 16 includes a memory 21 that primarily stores image information obtained by converting an analog image signal captured by the camera 13 into a digital image signal by the image processing unit 14, and a situation analysis unit 18 that analyzes information detected by the vehicle sensor 17. It also has the function. As an image stored in the memory 21, an image captured by the camera 13 in a stopped state is rewritten with an image captured in the luggage compartment 11 temporarily stored in the memory 21 before that. The timing of rewriting can be considered, for example, when the engine is started and when the transmission is switched from neutral to drive. The image of the luggage compartment 11 that is temporarily stored in the memory 21 is a comparative image for detecting the collapse of the load in the state of the load 42 after collapse from the load 41 before collapse shown in FIG.

  Here, the situation analysis unit 18 will be described in more detail. The situation analysis unit 18 to which the output of the sensor 17 that detects the situation of the cargo compartment 11 is supplied includes a cargo compartment change analysis unit 181, a traveling state analysis unit 182, and a cargo collapse determination unit 183.

  The cargo space change analysis unit 181 obtains the coordinates of the change region of the inter-frame difference between one frame of the image in the cargo compartment 11 captured by the camera 13 during traveling and one frame of the image stored in the memory 21 to store the memory. 21. When the difference between frames is larger than a predetermined value, the change in the cargo compartment 11 and the change occurrence location in the cargo compartment 11 are specified, and it is determined that there is a high possibility that the collapse of the cargo has occurred.

  The traveling state analysis unit 182 determines that the possibility of collapsing of the load is high when the detected information of the acceleration sensor indicates the acceleration stored in advance. For the detection information of the rudder angle sensor, when the values are close to the values of the pre-stored vehicle speed and rudder angle, it is judged that there is a high possibility of cargo collapse, and for the detection information of the vehicle speed sensor When the vehicle speed is faster than a value stored in advance, it is determined that the possibility of collapsing is high.

  The cargo collapse determination unit 183 makes a determination based on the results analyzed by the luggage compartment change analysis unit 181 and the traveling state analysis unit 182, and outputs the determination result to the image processing unit 14. That is, when the possibility of the collapse of the cargo is detected based on the information of both the image and the sensor 17, the result of the collapse of the cargo is output to the image processing unit 14. If there is no change in the difference between frames even if the risk of collapse of cargo is detected based on the information of the sensor 17, the result of no collapse of cargo is output to the image processing unit 14. Regardless of the sensor 17 information, if the result of obtaining the interframe difference is slight but a change is detected in the cargo compartment, the result that there is a possibility of cargo collapse is output to the image processing unit 14. Regardless of the difference between frames, if the information from the sensor 17 indicates an abnormal value, the result of the load collapse is output to the image processing unit 14.

  Next, the image processing unit 14 will be described in more detail. The image processing unit 14 that displays the output image in the cargo compartment 11 on the monitor 15 acquires an image signal obtained by digitally converting the analog image signal based on the control of the control circuit 16 and performs general image conversion processing and the like. In addition, the display control unit 141, the image update unit 142, the generation factor drawing unit 143, and the generation part drawing unit 144 are provided.

  The display control unit 141 provides an automatic detection mode and a fixed mode, and always displays an image in the fixed mode, and displays based on a situation analysis result in the automatic detection mode. The update operation can be stopped and restarted at an arbitrary timing.

  The image update unit 142 displays the image of the camera 13 in the cargo compartment 11 on the monitor 15 when the determination result of the load collapse determination unit 183 determines that there is load collapse or the possibility of load collapse.

  If the cause of the collapse of cargo can be specified, the generation factor drawing unit 143 performs a drawing process to which a symbol or a character explaining the generation factor is added together with the image of the camera 13 and displays it on the monitor 15.

  When the occurrence location drawing unit 144 can identify the location where the collapse of the cargo occurs, the occurrence location drawing unit 144 performs a drawing process indicating the occurrence location with a rectangle or a symbol that makes it easy to specify the occurrence location along with the image of the camera 13. indicate.

  Next, a more detailed operation of this embodiment will be described with reference to the flowchart of FIG. 5 and supplementary explanatory diagrams of FIG. 6 and FIG.

  In step S <b> 1 of FIG. 5, the image of the camera 13 and the information of the sensor 17 that are temporarily stored in the memory 21 in the control circuit 16 are updated with the image acquired by the latest camera 13 and the information of the sensor 17. The information analysis unit 18 analyzes the image of the camera 13 and the information of the sensor 17 stored in the memory 21 updated in step S1 (S2). The information analysis unit 18 determines a change area from the difference between one frame of the camera 13 image and one frame of the camera 13 image stored in the memory 21, and stores the coordinates in the memory 21 (S3). It should be noted that only a region where there is a preset inter-frame difference of threshold abnormality so that some inter-frame difference is ignored.

  In step S4, if it is determined that the detected value of the sensor 17 updated in step S1 is larger than the abnormal state stored in advance and the threshold value Th1 (abnormal) shown in FIG. It is determined that there is a high possibility that the alarm has occurred, the process proceeds to step S5, and a warning is issued from the alarm generation unit 19. The warning here informs the driver of an abnormal state in the cargo compartment 11 by voice or warning sound from the speaker 191 and blinking the LED 192.

  If it is determined in step S4 that the detected value of the sensor 17 analyzed in step S2 is smaller than the previously stored abnormal state, that is, the threshold Th2 (with change) shown in FIG. 6 or no change, the process proceeds to step S6. If it is determined in step S6 that the interframe difference analyzed in step S2 shows that a large change has been observed in the cargo compartment 11, it is determined that there is a high possibility that an abnormality has occurred in the cargo compartment 11, and the process proceeds to step S5. The warning is issued from the alarm generation unit 19.

  If it is determined in step S6 that the interframe difference analyzed in step S2 is smaller than the threshold, the process proceeds to step S7. In step S7, if the interframe difference is the threshold value Th2 (changed) in FIG. 6, it is determined that there is a slight change in the cargo compartment 11, and the process proceeds to step S8. If it is determined in step S8 that the detection result of the sensor 17 in step S2 is abnormal, the process proceeds to step S5, and an abnormal state in the cargo compartment 11 is warned through the alarm generation unit 19.

  In step S9, it is determined what causes the warning in step S5. If at least one of the vehicle speed sensor, rudder angle sensor, and acceleration sensor in the sensor 17 detects an abnormality, information based on the sensor that detected the abnormality is sent to the generation factor drawing unit 143 in step S10, and the generation factor The drawing generation process corresponding to is performed, and the process proceeds to step S11.

  As shown in FIG. 7, the drawing process in step S10 is, for example, [speed over] when the sensor 17 that detects an abnormality is a vehicle speed sensor, and the sensor 17 that detects an abnormality is a steering angle sensor. For example, when the sensor 17 that detects an abnormality is an accelerometer, for example, “It is a sudden handle”, a drawing that means “was shaking” is generated.

  If it is determined in step S9 that none of the various sensors of the sensor 17 has detected an abnormality, the process proceeds to step S11. If no abnormality is detected by the sensor 17 in step S8, the process proceeds to step S11.

  In step S11, the location where the load collapse occurred is acquired based on the coordinates calculated from the change area from the interframe difference between one frame of the camera 13 image in step S2 and one frame of the camera 13 image stored in the memory 21. The process proceeds to step S12.

  If it is determined in step S12 that the location where the load collapse has occurred can be specified, the process proceeds to step S13, and the control circuit 12 performs a drawing generation process of a marker representing the location where the load collapse has occurred with respect to the occurrence location drawing unit 144.

  If it is determined in step S12 that the location where the cargo collapse has occurred cannot be specified, the process proceeds to step S14. If the difference between the frames is unchanged in FIG. 6 in step S7, the process proceeds to step S14. In step S <b> 14, the drawing generated by the generation factor drawing unit 143 and the generation part drawing unit 144 is displayed on the monitor 15.

  As described above, the warning by the alarm generation unit 19 is an unconditional warning when there is anomaly information by the sensor 17 due to a large behavior or when there is a large inter-frame difference. Added a warning when the occurrence location is specified.

  As a result, it is possible to remove a factor that hinders safe driving of the driver, and to eliminate the cause of the false alarm as much as possible, and to improve the reliability of the driver with respect to the monitoring device. In addition, it is possible to display an easy-to-understand image of the location where the cargo collapse occurred, and the driver can immediately confirm the dangerous location. In addition, normally the cargo room image is not shown, and when the cause of occurrence and the location of the load collapse can be identified, the cause of the occurrence and the location of the load collapse are displayed on the monitor, thereby further inhibiting the obstacles to safe driving. It can be removed.

  In this embodiment, it is possible to efficiently present the condition in the cargo compartment without obstructing the driving operation of the driver, and the driver can easily generate an alarm generation factor even under conditions in which vehicle vibration occurs frequently. Can be confirmed.

  In the above-described embodiment, three types of sensors, a vehicle speed sensor, a rudder angle sensor, and an acceleration sensor are used. However, for example, only an acceleration sensor may be used. It may be a sensor that detects movement such as a human sensor.

  Further, the LED 192 of the alarm generating unit 19 may be alarmed by characters using LEDs in addition to the alarm by blinking. If the monitor 15 has a warning function by the LED 192, the LED 192 is not always necessary.

  Although several embodiments have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, combinations, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 11 Loading platform 12 Lighting fixture 13 Camera 14 Image processing part, 141 Display control part, 142 Image update part, 143 Generation | occurrence | production factor drawing part, 144 Generation | occurrence | production location drawing part 15 Monitor 16 Control part 17 Sensor 18 Situation analysis part, 181 Loading room change analysis , 182 Running state analysis unit, 183 Load collapse determination unit 19 Alarm generation unit, 191 Speaker, 192 LED
20 Operation unit 21 Memory

Claims (7)

A camera that is installed in the cargo compartment of the vehicle and acquires an image of the cargo compartment;
A sensor for detecting the behavior of the luggage compartment;
A situation analysis unit that analyzes the situation in the cargo compartment from the image acquired by the camera and detection information of the sensor;
Based on the analysis result of the cargo compartment obtained by the situation analysis unit, an alarm generation unit that notifies the driver of an alarm,
A cargo compartment monitoring device comprising: an image processing unit that generates a drawing based on an analysis result obtained by the situation analysis unit and supplies the drawing to a monitor that informs a driver of the situation inside the cargo compartment.   The situation analysis unit is configured to determine a change in the cargo compartment and a change occurrence location in the cargo compartment based on a difference between frames of the frame of the image information in the cargo compartment of the vehicle that is temporarily stored and the frame of the image information during traveling. The load chamber change analysis unit that determines that there is a high possibility of occurrence of cargo collapse, and the sensor is an acceleration sensor, and the value of the sensor indicates a value that is highly likely to cause cargo collapse, The luggage compartment monitoring device according to claim 1, further comprising: a traveling state analysis unit that determines that the possibility of collapse of the cargo is high.   The situation analysis unit is configured to determine a change in the cargo compartment and a change occurrence location in the cargo compartment based on a difference between frames of the frame of the image information in the cargo compartment of the vehicle that is temporarily stored and the frame of the image information during traveling. And a rudder angle sensor that detects the relationship between the vehicle speed and the angle at which the steering wheel is turned, and the value of the sensor is determined as follows: The luggage compartment monitoring device according to claim 1, further comprising: a traveling state analysis unit that determines that there is a high possibility of occurrence of load collapse when close to the behavior at the time of load collapse occurrence.   The load collapse determination unit determines that there is a load collapse based on both the image of the camera and the sensor information, and determines that there is a load collapse and notifies the image collapse information from the image processing unit through the monitor. The luggage compartment monitoring device according to claim 1.   Even if the load collapse determination unit detects the risk of load collapse from the sensor information, if there is no change in the difference between frames, the result of no load collapse is determined between frames regardless of the sensor information. As a result of the difference, when a slight change is detected in the cargo compartment, the result of the possibility of the collapse of the cargo is detected in the cargo compartment as a result of the difference between frames regardless of the sensor information. In this case, when the sensor information indicates an abnormal value regardless of the difference between the frames, the result of the load collapse is output to the image processing unit, respectively. Or the luggage storage monitoring apparatus of 4.   The image processing unit, when the load collapse occurrence location can be identified by the situation analysis unit, added to the image in the cargo room, a rectangle and a symbol that makes it easy to identify the occurrence location, and displayed on the monitor. The cargo room monitoring device according to 1.   2. The image processing unit according to claim 1, wherein, when the situation analysis unit is able to identify a cause of cargo collapse, the image processing unit adds symbols, characters, and the like that explain the factor to the cargo compartment image and displays them on the monitor. Cargo room monitoring device.

Images