JP2024047113A - Vehicle recording control device and vehicle recording control method - Google Patents

Abstract

[Problem] To appropriately monitor parking. [Solution] A vehicle recording control device 100 includes a video data acquisition unit 120 that acquires captured video data, an event detection unit 127 that detects events for the vehicle, a parking detection unit 129 that detects the parking state, an object detection unit 130 that detects objects around the vehicle when parked, a moving object detection unit 131 that detects moving objects, a recording function control unit 123 that performs recording due to events, and a camera control unit 139, and the object detection unit 130 detects the presence or absence of objects around the vehicle when parked, and if a surrounding object is detected, captures images using one of the multiple cameras that captures images in a direction other than the direction in which the surrounding object was detected, and if a surrounding object is detected and a moving object is detected around the vehicle, captures images using the multiple cameras including the camera that captures images in the direction in which the surrounding object was detected. [Selected Figure] Figure 1

Description

The present invention relates to a recording control device for a vehicle and a recording control method for a vehicle.

There is known a so-called drive recorder (a recording device for a vehicle) that records the surroundings of a vehicle. When an object detection unit detects an object that a person cannot easily cross, such as a garage wall, as a surrounding object that is less than a predetermined distance from the vehicle when the vehicle is parked, a technology is known in which recording is performed due to an event detected by an event detection unit using video data captured by a camera other than the camera that captures the direction in which the surrounding object was detected among multiple cameras (see, for example, Patent Document 1).

JP 2020-106943 A

In parking monitoring, it is preferable to capture a wide range in order to reliably record any theft or damage to the vehicle. However, in the technology described in Patent Document 1, when the vehicle is parked, video data captured by a camera in a direction in which a surrounding object less than a specified distance from the vehicle is detected is not recorded, and when an event is detected, video data captured by a camera in a direction in which no surrounding object is detected is recorded as an event. For this reason, if a third party who intends to harm the vehicle goes around from the direction of a camera that does not detect surrounding objects to the direction of a camera that detects surrounding objects and commits theft or damage to property, there is a risk that the footage will not be recorded appropriately. As such, there is room for improvement in order to perform more appropriate parking monitoring.

The present invention was made in consideration of the above, and aims to provide an appropriate method for monitoring parking.

In order to solve the above-mentioned problems and achieve the object, the vehicle recording control device according to the present invention includes a video data acquisition unit that acquires video data captured by a plurality of image capture units that capture the surroundings of the vehicle, an event detection unit that detects an event for the vehicle, a parking detection unit that detects that the vehicle is in a parked state, an object detection unit that detects objects in the vicinity of the vehicle when the vehicle is parked from the video data acquired by the video data acquisition unit, a moving body detection unit that detects moving bodies in the vicinity of the vehicle from the video data acquired by the video data acquisition unit, and a recording unit that records the video data resulting from the event detected by the event detection unit as event recording data. The camera control unit includes a recording function control unit that records the captured image in the recording unit, and a camera control unit that controls the capture and stop of the multiple capture units. The object detection unit detects the presence or absence of a surrounding object that prevents a person from entering the vicinity of the vehicle when the vehicle is parked. When the object detection unit detects a surrounding object that prevents a person from entering the vicinity, the camera control unit performs capture by a capture unit among the multiple capture units that captures images in a direction other than the direction in which the surrounding object is detected. When the object detection unit detects the surrounding object and the moving object detection unit detects a moving object in the vicinity of the vehicle, the camera control unit performs capture by the multiple capture units including the capture unit that captures images in the direction in which the surrounding object is detected.

The vehicle recording control method according to the present invention includes a video data acquisition step of acquiring video data captured by a plurality of image capture units that capture the periphery of the vehicle, an event detection step of detecting an event for the vehicle, a parking detection step of detecting that the vehicle is in a parked state, an object detection step of detecting objects in the vicinity of the vehicle when the vehicle is parked from the video data acquired by the video data acquisition step, a moving body detection step of detecting moving bodies in the vicinity of the vehicle from the video data acquired by the video data acquisition step, and a recording device that records the video data resulting from the event detected by the event detection step in a recording unit as event recording data. The method includes a function control step and a camera control step for controlling the shooting and stopping of the multiple shooting units, and the object detection step detects the presence or absence of a surrounding object that prevents a person from entering the vicinity of the vehicle when the vehicle is parked, and the camera control step, when a surrounding object that prevents a person from entering is detected by the object detection step, performs shooting by a shooting unit among the multiple shooting units that shoots in a direction other than the direction in which the surrounding object is detected, and when the surrounding object is detected by the object detection step and a moving object in the vicinity of the vehicle is detected by the moving object detection step, performs shooting by the multiple shooting units including a shooting unit that shoots in the direction in which the surrounding object is detected.

The present invention has the effect of enabling proper parking monitoring.

FIG. 1 is a block diagram showing an example of the configuration of a vehicle-mounted recording device having a vehicle-mounted recording control device according to the first embodiment. FIG. 2 is a flowchart showing a process flow in the vehicle recording control device according to the first embodiment. FIG. 3 is a flowchart showing the flow of processing in the vehicle record control device according to the first embodiment, and is an example of processing for recording an event when a moving object is detected. FIG. 4 is a flowchart showing the flow of processing in the vehicle record control device according to the first embodiment, and is an example of processing for recording an event when acceleration equal to or greater than a threshold is detected. FIG. 5 is a flowchart showing the flow of processing in the vehicle record control device according to the second embodiment, and is an example of processing for recording an event when a moving object is detected. FIG. 6 is a flowchart showing the flow of processing in the vehicle record control device according to the second embodiment, and is an example of processing for recording an event when acceleration equal to or greater than a threshold is detected.

The following describes in detail an embodiment of a vehicle recording control device according to the present invention with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiment.

[First embodiment]
<Recording device for vehicle>
1 is a block diagram showing an example of the configuration of a vehicle recording device 10 having a vehicle recording control device 100 according to the first embodiment. The vehicle recording device 10, which is a drive recorder that performs parking monitoring, performs event recording when an acceleration equal to or greater than a threshold value is applied to the vehicle or when a moving object is detected. The vehicle recording device 10 appropriately performs parking monitoring by using an appropriate camera out of multiple cameras according to the surrounding objects around the vehicle.

In this embodiment, the surrounding object is an object that is located near the vehicle periphery to prevent a person from entering the periphery of the vehicle. The surrounding object is, for example, a garage, a wall, a fence, or an object that a person cannot easily cross.

The vehicle recording device 10 may be a device that is installed in the vehicle, or may be a portable device that can be used in the vehicle. The vehicle recording device 10 may also be realized by including the functions or configuration of a device that is pre-installed in the vehicle or a navigation device. The vehicle recording device 10 has a camera unit (multiple image capture units) 210, a recording unit 220, an operation unit 230, a display unit 240, an acceleration sensor 250, a GPS (Global Positioning System) receiving unit 260, and a vehicle recording control device 100.

The camera unit 210 has multiple cameras that capture the surroundings of the vehicle. The multiple cameras capture images in different directions relative to the vehicle. In this embodiment, the camera unit 210 has a front camera 211 that can capture images in the front and a rear camera 212 that can capture images in the rear. The front camera 211 is disposed, for example, at the front of the vehicle interior. The rear camera 212 is disposed, for example, at the rear of the vehicle interior. In the following description, when it is not necessary to distinguish between the multiple cameras, they are described as the camera unit 210. In this embodiment, when the accessory power supply is OFF, in other words, when an event is detected while the vehicle is parked, the camera unit 210 can record video data for a predetermined period of time, for example, several tens of seconds. The camera unit 210 outputs the captured video data to the video data acquisition unit 120 of the vehicle recording control device 100. The video data is a moving image composed of images of, for example, 30 frames per second. Under the control of the vehicle recording control device 100, the camera unit 210 operates all or a selected portion of the multiple cameras equipped in the camera unit 210, and outputs the video data captured by the operating cameras to the video data acquisition unit 120.

The recording unit 220 is used for recording data in the vehicle recording device 10. The recording unit 220 is, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a recording unit such as a memory card. Alternatively, the recording unit 220 may be an external recording unit that is wirelessly connected via a communication device (not shown). The recording unit 220 records loop recording video data or event recording data based on a control signal output from the recording function control unit 123 of the vehicle recording control device 100.

The operation unit 230 can accept various operations on the vehicle recording device 10. For example, the operation unit 230 can accept an operation to manually record the captured video data in the recording unit 220 as event recording data. For example, the operation unit 230 can accept an operation to play back the loop recording video data or event recording data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation to erase the event recording data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation to end the loop recording. The operation unit 230 outputs operation information to the operation control unit 125 of the vehicle recording control device 100.

The display unit 240 is, for example, a display device specific to the vehicle recording device 10, or a display device shared with other systems including a navigation system. The display unit 240 may be formed integrally with the camera unit 210. The display unit 240 is, for example, a display including a liquid crystal display (LCD) or an organic electroluminescence (EL) display. In this embodiment, the display unit 240 is disposed in front of the driver of the vehicle on a dashboard, an instrument panel, a center console, or the like. The display unit 240 displays video data based on a video signal output from the display control unit 126 of the vehicle recording control device 100. The display unit 240 displays video data captured by the camera unit 210 or video data recorded in the recording unit 220.

The acceleration sensor 250 is a sensor that detects acceleration occurring to the vehicle. The acceleration sensor 250 outputs the detection result to the event detection unit 127 of the vehicle recording control device 100. The acceleration sensor 250 is a sensor that detects acceleration in, for example, three axial directions. The three axial directions are the forward/rearward direction, the left/right direction, and the up/down direction of the vehicle.

The GPS receiver 260 receives radio waves from GPS satellites (not shown). The GPS receiver 260 outputs the received radio wave signal to the location information acquisition unit 128 of the vehicle recording control device 100.

<Recording control device for vehicle>
The vehicle record control device 100 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit) and the like. The vehicle record control device 100 loads a stored program into memory and executes instructions included in the program. The vehicle record control device 100 includes an internal memory (not shown), which is used for temporary storage of data in the vehicle record control device 100. The vehicle record control device 100 includes a video data acquisition unit 120, a buffer memory 121, a video data processing unit 122, a recording function control unit 123, a playback control unit 124, an operation control unit 125, a display control unit 126, an event detection unit 127, a position information acquisition unit 128, a parking detection unit 129, an object detection unit 130, a moving object detection unit 131, and a camera control unit 139, which are connected to a bus 110.

The video data acquisition unit 120 acquires video data captured around the vehicle. More specifically, the video data acquisition unit 120 acquires the video data output by the camera unit 210 and outputs it to the buffer memory 121. The video data acquisition unit 120 acquires video data captured by all or a selected part of the operating cameras among the multiple cameras equipped in the camera unit 210.

The buffer memory 121 is an internal memory provided in the vehicle recording control device 100, and is a memory that temporarily stores a certain amount of video data acquired by the video data acquisition unit 120 while updating it.

The video data processing unit 122 converts the video data temporarily stored in the buffer memory 121 into an arbitrary file format, such as MP4 format, encoded with an arbitrary codec, such as H.264 or MPEG-4 (Moving Picture Experts Group). The video data processing unit 122 generates video data as a file for a certain period of time from the video data temporarily stored in the buffer memory 121. As a specific example, the video data processing unit 122 generates 60 seconds of video data as a file in the order in which the video data temporarily stored in the buffer memory 121 was stored. The video data processing unit 122 outputs the generated video data to the recording function control unit 123. The video data processing unit 122 also outputs the generated video data to the display control unit 126. The period of the video data generated as a file is set to 60 seconds as an example, but is not limited to this. The video data referred to here may be data including audio data input through a microphone (not shown) in addition to the video data captured by the camera unit 210.

The recording function control unit 123 controls the recording unit 220 to record the video data filed by the video data processing unit 122. During the period when loop recording processing is being performed, such as when the vehicle's accessory power is ON, the recording function control unit 123 records the video data filed by the video data processing unit 122 in the recording unit 220 as overwritable video data. More specifically, during the period when loop recording processing is being performed, the recording function control unit 123 continues to record the video data generated by the video data processing unit 122 in the recording unit 220, and when the capacity of the recording unit 220 becomes full, it overwrites the oldest video data with new video data and records it.

Furthermore, when the event detection unit 127 detects an event, the recording function control unit 123 records the video data for a predetermined period of time in the video data generated by the video data processing unit 122 in the recording unit 220 as event recording data that is prohibited from being overwritten.

When shooting starts after an event is detected, the event record data recorded by the recording function control unit 123 in the recording unit 220 is video data for a predetermined period, for example, 10 seconds or more and 60 seconds or less, from when the event is detected and shooting starts. When loop recording processing is being performed, the event record data recorded by the recording function control unit 123 in the recording unit 220 is video data for a predetermined period, for example, 10 seconds or more and 60 seconds or less, before and after the event is detected.

When the vehicle's accessory power supply is OFF, in other words, while the vehicle is parked, the recording function control unit 123 operates the parking monitoring function to record the video data captured by the camera unit 210. More specifically, the parking monitoring function detects an event and records the video data using a loop recording process.

In this embodiment, when a surrounding object is detected by the object detection unit 130, the recording function control unit 123 records the video data captured by the camera of the camera unit 210 other than the camera that captures the direction in which the surrounding object is detected (hereinafter referred to as the "surrounding object direction") as event recording data. In other words, when a surrounding object is detected by the object detection unit 130, the recording function control unit 123 records the video data captured by the camera of the camera unit 210 other than the surrounding object direction, which is the direction in which the surrounding object is detected, as event recording data. More specifically, when the object detection unit 130 detects a surrounding object less than a predetermined distance from the vehicle when the vehicle is parked, the recording function control unit 123 performs recording due to the event detected by the event detection unit 127 using the captured data captured by the camera of the camera unit 210 other than the camera that captures the surrounding object direction.

A camera other than the one facing the surrounding objects is a camera included in the camera unit 210, whose shooting range includes directions other than the surrounding object direction. For example, if the surrounding object direction is in front of the vehicle, the camera other than the one facing the surrounding objects is the rear camera 212, whose shooting range includes directions other than the front of the vehicle.

More specifically, when a surrounding object is detected within a predetermined distance from the vehicle, the recording function control unit 123 records video data captured by a camera in the camera unit 210 other than the camera that captures the surrounding object direction. If there is a surrounding object, there is no risk of a person approaching from the surrounding object direction and harming the vehicle. This allows the recording function control unit 123 to capture and record video data using a camera in the camera unit 210 other than the camera that captures the surrounding object direction. Then, based on the detection of an event by the event detection unit 127, the recording function control unit 123 records the video data captured by a camera in the camera unit 210 other than the camera that captures the surrounding object direction as event recording data.

When a surrounding object is detected by the object detection unit 130 and a moving object in the vicinity of the vehicle is detected by the moving object detection unit 131, the recording function control unit 123 records the video data captured by all cameras, including the cameras of the camera unit 210 that capture the image in the direction of the surrounding object, as event recording data based on the event detection by the event detection unit 127.

Furthermore, if the recording function control unit 123 does not detect any surrounding objects within a predetermined distance from the vehicle, it records the video data captured by all of the cameras in the camera unit 210. If there are no surrounding objects, there is a risk that a person could approach from any direction and harm the vehicle. For this reason, it is preferable for the recording function control unit 123 to record the video data captured by all of the cameras. Then, based on the detection of an event by the event detection unit 127, the recording function control unit 123 records the captured data captured by all of the cameras as event recording data.

The playback control unit 124 controls the playback of the loop recorded video data or event recorded data recorded in the recording unit 220 based on a playback operation control signal output from the operation control unit 125.

The operation control unit 125 acquires operation information of the operation accepted by the operation unit 230. For example, the operation control unit 125 acquires recording operation information indicating a manual recording operation of video data, playback operation information indicating a playback operation, or erase operation information indicating an erase operation of video data, and outputs a control signal. For example, the operation control unit 125 acquires end operation information indicating an operation to end loop recording, and outputs a control signal.

The display control unit 126 controls the display of video data on the display unit 240. The display control unit 126 outputs a video signal that causes the video data to be output to the display unit 240. More specifically, the display control unit 126 outputs a video signal that is displayed by playing back video data captured by the camera unit 210, or loop recorded video data or event recorded data recorded in the recording unit 220.

The event detection unit 127 detects an event when the vehicle is subjected to acceleration equal to or greater than a threshold value, or when a moving object is detected.

A case will be described where the application of acceleration to the vehicle that is equal to or greater than a threshold is detected as an event. The event detection unit 127 detects an event for the vehicle based on the detection result of the acceleration sensor 250. More specifically, the event detection unit 127 detects an event when acceleration equal to or greater than a threshold is detected by the acceleration sensor 250. The threshold for detecting an event during parking recording may be set to a lower threshold than the threshold for detecting an event while driving. For example, if the acceleration threshold for detecting an event while driving is about 1 G, the acceleration threshold for detecting an event during parking recording may be set to about 0.3 G.

A case will be described where the detection of a moving object is detected as an event. In this embodiment, the event detection unit 127 detects the detection of a moving object by the moving object detection unit 131 as an event. Alternatively, the event detection unit 127 performs image processing on the video data captured by the camera of the camera unit 210, and detects the detection of a moving object in the vicinity of the vehicle as an event for the vehicle. Any known technology may be used as a method for detecting a moving object from video data, and there is no limitation.

The object detection unit 130 detects objects around the vehicle when the vehicle is parked. More specifically, when the vehicle is parked, the object detection unit 130 detects surrounding objects that are present within a predetermined distance from the vehicle at the vehicle's parking position and that prevent people from entering the vehicle. The predetermined distance is, for example, about 2 m. The object detection unit 130 also detects the detection direction of the surrounding objects relative to the vehicle.

The object detection unit 130 may detect an object based on the detection results of a sensor that outputs radio waves other than visible light toward the periphery of the vehicle and detects an object by the reflected waves of the radio waves. The object detection unit 130 may detect an object based on the detection results of an infrared sensor, an ultrasonic sensor, a millimeter wave radar, or the like. The object detection unit 130 may detect an object by performing image processing on video data captured by the camera unit 210, for example. The object detection unit 130 may detect an object based on location information acquired by the location information acquisition unit 128 and map information acquired from a navigation system, for example. The object detection unit 130 may be any unit as long as it is capable of detecting an object.

The moving object detection unit 131 detects the presence or absence of a moving object from the video data acquired by the video data acquisition unit 120. The moving object detection unit 131 detects a moving object by, for example, detecting an area in the video data where brightness or color information changes from frame to frame in pixel units or in block units of several pixels square. The moving object detection unit 131 may also detect a moving object by other known methods.

The moving object detection unit 131 detects moving objects around the vehicle using video data captured by the activated cameras of the camera unit 210. If no surrounding objects are detected by the object detection unit 130, the moving object detection unit 131 detects moving objects around the vehicle using video data captured by all the cameras of the camera unit 210. If the object detection unit 130 detects a surrounding object that is preventing a person from entering, the moving object detection unit 131 performs image processing on the video data captured by the cameras of the camera unit 210 that capture images in directions other than the direction of the surrounding object, and detects moving objects around the vehicle.

A moving object is, for example, a moving object such as a vehicle, a person, or a falling or flying object.

The camera control unit 139 controls the starting and stopping of the front camera 211 and the rear camera 212 according to the surrounding conditions around the vehicle. For example, the camera control unit 139 stops the front camera 211 or the rear camera 212 that captures the image in the direction in which a surrounding object is detected. For example, when a moving object is detected, the camera control unit 139 starts the stopped front camera 211 or rear camera 212.

When a surrounding object is detected by the object detection unit 130, the camera control unit 139 controls the camera unit 210 to stop capturing images in the direction of the surrounding object and to capture images in the direction other than the direction of the surrounding object.

When the moving object detection unit 131 detects a moving object in the vicinity of the vehicle, the camera control unit 139 controls the camera of the stopped camera unit 210 to start up and take a picture.

The location information acquisition unit 128 calculates the vehicle's current location information using a known method based on the radio waves received by the GPS receiver unit 260.

The parking detection unit 129 detects that the vehicle is in a parked state based on information obtained from the vehicle.

The vehicle is considered to be in a parked state when the shift position is in "parking", the handbrake is operated, for a period of time of, for example, 5 seconds or more, the speed is zero, the engine is stopped, etc. Alternatively, the vehicle may be determined to be in a parked state when any trigger occurs, such as a user operation.

The vehicle recording device 10 constantly records video data (so-called loop recording) and detects events from the time the engine starts until it is stopped, that is, while the vehicle is not parked but operating. When the accessory power supply is OFF, in other words, while the vehicle is parked, if power is supplied to the vehicle recording device 10 from the vehicle battery in addition to the accessory power supply, the vehicle recording device 10 constantly records video data (so-called loop recording) and detects events, and when the vehicle recording device 10 is operating on its own dedicated battery, it detects events and captures video data when an event is detected.

<Processing in a Vehicle Recording Control Device (Vehicle Recording Control Method)>
Next, the flow of processing in the vehicle record control device 100 will be described with reference to Fig. 2. Fig. 2 is a flow chart showing the flow of processing in the vehicle record control device according to the first embodiment.

The vehicle record control device 100 uses the parking detection unit 129 to determine whether the vehicle is parked (step S11). If the parking detection unit 129 determines that the vehicle is parked (Yes in step S11), the vehicle record control device 100 proceeds to step S12. If the parking detection unit 129 determines that the vehicle is not parked (No in step S11), the vehicle record control device 100 ends this process. In the process of FIG. 2, before the determination in step S12 is Yes and after the process of FIG. 2 is completed, the vehicle is not parked, so event detection is performed while the vehicle is traveling.

If it is determined that the vehicle is in a parked state (Yes in step S11), the vehicle record control device 100 activates the parking monitoring function (step S12). The vehicle record control device 100 ends this process.

Next, using FIG. 3, a process flow for detecting the detection of a moving object as an event and recording video data will be described as an example of a parking monitoring function. FIG. 3 is a flowchart showing the process flow in a vehicle recording control device according to the first embodiment, and is an example of a process for recording an event when a moving object is detected. The process shown in FIG. 3 records video data for a predetermined period before and after the event is detected as event detection data in the recording unit 220 from video data that is loop-recorded based on event detection.

The process in FIG. 3 begins when the parking monitoring function is activated in step S12 of the flowchart shown in FIG. 2.

The vehicle record control device 100 determines whether there is a surrounding object that prevents a person from entering within a predetermined distance from the vehicle (step S111). More specifically, if the detection result of the object detection unit 130 indicates that there is a surrounding object that prevents a person from entering within a predetermined distance from the vehicle and the vehicle record control device 100 determines that there is a surrounding object that prevents a person from entering (Yes in step S111), the vehicle record control device 100 proceeds to step S112. The object detection by the object detection unit 130 for making the determination in step S111 may be based on the detection result immediately before parking the vehicle, or may be detected after parking. If the detection result of the object detection unit 130 does not indicate that there is a surrounding object that prevents a person from entering within a predetermined distance from the vehicle and the vehicle record control device 100 does not determine that there is a surrounding object that prevents a person from entering (No in step S111), the vehicle record control device 100 proceeds to step S117.

When it is determined that there is a surrounding object that prevents a person from entering the vehicle within a predetermined distance (Yes in step S111), the vehicle recording control device 100 starts moving object detection and continuous recording by the cameras of the camera unit 210 other than the one facing the surrounding object direction (step S112). More specifically, the vehicle recording control device 100 causes the camera control unit 139 to capture images by the cameras other than the one facing the surrounding object direction, and stops capturing images by the cameras facing the surrounding object direction. Then, the moving object detection unit 131 starts detecting moving objects from the video data captured by the cameras other than the one facing the surrounding object direction. The vehicle recording control device 100 starts loop recording processing using the video data captured by the cameras other than the one facing the surrounding object direction, using the recording function control unit 123. The vehicle recording control device 100 proceeds to step S113.

The vehicle record control device 100 determines whether or not a moving object has been detected (step S113). More specifically, if the moving object detection unit 131 detects a moving object around the vehicle (Yes in step S113), the vehicle record control device 100 proceeds to step S114. If the moving object detection unit 131 does not detect a moving object around the vehicle (No in step S113), the vehicle record control device 100 proceeds to step S116.

If a moving object is detected around the vehicle (Yes in step S113), the vehicle record control device 100 activates (starts capturing) the camera in the camera unit 210 facing the surrounding object, and starts continuous recording (step S114). More specifically, the vehicle record control device 100 causes the camera control unit 139 to start capturing images with the camera facing the surrounding object. Then, the vehicle record control device 100 starts detecting moving objects from the video data of all the cameras using the moving object detection unit 131. The vehicle record control device 100 starts loop recording processing using the video data of all the cameras using the recording function control unit 123. The vehicle record control device 100 proceeds to step S115.

The vehicle record control device 100 records event record data from the video data captured by all the cameras of the camera unit 210 (step S115). More specifically, the vehicle record control device 100 generates event record data from the video data acquired from all the cameras for a predetermined period of time before and after the event detection, using the video data processing unit 122. When the vehicle record control device 100 determines that the predetermined time has elapsed, it causes the recording function control unit 123 to record the event record data generated by the video data processing unit 122 in the recording unit 220, and proceeds to step S116.

The vehicle recording control device 100 determines whether the parking monitoring function has ended (step S116). End of the parking monitoring function is determined, for example, when the accessory power is turned ON or when the parking monitoring function is stopped by operating the operation unit 230. If it is determined that the parking monitoring function has ended (Yes in step S116), this process ends. If it is determined that the parking monitoring function has not ended (No in step S116), the process returns to step S113.

If it is not determined that there is a surrounding object that would prevent the person from entering the vehicle (No in step S111), the vehicle recording control device 100 starts moving object detection and continuous recording by all the cameras of the camera unit 210 (step S117). More specifically, the vehicle recording control device 100 uses the camera control unit 139 to capture images using all the cameras. The vehicle recording control device 100 starts detecting moving objects from the video data of all the cameras using the moving object detection unit 131. The vehicle recording control device 100 starts loop recording processing using the video data of all the cameras using the recording function control unit 123. The vehicle recording control device 100 proceeds to step S118.

The vehicle record control device 100 determines whether or not a moving object has been detected (step S118). More specifically, if the moving object detection unit 131 detects a moving object around the vehicle (Yes in step S118), the vehicle record control device 100 proceeds to step S119. If the moving object detection unit 131 does not detect a moving object around the vehicle (No in step S118), the vehicle record control device 100 proceeds to step S120.

If a moving object is detected around the vehicle (Yes in step S118), the vehicle recording control device 100 records event recording data from the video data captured by all the cameras of the camera unit 210 (step S119). More specifically, the vehicle recording control device 100 generates event recording data from the video data acquired from all the cameras for a predetermined period of time before and after the event detection, using the video data processing unit 122. When the vehicle recording control device 100 determines that the predetermined time has elapsed, it causes the recording function control unit 123 to record the event recording data generated by the video data processing unit 122 in the recording unit 220, and proceeds to step S120.

The vehicle recording control device 100 determines whether the parking monitoring function has ended (step S120). End of the parking monitoring function is determined, for example, when the accessory power is turned ON or when the parking monitoring function is stopped by operating the operation unit 230. If it is determined that the parking monitoring function has ended (Yes in step S120), this process ends. If it is determined that the parking monitoring function has not ended (No in step S120), the process returns to step S118.

Next, using FIG. 4, we will explain the process flow for detecting the detection of acceleration equal to or greater than a threshold as an event and recording video data as another example of the parking monitoring function. FIG. 4 is a flowchart showing the process flow in a vehicle recording control device according to the first embodiment, and is an example of the process for recording an event when acceleration equal to or greater than a threshold is detected.

The process in FIG. 4 is started when the parking monitoring function is activated in step S12 of the flowchart shown in FIG. 2. The processes in steps S141 to S144, S147, S150, and S151 in FIG. 4 are the same as those in steps S111 to S114, S116, S119, and S120 in FIG. 2.

The vehicle record control device 100 determines whether acceleration equal to or greater than the threshold value has been detected (step S145). More specifically, if the event detection unit 127 detects acceleration equal to or greater than the threshold value, the vehicle record control device 100 determines that an event has been detected (Yes in step S145) and proceeds to step S146. If the event detection unit 127 does not detect acceleration equal to or greater than the threshold value, the vehicle record control device 100 determines that an event has not been detected (No in step S145) and proceeds to step S147.

If an acceleration equal to or greater than the threshold is detected, the vehicle record control device 100 determines that an event has been detected (Yes in step S145), and records event record data from the video data captured by the active camera of the camera unit 210 (step S146). More specifically, the vehicle record control device 100 uses the video data processing unit 122 to generate event record data from video data acquired from the active camera for a predetermined period of time before and after the event detection. When the vehicle record control device 100 determines that the predetermined time has elapsed, it causes the recording function control unit 123 to record the event record data generated by the video data processing unit 122 in the recording unit 220, and proceeds to step S147.

If it is not determined that there is a surrounding object that is preventing the person from entering (No in step S141), the vehicle recording control device 100 starts continuous recording by all the cameras of the camera unit 210 (step S148). More specifically, the vehicle recording control device 100 causes all the cameras to take pictures using the camera control unit 139. The vehicle recording control device 100 starts a loop recording process of the video data from all the cameras using the recording function control unit 123. The vehicle recording control device 100 proceeds to step S149.

The vehicle record control device 100 determines whether acceleration equal to or greater than the threshold value has been detected (step S149). More specifically, if the event detection unit 127 detects acceleration equal to or greater than the threshold value, the vehicle record control device 100 determines that an event has been detected (Yes in step S149) and proceeds to step S150. If the event detection unit 127 does not detect acceleration equal to or greater than the threshold value, the vehicle record control device 100 determines that an event has not been detected (No in step S149) and proceeds to step S151.

In this way, when a surrounding object that prevents a person from entering the vicinity of the vehicle is detected, the camera in camera unit 210 facing the surrounding object is stopped from capturing images, and video data is captured by cameras other than those facing the surrounding object, and the parking monitoring function is activated. Also, when no surrounding object is detected, video data is captured by all cameras in camera unit 210, and the parking monitoring function is activated. Furthermore, when a moving object is detected after a surrounding object that prevents a person from entering the vicinity of the vehicle is detected, capturing images by the camera facing the surrounding object is started, and the event record data captured by all cameras is recorded.

＜Effects＞
As described above, in this embodiment, when a surrounding object that prevents a person from entering the vicinity of the vehicle is detected, the camera in the camera unit 210 in the direction of the surrounding object is stopped from capturing images, and the camera other than the camera in the direction of the surrounding object is used to capture image data, thereby enabling the parking monitoring function to be operated. In addition, in this embodiment, when a surrounding object is not detected, image data is captured by all the cameras in the camera unit 210, enabling the parking monitoring function to be operated. Furthermore, when a moving object is detected after a surrounding object that prevents a person from entering the vicinity of the vehicle is detected, the camera in the direction of the surrounding object is started to capture images, and the event record data captured by all the cameras can be stored. According to this embodiment, when a trouble such as contact with the vehicle is likely to occur, parking monitoring can be appropriately performed using all the cameras. In this way, according to this embodiment, parking monitoring can be appropriately performed using an appropriate camera in the camera unit 210.

In this way, when a surrounding object is detected, this embodiment operates only the camera that can capture the direction in which a person is likely to approach, thereby reducing power consumption and lengthening the parking monitoring time. When a moving object is detected while the camera in the direction of the surrounding object is stopped, this embodiment starts capturing images with the camera in the direction of the surrounding object, and can record video data that includes the camera in the direction of the surrounding object.

[Second embodiment]
The vehicle-mounted recording device 10 according to this embodiment will be described with reference to FIGS.
FIG. 5 is a flowchart showing the flow of processing in the vehicle record control device according to the second embodiment, which is an example of processing for recording an event when a moving object is detected. FIG. 6 is a flowchart showing the flow of processing in the vehicle record control device according to the second embodiment, which is an example of processing for recording an event when acceleration equal to or greater than a threshold is detected. The basic configuration of the vehicle record device 10 is the same as that of the vehicle record device 10 of the first embodiment. In the following description, the same or corresponding reference numerals are used for components similar to those of the vehicle record device 10, and detailed description thereof will be omitted. The vehicle record device 10 differs from the first embodiment in the processing in the moving object detection unit 131 and the camera control unit 139.

After detecting a moving object, the moving object detection unit 131 performs image processing on the video data captured by the camera of the camera unit 210 to detect that the moving object in the vicinity of the vehicle is no longer detected. After detecting a moving object, the moving object detection unit 131 performs image processing on the video data captured by the camera of the camera unit 210 to detect that the detected moving object has left the vehicle.

When a moving object is no longer detected after the moving object detection unit 131 has detected it, the camera control unit 139 controls the camera in the camera unit 210 facing the surrounding object direction to stop capturing images, and allows only the camera capturing images in directions other than the surrounding object direction to continue capturing images. When a moving object is detected by the moving object detection unit 131 and the detected moving object moves away from the vehicle, the camera control unit 139 controls the camera in the camera unit 210 facing the surrounding object direction to stop capturing images, and allows only the camera capturing images in directions other than the surrounding object direction to continue capturing images.

Next, referring to FIG. 5, a process flow for detecting the detection of a moving object as an event and recording video data will be described as an example of the parking monitoring function. The process in FIG. 5 is started when the parking monitoring function is operated in step S12 of the flowchart shown in FIG. 2. The processes in steps S121 to S125, S128, and S129 to S132 in FIG. 5 are the same as those in steps S111 to S115, S116, and S117 to S120 in FIG. 3.

The vehicle record control device 100 determines whether or not the moving object is no longer detected (step S126). More specifically, if the moving object detection unit 131 no longer detects the detected moving object around the vehicle (Yes in step S126), the vehicle record control device 100 proceeds to step S127. If the moving object detection unit 131 detects the detected moving object around the vehicle (No in step S126), the vehicle record control device 100 proceeds to step S128.

If the detected moving object around the vehicle is no longer detected (Yes in step S126), the vehicle record control device 100 stops the camera of the camera unit 210 facing the surrounding object (step S127) by the camera control unit 139. The vehicle record control device 100 proceeds to step S128.

Next, referring to FIG. 6, a process flow for detecting the detection of acceleration equal to or greater than a threshold as an event and recording video data will be described as another example of the parking monitoring function. Steps S151 to S154 and steps S157 to S159 shown in FIG. 6 perform the same processes as steps S121 to S124 and steps S126 to S128 in the flowchart shown in FIG. 5. Steps S155, S156, and steps S160 to S163 shown in FIG. 6 perform the same processes as steps S145, S146, and steps S148 to S151 in the flowchart shown in FIG. 4.

＜Effects＞
As described above, in this embodiment, when a detected moving object is no longer detected, the activated camera in the direction of the surrounding object can be stopped from capturing images. According to this embodiment, when a detected moving object moves away from the vehicle, the activated camera in the direction of the surrounding object can be stopped from capturing images. In this embodiment, the camera is stopped when the need for capturing images in the direction of the surrounding object decreases, so that the power consumption can be reduced and the parking monitoring time can be extended.

The vehicle recording device 10 according to the present invention may be implemented in various different forms other than the above-described embodiment.

Each of the components of the illustrated vehicle recording device 10 is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of it may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

The configuration of the vehicle recording device 10 is realized, for example, as software, by a program loaded into memory. In the above embodiment, these functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, by hardware alone, software alone, or a combination of both.

The above-mentioned components include those that a person skilled in the art would easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the spirit of the present invention.

[Modification]
In the above embodiment, the camera at the entrance of the parking space for the vehicle may continue to capture images even when the vehicle is parked.

When monitoring parking, the camera control unit 139 controls the camera facing the entrance to take pictures regardless of the presence or absence of surrounding objects or the detection result of a moving object.

When the object detection unit 130 detects a surrounding object that is preventing a person from entering the vehicle, the moving object detection unit 131 performs image processing on the video data captured by the camera in the camera unit 210 facing the parking space entrance direction and the camera that captures images in a direction other than the direction of the surrounding object, to detect moving objects in the vicinity of the vehicle.

The reason for detecting a moving object using the entrance camera is that if a moving object is captured by the entrance camera, it is highly likely that the moving object has not moved into the range of an inactive camera. Therefore, the approach of a moving object to the entrance camera may be used as a trigger to control the activation of the camera.

A camera facing the entrance of a parking space is a camera installed facing the entrance of the parking space in which the vehicle is parked. A camera facing the entrance of a parking space is a camera that takes pictures of the rear of the vehicle when, for example, the vehicle is parked facing forward into the parking space by driving forward. A camera facing the entrance of a parking space is a camera that takes pictures of the front of the vehicle when, for example, the vehicle is parked facing backward into the parking space by driving backward.

The camera facing the entrance direction of the parking space may be recognized by performing image processing on the video data captured by the camera unit 210 during parking operations. More specifically, image processing may be performed on the video data captured by each camera of the camera unit 210 to recognize the entrance direction of the parking space entrance, an aisle in the parking lot, a sign indicating an entrance in the parking lot, or an entrance to the parking lot, and the camera installed facing the recognized entrance direction may be regarded as the camera facing the entrance direction of the parking space.

The camera in the direction of the entrance to the parking space may be determined as follows. In advance, in the parking space where the vehicle is to be parked, each camera of camera unit 210 records video data in a direction in which the camera will not be activated in that parking space, for example, the rear of the parking space. Then, when the vehicle is parked in the parking space, the video data captured by the camera of camera unit 210 is compared with video data captured and recorded in advance in a direction in which the camera will not be activated. The camera in the direction where the video data matches is then stopped.

A direction in which the camera will not be activated is, for example, a direction in which a vehicle or person cannot enter due to surrounding objects. Also, a direction in which the camera will not be activated may be defined even if there are no surrounding objects.

The camera unit 210 captures and records video data from a direction in which the camera is not activated in advance as reference data. Therefore, whether the vehicle is parked facing forward or backward, the camera facing the entrance to the parking lot is always activated.

＜Effects＞
In the modified example, the parking monitoring function can be operated by capturing image data using a camera other than the entrance direction camera and the camera in the surrounding object direction. According to the modified example, the parking monitoring function can be operated using image data from a camera in the entrance direction where a moving object is more likely to be detected. According to the modified example, parking monitoring can be appropriately performed using an appropriate camera from camera unit 210.

REFERENCE SIGNS LIST 10 Vehicle recording device 100 Vehicle recording control device 110 Bus 120 Video data acquisition unit 121 Buffer memory 122 Video data processing unit 123 Recording function control unit (recording control unit)
124 Playback control unit 125 Operation control unit 126 Display control unit 127 Event detection unit 128 Position information acquisition unit 129 Parking detection unit 130 Object detection unit 131 Moving object detection unit 139 Camera control unit 210 Camera unit (plurality of imaging units)
220 Recording unit 230 Operation unit 240 Display unit 250 Acceleration sensor 260 GPS receiving unit

Claims (4)

a video data acquisition unit that acquires video data captured by a plurality of imaging units that capture images of the surroundings of the vehicle;
an event detection unit that detects an event for the vehicle;
a parking detection unit that detects that the vehicle is in a parked state;
an object detection unit that detects objects around the vehicle when the vehicle is parked from the video data acquired by the video data acquisition unit;
a moving object detection unit that detects moving objects around the vehicle from the video data acquired by the video data acquisition unit;
a recording function control unit that records video data resulting from the event detected by the event detection unit as event recording data in a recording unit;
A camera control unit that controls the shooting and stopping of the plurality of shooting units;
Equipped with
the object detection unit detects the presence or absence of a surrounding object that prevents a person from entering a vicinity of the vehicle when the vehicle is parked;
The camera control unit is
When a surrounding object that prevents a person from entering the vehicle is detected by the object detection unit, an image is captured by an image capturing unit that captures an image in a direction other than the direction in which the surrounding object is detected, among the plurality of image capturing units;
When the object detection unit detects the peripheral object and the moving object detection unit detects a moving object in the vicinity of the vehicle, photographing is performed by the plurality of photographing units including a photographing unit that photographs a direction in which the peripheral object is detected.
Vehicle recording control device. When the moving object is no longer detected after the moving object is detected by the moving object detection unit, the camera control unit stops capturing images by an image capturing unit, among the plurality of image capturing units, that captures an image in a direction in which the peripheral object is detected.
The recording control device for a vehicle according to claim 1. The camera control unit, when parking the vehicle, performs imaging using a photographing unit that photographs an entrance direction of a parking space of the vehicle, among the plurality of photographing units.
The recording control device for a vehicle according to claim 1. A video data acquisition step of acquiring video data captured by a plurality of image capturing units that capture images of the periphery of the vehicle;
an event detection step of detecting an event for the vehicle;
a parking detection step of detecting that the vehicle is in a parked state;
an object detection step of detecting objects around the vehicle when the vehicle is parked from the image data acquired by the image data acquisition step;
a moving object detection step of detecting a moving object around the vehicle from the image data acquired by the image data acquisition step;
a recording function control step of recording video data resulting from the event detected by the event detection step as event recording data in a recording unit;
a camera control step of controlling the shooting and stopping of the plurality of shooting units;
Including,
The object detection step detects the presence or absence of a surrounding object that prevents a person from entering a surrounding area of the vehicle when parking the vehicle,
The camera control step includes:
When a surrounding object that prevents a person from entering the vehicle is detected by the object detection step, an image is captured by an image capturing unit that captures an image in a direction other than the direction in which the surrounding object is detected, among the plurality of image capturing units;
When the peripheral object is detected by the object detection step and a moving object in the periphery of the vehicle is detected by the moving object detection step, photographing is performed by the plurality of photographing units including a photographing unit that photographs a direction in which the peripheral object is detected.
Recording control method for a vehicle.

Images