JP2020205108A - Information recording device, information recording method, and information recording program - Google Patents

Abstract

To provide an information recording device capable of recording an image or the like such that, in such a case of confirming a surrounding situation and the like after an incident, the situation can be confirmed together with an operational state of an accessory of a vehicle.SOLUTION: The information recording device includes: an interface 1 that acquires a circumferential image obtained by imaging the periphery of a vehicle, and acquires state information indicating an operational state of an accessory of the vehicle; and an image processing unit 3 that, based on the circumferential image and the state information, generates display image data for displaying horn display or the like indicating an operational state at a time when the circumferential image is captured together with the circumferential image, and records this on a memory SD.SELECTED DRAWING: Figure 2

Description

The present application belongs to the technical fields of information recording devices, information recording methods and information recording programs. More specifically, it belongs to the technical field of an information recording device and an information recording method for recording display image information corresponding to a surrounding image captured from the moving body such as a vehicle, and a program for the information recording device. ..

In recent years, for example, in order to use it for the purpose of later verifying the situation when an accident, sudden acceleration or deceleration, sudden steering wheel, etc. occur while moving by a vehicle, for example, the front of the moving vehicle is imaged. So-called drive recorders for recording have become commonplace.

At this time, as the prior art relating to the drive recorder that captures the image used for the verification, for example, there is the prior art described in Patent Document 1 below. In this prior art, when the acceleration of the vehicle exceeds the threshold value for determining whether or not an accident has occurred, the time is the same as the imaging time for the image for a predetermined time captured before the accident. The configuration is such that the altitude data and the gradient data acquired in the above are superimposed and recorded in the image memory.

On the other hand, when determining the sharing of negligence liability for an accident based on the results of the above verification, for example, in addition to the captured image, the equipment of the car that caused the accident (for example, headlights, wipers). Or it is necessary to verify the operating state of electrical components such as winkers and the behavior of the other vehicle.

Japanese Unexamined Patent Publication No. 2013-206417

At this time, the accident image (moving image) captured by the prior art described in Patent Document 1 is useful for determining the accident liability sharing of the accident vehicle or its driver, as described above. In addition to the driving condition of the accident vehicle, the operating condition of the equipment of the vehicle (for example, whether the headlight was turned on at the time of the accident) also affects the sharing of liability for negligence. However, in the prior art described in Patent Document 1, there is no mention of recording the operating status of the equipment of the vehicle that caused the accident. Therefore, there is a demand for a drive recorder that can confirm the surrounding conditions and the like as well as the operating state of the equipment after the fact.

Therefore, this application was made in view of the above request, and one example of the problem is the situation, etc., together with the operating state of the equipment, when confirming the surrounding conditions, etc. of the vehicle, etc. after the fact. An object of the present invention is to provide an information recording device and an information recording method capable of recording an image or the like so that confirmation or the like can be performed, and a program for the information recording device.

In order to solve the above problems, the invention according to claim 1 comprises an image information acquisition means for acquiring peripheral image information corresponding to a peripheral image captured from the moving body around the moving body, and an image information acquisition means of the moving body. Based on the state information acquisition means for acquiring the state information indicating the operating state of the equipment and the surrounding image information and the state information, the operating state image indicating the operating state at the imaging time of the surrounding image is combined with the surrounding image. A display information acquisition means for acquiring display information for display and a recording means for recording the surrounding image information and the display image information corresponding to the display information on a recording medium are provided.

In order to solve the above problems, the invention according to claim 10 is executed in an information recording device including an image information acquisition means, a state information acquisition means, a display information acquisition means, and a recording means. An information recording method, which is an image information acquisition step of acquiring surrounding image information corresponding to a peripheral image captured from the moving body by the image information acquisition means, and an operating state of equipment of the moving body. Based on the state information acquisition step of acquiring the state information indicating the above state information by the state information acquisition means and the surrounding image information and the state information, the operation state image indicating the operation state at the imaging time of the surrounding image is obtained as the surrounding image. The display information acquisition step of acquiring the display information to be displayed together with the display information acquisition means, and the surrounding image information and the display image information corresponding to the display information are recorded on the recording medium by the recording means. Including the recording process.

In order to solve the above-mentioned problems, the invention according to claim 11 is an image in which a computer included in an information recording device acquires surrounding image information corresponding to a peripheral image obtained by capturing the surroundings of a moving body from the moving body. Information acquisition means, state information acquisition means for acquiring state information indicating the operation state of the equipment of the moving body, operation of indicating the operation state at the imaging time of the surrounding image based on the surrounding image information and the state information. As a display information acquisition means for acquiring display information for displaying a state image together with the surrounding image, and a recording means for recording the surrounding image information and the display image information corresponding to the display information on a recording medium. Make it work.

It is a block diagram which shows the outline structure of the information recording apparatus which concerns on embodiment. It is a block diagram which shows the outline structure of the drive recorder which concerns on Example. It is a flowchart which shows the recording process of the display image data in the drive recorder which concerns on embodiment, (a) is the flowchart which shows the whole of the recording process, (b) is the detail of the detection process such as the situation in the said recording process. It is a flowchart which shows, and (c) is the flowchart which shows the detail of the display image data generation processing in the said recording process. It is a figure which illustrates the image recorded by the recording process by the drive recorder which concerns on Example, (a) is a figure which shows the 1st example, (b) is a figure which shows the 2nd example.

Next, a mode for carrying out the present application will be described with reference to FIG. Note that FIG. 1 is a block diagram showing an outline configuration of the information recording device according to the embodiment.

As shown in FIG. 1, the information recording device S according to the embodiment includes an image information acquisition means 1, a state information acquisition means 2, a display information acquisition means 3, and a recording means 4 connected to a recording medium SD. , Is configured.

In this configuration, the image information acquisition means 1 acquires the surrounding image information corresponding to the peripheral image captured from the moving body around the moving body.

On the other hand, the state information acquisition means 2 acquires state information indicating the operating state of the equipment of the moving body.

Then, the display information acquisition means 3 indicates the operating state of the equipment at the imaging time of the surrounding image based on the surrounding image information acquired by the image information acquisition means 1 and the state information acquired by the state information acquisition means 2. Acquires display information for displaying the operating state image together with the surrounding image.

As a result, the recording means 4 records the surrounding image information acquired by the image information acquisition means 1 and the display image information corresponding to the display information acquired by the display information acquisition means 3 on the recording medium SD.

As described above, according to the operation of the information recording device S according to the embodiment, it is based on the surrounding image information corresponding to the surrounding image obtained by capturing the surroundings from the moving body and the state information indicating the operating state of the equipment. Therefore, display information for displaying an operating state image indicating the operating state of the equipment at the time of capturing the surrounding image together with the surrounding image is acquired, and the display information and the display image information corresponding to the surrounding image information are recorded on the recording medium. Record in SD. Therefore, when the situation around the moving body is confirmed after the fact, it is possible to record the display image information that can confirm the situation and the like together with the operating state of the equipment.

Next, specific examples corresponding to the above-described embodiments will be described with reference to FIGS. 2 to 4. The embodiment described below is an example in which the embodiment is applied to recording processing of image data and the like in a drive recorder mounted on a vehicle corresponding to an example of a moving body.

Further, FIG. 2 is a block diagram showing an outline configuration of a drive recorder according to an embodiment, FIG. 3 is a flowchart showing a recording process of display image data in the drive recorder, and FIG. 4 is a recording process by the drive recorder. It is a figure which illustrates the image to be recorded. At this time, in FIG. 2, for each of the constituent members of the embodiment corresponding to each constituent member in the information recording device S according to the embodiment shown in FIG. 1, the same member number as each constituent member in the information recording device S is used. ing.

The drive recorder according to the embodiment is installed in the interior of the vehicle so that the front scenery of the vehicle on which the drive recorder is mounted can be photographed. In the following description, the vehicle in which the drive recorder according to the embodiment is used is simply referred to as "own vehicle". Then, as shown in FIG. 2, the drive recorder DR according to the embodiment includes an operation unit 11 including operation buttons and a touch panel, a display 18 for outputting various information, and a speaker 19 for emitting necessary operation guidance voices and the like. I have. In addition to these, the drive recorder DR according to the embodiment includes a processing unit 9 including a CPU, a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and controlling the entire drive recorder DR to exert its functions. An image data recording unit 10 composed of an SSD (Solid State Drive) or the like, a camera 12 composed of, for example, a CMOS (Complementary Metal-Oxide-Semiconductor) imaging element, a map data recording unit 13 composed of an SSD or the like, and GPS (Global Positioning). Sensor) Sensor 14, acceleration sensor 15, microphone 16, vehicle interface 17, memory SD such as a detachable SD (Secure Digital) card, camera 12, map data recording unit 13, GPS sensor 14 It is composed of an acceleration sensor 15, a microphone 16, and an interface 1 that connects the vehicle interface 17 and the processing unit 9. Further, the processing unit 9 is composed of an image processing unit 3 and a recording unit 4. The image processing unit 3 and the recording unit 4 may be realized by a hardware logic circuit including the CPU or the like constituting the processing unit 9, or a program corresponding to the recording processing of the display image data according to the embodiment described later. May be realized by software by reading and executing the above.

At this time, the interface 1 corresponds to an example of the image information acquisition means 1 and the state information acquisition means 2 according to the embodiment, and the image processing unit 3 corresponds to an example of the display information acquisition means 3 according to the embodiment. .. Further, the recording unit 4 corresponds to an example of the recording means 4 according to the embodiment, and the memory SD corresponds to an example of the recording means SD according to the embodiment. Then, as shown by the broken line in FIG. 2, the interface 1, the image processing unit 3, and the recording unit 4 constitute an example of the information recording device S according to the embodiment. Further, the interface 1 corresponds to an example of the "rule information acquisition means" according to the present application, and the image processing unit 3 corresponds to an example of the "state detection means" and the "determination means" according to the present application, respectively.

In the above configuration, the operation unit 11 is composed of an operation button, a touch panel, or the like as a part of the drive recorder DR, receives an operation by the user, and outputs an operation signal corresponding to the operation to the processing unit 9. Further, under the control of the processing unit 9, the display 18 displays information to be presented to the user as a function of the drive recorder DR by using, for example, an image or an icon. Further, the speaker 19 emits the above-mentioned operation guidance voice and the like necessary for exerting the function of the drive recorder DR under the control of the processing unit 9.

Next, the camera 12 has an imaging range including the surroundings including the front in the moving direction of the own vehicle. Then, the camera 12 generates imaging data corresponding to the surrounding image captured in the imaging range, and outputs the imaging data to the image processing unit 3 of the processing unit 9 via the interface 1. On the other hand, the map data recording unit 13 records as map data, in addition to general road data and intersection data, rule data indicating the contents of traffic rules or traffic regulations at each road or intersection. In the following description, the above traffic rules or the above traffic regulations are simply referred to as "traffic rules, etc." Then, the map data recording unit 13 outputs the rule data or the like to the image processing unit 3 via the interface 1 in response to a request from the image processing unit 3.

On the other hand, the GPS sensor 14 outputs position data indicating the current position of the drive recorder DR to the image processing unit 3 via the interface 1 based on the result of receiving a navigation radio wave from a navigation satellite (not shown). Here, the current position of the drive recorder DR is, in other words, the current position of the own vehicle. Next, the acceleration sensor 15 detects the acceleration applied to the own vehicle in, for example, the traveling direction, the left-right direction, and the vertical direction of the own vehicle, and the acceleration data as the detection result is transmitted to the image processing unit via the interface 1. Output to 3.

On the other hand, the microphone 16 collects the sound or sound of the own vehicle, for example, in the vehicle, and outputs the sound data as the sound collection result to the image processing unit 3 via the interface 1. At this time, the microphone 16 may be capable of collecting the sound or voice outside the own vehicle. Then, the vehicle interface 17 acquires state data indicating the operating state of the equipment (particularly electrical equipment) provided in the own vehicle via an in-vehicle network such as CAN (Controller Area Network), and via the interface 1. Is output to the image processing unit 3. At this time, the electrical components include, for example, the horn, winker, wiper, brake, and the like of the own vehicle. For the winker, state data indicating the operating state of each of the right winker and the left winker is separately acquired. Next, the image data recording unit 10 previously records sign image data for displaying traffic signs corresponding to the traffic rules and the like, state image data indicating the operating state of each of the equipment, and the like. Then, the image data recording unit 10 outputs the marker image data and the state image data in response to a request from the image processing unit 3.

As a result, the image processing unit 3 and the recording unit 4 have the imaging data and the state data acquired via the interface 1, the labeled image data and the state image data recorded in the image data recording unit 10, respectively. Is used to record the display image data according to the embodiment based on the content of the operation in the operation unit 11. At this time, the recording unit 4 records the display image data output from the image processing unit 3 in the memory SD. In this case, the recording unit 4 records the display image data in the memory SD in a general-purpose format. The general-purpose format is, for example, MP4 (Moving Picture 4) format, AVI (Audio video Interleave) format, MOV format, or the like. Further, the image processing unit 3 and the recording unit 4 record the audio data in the memory SD in synchronization with the corresponding display image data in parallel with the recording of the display image data in the memory SD. Then, the display image data, the audio data, and the like recorded in the memory SD are displayed or reproduced by an external playback device (not shown) or the like at the time of post-mortem verification such as an accident.

Next, the recording process of the display image data according to the embodiment, which is executed mainly by the image processing unit 3 in the drive recorder DR according to the embodiment having the above-described configuration, will be described with reference to FIGS. 2 to 4.

The recording process of the display image data according to the embodiment is started, for example, at the timing when the power switch of the drive recorder DR is turned on. Then, as shown in FIG. 3A as a whole, in the display image data recording process according to the embodiment, the image processing unit 3 first acquires the imaging data, the state data, and the like via the interface 1, respectively. Then, based on these, the situation in front of the own vehicle, the current position of the own vehicle, and the like are detected (step S10). Then, the image processing unit 3 performs a process of generating display image data to be recorded in the memory SD based on the state detected in step S10 and the like (step S20). Then, the image processing unit 3 uses the recording unit 4 to record the display image data generated in step S20 in the memory SD in the general-purpose format (step S30). In this case, the recording unit 4 may be configured to record the imaging data, the state data, and the labeled image data as separate layers as display image data, or the state data and the state data and the display image data. The display image data in which the marker image data is embedded in the imaging data may be recorded. After that, the image processing unit 3 determines whether or not to complete the recording process of the display image data according to the embodiment by turning off the power switch of the drive recorder DR or the like (step S40). When the recording process is terminated in the determination in step S40 (step S40: YES), the image processing unit 3 terminates the process as it is. On the other hand, in the determination of step S40, when the recording process is continued (step S40: NO), the image processing unit 3 returns to the step S1 and repeats each of the above-described processes. The image processing unit 3 cyclically (said) the processes of steps S10 to S30 while erasing the display image data and the like before that at preset time (for example, 1 minute to several minutes). It may be configured to execute by clicking).

Next, the details of the state detection process in step S10 will be specifically described with reference to FIG. 3 (b).

As shown in FIG. 3 (b), as the state or the like detection process in step S10, the image processing unit 3 first uses the imaging data corresponding to the imaging result within the imaging range of the camera 12 and the microphone 16. The audio data corresponding to the collected sound collection result is acquired via the interface 1 (step S11). Next, the image processing unit 3 detects whether or not another vehicle exists in front of the own vehicle based on the imaged data acquired in step S11, for example, by a predetermined image analysis method. In the following description, the above-mentioned other vehicle reflected in the imaging data is simply referred to as "another vehicle". In addition to this, the image processing unit 3 detects the lighting state of the headlight (headlight) in the other vehicle and the speed of the other vehicle based on the imaging data (step S12).

Next, the image processing unit 3 sets traffic rules and the like for roads and intersections in which the corresponding road data and intersection data are recorded in the map data recording unit 13 based on the above rule data from the map data recording unit 13. Detect (step S13). At this time, the image processing unit 3 may detect traffic rules and the like for roads and intersections in front of the own vehicle by using the above position data from the GPS sensor 14, and the traffic rules applied at the current time. Etc. may be detected. Further, the image processing unit 3 is based on the state of the other vehicle (for example, its speed, etc.) detected in step S12 and the traffic rule detected in step S13, and the traffic rule of the other vehicle on the road on which it is moving. Detecting whether or not there is a violation (step S14). In step S14, for example, the image processing unit 3 determines that the speed of entering the intersection where the suspension is specified is a significant value greater than zero kilometers per hour, or another vehicle moving on the intersecting road in front of the own vehicle. Detects that the other vehicle is in violation of traffic rules if it is moving faster than the maximum speed on the road.

Next, the image processing unit 3 detects the current position and speed of the own vehicle using the position data, and based on the acceleration data from the acceleration sensor 15, sudden acceleration, sudden deceleration, and sudden steering in the own vehicle. (Step S15). Next, the image processing unit 3 detects the operating state of the electrical component of the own vehicle for each electrical component based on the state data acquired via the vehicle interface 17 (step S16). After that, the image processing unit 3 shifts to step S20 shown in FIG. 3A.

Next, the details of the display image data generation process in step S20 will be specifically described with reference to FIG. 3 (c).

As shown in FIG. 3 (c), as the display image data generation process in step S20, the image processing unit 3 first performs traffic on a road or an intersection reflected in the image pickup range corresponding to the image capture data acquired in step S11. The sign image data for displaying the sign and the state image data indicating the operating state detected in step S16 are acquired from the image data recording unit 10 (step S21). Next, the image processing unit 3 deforms the shape of the sign image data acquired in step S21 on the display based on the state of the road or the like reflected in the captured image data acquired in step S11 (step S22). More specifically, the image processing unit 3 determines the maximum speed of, for example, a road on which the own vehicle is moving (the road is usually reflected so as to extend from the front to the back within the imaging range of the camera 12). The traffic sign to be shown is displayed when viewed from the front of the own vehicle. Also, for example, the highest of a road that intersects a road on which the own vehicle moves at an intersection ahead (usually, the intersection road is reflected so as to extend from the left or right to the center within the imaging range of the camera 12). The traffic sign indicating the speed, the temporary stop sign, etc. are deformed so as to be displayed in a state of being viewed from the own vehicle according to the position of the intersection road and the relationship with the road on which the own vehicle moves.

Next, the image processing unit 3 acquires a symbol image corresponding to the traffic sign or the like after adjusting the display position in the display image for each traffic sign whose shape on the display is deformed in step S22 (step S23). ). More specifically, for example, when another vehicle is reflected in the imaging range, the image processing unit 3 sets the display position of the traffic sign or the like so as to remove the display position in the display image of the other vehicle. Adjust and acquire the symbol image corresponding to the traffic sign or the like. After that, the image processing unit 3 generates display image data including the traffic sign whose display position has been adjusted in step S23 based on the state of the traffic rule detected in step S14, and the generated display image. The data is output to the recording unit 4 (step S24). After that, the image processing unit 3 shifts to the above step S30.

Next, the image recorded in the memory SD as a result of the recording processing of the display image data according to the embodiment described with reference to FIG. 3 will be described with reference to FIG.

First, as shown in FIG. 4A, the display image G corresponding to the case where the own vehicle is moving on the road having the cross intersection in front is superimposed on the front image captured by the camera 12. The lane display L and the lane display R corresponding to the moving road are displayed. Further, when another vehicle C approaching from the right is shown at the intersection in front (see step S12 in FIG. 3B), a vehicle display 23 indicating the existence and position of the other vehicle C is displayed. In addition, for the road on which the own vehicle moves and the road that intersects at the intersection, the traffic sign display 20 and the traffic sign display 21 corresponding to the traffic signs indicating the maximum speed of each, and the traffic rules and the like for the intersecting road are shown. The traffic sign display 22 (in the case of being illustrated in FIG. 4A, the display of the temporary stop sign) is displayed at a position in the display image G corresponding to the position of each road. At this time, the traffic sign display 21 and the traffic sign display 22 corresponding to the intersecting roads are displayed in a manner viewed from the own vehicle (see Step S13, Step S22, and Step S23 in FIG. 3).

In addition to these, a speed display 30 indicating the speed of the own vehicle is displayed. At this time, if the speed is equal to or less than the maximum speed on the road on which the own vehicle moves (see step S13 and step S14 in FIG. 3), the frame 30A and the leader line 30B of the speed display 30 do not violate the traffic rules. It is displayed as the indicated color (for example, green). The speed display 30, the frame 30A, and the image data for displaying the leader line 30B are each recorded in advance in the image data recording unit 10.

On the other hand, when the other vehicle C is within the imaging range, the speed display 31 indicating the speed of the other vehicle C is displayed. At this time, when the speed is faster than the maximum speed on the road on which the other vehicle moves (30 km / h in the example of FIG. 4) (that is, when the other vehicle is overspeeding. FIG. 3 Step S13 and step. (See S14.), The frame 31A of the speed display 31 and the leader line 31B are displayed in colors (for example, red) indicating that the traffic rules are violated. The speed display 31, the frame 31A, and the image data for displaying the leader line 31B are also recorded in advance in the image data recording unit 10.

Next, when the own vehicle moves further from the state illustrated in FIG. 4A and approaches the intersection where the other vehicle C is about to enter from the right, the other vehicle C does not stop temporarily. The display image G in the case of entering the intersection will be described with reference to FIG. 4 (b). That is, in that case, as illustrated in FIG. 4 (b), the lane display L and the lane display R and the traffic sign display 20, the traffic sign display 21, and the traffic sign display 22 shown in FIG. 4 (a) continue to be displayed. It is displayed at a position in the display image G corresponding to the position of each road (see Step S13, Step S22 and Step S23 in FIG. 3). At this time, the traffic sign display 21 (displayed on the right side of the display image G) and the traffic sign display 22 for the road on which the other vehicle C is approaching are not overlapped with the image of the other vehicle C. The display position is adjusted and displayed (see step S23 in FIG. 3).

In addition to these, when it is detected that another vehicle C has neglected to stop and is approaching (see Step S12, Step S13 and Step S14 in FIG. 3), a warning display 32 indicating that fact is displayed for traffic. It is displayed together with a frame 32A and a leader line 32B in a color (for example, red) indicating that the rule is violated. The warning display 32 and the image data for displaying the frame 32A and the leader line 32B are also recorded in advance in the image data recording unit 10. Further, in the case shown in FIG. 4B, when it is detected that the horn of the own vehicle is honked as the other vehicle C enters the intersection (see step S16 of FIG. 3), the horn indicating that fact. The display K is displayed at a position on the lower side in the display image G at the timing when the horn is sounded.

Not limited to the case illustrated in FIG. 4B, when it is detected that the winker of the own vehicle is operating (see step S16 of FIG. 3), the winker display WL and the winker display WR indicating that fact are shown. Is displayed separately on the left and right at, for example, the lower side of the display image G at the timing when the winker is operated. Similarly, when it is detected that the headlight of the own vehicle is lit (see step S16 of FIG. 3), the headlight display LT indicating that fact is displayed while the headlight is lit. It is continuously displayed at a position on the lower side of the display image G, for example.

Further, the horn display K, the winker display WL, the winker display WR, and the headlight display LT do not interfere with the recognition of the situation in front of the own vehicle, and other traffic sign display 20 and the like and warning display. It is displayed at a position in the display screen G that does not overlap with 32 (step S23 in FIG. 3). Further, each image data for displaying the horn display K, the winker display WL, the winker display WR, and the headlight display LT are also recorded in advance in the image data recording unit 10.

As described above, according to the operation according to the embodiment, the surrounding image at the time of capturing the surrounding image is based on the surrounding image obtained by capturing the surroundings including the front of the own vehicle and the operating state of the equipment of the own vehicle. Since the display image data for displaying the horn display K, etc. indicating the operating state of the equipment together with the surrounding image is recorded in the memory SD, the equipment can be used when checking the surrounding conditions of the own vehicle after the fact. Display image data that can confirm the status and the like together with the operating state can be recorded in the memory SD.

In addition, when the display image data is generated by embedding the horn display K or the like in the position in the corresponding surrounding image, the operating state of the equipment and the surrounding situation can be easily associated and displayed in a confirmable manner. The display image data can be recorded in the memory SD.

Further, since the display image data for displaying the traffic sign display 20 or the like indicating the contents of the traffic rules related to the surroundings of the own vehicle or its movement at the corresponding position in the surrounding image is recorded, the operating state of the equipment , Display image data for display in which the surrounding conditions including the contents of related traffic rules can be easily associated and confirmed can be recorded in the memory SD.

Furthermore, when displaying the traffic sign display 20 indicating the contents of the traffic rules related to the road on which the own vehicle moves, the traffic sign display 20 is displayed in a front view from the own vehicle, and is related to the intersecting road. When displaying the traffic sign display 21 and the traffic sign display 22 indicating the contents of the traffic rules to be carried out, the traffic sign display 21 and the traffic sign display 22 are displayed in a manner viewed from the own vehicle (see FIG. 4). Therefore, it is possible to record the display image data in the memory SD for displaying the traffic rules related to the road on which the own vehicle moves and the traffic rules related to the intersecting roads in a state where they can be easily visually recognized.

Further, since the display image data for displaying the vehicle display 23, the warning display 32, etc. indicating the state of the other vehicle C reflected in the surrounding image at the corresponding positions is recorded (see FIG. 4), the operating state of the equipment , The display image data for displaying the surrounding conditions including the state of the other vehicle C in a confirmable manner can be recorded in the memory SD.

Further, it is determined whether or not the state of the other vehicle C violates the traffic rule (see step S14 of FIG. 3), and the speed display 31 (frame 31A and the leader line) indicating the state determined to violate the traffic rule is determined. 31B) and warning display 32 (frame 32A and leader line 32B) can be identified with respect to a display (for example, speed display 30 including frame 30A and leader line 30B) indicating a state determined not to violate traffic rules. Since each is displayed, display image data for easily associating and confirming the operating state of the equipment and the surrounding situation including whether the state of the other vehicle C violates the traffic rules. Can be recorded in the memory SD.

Furthermore, when acquiring a moving image of the surroundings of the own vehicle from the own vehicle as a surrounding image, when confirming the surrounding conditions of the own vehicle after the fact, etc., as a moving image together with the operating state of the equipment. Display image data that can confirm the situation and the like can be recorded in the memory SD.

In addition, since the equipment of the own vehicle whose operating state is detected is the electrical equipment which is at least one of the horn, the light, the winker, and the wiper, when checking the surrounding conditions of the own vehicle after the fact, etc. In, the display image data can be recorded in the memory SD so that the operating state of the electrical component such as the horn and the situation can be confirmed.

Further, since the display image data is recorded in the memory SD using a general-purpose format, the versatility in reproduction or display of the display image data itself can be enhanced.

In addition to the horn display K and the like in the above-described embodiment, the wiper display indicating the operating state of the wiper may be displayed on the display screen G. In this case, display image data useful for post-mortem verification such as an accident that occurred in rainy weather can be recorded in the memory SD. Further, a display indicating the lighting status of the headlights in the other vehicle, which is detected based on the imaging data (see step S12 in FIG. 3), may be displayed on the display screen G. In this case, the lighting state of the headlights of the other vehicle can also be recorded in the memory SD so that it can be used for the above-mentioned post-verification.

The timing for starting recording of the display image data in the memory SD is, for example, from the timing when it is determined that the state of any other vehicle shown in the surrounding image violates the traffic rules (FIG. 3, step 14). (See), the display image data corresponding to the display image G that has been imaged and temporarily recorded in the ROM or the like in the image processing unit 3 may be configured to start recording in the memory SD. .. In this case, by recording the minimum necessary display image data for subsequent confirmation or the like, it is possible to record the necessary display image data while saving the memory SD. Further, as another example of the recording start timing, the ROM in the image processing unit 3 is obtained from the timing when the sudden deceleration, sudden acceleration, or sudden steering of the own vehicle is detected by the acceleration data from the acceleration sensor 15. The display image data corresponding to the display image G recorded in the above may be configured to start recording in the memory SD.

Furthermore, in the above-described embodiment, the marker image data and the like are recorded in the image data recording unit 10 in advance, and the case where these are acquired to generate the display image data has been described. However, in addition to this, each time it is necessary. The traffic sign display 20 and the like may be generated and superimposed on the surrounding image.

Further, in the above-described embodiment, the case where the embodiment is applied to the drive recorder DR mounted on the vehicle has been described, but in addition to this, the embodiment is applied to the drive recorder mounted on the motorcycle or the bicycle. It is also possible to do.

Further, a program corresponding to the flowchart shown in FIG. 3 is recorded on a recording medium such as an optical disk or a hard disk, or acquired via a network such as the Internet, and read out to a general-purpose microcomputer or the like. It is also possible to make the microcomputer or the like function as the image processing unit 3 according to the embodiment.

1 Image information acquisition means (interface)
2 Status information acquisition means 3 Display information acquisition means (image processing unit)
4 Recording means (recording unit)
12 Camera 13 Map data recording unit 14 GPS sensor 15 Accelerometer 16 Microphone 17 Vehicle interface 20, 21, 22 Traffic sign display 23 Vehicle display 30, 31 Speed display 30A, 31A, 32A Frame 31B, 31B, 32B Leader line 32 Warning display S Information recording device G Display image L, R Lane display C Other vehicle K Claction display DR Drive recorder SD Recording medium (recording means)
WL, WR winker display LT headlight display

Claims (1)

An image information acquisition means for acquiring surrounding image information corresponding to a peripheral image captured from the moving body around the moving body, and
A state information acquisition means for acquiring state information indicating the operating state of the equipment of the moving body, and
A display information acquisition means for acquiring display information for displaying an operating state image indicating the operating state at the imaging time of the surrounding image together with the surrounding image based on the surrounding image information and the state information.
A recording means for recording the surrounding image information and the display image information corresponding to the display information on a recording medium.
An information recording device characterized by comprising.

Images