WO2007066696A1

WO2007066696A1 - Information recording device, information recording method, information recording program and computer readable recording medium

Info

Publication number: WO2007066696A1
Application number: PCT/JP2006/324375
Authority: WO
Inventors: Hiroaki Shibasaki
Original assignee: Pioneer Corporation
Priority date: 2005-12-09
Filing date: 2006-12-06
Publication date: 2007-06-14

Abstract

An information recording device (100) records image data picked up by a photographing means arranged in a mobile body. The information recording device is provided with a detecting section (101) for detecting the time the image data is picked up; an acquiring section (102) for acquiring history information relating to the history of movement of the mobile body; a storing section (103) for storing the history information acquired by the acquiring section (102) and the image data by relating them, based on the time the image data picked up time detected by the detecting section (101); and a display control section (105) for controlling the display screen, synthesizing moving route and the image data which are related and stored by the storing section (103) and displaying them.

Description

Specification

Information recording device, information recording method, information recording program, and computer-readable recording medium

Technical field

[0001] The present invention relates to an information recording device for recording information, an information recording method, an information recording program, and a computer-readable recording medium. However, the use of this invention is not limited to the above-mentioned information recording device, information recording method, information recording program, and computer-readable recording medium.

Background technology

[0002] Conventionally, drive recorders have been known that record the surrounding conditions of a moving vehicle, similar to flight recorders mounted on airplanes. Such a drive recorder has, for example, a front camera that photographs the front of the vehicle, a rear camera that photographs the rear of the vehicle, and a function that writes front and rear images into a predetermined area of the image memory in synchronization with a reference signal. , record information in which vehicle position information and time information are added to image memory information is constantly recorded in a buffer memory. It has been proposed that when a shock detection sensor exceeds a predetermined value as a trigger, the video can be saved and used to identify the hit-and-run vehicle or as verification materials in case of a hit-and-run incident. (For example, see Patent Document 1 below.)

[0003] Patent document 1: Japanese Patent Application Publication No. 2004-224105

Disclosure of invention

Problems that the invention seeks to solve

[0004] However, according to the above-mentioned conventional technology, the video of the drive recorder does not include information regarding the movement history, such as the route taken by the vehicle before and after the accident. Therefore, when analyzing the cause of an accident, for example, if information that could lead to clarification of the accident location, such as the name of the intersection, is shown on the drive recorder video, it is not possible to accurately determine the accident location. An example of this problem is: In addition, if the drive recorder footage shows information that could lead to the location of the accident, An example of this is the problem that, even when using this information, it is not always possible for users to pinpoint the location of an accident based on this information.

Means to solve problems

[0005] In order to solve the above-mentioned problems and achieve the purpose, an information recording device according to the invention of claim 1 is an information recording device that records video data captured by a photographing means installed in a moving object. a detection means for detecting an imaging time of the video data; an acquisition means for acquiring history information regarding a history of movement of the moving body; It is characterized by comprising a storage means for associating and storing the history information acquired by the video data and the video data.

[0006] Further, the information recording method according to the invention of claim 5 is an information recording method for recording video data imaged by a photographing means installed in a moving object, and the method includes: an acquisition step of acquiring history information regarding the movement history of the moving object; The method is characterized in that it includes a storage step of storing the recorded history information and the video data in association with each other.

[0007] Furthermore, the information recording program according to the invention of claim 6 is characterized in that it causes a computer to execute the information recording method according to claim 5.

[0008] Furthermore, a computer-readable recording medium according to the invention of claim 7 is characterized in that the information recording program according to claim 6 is recorded thereon.

Brief description of the drawing

[0009] FIG. 1 is a block diagram showing an example of the functional configuration of an information recording device that is useful in this embodiment.

[Fig. 2] Fig. 2 is a flowchart showing the contents of processing of the information recording device according to the present embodiment.

[Fig. 3] Fig. 3 is an explanatory diagram showing an example of the vicinity of the dashboard of a vehicle in which the navigation device according to the first embodiment is installed.

[Figure 4] Figure 4 shows an example of the hardware configuration of the navigation device according to the first embodiment. FIG.

[Fig. 5] Fig. 5 is an explanatory diagram showing an example of a drive recorder image of the vehicle according to the first embodiment before the accident.

[FIG. 6] FIG. 6 is an explanatory diagram showing an example of a drive recorder image at the time of a vehicle accident according to the first embodiment.

[FIG. 7] FIG. 7 is a flowchart showing the contents of processing of the navigation device according to the first embodiment.

[FIG. 8] FIG. 8 is a flowchart showing the contents of processing of the navigation device according to the second embodiment. Explanation of symbols

[0010] 100 Information recording device

101 Detection part

102 Acquisition Department

103 Preservation Department

104 Detection part

105 Display control section

BEST MODE FOR CARRYING OUT THE INVENTION

[0011] Below, preferred embodiments of an information recording device, an information recording method, an information recording program, and a computer-readable recording medium according to the present invention will be described in detail with reference to the accompanying drawings.

[0012] (Embodiment)

(Functional configuration of information recording device)

The functional configuration of the information recording device that is useful in this embodiment will be explained using FIG. 1. FIG. 1 is a block diagram showing an example of the functional configuration of an information recording device that can be used in this embodiment.

[0013] In FIG. 1, an information recording device 100 that records video data captured by a photographing means installed on a moving body includes a detection section 101, an acquisition section 102, a storage section 103, a detection section 104, The display control section 105 is configured to include a display control section 105. [0014] Detection unit 101 detects the imaging time of video data captured by an imaging device installed on a moving body. The imaging time may be detected from time information using a timer provided in the information recording device 100, for example. Further, the detected imaging time may be stored in a storage unit 103, which will be described later, in association with the video data.

[0015] The acquisition unit 102 acquires history information regarding the movement history of the mobile object. The history information may include, for example, information including the moving route traveled by the moving object, and may be configured to display the moving route including the position of the moving object at the imaging time detected by the detection unit 101 on a map.

[0016] Based on the imaging time of the video data detected by the detection unit 101, the storage unit 103 associates and stores the history information acquired by the acquisition unit 102 and the video data. More specifically, for each frame of video data, the imaging time detected by the detection unit 101 and the history information including the moving route of the moving object acquired by the acquisition unit 102 are associated with the frame number. It is also possible to have a configuration in which the data is stored after being stored. Furthermore, when a dangerous behavior of a moving object is detected by a detection unit 104 (described later), the storage unit 103 stores the imaging time and information for each frame of video data for a predetermined period of time including the time of detection. A configuration may also be adopted in which historical information including the moving route of the moving object for a predetermined period of time including the time of detection is stored in correspondence with the frame number.

[0017] Detection unit 104 detects dangerous behavior of a moving object. The dangerous behavior of the moving object may be detected based on the outputs of various sensors mounted on the moving object, such as the movement or operation of the moving object. Various sensors include, for example, vibration sensors, G-sensors, contact sensors for moving objects, and sensors that can output information about operations such as steering wheel operation, direction signal input operation, accelerator pedal operation, and brake pedal operation. .

[0018] Further, the detection unit 104 detects dangerous behavior when, for example, the output value of various sensors such as a vibration sensor or a G sensor exceeds a specified value or approximates a predetermined pattern indicating an abnormality. Or, if a contact sensor is activated, it can be detected as a dangerous behavior. Furthermore, if the operation is dangerous, it may be determined that the operation results in dangerous behavior based on information regarding the operation of the moving body. More specifically, for example, a given corner A configuration that detects the operation of a moving object as an operation that causes dangerous behavior when information such as an operation that performs a sudden steering wheel operation, a steering wheel operation without direction indication, or unnecessary acceleration or deceleration is output. But ヽ.

[0019] The display control unit 105 controls the display screen to combine and display the history information of the moving body, which is stored in association with the storage unit 103, and the video data. More specifically, a configuration may be adopted in which video data captured by a photographing means installed on a moving object and history information including the moving route of the moving object are displayed together. At this time, the imaging time acquired by the detection unit 101 may also be displayed. Furthermore, the history information, video data, and imaging time of the moving object may be combined before being stored by the storage unit 103, and the combined video data may be displayed on the display screen by the display control unit 105. .

[0020] (Contents of processing of information recording device)

Next, with reference to FIG. 2, the contents of the processing of the information recording device 100 according to the present embodiment will be explained. FIG. 2 is a flowchart showing the details of the processing of the information recording device according to the present embodiment. In the flowchart of FIG. 2, first, the information recording device 100 determines whether or not input of video data captured by a photographing means installed on a moving object is accepted by an input unit (not shown) (step S201). ). The input of video data may be performed, for example, by the user operating an operation unit (not shown). Alternatively, a configuration may be adopted in which this is performed when the moving object starts traveling.

[0021] In step S201, the detection unit 101 waits until the input of video data is received, and if it is accepted (step S201: Yes), the detection unit 101 captures the video data captured by the imaging means installed on the moving body. Detect time (step S202). The imaging time may also be detected by time information using a timer provided in the information recording device 100, for example.

[0022] Next, the acquisition unit 102 acquires history information regarding the movement history of the mobile object (step S203). The history information may be, for example, information including the route traveled by the moving object, or may be configured to display the moving route of the moving object on a map using points or trajectories.

[0023] Next, the detection unit 104 detects dangerous behavior of the moving object (step S204). Dangerous behavior of a moving object is, for example, the movement and operation of a moving object, and various It may also be configured to detect based on the output of a sensor or the like. Dangerous behavior is detected, for example, when the output value of various sensors such as a vibration sensor or G sensor exceeds a specified value, or when it approximates a predetermined pattern that indicates an abnormality, or when a contact sensor is activated. It may also be detected as a negative behavior. Furthermore, if the operation is dangerous, it may be determined that the operation results in dangerous behavior based on information regarding the operation of the mobile object.

[0024] Then, in step S204, when the behavior of the moving body is detected by the detection unit 104, the storage unit 103 saves the history information and video data of the moving body acquired by the acquisition unit 102 to the detection unit. It is stored in association with the imaging time detected by 101 (step S20 5), and the series of processes ends. More specifically, for each frame of video data captured by a photographing means installed on a moving object, history information including the time of image capture and the moving route of the moving object is stored in correspondence with the frame number. But that's fine. Furthermore, when dangerous behavior of a moving object is detected by the detection unit 101, the storage unit 103 stores information including the imaging time and the detection time for each frame of video data at a predetermined time including the detection time. The configuration may also be such that historical information including the route of the moving object at a predetermined time is stored in correspondence with the frame number.

[0025] As explained above, according to the present embodiment, when a dangerous behavior of a moving object is detected, the video data captured by the imaging means installed on the moving object is The time and history information including the moving route of the moving object are stored in correspondence with each other. Therefore, when analyzing the situation of an accident, it is possible to accurately grasp information that will lead to elucidation of the cause of the accident, such as the time the image was taken and the moving route of the moving object, from the video data.

Example 1

[0026] Example 1 of the present invention will be described below. In the first embodiment, an example in which the information recording device of the present invention is implemented by a navigation device mounted on a moving body such as a vehicle (including four-wheeled vehicles and two-wheeled vehicles) will be described.

[0027] (Peripheral equipment configuration of navigation device)

First, the configuration of peripheral equipment of the navigation device according to the first embodiment will be explained using FIG. 3. FIG. 3 is an explanatory diagram showing an example of the vicinity of the dashboard of a vehicle in which the navigation device according to the first embodiment is installed. [0028] In FIG. 3, navigation device 300 is installed on the dashboard of the vehicle. The navigation device 300 includes a main body M and a display D, and the display D displays the vehicle's current location, map information, current time, and the like.

[0029] Furthermore, an in-vehicle camera 311 installed on the dashboard and an in-vehicle microphone 312 installed in the sun sensor are connected to the navigation device 300. The in-vehicle camera 311 may have a configuration in which the direction of the lens can be changed and images can be taken inside and outside the vehicle. The in-vehicle microphone 312 is used to operate the navigation device 300 by voice input and to record the situation inside the vehicle. Note that this in-vehicle camera 311 may be, for example, a fixed camera that is fixed to the back of the knock mirror and captures images of the outside of the vehicle.

[0030] Although not shown, the vehicle camera 311 may be attached to the rear of the vehicle. If an in-vehicle camera 311 is installed at the rear of the vehicle, it is possible to check the safety of the rear of the vehicle, and also to record the situation at the time of a rear-end collision when another vehicle is involved in a rear-end collision. In addition, the in-vehicle camera 311 may be an infrared camera that records in a dark place. Further, the vehicle-mounted camera 311 and the vehicle-mounted microphone 312 may be installed in plural numbers in the vehicle, or may be movable cameras instead of fixed ones.

[0031] The navigation device 300 not only searches for a route to a destination and records information, but also has a drive recorder function that records the driving state of the vehicle. The drive recorder function records video and audio obtained from an in-vehicle camera 311 and an in-vehicle microphone 312, as well as information on the vehicle's current location and driving speed obtained from a GPS recorder 415 and various sensors 416, which will be described later. Changes and the like are recorded on a recording medium (a magnetic disk 405 and an optical disk 407, which will be described later) of the navigation device 300.

[0032] By constantly recording driving conditions using such a drive recorder function, it can be used to investigate the facts when one's own vehicle is involved in an accident or an accident occurs around one's own vehicle. Materials can be obtained. The information recorded using the drive recorder function may be accumulated as long as it does not exceed the recording capacity of the recording medium, or may be erased one by one after leaving records for a predetermined period of time. In addition, the recording medium has an overwrite recording area that constantly overwrites driving conditions, and a storage storage area that saves driving conditions in the event of an accident. It is also possible to have a configuration with multiple recording media for overwriting and multiple recording media for storage.

[0033] (Hardware configuration of navigation device 300)

Next, the hardware configuration of the navigation device 300 according to the first embodiment will be described using FIG. 4. FIG. 4 is a block diagram showing an example of the hardware configuration of the navigation device according to the first embodiment.

[0034] In FIG. 4, the navigation device 300 is mounted on a moving body such as a vehicle, and includes a CPU 401, a ROM 402, a RAM 403, a magnetic disk drive 404, a magnetic disk 405, an optical disk drive 406, , optical disk 407, audio IZF (interface) 408, microphone 409, speaker 410, input device 411, video IZF412, display 413, communication IZF414, GPS unit 415, various sensors 416, camera It is equipped with 417 and. Further, each of the constituent parts 401 to 417 is connected to each other by a nozzle 420.

[0035] First, CPU 401 controls the entire navigation device 300. ROM402 records programs such as a boot program, route search program, route guidance program, voice generation program, map information display program, communication program, database creation program, and data analysis program. Additionally, RAM403 is used as a work area for CPU401.

[0036] Here, the route search program searches for the optimal route from the departure point to the destination point using map information recorded on the optical disc 407, which will be described later. Here, the optimal route is the shortest (or fastest) route to the destination, or the route that best matches the conditions specified by the user. The guidance route searched by executing the route search program is output to the audio IZF 408 and video IZF 412 via the CPU 401.

[0037] The route guidance program also uses the guidance route information searched by executing the route search program, the current location information of the navigation device 300 acquired by the communication IZF414, and the map information read from the optical disk 407. Based on this information, real-time route guidance information can be generated. The route guidance information generated by executing the route guidance program is output to the audio IZF 408 and video IZF 412 via the CPU 401. [0038] Furthermore, the voice generation program generates tone and voice information corresponding to the pattern.

. That is, based on the route guidance information generated by executing the route guidance program, it sets a virtual sound source corresponding to the guidance point and generates voice guidance information, and outputs it to the audio IZF 408 via the CPU 401.

[0039] Furthermore, the map information display program causes the video I/F 412 to determine the display format of map information to be displayed on the display 413, and causes the map information to be displayed on the display 413 in the determined display format.

[0040] Furthermore, the CPU 401 captures images for the drive recorder from the camera 417 while the vehicle is running. Then, the CPU 401 detects time information regarding the time when this drive recorder image was taken and frame information regarding the frame number of this drive recorder image. Further, the CPU 401 acquires map information including the moving route of the moving object at the time when the drive recorder image was taken. Then, the CPU 401 combines this map information, time information, and frame information into a drive recorder image in a buffer memory such as ROM 402 or RAM 403 (described later), and overwrites the image on a recording medium for overwriting. Furthermore, when a trigger is detected by various sensors 416, which will be described later, the CPU 401 saves this composite image in a storage recording medium.

[0041] Furthermore, while the vehicle is running, the CPU 401 records the drive recorder image taken by the camera 417 on a recording medium for overwriting. Then, when a trigger is detected by various sensors 416, which will be described later, the CPU 401 saves the image for the drive recorder on a storage storage medium, and acquires time information, frame information, and map information including the moving route of the moving object. do. Then, the CPU 401 may be configured to combine time information, frame information, and map information into a drive recorder image in a buffer memory such as ROM 402 or RAM 403, which will be described later, and store this combined image in a storage recording medium. Furthermore, if a user or the like instructs the CPU 401 to display a drive recorder image, the CPU 401 displays the image on a display 413, which will be described later.

[0042] The magnetic disk drive 404 controls reading and Z writing of data on the magnetic disk 405 under the control of the CPU 401. The magnetic disk 405 records data written under the control of the magnetic disk drive 404. As a magnetic disk 405, even if For example, HD (noded disk) or FD (flexible disk) can be used.

[0043] Further, the optical disc drive 406 controls reading and Z writing of data on the optical disc 407 under the control of the CPU 401. The optical disc 407 is a removable recording medium from which data is read under the control of the optical disc drive 406. The optical disc 407 can also be a writable recording medium. Further, this removable recording medium may be an optical disc 407, a memory card, or the like.

[0044] Examples of information recorded on the magnetic disk 405 and the optical disk 407 include images and sounds inside and outside the vehicle obtained by the in-vehicle camera 311 and in-vehicle microphone 312 shown in FIG. Examples include current location information of the detected vehicle, output values from various sensors 416, which will be described later. This information is recorded by the drive recorder function of the navigation device 300 and is used as verification materials in the event of a traffic accident.

[0045] Another example of information recorded on the magnetic disk 405 and the optical disk 407 is map information used for route searching, route guidance, and the like. The map information includes background data representing features such as buildings, rivers, and the ground surface, and road shape data representing the shape of roads. drawn originally. When the navigation device 300 is providing route guidance, the map information and the current location of the own vehicle obtained by the GPS unit 415, which will be described later, are displayed superimposed.

[0046] The road shape data further includes traffic condition data. Traffic condition data includes, for example, the presence or absence of traffic lights and crosswalks for each node, the presence or absence of expressway entrances and exits, junctions, the length (distance) of each link, road width, direction of travel, and road type (highway Contains information such as roads, toll roads, general roads, etc.

[0047] In addition, the traffic condition data stores past traffic congestion information that is statistically processed based on season, day of the week, long holidays, time, etc. The navigation device 300 obtains information on currently occurring traffic jams from the road traffic information received by communication IZF414, which will be described later, but it also makes it possible to predict the traffic jam situation at a specified time based on past traffic jam information. .

[0048] In the first embodiment, map information is recorded on the magnetic disk 405 and the optical disk 407. However, it is not limited to this. The map information is not limited to being recorded integrally with the hardware of the navigation device 300, but may be provided outside the navigation device 300. In that case, the navigation device 300 acquires map information via the network, for example, through the communication IZF414. The acquired map information is stored in RAM403, etc.

[0049] Furthermore, the audio IZF 408 is connected to a microphone 409 for audio input (for example, the in-vehicle microphone 312 in FIG. 3) and a speaker 410 for audio output. The audio received by microphone 409 is converted to AZD in audio IZF408. Additionally, the speaker 410 outputs audio. Note that the audio input from the microphone 409 can be recorded on the magnetic disk 405 or the optical disk 407 as audio data.

[0050] Examples of the input device 411 include a remote control, a keyboard, a mouse, a touch panel, etc., each having a plurality of keys for inputting characters, numbers, various instructions, and the like.

[0051] Further, the video IZF 412 is connected to a display 413 and a camera 417 (for example, the in-vehicle camera 311 in FIG. 3). Specifically, the video IZF412 includes, for example, a graphics controller that controls the entire display 413, a buffer memory such as VRAM (Video RAM) that temporarily records image information that can be displayed immediately, and output from the graphics controller. It is composed of a control IC that controls the display 413 based on the image data that is displayed. Note that in the first embodiment, the video I/F 412 may be configured to assign a frame number to each frame of the frame image photographed by the camera 417. Furthermore, in the first embodiment, the video IZF 412 controls the display 413 to display an image for a drive recorder, which will be described later, along with time information, a frame number, and map information regarding the moving route of the moving object. Good too.

[0052] The display 413 displays icons, cursors, menus, windows, and various data such as characters and images. This display 413 can be, for example, a CRT, a TFT liquid crystal display, a plasma display, or the like. The display 413 is installed, for example, in a manner similar to display section D in FIG. 3. Further, the vehicle may be equipped with a plurality of displays 413, for example, one for the driver and one for passengers seated in the rear seats. [0053] Camera 417 takes images of the inside or outside of the vehicle. The video can be either a still image or a video. For example, the camera 417 records the behavior of the driver inside the vehicle, and the video is output to a recording medium such as a magnetic disk 405 or an optical disk 407 via the video IZF 412. . Further, the camera 417 photographs the situation outside the vehicle, and the photographed image is output to a recording medium such as a magnetic disk 405 or an optical disk 407 via a video I/F 412. In addition, the video output to the recording medium is overwritten and saved as an image for the drive recorder.

[0054] Furthermore, the communication IZF 414 is connected to the network via wireless, and functions as an interface between the navigation device 300 and the CPU 401. Communication IZF414 is further connected to a communication network such as the Internet via wireless, and also functions as an interface between this communication network and CPU401.

[0055] Communication networks include LAN, WAN, public line networks, and mobile phone networks. Specifically, the communication IZF414 is composed of, for example, an FM tuner, a VICS (Vehicle Information and Communication System) Z beacon resino, a radio navigation device, and other navigation devices, and the VICS center power is also distributed during traffic jams and Obtain road traffic information such as traffic regulations. Please note that VICS is a registered trademark.

[0056] Furthermore, the GPS unit 415 uses received waves from GPS satellites and output values from various sensors 416 (for example, angular velocity sensor, acceleration sensor, tire rotation speed, etc.) to be described later to determine the current state of the vehicle. Calculates information indicating the current location of the location pierce device 300. Information indicating the current location is information that specifies a point on map information, such as latitude, longitude, and altitude. Furthermore, the GPS unit 415 uses the output values from various sensors 416 to output a odometer, a speed change amount, and an azimuth change amount. This makes it possible to analyze the dynamics of sudden braking, sudden steering, etc.

[0057] Here, a method for identifying the current location using GPS unit 415 will be described. First, in GPS, a total of 24 GPS satellites are placed, four in each of six orbital planes around the earth. The orbits of these satellites are adjusted so that the same satellite is located at the same time every day, and can be seen from any point on Earth (as long as it is in a clear line of sight). satellite can be seen. [0058] GPS satellites are equipped with cesium (Cs) atomic clocks (oscillators) that keep accurate time while being synchronized with the time of each satellite. Furthermore, each satellite is equipped with two backup cesium oscillators and two rubidium (Rb) oscillators. This is because accurate time is essential for position measurement using GPS.

[0059] GPS satellites transmit radio waves (hereinafter referred to as GPS signals) at two frequencies: 1575.42MHz (Ll) and 1227.60MHz (L2). This radio wave is modulated with a random number code called a pseudo random noise code, and when received by a GPS unit 415, etc., the signal contents are deciphered by referring to a code corresponding to a random number table. do.

[0060] The GPS unit 415 uses the decoded code and the clock in its own device to measure the time difference between the GPS satellite signal and the time when the GPS signal is emitted and the time when its own device receives the GPS signal. Then, the distance from the GPS satellite to the device is calculated by multiplying the time difference by the radio wave propagation speed (distance = speed x time). Note that this time is synchronized with Coordinated Universal Time (UTC).

[0061] GPS satellites send accurate information on their orbits, so the current location of the GPS satellite can be accurately known. Therefore, if the distance of the GPS satellite force is known, the current location of the device will be any point on the spherical surface with the GPS satellite as the center and the calculated distance as the radius. Note that the code string of the GPS signal is sent repeatedly at intervals of approximately lms. The propagation speed of the GPS signal is 400,000kmZ seconds, so the maximum measurement distance is 400,000 x 0.001 =400km. Therefore, with an accuracy of about 100 km, it is necessary to know the current location of the device in advance.

[0062] In this way, if the distances from three of the GPS satellites are calculated, the current location of the device will be one of the two points where the three spherical surfaces intersect. Furthermore, the predicted point forces for one of the two points are also far apart, so in principle only one point will be determined. However, in reality, the number of candidate points (intersections of three planes) for the current location calculated is not two. This is mainly because the accuracy of the clock mounted on the GPS unit 415 is lower than that of the atomic clock mounted on the GPS satellite, which causes errors in the calculation results.

[0063] Therefore, GPS unit 415 receives GPS signals from a total of four GPS satellites. This can be thought of as being solved by introducing new information (equation) with the clock error on the GPS unit 415 as another unknown. In this way, by receiving GPS signals from four GPS satellites, the GPS unit 415 can determine an almost accurate current location that converges on one point.

[0064] Various sensors 416 include vehicle speed sensors, acceleration sensors, G sensors, angular velocity sensors, etc., and their output values are used for calculation of the current location by the GPS unit 415, measurement of changes in speed and direction, etc. It will be done. The various sensors 416 also include sensors that detect various operations of the vehicle by the driver. The detection of each operation of the vehicle may be configured to detect, for example, steering wheel operation, turn signal input, accelerator pedal depression, brake pedal depression, etc. Additionally, the output values of the various sensors 416 can be used as data to be recorded with a drive recorder function.

[0065] Furthermore, the various sensors 416 may be configured to have a trigger set in advance for saving an image for the drive recorder, and to save the image for the drive recorder when the trigger is detected. . The trigger is, for example, something that triggers the storage of an image for a drive recorder, and may be configured such that the output of various sensors 416 is equal to or higher than a predetermined threshold value or output that approximates a predetermined pattern. More specifically, for example, the trigger in the various sensors 416 may be set when the vibration sensor detects a vibration exceeding a specified value or a predetermined vibration pattern. The predetermined vibration pattern may be any vibration pattern that indicates an abnormality, such as a sudden rise. Further, the trigger may be set, for example, when the G sensor detects a G greater than a specified value or a pattern of applying force of a predetermined G. The predetermined G force may be applied in a pattern that indicates an abnormality, such as a sudden rise. Alternatively, the trigger may be the presence or absence of contact with another object, the activation of an airbag, or the stopping of the vehicle using a contact sensor on the vehicle body. Furthermore, if there is more than one trigger mentioned above, you can combine multiple triggers to create a trigger!/,.

[0066] Of the functional configuration of the information recording device 100 according to the embodiment, the detection unit 101 and the display control unit 105 are connected to the CPU 401, and the acquisition unit 102 is connected to the GPS unit 415 and various sensors 416. The storage unit 103 realizes its functions by a magnetic disk drive 404 and an optical disk drive 406, and the detection unit 104 realizes its functions by various sensors 416. Ru.

[0067] Next, the outline of the drive recorder image according to the first embodiment will be explained using FIGS. 5 and 6. FIG. 5 is an explanatory diagram showing an example of a drive recorder image of the vehicle according to the first embodiment before the accident. In FIG. 5, a drive recorder image 500 before the vehicle accident includes an image 500a taken by the drive recorder function of the navigation device 300 installed in the own vehicle 501, and map information 500b regarding the movement history of the own vehicle 501. It is composed of The image 500a displays the frame number 502 of the image 500a and the time 503 when the image 500a was photographed. In this figure, an image 500a shows, for example, a situation in which the own vehicle 501 approaches an intersection and an oncoming vehicle 504 approaches the own vehicle 501. In addition, information such as the name of the intersection 505, traffic lights 506, crosswalks 507, stop lines 508, signs indicating crosswalks or bicycle crossing zones 509, and buildings near the intersection 510 are displayed. .

[0068] The map information 500b may also be configured to show the travel route 511 traveled by the host vehicle 501 as a point or a trajectory, such as map information that displays the travel route traveled by the host vehicle 501 on a map. good. The building 512 near the intersection and the name 513 of the intersection in the map information 500b correspond to the building 510 near the intersection and the name 505 of the intersection in the image 500a, respectively. In FIG. 5, the map information 500b is the power displayed at the upper right of the drive recorder image 500. This is not limited to the upper right, but may be displayed anywhere as long as it is displayed in association with the image 500a.

[0069] FIG. 6 is an explanatory diagram showing an example of a drive recorder image at the time of a vehicle accident according to the first embodiment. In FIG. 6, an image 600 at the time of a vehicle accident is generated by an image 600a taken by the drive recorder function of the navigation device 300 installed in the own vehicle 501, and map information 600b regarding the movement history of the own vehicle 501. configured. Image 600a shows, for example, a situation where own vehicle 501 collides with oncoming vehicle 504 at an intersection. In such a situation, information such as the name of the intersection 505, the traffic light 506, the crosswalk 507, the building near the intersection 510, etc., can be obtained from the frame pick-up 602 of image 600a and the time 603 when image 600a was taken. This information is used to understand the situation at the time of occurrence. [0070] The map information 600b may be map information that displays the travel route 611 of the host vehicle 501 until it collides with the oncoming vehicle 504. Furthermore, when an accident occurs, the position of the own vehicle 501 in the map information 600b may be displayed with a mark 612 that indicates that an accident has occurred. Furthermore, the map information 600b may be a map centered on the accident location or a map with the traveling direction of the own vehicle 501 facing upward. The scale of the map in the map information 600b may be a scale that assumes the distance traveled by the own vehicle 501 for a predetermined amount of time before and after the accident.

[0071] (Processing details of navigation device 300)

Next, the contents of the processing of the navigation device 300 according to the first embodiment will be explained using FIG. FIG. 7 is a flowchart showing the contents of the processing of the navigation device according to the first embodiment. In the flowchart of FIG. 7, first, the navigation device 300 determines whether or not the vehicle is running (step S701). Judgments regarding the running of the vehicle may be made with reference to the outputs of various sensors 416, for example.

[0072] In step S701, wait until the vehicle is running, and if the vehicle is running (step S701: Yes), the CPU 401 controls the camera 417 to start capturing images for the drive recorder. (Step S702). The drive recorder image may be, for example, an image taken in the front direction of the vehicle from a camera 417 mounted on the vehicle, as shown in FIG. 5 or 6 described above. This image shows, for example, in addition to the own vehicle, oncoming vehicles, intersections, the vicinity of intersections, traffic lights, road signs, etc.

[0073] Then, the CPU 401 overwrites and records the drive recorder image taken in step S702 (step S703). More specifically, the CPU 401 may control the magnetic disk drive 404 to overwrite the drive recorder image onto the overwrite recording medium.

[0074] Next, the CPU 401 determines whether or not the force detected is the trigger (step S704). The detection of the trigger may be performed by, for example, detecting a predetermined trigger using various sensors 416. The trigger may be, for example, a trigger to save an image for a drive recorder based on the output of various sensors 416, or more specifically, the trigger may be a case where a vibration sensor detects vibration exceeding a specified value or a predetermined vibration pattern. The predetermined vibration pattern may be any vibration pattern that indicates an abnormality, such as a vibration with a sudden rise. Also, the trigger is For example, it may be the case that the G-sensor detects a G that exceeds a specified value or a pattern of force applied to a predetermined G. The predetermined way of applying G force may be any pattern that indicates an abnormality, such as a sudden rise in G force. Alternatively, the trigger may be the presence or absence of contact with another vehicle or the activation of an airbag, etc., using a contact sensor in the vehicle body.

[0075] Furthermore, the CPU 401 may be configured to detect a trigger by detecting a driver's driving operation that causes dangerous behavior of the vehicle based on the outputs of various sensors 416. More specifically, the system can trigger unusual steering wheel operations, such as sudden steering that exceeds a predetermined angular velocity, steering wheel operations that exceed a specified angle without turning on a turn signal, and steering wheel operations that are typical when drowsy. You can also use it as In addition, normal accidents such as acceleration/deceleration exceeding a specified acceleration, failure to decelerate at an intersection without a traffic light, failure to decelerate at a red (yellow) light, and special pedal operations when feeling drowsy. It is also possible to use a configuration in which the trigger is a different pedal operation. In addition, in order to detect abnormalities in steering wheel operation or pedal operation, a movement pattern may be registered in advance and compared with the registered movement pattern. In addition, intersections without traffic lights and other points where it is necessary to stop may be obtained based on map information recorded in the ROM402 or the like. The color of the signal may also be configured to determine the strength of the image taken by the camera 417.

[0076] If the trigger is not detected in step S704 (step S704: No), it is determined whether or not the vehicle has finished traveling (step S710). On the other hand, if a trigger is detected in step S704 (step S704: Yes), the CPU 401 saves the image for the drive recorder (step S705). More specifically, the CPU 401 may control the magnetic disk drive 404 to save drive recorder images at the time of detection of the trigger in step S704 and a certain period of time before and after the detection time in a storage recording medium. Alternatively, the configuration may be such that a certain period of time can be set by the user, or the storage time can be extended if the trigger is detected again within a certain period of time from the time of detection.

[0077] Continuing, CPU 401 detects time information regarding the time when the drive recorder image was photographed and frame information regarding the frame number of the drive recorder image at this time (step S706). The time information may be detected from a timer provided in the navigation device 300, for example. Alternatively, the CPU 401 may control and detect the SGPS unit 415. Also, the frame number is, for example, if the video I/F412 is A configuration may also be adopted in which a frame number is assigned to each frame of the frame image taken by the camera 417.

[0078] Next, CPU 401 obtains map information regarding the history of movement of the vehicle based on the time information detected in step S706 (step S707). For example, the map information is obtained by the CPU 401 controlling the GPS unit 415 and various sensors 416 to obtain information regarding the vehicle's position, and as shown in Figures 5 and 6 described above, the map information is obtained by controlling the GPS unit 415 and various sensors 416 to obtain information about the vehicle's position. The configuration may be such that the route is displayed on the map using points or trajectories.

[0079] Then, the CPU 401 combines the time information and frame information detected in step S706 and the map information acquired in step S707 with the drive recorder image saved in step S705 (step S708). More specifically, in a buffer memory such as ROM 402 or RAM 403, CPU 401 combines time information and map information into a frame image corresponding to the frame number at this time. For example, as shown in Figures 5 and 6, the synthesized image displays frame information and time information in the upper left of the drive recorder image, and displays information about the movement history of the moving object in the upper right of the drive recorder image. It may also be configured to display map information.

[0080] Next, the CPU 401 saves the composite image synthesized in step S708 (step S709). More specifically, the configuration may be such that the CPU 401 controls the magnetic disk drive 404 to save the composite image in a storage recording medium.

[0081] The navigation device 300 then determines whether or not the vehicle has stopped running (step S710). Judgments regarding the running of the vehicle may be made with reference to the outputs of various sensors 416, for example. More specifically, it may be determined that the vehicle has finished running when the outputs of the various sensors 416 stop.

[0082] In step S710, if the vehicle has not finished traveling (step S710: No), the process returns to step S703 and repeats overwriting of the drive recorder image. Furthermore, in step S710, if the vehicle has finished traveling (step S710: Yes), the series of processes is immediately ended.

[0083] In the explanation of this figure, an image of the surroundings of the vehicle is taken as an image for the drive recorder in step S703 and is overwritten, but other various sensors 416 are used. It may also be configured to overwrite and record information related to driving conditions such as output. Further, in that case, in step S704, when the trigger is detected, the output at the time of detection and a certain period of time before and after the trigger may be saved. Further, in the explanation of this figure, a configuration may be adopted in which a trigger is detected and an image for a drive recorder is stored, but an attempt stage of a force accident is detected. In that case, it would be a good idea to change the settings of the trigger so that it can detect even attempted accidents.

[0084] As explained above, according to the first embodiment, the drive recorder image is always overwritten and recorded while the vehicle is running. When a trigger is detected, time information, frame information, and map information are combined and saved in the image for the drive recorder. Therefore, when analyzing the situation of a vehicle at the time of an accident, it is necessary to accurately grasp information that will lead to elucidation of the cause of the accident, such as the time of the accident, the location of the accident, and the vehicle's travel route before and after the time of the accident, from the drive recorder images. be able to.

[0085] Furthermore, according to the present Example 1, when a trigger is detected at the time of an attempted accident (near-miss) in addition to the time of encountering an accident, the time information, frame information, and map information are combined for use in a drive recorder. Save the image. Therefore, the stored composite images can be widely used for safe driving.

Example 2

[0086] Next, Example 2 of the present invention will be described. Embodiment 2 is a case in which, in the navigation device 300 described in Embodiment 1, time information, frame information, and map information are combined with a drive recorder image before a trigger is detected, and then overwritten recording is performed. I will explain about it. Note that the peripheral device configuration of the navigation device 300 according to the second embodiment is substantially the same as that in FIG. 3, and therefore a description thereof will be omitted. Further, since the hardware configuration of the navigation device 300 according to the second embodiment is almost the same as that in FIG. 4, a description thereof will be omitted.

[0087] (Contents of processing of navigation device 300)

Here, the contents of the processing of the navigation device 300 according to the second embodiment will be explained using FIG. 8. FIG. 8 is a flowchart showing the contents of the processing of the navigation device according to the second embodiment. In the flowchart of Figure 8, first, navigation device 3 00 determines whether the force is such that the vehicle is running (step S801). Judgments regarding the running of the vehicle may be made with reference to the outputs of various sensors 416, for example.

[0088] Here, wait until the vehicle is running, and if it is running (step S801: Yes), is it the same? 11401 controls camera 417 and starts capturing images for the drive recorder (step S802). The drive recorder image may be, for example, an image taken in the front direction of the vehicle from a camera 417 mounted on the vehicle, as shown in FIG. 5 or 6 described above. For example, in addition to the own vehicle, this image shows oncoming vehicles, intersections, the surrounding area, traffic lights, road signs, etc.

[0089] Next, the CPU 401 detects time information regarding the time when the drive recorder image was photographed and frame information regarding the frame number of the drive recorder image at this time (step S803). The time information may be detected from a timer provided in the navigation device 300, for example. Alternatively, the CPU 401 may control and detect the GPS unit 415. Further, the frame number may be configured such that, for example, the video IZF 412 assigns a frame number to each frame of a frame image taken from the power camera 417.

[0090] Subsequently, CPU 401 obtains map information regarding the history of movement of the vehicle based on the time information detected in step S803 (step S804). For example, the map information is obtained by the CPU 401 controlling the GPS unit 415 and various sensors 416 to obtain information regarding the vehicle's position, and as shown in Figures 5 and 6 described above, the map information is obtained by controlling the GPS unit 415 and various sensors 416 to obtain information about the vehicle's location. It may also be configured to display on a map using points or trajectories.

[0091] Then, the CPU 401 combines the time information and frame information detected in step S803 and the map information acquired in step S804 with the image for the drive recorder in step S802 (step S805). More specifically, in a buffer memory such as ROM 402 or RAM 403, CPU 401 combines time information and map information into a frame image corresponding to the frame number at this time. For example, as shown in Figures 5 and 6, the composite image has a configuration in which frame information and time information are displayed in the upper left of the drive recorder image, and map information regarding the movement history of the moving object is displayed in the upper right of the drive recorder image. But ヽ. [0092] Subsequently, the CPU 401 overwrites and records the composite image synthesized in step S806 (step S806). More specifically, the CPU 401 controls the magnetic disk drive 404 to overwrite and record the composite image on a recording medium for overwrite recording.

[0093] Next, the CPU 401 determines whether or not the force detected is the trigger (step S807). The detection of the trigger may be performed by, for example, detecting a predetermined trigger using various sensors 416. The trigger may be, for example, a trigger to save an image for a drive recorder based on the output of various sensors 416, or more specifically, the trigger may be a case where a vibration sensor detects vibration exceeding a specified value or a predetermined vibration pattern. The predetermined vibration pattern may be any vibration pattern that indicates an abnormality, such as a vibration with a sudden rise. Further, the trigger may be, for example, when a G sensor detects a G that exceeds a specified value or a pattern of applying force of a predetermined G. The predetermined way of applying G force may be any pattern that indicates an abnormality, such as a sudden rise in G force. Alternatively, the trigger may be the presence or absence of contact with another vehicle or the activation of an airbag, etc., using a contact sensor in the vehicle body.

[0094] Furthermore, the CPU 401 may be configured to detect a trigger by detecting a driver's driving operation that causes dangerous behavior of the vehicle based on the outputs of various sensors 416. More specifically, the system can trigger unusual steering wheel operations, such as sudden steering that exceeds a predetermined angular velocity, steering wheel operations that exceed a specified angle without turning on a turn signal, and steering wheel operations that are typical when drowsy. You can also use it as In addition, normal accidents such as acceleration/deceleration exceeding a specified acceleration, failure to decelerate at an intersection without a traffic light, failure to decelerate at a red (yellow) light, and special pedal operations when feeling drowsy. It is also possible to use a configuration in which the trigger is a different pedal operation. In addition, in order to detect abnormalities in steering wheel operation or pedal operation, a movement pattern may be registered in advance and compared with the registered movement pattern. In addition, intersections without traffic lights and other points where it is necessary to stop may be obtained based on map information recorded in the ROM402 or the like. The color of the signal may also be configured to determine the quality of the image taken by the camera 417.

[0095] If the trigger is not detected in step S807 (step S807: No), the CPU 401 determines whether or not the vehicle has finished traveling (step S809). On the other hand, if a trigger is detected in step S807 (step S807: Yes), the composite image synthesized in step S805 is saved (step S808). More specifically, CPU401 Power S The configuration may be such that the magnetic disk drive 404 is controlled to save a composite image at the detection point in time when the trigger is detected in step S807 and a certain period of time before and after that point in a storage storage medium. Alternatively, the configuration may be such that a certain period of time can be set by the user, or the storage time can be extended if the trigger is detected again within a certain period of time from the time of detection.

[0096] The navigation device 300 then determines whether or not the vehicle has stopped running (step S809). The determination regarding the running of the vehicle may be made with reference to the outputs of various sensors 416, for example. More specifically, it may be determined that the vehicle has finished running when the outputs of the various sensors 416 stop.

[0097] In step S809, if the vehicle has not finished traveling (step S809: No), the process returns to step S806 and the overwriting recording of the drive recorder image is repeated. Furthermore, in step S809, if the vehicle has finished traveling (step S809: Yes), the series of processes is immediately ended.

[0098] As explained above, according to the second embodiment, time information, frame information, and map information are added to the drive recorder image taken while the vehicle is running before the trigger is detected. Combine and overwrite. This composite image is then saved when a trigger is detected. Therefore, when analyzing the situation of a vehicle at the time of an accident, it is necessary to use the image power of a drive recorder to accurately grasp information that will lead to the elucidation of the cause of the accident, such as the time of the accident, the location of the accident, and the vehicle's travel route before and after the time of the accident. be able to.

[0099] Furthermore, according to the second embodiment, before detecting a trigger at the time of an accident encounter and the time of an attempted accident (near miss), time information, frame information, and map information are transferred to a drive recorder image. Synthesize into Then, if a trigger is detected at the time of an attempted accident, a composite image is saved. Therefore, the saved composite images can be widely used for safe driving.

[0100] Furthermore, the present invention only needs to have at least one or more of the functions of the first embodiment or the second embodiment. For example, if the functions of Embodiment 1 and Embodiment 2 are provided, the time at which the video was captured for the drive recorder image at and before and after the trigger was detected. and map information regarding the vehicle's history at this time can be displayed simultaneously. Therefore, the situation at the time of the accident and before and after it can be accurately grasped. can be grasped.

[0101] As explained above, according to the present invention, for a drive recorder image taken while the vehicle is running, the time when this image was taken, the frame number of this image, and the history of the vehicle are recorded. and the map information showing the information are combined and saved. Therefore, when analyzing the situation of a vehicle at the time of an accident, it is necessary to use the image power of the drive recorder to accurately grasp information that will lead to the elucidation of the cause of the accident, such as the time of the accident, the location of the accident, and the vehicle's travel route before and after the time of the accident. can do.

[0102] Note that the information recording method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, flexible disk, CD-ROM, MO, DVD, etc., and is executed by reading the recording medium by the computer. Further, this program may be a transmission medium that can be distributed via a network such as the Internet.

Claims

The scope of the claims

[1] An information recording device that records video data captured by a camera installed on a moving object.

detection means for detecting an imaging time of the video data;

an acquisition unit that acquires history information regarding a history of movement of the moving body; and an acquisition unit that associates the history information acquired by the acquisition unit with the video data based on the imaging time of the video data detected by the detection unit. a storage means for storing it,

An information recording device comprising:

[2] comprising a detection means for detecting dangerous behavior of the moving object,

The storage means is

The information recording device according to claim 1, further comprising storing the history information and the video data in association with each other based on a detection result detected by the detection means.

[3] The acquisition means includes:

At least a travel route traveled by the mobile object is acquired,

The storage means is

Claim characterized in that the travel route and the video data are stored in association with each other.

The information recording device described in 1.

[4] Claims 1 to 4, characterized by comprising display control means for controlling a display screen to synthesize and display the moving route and the video data, which are stored in association with each other by the storage means. The information recording device described in any one of 3.

[5] In an information recording method for recording video data captured by a photographing means installed on a moving object,

a detection step of detecting an imaging time of the video data;

an acquisition step of acquiring history information related to the movement history of the mobile body; and associating the history information acquired in the acquisition step with the video data based on the imaging time of the video data detected in the detection step. The security to save existing process,

An information recording method characterized by comprising:

[6] An information recording program that causes a computer to execute the information recording method according to claim 5.

[7] A computer-readable recording medium, on which the information recording program according to claim 6 is recorded.