JP5324722B1 - Video recording / playback device - Google Patents

Abstract

A video recording / reproducing apparatus capable of searching for a target video in a short time even in a continuous recording system is provided.
In the case of continuously recording moving image data captured by a camera 102, recording still image data when an incident is detected, and recording and reproducing the moving image data and a GPS signal in association with each other. By confirming and specifying still image data, target moving image data is automatically extracted via a GPS signal.
[Selection] Figure 1

Description

  The present invention relates to an apparatus for recording and reproducing a video taken by a video camera or the like.

  Drive recorder devices that can check the status of car accidents with images and security camera devices that can check crimes such as house intrusion with images are becoming widespread, and recording starts when an incident (accidental event) is detected In addition, in order not to miss a photo opportunity, a continuous recording type drive recorder device that continues recording recorded video data on a recording medium has also been proposed.

Japanese Patent No. 4749506

  However, the above-described continuous recording type drive recorder apparatus and security camera apparatus have a problem that it takes time to search for a target video after recording. There is a method of confirming the video by the fast-forward function of the playback device, but if the target video is an instantaneous video, there is a high possibility that it will be missed.

  The problem to be solved by the present invention is to provide a video recording / reproducing apparatus capable of searching a target video in a short time even in a continuous recording system.

  The present invention continuously records moving image data captured by a camera, records still image data when an incident is detected, records moving image data and a GPS signal in association with each other, and reproduces still images. By confirming and specifying the image data, the target moving image data is automatically extracted through the recording of the GPS signal.

  According to the video recording / playback apparatus of the present invention, when playing back, a target incident can be confirmed with a still image, and by specifying this, moving image data associated with the still image is extracted. . Therefore, the target video can be searched in a short time even with the continuous recording method.

It is a block diagram which shows the drive recorder to which one embodiment of this invention is applied. It is a block diagram which shows an example of the reproducing | regenerating apparatus of the data recorded with the drive recorder of FIG. 3 is a flowchart showing the operation of the playback device of FIG. It is a block diagram which shows the drive recorder to which other embodiment of this invention is applied. It is a figure for demonstrating the correspondence of moving image data and a GPS signal (NMEA data). It is a figure which shows the display mode of the display at the time of reproduction | regeneration. It is a flowchart which shows operation | movement of the drive recorder of FIG. 5 is a flowchart showing another example of the operation of the drive recorder in FIG. 4. 5 is a flowchart showing another example of the operation of the drive recorder in FIG. 4. 5 is a flowchart showing another example of the operation of the drive recorder in FIG. 4.

  Hereinafter, as an embodiment of a video recording / reproducing apparatus according to the present invention, an embodiment in which moving image data shot by a drive recorder is recorded on a recording medium and the moving image data is reproduced by a computer in which reproducing software is installed is shown. The video recording / reproducing apparatus according to the present invention can be applied to a security camera apparatus and other continuous recording type recording / reproducing apparatuses in addition to a drive recorder.

  As shown in FIG. 1, the drive recorder 1 of this example includes a camera 102 and a microphone 105, A / D converters 103 and 106, an image encoder 104 and an audio encoder 107, a multiplexing circuit 108, a memory drive 109, and an SD card recording. A medium 110, a shock sensor 111, a still image acquisition unit 112, and a GPS 113 are provided, and these components are accommodated in one small casing 101. The drive recorder 1 of this example can be mounted on the back surface of an indoor mirror using, for example, a bracket or an adhesive in order to photograph mainly the situation in front of the vehicle when traveling.

  The camera 102 is composed of a CCD camera or the like, and captures an environmental image around the target vehicle. The analog image signal captured by the camera 102 is converted into a digital image signal by the A / D converter 103, and the digital image signal is encoded by the image encoder 104. The microphone 105 collects environmental sound around the target vehicle. The analog audio signal collected by the microphone 105 is converted into a digital audio signal by the A / D converter 106, and this digital audio signal is encoded by the audio encoder 107. The multiplexing circuit 108 multiplexes the digital video signal having a predetermined frame rate acquired by the CCD camera 102 and the digital audio signal acquired by the microphone 105, and outputs the multiplexed signal to the memory drive 109. Such moving image data can be generated in a format such as MPEG standard or MOV system.

  The power supply terminal 114 of the drive recorder 1 of this example is connected to the vehicle battery VB via an on / off switch SW. The on / off switch SW is turned on / off in conjunction with the on / off of the ignition key VK of the vehicle. Turn off. That is, when the ignition key VK is turned on, the on / off switch SW of the connection circuit 115 is turned on, whereby the power from the battery VB is supplied to the power supply terminal 114 of the drive recorder 1. When the ignition key VK is turned off, the on / off switch SW of the connection circuit 115 is also turned off, and the power supply from the vehicle battery VB to the power supply terminal 114 is cut off. Note that the ON / OFF switch SW of the connection circuit 115 may be turned ON / OFF independently of the ON / OFF of the ignition key VK, so that the drive recorder 1 of the present example can be used as a countermeasure against vandalism while parked. Can function as a security system.

  The memory drive 109 records video / audio data multiplexed on a general-purpose portable recording medium such as the SD card recording medium 110. When recording the latest video / audio data after the recording capacity of the SD card medium 110 is full, the oldest video / audio data is erased in time, and the latest video / audio is constantly recorded. It is controlled by the memory drive 109 to record data. In this case, the recording timing can be set to an arbitrary length. In the drive recorder 1 of this example, it is assumed that files are divided and recorded at predetermined time intervals, for example, every 5 minutes.

  The drive recorder 1 of this example includes a shock sensor 111 for detecting an incident, and outputs a command signal to the still image acquisition unit 112 when a predetermined shock or more, specifically, a predetermined acceleration or more is detected. To do. The shock sensor 111 of this example is a sensor for detecting an incident, and besides a shock sensor according to the purpose, a sound sensor, an optical sensor, a touch sensor, a motion sensor, a temperature sensor, a humidity sensor, a water leak sensor, A concentration sensor, odor sensor, weight sensor, pull sensor, push sensor, or the like can also be used. Moreover, the input button which a user can input may be sufficient.

  The still image acquisition unit 112 acquires a still image when the command signal from the shock sensor 111 is input from the output signal of the A / D converter 103, and outputs, for example, JPEG still image data to the memory drive 109. To the SD card recording medium 110. The format of the still image acquired here is not limited to the JPEG method, but is required to be an image including time data as in the JPEG method. Then, the still image acquisition unit 112 reads the time data at that time from the clock 116 that outputs the time data including the date and time, and writes the time data in the still image data. It is assumed that the time data by the clock 116 coincides with the time data by an atomic clock included in a GPS signal described later. However, the time data included in the GPS signal is read instead of the clock 116 and is read as a still image. You may write to the data. Alternatively, the time data of the clock 116 may be corrected to time data included in the GPS signal at a predetermined interval.

  A GPS (Global Positioning System) 113 includes a GPS receiver, receives a signal from a GPS satellite in synchronization with a predetermined time interval, specifically, a time for dividing a moving image data file, and outputs this to the memory drive 109. To do. The GPS signal is NMEA data including time data from an atomic clock mounted on the satellite and orbit information of the satellite, that is, position data (latitude and longitude). The memory drive 109 records the NMEA data on the SD card recording medium 110, but records the NMEA data in association with the moving image data (video / audio data) captured at the time of recording. This association may be, for example, setting file names other than extensions of moving image data and MNEA data to the same file name. The MOV moving image data generated by the multiplexing circuit 108 described above does not include time data in the data structure, but the NMEA data acquired from the GPS signal includes time data. This NMEA data and moving image data Can be extracted and moving image data at a specific time can be extracted.

  A specific example in which NMEA data of GPS signals and moving image data are recorded in association with each other will be further described. As described above, the moving image data of this example is recorded by dividing the file at a predetermined time interval t1, while the GPS signal is also received at the predetermined time interval t1 synchronized therewith. Since the time interval t1 for dividing the moving image data file and the reception time interval t1 of the GPS signal coincide, for example, as shown in FIG. 5, the file name extension of the moving image data and the file name extension of the NMEA data (GPS signal) are excluded. The same number is attached to the part. Thereby, moving image data and NMEA data can be recorded in association with each other.

  FIG. 2 shows a playback apparatus 2 that plays back the moving image data recorded in the drive recorder 1 of FIG. 1, and may be built in the drive recorder 1, but a personal computer installed with software having the playback function described above is installed in the present invention. It can also be an example playback device. The playback device 2 shown in FIG. 2 includes a memory drive 201, a decoder 202, a still image extraction unit 203, a control unit 204, a display 205, and a keyboard 206.

  The memory drive 201 reads data from the SD card recording medium 110 on which moving image data or the like is recorded by the drive recorder 1 of FIG. 1 according to an instruction input to a keyboard (including an input device such as a mouse) 206, and The data and the NMEA file are output to the decoder 202, and the still image data is output to the still image extraction unit 203.

  The decoder 202 decodes the multiplexed moving image data to generate video data and audio data, and outputs these and NMEA data to the control unit 204. The still image extraction unit 203 outputs the still image data to the control unit 204 for displaying thumbnails. FIG. 6 is a diagram illustrating a display example of the display 205. The display 205 includes a moving image display area 207 for displaying moving images, a still image display area 208 for displaying still images as thumbnails, and various command buttons. A command button area 209 is provided.

  The control unit 204 outputs the input video data and audio data to a display (including a speaker) and displays the video data on the display 205 based on an input command from a keyboard 206 (including an input device such as a mouse). Audio data is output from the speaker while being displayed in the area 207. At the same time, the still image data input from the still image extraction unit 203 is displayed as a thumbnail in the still image display area 208 of the display 205.

  Below, based on still image data, the extraction and reproduction | regeneration procedure of the moving image data corresponding to this is demonstrated. FIG. 3 is a flowchart showing the extraction and reproduction procedure of this example.

  First, as shown in FIG. 6, a still image as a thumbnail is displayed in one window 208 of the display 205, and moving image data is displayed in another window 207. In step ST1, the user views the thumbnail still image displayed in the window 208, selects a desired still image, and inputs it via the keyboard 206. Then, the user proceeds to step ST2, and starts from the selected still image data. Read time data. Since the JPEG image data acquired by the still image acquisition unit 112 and written with the time data from the clock 116 includes the time data at the time of acquisition, the time data is read out. If no thumbnail is specified, the process ends.

  In step ST3, NMEA data including the same time data is searched based on the time data read in step ST2. Since the NMEA data also includes time data of the atomic clock, this data is searched. In step ST4, it is determined whether or not the NMEA data has been hit. If no hit is found, the process ends. If it has hit, the process proceeds to step ST5. If there is no hit, a comment such as “no corresponding video” may be displayed on the display 205.

  In step ST5, moving image data associated with the hit NMEA data is extracted. In step ST6, the cue playback position corresponding to the time of the NMEA data among the moving image data divided at a predetermined time interval is calculated. In step ST7, the moving image data is reproduced from the calculated cueing reproduction position.

  As described above, in the drive recorder 1 of the present example, the shock sensor 111 detects a moment at which the possibility of occurrence of an accident is high as an incident and records it as still image data, and the playback device 2 stores the still image data. If it is confirmed and selected as a thumbnail, moving image data temporally corresponding to the still image data can be cued and reproduced. Therefore, even the continuous recording type drive recorder 1 can confirm the target moving image data in a short time without being overlooked.

  In the above-described embodiment, still image data including time data is generated by the still image acquisition unit 112 and output to the memory drive 109 as it is and recorded on the SD card recording medium 110, but sent from the GPS. When a GPS signal (including time data and position data) is written to a predetermined location in the JPEG format, recorded on the SD card recording medium 110, and the thumbnail image data is specified by the playback device 2, the still image The corresponding NMEA data may be searched based on both the time data and the position data written in the data.

  By doing so, the position data included in the GPS signal is also written in the still image data. When the control unit 204 of the playback device 2 specifies the still image of the thumbnail, the position data is searched in addition to the time data. By searching the NMEA data using the key, the consistency of the data becomes higher. In particular, in the playback device 2 that centrally manages video from a plurality of drive recorders as a single file, if only time data is used as a search key, there may be a plurality of NMEA data at the same time, and the target video data is misidentified. In some cases, the hit rate of the target moving image data becomes higher by using the time data and the position data as search keys. Moreover, if the accuracy of the position data of the GPS signal is good, even if there is a vehicle equipped with a plurality of drive recorders in the same place, the target moving image data can be extracted.

  In the above-described embodiment, the shock sensor 111 is described as the incident detection unit according to the present invention. However, instead of or in addition to this, an incident may be detected by image recognition. FIG. 4 is a block diagram showing a drive recorder to which another embodiment of the present invention is applied. The drive recorder 1 of this example is provided with an image recognition unit 117 instead of the shock sensor 111 of the embodiment shown in FIG.

  The image recognition unit 117 shown in FIG. 4 recognizes various objects shown below from moving image data captured by the camera 102 and converted by the A / D converter 103, and the recognition result is set in advance. A command signal for acquiring still image data is output to the still image acquisition unit 112 when the threshold value is exceeded. When the acquisition command signal is input from the image recognition unit 117, the still image acquisition unit 112 acquires still image data together with the command signal, reads the time data at that time from the clock 116, and the still image data And output to the memory drive 109. Since the processing after the memory drive 109 is the same as that in the above-described embodiment, detailed description thereof is omitted, but still image data in which time data is written is recorded on the SD card medium 110.

An example of an object recognized by the image recognition unit 117 will be described below.
《Recognition of signal ignorance》
In the example of the flowchart shown in FIG. 7, if the drive recorder 1 detects that the traffic light is red, and if it detects that the host vehicle is moving forward at this time, it determines that the signal is ignored and regards this as an incident. To obtain still image data. That is, moving image data photographed by the camera 102 is extracted at a predetermined interval (step ST11), and a traffic light and a lighting color are detected using a known method such as a color filter (step ST12). The detection of the traffic light can be recognized by determining the objects arranged in the horizontal direction in the order of green, yellow and red from the left side as the traffic light. In order to reduce the detection time and the detection load by narrowing the scanning range, the upper half of the imaging area may be set as the detection area from the position and the angle of view in the vehicle interior where the drive recorder 1 is mounted.

  Next, it is determined whether or not the host vehicle is moving by calculating a change in position data included in the received GPS signal (steps ST13 to ST14), and the detected traffic light is red and the host vehicle moves. If it is in the middle, it is determined that the signal is ignored, and a command signal for acquiring still image data is output to the still image acquisition unit 112 (step ST16). As a result, the still image data corresponding to the evidence video data when the vehicle ignores the signal can be acquired, and the head of the video data for which the signal is ignored at the time of reproduction is immediately identified as in the above-described embodiment. Can be played. Even if the detected traffic light is red and the host vehicle is moving, if a differential value (acceleration / deceleration) of the position data change of the received GPS signal is calculated and the vehicle is decelerating, a still image is displayed. The output of the acquisition command signal to the acquisition unit 112 may be stopped (step ST15).

《Recognize speed violation》
In the example of the flowchart shown in FIG. 8, the legal speed is detected by the drive recorder 1, the speed of the own vehicle at this time is calculated from the change in the position data of the GPS signal, and the traveling speed of the own vehicle exceeds the legal speed. In this case, it is determined that the speed is violated, and this is regarded as an incident and still image data is acquired. That is, moving image data photographed by the camera 102 is extracted at predetermined intervals (step ST21), and a legal speed displayed on a road sign or road surface is recognized using a known method (step ST22). The legal speed detection by the road sign can be recognized by the circular display board, the periphery of the display board being red, and the number being displayed at the center. The legal speed displayed on the road surface can be detected by recognizing numbers from the position and angle of view of the interior of the vehicle in which the drive recorder 1 is mounted, with the lower half of the shooting area as the detection area. it can.

  Next, the travel speed of the host vehicle is calculated by calculating a change in the position data included in the received GPS signal (step ST23). If the travel speed of the host vehicle exceeds the legally recognized speed, It is determined that there is a speed violation, and a command signal for acquiring still image data is output to the still image acquisition unit 112 (steps ST24 to ST25). As a result, it is possible to obtain still image data corresponding to the evidence video data when the host vehicle has violated the speed, and immediately identify the top of the video data that has violated the speed during playback, as in the above-described embodiment. Can be played.

《Recognize suspension violation》
The example of the flowchart shown in FIG. 9 is a case where the drive recorder 1 detects a stop sign, calculates the speed of the host vehicle at this time from the change in position data of the GPS signal, and the host vehicle does not stop temporarily. Determines that it is a violation of suspension, regards this as an incident, and acquires still image data. That is, moving image data captured by the camera 102 is extracted at a predetermined interval (step ST31), and a pause by a road sign or a pause by red blinking of a traffic light is recognized using a known method (step ST32). The detection of the temporary stop by the road sign can be recognized by the fact that the display board is an inverted triangle, the whole display board is red, and the characters “stop” are displayed in the center. In addition, the recognition of the temporary stop by the red flashing of the traffic light is to recognize the red and flashing operation of the traffic light using the upper half of the shooting area as a detection area from the position and angle of view of the vehicle interior where the drive recorder 1 is mounted. Can be detected.

  Next, the traveling speed of the host vehicle is calculated by calculating a change in position data included in the received GPS signal (step ST33). If the traveling speed of the host vehicle is 3 km / h or more, it is a violation of temporary stop. It determines that there is, and outputs a command signal for acquiring still image data to the still image acquisition unit 112 (steps ST34 to ST35). As a result, it is possible to obtain still image data corresponding to the evidence video data when the host vehicle has violated the suspension, and immediately, at the beginning of the video data that has violated the speed during playback, as in the above-described embodiment. Can be identified and played.

<Recognition of pedestrian protection violation>
In the example of the flowchart shown in FIG. 10, the pedestrian crossing and a pedestrian crossing the pedestrian crossing are detected by the drive recorder 1, and the speed of the own vehicle at this time is calculated from the change in the position data of the GPS signal. If it is not temporarily stopped for, it is determined that it is a pedestrian protection violation, and this is regarded as an incident and still image data is acquired. That is, moving image data captured by the camera 102 is extracted at predetermined intervals (step ST41), and images of pedestrian crossings and pedestrians walking there are recognized using a known method (step ST42). The detection of the pedestrian crossing can be recognized by the pattern of white and black (road color) displayed on the road surface and the road sign (reverse home base type) of the pedestrian crossing. Moreover, the recognition of a pedestrian can be detected by a human shape.

  Next, the travel speed of the host vehicle is calculated by calculating the change in the position data included in the received GPS signal (step ST43). If the travel speed of the host vehicle is 3 km / h or higher, do not pause. Is determined to be a pedestrian protection violation, and a command signal for acquiring still image data is output to the still image acquisition unit 112 (steps ST44 to ST45). As a result, it is possible to obtain still image data corresponding to the evidence video data when the host vehicle has violated pedestrian protection, and immediately like the above-described embodiment, the head of the video data that has violated the speed is reproduced immediately. It is possible to play with specific.

《Displaying violations on the map》
As described above, when a violation is performed, it is assumed that an incident has occurred, still image data is acquired, time data from the clock 116 is written into the still image data, and then recorded on the SD card medium 110. On the other hand, moving image data and GPS signals (NMEA data) are associated with each other and recorded on the SD card medium 110. The moving image data and still image data recorded on the SD card medium 110 can be reproduced by the reproduction apparatus shown in FIG. 2, but based on the time of the still image data acquired when the traffic violation is performed, NMEA data of time may be extracted, and position data (latitude and longitude) included in the NMEA data may be displayed as a violation place on separately prepared map data.

DESCRIPTION OF SYMBOLS 1 ... Drive recorder 101 ... Case 102 ... CCD camera 103 ... A / D converter 104 ... Image encoder 105 ... Microphone 106 ... A / D converter 107 ... Audio encoder 108 ... Multiplexing circuit 109 ... Memory drive 110 ... SD card Recording medium 111 ... Shock sensor 112 ... Still image acquisition unit 113 ... GPS
114 ... Power supply terminal 115 ... Connection circuit 116 ... Clock 117 ... Image recognition unit VB ... Vehicle battery VK ... Ignition key SW ... On / off switch 2 ... Playback device 201 ... Memory drive 202 ... Decoder 203 ... Still image extraction unit 204 ... Control unit 205 ... Display 206 ... Keyboard 207 ... Movie display area 208 ... Still image display area 209 ... Command button area

Claims (8)

In a video recording / reproducing apparatus for recording video and reproducing the recorded video,
A camera that acquires the video and outputs video data;
Moving image data generating means for generating moving image data from the video data;
Detection means for detecting incidents;
A clock that outputs time data;
When the incident is detected, time data is read from the clock, and still image data generating means for generating still image data including the time data from the video data;
GPS acquisition means for acquiring GPS signals;
Recording the moving image data and the GPS signal in association with each other, and recording means for recording the still image data,
Extraction means for extracting data matching the time data of the still image data recorded in the recording means from the time data included in the GPS signal, and extracting moving image data associated with the extracted GPS signal; A video recording / reproducing apparatus comprising:   The video recording / reproducing apparatus according to claim 1, wherein the extraction unit calculates a cue / reproduce position of moving image data corresponding to time data of still image data. The recording means writes the position data included in the GPS signal to the still image data,
The extraction means includes the time data included in the GPS signal based on the time data of the still image data recorded in the recording means and the position data included in the GPS signal. The video recording / reproducing apparatus according to claim 1, wherein moving picture data extracted from the position data and associated with the extracted GPS signal is extracted. The detection means for detecting the incident includes an image recognition unit that detects red lighting of the traffic light, and a speed detection unit that detects a traveling speed of the host vehicle,
The video recording according to any one of claims 1 to 3, wherein the still image data generating unit generates still image data when the traffic light is lit red and the traveling speed of the host vehicle is in a traveling state. Playback device. The detection means for detecting the incident includes an image recognition unit that detects a legal speed, and a speed detection unit that detects a traveling speed of the host vehicle,
The video recording / reproducing apparatus according to any one of claims 1 to 3, wherein the still image data generating unit generates still image data when a traveling speed of the host vehicle exceeds the legal speed. The detection means for detecting the incident includes an image recognizing unit that detects redness of a road sign or a traffic light that is temporarily stopped, and a speed detecting unit that detects a traveling speed of the host vehicle,
The still image data generating means generates still image data when the suspended road sign is detected or the traffic light is blinking red and the traveling speed of the host vehicle is in a traveling state. The video recording / reproducing apparatus according to claim 1. The detection means for detecting the incident includes an image recognition unit that detects a pedestrian crossing and a pedestrian crossing the pedestrian crossing, and a speed detection unit that detects a traveling speed of the host vehicle,
The said still image data production | generation means produces | generates still image data, when the pedestrian is crossing the said pedestrian crossing and the driving speed of the own vehicle is a driving | running | working state. The video recording / reproducing apparatus as described.   The extraction unit extracts a GPS signal including time data that matches time data included in the still image data, extracts position data included in the GPS signal, and displays the position data on map data. The video recording / reproducing apparatus according to claim 7.

Images