JP2006211415A - On-vehicle video recording apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a user to use video images recorded as an evidence if an accident occurs, and to easily view the video images irrespective of an accident. <P>SOLUTION: An on-vehicle video recording apparatus includes: one or more video information acquisition units each for acquiring video information around a vehicle; a video encoding unit for encoding said video information into video encoded stream information, respectively; a traveling state information acquisition unit for acquiring traveling state information that is information indicating a traveling state of the vehicle; a multiplexed stream generation unit for generating a multiplexed stream by synchronously multiplexing the video encoded stream information and the traveling state information; and a recording unit for recording the multiplexed stream. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an in-vehicle video recording apparatus that records together with a vehicle video a situation related to traveling of the vehicle.

  In recent years, the large number of traffic accidents caused by vehicles such as automobiles has become a social problem. The situation of an accident caused by a vehicle is reproduced by on-site verification, testimony of parties and witnesses, etc., but there are cases where the physical evidence is scarce or the witness testimony is ambiguous and is not always accurate.

Therefore, a recording apparatus for recording various sensor information such as the speed and acceleration of the vehicle and the brake pressure when the accident occurs is becoming widespread for use in investigation of the cause of the accident. Further, in order to objectively indicate the situation at the time of the accident, in-vehicle video recording apparatus that records video captured by the camera in addition to these various sensor information is disclosed in Patent Document 1. Has been. Such an image is useful for preventing the occurrence of a similar accident because it is easy to grasp the situation at the time of the accident.
JP 2002-216284 A

  However, the conventional technology only considers the use of recorded video as evidence for post-processing related to accidents and insurance assessment processing, and video information has not been effectively used.

  More specifically, since an on-vehicle video recording device basically records video while the vehicle is moving, a landscape from the vehicle is photographed regardless of the occurrence of an accident. Therefore, it is possible to use the video recorded during driving after driving. However, the conventional in-vehicle video recording device does not take into account the user's appreciation and enjoyment of the recorded video regardless of the accident, and does not have various configurations for facilitating the appreciation. was there.

  The present invention has been made in order to solve the above-described problems, and the video captured by a camera or the like can be used as evidence at the time of the accident and the user can easily view the video recorded regardless of the accident. An object of the present invention is to provide an in-vehicle video recording apparatus and the like that can improve usability.

  In order to solve the above problems, the present invention provides at least one video information acquisition unit that acquires video information around a vehicle, and a video encoding unit that encodes the video information into video encoded stream information, respectively. A multiplexed stream that generates a multiplexed stream by synchronously multiplexing the running state information acquisition unit that acquires the running state information that is information indicating the running state of the vehicle, the video encoded stream information, and the running state information Provided is an in-vehicle video recording apparatus that includes a generation unit and a recording unit that records the multiplexed stream.

  Also, one or more video information acquisition units that acquire video information around the vehicle, a frame unit combined video information acquisition unit that acquires frame unit combined video information obtained by combining one or more video information in units of frames, An in-vehicle video recording apparatus comprising: a frame-unit combined video encoding unit that encodes frame-unit combined video information into video encoded stream information; a traveling state information acquisition unit; a multiplexed stream generation unit; and a recording unit. provide.

  The traveling state information acquisition unit acquires frame unit traveling state information that is traveling state information at the time when the video information acquisition unit acquires one frame of video information, and the multiplexed stream generation unit includes the video encoding A multiplexed stream may be generated by multiplexing the stream information and the frame unit traveling state information. The recording unit may record the multiplexed stream in units of a predetermined time length. The traveling state information acquisition unit acquires impact state information that is traveling state information indicating the impact of the vehicle. When the recording unit acquires the impact state information, the recording state of the multiplexed stream being recorded is recorded. The predetermined time area may be prohibited from being erased based on the timing at which the impact is detected. A motion change information detection unit that detects motion change information that is information related to a change in motion in the video indicated by the video information, and the recording unit controls recording based on the motion change information; May be.

  The present invention also provides a multiplexed stream acquisition unit that acquires a multiplexed stream recorded by the in-vehicle video recording device, a separation unit that separates the multiplexed stream into each stream, and a separation unit that separates the multiplexed stream. Among the information that has been obtained, the video information reproducing unit that reproduces the video information, the traveling state information display unit that displays the traveling state information among the information separated by the separation unit, the reproduction of the video information, An in-vehicle video recording / reproducing apparatus having a synchronization unit that synchronizes display of traveling state information is provided.

  According to the present invention, since a plurality of videos and vehicle running state information including position information can be multiplexed and recorded on a recording medium, the data can be copied, moved, deleted, etc. Can be handled easily, and usability can be improved.

  Hereinafter, embodiments of each invention will be described. Note that the present invention is not limited to these embodiments, and can be implemented in various modes without departing from the spirit of the present invention.

The relationship between the following embodiments and the claims is as follows.
In the first embodiment, claims 1 and 8 will be mainly described. The second embodiment will mainly describe claims 2 and 9. The third embodiment will mainly describe claim 3 and the like. The fourth embodiment will mainly describe claim 4 and the like. In the fifth embodiment, claim 5 will be mainly described. The sixth embodiment will mainly describe claim 6 and the like. The seventh embodiment will mainly describe claim 7 and the like.

<< Embodiment 1 >>
<Outline of Embodiment 1>
The present embodiment relates to an in-vehicle video recording apparatus that multiplexes and records a video around a vehicle and traveling state information such as vehicle position information and sensor information into a single stream. The concept of the in-vehicle video recording apparatus according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of a utilization concept of the present embodiment. FIG. 1A is an example of utilization of the present invention when a vehicle accident occurs. When the accident occurs, it can be read from the sensor that the vehicle X was braked and stopped. And it can grasp | ascertain instantaneously via the image | video that the vehicle Y has collided with the vehicle X which is stopping. On the other hand, FIG. 1B shows a state in which the position information during traveling and the surrounding video are recorded together. In this way, by multiplexing and recording the video around the vehicle and the information on the running state, the user can make various uses in addition to the verification at the time of the occurrence of the accident.

<Configuration of Embodiment 1>
FIG. 2 shows an example of a functional block diagram of the first embodiment. The “vehicle-mounted video recording device” (0200) of this embodiment shown in FIG. 2 includes one or more “video information acquisition units” (0210, 0211, 0212, 0213), and “video encoding unit” (0220). , “Traveling state information acquisition unit” (0230), “multiplexed stream generation unit” (0240), and “recording unit” (0250).

  One or more “video information acquisition units” (0210, 0211, 0212, 0213) acquire video information around the vehicle. “One or more” indicates that the video information acquisition unit may be configured by only one or may be configured by two or more video information acquisition units. In the on-vehicle video recording apparatus according to the present embodiment, a description will be given assuming that a total of four video information acquisition units are configured on the front, rear, left, and right sides of the vehicle. However, the present invention is not limited to this. “Vehicle” means any moving means on which an in-vehicle video recording device can be mounted, and specifically includes automobiles, motorcycles, bicycles, trains, ships, airplanes, and the like. The drivers of these vehicles are common in that they cannot appreciate the scenery around the vehicle during operation of the vehicle. “Video information” includes, for example, information representing a video signal, information representing a synchronization signal indicating the end of a video signal for one frame, and the like. The video information of the present embodiment can be used for videos of various scenes such as videos of surrounding landscapes in addition to videos at the time of an accident. The “video information around the vehicle” may be video information about the inside of the vehicle such as the driver's seat.

  Specific examples of the “video information acquisition unit” include an imaging device including a photoelectric conversion element such as a lens and a CCD, an autofocus circuit, a shake correction circuit, and the like. Thus, by comprising one or more video information acquisition units, video information around the vehicle can be acquired from various angles.

  The “video encoding unit” (0220) encodes the video information acquired by the video information acquisition unit (0210, 0211, 0212, 0213) into video encoded stream information. Examples of “video coding” include MPEG-2 video, MPEG-4 video and ITU-T recommendation H.264, which are ISO / IEC common standards. Examples include encoding in a format such as an international standard defined by H.264 or WMV (Windows (registered trademark) Media Video). Specific examples of the video encoding method include performing the encoding process through a motion vector detection process, a discrete cosine transform (DCT) process, a quantization process, a variable length encoding process, and the like. “Each” indicates that the video information acquired by one video information acquisition unit is independently encoded. That is, as shown in FIG. 3A, the video encoding unit in the present embodiment may include the same number of video encoding units as possible in a one-to-one relationship with the video information acquisition unit. Or as shown in FIG.3 (b), when comprised from one video encoding part, you may process independently independently. “Video encoded stream information” is information representing a series of bit strings as a result of the video encoding. The video encoded stream information may include, for example, information about which video information acquired from one of the one or more video information acquisition units is encoded. Information about the size (eg, the number of bits) of the stream. These pieces of information may be attached to the head portion of the video encoded stream information as header information.

  Specific examples of the “video encoding unit” include a video capturing unit that captures the video information in units of frames, a frame memory that stores the captured video data in units of frames, and the video encoding method as described above. The encoding means for performing the encoding process on the video information can be used.

  The “traveling state information acquisition unit” (0230) acquires traveling state information that is information indicating the traveling state of the vehicle. Specific examples of information included in the “running state information” include “time information”, “position information”, “impact sensor information”, “sensor information”, and the like. The “time information” is information about a time that becomes a reference when each unit constituting the in-vehicle video recording apparatus (0200) operates, and is created by counting clocks having a predetermined frequency. “Position information” refers to information related to the current position of the vehicle. For example, the position information includes a GPS receiver that receives positioning radio waves transmitted from GPS satellites, and calculates the distance from the plurality of GPS satellites to the vehicle. It is obtained by this. “Impact sensor information” refers to information related to the impact applied to the vehicle. For example, when the impact sensor device detects an impact of a predetermined magnitude or more, the impact sensor device detects an impact. It is obtained. “Sensor information” refers to information related to various sensors such as an acceleration sensor, a brake sensor, a vehicle speed sensor, and a rudder angle sensor. Since the traveling state information is used when a multiplexed stream described below is generated, it is desirable that the traveling state information be in a predetermined stream format. Further, the running state acquisition unit (0230) may have a configuration in which the running state acquisition unit (0230) is synchronized with the video encoding unit (0220) by a synchronous clock device (not shown).

  The “multiplexed stream generation unit” (0240) generates the multiplexed stream by synchronously multiplexing the video encoded stream information and the running state information. “Synchronous multiplexing” refers to performing a process of superimposing items acquired at the same time so that processes such as reproduction can be performed simultaneously at the same time. For example, when reproducing the left and right video information when the vehicle is stopped, processing may be performed so that the stopped video from the left and right cameras is reproduced at the same timing. Details of the synchronous multiplexing will be described later. A “multiplexed stream” is a stream composed of a plurality of streams. When the in-vehicle video recording device (0200) is configured by a plurality of video information acquisition units (0210, 0211, 0212, 0213) as in the present embodiment, it is based on a plurality of video encoded streams. Multiplexed streams will be generated. Examples of the multiplexing method include an international standard method defined by MPEG-2 system and MPEG-4 system, which are ISO / IEC common standards, ASF (Advanced Systems Format), and the like. Note that the multiplexed stream generating unit may generate header information of the multiplexed stream as necessary. The header information may be generated based on size information included in the video encoded stream information, time information included in the running state information, or the like.

  Here, an example of a multiplexed stream generation process will be described with reference to FIGS. 4 and 5, taking as an example a case where an MPEG-2 system is used as a multiplexing method. First, it is assumed that the video encoded stream information encoded by the video encoding unit has a format called PES (Packetized Elementary Stream) with a predetermined header added (hereinafter referred to as video PES). Similarly, it is assumed that the traveling state information is also in the PES format (hereinafter referred to as traveling PES). FIG. 4 shows an example of the video PES. In FIG. 4, 0400 is a video PES, 0401 is a PES header, and 0402 is video encoded stream information obtained by encoding one frame included in the video information. The multiplexed stream generation unit reads the video PES (0400) for each predetermined size, adds a header (TS header), and creates a fixed-length (188 byte) TS packet (0410-0416). The TS packet is an element when a multiplexed stream called a transport stream (TS) is configured. The TS header includes a synchronization byte indicating the start of the TS packet, an ID (PID) for uniquely identifying the TS packet, and the like. With this PID, each multiplexed stream can be distinguished. This process is also executed for other video encoded stream information. At that time, the PID becomes a different identifier.

  Next, each created TS packet is temporarily stored in a buffer or the like. A TS is configured by storing TS packets created from a plurality of PESs in a buffer. An outline of this processing is shown in FIG. In FIG. 5, video PES1 to PES4 indicate video PES encoded as video encoded stream information. When the video PES1 to 4 and the traveling PES are decomposed into TS packets, PIDs n1 to n5 are assigned, respectively. The multiplexed stream generation unit multiplexes these TS packets so as to become one TS. Note that the PID value of each TS packet multiplexed in the TS is described in a format called PMT (PROGRAM Mapped Table), and is multiplexed in the TS in the same manner as the video encoded stream information.

  In this way, by multiplexing the video information and the driving state information, it is possible to consolidate each information on one medium, and it becomes possible to easily handle subsequent copying, moving and deleting of data. , Usability is improved. For example, when a plurality of pieces of video information of the same time are associated with each other, each video can be displayed in one display using a multi-window or the like. The multiplexing process may be performed for each frame or may be performed in units of a plurality of frames.

  The “recording unit” (0250) records the multiplexed stream generated by the multiplexed stream generating unit (0240). The recording unit may include an interface for connecting a recording medium for recording the multiplexed stream. Specific examples of the recording medium include a magnetic disk such as a hard disk drive (HDD), an optical disk such as a DVD, and a nonvolatile memory card. For example, in addition to the first recording medium provided in the vehicle, a detachable second recording medium may be connected to the recording unit. In this case, the first recording medium may be protected by being housed in a strong housing in order to prevent damage due to impact or alteration by the party involved in the accident, so as to be used as evidence when the accident occurs. . On the other hand, the second recording medium may be easily detachable for the user to enjoy video data personally. Further, when there are two recording media as described above, the recording may be performed simultaneously on the first recording medium and the second recording medium, or the second recording medium according to a user operation. May be recorded. Further, the multiplexed stream may be recorded only on the first recording medium during the recording operation, and copied to the second recording medium after recording. Further, when the multiplexed stream is copied from the first recording medium to the second recording medium, the entire multiplexed stream may be copied, or only desired video encoded stream information is extracted from the multiplexed stream. It is possible to copy after re-multiplexing.

  In the in-vehicle video recording apparatus (0200) configured as described above, for example, the main power supply may be turned on in conjunction with the start of the vehicle engine, and the main power supply may be turned off in conjunction with the vehicle engine stop. .

  Each unit that is a component of the present invention is configured by any one of hardware, software, and both hardware and software. For example, as an example for realizing these, when a computer is used, hardware composed of a CPU, a memory, a bus, an interface, a peripheral device, and the like, and software executable on these hardware are listed. be able to. Specifically, the functions of each part are realized by processing, storing, and outputting data on the memory and data input via the interface by sequentially executing the program expanded on the memory (this book) The same applies throughout the specification).

<Processing flow of Embodiment 1>
FIG. 6 shows an example of the processing flow in the first embodiment. The on-vehicle video recording method according to Embodiment 1 first acquires video information around one or more vehicles (S0601). Next, traveling state information is acquired (S0602). The processes in step S0602 and step S0601 may be configured to perform the processes in synchronization with each other. Next, the video information acquired in step S0601 is encoded into video encoded stream information (S0603). Then, the video encoded stream information obtained in steps S0602 and S0603 and the running state information are synchronously multiplexed to generate a multiplexed stream (S0604). Thereafter, the multiplexed stream generated in step S0604 is recorded (S0605). These processes may be performed by, for example, turning on / off the main power supply of the vehicle.

<Effect of Embodiment 1>
The in-vehicle video recording apparatus according to the present embodiment records a multiplexed stream generated by synchronously multiplexing video information around the vehicle and driving state information, and therefore handles data copy, movement, and deletion. Can be easily performed, and convenience is enhanced. Therefore, in addition to a verification application such as accident processing, the user can appropriately use images of a desired time zone, place, direction, etc., and usability is improved.

<< Embodiment 2 >>
<Outline of Embodiment 2>
The second embodiment relates to an in-vehicle video recording apparatus as in the first embodiment, but unlike the first embodiment, videos from a plurality of cameras are combined in units of frames, and the combined screen is encoded. It is a feature. The utilization concept of Embodiment 2 is demonstrated using FIG. FIG. 7 is a diagram illustrating a scene when an accident occurs. It is assumed that the driver of the vehicle X has collided with the vehicle Y from the side when confirming that the signal is green and entering the intersection. At this time, if the images from the cameras installed on the front, back, left and right of the vehicle X are recorded in a single screen, the lighting status of the signal can be confirmed instantly, so the verification at the time of the accident is more It becomes easy.

<Configuration of Embodiment 2>
FIG. 8 shows an example of a functional block diagram in the second embodiment. 8 includes one or more “video information acquisition units” (0801-1, 0801-2, 0801-3,... 0801-n (where n is a positive integer). )), “Frame unit combined video information acquisition unit” (0802), “frame unit combined video encoding unit” (0803), “running state information acquisition unit” (0804), and “multiplexed stream generation unit” ”(0805) and“ Recording section ”(0806). Since the configuration excluding “frame unit combined video information acquisition unit” (0802) and “frame unit combined video encoding unit” (0803) is the same as that described in the first embodiment, Description is omitted.

  The “frame unit combined video information acquisition unit” (0802) acquires frame unit combined video information obtained by combining one or more pieces of the video information in units of frames. The “video information” is video information acquired by the video information acquisition unit. “Combining” refers to combining a plurality of video information frames into one video frame. Further, one piece of video information may be combined in units of frames. As described above, since the end of one frame can be determined by the synchronization signal included in the video information, the video information can be combined in units of frames. The frame unit combined video information acquisition unit may be preset with the number of frames m (m is a positive integer) and video information to be used when a new frame is configured. When the number of video information acquisition units is n, m pieces are selected from the video data of the video information acquisition units (0801-1 to 0801-n) on condition that n> m is satisfied. It may be configured. Further, the number m of frames used when newly configuring one frame may be configured to be appropriately changeable.

  FIG. 9 shows an example of a frame configuration when m = 4. FIG. 9 shows an example in which video information of four viewpoints is selected from n viewpoints, in which video information of four SD resolutions (480i) is configured as video information of one HD resolution (1080i). In this way, by combining a plurality of videos into one frame, it becomes possible to grasp the state around the vehicle clearly.

  The “frame unit combined video encoding unit” (0803) encodes the frame unit combined video information acquired by the frame unit combined video information acquisition unit (0802) into video encoded stream information. It is better to perform the encoding process after combining the video information as in this embodiment, rather than performing the encoding process individually while performing the process of associating each video information so that it can be displayed simultaneously on one screen. There is an advantage that a redundant code amount such as a header can be reduced. Since the process of synchronously multiplexing the subsequent video encoded stream information is the same as that of the first embodiment, the description thereof is omitted here.

  In addition, when each video information included in the frame unit combined video information acquired by the frame unit combined video information acquisition unit (0802) is changed to the video information acquired by another video information acquisition unit, the frame unit combination The video encoding unit (0803) may perform processing such that intra-frame encoding is applied when encoding into video encoded stream information. This is because, when the encoding method of the frame-unit combined video information before the change is an encoding method based on inter-frame prediction, at least the first frame to be encoded needs to be subjected to intra-frame encoding. Because. Therefore, when each video information included in the frame unit combined video information acquired by the frame unit combined video information acquisition unit (0802) is changed, the frame unit combined video encoding unit (0803) Processing may be performed so that the frame is encoded as an I picture. Alternatively, a series of I, P, and B picture sequences is referred to as a GOP, but control may be performed so as to change the video information included in the frame-unit combined video information in accordance with the GOP cycle. Here, an I picture is a frame to which intra-frame coding is applied when MPEG-2 is used as an encoding method, for example, and inter-frame predictive coding is applied to a P picture or B picture. It is a frame.

  In the above description, the case where the in-vehicle video recording apparatus according to the present embodiment has one frame-unit combined video encoding unit (0803) has been described, but a plurality of frame-unit combined video encoding units may be included. Good. For example, as described in the first embodiment, when the recording unit (0806) has a configuration in which the first recording medium and the second recording medium can be recorded, the first recording medium is used. Can be used for accident verification, and the second recording medium can be used for viewing the user's scenery. In this case, the second recording medium does not necessarily require a video that captures a plurality of directions, and thus recording only the video selected by the user saves the recording capacity of the second recording medium. It is possible to extend the recording time and improve usability.

<Processing flow of Embodiment 2>
FIG. 10 shows an example of the processing flow in the second embodiment. Frame unit combined video information obtained by combining one or more pieces of video information acquired in step S1001 in units of frames is acquired (S1003). The video information to be combined in units of frames may be set in advance by the user, or the video information to be combined may be changed during various processes. Then, the frame unit combined video information acquired in step S1003 is encoded into video encoded stream information (S1004). Other processes are the same as those described in the first embodiment, and a description thereof is omitted here.

<Effect of Embodiment 2>
In the present embodiment, one or more pieces of video information are combined in units of frames, and processing is performed using the combined video information, so that verification at the time of an accident becomes easier. In addition, since a plurality of videos are aggregated as one video, convenience is further enhanced when the user appreciates the surrounding scenery.

<< Embodiment 3 >>
<Outline of Embodiment 3>
The in-vehicle video processing apparatus according to the present embodiment is characterized in that it acquires travel state information when the video information is acquired in units of one frame. This facilitates synchronization when the video information and the running state information are multiplexed.

<Configuration of Embodiment 3>
FIG. 11 shows an example of a functional block diagram of the third embodiment. The “vehicle-mounted video recording device” (1100) of this embodiment shown in FIG. 11 includes one or more “video information acquisition units” (1110, 1111, 112, 1113), and “video encoding unit” (1120). , A “running state information acquisition unit” (1130), a “multiplexed stream generation unit” (1140), and a “recording unit” (1150). The traveling state acquisition unit (1130) includes a “frame unit traveling state information acquisition unit” (1131), and the multiplexed stream generation unit (1140) includes a “frame unit multiplexed stream generation unit” (1141). Since the configuration excluding “frame unit travel state information acquisition unit” (1131) and “frame unit multiplexed stream generation unit” (1141) is the same as that described in the first embodiment, Description is omitted. In the second embodiment, a common configuration can be adopted except for “frame unit traveling state information acquisition unit” (1131) and “frame unit multiplexed stream generation unit” (1141).

  The “frame unit travel state information acquisition unit” (1131) obtains frame unit travel state information which is the travel state information when the video information acquisition unit (1110, 1111, 1112, 1113) acquires one frame of video information. get. For example, in the case of the NTSC standard, the “running state information at the time when one frame of video information is acquired” constitutes a still image of about 30 frames per second, and thus the running state information such as position information and sensor information. Means that it is acquired every 1/30 seconds.

  Hereinafter, an example of a method for acquiring the running state information at the time when one frame is acquired will be described. First, when the video information acquisition unit (1110, 1111, 1112, 1113) detects a synchronization signal included in the video information and acquires video information for one frame, the video information acquisition unit (1111) receives the frame unit travel state information acquisition unit (1131). On the other hand, the completion of acquisition of video information for one frame is notified. Next, when receiving the notification, the frame unit travel state information acquisition unit (1131) acquires travel state information including time information, position information, sensor information, and the like. By performing the processing in this way, the video information and the running state information can be acquired in synchronization with each other.

  The “frame unit multiplexed stream generating means” (1141) generates a multiplexed stream by synchronously multiplexing the video encoded stream information and the frame unit running state information. In the present embodiment, since the video information and the running state information are acquired in synchronization, the multiplexing process is facilitated.

<Processing flow of Embodiment 3>
FIG. 12 shows an example of the flow of processing in this embodiment. First, video information around the vehicle is acquired (S1201). Next, the frame unit traveling state information, which is the traveling state information at the time when one frame of video information is acquired in step S1201, is acquired (S1202). Then, a multiplexed stream is generated by synchronously multiplexing the video encoded stream information and the frame unit running state information (S1204). Since other processes are the same as those described in the first or second embodiment, the description thereof is omitted here.

<Effect of Embodiment 3>
In the present embodiment, by notifying completion of acquisition of video information for one frame, it is possible to acquire frame-by-frame driving state information that is driving state information at the time when video information is acquired in units of one frame. Since the multiplexing process is performed using the frame unit traveling state information, it becomes easy to achieve synchronization, and the efficiency when performing the multiplexing process is improved. In addition, since traveling state information such as sensor information can be acquired in units of frames, it is possible to grasp the detailed state of the vehicle when an accident occurs.

<< Embodiment 4 >>
<Outline of Embodiment 4>
The in-vehicle video recording apparatus according to the present embodiment is characterized in that when a multiplexed stream is recorded, recording is performed in units of a predetermined time length. As a result, it is possible to record in a file format every predetermined time, so that it is easy to obtain information during reproduction.

<Configuration of Embodiment 4>
FIG. 13 shows an example of a functional block diagram of the fourth embodiment. The “vehicle-mounted video recording device” (1300) of this embodiment shown in FIG. 13 includes one or more “video information acquisition units” (1310, 1311, 1312, 1313), “video encoding unit” (1320), , “Traveling state information acquisition unit” (1330), “multiplexed stream generation unit” (1340), and “recording unit” (1350). The recording unit (1350) includes “time unit recording means” (1351). “The configuration excluding the time unit recording means (1351) is the same as that described in the first embodiment, and thus the description thereof is omitted. Also in the second embodiment,“ time unit recording means ”is also described. A common configuration can be adopted except for (1351).

  The “time unit recording means” (1351) records the multiplexed stream in units of a predetermined time length. The “predetermined time length” is an arbitrary time length. “In units of a predetermined time length” means that an arbitrary time length (for example, 15 seconds) is used as a recording unit, and a multiplexed stream having the time length forms one file. As described above, the multiplexed stream is recorded in one file with a predetermined time length as a unit, so that it is possible to individually access each file according to the time of each multiplexed stream. Note that, as a criterion for determining the length of the predetermined time length, time information based on the internal clock frequency may be used, or the number of video frames included in the video information may be used.

<Processing Flow of Embodiment 4>
FIG. 14 shows an example of the processing flow in this embodiment. Since the processing up to step S1404 is the same as that described in the first or second embodiment, description thereof is omitted here. In step S1405, the multiplexed stream is recorded in units of a predetermined time length.

<Effect of Embodiment 4>
In this embodiment, since a multiplexed stream is recorded in units of a predetermined time length, it becomes possible to individually access each file according to the time of each multiplexed stream. Therefore, the multiplexed stream can be used for situational evidence in case of an accident and analysis of the cause of the accident, and when the user wants to view the surrounding landscape video, etc. It can be acquired.

<< Embodiment 5 >>
<Concept of Embodiment 5>
The on-vehicle video recording apparatus according to the fifth embodiment is characterized in that when an impact is detected, the video information before and after the impact is prohibited from being erased. When an accident or the like occurs, the importance of video information and running state information before and after that dramatically increases. On the other hand, since recording processing is frequently performed, important video information and the like may be overwritten and erased. The present embodiment assumes such a situation.

<Configuration of Embodiment 5>
FIG. 15 shows an example of a functional block diagram of the fifth embodiment. The “vehicle-mounted video recording device” (1500) of this embodiment shown in FIG. 15 includes one or more “video information acquisition units” (1510, 1511, 1512, 1513), and “video encoding unit” (1520). , “Traveling state information acquisition unit” (1530), “multiplexed stream generation unit” (1540), and “recording unit” (1550). The traveling state information acquisition unit (1530) includes an “impact state information acquisition unit” (1531), and the “recording unit” (1550) includes an “impact detection deletion prohibiting unit” (1551). Since the configuration excluding the “impact state information acquisition unit” (1531) and the “impact detection erasure prohibiting unit” (1551) is the same as that described in the first embodiment, description thereof is omitted here. In the second embodiment, a common configuration can be adopted except for the “impact state information acquisition unit” (1531) and the “impact detection / erasure prohibition unit” (1551).

  The “impact state information acquisition unit” (1531) acquires impact state information which is travel state information indicating the impact of the vehicle. “Vehicle impact” refers to impact received by a vehicle on which the in-vehicle video recording device (1500) is mounted. The “impact” may be, for example, as severe as the vehicle is severely damaged, or as slight as a scratch. This is because there are various modes of accidents. The impact state information acquisition means is composed of, for example, an impact detection sensor. The impact detection sensor may be shared with an airbag sensor or the like.

  The “impact detection erasure prohibiting means” (1551), when acquiring the impact state information, prohibits erasure of a predetermined time region of the multiplexed stream being recorded based on the timing at which the impact is detected. “When the impact state information is acquired” includes, for example, the case where the impact state information is acquired from the traveling state information included in the multiplexed stream recorded by the recording unit (1550). “Recording” means that a recording process is currently being performed or a case where recording has already been performed. The “predetermined time area” is a storage area of a storage medium in which each file is recorded in units of a predetermined time, for example. “Prohibit erasure” means changing a file attribute to erasure prohibited. “Prohibition of erasure based on the timing at which an impact is detected” means that erasure is prohibited in a predetermined time region before and after the impact is detected. In the case of an accident or the like, the information immediately before the impact is detected is more important than the time when the impact is detected. The information on the recording medium may be prohibited from being erased by transmitting it to a server or the like via a wireless line or the like.

<Processing Flow of Embodiment 5>
FIG. 16 shows an example of the flow of processing in the fifth embodiment. Since the processing up to step S1603 is the same as that described in the first or second embodiment, description thereof is omitted here. In step S1604, impact state information that is travel state information indicating the impact of the vehicle is acquired. In step S1604, various traveling state information may be acquired in addition to the impact state information. If it is determined in step S1604 that the impact state information has been acquired, the predetermined time area of the multiplexed stream being recorded is prohibited from being erased based on the timing at which the impact was detected (S1607, S1608). Other processes are the same as those described in the first or second embodiment.

<< Embodiment 6 >>
<Overview of Embodiment 6>
The on-vehicle video recording apparatus according to the sixth embodiment is characterized in that it detects information related to a change in motion in a video and stops recording when there is no change in motion in the video. Also, recording can be resumed when a change in motion occurs. This eliminates the need to record unnecessary video.

<Configuration of Embodiment 6>
FIG. 17 shows an example of a functional block diagram of the sixth embodiment. The “vehicle-mounted video recording device” (1700) of this embodiment shown in FIG. 17 includes one or more “video information acquisition units” (1710, 1711, 1712, 1713) and a “motion change information detection unit” (1720). A "video encoding unit" (1730), a "running state information acquisition unit" (1740), a "multiplexed stream generation unit" (1750), and a "recording unit" (1760). The recording unit (1760) includes “motion change information use recording control means” (1761). Since the configuration excluding the “motion change information detection unit” (1720) and the “motion change information use recording control unit” (1761) is the same as that described in the first embodiment, the description here will be omitted. Omitted. Also in the second embodiment, a common configuration can be adopted except for the “motion change information detection unit” (1720) and the “motion change information use recording control unit” (1761).

  The “motion change information detection unit” (1720) detects motion change information that is information relating to a change in motion in the video indicated by the video information. The “video information” refers to video information acquired by the video information acquisition unit (1710, 1711, 1712, 1713), and is encoded into video encoded stream information by the video encoding unit (1730). It is the video information to be played. “Movement in video” refers to, for example, a change in the position of an object between frames before and after. The motion change information may be information regarding a motion vector in MPEG or the like. Further, the motion change information may be information resulting from a sudden change in motion at the same position in the frame. In other words, “movement” that has not reached the predetermined amount of movement can be regarded as having no “change in movement in video”. Note that the motion change information detection unit (1720) may be integrated with the video encoding unit (1730).

  Hereinafter, a method for detecting motion change information will be described using a motion vector as an example. The motion change information detection unit (1720) reads a plurality of frames before and after the video data after the video data for one frame is taken into the frame memory by the video encoding unit (1730), Motion detection is performed, and a motion vector indicating the direction and magnitude of the motion is calculated. An example of the motion detection method is a block matching method. In this method, an encoding target frame and temporally preceding and following frames are compared in units of blocks of a predetermined size, and the displacement of the position between the nearest blocks is calculated as a motion vector. Based on the motion vector calculated in this way, the motion change information is detected by performing “determination” as to whether or not there is a motion change between frames. The reason for performing the determination is, for example, in the case of traveling at a constant speed, such as when traveling in a tunnel, so that unnecessary images need not be recorded. This is because. Even if there is a minute change in motion, the motion vector itself is generated. Therefore, it is assumed that there is a “motion change” only when a motion exceeding a predetermined threshold is detected.

  Next, an example of a “determination” method for a change in motion will be described. Here, if the motion vector at a certain position of the frame in the time unit t is MV (t) = (mvx, mvy), if the magnitude of the motion vector | MV (t) | If not, there will be motion between frames if non-zero. Then, whether there is a change in the presence or absence of motion between MV (t−1) and MV (t) can be checked depending on whether the magnitude of the motion vector is zero or non-zero. For example, it can be determined that there is no change when zero → zero, and there is a change when zero → non-zero or non-zero → zero. On the other hand, in the case of non-zero → non-zero, the presence / absence of motion cannot be determined only by the magnitude of the motion vector, and therefore the presence / absence of change is determined in consideration of the direction of the motion vector. That is, it can be considered that there is no sudden change in the motion vector in almost the same direction, such as when traveling at a constant speed. Here, the direction of MV (t) can be calculated from the magnitudes of mvx and mvy and the sign of positive and negative. For example, it may be determined which of the eight directions shown in FIG. 18 belongs, and a label with a value of −3 to 4 may be attached. Here, if the direction of the motion vector at a certain position of the frame in the time unit t is D (t), it is almost the same if the absolute value of the difference between D (t) and D (t−1) is 1 or less. Since it is a motion vector in the direction, it is assumed that there is no significant change, and otherwise there is a change. In this way, the presence / absence of change is determined for all blocks. For example, when the number of motion vectors determined to have changed exceeds a predetermined threshold, it is assumed that there is finally a “motion change”. Also good. The target for calculating the difference from D (t) may be not only the direction D (t−1) of the motion vector one frame before in time but also the average value of D (t) in a predetermined period.

  "Motion change information use recording control means" (1761) controls recording based on the motion change information detected by the motion change information detection unit. “Recording control” refers to temporarily stopping the recording operation or restarting the recording operation. For example, when motion change information is detected that has changed around the vehicle, such as when a subsequent vehicle suddenly approaches while the recording operation is paused, the recording operation may be resumed. Good. As a result, when there is no particular change in the situation around the vehicle when the vehicle is stopped or traveling at a constant speed, it is possible not to record images that do not need to be recorded. In addition, recording can be resumed promptly if there is any change.

  Also, when controlling the recording, certain video information may be fixedly recorded regardless of the result of the motion change information, and other video information may be controlled to be recorded according to the motion change information. . Or you may process according to the sensor information contained in driving state information. For example, according to the vehicle speed detected by the vehicle speed sensor, video information recording control that captures a distant view may be performed when the vehicle speed is high, and video information recording control that captures a close view may be performed when the vehicle speed is low. Further, after the video information to be recorded is changed, recording may be performed for a certain time regardless of the result of the motion change information. As a result, it is possible to perform a flexible process such as carefully selecting information on the necessary movement change.

<Processing flow of Embodiment 6>
FIG. 19 shows an example of the processing flow in the sixth embodiment. Since the processing up to step S1903 is the same as that described in the first or second embodiment, description thereof is omitted here. When the video information is encoded in step S1903, motion change information that is information relating to a change in motion in the video indicated by the video information is detected (S1904). Thereafter, the processing up to step S1906 is the same as that described in the first or second embodiment. In step S1907, it is determined whether motion change information is detected. If it is determined in step S1907 that motion change information has been detected, recording control is performed (S1908).

<Effect of Embodiment 6>
In the present embodiment, information relating to a change in motion in the video is detected, recording is stopped when there is no motion change in the video, and recording is resumed when a motion change occurs. Can do. As a result, when there is no particular change in the situation around the vehicle, unnecessary video is not recorded.

<< Embodiment 7 >>
<Outline of Embodiment 7>
In the seventh embodiment, the in-vehicle video recording / reproducing that enables the multiplexed stream recorded by the in-vehicle video recording apparatus described in any of the first to sixth embodiments to be separated into each stream and reproduced. It relates to the device.

<Configuration of Embodiment 7>
FIG. 20 shows an example of a functional block diagram of the seventh embodiment. The “vehicle-mounted video recording / playback apparatus” (2000) shown in FIG. 20 includes a “multiplexed stream acquisition unit” (2001), a “separation unit” (2002), a “video information playback unit” (2003), It has a “running state information display section” (2004) and a “synchronization section” (2005).

  A “multiplexed stream acquisition unit” (2001) acquires a multiplexed stream recorded by the in-vehicle video recording apparatus according to any one of the first to sixth embodiments. Specifically, a process for reading a multiplexed stream from a recording medium or the like is performed. The “separator” (2002) separates the multiplexed stream acquired by the multiplexed stream acquisition unit (2001) into each stream. As described above, the multiplexed streams are separated based on the ID (PID) included in the TS header for uniquely identifying each stream.

  The “video information reproducing unit” (2003) reproduces video information among the information separated by the separating unit (2002). “Playback video information” is to play back video information by decoding separated video encoded stream information. The traveling state information display unit (2004) displays the traveling state information among the information separated by the separating unit (2002). The “synchronizing unit” (2005) synchronizes the reproduction of the video information and the display of the traveling state information. Since the separated traveling state information includes, for example, position information, the position of the vehicle can be specified in synchronization with the display of the video. Thus, for example, by linking with map data, the user can view the video while displaying the route the vehicle has traveled on the map.

<Processing flow of Embodiment 7>
FIG. 21 shows an example of the processing flow in the seventh embodiment. First, a multiplexed stream recorded by the in-vehicle video recording apparatus according to any one of Embodiments 1 to 6 is acquired (S2101). Next, the multiplexed stream acquired in step S2101 is separated into each stream (S2102). After being separated into each stream, the video information is reproduced while synchronizing (S2103), and the running state information is displayed (S2104).

<Effect of Embodiment 7>
In the present embodiment, the multiplexed stream recorded by the in-vehicle video recording apparatus according to any one of the first to sixth embodiments can be separated and reproduced and displayed while being synchronized. Thus, it is possible to enjoy video while displaying the travel route, and usability is improved.

  As mentioned above, although each embodiment of this invention was described, the vehicle-mounted video recording apparatus of this invention is not limited to said embodiment, In the range which does not deviate from the summary of this invention, various changes are carried out. Of course, it can be added.

Conceptual diagram for explaining the first embodiment Functional block diagram for explaining the first embodiment The figure explaining the connection structure of the image | video encoding part of Embodiment 1. FIG. Schematic diagram for explaining how to configure TS packets Schematic diagram for explaining how to multiplex streams The figure explaining the flow of processing of Embodiment 1. Conceptual diagram for explaining the concept of the second embodiment Functional block diagram for explaining the second embodiment The figure for showing the example of combination of 1 frame of picture information The figure explaining the flow of processing of Embodiment 2. Functional block diagram for explaining the third embodiment The figure explaining the flow of processing of Embodiment 3. Functional block diagram for explaining the fourth embodiment The figure explaining the flow of processing of Embodiment 4 Functional block diagram for explaining the fifth embodiment The figure for demonstrating the flow of a process of Embodiment 5. Functional block diagram for explaining the sixth embodiment Illustration to show direction of movement The figure for demonstrating the flow of a process of Embodiment 6. FIG. Functional block diagram for explaining the seventh embodiment The figure for demonstrating the flow of a process of Embodiment 7. FIG.

Explanation of symbols

0200 On-vehicle video recording device 0210 Video information acquisition unit 0220 Video encoding unit 0230 Running state information acquisition unit 0240 Multiplexed stream generation unit 0250 Recording unit

Claims (9)

One or more video information acquisition units for acquiring video information around the vehicle;
A video encoding unit that encodes the video information acquired by the video information acquisition unit into video encoded stream information, and
A traveling state information acquisition unit that acquires traveling state information that is information indicating the traveling state of the vehicle;
A multiplexed stream generating unit that synchronously multiplexes the video encoded stream information and the running state information to generate a multiplexed stream;
A recording unit for recording the multiplexed stream generated by the multiplexed stream generating unit;
An in-vehicle video recording apparatus. One or more video information acquisition units for acquiring video information around the vehicle;
A frame unit combined video information acquisition unit for acquiring frame unit combined video information obtained by combining one or more pieces of the video information in units of frames;
A frame unit combined video encoding unit that encodes the frame unit combined video information acquired by the frame unit combined video information acquisition unit into video encoded stream information;
A traveling state information acquisition unit that acquires traveling state information that is information indicating the traveling state of the vehicle;
A multiplexed stream generating unit that synchronously multiplexes the video encoded stream information and the running state information to generate a multiplexed stream;
A recording unit for recording the multiplexed stream generated by the multiplexed stream generating unit;
An in-vehicle video recording apparatus. The traveling state information acquisition unit
A frame unit running state information obtaining unit for obtaining frame unit running state information which is a running state information at the time when the video information obtaining unit obtains one frame of video information;
The multiplexed stream generator is
The in-vehicle video recording according to claim 1 or 2, further comprising a frame unit multiplexed stream generating means for generating a multiplexed stream by synchronously multiplexing the video encoded stream information and the frame unit running state information. apparatus. The recording unit is
Time unit recording means for recording a multiplexed stream in units of a predetermined time length,
The in-vehicle video recording apparatus according to claim 1, further comprising: The traveling state information acquisition unit
Having impact state information acquisition means for acquiring impact state information which is traveling state information indicating the impact of the vehicle;
The recording unit is
3. The apparatus according to claim 1 or 2, further comprising impact detection / erasure prohibiting means for prohibiting erasure of a predetermined time region of the multiplexed stream being recorded based on a timing at which the impact is detected when the impact state information is acquired. In-vehicle video recording device. A motion change information detection unit that detects motion change information that is information related to a change in motion in the video indicated by the video information;
The recording unit is
Motion change information use recording control means for controlling recording based on the motion change information detected by the motion change information detection unit,
The in-vehicle video recording apparatus according to claim 1, further comprising: A multiplexed stream acquisition unit that acquires a multiplexed stream recorded by the in-vehicle video recording device according to any one of claims 1 to 6,
A separation unit that separates the multiplexed stream acquired by the multiplexed stream acquisition unit into each stream;
Among the information separated by the separation unit, a video information reproduction unit that reproduces video information;
Of the information separated by the separation unit, a traveling state information display unit that displays traveling state information,
A synchronization unit that synchronizes the reproduction of the video information and the display of the running state information;
An in-vehicle video recording / reproducing apparatus having A video information acquisition step for acquiring video information around the vehicle;
A video encoding step of encoding the video information acquired in the video information acquisition step into video encoded stream information;
A driving state information acquisition step of acquiring driving state information which is information indicating the driving state of the vehicle;
A multiplexed stream generating step of generating a multiplexed stream by synchronously multiplexing the video encoded stream information and the running state information;
A writing step of writing the multiplexed stream generated in the multiplexed stream generating step into a recording medium;
An in-vehicle video recording method comprising: One or more video information acquisition steps for acquiring video information around the vehicle;
A frame unit combined video information acquisition step of acquiring frame unit combined video information obtained by combining one or more pieces of the video information in units of frames;
A frame unit combined video encoding step for encoding the frame unit combined video information acquired in the frame unit combined video information acquisition step into video encoded stream information;
A driving state information acquisition step of acquiring driving state information which is information indicating the driving state of the vehicle;
A multiplexed stream generating step of generating a multiplexed stream by synchronously multiplexing the video encoded stream information and the running state information;
A writing step of writing the multiplexed stream generated in the multiplexed stream generating step into a recording medium;
An in-vehicle video recording method comprising:

Images