JP2013130924A - Travel video display program and travel video display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a display mode enabling an easy and objective grasp of a specific travel condition from video data representing the travel mode of a preceding vehicle.SOLUTION: A travel video display program causes a computer to function as: video replay display means for forming a video replay display zone used for displaying a replay video on the basis of video data, and controlling a display state of the replay video in response to a video replay operation; positional reference setup means for setting a positional reference that determines a display position on a display video and a display interval thereon that have reflected the position of a point and the distance between plural points on the travel road displayed on a replay video in response to a reference-specifying operation that specifies, directly or indirectly, at least the display position and display interval on the replay video; and positional indicator display means for displaying a positional indicator at the display position on the replay video that has reflected the position of the point and the distance between the plural points on the basis of the positional reference.

Description

  The present invention relates to a traveling image display program and a traveling image display system, and more particularly to an image display technique suitable for analyzing image data indicating a traveling or traveling mode of a traveling vehicle such as an automobile or a train.

  At present, efforts to eliminate traffic accidents are being carried out from various viewpoints by the government, transportation-related operators, individual drivers, etc. As one of such efforts, safety driving education and safety driving awareness activities for drivers, etc. Is mentioned. In these education and activities, safe driving diagnosis and measurement and determination by a simulator are performed. In addition, a driving skill determination system that determines safety and efficiency according to a driving mode has been proposed (see Patent Document 1 below).

  On the other hand, by installing a drive recorder in the vehicle and recording video and sound, it is possible to detect the impact and leave a record in the event of an accident so that the situation of the accident can be ascertained after the accident The cause is analyzed (see Patent Document 2 below). Further, it is determined whether or not the specific behavior has occurred from the traveling data of the traveling body according to a predetermined condition, and information relating to the specific behavior of the traveling body is recorded on a recording medium according to the fact that the specific behavior has occurred, and based on this information A method of analyzing the operating tendency of the traveling body has also been proposed (see Patent Document 3 below).

JP 2008-298999 A Japanese Patent Laid-Open No. 10-63905 JP 2000-290354 A

  However, in the method of analyzing the recording by the above conventional drive recorder, although the actual driving situation can be grasped concretely by video or recording, only the recording is retained when an impact or sound is detected. Although it is possible to investigate the cause of the accident and take countermeasures, the daily driving operation of the driver cannot be recorded. In addition, since a large number of various driving modes cannot be collected, there is a problem that the amount of information necessary for safe driving education cannot be secured. Furthermore, since it aims at the record at the time of an accident, there also exists a problem that it cannot be used for operation management of vehicles, such as transportation industry.

  For this reason, it is conceivable to record video images during driving on a daily basis with the above-described conventional drive recorder, and to clarify the problems of the driving operation of the driver based on the video recording. However, the impression received from the above video recording varies greatly depending on the vehicle type, camera position, day and night, weather, etc., and it is difficult to grasp the objective driving mode. In addition, when determining whether or not there is a problem in the driving mode, it is not possible to accurately grasp the problem unless an objective index (for example, a numerical value) is provided.

  Therefore, the present invention solves the above-mentioned problems, and the problem is that a running video display program that can easily and objectively grasp a specific running situation from video data indicating a running mode of a running vehicle, and The object is to provide a traveling image display system.

  In view of such a situation, the present invention uses a computer to reproduce a reproduction image corresponding to image data including at least a part of an image of a traveling road outside the traveling vehicle derived from acquired information acquired in the traveling vehicle. A program for displaying, wherein the computer forms a video playback display area for displaying the playback video based on the video data, and controls the display state of the playback video according to a video playback operation Means for reflecting the position of the point on the travel path and the distance between the plurality of points reflected in the reproduced video according to at least a reference instruction operation that directly or indirectly indicates the display position and display interval on the reproduced video Position reference setting means for setting a position reference for determining a display position and a display interval on the reproduced video, and a position reference based on the position reference. A traveling image display program for operating the position indicator display means for displaying the position index on the display position on the reproduction image distance reflecting between the positions and the plurality of points of the point as. Here, the traveling road refers to a road or a track on which the traveling vehicle travels. Moreover, the said point means the location (part) of the driving | running | working path projected in the image | video outside a traveling vehicle at least among the said reproduction | regeneration images.

  According to the present invention, the playback video corresponding to the video data is displayed in the video playback display area by the video playback display means, and the display state can be controlled according to the video playback operation. In addition, if there is a reference instruction operation that directly or indirectly indicates at least the display position and the display interval on the playback image, the position of the point on the travel path and the distance between the plurality of points reflected in the playback image are accordingly determined. A position reference that determines the display position and display interval on the reflected reproduced video is set. Then, the position index display means displays the position index at the display position on the reproduced video reflecting the position of the point and the distance between the plurality of points based on the position reference. In this way, the position reference for the playback video is set by the reference instruction operation that directly or indirectly indicates the display position and display interval on the playback video, and the position index is set at the display position on the playback video based on this position reference. Because it is displayed, it is easy to set the position reference even for various playback images with different shooting conditions regardless of the type of traveling vehicle, camera installation status, etc., and display the position index accordingly Can do. Therefore, it is possible to quickly and surely know the positional relationship on the travel path displayed in the reproduced video without being confused by the difference in the shooting conditions, the difference in daytime and nighttime, weather, and the like. As a result, it is possible to easily and objectively grasp the specific driving situation from the reproduced video corresponding to the video data including at least a part of the external video indicating the driving mode of the traveling vehicle. In addition, by using the position index, it is possible to make an objective determination on a specific driving mode without depending on the subjectivity and feeling of the individual judge.

  As the above position index, various indices useful for grasping the display position and display interval on the reproduced video as a result are widely included. Typically, a display position that is present and recognizable regardless of the video content such as the lower edge, upper edge, side edge, etc. of the playback video, or an origin index provided separately from this (such as a video baseline described later) ) With reference to the origin position indicated by the display position, or an index indicating a display position having a certain interval from the origin position, or a plurality of them arranged at equal intervals in the reproduced video with reference to the origin position. Indicators. The display form of the indicator may be any form as long as it can be grasped visually as a result, but typically, various types of lines (lines), points, symbols, figures, different colors and patterns The boundary of etc. is mentioned.

  In the present invention, the position reference is a display of a direction on the reproduced image corresponding to the traveling direction, which reflects the position of the point in the traveling direction of the traveling vehicle and the distance between the plurality of points in the traveling direction. Preferably, the position index is displayed at a specific display position in a direction on the reproduction image corresponding to the traveling direction. In this way, the position of the travel direction point on the travel path and the distance between the travel direction points shown in the playback image can be quickly and reliably known by the position index. It is possible to easily and objectively grasp the direction stop position and the distance (inter-vehicle distance) between other traveling vehicles when the traveling vehicle is traveling.

  However, in the present invention, the position reference defines the display position and the display interval of the direction on the playback image corresponding to the traveling direction, which reflects the position of the point in the traveling direction and the distance between the plurality of points. The position index is not limited to being displayed at a specific display position in the direction on the playback image corresponding to the traveling direction. In other words, a position reference that determines the display position and display interval on the playback image reflecting the position of the point and the distance between the plurality of points can also be set for directions other than the traveling direction. A position index can be displayed at a specific display position in a direction on the reproduced video corresponding to a direction other than the traveling direction. For example, when the direction other than the traveling direction is a direction orthogonal to the traveling direction, the traveling position in the width direction in the lane of the traveling vehicle can be grasped, and the lane change or right / left turn can be performed. It is also possible to ascertain the quality of the travel locus at the time, the degree of travel speed, the degree of sudden operation, and the like.

  In the present invention, the position reference includes the specific display position and the specific display interval on the reproduced video, and the position of the specific point on the travel path and the specific plurality of points corresponding thereto. It is preferable to include a scale condition that defines the relationship with the distance, and a shooting condition that defines the shooting position, shooting direction, and shooting angle of view of the video data. According to this, the relationship between the specific display position and the specific display interval on the playback video, the position of the specific point on the travel route corresponding to this, and the distance between the specific points is defined by the scale condition. Since the shooting mode for the travel path of the reproduced video is defined by the shooting conditions, the above-described shooting conditions are used in addition to the scale conditions, so that the present invention can be applied to other than the specific positional relationship defined by the scale conditions. Since the position reference can be obtained, the position index can be displayed in a manner that can be applied to the entire traveling path shown in the image outside the traveling vehicle.

  In this case, the scale condition is designated by the reference instruction operation or an origin position defined in advance as a predetermined position, and is designated by the reference instruction operation or defined as a predetermined value in advance. It is preferable to have a reference distance indicating a specific distance and a reference position designated by the reference instruction operation. In this way, a method of designating a distance between two points in a predetermined or specified traveling direction on the playback video as the reference distance, or a distance between the two points equal to the predetermined reference distance. If so, the reference instruction operation is performed so that the display position on the playback image corresponding to the two points separated by the reference distance is the origin position and the reference position. The absolute position and scale reference on the playback video can be set. The reference instruction operation may be any instruction that directly or indirectly indicates the display position and display interval on the reproduced video as a result. Therefore, when the above three elements of the origin position, the reference distance, and the reference position are used as the scale conditions, it is only necessary to perform an operation in which all of the above three elements are determined as a result by performing at least some instruction. In other words, an operation for designating all the above three elements may be performed, but when two of the above three elements are set to predetermined values, only the remaining one element is designated. The position reference (scale condition) is determined. For example, in the following embodiment, when the origin position is not changed, the reference distance is set to a default value, so that the scale condition can be determined by indicating only the reference position. Of course, the position reference (scale condition) may be determined using an element set to one other predetermined value by indicating two elements.

  In this case, the position index display means is provided on the condition that the distance between the origin point on the travel path corresponding to the origin position and the reference point on the travel path corresponding to the reference position matches the reference distance. It is desirable to display the position index at the obtained display position. Further, the position index display means obtains a display position on the reproduced video other than the origin position and the reference position under a condition that a distance between the origin point and the reference point matches the reference distance, It is desirable to display the position index at the display position, the origin position, and the reference position. The display position of the position index by the position index display means may be at least only the reference position, and the origin position may be added thereto. However, as described above, since the position index can be displayed at a display position other than the origin position and the reference position, it is possible to display on the playback video without being restricted by the set origin position and the reference position. Since the position index can be arranged, the degree of freedom of the display position of the position index can be increased.

  In the present invention, the position index display means displays the position index according to an index display condition indicating an array mode and a display mode of the position index, and at least one of the array mode and the display mode can be set. Desirably configured. For example, as the arrangement mode of the position index, a value indicating the distance to the origin point on the travel path corresponding to the display interval between the origin position when the display position of the position index is determined, or required for traveling from the origin point Examples include a numerical value indicating time, the number of display positions and the display interval. In addition, as a display form of the position index, whether the position index has a form such as a line, a symbol, or a character, whether or not the position index includes an unusable element such as a distance display or a time display, the unusable element accompanies. In some cases, the display modes (numbers, characters, colors, patterns, etc.) are listed.

  In this case, the position index is a specific point on the travel path corresponding to a specific display position of the position index from an origin point on the travel path corresponding to the origin position on the playback image included in the position reference. It is preferable to accompany a distance display indicating the distance on the reproduced video until. According to this, since the position index is accompanied by a distance display, the distance from the origin point at a specific point can be immediately grasped on the reproduced video. Here, the distance display is not limited to the case where the numerical value indicating the distance itself is displayed, but may be configured so that the user can recognize the magnitude of the distance in some manner as a result. The color and shape of the position index may be changed accordingly. Even when the position index is not accompanied by a distance display, for example, a sufficient effect can be obtained by a method in which a plurality of position indexes are arranged at equal intervals to form a scale-like display mode as a whole. .

  In addition, the position index is determined so that the traveling vehicle reaches a specific point on the travel path corresponding to a specific display position of the position index from an origin point corresponding to the origin position on the reproduced video included in the position reference. It is preferable to accompany the time display which shows the time required for doing according to the travel speed of the said traveling vehicle. According to this, it is possible to immediately grasp the time required for the traveling body to reach from the origin point at the specific point by including the time indicator in the position index. Here, the time display is not limited to the case where the numerical value indicating the time itself is displayed, but may be configured so that the user can understand the time as a result in some manner. The color and shape of the position index may be changed. Even when the position index is not accompanied by a time display, it is possible to obtain a sufficient effect by a method such as arranging a scale or a symbol as a position index at equal time intervals on the reproduced video.

  In the present invention, the computer displays a travel change display that graphically displays a temporal change in the travel mode of the traveling vehicle based on travel data that is derived from the acquired information and indicates the travel mode of the traveling vehicle corresponding to the video data. It is preferable to further function as travel change display means for forming an area and instructing a position on the travel change display area corresponding to the playback time of the video data. According to this, since the time change of the traveling mode of the traveling vehicle is displayed in the form of a graphic in the travel change display area and the playback time point of the video data is indicated, the video playback operation for the playback video displayed in the video playback display area This makes it easier to adjust the position of the point on the road that appears in the playback image in the direction of travel, so that it is possible to quickly and reliably perform the reference instruction operation that refers to the display position of the point. Become.

  Next, the traveling video display system of the present invention displays a reproduced video corresponding to video data including at least a part of the video of the traveling road outside the traveling vehicle derived from the acquired information acquired in the traveling vehicle. A video data capturing means for capturing the video data in response to an information capturing operation, a video playback display area for displaying the playback video based on the captured video data, and a video playback operation Video playback display means for controlling the display state of the playback video in response to the reference instruction operation for directly or indirectly specifying at least the display position and display interval in the running direction on the playback video. A position reference is established for determining the display position and display interval on the playback image reflecting the position of the point on the road to be reflected and the distance between the plurality of points. Position reference setting means, and position index display means for displaying a position index at a display position on the reproduced video reflecting the position of the point and the distance between the plurality of points based on the position reference. It is characterized by that.

  In the present invention, as long as the video data includes a video outside the traveling vehicle as a part of the video data, the point on the travel path that appears in the reproduced video corresponding to the video data, regardless of the shooting direction. Can be grasped by the position index displayed on the reproduced video. However, in order to make it easier to grasp a point ahead in the traveling direction, it is preferable that the video data is video data obtained by capturing a front image in the traveling direction. In addition, in order to make it easy to grasp the traveling mode as a whole, the positional relationship is preferably a positional relationship in the traveling direction of the traveling vehicle. That is, the position of the point and the distance between the points are the position and distance along the traveling direction of the traveling vehicle, and the display position and the display interval are positions along the direction on the reproduced image corresponding to the traveling direction. And spacing. The video data is shot by video shooting means (for example, a camera mounted on a drive recorder or the like) mounted on the traveling vehicle.

  In the present invention and the present specification, “video data or traveling data derived from acquired information acquired in a traveling vehicle” includes the acquired information itself acquired in the traveling vehicle, and some processing is performed on the acquired information. Various types of information that have been applied and include all (for example, clip information described later) including at least a part of video data or travel data derived from the acquired information. The “running data” refers to data that includes GPS data and can indicate changes in the running mode such as the position, speed, and acceleration of the running vehicle. “Graphic” refers to a pattern including various shape elements such as a map, various graphs, icons, and symbols.

  Advantageous Effects of Invention According to the present invention, it is possible to achieve an excellent effect that a specific traveling state can be easily and accurately grasped based on video data including a video outside the traveling vehicle that indicates a traveling mode of the traveling vehicle.

The schematic block diagram which shows the whole structure of the operation condition management system of embodiment which concerns on this invention. 4 is a schematic flowchart showing a flow of the first half of a processing procedure realized by the embodiment. The schematic flowchart which shows the flow of the second half part of the process sequence implement | achieved by the same embodiment. The schematic block diagram which shows the structure of the function implementation means implement | achieved by execution of the clip information generation program of the embodiment. The schematic block diagram which shows the structure of the function implementation means implement | achieved by execution of the operation condition report program of the embodiment. The schematic block diagram which shows the structural example of the clip information database formed by the clip information database production | generation means implement | achieved by execution of the clip information production | generation program of the embodiment. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of a clip information generation program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. The screen block diagram which shows the user interface (display screen) of an operation condition report program. A function realization means corresponding to the position reference setting means and the position index display means of the traveling image display program or traveling image display system according to the present invention, which can be configured as a function added to the clip information generation program and the operation status report program. The schematic block diagram which shows a structure. The screen block diagram (a) and (b) which show the main screen of the user interface of the clip information generation program which added the function implementation means equivalent to a position reference setting means and a position index display means. Explanatory drawing (a) and (b) which show the relationship between the position and space | interval on a virtual screen, the position of the point on a travel path, and the distance between points. Explanatory drawing of a screen configuration showing functions and procedures for setting and displaying a distance line using the program. The screen block diagrams (a) and (b) which show the case where a reproduction | regeneration video is a composite video (2 screen video and 4 screen video). Screen explanatory drawing which shows the setting and display mode when there is a blind spot in the video. Screen explanatory drawing which shows another setting and display mode when a blind spot exists in an image | video. Explanatory drawing of a screen showing an example of performing setting and display using a road mark. The screen block diagram which shows the tab for operation | movement setting of a condition setting dialog. The screen block diagram which shows the tab for distance scale settings of a condition setting dialog. The screen block diagram which shows the tab for time scale setting of a condition setting dialog. Explanatory drawing (a) and (b) which show the relationship between the position and space | interval on a virtual screen when the underline increase distance is considered, and the position of the point on a travel path, and the distance between points.

  Next, an operation state management system as an embodiment of a traveling image display program and a traveling image display system according to the present invention will be described in detail with reference to the accompanying drawings. Here, the traveling video display program functions as an operation status display program in the embodiment described below, but if it displays traveling information including video data and traveling data in some form, It is not limited to this. In the embodiment described below, the traveling video display system functions as an operation status management system. However, if the traveling information including the video data and the traveling data is managed in some form, It is not limited to. Note that the traveling image display program and the traveling image display system according to the present invention correspond to image data including at least a part of an image of a traveling road outside the traveling vehicle derived from acquired information acquired in various traveling vehicles. The present invention can be applied to any object as long as it can display at least a reproduced video.

[Operation status management system]
FIG. 1 is a schematic configuration diagram showing an overall configuration of an operation status management system which is an embodiment of a traveling video display program and a traveling video display system according to the present invention, and FIGS. 2 and 3 are schematic diagrams showing processing procedures according to the present embodiment. It is a flowchart. This system can be generally configured by operating various programs using a computer, but the system is not limited to this.

  As shown in FIG. 1, the operation status management system of the present embodiment is mounted on a traveling vehicle and has a drive recorder 1 (a traveling information acquisition device or a video data acquisition device) for acquiring traveling information of the traveling vehicle, Acquired information processing device 2 (traveling information processing device or video data processing device) for processing travel information including at least part of the acquired information acquired by the drive recorder 1 and video data and travel data derived therefrom, and the travel And an operation status display device 3 (travel information display device) for displaying information.

  The drive recorder 1 includes a video photographing means for photographing a forward video of a traveling vehicle (traveling direction), a video of a crew member of a traveling vehicle (driver), and the like, and outputting video data. Recording means for outputting, GPS detecting means for outputting the traveling data (for example, including GPS data), a recording medium for recording each data, and a control unit for controlling recording on the recording medium Including recording means. In the drive recorder 1, an operation recording process is performed in which acquisition information MA including video data, audio data, and travel data in a form associated with each other along with the acquisition time is recorded on an appropriate recording medium by a recording unit (STEP 1 in FIG. 2). reference). For example, audio data Ma0 is recorded on track 0 of the recording medium, video data Ma1 is recorded on track 1, and traveling data Ma2 such as time and GPS data is recorded on track 2 every predetermined unit time (for example, 1 second). These are recorded repeatedly over the acquisition time. In this specification, when a plurality of pieces of acquired information MA are managed, the expression MA (i) (i is a natural number) is used as shown in FIG.

  The acquired information MA can be used for the next processing process as it is. However, in the operation status management system according to the present embodiment, the acquired information processing apparatus 2 acquires the acquired information MA so that the traveling information can be easily managed. Is converted into acquired information MB in which the travel data Mb2 is collectively arranged at the end of the audio data Mb0 and the video data Mb1 (see STEP 2 in FIG. 2). Here, the audio data Mb0 is substantially equivalent to the audio data Ma0, the video data Mb1 is substantially equivalent to the video data Ma1, and the traveling data Mb2 is substantially equivalent to the traveling data Ma2. This data conversion processing is realized, for example, by executing a data conversion program by a computer. Since the data conversion program simply converts the data structure of the acquired information MA as described above, a description thereof will be omitted. Generally, the acquisition information MA is recorded in the DRV file format, for example, by the drive recorder 1, and the acquisition information MB after data conversion is in a general-purpose video file format (for example, ASF file format).

  Next, the acquired information processing apparatus 2 performs an acquired information reproduction process for displaying the acquired information MB (see STEP 3 in FIG. 2). In this acquisition information reproduction process, at least the video data of the acquisition information MB is reproduced and displayed in the video reproduction display area. Moreover, the time change of the speed corresponding to the driving mode (moving mode) is graphically displayed in the driving change display area in a mode such as a speed graph based on the driving data. The reproduction display of the acquired information MB is indispensable for each process described later, and the graphic display of the time change of the running mode assists the operator's work in each process described later. This process is executed, for example, by operating a clip information generation program described later by a computer.

  Next, a clip information setting process for setting the clip period for the acquired information MB (see STEP 4 in FIG. 2), the video data and the running data of the set clip period are extracted from the acquired information MB, and the clip information CL Clip information output processing (see STEP 5 in FIG. 2) is performed. In general, a plurality of pieces of acquisition information MB (1), MB (2), MB (3),... Acquired in the same or different traveling vehicles are used, so that the acquisition information MB (i) (I is a natural number). In this case, generally, a plurality of pieces of clip information CL (i, 1), CL (i, 2),... Are extracted from each travel information MB (i), so that the clip information CL (i, j) where i and j are natural numbers, respectively. The above-described clip information setting process and clip information output process are also executed by, for example, operating a clip information generation program by a computer. In this process, the computer operator performs a clip information setting operation and a clip information output operation for specifying a clip period determined by the clip start time and the clip end time of the travel information MB to be extracted as the clip information CL. Clip information is output according to the clip information output operation in the clip period according to the setting operation.

  Based on the clip information CL (i, j) extracted as described above, the clip information database DBCL is configured by the database configuration processing (see STEP 6 in FIG. 2). This database construction process is also executed by operating the clip information generation program by a computer. The clip information database DBCL formed by this database configuration process includes a plurality of clip information CL (i, j), an acquisition information identification code Ici for mutually identifying the plurality of acquisition information MB (i), and a certain information A plurality of clip information CL (i, j) obtained from the acquired information MB (i) are respectively associated with clip information identification codes Icj for identifying each other. The acquired information identification code Ici specifies vehicle specifying information (specific information such as the vehicle number and model of the traveling vehicle) that identifies the traveling vehicle from which the acquisition information MB is obtained, the traveling date and time of the traveling vehicle, and the crew of the traveling vehicle. Information related to crew member identification information (crew member affiliation, employee number, name, etc.), etc. is indicated by symbols, numerical values, and the like. The clip information identification code Icj includes the date and time of the clip period from which the clip information CL (i, j) was taken out, the type of determination item in the clip period (basic running mode such as start, stop, right / left turn, etc., pause Violation, stop line over, speed violation, overtaking violation, slow speed, wandering, sidewalk, neglected signal, bad distance between vehicles, traffic violations such as accidents, etc.), the judgment result by the administrator for the relevant judgment items (impossible, inappropriate, acceptable, Suitable, recommended, etc.), the type of specific location on the travel route corresponding to the travel route (intersection (square, T-junction, Y-junction, etc.), stop line, railroad crossing, junction, 40km restricted road, expressway, Information about parking lots, premises, etc.) is indicated by symbols and numerical values. The clip information database DBCL according to the present invention is not limited to the case where the clip information CL (i, j) is associated with only the above two types of identification codes Ici and Icj. However, by associating the clip information CL with the acquired information identification code Ici and the clip information identification code Icj, for example, a plurality of clip information CL (i, j) can be classified and displayed in a two-dimensional matrix. Become.

  The acquired information processing apparatus 2 can also register specific point data on the travel route indicated by the travel data Mb2 of the acquired information MB as check information CH (see STEP 8 in FIG. 2). This check information CH includes, for example, important points (intersections (squares, T-junctions, Y-junctions, etc.), stop lines, railroad crossings, junctions, 40-kilometer restricted roads, expressways, parking lots, premises Etc.), etc. (point position data or point range data, or data including the traveling direction). In addition to the point data, the check information CH can include the acquired information identification code Ici, the clip information identification code Icj, or various information corresponding to these codes. This check information registration process is executed by, for example, operating the clip information generation program by a computer. In this process, the operator of the computer performs a check information registration operation corresponding to specific point data of the acquired information MB, and the computer registers the check information according to the check information setting operation.

  Further, if necessary, the acquired information processing apparatus 2 executes a check information input process for inputting the check information CH from the outside in accordance with the check information input operation (see STEP 7 in FIG. 2). If necessary, a check information output process for outputting the registered or input check information CH to the outside according to the check information output operation is executed (see STEP 9 in FIG. 2). These check information input processing and check information output processing are executed, for example, by operating the clip information generation program by a computer.

  Based on the clip information database DBCL, the clip information CL (i, j) is displayed by the operation status display device 3. In response to the clip information fetching operation, the operation status display device 3 has a plurality of clip information CL (i, j) based on the clip information database DBCL selected by the operation, and a travel information identification code Ici and clip information identification. Clip classification display processing that forms a clip classification display area that is classified according to the difference in code Icj and that is displayed so that one or a plurality of clip information can be selected from a plurality of clip information CL (i, j). Perform (see STEP 10 in FIG. 3). Then, in response to a clip information selection operation performed for a predetermined display classification in the clip classification display area, clip information call processing for calling one or a plurality of clip information belonging to the display classification is performed (see STEP 11 in FIG. 3). ). These clip classification display processing and clip information call processing correspond to travel information (clip information) capturing processing for capturing clip information. This travel information (clip information) capturing process is executed, for example, by operating an operation status report program described later by a computer.

  Next, clip information reproduction processing for reproducing one or a plurality of clip information CL selected as described above is performed (see STEP 12 in FIG. 3). This clip information reproduction process is also executed by operating the operation status report program by a computer. When a plurality of clip information is selected and captured by the clip information import process, the clip information reproduced and displayed by the clip information playback process can be further selected from the plurality of clip information. It is also possible to continuously display the clip information. Also in this clip information reproduction process, it is preferable to form a travel change display area showing the time change of the travel mode as described above, and to display a graphic such as a speed time change graph in this area.

  By operating the operation status report program, the computer performs a clip information editing process in accordance with a clip information editing operation by the computer operator (see STEP 13 in FIG. 3). Specifically, for example, various additional information such as comments and determination results corresponding to the editing operation is added to the displayed clip information. Further, the individual file output process is performed according to the operation of the computer operator by the operation of the operation status report program by the computer (see STEP 14 in FIG. 3). In the individual file output process, an individual file including bibliographic data relating to one or a plurality of clip information selected according to the clip information selection operation is output.

[Clip information generation program]
Next, with reference to FIG. 4 and FIGS. 7 to 23, a clip information generation program corresponding to the embodiment of the traveling image display program and the traveling image display system according to the present invention will be described. FIG. 4 is a schematic configuration diagram showing a configuration of function realizing means realized by executing the clip information generation program by a computer, and FIGS. 7 to 23 show various procedures when the clip information generation program is executed by the computer. It is a screen block diagram which shows the example of the display screen which appears in.

  In the clip information generation program P1 of this embodiment, when the program is started, a display screen (actually a display window, the same applies hereinafter) G1 shown in FIG. 7 is formed. In the display screen G1, an input file designation area g11 is provided on the left side of the screen. In the input file designation area g11, an input folder designation part g11a for designating an input folder, an input file display part g11b for displaying an acquisition information file (ASF file) storing the acquisition information MB in the input folder, An output folder designating part g11c for designating a storage folder of a clip information file (to be described later) storing the clip information CL is formed.

  When a folder specifying operation such as a double click operation with the mouse is performed on the input folder specifying unit g11a, the input folder specifying dialog g11d shown in FIG. 8 is displayed, and the input folder specifying the acquired information MB (i) is specified. When an operation is performed, an input folder (ASF folder) is set according to the operation. When the input folder is set in this way, as shown in FIG. 9, one or a plurality of acquisition information files including the acquisition information MB (i) stored in the input folder are read, and the input folder specifying unit g11a In the input file display part g11b formed below, the images are displayed in a predetermined order (in the illustrated example, the order according to the recording date and time indicated by the file name).

  Further, one or a plurality of acquired information files displayed on the input file display unit g11b can be individually selected by a click operation with a mouse or the like. When this input file selection operation is performed, the acquired information file is highlighted, for example, so as to be distinguished from the others, thereby indicating that a specific acquired information file is selected. The above operation is executed by the acquisition information fetching means P1a shown in FIG. 4 in response to the above input folder designation operation and input file selection operation for the input file designation area g11. The acquired information capturing means P1a captures the video data Mb1 included in the acquired information MB (i), and corresponds to the video data capturing means according to the present invention.

  As shown in FIG. 7, a rectangular video reproduction display area g12 is formed on the right side of the input folder designation part g11a and the input file display part g11b. In the video reproduction display area g12, the video data Mb1 of the selected acquisition information file is configured to be reproducible. In the illustrated example, the front image and the in-vehicle image are displayed side by side in the image reproduction display area g12. However, only a single image may be displayed, or three or more images may be displayed simultaneously. . These display modes are appropriately configured according to the configuration of the video data Mb1. Also, the audio data Mb0 of the acquired information file is configured to be reproducible. A playback operation input unit g12s is provided below the video playback display area g12. In the reproduction operation input unit g12s, a rewind button, a stop button, a reproduction button, a pause button, and a feed button for the reproduction operation of the audio data and the video data Mb0 are sequentially arranged from the left side to the right side. The playback state of the video playback display area g12 is controlled in accordance with an operation on each of these buttons (corresponding to the video playback operation according to the present invention).

Further, on the right side of the reproduction operation input part g12s, a continuous reproduction mode for continuously reproducing a plurality of travel information files displayed on the file display part g11b and an individual reproduction mode for reproducing only the selected travel information file. And a continuous reproduction button g12t that can be switched alternately. Figure 15 is a result of continuous reproduction mode is selected operation shows a state in which the continuous playback button g12t is highlighted. Further, as shown in FIG. 7, a volume adjustment operation part g12a is formed at the lower right of the video reproduction display area g12. On the right side of the reproduction operation input unit g12s, the reproduction speed reproduced in the video reproduction display area g12 (“× 1” = 1 × speed is selected in the illustrated example, but “× 2” = 2). Double speed, “× 5” = 5 × speed, “× 10” = 10 × speed, etc. can also be selected). When the reproduction operation is input to the reproduction operation input unit g12s, the reproduction operation of the video data Mb1 in the video reproduction display area g12 is performed by the video reproduction display means P1b shown in FIG.

  A playback file information display area g13 is provided on the right side of the video playback display area g12. In the reproduction file information display area g13, as shown in FIG. 9, the bibliographic items of the acquired information file selected or reproduced, that is, the traveling date and time, the traveling time, the vehicle number (specific information of the traveling vehicle), etc. The file information display part g13a to be displayed and the playback time (video (and audio) playback time) and playback time (video (and audio) playback start of the video (and audio) being played back in the video playback display area g12 And a reproduction information display part g13b for displaying the elapsed time).

  Below the video reproduction display area g12, a travel change display area g14 (travel mode time) for displaying a change in travel mode based on the travel data Mb2 of the acquired information MB (i) stored in the acquired information file. Corresponding to the travel change display area for displaying changes). The travel change display area g14 displays the time change of the travel mode as a graphic, and in the illustrated example, the speed change is displayed by a line graph with the vertical axis representing speed and the horizontal axis representing time. . However, the graphic display of the travel change display area g14 is not limited to a line graph, but may be other graphic such as a bar graph. Moreover, as a driving | running | working mode, not only speed but the position on a driving route (In this case, what is displayed on a map etc. can be considered) and acceleration may be sufficient. A speed value display part g14p for displaying a speed value at the time of reproduction is formed in the upper left of the travel change display area g14.

  In the travel change display area g14, as shown in FIG. 9, a vertical reproduction position indicating line g14n indicating a position corresponding to the reproduction time point of the video data Mb1 (and audio data Mb0) is displayed. The reproduction position instruction line g14n moves to the right side of the drawing as the reproduction video displayed in the video reproduction display area g12 progresses, and the reproduction video is stopped, rewound, Alternatively, when feeding occurs, the feed stops and moves to the left side in the figure or moves to the right side in the figure. That is, as shown in FIGS. 9 and 10, the reproduction position instruction line g14n always indicates the position on the travel change display area g14 corresponding to the reproduction time point of the video reproduction display area g12. Further, the travel change display area g14 has the same start position instruction line g14s that indicates the position on the travel change display area g14 corresponding to the clip start time of the set clip period in accordance with the clip information setting operation. An end position indicating line g14f that indicates the same position corresponding to the clip end time of the clip period can be displayed according to a mode of setting operation of a clip setting area g16 described later.

  The travel change display area g14 is an input position detection area that accepts a position input operation such as a click operation with a mouse. As shown in FIG. 11, when a position in the travel change display area g14 is instructed by the position input operation, the reproduction position instruction line g14n moves to the position and is reproduced in the video reproduction display area g12. The video (and audio) being displayed shifts to the reproduction time corresponding to the position of the reproduction position instruction line g14n.

  Further, as shown in FIG. 9, a travel change display setting part g15 is formed on the left side of the travel change display area g14. In the travel change display setting part g15, a time display setting part g15a for setting the horizontal display magnification of the travel change display area g14 and a speed display for setting the vertical display magnification (maximum speed). A setting unit g15b and a display mode setting unit g15c having a check box of a display filter function for smoothing the display mode of a graph indicating a change in driving mode (speed change) are provided. Further, a button for returning the time display setting and the speed display setting to the default values is formed in the travel change display setting unit g15. The display operation in the travel change display area g14 is executed by the travel change display means P1c in FIG. 4 according to the operation on the travel change display setting unit g15 and the various operations described above.

  A clip information setting area g16 is formed at the lower right of the video reproduction display area g12. In the clip information setting area g16, an indicator display setting unit g16a for setting whether or not to display an indicator including the start instruction line g14s and the end instruction line g14f indicating the clip period, and a time width of the clip period are fixed. A clip period width setting display part g16b for setting whether or not to perform, a setting button A for setting the clip start time, a setting button B for setting the clip end time, and the set clip start time and clip end time The clip period setting display part g16c provided with a time display for displaying each of the above and a clip travel distance display part g16d indicating the travel distance of the traveling vehicle corresponding to the clip period.

  In the clip period width setting display portion g16b, when the setting button A or B is operated, the clip start time or the clip end time is set at the playback time at the time of the operation, that is, the time corresponding to the playback position indicating line g14n. . At this time, if the time width of the clip period is set by entering a number in the time display box on the right side of the figure and the check box on the left side of the figure is checked to fix the clip period, the clip start time and clip end time will be When one of the times is designated, the other time is automatically set according to the time width of the clip period. When the check box is unchecked, the clip start time and the clip end time can be set separately by operating the setting buttons A and B, respectively. The duration of the clip period is automatically calculated and displayed in the time display box. Here, the above-described clip information setting operation is executed by the clip information setting unit P1d shown in FIG. 4 in accordance with an operation on the clip period width setting display unit 16b and other operations.

  The clip information setting area g16 includes a preview button g16e for reproducing only the set clip period, and clip information CL (i) obtained by cutting out the audio data Mb0, the video data Mb1, and the travel data Mb2 in the set clip period. , J) are provided with two types of clip output buttons g16f and g16g for outputting and saving the clip information file. Further, in the output folder designating part g11c arranged between the input file designating area g11 and the travel change display setting part g15, as shown in FIG. 12, a specific output folder designating operation such as a double click of the mouse is performed. Is input, an output folder designation dialog g11e is displayed, and a storage folder for a clip information file having a clip period corresponding to a clip information setting operation for the clip information setting area 16 can be designated.

  When the clip output button g16f “CLIP1” is selected and operated, a clip output dialog g16h shown in FIG. 17 is displayed. As shown in FIG. 18, when predetermined determination information (determination result that is a clip information identification code in the illustrated example) in the input assist box on the left side of the drawing is selected by a mouse click operation or the like, a plurality of items in the storage folder are selected. In the subfolder box on the right side of the figure in which the subfolder is displayed, the subfolder corresponding to the determination information is automatically designated and displayed in the designation box below it. Here, by operating the save button by clicking the mouse, etc., as shown in FIG. 19, the clip information file having the predetermined determination information as the file name is saved in the subfolder. When the above clip output button g16g “CLIP2” is selected and operated, an output folder designation dialog g16i is opened as shown in FIG. 20, so that the folder is directly designated and the clip information file is saved as shown in FIG. can do. The above clip information file output operation is executed by the clip information output means P1e shown in FIG.

  The clip information file output operation executed by the clip information output unit P1e preferably involves the database configuration process STEP6 shown in FIG. This database configuration process STEP6 is a process for forming the clip information database DBCL. FIG. 6 shows a specific configuration example of the clip information database. In this configuration example, the clip information file output by the clip information generation program P1 of the present embodiment is set to be stored in the root folder RFCL. In the illustrated example, subfolders CLA, CLB, CLC, CLa1, CLa2, CLc1, and CLa1a having a plurality of layers (up to three layers in the illustrated example) are formed in the root folder RFCL, and the lowermost subfolders CLa1a, CLa2, CLB, and CLc1 are formed. Each of the above clip information databases DBCL is configured.

  The clip information database DBCL is provided with a plurality of DB folders S1, S2,... Stored in the subfolder CLa1a, for example. The above-mentioned clip information files S11, S12,... Are stored in these DB folders. In the DB folders S1, S2,..., At least a part of the clip information identification code Icj such as the type of the determination item is recorded as, for example, a folder name. In addition, each clip information file S11, S12,... Includes at least a part of the acquired information identification code Ici such as, for example, the name of the acquired information file, the specific information of the traveling vehicle such as the vehicle number, and the traveling date and time. Recorded as a file name. The clip information identification code Icj and the acquired information identification code Ici are not limited to being recorded as a folder name or a file name, but are recorded in an appropriate file in the folder or an appropriate configuration area in the file. Also good. However, since each code is recorded as a folder name and a file name as described above, only the identification code recorded as the folder name or the file name is recognized and classified by the operation status report program P2 described later. It becomes easy to display.

  As shown in FIG. 12, a check information operation input part g17 is formed between the video reproduction display area g12 and the travel change display area g14. In the illustrated example, a check information registration icon g17a and a check information expansion list g17b are formed in the check information operation input unit g17. When the check information development list g17b is selected, as shown in FIG. 13, a check information registration button g17c, a check information search button g17d, a clip batch registration button g17e, a check information output button g17f, and a check information input button g17g are displayed. The check information registration icon g17a and the check information registration button g17c have the same function, and when these are selected, point data corresponding to the playback time of the video data at the selected time point is registered as check information CH. In addition, as shown in FIG. 11, the check information CH can be registered by instructing the inside of the travel change display area g14 with a right click of the mouse or the like.

  Registration of the check information CH is performed by being recorded in a check information file (or check information database) other than the acquired information file and the clip information file. However, the check information CH may be recorded in the acquisition information file together with the acquisition information MB (i). As the contents of the check information CH, for example, coordinate data (GPS data) indicating point data is an essential element. Of course, the information is not limited to the coordinate data, as long as it is information that can identify the point data even indirectly. Date and time of check registration, or the name and storage location of the acquired information file that was displayed when the point data was imported, time data at the time of playback when the coordinate data in the acquired information file was passed, the point The traveling direction data of the traveling vehicle at may also be included.

  The check information CH that has undergone the registration operation as described above has point data corresponding to the playback time point of the video data. For example, in this embodiment, the check information CH includes point data corresponding to the playback time point. However, in the present embodiment, the check information CH is set not only as the point data itself but as indicating a predetermined range (for example, a range having a radius of 50 m) around the point data. Further, when the check information CH is registered, as shown in FIG. 14, the check information CH is instructed in the travel change display area g14. In the illustrated example, a colored band mark displayed on the upper edge of the graph display area of the travel change display area g14 is a check information marker g14ch that displays check information CH. In this case, for example, the recording range when traveling in a range of a radius of 50 m centered on the point is displayed by the length of the check information marker g14ch in the time axis direction. Therefore, when the traveling speed is high, the band shape of the check information marker g14ch is displayed short. In the present embodiment, the check information CH is registered so as to be within a certain distance range, but may be registered so as to be within a certain time range, or simply registered as single point or temporary point information. May be.

  When the check information search button g17d is selected and operated, a confirmation dialog box shown in FIG. 22 is opened. If the user agrees to the confirmation dialog box, the plurality of acquired information files displayed in the input file display box g11b are searched. As shown, the display portion of the acquired information file in which the check information is registered is displayed in color. When the colored acquisition information file is selected, a travel change display area g14 including the check information marker g14ch is displayed as shown in FIG. When the clip batch registration button g17e is selected and operated, a designation dialog (not shown) for designating a folder in which clip information files are stored is displayed. When a folder designation operation is performed, clips in the folder are displayed. The point data of the information file can be registered automatically. In this case, when the name of the acquisition information file is recorded in the clip information file in the form of a part of the file name, for example, it is read and the corresponding acquisition of the displayed plurality of acquisition information files is obtained. For example, by registering the check information CH including the name of the target acquisition information file in association with the information file, the check information marker is displayed in the travel change display area g14 only when the acquisition information file is reproduced and displayed. It can be configured to display g14ch.

  The check information file is registered as the check information file in the computer on which the clip information generation program is executed, or more preferably, a check information folder storing a plurality of check information files is formed. Registered as an information database. The above operation is executed by the check information registration unit P1f shown in FIG. 4 in response to the above-described check information registration operation. Here, when the registered check information CH is shared or used between terminals such as other computers, the registered data in the check information file is output by operating the check information output button g17f. can do. This operation is executed by the check information output means P1g shown in FIG. 4 according to the check information output operation. On the contrary, when the check information is fetched from the outside, the registered data can be fetched by operating the check information input button g17g. This operation is executed by the check information input means P1h shown in FIG. 4 according to the check information input operation.

  As shown in FIG. 9, an OPTION button g18 is formed between the video playback display area g12 and the travel change display area g14. When the OPTION button g18 is operated, a plurality of OPTION buttons g18 are operated as shown in FIG. A setting list g18a including setting items appears so that appropriate settings can be made according to the selection operation.

[Operation status report program]
Next, with reference to FIG. 5 and FIGS. 24 to 38, an operation status report program corresponding to an embodiment of the traveling image display program and the traveling image display system according to the present invention will be described. FIG. 5 is a schematic configuration diagram showing the configuration of the function realizing means realized by executing the operation status report program by the computer. FIGS. 24 to 38 show various procedures when the operation status report program is executed by the computer. It is a screen block diagram which shows the example of the display screen which appears in.

  In the operation status report program P2 of this embodiment, when the program is started, a display screen (actually a display window, the same applies hereinafter) G2 shown in FIG. 24 is formed. In the display screen G2, an operation menu g21 is formed in the upper left, and a file operation input unit g21a and a setting operation input unit g21b are formed in the operation menu g21. Below the operation menu g21, an operation setting display unit g22 including a travel month display unit g22a, an input folder display unit g22b, a travel month operation unit g22c, and a data search button g22d is formed. In this operation setting display part g22, the month to be displayed on the travel month display part g22a is displayed according to the operation on the travel month operation part g22c, and when the data search button g22d is operated, the subfolder in which the data exists is automatically searched. One of them is displayed in a database display area g23 to be described later. Further, when a plurality of subfolders exist in the root folder RFCL by the above search, they are displayed in the pull-down list of the folder display portion g22b, and the subfolders to be displayed can be selected from the list.

  A database display area g23 is formed below the operation setting display part g22. The database display area g23 is an area for classifying and displaying the entire configuration of the above-described clip information database, and occupies the main part of the display screen G2. A list output button g23a is formed at the upper right of the database display area g23. When the list output button g23a is operated, the data contents displayed in the database display area g23 are output as a file in the form of a list corresponding to a classification display described later.

  When the setting operation part g21b of the operation menu g21 is selected, an environment setting drop-down menu is displayed as shown in FIG. 25. When the environment setting in this menu is operated, an environment setting dialog g21c shown in FIG. 26 is displayed. The In the environment setting dialog g21c, a route designation part g21d for designating the root folder RFCL in which clip information is stored and a setting in the computer, various search key settings, link data, and the like are registered, and clip information is registered. An internal management DB designating part g21e for designating an internal management database for overall management of the database is provided, and other setting parts are formed as necessary.

  On the other hand, when the file operation part g21a of the operation menu g21 is selected and operated, drop-down menus of an import menu g21f and a reconstruction menu g21g are displayed as shown in FIG. When the import menu g21f is selected, an input dialog g21h shown in FIG. 28 is displayed. In the input dialog g21h, an input folder designating part g21i for designating an input folder in which a clip information database to be imported is stored, an input folder display part g21j for displaying the configuration in the designated folder, and an import destination DB folder are designated. And a DB folder display part g21l for displaying a configuration in the designated DB folder. The file display part g21m displays the imported clip information file. When the import button g21n is operated, as shown in FIG. 29, the clip information file in the folder designated by the input folder designation part g21i and displayed in the input folder display part g21j is designated by the DB folder designation part g21k and It is imported into the DB folder displayed in the DB folder display part g21l.

  When the reconfiguration menu g21g shown in FIG. 27 is selected and operated, a confirmation display dialog g21o shown in FIG. 30 is displayed, and when the reconfigure button g21p on the lower right is operated, the changes made by the above import processing are reflected in the database configuration. In addition, the clip information database is reconstructed as shown in FIG.

  Next, when the data search button g22d is selected, the contents of the clip information database DBCL in the root folder RFCL are displayed in the database display area g23 as shown in FIG. The database display area g23 displays the clip information CL (i, j) stored in the clip information file by classifying it according to the difference between the acquired information identification code Ici and the clip information identification code Icj. In the present embodiment, the classification display mode M has a tabular format that forms a two-dimensional matrix in such a mode that the acquired information identification code Ici is a row and the clip information identification code Icj is a column. In the illustrated example, a row is formed for each vehicle number and crew name displayed in the row title column at the left end as the acquired information identification code Ici and the detection date, and is displayed as the clip information identification code Icj in the column title row at the upper end in the drawing. A column is formed for each judgment item. Further, an “other” column is provided at the right end of the figure for each acquired information identification code Icj, and an event that occurred during traveling is recorded in the clip information CL (i, j) for each original acquired information MB (i). .

  In the clip information database DBCL classified and displayed in a tabular format in the database display area g23, the classification display mode M in a vertical and horizontal matrix configured according to the difference between the acquired information identification code Ici and the clip information identification code Icj. One or a plurality of clip information CL (i, j) is associated with each of the plurality of cells ms, and a display marker corresponding to each clip information is displayed. In the illustrated example, a symbol indicating the determination result of the clip information CL (i, j) is displayed in each cell ms. Here, in the determination result of the illustrated example, the symbol “◎” is excellent, the symbol “○” is good, the symbol “△” is allowed in the case where there is no traffic violation, and the symbol “▲” is displayed in the case where there is a traffic violation. Minor violations, symbol “●” indicates serious violation, and symbol “?” Indicates difficulty in determination. The above operations are executed by the clip classification display means P2a shown in FIG. 5 according to the selection operation for the classification display mode M.

  In the above-described classification display mode M in the matrix format or the table format, when the selection operation is performed within each cell ms classified by the two identification codes Ici and Icj by clicking with the mouse or the like, the display in the selected cell ms corresponds. One or a plurality of clip information CL is selected at once. Further, when the row title mi in the leftmost row title column or the column title mj in the uppermost column title row for displaying the acquired information identification code Ici or the clip information identification code Icj itself is selected and operated, All included clip information CL is selected. Note that “other” cell ms is associated with one or a plurality of clip information to be noted in the acquisition information corresponding to the acquisition information identification code of the row to which the cell belongs, and the clip information to be noted by the selection operation. Are selected at once.

  When one or a plurality of clip information CL displayed in the database display area g23 is selected as shown in FIG. 32 as described above, the selected clip information CL is called, and as shown in FIG. 33, the display screen G3 is displayed. A (display window) is formed separately from the display screen G1, and the selected clip information CL in the video list g31 is displayed by at least a part of the identification codes Ici and Icj. The clip information database configuration display function for the database display area g32 and the function for calling one or a plurality of clip information CL to the display screen G3 according to the selection operation for the configuration display are the above-described internal management database. It is done with reference to. At this time, the calling operation of the selected one or more clip information is executed by the clip information calling means P2b shown in FIG. In the operation status report program P2, the clip classification display means P2a and the clip information call means P2b have a function as travel information fetching means, and the video data fetching means of the travel video display system according to the present invention is applied. In addition, when the travel information capturing unit is provided in the travel image display program according to the present invention, it corresponds to the image data capturing unit of the program.

  As shown in FIG. 33, on the display screen G3, a video playback display area g32 configured in the same manner as the video playback display area g12 is formed on the left side of the video list g31. A reproduction operation input unit g32s configured similarly to the operation input unit g12s is formed. A determination information display part g33 for displaying determination information is formed below the reproduction operation input part g32s. Further, below the video list g31, a travel change display area g34 configured in the same manner as the travel change display area g14, a comment input part g35 (see FIG. 35), and a GPS data display part g36 (see FIG. 35) can be displayed alternately by the tab structure. The above operations are executed by the clip information display means P2c shown in FIG. The clip information display means P2c corresponds to the video reproduction display means according to the present invention.

  Here, as shown in FIG. 35, when the comment tab is selected, a comment input part g35 is displayed. The comment input unit g35 is configured to store various comments related to the clip information CL being reproduced. This operation is executed by the clip information editing means P2d shown in FIG.

  Further, when the individual output button g38 is operated, a save dialog g39 shown in FIG. 36 is displayed, and individual data relating to the selected one or more clip information CL can be output. This operation is executed by the individual data output means P2e shown in FIG. The individual data output means P2e is a means for creating and outputting appropriate data for one or a plurality of clip information CL selected by the operator, whereby one or a plurality of the data selected as described above is output. Management data can be created in an appropriate format for the clip information CL. In this case, the individual data can be output after adding additional information by the operator to at least a part of the original one or a plurality of clip information CL by the clip information editing means P2d.

  In addition, as shown in FIG. 37, you may further provide the map display part g40 in the said display screen G3. In the illustrated example, the map display unit g40 is configured to be able to display the video list g31 alternately by a tab structure. When the map display part g40 is selected and operated, a map display area g41 shown on the left side of FIG. 38 is displayed. The map display area g41 displays a map of a range including point data corresponding to the reproduction time point of the video reproduction display area g32 (centering on a position corresponding to the point data in the illustrated example). In the map display area g41, a standard marker g42 indicating the current traveling position corresponding to the point data is shown. Further, in the map display area g41, the display and non-display of the standard marker g42, the display and non-display of the travel locus, and the necessity of rotating the map in accordance with the travel direction can be switched by selecting a check box. Composed. Further, when the illustrated distance radar button g43 is operated, the reproduction of the video data in the video reproduction display area g32 is temporarily stopped, and the distance from the current traveling position is concentric as shown on the right side of FIG. Displayed by distance marker g44.

  According to the operation status management system, the clip information generation program P1 and the operation status report program P2 of the present embodiment described above, the following effects can be obtained.

  First, clip information CL (i, j) can be generated from the acquired information MB (i) by the clip information generation program P1, and the clip information CL (i, j) can be reproduced and displayed by the operation status report program P2. Even if the acquired information MB (i) is recorded as data over a long period of time, the main points of the acquired information MB (i) can be quickly and easily grasped, and various processes and other management operations are performed in a short time. It becomes possible.

  Further, in the clip information generation program P1, when the acquired information MB (i) is reproduced and displayed, the time change of the running mode is displayed in graphic form, and the position corresponding to the reproduction time point is indicated, whereby the time at the reproduction time point of the acquired information is displayed. Since the driving situation before and after the target can be estimated, it is possible to easily and quickly grasp the driving situation and set the clip information. This is the same even when the clip information CL (i, j) is reproduced and displayed in the operation status report program, and the traveling state is displayed by the graphic display of the time variation of the traveling mode and the display of the indicated position corresponding to the reproduction time point. It becomes possible to grasp the situation easily and quickly.

  Furthermore, since the clip information generation program P1 can set the clip period corresponding to the playback time point of the video data, the clip period can be set accurately and quickly only by operating while viewing the video data. In addition, this point is the same when registering the check information CH, and the point data corresponding to the playback time point of the video data can be registered as the check information CH. Therefore, the point data can be accurately and simply operated by watching the video data. You can register quickly.

  Further, in the operation status report program P2, a plurality of clip information CL (i, j) are classified and displayed by the acquired information identification code Ici and the clip information identification code Icj, and each display classification (cell ms, row) of this classification display mode M is displayed. By selecting the title mi or the column title mj), one or a plurality of clip information CL belonging to the display classification can be called. Accordingly, since it is possible to capture and display an appropriate clip information group required by the operator, it is possible to quickly and easily perform various report processing work and management work of the operation status.

[Configuration corresponding to position reference setting means and position index display means]
Finally, a configuration corresponding to the position reference setting unit and the position index display unit in the traveling image display program and the traveling image display system according to the present invention will be described. The configuration is such that when the clip information generation program P1 or the operation status report program P2 displays the playback video in the video playback display area g12 or g32 based on the video data included in the acquired information MB or the clip information CL, respectively. In addition, this is an additional function applied to the reproduced video. Below, the case where the said function is added in the said clip information generation program P1 is demonstrated in detail, However, The said function can be similarly added and comprised about the said operation condition report program P2.

  FIG. 39 is a schematic configuration diagram showing the configuration of the function realization means of the clip information generation program P1 ′ of this embodiment. Here, each means indicated by a dotted line in the figure is the same as the clip information generation program P1 of the previous embodiment, and is not an essential configuration in the present invention, so the description thereof is omitted. In the present embodiment, a video scaling function for displaying a distance line or a time line as a position index on the reproduced video displayed in the video reproduction display area g12 by the video reproduction display means P1b similar to the previous embodiment is displayed. It is provided.

  In the present embodiment, as shown in FIG. 39, position reference setting means P1i for setting a position reference in accordance with a reference specifying operation, and position index display means P1j for displaying a position index superimposed on the reproduced video according to the position reference. And. The position reference includes a scale condition determined by an origin position, a reference distance, and a reference position, and a shooting condition determined by a shooting position, a shooting direction, and a shooting angle of view related to the position and orientation of the camera. Further, the position index display means P1j has a function for setting a condition related to the display mode of the position index, for example, an index display condition including an array mode of the position index and a display mode of the position index, A function for calculating the display position of the index, and a function for displaying the position index in a superimposed manner on the playback video according to the display position and the display form.

  FIG. 40 is a screen configuration diagram (a) showing a user interface before setting the position reference and displaying the position index of the clip information generation program P1 ′ having the video scaling function of this embodiment, and the position index. The screen block diagram (b) which shows the user interface of the displayed state is shown. As shown in FIG. 40 (a), the display screen G1 ′ of this embodiment is similar to the display screen G1 of the clip information generation program P1 of the previous embodiment, and the input file designation area g11 and the video reproduction display area g12. A reproduction file information display area g13, a travel change display area g14, a travel change display setting part g15, and a clip information setting area g16. In the video reproduction display area g12, an image of a traveling road outside the traveling vehicle is displayed by a camera or the like mounted on the traveling vehicle as shown.

  On the display screen G1 ′, the video scaling activation is made up of two check boxes for setting whether or not to display the distance line and the time line corresponding to the position index of the present invention in the upper left position of the video reproduction display area g12. An operation unit g12x is provided, and it is possible to select whether or not to display a distance line and whether or not to display a timeline by an operation such as clicking with a mouse or the like. In the case of the illustrated example, the distance line can be displayed by an operation of checking a check box on the left side of the image scaling activation operation unit g12x. In this state, a distance line A (for example, a red line) that extends horizontally is displayed outside the upper edge of the video reproduction display area g12, and a video baseline C that extends horizontally outside the lower edge of the video reproduction display area g12. (For example, a gray line) is displayed.

  The distance line A and the video base line C are video playback display areas by moving operations such as drag and drop from the initial position (position along the upper edge and the lower edge of the playback video), respectively. It can be arranged at an arbitrary display position in the traveling direction (vertical direction in the figure) on g12. Here, the video base line C indicates an origin position which is one of the scale conditions among the position references regarding the display position on the reproduced video, and the distance line A is a contrast which is another scale condition. It shows the position. That is, the moving operation is a reference instruction operation for setting the scale condition of the reproduced video by designating the origin position and the reference position. However, if the lower edge position of the video playback display area g12 coincides with the lower edge position of the playback video and the lower edge of the playback video may be used as the origin position as it is, the moving operation of the video baseline C is not performed. The initial position may be left as it is. It should be noted that the scale condition of the reproduced video is not defined until a reference distance (to be described later) indicating the distance between the origin point on the traveling road (road surface) and the reference point corresponding to the display interval between the origin position and the reference position is specified. Is set. Since the reference distance can be a predetermined value (5 m in the illustrated example), it is not necessary to be a target for the reference instruction operation. However, the reference distance may be appropriately changed. In this case, the reference instruction operation may include a reference distance instruction operation.

  FIG. 40B shows a state in which the distance lines A and P and the time line Q, which are position indicators, are displayed based on a position reference including a shooting condition described later in addition to the scale condition. The timeline Q is displayed under a predetermined condition by checking the check box on the right side of the video scaling activation operation unit g12x. The distance lines A and P indicate the display position on the reproduced image corresponding to the reference point that is a predetermined distance away from the origin point on the travel path corresponding to the display position (origin position) of the video baseline C. Here, the distance lines A and P are displayed in red, the time line Q is displayed in yellow, and the distance lines A and P and the time line Q are displayed so that the colors and other aspects can be distinguished from each other. The distance line P is a position index displayed at a display position different from the distance line A arranged on the reproduced video by the above-described reference instruction operation. In the illustrated example, the distance line P is a specific distance from the origin point. It is arranged at a specific display position corresponding to a specific point having. In the illustrated example, five distance lines P corresponding to five points 0 m, 1 m, 3 m, 10 m, and 20 m from the origin point corresponding to the origin position indicated by the video baseline C are displayed on the reproduced video. Overlaid on the screen. Here, each distance line A, P is accompanied by a distance display indicating the distance L. In addition, the 0 m distance line P displayed superimposed on the video base line C has a screen underline distance obtained in accordance with shooting conditions described later (the origin corresponding to the display position of the video base line C of the playback video from the camera position). The distance in the traveling direction to the point is additionally displayed.

  On the other hand, the timeline Q indicates a specific display position on the reproduced video corresponding to a specific point starting from the origin point and reaching a predetermined time t when the traveling vehicle travels at the current speed v. In the illustrated example, four timelines Q after 0.3 seconds, 0.5 seconds, 1.0 seconds, and 3.0 seconds are displayed superimposed on the reproduced video. This timeline Q is accompanied by a time display indicating the time t. The timeline Q is checked on the right side of the figure only when the distance line A is instructed while the check box on the left side of the video scaling activation operation part g12x is checked and the distance lines A and P can be displayed. Displayed when a box is checked. The distance lines A and P arranged on the reproduced video can be individually deleted by an instruction and operation (double-clicking at the time of instruction) with a mouse or the like, and the distance line A at the initial position is indicated and By operating (double-clicking when instructing), all the distance lines A and P on the reproduced video can be deleted. Furthermore, when the instruction of the distance line A is completed in the state shown in FIG. 40A, the instruction of the distance line A and another operation (right double click at the time of instruction) are performed, so that FIG. The indicated distance line P is displayed.

  In the present embodiment, the distance lines A and P and the time line Q, which are position indicators, are displayed at specific display positions on the reproduced video, but the display positions are on a traveling path (road surface) reflected in the reproduced video. Reflects specific points and the distance between specific points. For example, the distance line P having the distance L of 10 m is displayed at a specific display position having a specific interval from the origin position on the reproduced video. This display position is the origin point on the travel path reflected on the reproduced video (reproduced). This is a position where a specific point on the traveling road 10 m ahead from the point on the traveling road corresponding to the display position of the video baseline C on the video is reflected.

  In this way, by looking at the distance lines A and P, a point having a specific distance from the origin point can be known on the reproduced video. Therefore, for example, when the traveling vehicle is temporarily stopped or parked, the point on the traveling path corresponding to the temporary stop position or the parking position corresponds to the preceding vehicle traveling on the traveling path first during traveling. It is possible to quickly and surely grasp whether the distance between the vehicles. Therefore, it is possible to easily and objectively determine whether the stop position, the parking position, and the inter-vehicle distance are appropriate.

  On the other hand, by visually recognizing the timeline Q, it is possible to know a specific point that arrives after a specific time from the origin point. Thus, for example, whether the traveling vehicle has sufficient time to sufficiently respond to the sudden accident of the preceding vehicle or whether the vehicle is making a right or left turn at a slow speed sufficient to avoid crossing pedestrians. It is possible to grasp with certainty. Therefore, it is possible to easily and objectively determine the degree of safety based on the inter-vehicle distance and the traveling speed.

41 (a) and 41 (b) show the relationship between the position and interval on the virtual screen DP corresponding to the reproduced video and the position of the point on the traveling road (road surface) R and the distance between the points reflected in the reproduced video. It is explanatory drawing shown. The virtual screen DP is a virtual screen on which an image corresponding to the playback video can be obtained when all points on the travel path R that appear in the playback video are projected in the shooting direction (direction toward the camera). FIG. 41A shows the relationship between the positions of the distance lines A and P and the video baseline C on the virtual screen DP and the points B, Bs, and Bp on the travel path R. The shooting conditions when shooting the outside using a camera mounted on a traveling vehicle, etc. are the shooting position determined by the camera ground height H, the shooting direction determined by the camera vertical tilt δ, and the shooting image determined by the camera vertical angle of view φ. It is determined by the angle. First, the horizontal distance (traveling vehicle) in real space between the shooting position of the camera and the screen lower edge position B indicating the lower edge of the virtual screen DP (in the example shown, coincides with the point B on the travel path R). Is the underline distance Ld on the screen.
Ld = Htanθ (1)
It turns out that it becomes. Here, if the camera vertical angle of view φ is equiangular up and down with respect to the shooting direction (direction along the dashed line in the figure), θ = 90 ° −φ / 2−δ. However, in this case, the camera inclination angle δ is positive from the horizontal to the downward angle as shown in the figure.

  First, assuming that the video baseline C coincides with the screen lower edge position B as shown by the solid line in the figure, in this case, the screen lower edge position B is the origin position on the reproduced video. Is the origin position on the virtual screen DP corresponding to. In the illustrated example, a virtual screen DP in which the lower edge position of the screen is on the travel path R is assumed. Therefore, the origin position B also coincides with the origin point on the travel path R. Further, the position of the distance line A on the virtual screen DP determined by the camera ground height H, the camera vertical tilt δ, and the camera vertical angle of view φ is determined by an interval Xa with the screen lower edge position B. At this time, a point on the travel route R corresponding to the position of the distance line A on the virtual screen DP is set as a reference point Bs. Here, the following description will be made on the assumption that a position reference including a scale condition is set, in which the reference point Bs is located in front of the origin point B by a reference distance Ls. In the present embodiment, as described later, the position reference is based on road surface display such as a white line, a speed display, and a rhombus mark drawn on the road R while watching the road R displayed in the reproduced image. As described above, the distance line A can be set (reference instruction operation) by disposing it at the reference point Bs separated from the origin point B on the travel path R corresponding to the screen lower edge position B by the reference distance Ls.

First, as shown in FIG. 41A, the intersection of the line of sight of the distance line A (shown dotted line) and the perpendicular passing through the screen lower edge position B is K, and the height of the intersection K is h. In this case, the following formula (2) is established.
h = H · Ls / (Ld + Ls) (2)
Further, assuming that the intersection angle between the perpendicular and the virtual screen DP is the same as the camera tilt angle δ, the following expression (3) is established.
h−Xacosδ = H · Xasinδ / (Ld + Ls) (3)
Here, since h = Xacosδ + (h−Xacosδ), the following formula (4) is established by substituting the above formula (3).
h = Xacosδ + H · Xasinδ / (Ld + Ls) (4)
From the above formula (2) and the above formula (4), the following formula (5) is obtained.
H · Ls / (Ld + Ls) = Xacosδ + H · Xasinδ / (Ld + Ls) (5)
When the interval Xa on the virtual screen DP is obtained from this equation (5), the following equation (6) is obtained.
Xa = H · Ls / [(Ld + Ls) cosδ + Hsinδ] (6)

However, the playback video that is actually displayed in the video playback display area g12 is the virtual screen DP reduced at a constant scale S, so that the lower edge of the display position of the distance line A on the playback video ( The distance xa from the screen lower edge position B) is expressed by the following equation (7).
xa = H · Ls · S / [(Ld + Ls) cosδ + Hsinδ] (7)
Note that the scale S is obtained by actually measuring the display interval xa on the reproduced video, and based on the camera ground height H, the camera vertical tilt δ, and the camera vertical angle of view φ of the imaging conditions, the screen underline distance from the equation (1). By obtaining Ld and further using the reference distance Ls, an unknown scale factor S can be obtained. The scale S is defined by the following equation (8).
S = xa / Xa = xa [(Ld + Ls) cosδ + Hsinδ] / H · Ls (8)

Next, a method for obtaining the display position of the distance line P on the reproduced video will be described. The distance line P is a position index indicating a display position corresponding to a point Bp on another travel path R other than the control point Bs on the travel path R corresponding to the display position of the distance line A. Assuming that the distance between the point Bp on the travel route R corresponding to the distance line P and the origin point B is Lp, the virtual screen DP between the display position P of the distance line and the screen lower edge position (origin position) B The upper interval Xp is as shown in FIG. 41A, and the display interval xp = Xp · S on the reproduced video is obtained by substituting the distance Lp in place of the reference distance Ls in the above equation (7). Similar to (8), it is represented by the following formula (9).
xp = H · Lp · S / [(Ld + Lp) cosδ + Hsinδ] (9)
Here, S is obtained by the equation (8), the screen underline distance Ld is obtained by the equation (1), and the camera ground height H and the camera vertical inclination δ are used to obtain an arbitrary distance. The display interval xp corresponding to Lp can be obtained.

On the other hand, as shown in FIG. 41 (b), the distance from the origin point B corresponding to the display position of the video baseline C to the point Bq that arrives after time t is Lq, and the speed of the traveling vehicle If v is v, the distance between the two points is represented by Lq = v · t. At this time, the timeline Q at time t, which is a position index, indicates the display position on the reproduced video corresponding to the point Bq. Here, the display interval xq on the playback video of the timeline Q corresponding to the position on the virtual screen DP corresponding to the point Bq (interval Xq with respect to the lower edge position B of the screen) is the following, similarly to the above equation (9): (10)
xq = H · Lq · S / [(Ld + Lq) cos δ + Hsin δ] (10)
Therefore, since the distance Lq is obtained by setting the time t, the display interval xq of the timeline Q corresponding to the point Lq can be obtained from the equation (10) in the same manner as described above.

Each of the above equations is established when θ is determined as described above by the camera vertical tilt δ and the camera vertical angle of view φ, and the screen underline distance Ld is determined by the above equation (1) by θ and the camera ground height H. . At this time, the video baseline C is set to the lower edge position of the reproduced video (the lower edge position of the screen or the origin position B in the figure) as described above (interval Xc = 0). However, when the video baseline C is arranged above the lower edge position of the reproduced video as shown in FIG. 40, the interval Xc is not 0 as shown by a white circle C in FIG. As indicated by the chain line, the substantial lower edge position B ′ of the screen is arranged forward by ΔL from the origin point B corresponding to the origin position. The screen underline distance Ld ′ in this case is expressed by the following equation (11) using the underline increase distance ΔL.
Ld ′ = Ld + ΔL = H tan θ ′ = H tan (θ + Δθ) (11)
Here, Δθ is expressed by the following equation (12) when the camera vertical tilt δ does not change and the amount of change in the camera vertical angle of view φ is −Δφ.
Δθ = − (φ′−φ) / 2 = − [(φ−Δφ) −φ] / 2 = Δφ / 2 (12)
That is, when the video baseline C is moved upward, as the upward movement amount increases, the camera vertical field angle φ (shooting field angle) decreases (−Δφ), and θ increases correspondingly (+ Δθ = + Δ / 2), the screen underline distance Ld increases on the contrary (+ ΔL).

  On the other hand, since the reference distance Ls does not change from the above, the reference point Bs also moves forward by ΔL to become the reference point Bs ′, and the point Bp also moves forward by ΔL to become the point Bp ′. Accordingly, the position on the virtual screen DP of the distance line A indicated in accordance with the reference point Bs is the point A ′ (on the virtual screen DP corresponding to the reference point Bs ′ (see FIG. 41A). Accordingly, the position of the distance line P corresponding to the point Bp ′ on the virtual screen DP also becomes P ′ (white circle in the figure).

  In this case, when setting the scale condition, if the position of the video baseline C on the virtual screen DP is close to the screen lower edge position B, there is almost no problem even if the camera vertical angle of view is left as described above. Absent. However, if the video baseline C moves away from the screen lower edge position B to some extent as shown in the figure, the amount of change (decrease) −Δφ in the camera vertical angle of view φ increases and + ΔL also increases. The display position xp of the distance line P obtained by Expression (9) does not match the point on the travel path R shown in the reproduced video. This is because the interval Xp on the virtual screen DP is obtained with the camera vertical angle of view φ as it is according to the above equation (6), although the shooting angle of view is substantially narrowed (the screen underline distance Ld is increased). Because Ld remains small, the distance Xp indicating the position of the distance line that should be at the position P ′ on the virtual screen DP further increases, and the distance line P moves further upward. At this time, as will be described later, the distance line P is adjusted by adjusting the camera vertical angle of view φ while viewing the reproduced video (decreasing the camera vertical angle of view φ in accordance with the amount of movement of the video baseline C). An appropriate camera vertical angle of view may be adjusted so that it matches the display position of the point on the travel path R that appears in the reproduced video. In this case, theoretically, the camera vertical angle of view should coincide with φ ′, but the camera vertical angle of view is not necessarily φ ′. This is because the display position of the distance line P does not always coincide with the corresponding point Bp on the traveling path R even if the camera vertical angle of view is set to φ ′ due to errors in other shooting conditions, lens characteristics, and the like. It is. For this reason, it is meaningful to adjust the vertical angle of view of the camera while viewing the reproduced video as described above.

  Next, a method for setting the distance line A will be described with reference to FIG. Here, the reproduced video shown in the figure is an example of a reproduced video having no blind spot below, such as a transport truck. For this reason, the moving operation of the video baseline C is unnecessary, and the origin position Xc = 0. Then, by operating the reproduction operation input unit g12s in the upper left diagram of FIG. 42, the base end (the end on the near side) of the white line (length is 5 [m]) at the center of the road surface of the traveling road R shown in the reproduction image. Is set to the lower edge position of the reproduced video (in the example shown, it matches the origin position of the video baseline C). Thereafter, the distance line A is moved, and the distance line A is aligned with the tip (distant end) of the white line, thereby specifying the reference position A and the distance Xa between the origin position B and the reference position A. (Reference instruction operation). However, the actual operation content in this case is only an instruction operation for the reference position A, and default values are used for the origin position B = C and the reference distance Ls. Here, if the default value of the reference distance Ls is set to 5 m, Xa−Xc = Xa = 5 m. In this case, the scale condition in the traveling direction with the interval Xa = 5 m is set by the position reference setting means P1i. Will be set.

  On the other hand, in this example, the camera ground height H, the camera vertical tilt δ, and the camera vertical angle of view φ are set as predetermined values. For this reason, when the scale condition is set, the position reference of the reproduced video is determined based on the scale condition and the predetermined shooting condition. Further, when a predetermined operation, for example, a right double click or the like is performed by indicating the display position of the distance line A, the position reference display means P1j causes the position reference and the arrangement of the position indexes among the index display conditions. Based on the mode (which is also set to a default value), the display interval xa of the distance line A and the display interval xc of the video baseline C are measured, and the display position xp of the distance line P as a position index is calculated. Is done. Thus, as shown in the upper right diagram of FIG. 42, as the position index, the distance L which is the display value of the distance display is 9 distances of 0 m, 1 m, 2 m, 3 m, 4 m, 5 m, 10 m, 15 m and 20 m. Lines A and P are displayed on the reproduced video in accordance with the display mode of the position index among the index display conditions (in the form of a horizontal line with the distance display). The distance display associated with the distance line indicates the value of the distance L from the origin point B at the position of the reference point Bs and the point Bp on the travel route R corresponding to the display intervals xa and xp of the distance lines A and P. Yes.

  In the playback image of the illustrated example, a white line of 5 m is shown ahead with a white line having a length of 5 m arranged at the foremost side, and a white line of 5 m is shown further ahead, so from the origin point B corresponding to the origin position It is possible to confirm the display position on the reproduced video corresponding to a point 10 m or 15 m away. In the case of the upper right diagram in FIG. 42, the display position of the distance line P corresponding to a point that is separated from the origin point B by 10 m or more does not coincide with the white line and the interval on the playback image (the length and interval of the white line are both 5 m). You can see that This is because the above shooting conditions do not correctly reflect the shooting state of the actual video data of the playback video. Therefore, as shown in the lower right diagram of FIG. 42, the condition setting dialog DA is called, and the distance scale setting tab DA2 is changed to change any of the camera ground height H, the camera vertical inclination δ, and the camera vertical angle of view φ. The shooting condition is corrected by adjusting at least one of the position, shooting direction, and shooting angle of view. However, in this example, since the video base line C is not moved (the video base line C is at the origin position B), the above-described camera vertical view angle φ and screen underline distance Ld do not change. It is not necessary to make significant adjustments (reductions) in the camera vertical angle of view φ, and generally, if the shooting conditions are not so different, the camera ground height H, camera vertical tilt δ, It is sufficient to finely adjust any of the angles φ as appropriate. Here, since the positions of the distance lines A and P change in real time by this adjustment operation, as shown in the lower left diagram of FIG. 42, all the distance lines A and P are aligned with the display positions corresponding to the white lines on the reproduced video. Make adjustments until

  FIG. 43A shows a case where the playback video displayed in the video playback display area g12 is two screens. In this case, for example, a vehicle exterior image in front of the traveling direction is displayed on the left side of the reproduced image, and the traveling road is reflected in the vehicle exterior image. On the right side of the reproduced image, an in-vehicle image of the traveling vehicle is displayed. In this case, in order to display both videos side by side in the video playback display area g12, the vertical width of the playback video is smaller than the vertical width of the video playback display area g12. For this reason, the video base line C is moved upward in the figure and matched with the lower edge position of the left image in the figure, thereby setting the lower edge position of the outside image on the left side in the figure as the origin position. In this way, the distance line P can be displayed by instructing the display position of the distance line A as described above.

  FIG. 43B shows a case where the playback video displayed in the video playback display area g12 is four screens. In this case, for example, a vehicle exterior image in front of the traveling direction is displayed in the upper left of the reproduced image, a vehicle exterior image captured in the right side of the vehicle body is displayed in the upper right of the reproduced image, and the image in the lower left of the reproduced image is displayed. Shows a vehicle exterior image captured in the rear side of the traveling direction photographed on the right side of the vehicle body, and a vehicle exterior image rearward in the traveling direction is displayed in the lower right of the reproduced image. All of these images outside the vehicle show the road. Here, for example, the video baseline C is moved upward in the figure to match the lower edge position of the outside image in the upper left of the figure (and the upper right of the figure). In this way, the designation and display of the distance line A and the display of the distance line P can be performed with the lower edge position of the image outside the vehicle in the upper left (and upper right in the figure) as the origin position.

  Note that in both cases of the two screens and the four screens, since the lower edge of the reproduced video in which the traveling path is reflected is above the lower edge of the video reproduction display area g12, the position of the video baseline C is set to the position of the reproduced video. Setting the lower edge simply means setting the lower edge of the reproduced video to the origin position B. In this case, since the lower edge of the reproduced video is set to the origin position B, the display position of the position index reflecting the original camera vertical angle of view φ can be obtained. However, the scale S obtained by measuring the display positions xa and xc is smaller than that in the case of a single screen. Even when the lower edge of the reproduced image is above the lower edge of the image reproduction display area g12 in this way, the field of view outside the vehicle is hidden by a part of the vehicle near the lower edge of the external image in front of the actual traveling direction. In the same manner as in FIG. 40, the video baseline C can be moved further upward than the lower edge position of each video to match the lower limit of the range in which the field of view outside the vehicle is displayed. However, in this case, since the origin position indicated by the video baseline C is higher than the lower edge of the reproduced video, it is necessary to adjust the camera vertical angle of view φ as described above.

  44 and 45 show a distance line setting method when there is a blind spot on the lower side of the reproduced video. 44 shows a case of a passenger car, and FIG. 45 shows a case of a transport truck. In FIG. 44, as shown in the upper left diagram, the video baseline C is moved above the reproduced video and is arranged at the tip of the bonnet. In the case of a normal vehicle, the front end of the vehicle body is about 2 m ahead of the camera position, and the screen underline distance Ld (dead angle) corresponding to the front end of the vehicle body is about 5 m. When the vehicle is on the baseline C, the inter-vehicle distance is about 3 m. Thus, as the blind spot range is larger, the amount of upward movement of the video base line C is larger, so the above-mentioned screen underline distance Ld ′ is increased underline increase distance + ΔL.

  At this time, if the dimension (length) in the traveling direction of the speed display of 50 km shown on the road surface of the traveling road reflected in the outside image is known, the base end (front end) of the speed display is determined. The playback video is sent and returned to match the video baseline C. Thereafter, the distance line A is moved downward in the reproduced video and is aligned with the tip (distant end) of the speed display. Thus, the distance line A is a reference position on the reproduced image corresponding to the reference point Bs that is separated from the origin point B on the road corresponding to the origin position indicated by the video base line C by the speed display length. Will be placed. If the speed display length matches the reference distance, the scale condition of the reproduced video is correctly set.

  However, as described with reference to FIG. 41, in this case shown in FIG. 44 as well, since the video baseline C is moved to a position higher than the lower edge of the playback video, φ And the difference between φ ′ and −Δφ, the consistency between the display position of the distance line P and the position of the point on the travel path R is lost. For example, as the display position of the distance line P corresponding to the point Bp on the road R where the distance Lp from the origin point B is large, the deviation from the point on the road shown in the reproduced video corresponding thereto becomes more conspicuous. Therefore, the condition setting dialog DA is called as shown in the upper right diagram of FIG. 44, and the camera vertical view angle φ is adjusted to be smaller (−Δφ) than the original playback video shooting angle in the distance scale setting tab DA2. By doing so, the distance display of the distance line P can be matched with the reproduced video as shown in the lower diagram of FIG.

  Next, also in the case of FIG. 45, since the dashboard is shown near the lower edge of the reproduced video as shown in the upper left diagram, the video baseline C is aligned with the tip of the dashboard. Further, when the distance line A is arranged in accordance with the white line on the traveling road and a predetermined operation is performed, the distance line P is displayed as shown in the upper right diagram. In this case, the display position of the distance line P is not so bad in consistency with the corresponding point on the traveling road, and has consistency with the corresponding point up to the distance line P of 10 m. However, the display position of the distance line P of 15m and 20m ahead is shifted from the corresponding point. Therefore, the condition setting dialog DA shown in the lower right diagram is called to lower the camera vertical angle of view φ in the distance scale setting tab DA2, and the display positions of all the distance lines P are displayed at the corresponding points on the road as shown in the lower left diagram. Adjust until it matches the display position.

  FIG. 46 shows a case where a rhombus mark drawn on the road surface of the traveling road is used. In this case, as shown in the upper left diagram, the base line (front edge) of the rhombus mark is aligned with the lower edge (or video base line C) of the reproduced image, and the distance line A is then displayed on the rhombus mark. Arrange it according to the tip (far edge). Thereafter, when the distance line P is displayed by a predetermined operation, the upper right view is obtained. At this time, in order to confirm the consistency of the distance line P, as a different method from the above, the reproduced image is returned by frame advance, and as shown in the left middle diagram, the rhombus marks are located on the far side of the reproduced image. It is moved to (upward position on the reproduced image), and in this state, the base end or tip end of the rhombus mark is aligned with any distance line P. Then, on this screen, it is possible to confirm the consistency of the display interval between the distance lines (in the example shown, the distance line A of 5 m and the distance line P of 10 m) corresponding to the base end and the tip end of the rhombus mark. At this time, if the consistency is not sufficient, the distance line is aligned with the road surface display in the playback video of the left middle figure while operating the distance scale setting tab DA2 of the condition setting dialog DA as shown in the middle right figure. Let Further, the same procedure as described above is further repeated, and as shown in the lowermost figure, the display interval of another distance line and the consistency of the display distance between the distance lines P of 10 m and 15 m can be confirmed. When the display positions of the distance lines are not matched, the shooting conditions for the camera ground height H, the camera vertical tilt δ, and the camera vertical angle of view φ may be adjusted as appropriate as described above. Also, in the above method, the playback time point of the playback video is returned to move the display position of the same road surface display to a distant point, but another road surface display having the same dimensions is arranged in front. If so, the playback time point of the playback video may be advanced.

  FIG. 47 shows a display mode of the operation setting tab DA1 in the condition setting dialog DA. The operation setting tab DA1 includes communication setting items for specifying communication conditions for cooperation with map data and GPS data prepared outside the computer, presence / absence of voice output at the time of starting the program, range of used functions, operation Setting items relating to aspects and the like are provided.

  FIG. 48 shows a display mode of the distance scale setting tab DA2 in the condition setting dialog DA. This distance scale setting tab DA2 is provided with a shooting condition setting section DA2a for setting shooting conditions such as a shooting position, a shooting direction, and a shooting angle of view, such as the camera ground height H, the camera vertical tilt δ, and the camera vertical angle of view φ. . The camera underline distance shown corresponds to the screen underline distance Ld, and is automatically calculated from the other imaging conditions.

  Further, the distance scale setting tab DA2 is provided with a display distance designating part DA2b for designating a display distance measured from the origin point of the point on the travel path corresponding to the display position of the distance line P as an arrangement mode of the position index. . A distance line P is arranged at a display position on the reproduced video corresponding to the display distance specified here, and a distance display indicating the numerical value of the display distance is attached to the distance line P. In the illustrated example, the 0 m and 5 m distance lines do not need to be specified, and the 0 m distance line P is automatically displayed. Further, the distance line A of 5 m corresponds to the reference distance Ls = 5 m, and is a default value that does not need to be specified in the illustrated example. However, the reference distance Ls may be set arbitrarily.

  FIG. 49 shows a display mode of the time scale setting tab DA3 in the condition setting dialog DA. The time scale setting tab DA3 is provided with a display time designating section DA3a for designating the display time of the timeline Q as an arrangement mode of the position index. A timeline Q is arranged at a display position on the reproduced video corresponding to the display time designated here, and this timeline Q is accompanied by a time display indicating the numerical value of the display time.

  50 (a) and 50 (b) show the position of the distance line P or timeline Q on the virtual screen DP and the points on the travel path when the underline increasing distance Lc corresponding to the moving amount of the video baseline C is taken into consideration. It is explanatory drawing which shows the relationship with a position. As illustrated, when the underline increase distance Lc corresponding to the display position of the video baseline C is taken into consideration, the substantial screen underline distance is Ld + Lc. In the present embodiment, the position on the virtual screen DP corresponding to the screen underline distance Ld + Lc is the origin position C, and there is an illustrated interval Xc between the origin position C and the screen lower edge position B on the virtual screen DP. The origin point Bc corresponding to the origin position C is ahead of the screen lower edge position B by the distance Lc, and the reference distance Ls and the display distance Lp are set starting from the origin point Bc, and the reference point Bs and the point Bp are set. The position of is determined.

In this case, the following equation (13) corresponding to the above equation (6) is established.
Xa = H (Lc + Ls) / [(Ld + Lc + Ls) cosδ + Hsinδ] (13)
Further, when the interval Xc on the virtual screen DP is obtained in the same manner as the equation (13), the following equation (14) is obtained.
Xc = H · Lc / [(Ld + Lc) cosδ + Hsinδ] (14)
When the scale S shown in the following equation (15) is used, the display position xp of the distance line P and the display position xq of the time line Q are expressed by the following equations (16) and (17).
S = (xa−xc) / (Xa−Xc) (15)
xp = H (Lc + Lp) S / [(Ld + Lc + Lp) cosδ + Hsinδ] (16)
xq = H (Lc + Lq) S / [(Ld + Lc + Lq) cosδ + Hsinδ] (17)
Here, Ld can be obtained from the above equation (1). The underline increase distance Lc and the scale factor S, which are unknown numbers, are obtained by measuring the display position xa of the distance line A and the display position xc of the video baseline C. , Can be obtained using the above equations (13) to (15). Then, the display position xp of the distance line P and the display position xq of the time line Q can be calculated by the above formulas (16) and (17) using Lc and S obtained as described above.

  In this case, in addition to the camera ground height H, the camera vertical tilt δ, the camera vertical angle of view φ, and the screen underline distance Ld, which are shooting conditions, the underline increase distance Lc determined by the set position of the video baseline C is taken into consideration. Therefore, theoretically, no adjustment work should be necessary if the shooting conditions are correct for the actual camera regardless of the setting position of the video baseline C. However, since the actual camera situation does not necessarily exactly match the above shooting conditions and is also affected by the lens characteristics, in order to match the display positions of all the distance lines P on the reproduced video, It is preferable to perform an operation for adjusting any of the photographing conditions in the same manner as described above.

  The traveling image display program and the traveling image display system according to the present invention are not limited to the illustrated examples described above, and can be variously modified without departing from the scope of the present invention. . For example, when the clip information generation program P1 processes the acquisition information MB to generate the clip information CL, the clip information generation program P1 displays the reproduction video based on the video data Mb1 included in the acquisition information MB, and It is equivalent to a traveling video display program that sets a position reference and displays a position index indicating a display position on a reproduced video in an overlapping manner, and if it has a configuration corresponding to the present invention like these, Various modifications can be made to the clip information generation program P1. In addition, when the operation status report program P2 performs a process of adding a comment or the like to the clip information CL, the operation status report program P2 displays a playback video based on the video data included in the clip information CL, and then performs a position reference for the playback video. Is equivalent to a traveling video display program that displays a position index indicating the display position on the playback video, and if the vehicle has a configuration corresponding to the present invention as described above, the operation Various modifications can be made to the status report program P2.

DESCRIPTION OF SYMBOLS 1 ... Drive recorder, 2 ... Acquisition information processing apparatus, 3 ... Operation condition display apparatus, P1 ... Clip information production | generation program, P2 ... Operation condition report program, G1, G2, G3 ... Display screen, g11 ... Input file designation | designated area | region, g11a ... input folder designation section, g11b ... input file display section, g11c ... output folder designation section, g11d ... input folder designation dialog, g11e ... output folder designation dialog, g12 ... video playback display area, g12s ... playback operation input section, g12t ... Continuous playback button, g12a ... volume adjustment operation part, g12q ... playback speed setting part, g12x ... video scaling activation operation part, g13 ... playback file information display area, g13a ... file information display part, g13b ... playback information display part, g14 ... Travel change display area, g14p ... speed value display section, 14n: reproduction position indication line, g14s: start position indication line, g14f: end position indication line, g14ch: check information marker, g15: traveling change display setting unit, g15a: time display setting unit, g15b: speed display setting unit, g15c ... display mode setting part, g16 ... clip information setting area, g16a ... indicator display setting part, g16b ... clip period width setting part, g16c ... clip period setting display part, g16d ... clip travel distance display part, g16e ... preview button, g16f G16g ... clip information output button, g16h ... clip output dialog, g16i ... output folder designation dialog, g17 ... check information operation input section, g17a ... check information registration icon, g17b ... check information expansion list, g17c ... check information registration button, g1 d ... Check information search button, g17e ... Clip batch registration button, g17f ... Check information output button, g17g ... Check information input button, g18 ... OPTION button, g18a ... Setting list, g21 ... Operation menu, g21a ... File operation input section, g21b: Setting operation input unit, g21c: Environment setting dialog, g21d: Route specifying unit, g21e ... Internal management DB specifying unit, g21f ... Import menu, g21g ... Reconfiguration menu, g21h ... Input dialog, g21i ... Input folder specifying unit, g21j: Input folder display section, g21k: DB folder designation section, g21l: DB folder display section, g21m: File display section, g21n: Import button, g21o: Confirmation display dialog, g21p: Reconstruct button, g22: Operation settings Fixed display section, g22a ... running month display section, g22b ... input folder display section, g22c ... running month operation section, g22d ... data search button, g23 ... database display area, g23a ... list output button, g31 ... video list, g32 ... Video playback display area, g32s ... playback operation input section, s33 ... determination information display section, g34 ... travel change display area, g35 ... comment input section, g36 ... GPS data display section, g37 ... setting menu button, g38 ... individual output button , G39 ... save dialog, g40 ... map display section, g41 ... map display area, g42 ... standard marker, g43 ... distance radar button, g44 ... distance marker, A, P ... distance line, C ... video baseline, Q ... time Line, H ... Camera ground height, δ ... Camera vertical tilt, φ ... Camera vertical angle, DP ... Virtual screen , B ... lower edge position (origin position, origin point), DA ... condition setting dialog, DA2 ... distance scale setting tab DA2, DA3 ... time scale setting tab, C ... origin point, Bs ... control point, Bp ... Point, Ld: Underline distance on screen, Lc (ΔL): Underline increase distance, Lp: Distance, P1i: Position reference setting means, P1j: Position indicator display means, R: Traveling path

Claims (11)

Using a computer, a program for displaying a playback video corresponding to video data including at least a part of a video of a travel path outside the travel vehicle derived from acquired information acquired in the travel vehicle,
Computer
Video playback display means for forming a video playback display area for displaying the playback video based on the video data and for controlling a display state of the playback video according to a video playback operation;
In response to a reference instruction operation that directly or indirectly indicates at least a display position and a display interval on the playback video, the position of the spot on the travel path reflected on the playback video and the distance between the points are reflected. Position reference setting means for setting a position reference for determining the display position and display interval on the reproduced video;
And
Position index display means for displaying a position index at a display position on the reproduced video reflecting the position of the point and the distance between the plurality of points based on the position reference;
Driving video display program to function as.   The position reference reflects the position of the point in the traveling direction of the traveling vehicle and the distance between the plurality of points in the traveling direction, and the display position and display interval of the direction on the playback image corresponding to the traveling direction. The traveling image display program according to claim 1, wherein the position index is displayed at a specific display position in a direction on the reproduced image corresponding to the traveling direction.   The position reference is a relationship between the specific display position and the specific display interval on the reproduced video, and the corresponding position of the specific point on the travel path and the distance between the specific points. 3. The traveling video display program according to claim 1, further comprising a scale condition that defines a shooting condition, and a shooting condition that defines a shooting position, a shooting direction, and a shooting angle of view of the video data.   The scale condition includes an origin position specified by the reference instruction operation or specified in advance as a predetermined position, and a specific distance specified by the reference instruction operation or specified as a predetermined value in advance. 4. The traveling image display program according to claim 3, further comprising a reference distance to be indicated and a reference position designated by the reference instruction operation.   The position index display means is the reproduction that is obtained under a condition that a distance between an origin point on the travel path corresponding to the origin position and a reference point on the travel path corresponding to the reference position matches the reference distance. 5. The traveling image display program according to claim 4, wherein the position index is displayed at a display position on the image.   The position index display means obtains a display position on the reproduced video other than the origin position and the reference position under a condition that a distance between the origin point and the reference point matches the reference distance, and the display position The travel image display program according to claim 4, wherein the position index is displayed at the origin position and the reference position.   The position index display means is configured to display the position index according to an index display condition indicating the arrangement mode of the position index and the display mode, and at least one of the arrangement mode and the display mode can be set. The traveling image display program according to any one of claims 1 to 6, wherein:   The position index is the reproduction from the origin point on the travel path corresponding to the origin position on the playback image included in the position reference to the specific point on the travel path corresponding to the specific display position of the position index. The travel image display program according to any one of claims 1 to 7, further comprising a distance display indicating a distance on the image.   The travel indicator is located at a specific point on the travel path corresponding to a specific display position of the position index from an origin point on the travel path corresponding to the origin position on the playback image included in the position reference. The traveling image display program according to any one of claims 1 to 7, further comprising a time display indicating a time required for the vehicle to reach the vehicle according to a traveling speed of the traveling vehicle. Computer
Forming a travel change display area that graphically displays a time change of the travel mode of the traveling vehicle based on travel data derived from the acquired information and indicating the travel mode of the traveling vehicle corresponding to the video data. Travel change display means for indicating a position on the travel change display area corresponding to the reproduction time of the data;
The travel image display program according to any one of claims 1 to 9, further functioning as: A system for displaying a playback video corresponding to video data including at least a part of a video of a travel path outside the travel vehicle derived from acquired information acquired in the travel vehicle,
Video data fetching means for fetching the video data in response to an information fetching operation;
Video playback display means for forming a video playback display area for displaying the playback video based on the captured video data, and for controlling a display state of the playback video according to a video playback operation;
In response to a reference instruction operation that directly or indirectly indicates at least a display position and a display interval on the playback video, the position of the spot on the travel path reflected on the playback video and the distance between the points are reflected. Position reference setting means for setting a position reference for determining the display position and display interval on the reproduced video;
And
Position index display means for displaying a position index at a display position on the reproduced video reflecting the position of the point and the distance between the plurality of points based on the position reference;
A traveling video display system comprising: