JP2016167771A - Digest video generation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a drive video generation device for generating reproduction data from which a user easily recognizes information related to traveling of a vehicle in digest video.SOLUTION: A driving scene discretization unit 106 divides a trip into a plurality of driving scenes on the basis of driving behavior data showing a driving situation of a vehicle; a speed tempo setting unit 108 sets reproduction speed of a video section corresponding to each driving scene from duration of the driving scene. A drive video summary unit 111, then, generates digest video obtained by summarizing the drive video on the basis of the reproduction speed set by the speed tempo setting unit 108 for each driving scene. A BGM generation unit 109 generates BGM whose tempo varies depending on the vehicle's traveling speed in each scene in the digest video; a reproduction data generation unit generates reproduction data obtained by adding the BGM to the digest video.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a digest video generation device that generates a digest video that summarizes drive video shot by a camera mounted on a vehicle.

  Conventionally, enjoyment of viewing a video (taken as a drive video) of a landscape while a vehicle is running has been proposed. In addition, the drive video may be used as data recording a driving situation such as a driving operation of a driver or a behavior of a vehicle, for example, for training of driving skills. However, since the drive video is not edited as it is, it naturally includes a lot of boring scenes and scenes that are not useful for driving skill education. In addition, it is not realistic that the same time as the actual travel time is required to view the drive video.

  Therefore, Patent Document 1 proposes an apparatus that generates a digest video summarizing a drive video (hereinafter referred to as a digest video generation device) in order to grasp the contents of the drive video in a short time.

  According to the technology disclosed in Patent Document 1, vehicle information indicating a driving situation is analyzed, and a series of travels (which are referred to as trips) from the start of travel to arrival at a destination are divided into a plurality of drive scenes. Turn into. Then, a playback speed corresponding to the duration of each driving scene is set for the video section corresponding to each driving scene in the series of driving images, and the video section corresponding to each driving scene is set. A digest video is generated by editing the video so that it is played back at the playback speed.

  As a technique for discretizing trips into several driving scenes using vehicle behavior, there is a technique disclosed in Non-Patent Document 1. According to the technique disclosed in Non-Patent Document 1, a trip is divided into driving scenes based on the behavior of the vehicle and the driving operation by the driver without giving a driving scene definition in advance, and a similar driving scene is further divided into one scene. Can be integrated into groups. Further, according to Non-Patent Document 1, driving events can be extracted from vehicle behavior, additional information, and driving scene information.

JP 2014-27481 A

Takashi Bando, Kazuhito Takenaka, Shogo Nagasaka, Tadahiro Taniguchi, "Generating Contextual Description from Driving Behavioral Data," IEEE Intelligent Vehicles Symposium (IV2014), 2014

  When the digest video is generated by changing the playback speed of the drive video for each driving scene as in Patent Document 1, the digest video cannot be recognized by the user or is difficult for the user to recognize. There is information to become.

  For example, while the driving speed expresses the vehicle running speed as it is, the sense of vehicle speed felt by the user from the digest video is affected by the playback speed, so the actual running speed is not known in the digest video. In addition, information such as acceleration and deceleration is indistinguishable from that due to a change in reproduction speed accompanying switching of driving scenes.

  As one of the solutions to such a problem, various information that is difficult to recognize with the digest video itself, such as travel speed, acceleration, and deceleration, that is difficult to recognize with the digest video itself is superimposed and displayed on the digest video. A configuration (a comparative configuration) is also conceivable.

  However, such a comparison configuration increases visual information in the screen. Since the digest video is a video with a dense amount of information per time, adding a gazing point in the screen makes it more difficult to grasp the content of the digest video. For example, the user may miss an important scene in the digest video while viewing text information indicating the traveling speed.

  The present invention has been made based on this situation, and an object of the present invention is to provide a drive video generation device that generates data for reproduction that makes it easy for a user to recognize information related to vehicle travel in a digest video. It is to provide.

  In order to achieve the object, the present invention includes a video acquisition unit (101) that sequentially acquires video captured by an in-vehicle camera mounted on a vehicle, and a video storage unit (102) that stores the video acquired by the video acquisition unit. ), Vehicle information acquisition unit (103) that sequentially acquires vehicle information indicating the driving status of the vehicle from the start to the end of shooting by the in-vehicle camera, and the vehicle information collected by the vehicle information acquisition unit Based on the length of the driving scene, a scene dividing unit (106) that divides a trip, which is a series of traveling of the vehicle from the start to the end of shooting by the in-vehicle camera, into a plurality of driving scenes. Accordingly, a playback speed setting unit (108) for setting the playback speed of the video shot in the time zone corresponding to the driving scene, and the playback speed for each driving scene set by the playback speed setting unit. And a drive video summarizing unit (111) for generating a digest video that is a video summarizing the video stored in the video storage unit, and information related to driving of the vehicle in each scene of the digest video. A transmission data generation unit (109) that generates transmission data, which is data for transmitting certain traveling-related information to the user via the user's auditory or tactile sense, and the digest video generated by the drive video summarization unit. A reproduction data generation unit (112) configured to generate the transmission data generated by the transmission data generation unit and the added reproduction data.

  In the above configuration, the scene dividing unit divides the trip into a plurality of driving scenes based on the vehicle information, and the reproduction speed setting unit sets the reproduction speed for each driving scene. Then, the drive video summarization unit generates a digest video that is a video summarizing the video (that is, drive video) taken by the in-vehicle camera during the trip based on the playback speed for each driving scene set by the playback speed setting unit. To do.

  The transmission data generation unit generates transmission data for transmitting travel-related information in each scene of the digest video via the user's auditory or tactile sense, and the reproduction data generation unit transmits the digest video to the digest video. Data for reproduction with data added is generated.

  If the playback data generated by the above configuration is played back, the digest video is played back, and the information related to the running of the vehicle corresponding to the scene being played back by the transmission data is audio information or tactile information. Expressed. Therefore, the user can recognize information related to the traveling of the vehicle in the scene being reproduced through the auditory sense or the tactile sense together with the digest video.

  The transmission data corresponds to, for example, BGM data added to the digest video, data that instructs the vibrator to vibrate at a predetermined vibration pattern and at a predetermined timing, and the like. If BGM data is adopted as transmission data, for example, the tempo of BGM or the type of music used as BGM is changed according to the travel-related information (for example, travel speed), so that the travel-related in each scene of the digest video Information can be communicated to the user.

  In the above configuration, information related to vehicle travel is expressed by a medium that uses the user's sense of hearing and touch, so that the visual information in the screen on which the digest video is displayed does not increase. That is, since the gazing point does not increase in the screen, it is easier to recognize information related to traveling of the vehicle corresponding to the digest video.

  In addition, the code | symbol in the parenthesis described in the claim shows the correspondence with the specific means as described in embodiment mentioned later as one aspect, Comprising: The technical scope of this invention is limited is not.

1 is a block diagram schematically showing a configuration of a system including a digest video generation device 100. FIG. 2 is a block diagram illustrating a schematic configuration of a digest video generation apparatus 100. FIG. It is a figure for demonstrating the action | operation of the driving scene discretization part. It is a figure for demonstrating the relationship between the event which the event extraction part 107 extracts, and a scene group. It is a flowchart showing the processing content which the speed tempo setting part implements. It is a figure for demonstrating the relationship between the continuation time of a driving scene, and the reproduction speed. It is a figure showing the relationship between the switching point of a scene group and BGM tempo. It is a figure showing an example of the data for determining the range of the tempo of the part corresponding to the scene group in BGM from the average vehicle speed of a scene group. It is a figure for demonstrating the relationship between the tempo of BGM and a scene group. It is a figure for demonstrating the action | operation of the BGM production | generation part 109. FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. First, the configuration of a system including the digest video generation apparatus 100 according to the present embodiment will be described with reference to FIG. As shown in FIG. 1, the digest video generation device 100 is connected to an in-vehicle camera 20, an in-vehicle sensor 30, a navigation ECU 40, a display 50, a speaker 60, a vibrator 70, and the like via a vehicle network 10.

  The in-vehicle camera 20 is a camera provided in the vicinity of a front bumper, a room mirror in the vehicle interior, the upper end of the windshield, or the like so as to photograph the front of the vehicle. Video signals captured by the in-vehicle camera 20 are sequentially output to the digest video generation device 100. This in-vehicle camera 20 corresponds to an example of a video photographing device described in the claims. The in-vehicle sensor 30 is a sensor that is mounted on the vehicle and detects information related to the driving operation by the driver and information related to the behavior of the vehicle that appears as a result of the driving operation.

  In FIG. 1, as an in-vehicle sensor 30, an accelerator sensor 31 that detects the amount of depression of the accelerator pedal, a brake sensor 32 that detects the amount of depression of the brake pedal or a brake pressure generated by the master cylinder, and steering that detects the steering angle of the steering wheel. The angle sensor 33 is illustrated. Of course, the sensor corresponding to the in-vehicle sensor 30 is not limited to the sensor described above. For example, a position sensor that detects the shift position of the transmission, a yaw rate sensor that detects the yaw rate acting on the vehicle, a tilt sensor that detects the tilt angle of the vehicle body with respect to a horizontal plane, a winker switch for operating a turn indicator (blinker), etc. Corresponds to the in-vehicle sensor 30.

  The navigation ECU 40 is an electronic control unit (ECU: Electronic Control Unit) having the same function (a navigation function) as a known navigation device. The navigation ECU 40 provides the digest video generation device 100 with information indicating the current position, destination information set by the user, information on the travel route, information about facilities existing around the vehicle (referred to as ambient environment information), and the like.

  The display 50 displays an image (including text) based on an instruction from the digest video reproduction device 200. The display 50 may be a display mounted on a vehicle or a mobile terminal display. The display 50 may be a head-up display.

  The speaker 60 outputs sound (including simple sounds and music) based on an instruction from the digest video reproduction device 200. The vibrator 70 is a device that generates vibration by operating a built-in motor based on an instruction from the digest video reproduction device 200. Vibrator 70 should just be provided in the part which touches a user's body, such as a steering and a sheet, for example.

  The digest video generation device 100 generates a video (referred to as a digest video) obtained by summarizing video captured by the in-vehicle camera 20 (referred to as a drive video) according to a predetermined rule. In addition, the digest video generation device 100 generates playback data in which BGM (background music) corresponding to the driving state of the vehicle represented by each scene of the digest video is added to the digest video. BGM data plays a role of supplementarily explaining the driving situation of the vehicle on each screen of the digest video. Details of the digest video generation apparatus 100 will be described later.

  The digest video reproduction device 200 displays the digest video on the display based on the reproduction data (described later) generated by the digest video generation device 100 and outputs BGM synchronized with the digest video from the speaker 60. In addition, as described in the modification, when the reproduction data includes vibration instruction data instructing to vibrate the vibrator 70 at a predetermined timing, the vibrator 70 is vibrated at the instructed timing. . In addition to the schedule information indicating the timing at which the vibrator 70 is vibrated, the vibration instruction data may define a pattern of vibration when vibrating at each timing.

[Configuration of digest video generator]
Hereinafter, the configuration of the digest video generation apparatus 100 will be described. As shown in FIG. 2, the digest video generation apparatus 100 includes a drive video acquisition unit 101, a drive video database (hereinafter referred to as drive video DB) 102, a vehicle information collection unit 103, a driving environment information collection unit 104, a driving scene database (hereinafter referred to as “drive video database”). , Driving scene DB) 105, driving scene discretization unit 106, event extraction unit 107, speed tempo setting unit 108, BGM generation unit 109, text generation unit 110, drive video summarization unit 111, and reproduction data generation unit 112. I have.

  The digest video generation apparatus 100 is realized by a microcomputer (hereinafter referred to as a microcomputer), and each unit other than the drive video DB 102 and the driving scene DB 105 is realized by a CPU (not shown) included in the microcomputer executing a predetermined program. It is. That is, FIG. 2 shows various functions realized by the CPU divided into functional blocks. However, these units do not necessarily have to be realized by software, and all or a part thereof may be realized by hardware such as a logic circuit.

  The drive video DB 102 is realized by a known rewritable storage medium, and the driving scene DB 105 is realized by a non-volatile storage medium. The function of each part will be described below.

[Drive video acquisition unit]
The drive video acquisition unit 101 sequentially acquires video signals captured by the in-vehicle camera 20, performs a predetermined encoding process, and sequentially stores them in the drive video DB 102. The drive video acquisition unit 101 corresponds to the video acquisition unit described in the claims, and the drive video DB 102 corresponds to the video storage unit described in the claims.

  Note that the sequentially stored drive video is stored in association with time information indicating the time when the drive video acquisition unit 101 acquires the video signal, in other words, time information indicating the shooting time. Hereinafter, a series of travels (including when the vehicle is stopped) of the vehicle from when shooting by the in-vehicle camera 20 is started to when shooting is ended is referred to as one trip.

[Vehicle information collection unit]
The vehicle information collection unit 103 sequentially acquires driving data representing driving operation by the driver and behavior data representing vehicle behavior appearing as a result of the driving operation from the in-vehicle sensor 30. Further, the vehicle information collection unit 103 generates differential data obtained by differentiating the driving data and behavior data.

  The vehicle information collection unit 103 collectively handles multidimensional data including driving data, behavior data, and differential data at a certain point in time as driving behavior data at that point. Further, the vehicle information collection unit 103 gives time information indicating the time when the driving behavior data is acquired to the driving behavior data, and the driving scene discretization unit 106, the event extraction unit 107, the speed tempo setting unit 108, etc. Provide to each part. The driving behavior data corresponds to the vehicle information described in the claims, and the vehicle information collection unit 103 corresponds to the vehicle information acquisition unit described in the claims.

  The driving data includes, for example, an accelerator pedal operation amount, a brake pedal operation amount, a steering wheel operation amount (steering angle), a direction indicator operation state, a transmission shift position, and a wiper operation state. be able to. Further, as the behavior data, for example, the traveling speed of the vehicle, the yaw rate, the acceleration, the inclination angle of the vehicle body with respect to the horizontal plane, and the like can be used.

  Hereinafter, the information for each type included in the driving behavior data is also referred to as an element of the driving behavior data. For example, if the driving behavior data includes the accelerator pedal operation amount, the brake pedal operation amount, and the traveling speed, the accelerator pedal operation amount, the brake pedal operation amount, and the traveling speed correspond to the elements of the driving behavior data. To do.

[Driving Environment Information Collection Department]
The travel environment information collection unit 104 sequentially acquires environment information (referred to as travel environment information) related to travel of the vehicle from the navigation ECU 40 and the in-vehicle camera 20. The traveling environment information corresponds to, for example, current position information indicating the current position of the vehicle, traveling locus information determined from the current position information, ambient environment information representing information about the environment around the vehicle, and the like.

  Ambient environment information includes the geographical information indicating the surrounding geographical information such as the facilities existing near the current position of the vehicle, the name of the road on which the vehicle is traveling, and the road type (for example, a general road or a highway). Environmental information is included.

  In addition, when the trip destination or waypoint is set in the navigation ECU 40, information indicating the destination or waypoint, guidance route information, and the like also correspond to the travel environment information. Various traveling environment information may be acquired from the navigation ECU 40, for example.

  Further, as the ambient environment information, not only information provided from the navigation ECU 40 but also information extracted by performing a known image recognition process on the video captured by the in-vehicle camera 20 can be employed. . The information extracted from the video taken by the in-vehicle camera 20 includes, for example, geographical information such as passing through an intersection with a signal, as well as preceding information obtained by recognizing a specific object (such as a vehicle or a pedestrian). This is information about the positional relationship between a vehicle such as a vehicle or a pedestrian, or a moving object (or a fixed object) that exists around the vehicle. That is, as the surrounding environment information, dynamic environment information indicating the positional relationship with other objects (vehicles or pedestrians) existing around the vehicle may be employed.

  The traveling environment information collection unit 104 adds time information indicating the acquisition time to the acquired traveling environment information and provides the event extraction unit 107 with the time information.

  Note that the traveling environment information may include information such as weather and temperature in the area. The acquisition source of various information is not limited to the navigation ECU 40 or the in-vehicle camera 20. Some or all of the various traveling environment information may be acquired from a mobile terminal such as a smartphone that is communicably connected to the digest video generation device 100, or may be input by a user.

  The drive image acquisition unit 101, the vehicle information collection unit 103, and the traveling environment information collection unit 104 described above use common (that is, synchronized) time information, and each unit sets the acquisition time in the acquired data. The time information shown is given and stored or output to another functional unit. Thus, the drive video acquired by the drive video acquisition unit 101 at a certain point in time, the driving behavior data acquired by the vehicle information collection unit 103, and the driving environment information acquired by the driving environment information collection unit 104 are associated with each other. ing.

[Driving scene DB]
The driving scene DB 105 includes a plurality of sections (driving scenes) corresponding to changes in driving conditions based on driving behavior data acquired from the vehicle information collecting unit 103 by a driving scene discretizing unit 106 described below. Data necessary for division (discretization). Data necessary to discretize a series of trips into multiple driving scenes is defined as the data that defines the probability of each driving situation or the probability of transition from one driving situation to another. Data, data indicating a plurality of driving topics for specifying what driving situation the discretized driving scene indicates.

Each driving topic is data representing a distribution pattern (referred to as a base feature distribution) of each element of driving behavior data in a typical predetermined driving situation. For example, the driving scene DB 105 stores driving topic data corresponding to starting, stopping, constant speed driving, turning in a curve, turning right and left at an intersection, changing lanes to a right lane and a left lane, and the like.
The data of each driving topic is composed of a base feature distribution defined in advance by various tests and a base tag distribution representing a distribution of a plurality of tags prepared in advance for explaining the driving scene. Details of the base feature distribution and the base tag distribution are disclosed in Non-Patent Document 1 and Japanese Patent Application Laid-Open No. 2014-235605 as a reference document, and thus description thereof is omitted here.

  Note that Patent Document 1, Non-Patent Document 1, and Reference Documents are all documents that disclose techniques related to the digest video generation apparatus 100. The patent document 1, the non-patent document 1, and the reference document will be collectively referred to as related documents hereinafter.

[Operation scene discretization unit]
The driving scene discretization unit 106 discretizes the trip into a plurality of driving scenes using the driving behavior data acquired from the vehicle information collection unit 103 and the data stored in the driving scene DB 105. Then, what kind of situation each driving scene represents is analyzed, and a plurality of continuous driving scenes showing similar situations are integrated into one group (referred to as a scene group). The driving scene discretization unit 106 corresponds to the scene division unit described in the claims.

  The details of the specific processing performed by the driving scene discretization unit 106, that is, a method of discretizing trips into a plurality of driving scenes based on driving behavior data and further integrating the driving scenes into a scene group Have already been disclosed in the above-mentioned related literature. Therefore, detailed description thereof is omitted here. The outline is as follows.

  First, the driving scene discretization unit 106 arranges the driving behavior data collected during the trip in time series as shown in FIG. 3 by using a well-known double segment analyzer (DAA). The obtained data (time series data) is segmented into a plurality of partial series. One partial series corresponds to one driving scene.

  The driving behavior column in FIG. 3 shows temporal changes of various elements included in the driving behavior data, and one arrow block shown in the driving scene column in FIG. 3 represents one driving scene. Specifically, nine driving scenes Sn1 to Sn9 are illustrated.

  In FIG. 3, for the sake of simplification of the drawing, temporal changes of four predetermined elements among the elements of the driving behavior data are illustrated. However, the elements of the driving behavior data used for setting the driving scene are illustrated. The number is not limited to four. In setting a driving scene, it is not necessary to use all elements included in driving behavior data. Here, as an example, among the elements included in the driving behavior data, the driving scene is based on the accelerator pedal operation amount, the brake pedal operation amount, the steering operation amount, the traveling speed, and the eight-dimensional data including the respective differential data. Is set.

  Next, for each driving scene, the driving scene discretization unit 106 generates a feature quantity distribution that represents the distribution of the feature quantity that appears in the driving scene, and various preset driving topics are included in the feature quantity distribution. A topic ratio representing what ratio is included is calculated. The topic ratio represents the content ratio of the base feature distribution corresponding to each driving topic with respect to the feature amount distribution generated from the driving scene.

  The topic ratio column in FIG. 3 represents the topic ratio for each driving scene. For convenience, here, one driving scene is represented by a mixture of four types of driving topics (driving topics A, B, C, and D). Of course, the types of driving topics used to represent one driving scene are not limited to four. For example, it may be represented by a mixture of five or more driving topics, such as 10 or 100.

  Then, the driving scene discretization unit 106 determines whether topic ratios are similar in a plurality of continuous driving scenes, and collects driving scenes having similar topic ratios into one driving group.

  Whether or not the topic ratio of a certain driving scene is similar to the topic ratio of the next driving scene may be determined by the method disclosed in Non-Patent Document 1. Moreover, as another aspect, in the topic ratio for each of a plurality of driving scenes to be compared, when the sum of the squares of the ratio differences for each driving topic is within a predetermined threshold, those driving scenes It may be determined that the topic ratio is similar.

  The column of the scene group in FIG. 3 represents the result of the driving scenes Sn1 to Sn9 being grouped into scene groups based on the respective topic ratios. Specifically, driving scenes Sn1 to Sn3 determined to have similar topic ratios are integrated as a scene group Gr1. Further, since the driving scene Sn4 is not similar to the preceding and following driving scenes Sn3 and Sn5, the driving scene Sn4 becomes one scene group Gr2 as it is. The driving scenes Sn5 to Sn9 are grouped as a scene group Gr3 based on the similarity of the topic ratio.

  In addition, although the aspect which implement | achieves the driving | running | working scene discretization part 106 was illustrated here by using a technique for an indication to related literature, it is not restricted to this. The driving scene discretization unit 106 may be realized by other methods. For example, as disclosed in Japanese Patent Application Laid-Open No. 2011-129010, a correspondence relationship between driving behavior data and a driving scene is defined in advance, a driving scene is specified from driving behavior data acquired sequentially, and a trip is performed. It is good also as a mode discretized into a plurality of driving scenes. However, in that case, it is necessary to define data indicating the correspondence between the driving scene and driving behavior data, and it is also necessary to separately design an algorithm for grouping into scene groups based on the similarity of driving scenes.

  On the other hand, if Non-Patent Document 1 is used as in the present embodiment, a trip can be divided into a plurality of driving scenes from driving behavior data without providing a driving scene definition in advance, and furthermore, a driving scene with high similarity. Can be integrated into one scene group.

  Information about the driving scene and the scene group set as described above is provided to each unit such as the event extraction unit 107 and the speed tempo setting unit 108. Note that information about a certain driving scene (scene information) includes time information indicating the start time and end time of the driving scene, a topic ratio of the driving scene, information indicating a scene group to which the driving scene belongs, and the like. To do.

  Information about scene groups (scene group information) is information for managing scene information for each driving scene in units of scene groups, and information (for example, pointers) for accessing scene information of driving scenes belonging to each scene group. ) And time information indicating the start time and end time of the scene group.

  Of course, the scene information and the scene group information need not include all the information described above. The type of information that the scene information and scene group information should have may be designed as appropriate. Here, scene group information is introduced as an example, and a configuration in which scene information of each driving scene can be managed in units of scene groups is illustrated, but the present invention is not limited to this. There may be no scene group information.

[Event extractor]
The event extraction unit 107 includes time series data of driving behavior data collected and calculated by the vehicle information collection unit 103, driving environment information collected by the driving environment information collection unit 104, and scenes provided from the driving scene discretization unit 106. Various events related to running are extracted based on at least one of the information.

  Events related to driving include, for example, high-speed driving, sudden acceleration operation, sudden braking operation, lane change, passing around a predetermined point of interest (POI) such as a tourist attraction, arrival at a destination, entry to a highway, For example, returning from a highway to a general road. The event extraction unit 107 corresponds to the event detection unit described in the claims.

  In the present embodiment, as an example, the event extraction unit 107 extracts various events related to traveling by using the technique of related literature and analyzing the topic ratio of the driving scene included in the scene information.

  Specifically, based on the topic ratio of the driving scene and the base tag distribution of each driving topic, information (referred to as a scene label) indicating the driving situation of the driving scene is used as the driving scene. Correlate with. For example, there are scene labels that indicate driving conditions such as whether the vehicle is running, whether the accelerator pedal is depressed, whether the vehicle is turning. In addition, a plurality of scene labels may be given to one driving scene.

  In this way, by using the technique disclosed in the related literature, it is possible to automatically extract an event without giving a definition in advance to each of various events to be extracted. For example, the occurrence (and continuation) of an event such as high-speed traveling, sudden braking operation, or lane change is detected.

  Of course, the event extraction unit 107 may extract various events related to traveling from the driving behavior data collected and calculated by the vehicle information collection unit 103 and the traveling environment information collected by the traveling environment information collection unit 104. The event extracted from the driving behavior data is, for example, operations such as sudden braking, sudden acceleration, and sudden steering. The event extracted from the travel environment information corresponds to, for example, passage of a predetermined POI, arrival at a destination, approach to a highway, return from a highway to a general road, approach of a preceding vehicle, and the like.

  Of course, the event extraction unit 107 may extract events by other methods. For example, when a known image recognition process is performed on an image captured by the in-vehicle camera 20 and an object to be detected is detected, it may be determined that an event corresponding to the object has occurred. .

  By the way, the types of events extracted by the event extraction unit 107 are mainly events that contribute to the division of the driving scene, and events that are caused by elements that do not contribute to the setting of the driving scene among the elements included in the driving behavior data. The event is derived from information that does not appear in the driving behavior data.

  Among the elements included in the driving behavior data, an event caused by an element that does not contribute to the setting of the driving scene is, for example, if the operation information of the winker switch is not used for dividing the driving scene, The operation is applicable. The event derived from information not included in the driving behavior data is, for example, an event derived from the travel environment information, and corresponds to, for example, the aforementioned entry / exit to the expressway.

  FIG. 4 shows the relationship between events extracted by the event extraction unit 107 and scene groups. Time T10 represents the time when the vehicle detected an event of passing through the entrance of the expressway, and from T11 to time T12 represents the time zone during which the event that the vehicle is in a high-speed running state is detected. ing. Further, from time T13 to time T14 represents a time zone in which an event such as a lane change is being detected.

  An event caused by traveling environment information such as entering a highway does not directly affect the setting of a driving scene by the driving scene discretization unit 106. Therefore, it is processed as an event that occurs in the middle of the scene group.

  The state where the vehicle is traveling at high speed appears in the driving behavior data that contributes to the setting of the driving scene, such as the traveling speed, and driving that expresses less similar topic ratios such as acceleration and deceleration before and after high speed traveling Since an operation exists, one scene group is extracted as one event. Note that one high-speed driving state may be divided into a plurality of scene groups by another event that occurs during high-speed driving. An event such as driving at high speed may be detected by analyzing the topic ratio of the driving scene, or may be extracted by setting a predetermined condition for the driving speed or the like.

  In the present embodiment, as an example, information such as operation of the blinker switch is not used for setting a driving scene. Even if it is an element included in the driving behavior data, an event caused by an element that does not directly affect the discretization of the driving scene is processed as an event that occurs in the middle of the scene group, like the passage of POI. The

  Information (event information) about various events extracted by the event extraction unit 107 as described above is provided as event information to the BGM generation unit 109, the text generation unit 110, and the like. The event information corresponds to the content (type) of the event, time information indicating the time when the event occurs (and ends), information indicating a driving scene including the event, and the like. Of course, the event information does not have to include all these information. The information included in the event information may be designed as appropriate.

[Speed tempo setting section]
The speed tempo setting unit 108 performs the three steps S1 to S3 shown in FIG. 5 to set the playback speed of the section corresponding to each driving scene in the series of drive images shot during the trip. The tempo of the BGM to be reproduced is determined while the section corresponding to the driving scene is being reproduced.

  The flow shown in FIG. 5 only needs to be performed at a predetermined timing. For example, when an operation for instructing generation of reproduction data is received from the user, at the end of a trip, or when a scene group break is detected. What is necessary is just to be implemented. In the following, a section corresponding to a certain driving scene in a series of drive videos shot during the trip is also referred to as a video section corresponding to the driving scene. The speed tempo setting unit 108 corresponds to the reproduction speed setting unit described in the claims.

  Hereinafter, the contents of each step will be described. First, in step S1, the speed tempo setting unit 108 temporarily sets the playback speed of the video section corresponding to the driving scene according to the length of time that the driving scene has continued.

  Since the video section corresponding to the driving scene with a long duration is taken in a situation where substantially the same driving situation continues, the information amount per unit time regarding the driving situation is relatively small. In other words, it can be said that the video section corresponding to the driving scene with a short duration has a larger amount of information per unit time regarding the driving situation than the video section corresponding to the driving scene with a long duration.

  Therefore, the speed tempo setting unit 108 plays back each section so that the playback speed of the video section corresponding to the driving scene with a long duration is faster than the playback speed of the section corresponding to the driving scene with a short duration. Calculate the speed. By making the video section corresponding to the driving scene having a long duration faster playback speed, the playback time per driving scene is made uniform.

  For example, the speed tempo setting unit 108 determines the multiplication result obtained by multiplying the length of the driving scene by a predetermined proportional constant as the playback speed of the video section corresponding to the driving scene. However, when the calculated reproduction speed exceeds a predetermined maximum speed (for example, 10 times speed), the reproduction speed of the driving scene is limited to the maximum speed. This is because if the playback speed is excessively increased, it may become difficult to understand the contents when viewing the playback speed.

  FIG. 6 is a conceptual diagram showing the relationship between the duration of the driving scene, the playback time of the video section corresponding to the driving scene, and the playback speed set for each driving scene. As shown in FIG. 6, the speed tempo setting unit 108 shortens the playback time of the section by setting a higher playback speed for the video section corresponding to the driving scene having a longer duration.

  Further, the speed tempo setting unit 108 reduces the reproduction speed to a predetermined speed (for example, double speed) for the switching portion of the driving scene. This emphasizes the transition of the scene. The switching portion of the driving scene refers to a predetermined time (for example, 0.5 seconds) before and after the break of the driving scene.

  Furthermore, when the playback speed is changed instantaneously, the viewer feels very difficult to see or feels uncomfortable. Therefore, the speed tempo setting unit 108 calculates the reproduction speed so as to gradually change when changing the reproduction speed in order to suppress a sudden change in the reproduction speed.

  In the present embodiment, the magnification of the playback speed of the drive video corresponding to each driving scene is basically set to a predetermined value (for example, twice) or more, while the duration of the driving scene is equal to or less than a predetermined threshold. In this case, the reproduction speed magnification of the driving scene is set to a value (for example, 1 time) that is equal to or less than a specified value.

  This is because if a drive video of a very short driving scene is reproduced in a shorter time, it becomes difficult for the user to understand the content. In addition, the short duration of the driving scene suggests that the driving situation has changed finely, and there is a high possibility that important information is included. Also from such a viewpoint, when the duration of the driving scene is equal to or less than a predetermined threshold, it is preferable to set the reproduction speed magnification of the driving scene to a value equal to or less than a specified value (here, 1 × speed). .

  As another mode, among various driving scenes, for driving scenes that should be particularly emphasized, the magnification of the reproduction speed is reduced to a value not more than a specified value (for example, 1 or 0.5 times). You may stress. The conditions for the driving scene to be particularly emphasized may be appropriately designed. For example, the driving scene in which an event corresponding to a dangerous driving operation such as sudden braking is extracted by the event extraction unit 107 may be used. As a result, it is possible to emphasize and present a portion to be confirmed by the user in the digest video among the drive videos shot during the trip.

  When the above processing is completed, the speed tempo setting unit 108 calculates the position (time information) at which the video section corresponding to each driving scene is started in the digest video. The playback time of the section corresponding to each driving scene in the digest video may be calculated from the playback speed temporarily set in step S1 for that driving scene and the duration of the driving scene. Then, the position (time information) at which the video section corresponding to each driving scene in the digest video is started is calculated by accumulating the reproduction time for each section corresponding to each driving scene. The calculated start position in the digest video for each driving scene may be added to the scene information.

  Thus, by specifying the start position for each driving scene in the digest video, it becomes possible to specify the time point when the scene group in the digest video is switched.

  In the next step S2, the speed tempo setting unit 108 sets the BGM tempo to be added to the digest video based on the scene information generated by the driving scene discretization unit 106 and the driving behavior data collected by the vehicle information collection unit 103. Set the point of change (hereinafter referred to as the tempo change point). Also, a range of values that can be adopted as the BGM tempo between the set tempo change points (hereinafter referred to as tempo range) is determined.

  First, the speed tempo setting unit 108 specifies the time point when the scene group is switched in the digest video based on the scene information generated by the driving scene discretization unit 106, and sets the scene group switching point as the tempo change point. As a result, the tempo of the BGM is constant while one scene group continues.

  Next, the speed tempo setting unit 108 determines a tempo range between a certain tempo change point and the next tempo change point based on the driving behavior data. Here, the tempo range between a certain tempo change point and the next tempo change point is determined according to the average value of the vehicle traveling speed between tempo change points (that is, the average vehicle speed). Since the tempo change point is a scene group switching point, the time zone from one tempo change point to the next tempo change point means the time zone in which a certain scene group continues. ing.

  Specifically, the speed tempo setting unit 108 calculates the average vehicle speed for each scene group based on the scene information and the time series data of the traveling speed. In the graph shown in the travel speed column of FIG. 7, the solid line represents the time change of the travel speed for each scene group, and the dashed line represents the average vehicle speed in the scene group. A known method may be used as a method for calculating the average vehicle speed.

  Then, based on the average vehicle speed for each scene group obtained as described above, the speed tempo setting unit 108 determines the tempo range in the time zone in which the scene group continues. For example, the speed tempo setting unit 108 refers to data defining the correspondence relationship between the average vehicle speed and the tempo range as shown in FIG. 8, and the tempo range corresponding to the average vehicle speed of the scene group corresponds to the scene group. Adopt as tempo range.

  It is assumed that the data defining the correspondence relationship between the average vehicle speed and the tempo range is set so that the faster the average vehicle speed is, the faster the tempo is. Accordingly, the speed tempo setting unit 108 adopts a range having a relatively fast tempo as the average vehicle speed of the scene group increases. For example, the tempo range is set to 60 to 90 BPM for a scene group with an average vehicle speed of 20 km / h, and the tempo range is set to 150 to 180 BPM for a scene group with an average vehicle speed of 80 km / h.

  In FIG. 8, data indicating the correspondence relationship between the average vehicle speed and the tempo range is represented in a table format, but the correspondence relationship between the average vehicle speed and the tempo range may be represented by a map or a function.

  In step S3, the BGM tempo value for each scene group is determined based on the playback speed for each driving scene temporarily set in step S1 and the tempo range for each scene group set in step S2. Adjust the playback speed for each scene as necessary.

  Specifically, as shown in FIG. 9, the speed tempo setting unit 108 sets the tempo value for each scene group so that the tempo change point (scene group switching point) becomes a break of music. Adjust within the specified tempo range. Here, four measures in a musical piece are treated as one unit (one phrase), and the moment when exactly one phrase ends is taken as the break of the musical piece. That is, a new phrase starts when moving from one scene group to another scene group, and the tempo value is set so that each scene group includes an integer of one phrase consisting of four measures.

  As an example, the speed tempo setting unit 108 may determine the tempo value in each scene group as follows. When determining the tempo value for a certain scene group, the speed tempo setting unit 108 calculates the number of phrases appropriate for the playback time of the scene group, for example, using the median value of the tempo range as an initial value.

  If the BGM performance time corresponding to the calculated number of phrases is insufficient with respect to the playback time of the scene group, the switching point of the scene group can be changed by setting the tempo value slower than the median value. Adjust so that there is a break. If the BGM performance time corresponding to the calculated number of phrases is redundant with respect to the playback time of the scene group, the scene group switching point can be set by making the tempo value faster than the median value. Adjust so that the music breaks. If the tempo is increased, the time required for reproducing one phrase is shortened, and if the tempo is decreased, the time required for reproducing one phrase is increased.

  Further, as a result of the above-described processing, the speed tempo setting unit 108 determines that the tempo value for matching the scene group switching point and the music break exceeds the tempo range set in step S2. The tempo value corresponding to the scene group is set to the limit value of the tempo range set in step S2. Then, by adjusting the playback speed for each driving scene belonging to the scene group, the scene group switching point and the break of music are matched.

  When the playback speed is adjusted for each driving scene by the speed tempo setting unit 108, the adjusted playback speed is determined as the playback speed of the driving scene. Further, for the driving scene in which the reproduction speed is not adjusted, the reproduction speed temporarily set in step S1 is adopted as the reproduction speed of the driving scene. When the speed tempo setting unit 108 adjusts the reproduction speed for each driving scene, the start position in the digest video included in the scene information of each driving scene is updated.

  Information on the playback speed determined for each driving scene is output to the BGM generation unit 109 and the drive video summarization unit 111. The tempo change point determined by the speed tempo setting unit 108 and the tempo value to be set after the tempo change point are output to the BGM generation unit 109 as tempo information.

  In this example, the processing for setting the playback speed for each driving scene and the processing for setting the BGM tempo for each scene group are performed by one functional block (that is, the speed tempo setting unit 108). Not exclusively. For example, the speed tempo setting unit 108 is a reproduction speed setting unit that is in charge of processing for setting a reproduction speed for each driving scene, and a tempo determination unit that is in charge of processing for determining a BGM tempo change point and a tempo after the change point. It may be separated into smaller functional blocks.

[BGM generator]
The BGM generation unit 109 generates BGM data to be added to the digest video from the tempo information set by the speed tempo setting unit and the event information extracted by the event extraction unit 107. Specifically, a tempo change is added to the MIDI (Musical Instrument Digital Interface) data of the music prepared in advance as BGM at the timing of the tempo change point. The tempo value set as a result of the tempo change is a value set by the speed tempo setting unit 108.

  Further, the BGM generation unit 109 adds sound effects to the BGM at the timing when the event occurs based on the event information extracted by the event extraction unit 107, and arranges the measures corresponding to the time zone in which the event occurs. Put in.

  For example, as shown in FIG. 10, for the event with a relatively short occurrence time, such as sudden braking, predetermined POI passing, highway gate passing, etc., by adding sound effects to the BGM, Express the occurrence of When a plurality of types of sound effects are provided to the BGM, different types of sound effects may be provided depending on the type of event.

  In addition, those that are assumed to have a relatively long event duration, such as high-speed driving and lane changes, add an arrangement to the BGM. Arrangement types include drum pattern changes, instrument type changes, tune changes, and the like.

  Note that the timing at which the BGM generating unit 109 provides sound effects corresponding to the event or arranges them is a time zone in which the event is displayed in the digest video. The timing of occurrence and end of each event in the digest video may be specified from the duration of each driving scene, the playback speed of each driving scene, and event information. The BGM data generated as described above is output to the reproduction data generation unit 112. The BGM generation unit 109 corresponds to an example of a transmission data generation unit described in the claims. BGM data corresponds to an example of transmission data.

[Text generator]
The text generation unit 110 generates text indicating the content of the event based on the event information provided from the event extraction unit 107. For example, if the event extraction unit 107 has extracted an event such as the depression of an accelerator pedal to pass through a toll gate on a highway, text data indicating that fact is generated. Note that the text generation unit 110 may generate text data for all events, or may generate text data only for predetermined types of events.

  The text data generated by the text generation unit 110 is added with information indicating the timing for displaying the text, and is output to the reproduction data generation unit 112. The timing at which the text should be displayed is a time zone in which an event corresponding to the text is displayed in the digest video. The timing of occurrence and end of each event in the digest video may be specified from the duration of each driving scene, the playback speed of each driving scene, and event information.

[Drive video summary section]
The drive video summarization unit 111 thins out the drive video data corresponding to each driving scene based on the playback speed for each driving scene set by the speed tempo setting unit 108 to summarize the driving video (digest video). Create). Since a moving image editing technique that makes an original video reproduced at a predetermined reproduction speed is well known, detailed description thereof is omitted here. The created digest video is output to the reproduction data generation unit 112.

  Note that the drive video stored continuously in the drive video DB 102 over time and the driving behavior data acquired by the vehicle information collection unit 103 are obtained using the same (synchronized) time information, and the time at which they are obtained. Is recorded. Therefore, the drive video summarizing unit 111 can specify a video section corresponding to each driving scene in a series of drive videos shot during the trip. Thereby, the video section corresponding to each driving scene can be edited into a video played at the playback speed set for the driving scene.

[Reproduction data generator]
The reproduction data generation unit 112 combines the digest video generated by the drive video summarization unit 111 with the BGM data generated by the BGM generation unit 109 and the text data generated by the text generation unit 110 to generate the reproduction data. Generate.

  The synthesis of text data into a digest video refers to a process of embedding text corresponding to various events in the video data so as to be displayed as a caption in the time zone in which the event is displayed. A technique for adding a caption to an image may also use a known method.

  Note that the upper limit of the number of texts to be displayed per fixed time and the lower limit of the time to continue displaying one text are set, and the reproduction data generation unit 112 sets the text corresponding to a relatively important event. It is good also as an aspect which selects the text added to a digest image | video so that it may display preferentially. The degree of importance of an event may be determined based on data indicating correspondence between the contents of the event and the degree of importance in advance.

  In the reproduction data generated as described above, the scene group transition in the digest video and the tempo change in the BGM are synchronized by adjusting the reproduction speed and tempo in the speed tempo setting unit 108. The sound effect embedded in the BGM and the time zone of the section subjected to the arrangement processing are also synchronized with the scene in which the event occurs in the digest video.

[Effects of this embodiment]
Through the above processing, the playback data generated by the digest video generation device 100 is provided to the digest video playback device 200 and played back, for example. That is, the digest video playback device 200 displays the digest video on the display 50 based on the playback data, and outputs BGM synchronized with the digest video from the speaker 60.

  The BGM tempo output together with the digest video represents the average vehicle speed of the scene in the digest video. Specifically, the BGM tempo is faster as the average vehicle speed is higher, and the BGM tempo is slower as the average vehicle speed is lower.

  Generally, when a digest video is created by changing the playback speed of each scene of the drive video, it is difficult to grasp the traveling speed of the scene from the digest video itself. This is because it is difficult for the user to identify whether the sense of vehicle speed felt by the user from the digest video is due to the actual traveling speed or the reproduction speed.

  For such a problem, as a comparative configuration, the vehicle running speed in the scene is displayed on the digest video by sequentially displaying the running speed of the vehicle as text or an image simulating a meter (referred to as a meter image). It is possible to have a configuration that conveys to

  However, when text and meter images representing travel speed are superimposed and displayed on the digest video, the user's point of interest increases, and there is a risk that the information displayed on the display 50 will be excessive. In particular, since the traveling speed is information that changes continuously, text and meter images representing the traveling speed are always displayed. In addition, the traveling speed is information that changes continuously, and viewers tend to gaze at dynamically changing parts, so by displaying text and meter images representing the traveling speed, digest video There is a risk that it will be difficult to watch.

  On the other hand, according to the configuration of the present embodiment, the traveling speed of the vehicle is expressed as a BGM tempo. Therefore, it is possible to convey information that is difficult to convey only by the digest video, such as the traveling speed of the vehicle, to the user without increasing the gazing point in the screen. The travel speed of the vehicle corresponds to an example of travel-related information described in the claims.

  Further, the acceleration and deceleration of the vehicle are also mixed with those caused by the change in the reproduction speed in the digest video, and are difficult to understand. In the present embodiment, since the BGM tempo is determined by the average vehicle speed, the change in the vehicle traveling speed is expressed as a change in the tempo.

  Therefore, the user can tell the user that the vehicle has accelerated or decelerated because the tempo of the BGM has changed. Specifically, the user can intuitively recognize that the running speed of the vehicle has slowed because the tempo has become slow, and the user has increased the running speed of the vehicle because the tempo has become faster. Can be recognized intuitively. Therefore, acceleration and deceleration also correspond to an example of the travel related information described in the claims.

  In addition, when an instantaneous event such as sudden acceleration or deceleration (finished in a relatively short time) occurs, a sound effect is output, so that the user listens to the sound effect and some event occurs. I can recognize that. In particular, by properly using sound effect patterns (melody, volume, etc.) according to the content of the event, the user can recognize the content of the event that occurred in the scene from the type of the output sound effect.

  Furthermore, while a continuous event such as high speed driving or lane change occurs, the arranged BGM is output as a voice. Therefore, the user can recognize that a continuous event has occurred since the arrangement has been added to the BGM. Further, since the arrangement has been canceled, it can be recognized that the event has ended.

  Note that the sound effects and arrangements are performed in units of measures in the MIDI data, so that it is possible to reduce the possibility of giving the user a sense of discomfort. In particular, for a momentary event such as sudden acceleration / deceleration, if a sound effect is given only during the event occurrence, the sound generation time is short, and the user may miss the sound effect. On the other hand, in this embodiment, since the sound effect is given in units of measures, it is possible to reduce a possibility that the sound effect that notifies the occurrence of the event by the user is missed.

  Further, according to the above configuration, since the timing for switching the BGM tempo and the timing for switching the driving scene (and scene group) are synchronized, the user switches the BGM tempo. Recognize that the group has changed. Switching between driving scenes and scene groups corresponds to changes in driving conditions. That is, according to the above-described configuration, the user can recognize the change in the driving situation from the change in the tempo of the BGM.

  Moreover, according to the above structure, since the vehicle behavior such as travel speed and acceleration / deceleration can be transmitted to the user by voice information, the amount of information displayed on the display 50 can be suppressed. As a result, another information can be displayed in an empty space in the screen.

  For example, as described above, even if the text explaining the scene being reproduced is displayed as a caption on the digest video, the user can easily recognize the content.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to the above-mentioned embodiment, The following modification is also contained in the technical scope of this invention, Furthermore, the summary other than the following is also included. Various modifications can be made without departing from the scope.

<Modification 1>
In the above, an example has been described in which various events are transmitted to the user by sound effects or BGM arrangement, but the present invention is not limited to this. Various events may be transmitted to the user by vibrating the vibrator 70. Further, the vibration pattern (vibration intensity, vibration interval, etc.) of vibrator 70 may be changed according to the type of event.

  In a case where predetermined information is transmitted to the user by vibrating the vibrator 70, the digest video generation apparatus 100 receives vibration instruction data for instructing to vibrate the vibrator 70 at a predetermined timing and a predetermined vibration pattern. A function to generate (referred to as a vibration instruction information generation unit) is provided.

  The timing to vibrate the vibrator 70 by the vibration instruction data is the timing at which a scene corresponding to a predetermined event is displayed in the digest video, similar to the timing at which the BGM generation unit 109 adds sound effects and arrangements to the BGM.

  Then, the reproduction data generation unit 112 may generate, as reproduction data, data obtained by packaging data such as a digest video and vibration instruction information generated by the vibration instruction generation unit.

  According to such an aspect, the user can recognize the occurrence of the event by feeling the vibration of the vibrator 70 and can recognize the contents of the event from the vibration pattern. That is, according to the aspect shown in the first modification, it is possible to inform the user of information related to the traveling of the vehicle in each scene of the digest video. The vibration instruction data corresponds to the transmission data described in the claims, and the various event information corresponds to an example of the travel related information described in the claims.

  In addition, you may combine embodiment mentioned above and this modification 1. FIG. That is, event notification by vibration of vibrator 70 and event notification by sound effect or BGM arrangement may be used in combination, or may be used depending on the type of event. According to such an aspect, it is possible to convey to the user various information related to the running of the vehicle in each scene of the digest video using both the user's sense of touch and hearing.

  For example, an instantaneous event related to vehicle behavior is expressed using both the application of sound effects and vibration of the vibrator 70, and a continuous event such as high-speed driving is expressed only by voice information (for example, BGM arrangement). May be.

<Modification 2>
When the digest video playback device 200 is mounted on the vehicle, the indication values of the vehicle speed meter and engine speed meter mounted on the vehicle are linked with the scene of the digest video being played back. You may control so that it may become a value.

  In such a case, the digest video generation device 100 may be configured to include a function (control data generation unit) that generates control data for moving the pointers of various meters in synchronization with the scene of the digest video. . Then, the reproduction data generation unit 112 may generate, as reproduction data, data obtained by packaging data such as a digest video and the control data generated by the control data generation unit.

  Further, the BGM generation unit 109 may generate audio data for outputting engine sound corresponding to the digest video from the speaker 60 as information expressing the behavior of the vehicle corresponding to the digest video. In this case, the reproduction data generation unit 112 may generate reproduction data obtained by synthesizing engine sound audio data with the digest video.

<Modification 3>
The travel related information in each scene of the digest video may be expressed by audio information such as BGM or tactile information such as vibration, and further, a text or an image indicating the travel related information may be superimposed and displayed on the digest video. For example, changes over time in parameters such as travel speed and acceleration may be displayed as meter images, graphs, and bar expansion / contraction.

  Even in such a case, since the user can recognize the travel related information through hearing and touch, the risk of gazing at the travel related information displayed on the display 50 can be reduced, and the user can concentrate on the digest video. .

  In addition, the user can confirm more specific travel-related information in the scene by directing his / her line of sight to an area where text and images representing the travel-related information are displayed on the screen as necessary. . In other words, it is possible to improve the variety of processes in which the user recognizes various travel-related information.

<Modification 4>
In the above, the digest video reproduction device 200 is mounted on the vehicle, but the present invention is not limited to this. A mobile terminal such as a smartphone may be employed as the digest video reproduction device 200. In that case, the digest video generation apparatus 100 only needs to have a storage function for storing the generated reproduction data in a predetermined storage medium and an external output function for external output.

<Modification 5>
In the above description, the vehicle information collection unit 103 acquires the driving behavior data from the in-vehicle sensor 30 through the in-vehicle network 10, but is not limited thereto. A mobile terminal such as a smartphone may be employed as the vehicle information collection unit 103. In that case, an acceleration sensor or the like mounted on a mobile terminal such as a smartphone is used as a signal source corresponding to the in-vehicle sensor 30, and the operation amount such as the operation amount of the accelerator pedal or the operation amount of the brake pedal is not directly acquired. What is necessary is just to acquire vehicle behavior data from the value of the acceleration sensor mounted in the terminal.

  The traveling environment information collection unit 104 may also collect various information from the navigation ECU 40 based on the output of a GPS receiver or the like mounted on the portable terminal, instead of acquiring various information. As a result, the digest video can be generated using only the mobile terminal without being connected to the in-vehicle network.

<Modification 6>
The data that is the basis for generating the BGM is not limited to MIDI data, but may be electronic data that can be arranged. Moreover, you may employ | adopt the music set by the user as BGM. Furthermore, electronic data of a plurality of types of music may be prepared, and the BGM generation unit 109 may automatically adopt electronic data of music corresponding to the driving situation as data that is the basis of BGM.

  The BGM to be added to the digest video is not generated based on one type of music data, but may be generated using a combination of a plurality of types of music. For example, you may change the kind of music as BGM according to the running speed of the vehicle in a digest image | video. According to such an aspect, the magnitude of the running speed is expressed by the type of music, and the change in the running speed is expressed by changing the type of music.

<Modification 7>
Further, the BGM generation unit 109 may express an instantaneous event by changing the volume level or adding noise instead of adding a sound effect to the BGM. Further, the BGM generation unit 109 may express the traveling speed of the vehicle by raising and lowering the sound range (frequency) of the BGM.

<Modification 8>
Moreover, although the aspect which employ | adopted the vehicle-mounted camera 20 which is an optical camera was illustrated as an image | video imaging device as described in the above, it is not restricted to this. For example, an apparatus (referred to as a laser radar imaging apparatus) that captures a distance to an object as an image using a laser radar may be used as the image capturing apparatus. In such an aspect, as in the case of using the in-vehicle camera, a digest video is generated from the drive video obtained by the laser radar imaging device using the vehicle information, and the BGM or text reflecting the vehicle information and the traveling environment information is used. Can be granted.

  DESCRIPTION OF SYMBOLS 100 Digest video generation apparatus, 101 Drive video acquisition part (video acquisition part), 102 Drive video DB (video storage part), 103 Vehicle information collection part (vehicle information acquisition part), 104 Driving environment information collection part, 105 Driving scene database 106 Driving scene discretization unit (scene division unit) 107 Event extraction unit (event detection unit) 108 Speed tempo setting unit (playback speed setting unit) 109 BGM generation unit 110 Text generation unit 111 Drive video summarization unit 112 Data generator for reproduction

Claims (10)

A video acquisition unit (101) for sequentially acquiring video captured by a video imaging device mounted on the vehicle;
A video storage unit (102) for storing the video acquired by the video acquisition unit;
A vehicle information acquisition unit (103) that sequentially acquires vehicle information indicating a driving situation of the vehicle from the start to the end of shooting by the video imaging device;
A scene dividing unit that divides a trip, which is a series of travels of the vehicle from the start to the end of photographing by the video photographing device, into a plurality of driving scenes based on the vehicle information collected by the vehicle information acquisition unit. (106)
A playback speed setting unit (108) for setting a playback speed of a video shot in a time zone corresponding to the driving scene according to the length of the driving scene;
A drive video summarization unit (111) for generating a digest video summarizing the video stored in the video storage unit based on the playback speed for each driving scene set by the playback speed setting unit;
A transmission data generation unit that generates transmission data that is data for transmitting travel-related information, which is information related to the travel of the vehicle in each scene of the digest video, to the user via the user's hearing or touch. 109),
A reproduction data generation unit (112) configured to generate the transmission data generated by the transmission data generation unit and the reproduction data added to the digest video generated by the drive video summarization unit; A digest video generation device. In claim 1,
A digest video generation apparatus comprising: a BGM generation unit that generates a BGM of the digest video that changes according to the travel-related information corresponding to each scene of the digest video as the transmission data generation unit. In claim 2,
The digest video generation device, wherein the BGM generation unit generates the BGM whose tempo changes in accordance with the traveling speed of the vehicle in each scene of the digest video. In claim 3,
The digest video generation device, wherein the BGM generation unit increases the tempo of the portion corresponding to the scene as the traveling speed of the vehicle increases. In claim 4,
The BGM generation unit generates the BGM that synchronizes a timing at which a tempo in the BGM changes and a timing at which the driving scene is switched in the digest video. In claim 5,
The scene dividing unit determines whether or not the driving situations indicated by each of the plurality of consecutive driving scenes are similar, and determines that the driving scenes are similar to each other when it is determined that they are similar. Set as a scene group,
The digest video generation device, wherein the BGM generation unit sets a tempo of a portion corresponding to the driving scene belonging to the same scene group in the BGM to a constant value according to an average vehicle speed in the scene group. In claim 5 or 6,
The digest video generation device, wherein the BGM generation unit changes a tempo at a break of a measure of the BGM. In any one of Claims 2-7,
An event detector (107) for detecting a predetermined event related to the traveling of the vehicle that occurred during the trip;
The BGM generation unit adds a sound effect corresponding to the event to a portion where the event detected by the event detection unit occurs in the BGM, or performs an arrangement process corresponding to the event. A digest video generation device characterized by the above. In claim 8,
A traveling environment information collecting unit (104) for collecting traveling environment information related to the traveling environment of the vehicle;
The event detection unit detects the event based on at least one of the travel environment information acquired by the travel environment information collection unit and the vehicle information acquired by the vehicle information acquisition unit. Digest video generation device. In claim 9,
A text generation unit (110) for generating text representing the content of the event detected by the event detection unit;
The reproduction data generation unit generates the reproduction data in which the text is added to the digest video so that the text is superimposed on a portion corresponding to the timing at which the event occurs in the digest video. A digest video generation device characterized by the above.

Images