WO2010150348A1 - Video recording/reproduction device, video recording/reproduction method, and video recording/reproduction program - Google Patents

Abstract

A video recording/reproduction device includes: an imaging means such as a camera arranged on a mobile body; a video recording means, a travelling state analysis means, and an importance judgment means.  The imaging means captures a travelling video around the travelling mobile body.  The video recording means records the video captured by the imaging means.  The travelling state analysis means obtains a travelling state of the mobile body.  The importance judgment means judges and sets an importance degree of each video scene on the basis of the obtained travelling state.

Description

Video recording / playback apparatus, video recording / playback method, and video recording / playback program

The present invention relates to a video recording / reproducing apparatus for recording and reproducing a video photographed by a moving body photographing apparatus.

In recent years, one of the new ways to enjoy a video camera is to shoot and record a scene image (hereinafter referred to as a “travel image”) that can be seen while the vehicle is traveling, and view it. Some attempt to share this running video on the Internet. For example, in a video distribution site where comments from viewers can be posted, driving images that have been driven by vehicles on roads that are difficult to pass by vehicles are uploaded, and these images are received from many viewers. Has won the comment. There are also many personal sites that publish such driving images. Furthermore, as a way to enjoy a video camera, it is not limited to recording driving images in a vehicle, but it has the potential to spread to a wider range of ways to enjoy such as driving images on a bicycle or skiing and snowboarding. ing.

By the way, unlike a broadcast program on television, the traveling video shot as described above is not edited at all, so it is content that contains many monotonous and boring scenes for viewing as it is. It can be said. In addition, when the entire process of the drive is recorded, if the entire process is viewed, the same time as the entire time of the drive is required, which is not realistic. When a user watches a running video, in many cases, he does not want to see all the scenes. For example, there are scenes that are running smoothly, scenes with good scenery near famous tourist spots, or special events. It is natural to think that it is only the scene that has occurred.

Therefore, as a technique for grasping the summary of the content such as the above-described traveling video in a short time, a method of creating a digest of the content and reproducing the digest has been devised. For example, Patent Document 1 sets the summary segment to be extracted based on the position on the time axis of the silent section and the noise section of the audio-video information and the section length, and the importance of the summary segment. A method for digest playback based on summary segments and importance is described. Further, as a related technique, Patent Document 2 discloses that traveling images taken at predetermined time intervals are sequentially and cyclically stored in a plurality of semiconductor storage devices, and the storage operation is stopped when an automobile accident occurs. A method for storing a plurality of still images before an accident in the semiconductor memory device is described.

Japanese Patent Laid-Open No. 2003-87728 Japanese Unexamined Patent Publication No. 63-16785

However, in the method described in Patent Document 1, only background speech is used as a judgment criterion for digest playback scheduling. That is, since other information such as an image is not used, it is difficult to perform an appropriate digest reproduction that does not leak important scenes. Further, the technique described in Patent Document 2 is intended to record an accident video of a vehicle and has a different problem from the present invention that aims to perform digest reproduction.

Examples of problems to be solved by the present invention include the above. An object of the present invention is to perform an appropriate digest reproduction that does not leak important scenes.

The invention according to claim 1 is a video recording / reproducing apparatus, wherein the photographing means provided in the moving body, the video recording means for recording the video photographed by the photographing means, and the traveling state of the moving body are provided. It comprises: a travel condition analysis means to be obtained; and an importance degree judgment means for judging and setting the importance for each scene of the video based on the obtained travel state.

The invention according to claim 14 is a video recording / playback method, wherein a shooting step of shooting a video by a shooting unit provided in a moving body, a video recording step of recording a video shot by the shooting unit, A running state analysis step for obtaining a running state of the mobile body, and an importance level judging step for determining and setting the importance level for each scene of the video based on the obtained running state. To do.

According to a fifteenth aspect of the present invention, there is provided a video recording / reproducing program executed by a navigation device having a photographing unit, wherein the video recording unit records a video photographed by the photographing unit, and obtains a traveling state of the moving body. The navigation apparatus is made to function as travel state analysis means and importance level determination means for determining and setting the importance level for each scene of the video based on the obtained travel state.

It is a figure which shows an example of a vehicle provided with the navigation apparatus with which the video recording / reproducing apparatus of this invention was applied. It is a figure which shows the apparatus structure of a navigation apparatus. It is a figure which shows the function structure of the video recording / reproducing apparatus which concerns on 1st Example. It is a figure which shows an example of the information recorded on a driving | running | working video database. It is a figure which shows an example of the information recorded on a driving | running | working state database. It is the figure which listed the example of the change point of a driving | running | working state. It is the figure which listed the example of the characteristic time of a driving state. It is a figure which shows an example of the importance determination table of a driving | running | working state. It is a figure which shows an example of the importance determination table of a driving | running | working state. It is a figure which shows an example of the information recorded on a scene database. It is a figure which shows the tendency of the priority by calculating | requiring scene importance. It is a flowchart which shows the whole control processing in 1st Example. It is a flowchart of the scheduling for digest reproduction | regeneration. It is a figure which shows the function structure of the video recording / reproducing apparatus which concerns on 2nd Example. It is a figure which shows an example of the importance determination table of the frequency | count of driving | running | working. It is a figure which shows the function structure of the video recording / reproducing apparatus which concerns on 3rd Example. It is a figure which shows an example of the importance determination table | surface of personal information. It is a figure which shows the function structure of the video recording / reproducing apparatus which concerns on 4th Example. It is a figure which shows the function structure of the video recording / reproducing apparatus which concerns on an application example. It is a graph which shows the change of the scene importance with respect to the time of a driving | running | working image | video. It is a flowchart which shows the whole control processing in an application example.

DESCRIPTION OF SYMBOLS 11 Acceleration sensor 12 Gyro sensor 13 Vehicle speed pulse sensor 18 GPS sensor 20 System controller 70 Shooting device 100 Video recording / reproducing device

In one aspect of the present invention, a video recording / reproducing apparatus includes a photographing unit provided in a moving body, a video recording unit that records a video photographed by the photographing unit, and a traveling state for determining a traveling state of the moving body. Analyzing means and importance determining means for determining and setting importance for each scene of the video based on the obtained traveling state.

The video recording / playback apparatus includes a photographing unit such as a camera provided in the moving body, a video recording unit, a running state analyzing unit, and an importance level determining unit. The photographing means photographs a traveling image around the moving moving body. The video recording unit records the video shot by the shooting unit. The traveling state analyzing means obtains the traveling state of the moving body. The importance level determination means determines and sets the importance level for each scene of the video based on the obtained running state. In this way, it is possible to set an appropriate importance level for each scene of the video, and it is not necessary to leak the important scene when performing digest playback scheduling.

In another aspect of the video recording / playback device, the running state analyzing unit is configured to perform the running based on a feature amount obtained by analyzing at least one of images and sounds included in the video. Find the state. Here, the image feature amount is, for example, luminance, color histogram, edge information, and motion information, and the sound feature amount is, for example, sound pressure power and sound frequency characteristics. By using the feature amount of the image, it is possible to obtain image information such as road markings, vehicles, and pedestrians as information indicating the traveling state of the moving body. By using the feature amount of the voice, it is possible to obtain voice information such as a human voice, a crowded sound, and a horn sound as information indicating the traveling state of the moving body.

In another aspect of the video recording / reproducing apparatus, the running state analyzing means is based on a sensor signal from at least one of a GPS sensor, an acceleration sensor, a gyro sensor, and a vehicle speed pulse sensor. The travel state is obtained. Thereby, it is possible to obtain information such as the travel position, the vehicle speed state, the acceleration / deceleration state, the direction, the turning state, and the tilt state as information indicating the travel state of the moving body.

Another aspect of the video recording / reproducing apparatus includes a map information recording unit that records map information, and the traveling state analyzing unit obtains the traveling state based on the map information. As a result, it is possible to obtain information such as an address, an altitude state, a nearby geographical spot, a road state, and landscape information as information indicating the traveling state of the mobile body.

Another aspect of the video recording / reproducing apparatus includes a travel history recording unit that records a travel history of the mobile body, and the importance level determination unit is configured to determine the importance level based on the travel history and the travel state. The importance is determined and set for each scene of the video. Thereby, the appropriate importance according to the frequency | count of driving | running | working can be set about each scene of an image | video. For example, when scheduling digest playback, it is possible to reduce the priority of familiar road scenes and increase the priority of unfamiliar road scenes.

Another aspect of the video recording / playback apparatus includes personal information recording means for recording personal information of a user, and the importance level determination means is configured to determine the importance of the video based on the personal information and the running state. The importance is judged and set for each scene. Thereby, the appropriate importance according to personal information can be set about each scene of an image | video. For example, when performing digest playback scheduling, it is possible to lower the priority of a scene in a known place such as the vicinity of a home or a commuting route, and increase the priority of the scene such as a user's memory location.

Another aspect of the video recording / reproducing apparatus includes an instruction unit for a user to instruct information indicating an important scene, and the importance level determination unit includes the information instructed by the user, the running state, and the like. Based on the above, the importance is determined and set for each scene of the video. This makes it possible to prioritize important scenes instructed by the user when performing digest playback scheduling.

Another aspect of the video recording / reproducing apparatus includes a scene dividing unit that divides the video into a plurality of scenes based on the running state. This makes it possible to divide the scene into meaningful units.

In another aspect of the video recording / reproducing apparatus, the importance level determination unit determines and sets the importance level for each frame of the video based on the traveling state of the moving body. As a result, it is possible to add an index to the important frame, and the user can find an important scene based on the index.

Another aspect of the video recording / playback apparatus includes digest playback control means for controlling playback by creating a schedule for digest playback according to the importance set for each scene of the video. This makes it possible to appropriately perform digest playback scheduling.

In a preferred embodiment of the video recording / playback apparatus, the digest playback control means preferentially schedules the video scene as the importance set for the video scene increases.

In a preferred embodiment of the video recording / playback apparatus, the digest playback control means plays back the video scene faster as the importance set in the video scene becomes lower. Thereby, digest reproduction can be performed in a short time.

In a preferred embodiment of the video recording / playback apparatus, the digest playback control means plays back the video scene faster as the time length of the video scene becomes longer. This also makes it possible to perform digest reproduction in a short time.

In another aspect of the present invention, a video recording / playback method includes a shooting step of shooting a video by a shooting unit provided in a moving body, a video recording step of recording a video shot by the shooting unit, and the moving body. A travel state analysis step for obtaining the travel state, and an importance level determination step for setting the importance level for each scene of the video based on the obtained travel state. Also with this video recording / playback method, it is possible to set an appropriate level of importance for each scene of the video, and it is not necessary to leak important scenes when performing digest playback scheduling.

In still another aspect of the present invention, a video recording / playback program executed by a navigation apparatus having a photographing unit includes a video recording unit that records a video photographed by the photographing unit, and a traveling for obtaining a traveling state of the moving body. The navigation device is caused to function as state analysis means and importance determination means for determining and setting importance for each scene of the video based on the obtained traveling state. This video playback program can also set an appropriate importance level for each scene of the video.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[Navigation device]
First, an example of a navigation apparatus to which the video recording / reproducing apparatus of the present invention is applied will be described.

FIG. 1 shows an example of a vehicle equipped with a navigation device to which the video recording / reproducing apparatus of the present invention is applied. FIG. 1 illustrates a vehicle 90 that is a vehicle driven by a user, and the navigation device 1 is mounted on the vehicle 90.

In the first embodiment, the navigation device 1 mounted on the vehicle 90 includes a photographing device 70. The imaging device 70 captures a scene outside the traveling vehicle 90, that is, captures a traveling image of the vehicle 90. Note that the shooting direction of the shooting device 70 is not limited to the front of the vehicle 90, but may be shot in the left and right sides of the vehicle 90, the rear, or other directions. Further, the photographing direction of the photographing apparatus 70 is not limited to one direction, and may be a plurality of directions. When the navigation device 1 functions as a video recording / reproducing device, the importance level is determined and set for each scene based on the traveling state of the vehicle 90 for the video imaged by the imaging device 70.

The device configuration of the navigation device 1 will be described with reference to FIG. FIG. 2 shows an example of the device configuration of the navigation device. As shown in FIG. 2, the navigation device 1 includes a self-supporting positioning device 10, a GPS receiver 18, a system controller 20, a disk drive 31, a data recording unit 36, a communication interface 37, a communication device 38, a display unit 40, an audio output. A unit 50, an input device 60, and a photographing device 70 are provided.

The self-supporting positioning device 10 includes an acceleration sensor 11, a gyro sensor 12, and a vehicle speed pulse sensor 13. The acceleration sensor 11 is made of, for example, a piezoelectric element, detects the acceleration of the vehicle 90, and outputs acceleration data. The gyro sensor 12 is composed of, for example, a vibrating gyroscope, detects the angular velocity of the vehicle 90 when the direction of the vehicle 90 is changed, and outputs angular velocity data and relative azimuth data. The vehicle speed pulse sensor 13 measures a vehicle speed pulse composed of a pulse signal generated with the rotation of the wheel of the vehicle 90.

A GPS sensor (hereinafter simply referred to as “GPS”) 18 is positioning data (ie, GPS) from a plurality of GPS satellites to be used to detect the absolute position of the vehicle 90 from latitude and longitude information. This is a part for receiving radio waves 19 carrying downlink data including data.

The system controller 20 includes an interface 21, a CPU (Central Processing Unit) 22, a ROM (Read Only Memory) 23, and a RAM (Random Access Memory) 24, and is configured to control the entire navigation device 1. .

The interface 21 performs an interface operation with the acceleration sensor 11, the gyro sensor 12, the vehicle speed pulse sensor 13, and the GPS 18. From these, acceleration data, relative azimuth data, angular velocity data, GPS positioning data, absolute azimuth data and the like are input to the system controller 20 in addition to the vehicle speed pulse. The CPU 22 controls the entire system controller 20. The ROM 23 includes a nonvolatile memory (not shown) in which a control program for controlling the system controller 20 is stored. The RAM 24 stores various data such as route data preset by the user via the input device 60 so as to be readable, and provides a working area to the CPU 22.

The system controller 20, the disk drive 31, the data recording unit 36, the communication interface 37, the display unit 40, the audio output unit 50, the input device 60 and the photographing device 70 are connected to each other via the bus line 30.

The data recording unit 36 is configured by, for example, an HDD or the like, and records various data used for navigation processing such as map information, traveling video data photographed by the photographing device 70, and analysis data analyzed by the system controller 20. It is. The disk drive 31 reads and outputs content data such as music data and video data from the disk 33 under the control of the system controller 20. Further, the disk drive 31 records the above-described traveling video data and analysis data on the disk 33 under the control of the system controller 20. As the disk 33, for example, various disks such as DVD ± RW are applicable.

The communication device 38 includes, for example, an FM tuner, a beacon receiver, and the like, and acquires information distributed from a VICS (Vehicle Information Communication System) center or the like.

The photographing device 70 is, for example, a camera, and captures a traveling image while the vehicle 90 is traveling as described above. Here, it is assumed that the photographing device 70 also includes a microphone, and the traveling video includes sound as data in addition to images. The imaging device 70 is controlled by the system controller 20.

The display unit 40 displays various display data and images captured by the image capturing device 70 on the display screen of the display 44 under the control of the system controller 20. For example, when displaying map information as display data on the display screen, the system controller 20 reads map information from the data recording unit 36, and the display unit 40 is read from the data recording unit 36 by the system controller 20. The map information is displayed on the display screen. The display unit 40 includes a graphic controller 41 that controls the entire display unit 40 based on control data sent from the CPU 22 via the bus line 30, and image information that can be displayed immediately, such as a VRAM (Video） RAM) memory. A buffer memory 42 for temporarily recording, a display control unit 43 for controlling display of a display 44 such as a liquid crystal display or a CRT (Cathode Ray Tube) based on image data output from the graphic controller 41, and a display 44 are provided. Configured. The display 44 is composed of, for example, a liquid crystal display device having a diagonal size of about 5 to 10 inches, and is mounted near the front panel in the vehicle.

The audio output unit 50 is a D / A converter 51 that performs D / A (Digital-to-Analog) conversion of audio digital data sent from the RAM 24 or the like via the bus line 30 under the control of the system controller 20. An amplifier (AMP) 52 that amplifies the audio analog signal output from the converter 51 and a speaker 53 that converts the amplified audio analog signal into audio and outputs the audio to the vehicle are configured.

The input device 60 includes keys, switches, buttons, a remote controller, a voice input device, and the like for inputting various commands and data. The input device 60 is disposed around the front panel and the display 44 of the main body of the in-vehicle electronic system mounted in the vehicle. When the display 44 is a touch panel system, the touch panel provided on the display screen of the display 44 also functions as the input device 60.

[First embodiment]
A video recording / reproducing apparatus according to the first embodiment will be described. FIG. 3 shows a functional configuration of the video recording / reproducing apparatus 100 according to the first embodiment. Note that the video recording / reproducing apparatus 100 is substantially realized by each component of the navigation apparatus 1 shown in FIG. This will be specifically described below.

The video recording / reproducing apparatus 100 according to the first embodiment includes an imaging device 70, a GPS 18, an acceleration sensor 11, a gyro sensor 12, a vehicle speed pulse sensor 13, a traveling video recording unit 221, an image / audio analyzing unit 222, and a traveling state analyzing unit 223. , A scene division unit 224, a scene importance level determination unit 225, a digest reproduction control unit 226, a traveling video database 361, a traveling state database 362, a scene database 364, and a map database 363.

Here, the traveling video recording unit 221, the image / sound analysis unit 222, the traveling state analysis unit 223, the scene division unit 224, the scene importance level determination unit 225, and the digest reproduction control unit 226, for example, are executed by the system controller 20. It is realized by doing. In addition, the traveling video database 361, the traveling state database 362, the scene database 364, and the map database 363 are recorded in the data recording unit 36 or the writable disc 33.

The video recording / reproducing apparatus 100 according to the first embodiment obtains the running state of the vehicle 90 based on sensor signals from various sensors and performs scene division of the running video based on the obtained running state. Further, the video recording / reproducing apparatus 100 determines and sets the importance for each divided scene based on the obtained running state. Hereinafter, each function of the video recording / reproducing apparatus 100 according to the first embodiment will be described in detail.

The traveling image recording unit 221 records the traveling image captured by the imaging device 70 in the traveling image database 361. An example of information recorded in the traveling video database 361 is shown in FIG. As shown in FIG. 4, the traveling video database 361 records a traveling video ID that uniquely identifies the traveling video, a shooting start date and time, a time length, a file name, and the like.

The image / speech analysis unit 222 analyzes the image and sound from the running video and extracts the feature amount. Here, the feature amount is, for example, a feature amount of an image (hereinafter referred to as “image feature amount”), such as luminance, color histogram, edge information, motion information, and the like. Sound pressure power, sound frequency characteristics, and the like.

In the map database 363, map information used as reference information by the traveling state analysis unit 223 is recorded in advance. Map information includes, for example, road traffic information such as addresses, elevations, slopes, intersections, three-dimensional intersections, railroad crossings, tunnels, bridges, vehicle width, number of lanes, speed limit, expressways, ordinary roads, residential roads, parking lots, etc. Road attribute information, shops, facilities, famous buildings, parks, amusement parks, landmark information such as tourist attractions, topographical information such as sea, lake, river, mountain, view spot, speed limit, one-way road traffic law The above regulatory information, near miss points, etc.

The running state analysis unit 223 is recorded in the map database 363, various sensor signals detected from the GPS 18, the acceleration sensor 11, the gyro sensor 12, and the vehicle speed pulse sensor 13, the feature values obtained by the image / voice analysis unit 222. Various traveling states of the vehicle 90 are obtained based on the map information. The traveling state analysis unit 223 records the obtained traveling state together with various sensor signals and feature quantities in the traveling state database 362. The traveling state database 362 includes various sensor signals, feature amounts, traveling states obtained based on the various sensor signals and feature amounts, and frame IDs (or traveling images) that uniquely identify frames corresponding to the traveling states. (Time position in the middle) are recorded in association with each other. Here, it is needless to say that the driving state database 362 does not have to manage the sensor signal, the feature amount, and the driving state in an integrated manner, and may be configured by a plurality of databases that manage each of them.

The scene dividing unit 224 performs scene division of the running video based on the running state obtained by the running state analyzing unit 223. As a reference for performing scene division, for example, a change point of the running state or a characteristic time point of the running state can be given. The scene division unit 224 records scene information indicating the divided scenes in the scene database 364.

The scene importance level determination unit 225 determines and sets the importance level (hereinafter referred to as “scene importance level”) for each scene based on the running state in each scene divided by the scene division unit 224. The higher the importance of this scene, the higher the probability that the scene will be selected and played back during digest playback. The scene importance determination unit 225 records the scene importance obtained for each scene in the scene database 364.

The digest playback control unit 226 performs playback control by creating a schedule for digest playback of a running video. Specifically, the digest playback control unit 226 selects a scene to be played back and determines a playback speed according to the target playback time and the scene importance level.

The display unit 401 is a display device that performs normal reproduction and digest reproduction of a running video. For example, the display unit 401 corresponds to the display unit 40 when reproduction is performed in the vehicle 90. Needless to say, the display unit 401 is not limited to the display unit 40, and a display device such as another display may be used. The display unit 401 also displays GUI (Graphical User Interface) display of the operation menu, information related to the traveling video, and the like.

(Driving condition calculation method)
Next, a method for calculating the running state will be specifically described. FIG. 5 shows an example of information stored in the running state database 362. As shown in FIG. 5, as the type of traveling state of the vehicle, for example, traveling position, vehicle speed state, acceleration / deceleration state, heading, turning state, inclination state, image information, audio information, address, section boundary, altitude state, Examples include geographical spots, road conditions, landscape conditions, and near-miss points. The traveling state analysis unit 223 obtains each traveling state based on various sensors and feature amounts. Then, the traveling state analysis unit 223 records the obtained traveling state in the traveling state database 362 in association with the frame in the traveling image (or the time position in the traveling image). Below, each driving | running | working state is demonstrated concretely.

The traveling position of the vehicle 90 is obtained based on a sensor such as GPS18. Specifically, the traveling state analysis unit 223 obtains the traveling position of the vehicle 90 by latitude and longitude based on the sensor signal from the GPS 18. Alternatively, the traveling state analysis unit 223 may determine the traveling position of the vehicle 90 by using autonomous navigation based on sensor signals from the gyro sensor 12 and the vehicle speed pulse sensor 13 instead of doing this. Further, the traveling state analysis unit 223 may correct the obtained traveling position of the vehicle 90 by using map matching navigation that performs collation with map information. The traveling state analysis unit 223 records the obtained traveling position of the vehicle 90 in the traveling state database 362.

The vehicle speed state of the vehicle 90 is obtained based on the sensor signal from the vehicle speed pulse sensor 13. Specifically, the traveling state analysis unit 223 obtains the vehicle speed based on the sensor signal from the vehicle speed pulse sensor 13. Then, based on the obtained vehicle speed, the traveling state analysis unit 223 includes, for example, the vehicle 90 in any state among the vehicle speed states of stopping, normal traveling, traffic jam section, low speed traveling, and high speed traveling. Ask for. The traveling state analysis unit 223 records the obtained vehicle speed and the vehicle speed state in the traveling state database 362.

The acceleration / deceleration state of the vehicle 90 is obtained based on sensor signals from the acceleration sensor 11 and the like. Specifically, the running state analysis unit 223 obtains acceleration based on a sensor signal from the acceleration sensor 11 or by analyzing a change in the running position. Then, based on the obtained acceleration, the traveling state analysis unit 223 determines whether the vehicle 90 is in an acceleration / deceleration state such as sudden acceleration or sudden braking. The traveling state analysis unit 223 records the obtained acceleration and acceleration / deceleration state in the traveling state database 362.

The direction and turning state of the vehicle 90 are obtained based on sensor signals from the gyro sensor 12 and the like. Specifically, the traveling state analysis unit 223 obtains the azimuth, the angular velocity, and the angular acceleration based on a sensor signal from the gyro sensor 12 or by analyzing a change in the traveling position. Then, based on the obtained angular velocity and angular acceleration, the traveling state analysis unit 223 determines which state the vehicle 90 is in, for example, each turning state of a right / left turn section, a straight traveling section, or a winding section. The traveling state analysis unit 223 records the obtained azimuth, angular velocity, angular acceleration, and turning state in the traveling state database 362.

The inclination state of the vehicle 90 is obtained based on sensor signals from the acceleration sensor 11 and the like. Specifically, the traveling state analysis unit 223 obtains the inclination angle of the vehicle 90 based on a sensor signal from the acceleration sensor 11 or by collating the traveling position with map information. Then, based on the obtained inclination angle, the traveling state analysis unit 223, for example, the vehicle 90 in any state of flat, uphill, steep uphill, downhill, and steep downhill inclination states. Ask if there is. The traveling state analysis unit 223 records the obtained inclination angle and inclination state in the traveling state database 362.

The image information is obtained based on the image feature amount extracted by the image / speech analysis unit 222. Specifically, the running state analysis unit 223 analyzes image feature amounts such as luminance, color histogram, edge information and motion information, thereby indicating image information indicating each sign such as a white line, a road sign, a guide sign, Image information indicating traffic lights, vehicles, pedestrians, etc. is obtained. In addition to this, the traveling state analysis unit 223 may increase the detection accuracy of these pieces of image information by collating the traveling position with the map information or using the audio feature amount. The traveling state analysis unit 223 records the obtained luminance, color histogram, edge information, motion information, image information, and the display position of the image information in the frame in the traveling state database 362.

The audio information is obtained based on the audio feature amount extracted by the image / audio analysis unit 222. Specifically, the running state analysis unit 223 obtains voice information indicating a human voice, a hustle sound, a horn sound, a brake squeal sound, and the like by analyzing voice feature values such as sound pressure power and sound frequency characteristics. . In addition to this, the traveling state analysis unit 223 may increase the detection accuracy of the audio information by collating the traveling position with the map information or by using the image feature amount. The traveling state analysis unit 223 records the obtained sound pressure power, frequency characteristics, and voice information in the traveling state database 362.

Information such as the address of the travel position and whether or not the travel position is at the partition boundary is obtained by collating the travel position with the map information. Here, examples of the partition boundaries include prefectural boundaries, municipal boundaries, town / character boundaries, and chome boundaries. Specifically, the traveling state analysis unit 223 obtains an address by collating the traveling position with map information, and determines whether or not the vehicle 90 is located at the partition boundary. Instead of doing this, the traveling state analysis unit 223 may obtain the address by performing text analysis based on the image feature amount. The traveling state analysis unit 223 records the obtained address and section boundary in the traveling state database 362.

The altitude state is obtained by comparing the traveling position with the map information. Specifically, the traveling state analysis unit 223 obtains the altitude by comparing the traveling position with map information. Then, based on the obtained altitude, the traveling state analysis unit 223 determines whether the vehicle 90 is located at a characteristic altitude point such as the highest altitude point of the pass, the highest altitude point on the route, or the lowest altitude point. Ask for. Instead of doing this, the navigation device 1 may include an altimeter, and the traveling state analysis unit 223 may obtain the altitude based on the value of the altimeter. The traveling state analysis unit 223 records information such as whether or not the vehicle 90 is located at the obtained elevation and a characteristic elevation point in the traveling state database 362.

The travel spot or geographic spot information in the vicinity thereof is obtained by the travel state analysis unit 223 collating the travel position with the map information. Geographic spot information includes things related to road traffic such as intersections, three-dimensional intersections, railroad crossings, tunnels, bridges, stores, facilities, famous buildings, parks, amusement parks, tourist attractions, sea, Things related to topography such as lakes, rivers, mountains, and viewing spots. The traveling state analysis unit 223 records the obtained geographical spot information in the traveling state database 362.

The road type of the traveling position is obtained by the traveling state analysis unit 223 collating the traveling position with the map information. As road types, for example, express roads, toll roads, general roads, residential roads, parking lots, road attributes such as road width and number of lanes, speed limits, road traffic laws such as one-way traffic, etc. There are regulations. The traveling state analysis unit 223 records the road type of the traveling position thus obtained in the traveling state database 362.

The landscape state information indicating the scenery around the travel position is obtained by the travel state analysis unit 223 collating the travel position with the map information. Examples of the landscape state information include an urban area, a countryside, a mountainous area, and a coastal coast. The traveling state analysis unit 223 records the landscape state information thus obtained in the traveling state database 362.

Information such as whether or not the vehicle 90 is located at the near-miss point is obtained by the traveling state analysis unit 223 collating the traveling position with the map information. Here, near-miss points mean dangerous places and difficult places on road traffic. The place of occurrence is listed. The traveling state analysis unit 223 records information indicating whether or not the traveling position is at a near-miss point in the traveling state database 362.

(Scene division method)
Next, the scene division method will be described. In general, since a broadcast program is edited content, it is possible to divide a scene by detecting a “shooting discontinuity point”, specifically, a scene change. The scene divided in this way roughly corresponds to one meaningful unit and plays a very important role in understanding the meaning of the content. On the other hand, in the case of a running video, after shooting is started, the content has no “shooting discontinuity” until shooting is completed unless the user intentionally stops shooting. That is, in the case of a running video, it is difficult to divide a scene by detecting “shooting discontinuities”. However, when performing digest playback, it is essential to understand the meaning of the content. For this purpose, it is necessary to divide the travel image into meaningful units.

Therefore, in the first embodiment, the scene dividing unit 224 performs scene division of the running video at the change point or characteristic time point of the running state recorded in the running state database 362. FIG. 6 lists examples of travel state change points, and FIG. 7 lists examples of characteristic time points of the travel state. However, all of the change points of the running state and the characteristic time points of the running state are not necessarily used for scene division. Instead, it goes without saying that scene division may be performed using only those effective in the system. The scene division unit 224 performs scene division on the running video with reference to the time points shown in FIGS. 6 and 7, and then records the divided scenes in the scene database 364. At this stage, for example, a travel video ID, a scene ID for identifying a scene in the travel video, and a start time and an end time in the travel video of the scene are recorded in the scene database 364 (see FIG. 10 described later).

(Scene importance calculation method)
Next, a method for calculating the scene importance will be described. Here, as an example, a method using a traveling state importance determination table will be described.

FIG. 8 and FIG. 9 show the importance determination tables for the running state. The travel state importance determination table predefines the importance of various travel states. 8 and 9, the importance is represented by a numerical value. Specifically, a positive integer indicates a higher importance as the value is positive, and a negative integer indicates a lower importance as the value is negative. This importance determination table is recorded in advance in the data recording unit 36 or the like.

The scene importance determination unit 225 refers to the importance determination table for each scene divided by the scene division unit 224, obtains the importance of various running states, and determines the importance of the obtained various running states. The scene importance of each scene is determined by summing the degrees. For example, for a traveling state of a scene, the vehicle 90 is traveling at a low speed and includes a guide sign as image information, an intersection and a tourist attraction as geographical spot information, and a type of landscape state Is an urban area, the scene importance is obtained as follows with reference to FIGS.

Scene importance = 0 (traveling) + (-5) (low-speed traveling) + 25 (guide sign) + 30 (intersection) + 50 (tourist attraction) + 15 (city area) = 115
The scene importance determination unit 225 determines the scene importance for each scene as described above, and records the calculated scene importance in the scene database 364. An example of data recorded in the scene database 364 is shown in FIG. As shown in FIG. 10, at this time, in the scene database 364, in addition to the travel video ID, the scene ID for identifying the scene in the travel video, the start time and end time in the travel video of the scene, The scene importance determined at 225 is recorded.

FIG. 11 shows a tendency of the priority by obtaining the scene importance based on FIGS. 8 and 9. Here, the priority indicates the priority to be played back during digest playback. In FIG. 8, for example, when looking at “turning state” as one of the types of traveling states shown in FIG. 8, the “right / left turn point” is set to 50, and “straight section” is important. The degree is set to −5, and the importance of “winding section” is set to 10. Therefore, as a tendency of the importance of the scene, the priority increases when the scene includes a right / left turn point or a winding section, and the priority decreases when the scene includes a straight section. Since the right / left turn point is more important than the winding section, the scene including the right / left turn point has a higher priority than the scene including the winding section.

In the example shown in FIGS. 8 and 9 described above, a positive value and a negative value are used as importance values, but the present invention is not limited to this. Instead of doing this, the importance value may be represented by an integer value of 0 or more, such as a continuous value from 0 to 100. In this case, for example, the importance is set to increase as the value increases. Alternatively, instead of doing this, the importance value may be indicated by a three-level evaluation, for example, importance = 2, normal = 1, and boredom = 0.

As described above, it is possible to appropriately obtain the scene importance for each scene in the running video.

(Digest playback method)
Next, a digest reproduction method will be described. The digest playback control unit 226 performs scheduling to select a scene to be played back, and performs digest playback by playing back the scene according to the scheduling. More specifically, the digest playback control unit 226 performs playback based on the scene importance and the scene time length (that is, the time length of the scene) on the condition of the target playback time of the digest playback as a condition. Select the scene you want. This will be described in more detail below.

First, the digest reproduction control unit 226 sets a target reproduction time T for digest reproduction. Here, the target reproduction time T is set to a time corresponding to the ratio to the total time of the traveling video or a predetermined time. Instead of doing this, the target reproduction time T may be set to the time input by the user via the input device 60.

The digest playback control unit 226 sequentially selects scenes having higher scene importance from the scene database 364, and determines the scene playback speed for the selected scene. The reproduction speed indicates the degree of double speed reproduction such as constant speed reproduction, double speed reproduction, and N double speed reproduction. Here, high speed playback is performed as N increases. As a method for determining the reproduction speed, for example, any one of the following criteria (a) to (d) is used. In this way, digest reproduction can be performed in a short time.

(A) Scenes with high importance are played back at a constant speed, and as the scene becomes lower, playback is faster.

(B) Scenes with a fast scene selection order are played at a constant speed, and at a slower speed, the scene is played back at a higher speed.

(C) A scene with a short scene length is played back at a constant speed, and a longer scene is played back at a higher speed.

(D) A combination of (a), (b) and (c) above.

The digest playback control unit 226 calculates the scene playback time Tsi for the selected scene based on the scene time length and the scene playback speed. The scene playback time Tsi is calculated as follows.

Scene playback time Tsi = scene time length / scene playback speed The digest playback control unit 226 calculates the scene playback time Tsi for each of the scenes selected in descending order of the scene importance from the scene database 364, and those scene playbacks thus calculated. The digest reproduction time Td is calculated by adding the times Tsi. When the digest playback time Td becomes equal to or longer than the target playback time T, the digest playback control unit 226 causes the scene selected so far to be in the specified playback speed in the time series of shooting. Perform scheduling. The digest reproduction control unit 226 reproduces each scene on the display unit 401 according to the scheduling determined in this way. By doing so, it is possible to perform digest reproduction giving priority to reproduction of important scenes.

(Control processing)
Next, control processing by the video recording / reproducing apparatus 100 will be described with reference to the flowcharts of FIGS.

FIG. 12 is a flowchart showing an overall control process in which a scene of a running image is divided based on the running state of the vehicle, and an importance is set for each scene and digest reproduction is performed. FIG. 13 is a flowchart showing a control process for performing scheduling for digest reproduction.

First, in step S101, a travel image is captured by the image capturing device 70, and the captured travel image is input to the image recording / reproducing device 100. The travel video recording unit 221 records the input travel video in the travel video database 361.

In step S102, various sensor signals are input to the video recording / reproducing apparatus 100 from the GPS 18, the acceleration sensor 11, the gyro sensor 12, the vehicle speed pulse sensor 13, and the like. In step S <b> 103, the image / audio analysis unit 222 analyzes the running video and extracts an image feature amount and an audio feature amount. In step S <b> 104, the traveling state analysis unit 223 obtains various traveling states based on various sensor signals and feature amounts, and records them in the traveling state database 362.

In step S105, the scene dividing unit 224 is recorded in the travel video database 361 based on the travel state obtained in step S104, more specifically, based on the change point of the travel state and the characteristic time point. Performs scene division of running images. Thereby, a driving | running | working image | video can be divided | segmented into the scene of a meaningful content. The scene dividing unit 224 records the divided scenes in the scene database 364.

In step S106, the scene importance level determination unit 225 determines and sets the scene importance level for each scene recorded in the scene database 364 based on various running states in each scene. In this way, an appropriate scene importance can be set for each scene.

In step S107, the digest reproduction control unit 226 performs scheduling for selecting an important scene to be reproduced. The scheduling control process in step S107 will be described with reference to FIG.

First, in step S201, the digest reproduction control unit 226 sets a target reproduction time T. In subsequent step S202, the digest reproduction control unit 226 sets the digest reproduction time Td to “0”. This process is a process for initializing the digest playback time Td.

In step S203, the digest playback control unit 226 selects a scene having the highest scene importance from the scenes recorded in the scene database 364. In subsequent step S204, the digest playback control unit 226 determines the scene playback speed for the selected scene based on the scene importance level and the scene time length.

In step S205, the digest playback control unit 226 obtains the scene playback time Tsi by dividing the scene time length by the scene playback speed for the selected scene. In subsequent step S206, the digest reproduction control unit 226 sets a value obtained by adding the scene reproduction time Tsi to the digest reproduction time Td as a new digest reproduction time Td.

In step S207, the digest reproduction control unit 226 determines whether the digest reproduction time Td is equal to or longer than the target reproduction time T. If the digest playback control unit 226 determines that the digest playback time Td is less than the target playback time T (step S207: No), the digest playback control unit 226 returns to the process of step S203, and next to the previously selected scene. For scenes with a high degree of importance, processing similar to that described in steps S204 to S206 is performed. On the other hand, when the digest playback control unit 226 determines that the digest playback time Td is equal to or longer than the target playback time T (step S207: Yes), the process proceeds to step S208, and the scene selected so far. Are scheduled in accordance with the photographed time series and at a designated playback speed. Thereafter, the digest reproduction control unit 226 proceeds to the process of step S108 in FIG.

Returning to FIG. 12 and continuing the description, in step S108, the digest playback control unit 226 plays back the scene according to the scheduling set in the processing of FIG. Thereafter, the digest reproduction control unit 226 ends this control process.

As described above, in the first embodiment, the running state of the vehicle is obtained based on sensor signals from various sensors, and the scene division of the running image is performed based on the obtained running state. In the first embodiment, scene importance is set for each divided scene based on the running state. By dividing the scene of the running video based on the running state, the running video can be divided into scenes of meaningful content. In addition, by setting the scene importance level for each divided scene based on the running state, it is possible to set an appropriate scene importance level for each scene. There is no need to leak.

[Second Embodiment]
Next, a video recording / reproducing apparatus according to the second embodiment will be described.

Since the road on which the user is always traveling is a place familiar to the user, it is considered that the scene when traveling on such a road should be excluded during digest playback. On the other hand, the first or less frequently run road is a fresh place for the user, so the scene when driving on such a road should be actively played back during digest playback. It is believed that there is. Therefore, in the video recording / playback apparatus according to the second embodiment, the scene importance is set for each scene of the running video based on the running history in addition to the running state.

FIG. 14 shows a functional configuration of the video recording / reproducing apparatus 100a according to the second embodiment. 14, the same functions as those of the video recording / playback apparatus 100 according to the first embodiment are denoted by the same reference numerals as those shown in FIG. Similar to the video recording / reproducing apparatus 100 according to the first embodiment, the video recording / reproducing apparatus 100a according to the second embodiment is actually realized by each component of the navigation apparatus 1 shown in FIG. .

As can be seen from FIG. 14, the video recording / reproducing apparatus 100a according to the second embodiment has a configuration including a travel history database 365 in addition to the functional configuration of the video recording / reproducing apparatus 100 according to the first embodiment.

The travel state analysis unit 223 records the travel state obtained based on various sensor signals or feature quantities in the travel state database 362, and appropriately records the travel position recorded in the travel state database 362. Back up to 365.

The scene importance level determination unit 225 obtains the number of times the route has traveled in each divided scene based on the travel history recorded in the travel history database 365. The scene importance level determination unit 225 determines the importance level according to the number of travel times of the route in each scene, for example, using a travel frequency importance level determination table as shown in FIG. . Then, the scene importance level determination unit 225 calculates the scene importance level by adding the importance level corresponding to the number of times of travel to the value obtained by summing the importance levels of the driving state for each scene.

For example, in the importance determination table for the number of travels shown in FIG. 15, the route is set so that the importance is increased as the route is less traveled, and the importance is set smaller as the route is traveled more frequently. By doing in this way, the importance level of each scene is set so that the importance level is set to be larger for a route having a smaller number of times of travel corresponding to the scene, and the importance level is less for a route having a greater number of times of travel corresponding to the scene. Will be set. As a result, the road on which the user is always traveling has a low priority at the time of digest reproduction, and the first road or the road having a small number of runs has a high priority at the time of digest reproduction.

As can be seen from the above description, in the second embodiment, the scene importance level is set for each scene of the running video based on the running history in addition to the running state. In this way, an appropriate scene importance level corresponding to the number of travels can be set for each scene.

[Third embodiment]
Next, a video recording / reproducing apparatus according to the third embodiment will be described.

Since the vicinity of the user's home and the commuting route is a familiar place, it is considered that scenes of such a place should be excluded during digest playback. On the other hand, a scene such as a memory location for the user is a scene that is highly appreciated by the user, so it is considered that the scene should be actively played back during digest playback. Therefore, in the video recording / playback apparatus according to the third embodiment, the scene importance is set for each scene of the running video based on the personal information that is the personal information of the user in addition to the running state. .

FIG. 16 shows a functional configuration of the video recording / reproducing apparatus 100b according to the third embodiment. In FIG. 16, functions similar to those of the video recording / reproducing apparatus 100 according to the first embodiment are denoted by the same reference numerals as those shown in FIG. Similar to the video recording / reproducing apparatus 100 according to the first embodiment, the video recording / reproducing apparatus 100b according to the third embodiment is actually realized by each component of the navigation apparatus 1 shown in FIG. .

As can be seen from FIG. 16, the video recording / playback apparatus 100b according to the third embodiment has a personal information database 366 in addition to the functional configuration of the video recording / playback apparatus 100 according to the first embodiment.

In the personal information database 366, as personal information, for example, the location of a familiar place such as a home, a home, or a company, a commuting route, a location of a memory location, and the like are recorded. These data are recorded in advance by the user.

The scene importance level determination unit 225 determines whether or not the traveling position in each scene is near the position or route recorded as personal information in the personal information database 366. When the scene importance degree determination unit 225 determines that the traveling position in each scene is in the vicinity of the position or route recorded as personal information in the personal information database 366, for example, personal information as shown in FIG. The importance level corresponding to the personal information is obtained for each scene using the importance level determination table. Then, the scene importance level determination unit 225 calculates the scene importance level by adding the importance level according to the personal information to the value obtained by summing the importance levels of the running states for each scene. For example, in the importance level determination table for personal information shown in FIG. 17, the importance level is set to be small near the home or near the commuting route, and the importance level is set to be large at the memory location. As a result, scenes near the user's home or near the commuting route have low priority during digest playback, and scenes at the user's memory location have high priority during digest playback.

As can be seen from the above description, in the third embodiment, the scene importance is set for each scene of the running video based on the personal information in addition to the running state. Even in this way, it is possible to set an appropriate scene importance according to personal information for each scene.

[Fourth embodiment]
Next, a video recording / reproducing apparatus according to the fourth embodiment will be described.

In the video recording / reproducing apparatus according to the above-described embodiments, the scene importance level of each scene of the running video is automatically determined. However, the video recording / playback apparatus according to each embodiment may fail to schedule a scene important for the user. Therefore, in the video recording / playback apparatus according to the fourth embodiment, the scene importance level is set for each scene of the running video based on the information on the important scene explicitly instructed by the user in addition to the running state. And

FIG. 18 shows a functional configuration of the video recording / reproducing apparatus 100c according to the fourth embodiment. 18, the same components as those of the video recording / reproducing apparatus 100 according to the first embodiment are denoted by the same reference numerals as those shown in FIG. Similar to the video recording / reproducing apparatus 100 according to the first embodiment, the video recording / reproducing apparatus 100c according to the fourth embodiment is actually realized by each component of the navigation apparatus 1 shown in FIG. .

As can be seen from FIG. 18, in addition to the functional configuration of the video recording / reproducing apparatus 100 according to the first embodiment, the video recording / reproducing apparatus 100c according to the fourth embodiment includes an important scene instruction means 14 and an important scene instruction information database. 367.

The important scene instructing means 14 is a means for notifying the video recording / reproducing apparatus 100c of this intention when the user thinks that the running video at this place is an important scene or wants to watch it later. . Specifically, the important scene instruction unit 14 is an input device such as a button, a switch, or a touch panel. Note that the important scene instruction unit 14 may be an input device that performs voice recognition for recognizing a user's voice or gesture recognition for recognizing a user's gesture. The important scene instruction unit 14 records the important scene instruction information instructed by the user in the important scene instruction information database 367. The important scene instruction information recorded in the important scene instruction information database 367 includes, for example, the time when the instruction is given by the user and the traveling position.

The scene importance level determination unit 225 calculates a scene importance level by adding a certain level of importance to a value obtained by summing the importance levels of the driving state for a scene including an important scene instructed by the user. By doing so, the importance level is set to be large for scenes including the important scene instructed by the user, and the priority level during digest playback is increased.

As can be seen from the above description, in the fourth embodiment, the scene importance is set for each scene of the running video based on the important scene instruction information in addition to the running state. In this way, it is possible to perform digest playback without missing a scene that the user wants to see.

[Application example]
Next, application examples of the video recording / reproducing apparatus according to the above-described embodiments will be described. In each of the embodiments described above, scene division of a running video is performed, and scene importance is set for each divided scene. However, the present invention is not limited to this, and scene importance may be set for each frame, which is the minimum unit of the scene, without performing scene division of the running video.

FIG. 19 shows a functional configuration of a video recording / reproducing apparatus 100d according to an application example. A video recording / reproducing apparatus 100d shown in FIG. 19 shows an application example of the video recording / reproducing apparatus 100 according to the first embodiment as an example. In FIG. 19, the same components as those of the video recording / reproducing apparatus 100 according to the first embodiment are denoted by the same reference numerals as those shown in FIG.

19, unlike the video recording / reproducing apparatus 100 according to the first embodiment, the video recording / reproducing apparatus 100d according to the application example includes an index database 368 instead of the scene dividing unit 224 and the scene database 364.

In the video recording / reproducing apparatus 100d according to the application example, the scene importance determination unit 225 calculates the scene importance for each frame of the driving video based on the driving state. FIG. 20 is a graph showing a change in the importance of the scene with respect to the time of the running video.

When the scene importance level exceeds a predetermined threshold, the scene importance level determination unit 225 assigns an index to the frame having the highest importance level within the exceeded section. The indicated frame ID or the time position at that time is recorded in the index database 368. Then, the scene importance level determination unit 225 displays a list of frames with indexes as representative images on the display unit 401. The user selects an arbitrary image from the representative images displayed as a list on the display unit 401. In this way, the user can perform skip playback that skips unnecessary scenes.

Control processing by the video recording / reproducing apparatus 100d according to the application example described above will be described with reference to the flowchart of FIG.

The processing from step S301 to S304 is the same as the processing from step S101 to S104 described in FIG.

In step S <b> 305, the scene importance level determination unit 225 determines the importance of the scene based on the driving state (or in addition to the driving history and personal information) for each frame of the driving video recorded in the driving video database 361. Set the degree.

In step S306, when the scene importance level exceeds a predetermined threshold value for each frame for which the scene importance level is set, the scene importance level determination unit 225 has the highest importance level in the exceeded section. Is recorded in the index database 368.

In step S307, the scene importance level determination unit 225 displays a list of frames to which indexes have been assigned as representative images on the display unit 401, and ends this control process.

Also by the video recording / reproducing apparatus 100d according to the application example described above, the user can skip unnecessary scenes. Thereby, the user can confirm only an important scene, and can fully confirm the content of a driving | running | working image | video in a short time.

[Modification]
The present invention is not limited to the above-described embodiments, and can be changed as appropriate without departing from the spirit or idea of the invention that can be read from the claims and the entire specification. Is also included in the technical scope of the present invention.

For example, in the above description, the controls in the first to fourth embodiments and application examples have been described separately, but the controls in the first to fourth embodiments and application examples may be appropriately combined and executed.

Further, in each of the above-described embodiments, the imaging device 70 captures a traveling image that is an image around the traveling vehicle 90, but is not limited thereto, and in addition, the interior of the vehicle 90 (Hereinafter, referred to as “vehicle interior video”) may be taken, and scene splitting and scene importance setting may be performed for the vehicle interior video in accordance with the driving state. In each of the above-described embodiments, the video recording / reproducing apparatus uses the GPS 18, the acceleration sensor 11, the gyro sensor 12, and the vehicle speed pulse sensor 13 to obtain the traveling state. However, this is only an example, and it goes without saying that the video recording / reproducing apparatus may obtain the running state using some of these sensors.

Furthermore, the video recording / reproducing apparatus may obtain the running state using another sensor in addition to all or a part of the above-described sensors. Further, in each of the above-described embodiments, the video recording / playback apparatus analyzes the image and sound included in the video to obtain the image feature amount and the sound feature amount, and uses these feature amounts to obtain the running state. However, it is not limited to this. Instead of this, it goes without saying that the video recording / reproducing apparatus may obtain the running state using only one of the image feature quantity and the audio feature quantity.

In the first to fourth embodiments, all the functions of the video recording / reproducing apparatus are realized by the navigation apparatus 1, but the present invention is not limited to this. Instead of this, all or some of the functions of the video recording / playback apparatus may be realized by another apparatus different from the navigation apparatus 1. For example, the system controller of the navigation device 1 has functions of a traveling video recording unit, an image / sound analysis unit, and a traveling state analysis unit, and another audio device different from the navigation device 1 includes a scene dividing unit, a scene importance level It may have functions of a determination unit and a digest reproduction control unit. In this case, the navigation device 1 obtains the traveling state based on sensor signals from various sensors and records the obtained traveling state in the traveling state database. Here, the traveling video database and the traveling state database are recorded on a disc or the like. Then, the other audio apparatus performs scene reproduction and scene importance determination by using the traveling video database and the traveling state database recorded on the disc or the like, and performs digest reproduction.

It should be noted that the video recording / reproducing apparatus of the present invention is not limited to being applied to a vehicle navigation apparatus, but may be applied to a navigation apparatus mounted on a bicycle or a mobile phone instead. Yes. That is, the video recording / reproducing apparatus of the present invention can be applied to other mobile navigation devices that are not limited to vehicles.

INDUSTRIAL APPLICABILITY The present invention can be used for a car navigation device equipped with a camera for photographing, a PND (Personal Navigation Device), a car AV system, a mobile phone, a cycle computer, a GPS logger, and other in-vehicle devices or mobile devices. .

Claims (15)

1. Photographing means provided in the moving body;
   Video recording means for recording the video imaged by the imaging means;
   Traveling state analysis means for determining the traveling state of the moving body;
   A video recording / reproducing apparatus comprising: an importance level determination unit configured to determine and set the level of importance for each scene of the video based on the obtained running state.
2. The said running condition analysis means calculates | requires the said running condition based on the feature-value calculated | required by analyzing at least 1 or more among the image and audio | voice contained in the said image | video. Video recording and playback device.
3. The traveling state analyzing means obtains the traveling state based on a sensor signal from at least one of a GPS sensor, an acceleration sensor, a gyro sensor, and a vehicle speed pulse sensor. 3. The video recording / reproducing apparatus according to 1 or 2.
4. Having map information recording means for recording map information;
   The video recording / reproducing apparatus according to claim 2, wherein the running state analyzing unit obtains the running state based on the map information.
5. Having travel history recording means for recording the travel history of the mobile body;
   5. The importance level determination unit determines and sets the level of importance for each scene of the video based on the travel history and the travel state. 6. Video recording and playback device.
6. Having personal information recording means for recording user's personal information;
   The importance level determination unit determines and sets the importance level for each scene of the video based on the personal information and the running state. Video recording and playback device.
7. An instruction means for the user to indicate information indicating an important scene;
   The importance level determination unit determines and sets the importance level for each scene of the video based on information instructed by the user and the running state. The video recording / reproducing apparatus according to one item.
8. The video recording / reproducing apparatus according to any one of claims 1 to 7, further comprising scene dividing means for dividing the video into a plurality of scenes based on the running state.
9. The video according to claim 1, wherein the importance level determination unit determines and sets the level of importance for each frame of the video based on a traveling state of the moving body. Recording / playback device.
10. 9. The apparatus according to claim 1, further comprising digest reproduction control means for controlling reproduction by creating a schedule for digest reproduction according to the importance set for each scene of the video. The video recording / reproducing apparatus as described.
11. 11. The video recording / playback apparatus according to claim 10, wherein the digest playback control means schedules the video scene preferentially as the importance set for the video scene increases.
12. 12. The video recording / playback apparatus according to claim 10, wherein the digest playback control unit plays back the video scene faster as the importance set in the video scene becomes lower.
13. The video recording / playback apparatus according to any one of claims 10 to 12, wherein the digest playback control means plays back the video scene faster as the time length of the video scene becomes longer.
14. A photographing step of photographing an image by photographing means provided in the moving body;
    A video recording step for recording the video imaged by the imaging means;
    A running state analyzing step for obtaining a running state of the moving body;
    An importance level determining step of determining and setting the importance level for each scene of the video based on the obtained running state.
15. A video recording / playback program executed by a navigation device having photographing means,
    Video recording means for recording the video imaged by the imaging means;
    Traveling state analysis means for determining the traveling state of the moving body,
    An image recording / reproducing program that causes the navigation device to function as importance determining means for determining and setting importance for each scene of the image based on the obtained running state.

Images