JP2011071642A - Moving picture storage system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture memory system which can search image data composing moving picture data from behavior of a vehicle. <P>SOLUTION: A data creation unit 15 acquires moving picture data which are constituted of a plurality of image data from a camera 12 outside a vehicle cabin, acquires position data of the vehicle from a GPS receiver 11, and acquires vehicle data showing at least one kind of behavior of a vehicle corresponding at least a part of image data in a plurality of image data from a first on-vehicle ECU (Electronic Control Unit) 18a to a third on-vehicle ECU 18c. It creates processed moving picture data making the vehicle data as a search key, which include a plurality of image data, and correspond the vehicle data to image data corresponding to the vehicle data, and stores the created processed moving picture data in a memory unit 14. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a moving image storage system that stores moving image data composed of a plurality of image data.

  Conventionally, there is a landscape moving image display navigation device disclosed in Patent Document 1 as an example of storing moving image data composed of a plurality of image data. The landscape moving image display navigation device disclosed in Patent Document 1 captures image data (still image) of a landscape around a vehicle at predetermined distances from an intersection, and stores the image data together with position data specifying the location where the image data was captured. . Then, the image data from the intersection to the intersection is converted into a moving image, and the animated moving image data (landscape moving image) is stored together with the road data corresponding to the road link between the intersections.

JP 2004-212232 A

  As described above, the landscape moving image display navigation device disclosed in Patent Document 1 stores image data together with position data for specifying a place where image data is captured, so that the distance of the vehicle travels a predetermined distance from the intersection. Can be read out.

  However, although the landscape moving image display navigation device disclosed in Patent Document 1 can retrieve image data from the position of the vehicle, it cannot retrieve moving image data from the behavior of the vehicle (for example, vehicle speed, steering angle, etc.). There's a problem.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a moving image storage system capable of searching image data constituting moving image data from the behavior of a vehicle.

In order to achieve the above object, the moving image storage system according to claim 1 constitutes moving image data, and includes a plurality of image data including images captured by an in-vehicle camera mounted on the vehicle, and a plurality of images. Storing video data with a search key that is associated with at least a part of the image data of the data and includes a search key for searching the image data,
Movie data acquisition means for acquiring movie data composed of a plurality of image data,
Vehicle data acquisition means for acquiring vehicle data indicating at least one kind of behavior of the vehicle corresponding to at least some of the image data in the plurality of image data;
Data creating means including a plurality of image data, associating vehicle data with image data corresponding to the vehicle data, and creating moving image data with a search key using the vehicle data as a search key;
Storage means for storing moving image data with a search key created by the data creation means;
It is characterized by providing.

  Thus, the moving image storage system associates the vehicle data indicating at least one kind of behavior of the vehicle with the image data corresponding to the vehicle data, and stores the moving image data with the search key created using the vehicle data as the search key. The image data can be retrieved from the vehicle data (vehicle behavior).

  In addition, as shown in claim 2, only the vehicle data satisfying the vehicle data storage condition for each type of vehicle behavior may be associated with the image data.

  By doing so, only necessary vehicle data can be stored, which is preferable because the amount of vehicle data can be reduced.

  In addition, vehicle data required as a search key may change depending on the environment in which the vehicle is located. Accordingly, as shown in claim 3, surrounding information acquisition means for acquiring surrounding information indicating the surrounding environment where the vehicle is located, and vehicle data for changing the vehicle data storage condition according to the acquisition result of the surrounding information acquisition means You may make it provide a memory condition change means. This is preferable because necessary vehicle data can be associated with image data in accordance with the environment in which the vehicle is located.

  As for image data, as shown in claim 4, moving image data with a search key may be created only for image data when at least one of the vehicle data satisfies the image data storage condition. By doing so, it is possible to create moving image data with a search key only for necessary image data, which is preferable because the amount of moving image data with a search key can be reduced.

  Further, the image data necessary as the moving image data with the search key may change depending on the environment where the vehicle is located. Therefore, as described in claim 5, when the moving image data with the search key is created only for the image data when at least one of the vehicle data satisfies the image data storage condition, it is acquired by the peripheral information acquisition means. You may make it change image data storage conditions according to the environment (acquisition result) where the vehicle is located. By doing so, it is possible to create moving image data with a search key for only the necessary image data according to the environment in which the vehicle is located, so the data of the moving image data with a search key is included while including appropriate image data. This is preferable because the amount can be reduced.

  In addition, necessary vehicle data and image data may change depending on the environment in which the vehicle is located. Therefore, as described in claim 6, when the moving image data with the search key is created only for the image data when at least one of the vehicle data satisfies the image data storage condition, it is acquired by the peripheral information acquisition means. You may make it change vehicle data storage conditions and image data storage conditions according to the environment (acquisition result) where the vehicle is located. By doing so, it is possible to create moving image data with a search key for only the necessary vehicle data and image data according to the environment in which the vehicle is located, so it is possible to search while including appropriate vehicle data and image data. This is preferable because the data amount of keyed moving image data can be reduced.

  As described above, when creating moving image data with a search key only for image data when at least one of the vehicle data satisfies the image data storage condition, the image data storage condition may or may not be satisfied. It can happen in a short time. In such a case, the created moving image data with a search key becomes an intermittent moving image, which may be difficult to see.

  Accordingly, as described in claim 7, the moving image data with the search key is used for a predetermined time after at least one of the vehicle data satisfies the image data storage condition even if the vehicle data does not satisfy the image data storage condition. You may make it create. By doing so, a continuous moving image (moving image data with a search key) can be created for a predetermined time after at least one of the vehicle data satisfies the image data storage condition, thereby suppressing the amount of data. However, it can suppress that it becomes difficult to see a moving image.

  In addition, you may make it memorize | store the moving image data with a search key in the vehicle-mounted memory | storage part mounted in the vehicle, as shown in Claim 8. FIG. By doing in this way, the image data which comprises moving image data from the behavior of a vehicle can be searched in a vehicle interior.

  According to a ninth aspect of the present invention, the moving image data with the search key may be transmitted to an external station provided outside the vehicle and provided with an external storage unit for storing the moving image data with the search key. By doing so, it is possible to search for image data constituting the moving image data from the behavior of the vehicle even outside the vehicle interior.

In addition, as shown in claim 10, the moving image data with the search key is always stored in the in-vehicle storage unit mounted on the vehicle,
It is possible to communicate with an external station provided outside the vehicle and provided with an external storage unit for storing moving image data with a search key. When at least one of the vehicle data satisfies the image data storage condition, it is stored in the in-vehicle storage unit Of the moving image data with search key, communication means for transmitting the moving image data with search key for a predetermined time before and after the image data storage condition is satisfied to an external station may be provided.

  By doing so, it is possible to create moving image data with a search key mainly for necessary image data, which is preferable because the amount of moving image data with a search key can be reduced. Further, it is possible to create a continuous moving image (moving image data with a search key) for a predetermined time before and after at least one of the vehicle data satisfies the image data storage condition. Therefore, it is possible to suppress the difficulty in viewing the moving image while suppressing the data amount of the moving image data with the search key.

Moreover, as shown in claim 11, the moving image data with the search key is always stored in the in-vehicle storage unit mounted on the vehicle,
It is possible to communicate with an external station provided outside the vehicle and provided with an external storage unit for storing moving image data with a search key. When at least one of the vehicle data satisfies the image data storage condition, it is stored in the in-vehicle storage unit Communication means for transmitting to the external station moving image data with a search key for a predetermined time before and after the time when the image data storage condition is satisfied among the moving image data with a search key;
Surrounding information acquisition means for acquiring surrounding information indicating the surrounding environment where the vehicle is located;
Image data storage condition changing means for changing the image data storage condition according to the acquisition result of the peripheral information acquisition means may be provided.

  By doing so, it is possible to create video data with a search key mainly for necessary image data according to the environment in which the vehicle is located. Therefore, while including appropriate image data, This is preferable because the amount of data can be reduced. Further, it is possible to create a continuous moving image (moving image data with a search key) for a predetermined time before and after at least one of the vehicle data satisfies the image data storage condition. Therefore, it is possible to suppress the difficulty in viewing the moving image while suppressing the data amount of the moving image data with the search key.

Moreover, as shown in claim 12, the moving image data with the search key is always stored in the in-vehicle storage unit mounted on the vehicle,
It is possible to communicate with an external station that is provided outside the vehicle and includes an external storage unit that stores moving image data with a search key. When at least one of the vehicle data satisfies the image data storage condition, Communication means for transmitting to the external station moving image data with a search key for a predetermined time before and after the time when the image data storage condition is satisfied among the moving image data with a search key;
Surrounding information acquisition means for acquiring surrounding information indicating the surrounding environment where the vehicle is located;
Vehicle data storage condition changing means for changing the vehicle data storage condition according to the acquisition result of the peripheral information acquisition means;
Image data storage condition changing means for changing the image data storage condition according to the acquisition result of the peripheral information acquisition means may be provided.

  By doing this, it is possible to create video data with a search key for the necessary vehicle data and image data mainly depending on the environment where the vehicle is located, so including appropriate vehicle data and image data, This is preferable because the amount of moving image data with a search key can be reduced. Further, it is possible to create a continuous moving image (moving image data with a search key) for a predetermined time before and after at least one of the vehicle data satisfies the image data storage condition. Therefore, it is possible to suppress the difficulty in viewing the moving image while suppressing the data amount of the moving image data with the search key.

It is a block diagram which shows schematic structure of the vehicle equipment in embodiment of this invention. It is an image figure which shows schematic structure of the processed image data (moving image data with a search key) in embodiment of this invention. It is drawing which shows the sequence of the vehicle equipment in embodiment of this invention. It is a block diagram which shows schematic structure of the vehicle equipment in the modification 1. It is an image figure which shows schematic structure of the table for vehicle data determination in a modification 1 (an example). It is drawing which shows the sequence of the vehicle equipment in the modification 1. FIG. It is a block diagram which shows schematic structure of the vehicle equipment in the modification 2. It is drawing which shows the sequence of the vehicle equipment in the modification 2. It is a block diagram which shows schematic structure of the vehicle equipment in the modification 3. It is an image figure which shows schematic structure of the processed image data (moving image data with a search key) in the modification 3. It is drawing which shows the sequence of the vehicle equipment in the modification 3. FIG. It is a block diagram which shows schematic structure of the network containing the vehicle equipment in the modification 4. It is drawing which shows the sequence of the vehicle equipment in the modification 4.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

  In the present embodiment, an example in which the moving image storage system of the present invention is applied to the vehicle-mounted device 10 shown in FIG. 1 will be described. The in-vehicle device 10 is mounted on a vehicle, constitutes moving image data, and includes a plurality of image data and a plurality of image data captured by a vehicle exterior camera 12 (on-vehicle camera) mounted on the vehicle. Video data with a search key that is associated with at least a part of the image data and includes a search key (vehicle data) for searching the image data (also referred to as processed video data in the following description and drawings) Is stored in the storage unit 14 (on-vehicle storage unit).

  As shown in FIG. 1, the in-vehicle device 10 includes a GPS (Global Positioning System) receiver 11, an in-vehicle camera 12, a vehicle data receiving unit 13, a storage unit 14, a data creation unit 15, and the like, and via an in-vehicle network. The first on-vehicle ECU (Electronic Control Unit) 18a to the third on-vehicle ECU 18c are connected. The in-vehicle device 10 is connected to a search device 30 for searching for image data (for example, the first image of a moving image to be reproduced) from the processed image data stored in the storage unit 14.

  The GPS receiver 11 detects the current position of the vehicle, receives GPS signals emitted from a plurality of GPS satellites 40 (shown in a simplified manner in FIG. 1), and uses the received GPS signals. Position data indicating the current position of the vehicle is calculated. Further, the GPS receiver 11 outputs the calculated position data to the data creation unit 15. In the present embodiment, an example in which the GPS receiver 11 calculates position data indicating the current position of the vehicle will be described. However, the present invention is not limited to this. For example, the GPS receiver 11 may output the received GPS signal to the data creation unit 15 so that the data creation unit 15 calculates position data using the GPS signal.

  The vehicle exterior camera 12 is mounted on a vehicle and captures the exterior (front, front, rear, etc.) of the vehicle with a predetermined imaging cycle. Further, the vehicle exterior camera 12 outputs a moving image composed of a plurality of image data including a captured image (still image) to the data creation unit 15. The image data includes an image frame (or an image frame and difference data) indicating each still image, and an identification signal (here, which is associated with (linked to) each image frame and identifies each image frame. Frame No. is adopted).

  The vehicle data receiving unit 13 receives vehicle data indicating the behavior of the vehicle from the first in-vehicle ECU 18 a to the third in-vehicle ECU 18 c via the in-vehicle network, and outputs the vehicle data to the data creation unit 15. In the present embodiment, an example in which vehicle data indicating three types of behavior is received from each of the first in-vehicle ECU 18a to the third in-vehicle ECU 18c (three in-vehicle ECUs) will be described. It is not limited to. The present invention can achieve the object by acquiring vehicle data indicating at least one kind of behavior (for example, vehicle speed). Therefore, the object can be achieved if there is an electronic device that outputs vehicle data showing at least one kind of behavior to the data creation unit 15. Moreover, you may make it acquire several vehicle data from one vehicle-mounted ECU.

  As the vehicle behavior, for example, vehicle speed, acceleration, rudder angle, ABS (Antilock Brake System) operating status, ACC (Adaptive Cruise Control) control status, and the like can be adopted. That is, as the vehicle data, vehicle data indicating the vehicle speed, vehicle data indicating the acceleration, vehicle data indicating the steering angle, vehicle data indicating the ABS operation status, vehicle data indicating the ACC control status, and the like can be adopted. In the present embodiment, vehicle data indicating vehicle speed, vehicle data indicating acceleration, and vehicle data indicating steering angle will be described as vehicle data.

  Each of the first in-vehicle ECU 18a to the third in-vehicle ECU 18c is configured as a normal computer, and has a well-known CPU, ROM, RAM, I / O and a bus line for connecting these configurations (both shown in the figure). Not shown). In the present embodiment, the first vehicle-mounted ECU 18a will be described by adopting an example in which a vehicle speed sensor is mounted and vehicle data indicating the vehicle speed is output. The second in-vehicle ECU 18b will be described by adopting an example in which an acceleration sensor is mounted and vehicle data indicating the acceleration is output. Further, the third vehicle-mounted ECU 18c will be described by adopting an example in which a steering angle sensor is mounted and vehicle data indicating the steering angle is output.

  The data creation unit 15 is a so-called ECU (configured as a normal computer) that includes a well-known CPU, ROM, RAM, I / O and a bus line (none of which is shown) for connecting these components. Included in Electronic Control Unit). In other words, the data creation unit 15 is a functional block executed by the ECU.

  The data creation unit 15 acquires position data indicating the current position (coordinates) of the vehicle from the GPS receiver 11 (position data acquisition means). Moreover, the data creation part 15 acquires the moving image data comprised from several image data from the vehicle exterior camera 12 (moving image data acquisition means). Furthermore, the data creation unit 15 acquires vehicle data corresponding to at least some image data in the plurality of image data from the vehicle data reception unit 13 (vehicle data acquisition unit). As the vehicle data corresponding to the image data, vehicle data (vehicle behavior) acquired at the same time as the image data can be adopted.

  The data creation unit 15 includes a plurality of image data acquired from the vehicle exterior camera 12, and corresponds to the position data and vehicle data corresponding to the position data acquired from the GPS receiver 11 and the vehicle data acquired from the vehicle data reception unit 13. It associates (associates) with image data to be created, and creates moving image data with a search key using the vehicle data as a search key (data creation means). That is, processed moving image data that can search image data from vehicle data is created. In the processed moving image data in the present embodiment, since the position data is also associated with the image data, the image can be searched from the position.

  At this time, when the image data is acquired, the data creating unit 15 associates the position data (vehicle position) and the vehicle data (vehicle behavior) acquired simultaneously with the image data. That is, the position data (vehicle position) and the vehicle data (vehicle behavior) when the image data is acquired are associated with the image data. Further, when associating the image data with the position data and the vehicle data, as shown in FIG. 2, the frame number of the image data is associated with the position data and the vehicle data. In FIG. 2, the vehicle data describes only acceleration (deceleration).

  In the present embodiment, as described above, an example in which position data and vehicle data are associated as search keys with respect to image data will be described. However, the present invention is not limited to this. . For example, only image data and vehicle data may be associated as search keys, or image data, position data, vehicle data, and time data indicating the time when the image data was acquired may be associated as search keys. Also good. This time data may be acquired from the GPS receiver 11 or may be acquired by the data generation unit 15 itself with a clock provided in the data generation unit 15. In the processed moving image data in which the time data is associated with the image data, the image can be searched from the time.

  Further, it is not necessary to associate vehicle data or the like with all image data (frame No.). The object of the present invention can be achieved by associating vehicle data corresponding to at least some of the plurality of image data. That is, the object of the present invention can be achieved by associating vehicle data showing at least one type of behavior corresponding to at least some of the image data in the plurality of image data.

  The storage unit 14 is composed of a writable storage medium such as a hard disk. The storage unit 14 stores processed moving image data created by the data creation unit 15.

  The search device 30 is mounted on a vehicle. For example, the search device 30 includes a liquid crystal display and the like. The search 31 includes a display 31 for displaying processed moving image data output from the search unit 32 and a normal computer. The unit 32 and a signal indicating a search key (vehicle position, vehicle behavior, etc.) based on a user operation, which includes an input device such as a touch panel provided on the display surface of the plurality of mechanical switches and the display 31. Is input to the search unit 32, and an input unit 33 (input means) is provided.

  When a search key (vehicle position, vehicle behavior, etc.), a signal indicating a search start, or the like is input from the input unit 33, the search unit 32 receives a search input from the processed moving image data stored in the storage unit 14. The image data corresponding to the key is searched (search means). Then, when the corresponding image data can be searched, the search device 30 displays the image data on the display. The search device 30 can display a moving image from the searched image data on the display 31 when the search unit 32 searches for image data.

  Here, the processing operation of the vehicle-mounted device 10 will be described with reference to FIG.

  The GPS receiver 11, the vehicle exterior camera 12, the vehicle data receiving unit 13, and the data creating unit 15 are, for example, instructions for starting a processing operation when power is supplied or when an operation switch (not shown) is operated by the user. The processing operation is started at the timing when the signal is input.

  That is, the vehicle exterior camera 12 starts imaging and outputs captured moving image data (including a plurality of image data). The GPS receiver 11 starts receiving GPS signals and calculating position data, and outputs the calculated position data. Furthermore, the vehicle data receiving unit 13 starts receiving vehicle data from the first in-vehicle ECU 18a, the second in-vehicle ECU 18b, and the third in-vehicle ECU 18c, and outputs the received vehicle data.

  The data creation unit 15 acquires moving image data (a plurality of image data) from the vehicle exterior camera 12 (moving image data acquisition unit), acquires position data from the GPS receiver 11 (position data acquisition unit), and a vehicle data reception unit. Vehicle data is acquired from 13 (vehicle data acquisition means). When the image data is acquired, the data creation unit 15 associates the position data and the vehicle data acquired simultaneously with the image data, and associates the position data and the vehicle data with the position data and the vehicle data as a search key. Processed moving image data including a plurality of pieces of image data is created (data creation means). In addition, the data creation unit 15 stores the created processed moving image data in the storage unit 14 (storage unit).

  In this way, the processed video created by associating vehicle data (here, vehicle speed, acceleration, rudder angle) indicating at least one kind of behavior of the vehicle with the image data acquired at the same time as the vehicle data and using the vehicle data as a search key. By storing the data, the image data can be retrieved from the vehicle data (vehicle behavior). In addition, since the image data can be searched from the behavior of the vehicle as described above, when the vehicle is traveling with the desired vehicle behavior or when the processed moving image data from the time when the vehicle is traveled with the desired vehicle behavior is reproduced. It is suitable for. In this embodiment, an example is adopted in which position data indicating the position of the vehicle is associated with image data acquired at the same time as the position data, and processed moving image data created using the position data as a search key is stored. Therefore, the image data can also be searched from the position data.

(Modification 1)
Next, a first modification of the present invention will be described with reference to FIGS.

  Since the above-described embodiment and modification 1 have many similar parts, the same parts will be denoted by the same reference numerals in the drawings and the description thereof will be omitted, and different parts will be mainly described.

  The difference between the above-described embodiment and Modification 1 includes vehicle data storage conditions (condition data) for determining whether to associate position data and vehicle data with image data, as shown in FIG. The vehicle data determination table 16 is provided. The vehicle data determination table 16 is stored in a storage medium such as a ROM. The vehicle data determination table 16 may employ an example provided in the same ROM of the ECU as the data creation unit 15, for example. Note that the search device 30 is the same as that in the above-described embodiment, and thus is omitted in FIG.

  In the present embodiment, the vehicle data determination table 16 will be described by adopting an example including a condition for determining whether or not to associate position data and vehicle data with image data. The object can be achieved as long as it includes at least a condition for determining whether or not to associate the vehicle data with the image data.

  For example, when the imaging cycle is 1/16 s (1 frame 1/16 s), the position of the vehicle does not change much at 1/16 s. That is, the position data does not need to be acquired (associated) for each imaging cycle by the vehicle exterior camera 12. For example, when it is desired to search for image data when the speed is exceeded, there is no need to acquire (associate) vehicle data indicating the vehicle speed when the speed is not exceeded.

  The vehicle data determination table does not associate such unnecessary position data and vehicle data with image data (that is, associates only necessary position data and vehicle data with image data) vehicle data storage conditions (condition data). Is included. For example, in the example of the vehicle data determination table shown in FIG. 5, the vehicle data storage condition (condition data) for associating with the image data is as follows: position data (position) is 1-second intervals, brake pedaling amount is above 3, The vehicle data (speed) indicating the vehicle speed is higher than 60 km / h, and the vehicle data (steering wheel) indicating the steering angle is 50 degrees or more. That is, the position data is associated with the image data at intervals of 1 second. The vehicle data indicating the brake depression amount is associated with the image data when the brake depression amount is greater than 3 among the data acquired simultaneously with the image data. The vehicle data (speed) indicating the vehicle speed is associated with the image data when the vehicle speed is higher than 60 km / h among the data acquired simultaneously with the image data. The vehicle data (steering wheel) indicating the steering angle is associated with the image data when the steering angle is 50 degrees or more among the data acquired simultaneously with the image data. As described above, the vehicle data storage condition relating to the vehicle data is set for each type of vehicle behavior.

  Note that, in the first modification, vehicle data indicating the brake pedal stroke is employed instead of the vehicle data indicating acceleration. That is, the vehicle data receiving unit 13 receives vehicle data indicating the brake pedaling amount from an in-vehicle ECU equipped with a sensor for detecting the brake pedaling amount, and sends the vehicle data indicating the brake pedaling amount to the data creating unit 15. Output.

  Here, the processing operation of the vehicle-mounted device 10 will be described with reference to FIG.

  The GPS receiver 11, the vehicle exterior camera 12, the vehicle data receiving unit 13, and the data creating unit 15 are, for example, instructions for starting a processing operation when power is supplied or when an operation switch (not shown) is operated by the user. The processing operation is started at the timing when the signal is input.

  The data creation unit 15 acquires moving image data (including a plurality of image data) from the vehicle exterior camera 12 (moving image data acquisition unit), acquires position data from the GPS receiver 11 (position data acquisition unit), and vehicle data. Vehicle data is acquired from the receiver 13 (vehicle data acquisition means). Furthermore, the data creation unit 15 acquires vehicle data storage conditions (condition data) from the vehicle data determination table 16.

  The data creation unit 15 acquires only the position data and vehicle data that satisfy the vehicle data storage condition indicated by the acquired condition data among the position data and vehicle data acquired simultaneously with the image data when the image data is acquired. Is processed with the image data, and the processed moving image data including a plurality of image data associated with the position data and the vehicle data is created using the vehicle data as a search key (data creation means).

  By doing so, only necessary position data and vehicle data can be stored, which is preferable because the amount of vehicle data and the amount of processed moving image data can be reduced.

(Modification 2)
Next, a second modification of the present invention will be described with reference to FIGS.

  In addition, since the modified example 2 is often the same as the above-described embodiment or modified example 1, the description of the similar part is omitted by giving the same reference numerals to the drawings, and the different part is mainly described. To do.

  The difference between the modified example 2 and the above-described embodiment or modified example 1 is that, as shown in FIG. 7, a peripheral information acquisition unit 17 (peripheral information acquisition) that acquires peripheral information indicating the surrounding environment where the vehicle is located. Means), the condition data (vehicle data storage condition) acquired by the data creation unit 15 from the vehicle data determination table 16 according to the acquisition result of the peripheral information acquisition unit 17 (peripheral information, also referred to as environmental data in the drawing) ) Is changed (vehicle data storage condition changing means).

  The peripheral information acquisition unit 17 is, for example, the speed limit of the road on which the vehicle is located from the map data storage unit (not shown), the intersection where the vehicle is traveling from the map data storage unit and the road machine (not shown). Get peripheral information such as traffic signal status. Further, in order to change the condition data (vehicle data storage condition), each condition data (vehicle data storage condition) and each peripheral information are associated with each other in advance and stored in the ROM or the like of the data creation unit 15. Can be done by. Note that the search device 30 is the same as that of the above-described embodiment, and is omitted in FIG.

  When this condition data (vehicle data storage condition) is changed, for example, when the vehicle is located on a road having a speed limit of 50 km / h, the vehicle data storage condition is set above 50 km / h, and the vehicle has a speed limit of 80 km / h. If the vehicle is located on the road h, the vehicle data storage condition may be set above 80 km / h.

  In other words, the data creation unit 15 determines the condition data (vehicle data storage condition) corresponding to the peripheral information from among a plurality of condition data (vehicle data storage conditions) according to the peripheral information acquired by the peripheral information acquisition unit 17. Select.

  Here, the processing operation of the vehicle-mounted device 10 will be described with reference to FIG.

  The GPS receiver 11, the vehicle exterior camera 12, the vehicle data receiving unit 13, and the data creating unit 15 are, for example, instructions for starting a processing operation when power is supplied or when an operation switch (not shown) is operated by the user. The processing operation is started at the timing when the signal is input. The peripheral information acquisition unit 17 starts acquiring peripheral information and outputs the acquired peripheral information.

  The data creation unit 15 acquires moving image data (including a plurality of image data) from the vehicle exterior camera 12 (moving image data acquisition unit), acquires position data from the GPS receiver 11 (position data acquisition unit), and vehicle data. Vehicle data is acquired from the receiver 13 (vehicle data acquisition means), and condition data (vehicle data storage conditions) is acquired from the vehicle data determination table 16. Furthermore, the data creation unit 15 acquires peripheral information from the peripheral information acquisition unit 17 (peripheral information acquisition means).

  Then, the data creation unit 15 changes (selects) the condition data (vehicle data storage condition) acquired from the vehicle data determination table 16 in accordance with the peripheral information acquired from the peripheral information acquisition unit 17. That is, the condition data (vehicle data storage condition) associated with the acquired peripheral information is set as the adopted condition data. The data creation unit 15 obtains only the position data and vehicle data satisfying the vehicle data storage condition indicated by the set condition data among the position data and vehicle data acquired simultaneously with the image data when the image data is acquired. Processed moving image data including a plurality of image data associated with position data and vehicle data is created using the vehicle data as a search key in association with image data (data creation means).

  This is preferable because necessary vehicle data can be associated with image data in accordance with the environment in which the vehicle is located.

  That is, for example, when it is desired to search for image data when the speed is exceeded, vehicle data indicating a vehicle speed of 70 km / h is not necessary when the vehicle is located on a road having a speed limit of 80 km / h, and the vehicle has a speed limit of 50 km / h. Vehicle data indicating a vehicle speed of 40 km / h is not necessary when the vehicle is located on the road. Therefore, as shown in Modification 2, by changing the condition data (vehicle data storage condition) according to the surrounding environment (peripheral information) where the vehicle is located, for example, in the case of a road with a speed limit of 80 km / h The vehicle is positioned on a road with a speed limit of 80 km / h by setting the data storage condition above a vehicle speed of 80 km / h and, in the case of a road with a speed limit of 50 km / h, by setting the data storage condition above a speed of 50 km / h. Vehicle data indicating vehicle speed of 70 km / h when the vehicle is driving, vehicle data indicating vehicle speed of 40 km / h when the vehicle is located on a road having a speed limit of 50 km / h, etc. Can only be associated with image data.

(Modification 3)
Next, a first modification of the present invention will be described with reference to FIGS.

  Since the above-described embodiment, modification 1, modification 2 and modification 3 have many similar parts, the same parts are denoted by the same reference numerals in the drawings and the description thereof is omitted, and different parts are provided. Explain mainly.

  The difference between the above-described embodiment, modification 1, modification 2 and modification 3 is that, as shown in FIG. 9, image data storage conditions (condition data) for determining whether or not to store image data. ) Including an image data determination table 161. The image data determination table 161 is stored in a storage medium such as a ROM. For example, the image data determination table 161 may be provided in the same ROM of the ECU as the data creation unit 15. Note that the search device 30 is the same as that in the above-described embodiment, and thus is omitted in FIG.

  For example, when it is desired to search for image data when the speed is exceeded, it is not necessary to create processed moving image data for the image when the speed is not exceeded. The image data determination table does not use such unnecessary image data as a target when creating processed video data (that is, only necessary image data is used as a target when creating processed video data). Image data storage conditions (condition data). Therefore, as an example of the image data determination table, image data storage conditions (condition data) such that the image data is processed as moving image data only when the vehicle data (speed) indicating the vehicle speed is higher than 60 km / h. An example including In this case, in the processed moving image data shown in FIG. 10, only the image data of the frames No. 1 and 2 are the targets of the processed moving image data, and the image data of the frame No. 3 is not the target of the processed moving image data.

  Note that the image data storage condition can be set for vehicle data indicating the behavior of the vehicle as in the example of the vehicle speed. Further, it may be set for each type of vehicle behavior (vehicle data). That is, image data storage conditions are set for each piece of vehicle data indicating a plurality of types of behavior (for example, vehicle data indicating vehicle speed, vehicle data indicating acceleration, vehicle data indicating steering angle), and corresponding to the acquired image data. If at least one of the vehicle data to be acquired (at the same time) satisfies the image data storage condition, processed moving image data is created for the image data.

  Here, the processing operation of the vehicle-mounted device 10 will be described with reference to FIG.

  The GPS receiver 11, the vehicle exterior camera 12, the vehicle data receiving unit 13, and the data creating unit 15 are, for example, instructions for starting a processing operation when power is supplied or when an operation switch (not shown) is operated by the user. The processing operation is started at the timing when the signal is input.

  The data creation unit 15 acquires moving image data (including a plurality of image data) from the vehicle exterior camera 12 (moving image data acquisition unit), acquires position data from the GPS receiver 11 (position data acquisition unit), and vehicle data. Vehicle data is acquired from the receiver 13 (vehicle data acquisition means). Further, the data creation unit 15 acquires image data storage conditions (condition data) from the image data determination table 161.

  And when the data creation part 15 acquires image data, position data, and vehicle data, only the image data corresponding to the vehicle data satisfying the image data storage condition indicated in the acquired condition data is used as the position data, It associates with vehicle data and creates processed moving image data using the vehicle data as a search key (data creation means). In other words, processed moving image data is created only for image data when at least one of the vehicle data satisfies the image data storage condition.

  By doing so, processed moving image data can be created only for the necessary image data, which is preferable because the amount of processed moving image data can be reduced.

  Further, the image data required as processed moving image data may change depending on the environment in which the vehicle is located. Therefore, a peripheral information acquisition unit 17 (peripheral information acquisition means) similar to that of Modification 2 is provided, and the data creation unit 15 changes the image data storage condition according to the acquisition result (peripheral information) of the peripheral information acquisition unit 17 ( (Image data storage condition changing means).

  By doing so, it is possible to create processed moving image data only for the necessary image data depending on the environment in which the vehicle is located, so the amount of processed moving image data can be reduced while including appropriate image data. Since it can reduce, it is preferable.

  Further, the data creation unit 15 may change both the vehicle data storage condition and the image data storage condition according to the acquisition result (peripheral information) of the peripheral information acquisition unit 17.

  In this way, processed video data can be created only for the necessary vehicle data and image data depending on the environment in which the vehicle is located, so that it has been processed while including appropriate vehicle data and image data. This is preferable because the amount of moving image data can be reduced.

  As described above, when creating moving image data with a search key only for image data when at least one of the vehicle data satisfies the image data storage condition, the image data storage condition may or may not be satisfied. It can happen in a short time. In such a case, the created moving image data with a search key becomes an intermittent moving image, which may be difficult to see. For example, when the vehicle speed XX km / h is set as the image data storage condition, the created moving image data with search key is intermittent when the actual vehicle speed repeatedly exceeds or does not exceed the vehicle speed XX km / h. It may be difficult to see because it becomes a typical video.

  Therefore, the data creating unit 15 processes the processed moving image data for image data whose vehicle data does not satisfy the image data storage condition for a predetermined time after the vehicle data satisfies the image data storage condition indicated in the condition data. You may make it create.

  By doing so, since a continuous moving image (processed moving image data) can be created for a predetermined time after at least one of the vehicle data satisfies the image data storage condition, the data amount is suppressed. However, it is possible to prevent the moving image from being difficult to see.

(Modification 4)
Next, a fourth modification of the present invention will be described with reference to FIGS.

  The above-described embodiment, Modification 1 to Modification 3 and Modification 4 are similar in many respects, and therefore similar portions are denoted by the same reference numerals in the drawings and description thereof is omitted, and different portions are provided. Explain mainly.

  The difference between the above-described embodiment, Modification 1 to Modification 3 and Modification 4 is that the in-vehicle device 10 can communicate with the Web server 20 as shown in FIG. A point to be transmitted to the Web server 20, a point that the in-vehicle device 10 includes an upload unit 19 a, an upload determination unit 19 b and a wide area communication device 19 for transmitting processed video data to the Web server 20, and a search device 30 such as a personal computer The client terminal is adopted.

  First, the wide-area communication device 19 (communication means) provided in the in-vehicle device 10 is a communication device that can access the Web server 20 via the Internet network, and for example, a mobile phone or an in-vehicle phone can be adopted.

  Further, the upload unit 19a (communication unit) and the upload determination unit 19b (communication unit) provided in the in-vehicle device 10 may employ an example provided in the same ECU as the data creation unit 15, for example. The upload unit 19 a transmits processed video data to the Web server 20 via the wide area communication device 19. The upload determination unit 19b determines processed moving image data to be transmitted to the Web server 20.

  For example, the upload determination unit 19b uses the processed moving image data stored in the storage unit 14 as processed Web data for a predetermined time before and after the time when at least one of the vehicle data satisfies the above-described image data storage condition. It may be transmitted to the server 20. In this case, it can be realized by always storing the processed moving image data in the storage unit 14 mounted on the vehicle (storage means).

  By doing in this way, it can suppress that a moving image becomes discontinuous and it becomes difficult to see, suppressing the data amount of processed moving image data. Note that, in the fourth modification, an example in which the upload determination unit 19b is provided as described above will be described, but the present invention is not limited to this. When the upload determination unit 19b is not provided, for example, the upload unit 19a is processed video data stored in the storage unit 14 or processed video data created by the data creation unit 15 via the wide area communication device 19. All of the above may be transmitted to the Web server 20.

  The Web server 20 corresponds to an external station in the present invention, and a database 21 (corresponding to an external storage unit) that can store processed moving image data and a search unit 22 that searches image data from the database 21. Etc. Although not shown, the Web server 20 includes a communication device that can be connected to the Internet network. Although not shown, the Web server 20 includes an HTML file, an image file, and the like for a Web page such as an image data search page browsed by the browser 34 of the search device 30. In addition, an input form for transmitting data such as a search key from the search device 30 to the Web server 20 can be set in the Web page.

  The search device 30 includes a display 31, an input unit 33, a browser 34, and the like. The browser 34 is for browsing a web page such as an image data search page provided by the web server 20, and displays the web page on the display 31. That is, the browser 34 downloads an HTML file, an image file, or the like from the Web server 20, analyzes the layout, and displays the Web page on the display 31. If there is an input form set on the web page, the browser 34 uses the input form to input data (in this case, data indicating a search key, vehicle behavior, etc.) ) Can be transmitted to the Web server 20.

  When searching for image data using the search device 30, the user uses a search key (vehicle position, vehicle behavior, etc.) using the input unit 33 in a predetermined input form of a Web page displayed on the display 31. Enter. When the search key is input, the search device 30 transmits the search key to the Web server 20. The Web server 20 searches for image data corresponding to the search key received from the processed moving image data stored in the database 21 (search means). If the corresponding image data can be retrieved, the image data is transmitted to the retrieval device 30 and displayed on the display 31. When image data is searched by the search unit 22, a moving image from the searched image data can be displayed on the display 31.

  Here, the processing operation of the vehicle-mounted device 10 will be described with reference to FIG.

  The data creation unit 15 acquires moving image data (including a plurality of image data) from the vehicle exterior camera 12 (moving image data acquisition unit), acquires position data from the GPS receiver 11 (position data acquisition unit), and vehicle data. Vehicle data is acquired from the receiver 13 (vehicle data acquisition means). When the image data is acquired, the data creation unit 15 associates the position data and the vehicle data acquired at the same time with the image data, and uses the vehicle data as a search key to associate the position data with the vehicle data. The processed moving image data including the image data is created (data creation means). Further, the data creation unit 15 transmits the created processed moving image data to the upload unit 19a (storage unit). The data creation unit 15 may transmit the created processed moving image data to the upload unit 19a and store it in the storage unit 14.

  Then, the upload unit 19 a transmits the acquired processed moving image data to the Web server 20 via the wide area communication device 19. At this time, as described above, the upload unit 19a processes the processed moving image data determined to be transmitted by the upload determination unit 19b (at a predetermined time before and after the time when at least one of the vehicle data satisfies the image data storage condition described above). Processed video data) is transmitted to the Web server 20.

  In this way, the processed video created by associating the vehicle data (here, vehicle speed, acceleration, rudder angle) indicating at least one kind of behavior of the vehicle with the image data acquired at the same time as the vehicle data and using the vehicle data as a search key. By transmitting the data to the Web server 20, the image data can be retrieved from the vehicle data (vehicle behavior) even outside the vehicle interior. In addition, since the image data can be searched from the behavior of the vehicle as described above, when the vehicle is traveling with the desired vehicle behavior or when the processed moving image data from the time when the vehicle is traveled with the desired vehicle behavior is reproduced. It is suitable for.

  Also, since processed moving image data can be created mainly for necessary image data, it is preferable because the amount of processed moving image data can be reduced. Further, it is possible to create a continuous moving image (processed moving image data) at a predetermined time before and after at least one of the vehicle data satisfies the image data storage condition. Therefore, it is possible to suppress the difficulty in viewing the moving image while suppressing the data amount of the processed moving image data.

  As described above, the vehicle data determination table 16 including vehicle data storage conditions (condition data) for determining whether or not to associate vehicle data with image data may be provided. Further, an image data determination table 161 including image data storage conditions (condition data) for determining whether or not to store image data may be provided.

  In addition, the data creation unit 15 may change the image data storage condition (image data storage condition changing unit) according to the acquisition result (peripheral information) of the peripheral information acquisition unit 17. As a result, processed video data can be created mainly for necessary image data according to the environment in which the vehicle is located, so that the amount of processed video data can be reduced while including appropriate image data. It is preferable because it is possible. Further, it is possible to create a continuous moving image (processed moving image data) at a predetermined time before and after at least one of the vehicle data satisfies the image data storage condition. Therefore, it is possible to suppress the difficulty in viewing the moving image while suppressing the data amount of the processed moving image data.

  Further, the data creation unit 15 may change both the vehicle data storage condition and the image data storage condition according to the acquisition result (peripheral information) of the peripheral information acquisition unit 17. As a result, it is possible to create video data with a search key for the necessary vehicle data and image data mainly depending on the environment where the vehicle is located, so a video with a search key is included while including appropriate vehicle data and image data. This is preferable because the amount of data can be reduced. Further, it is possible to create a continuous moving image (moving image data with a search key) for a predetermined time before and after at least one of the vehicle data satisfies the image data storage condition. Therefore, it is possible to suppress the difficulty in viewing the moving image while suppressing the data amount of the moving image data with the search key.

  It should be noted that the above-described embodiment, Modification 1 to Modification 4 can be executed in appropriate combination.

DESCRIPTION OF SYMBOLS 10 Car equipment, 11 GPS receiver, 12 Camera outside vehicle, 13 Vehicle data receiving part, 14 Memory | storage part, 15 Data preparation part, 16 Vehicle data determination table, 161 Image data determination table, 17 Peripheral information acquisition part, 19a Upload unit, 19b Upload determination unit, 19 Wide-area communication unit, 18a to 18c 1st in-vehicle ECU to 3rd in-vehicle ECU, 20 Web server, 21 database, 22 search unit, 30 search device, 31 display, 32 search unit, 33 input Part, 34 browser, 40 GPS satellites

Claims (12)

A plurality of image data that includes moving image data and includes an image captured by an in-vehicle camera mounted on a vehicle, and the image data that is associated with at least a part of the plurality of image data. A video storage system for storing video data with a search key including a search key for searching for data,
Moving image data acquisition means for acquiring the moving image data composed of a plurality of the image data;
Vehicle data acquisition means for acquiring vehicle data indicating at least one kind of behavior of the vehicle corresponding to at least some of the image data in the plurality of image data;
A data creating unit including a plurality of the image data, associating the vehicle data with the image data corresponding to the vehicle data, and creating the moving image data with the search key using the vehicle data as the search key;
And a storage unit for storing the search key-added moving image data created by the data creating unit.   2. The moving image storage system according to claim 1, wherein the data creation unit associates only the vehicle data satisfying a vehicle data storage condition for each type of behavior of the vehicle with the image data.   Peripheral information acquisition means for acquiring peripheral information indicating the peripheral environment in which the vehicle is located, and vehicle data storage condition change means for changing the vehicle data storage condition according to the acquisition result of the peripheral information acquisition means, The moving image storage system according to claim 2, further comprising:   The said data preparation means produces the said moving image data with a search key only for the said image data when at least one of the said vehicle data satisfy | fills image data storage conditions. The moving image storage system according to any one of the above. The data creation means creates the search keyed moving image data only for the image data when at least one of the vehicle data satisfies image data storage conditions,
Peripheral information acquisition means for acquiring peripheral information indicating the peripheral environment in which the vehicle is located; and image data storage condition changing means for changing the image data storage condition according to the acquisition result of the peripheral information acquisition means; The moving image storage system according to claim 1, further comprising: a moving image storage system according to claim 1. The data creation means creates the search keyed moving image data only for the image data when at least one of the vehicle data satisfies image data storage conditions,
Surrounding information acquisition means for acquiring surrounding information indicating the surrounding environment where the vehicle is located;
Vehicle data storage condition changing means for changing the vehicle data storage condition according to the acquisition result of the peripheral information acquisition means;
The moving image storage system according to claim 2, further comprising: an image data storage condition changing unit that changes the image data storage condition according to an acquisition result of the peripheral information acquisition unit.   The data creation means is configured to provide the moving image with the search key for a predetermined time after at least one of the vehicle data satisfies the image data storage condition even if the vehicle data does not satisfy the image data storage condition. The moving image storage system according to any one of claims 4 to 6, wherein data is created.   The moving image storage system according to claim 1, wherein the storage unit stores the moving image data with a search key in an in-vehicle storage unit mounted on the vehicle.   9. The communication device according to claim 1, further comprising a communication unit that is provided outside the vehicle and transmits the moving image data with the search key to an external station including an external storage unit that stores the moving image data with the search key. The moving image storage system according to any one of the above. The storage means always stores the moving image data with the search key in an in-vehicle storage unit mounted on the vehicle,
When it is possible to communicate with an external station provided outside the vehicle and provided with an external storage unit for storing the moving image data with search key, and when at least one of the vehicle data satisfies an image data storage condition, the in-vehicle storage unit And a communication means for transmitting the search key-added moving image data for a predetermined time before and after the image data storage condition is satisfied to the external station. The moving image storage system according to any one of claims 1 to 3. The storage means always stores the moving image data with the search key in an in-vehicle storage unit mounted on the vehicle,
When it is possible to communicate with an external station provided outside the vehicle and provided with an external storage unit for storing the moving image data with search key, and when at least one of the vehicle data satisfies an image data storage condition, the in-vehicle storage unit Communication means for transmitting the search key-added video data for a predetermined time before and after the time when the image data storage condition is satisfied, to the external station, among the search key-added video data stored in
Surrounding information acquisition means for acquiring surrounding information indicating the surrounding environment where the vehicle is located;
The moving image storage system according to claim 1, further comprising: an image data storage condition changing unit that changes the image data storage condition according to an acquisition result of the peripheral information acquisition unit. The storage means always stores the moving image data with the search key in an in-vehicle storage unit mounted on the vehicle,
When it is possible to communicate with an external station provided outside the vehicle and provided with an external storage unit for storing the moving image data with search key, and when at least one of the vehicle data satisfies an image data storage condition, the in-vehicle storage unit Communication means for transmitting the search key-added video data for a predetermined time before and after the time when the image data storage condition is satisfied, to the external station, among the search key-added video data stored in
Surrounding information acquisition means for acquiring surrounding information indicating the surrounding environment where the vehicle is located;
Vehicle data storage condition changing means for changing the vehicle data storage condition according to the acquisition result of the peripheral information acquisition means;
The moving image storage system according to claim 2, further comprising: an image data storage condition changing unit that changes the image data storage condition according to an acquisition result of the peripheral information acquisition unit.

Images