JP2019032739A - Reproducing apparatus and reproducing method, program thereof, recording apparatus, control method of recording apparatus, and the like - Google Patents

Abstract

To realize that a user can view an image processed based on acquired information.SOLUTION: While a reproduction window 130 is displayed on a display screen of a display device of a personal computer, an image recorded by a drive/recorder is displayed in an image display area 141 of the reproduction window 130. A frame 143 of a field of view range of a user is displayed and the image is processed and displayed so that a region 142 outside the field of view range is blurred.SELECTED DRAWING: Figure 19

Description

  The present invention relates to, for example, a playback device, a playback method, a program thereof, a recording device, a control method for the recording device, and the like.

  In-vehicle video recording that captures video around the vehicle with a camera installed in the vehicle and records the peripheral video and vehicle speed when the vehicle is impacted by an event such as sudden braking, sudden steering, or collision There are known devices, and there are known playback devices that play back images taken by such drive recorders. (Patent Document 1).

Patent No. 5966131

  However, in the invention described in Patent Document 1, only captured images such as images before and after the occurrence of an event are reproduced.

  An object of the present invention is, for example, to increase the possibility of displaying an image more suitable for the user than in the past. The object of the invention of the present application is not limited to this, and there is an intention to acquire the right by a divisional application, amendment, etc. for a configuration aiming to obtain an effect obtained from the configuration portion disclosed in the present specification and drawings. . For example, the present specification discloses a problem in which a part described as “can be” in the present specification is read as “to be a problem”. The issues are described as being independent of each other, and there is an intention to acquire the right by a divisional application, amendment, etc. independently for the configuration for solving this issue. Even if the problem can be grasped silently from the description of the specification, the applicant intends to make a part of the configuration described in the specification as a claim in an amendment or divisional application. .

  (1) A playback device for playing back recorded video data, which controls the recorded video data based on the acquired information and displays the video based on the processed video data. It is good to do.

In this way, the user can see the video processed based on the acquired information, not the recorded video itself. By processing the processing suitable for the user viewing the video, it is possible to obtain a video suitable for the user. Since the recorded video data is processed based on the acquired information rather than simply processing the recorded video, the possibility of displaying a video more suitable for the user viewing the video increases. For example, a playback device that plays back video data recorded in a vehicle, processes the recorded video data based on information acquired in the vehicle, and displays a video based on the processed video data It is good to perform control for this. In particular, control is performed to process the recorded video data based on the video data recorded in the vehicle and information acquired in the vehicle at the same time, and to display a video based on the processed video data. It is good to do. The same period may be within a predetermined width, and the predetermined width may be several seconds, for example.
The information to be acquired is particularly preferably information that changes in accordance with the driving operation of the driver of the vehicle, and in particular, information regarding the behavior of the driver itself. The information regarding the driver's own state may be information having a relationship between the driver's own state and an image recorded in the vehicle. The relationship may be an objective relationship, but particularly preferably a subjective relationship of the driver. The subjective relationship may be a relationship that the driver thinks that it looks like this, for example, information that is necessary for estimating that it seemed like this.
However, the information to be acquired may be information other than the vehicle speed.

  The recorded video data may be, for example, video data recorded by a recording device, for example, video recorded on a memory card such as an SD (Secure Digital) card, a micro SD card, or an XQD (registered trademark) card. Data is good. The acquired information may be, for example, information input from a user browsing the video. When the user inputs information and the playback device acquires the information so that processing suitable for the user viewing the video is performed, the possibility that the video suitable for browsing by the video user is displayed is increased. . Further, the acquired information may be predetermined information. Information may be acquired by reading such predetermined information. For the processing, for example, the video data before and after the processing may be changed.

  (2) The processing may be processing for displaying a user's visual field range on the video.

  In this way, the user's visual field range in the video can be easily understood. Since the user's visual field range is known, for example, it is easy to understand the part that the user cannot see and the part that the user can see. The visual field range of the user may be fixed, may be determined according to the user's age, or may be determined by measurement for each user. In particular, the processing process may be a process of displaying the user's visual field range on the video based on the acquired information. In particular, a processing based on the range based on information for adjusting the visual field range input from the visual field range input means and the visual field range of the user may be performed based on the acquired information. The visual field range is displayed on the image in such a manner that the inside of the visual field range and the outside of the visual field range can be distinguished. For example, the visual field range may be displayed surrounded by a frame. It may be displayed filled or blurred. The video may be, for example, a video recorded by a recording device using a wide-angle camera or a video recorded by a recording device using an omnidirectional camera.

  (3) When there is an object to be noted in the video outside the visual field range of the user, that fact may be notified.

  In this way, it becomes easy for the user to understand that there is an object to be noted in a part that he cannot see. Whether or not there is an object to be noted in the video outside the user's field of view is determined by, for example, detecting the object present in the video in each frame of the recorded video by image recognition or the like, and In this case, it may be determined that the object is present when the range of the detected object is within the range outside the visual field range, and that the object is absent when the range is not present. In particular, in the object detection process, at least a part of the search for the object by image recognition in the range of the field of view in the image of the frame may be omitted, and it is preferable that the object detection process is not desirable. In the video of the frame, the object may be searched by image recognition only in a range outside the visual field range. For example, in the video acquired by the recording device, it can be seen that there is an object to be noted in a place where the user cannot see, so the user may move his neck while driving and pay attention to the invisible range. Increase the chances of being able to do it. The object to be noted may be, for example, a pedestrian, a bicycle, a car, or a motorcycle. Informing that effect, it is particularly preferable to display the position in the video.

  (4) The processing may be a processing for displaying a user's line of sight when recording video data on the video.

  In this way, it becomes easy to grasp where the user was looking at the time of recording the video data. In particular, the processing process may be a processing process for displaying the user's line of sight at the time of recording the video data on the video based on the acquired information. In particular, the user's line of sight may be displayed on the video based on the user's line of sight input from the input means for inputting the user's line of sight at the time of recording the video data and the information acquired in the previous period. For example, at the time of recording video data, the user's eye movement may be recorded, and the user's command may be displayed on the video based on the recording. The line of sight is, for example, the direction the user is looking at, and may be the line of sight. Displaying the line of sight on the video may be performed by sequentially displaying the line of sight as a point on the video, or the line of sight of the line of sight may be displayed on the video. The user's line of sight may be, for example, when the video data is recorded, the user may be photographed by the photographing unit, and the line of sight may be detected from the photographed image obtained by the photographing unit, or the line of sight detecting device such as eyeglasses for detecting the line of sight The line of sight may be detected by a line-of-sight detection device such as glasses.

  (5) The processing process may be a processing process for displaying the video by moving the visual field range in a direction that the user faces when recording video data.

  In this way, the direction in which the user is facing at the time of recording video data can be known, and the visual field range in that direction can be easily understood. When recording video data, it becomes easier to see which part of the video was visible. In particular, information indicating the direction detected by the detecting means for detecting the direction in which the user is facing may be acquired, and the visual field range may be moved based on the acquired information and displayed on the video. The visual field range may be moved by processing the frame so that the internal and external ranges of the visual field range can be distinguished for each fixed frame. For example, the visual field range may be moved by relatively moving the visual field range, and the visual field range may be relatively moved by moving the image.

  (6) For example, the processing process may be a processing process for displaying on the video a range that is not viewed by the user during a predetermined time when video data is recorded.

  In this way, it becomes easy to understand the range that the user has not seen during a certain period of time. In particular, information obtained from detection means for detecting a range that is not viewed by the user during a predetermined time is acquired, and a range that is not viewed by the user during a predetermined time is displayed on the video from the acquired information. It is good to process. It is preferable to detect the user's line of sight and detect a range that the user has not seen for a certain period of time from the detected information of the user's line of sight and information for a certain period of time. The user's line of sight may be, for example, when the video data is recorded, the user may be photographed by the photographing unit, and the line of sight may be detected from the photographed image obtained by the photographing unit, or the line of sight detecting device such as eyeglasses for detecting the line of sight The line of sight may be detected by a line-of-sight detection device such as glasses. For example, if the video data is recorded by a recording device during a certain period of time, it may be during a time when the video data is stopped at the intersection, during a right or left turn at the intersection, or during a lane change. Displaying the unviewed range on the video may be, for example, filling or blurring the unviewed range.

  (7) For example, the processing may be a processing for displaying on the video whether or not the user's line of sight at the time of recording the video data coincides with the direction to be viewed by the user.

  In this way, it becomes easier to see whether the user is looking in the direction to see or not. In particular, information from an input means for inputting information indicating whether or not the user's line of sight at the time of recording video data coincides with the direction to be viewed by the user is acquired, and recording of video data is performed based on the acquired information. Whether or not the user's line of sight at the time coincides with the direction to be viewed by the user may be a processing process to be displayed on the video. Further, the information input from the input means for inputting information indicating the user's line of sight at the time of recording the video data and the information input from the input means for inputting information to be viewed by the user are acquired, and based on the acquired information. Thus, the processing for displaying on the video may be performed based on whether or not the user's line of sight at the time of recording the video data matches the direction in which the user should see. The information obtained from the detecting means for detecting whether or not the user's line of sight at the time of recording the video data coincides with the direction to be viewed by the user is acquired, and based on the acquired information, the user at the time of recording the video data Whether the line of sight and the direction to be viewed by the user coincide with each other may be set as a processing process to be displayed on the video. For example, when video data is recorded by a recording device, the direction to be viewed by the user is determined in advance according to the surrounding situation. The degree of coincidence between the user's line of sight and the direction to be viewed by the user may be calculated.

  (8) For example, when the video data is recorded by a recording device, the direction to be viewed by the user when the user's line of sight at the time of recording the video data matches the direction to be viewed by the user is: It may be different depending on the driving operation of the car when recording the video data.

  In this way, it becomes easy to understand that the user's viewing direction differs according to the driving operation of the car at the time of recording the video data or the driving operation of the car by the user. Depending on the driving of the car at the time of recording the video data or the user's operation of driving the car, the user's viewing direction is different. Depending on the operation, it will be easier to see whether you are looking at the direction to see or not. In particular, the direction to be viewed by the user may be determined based on information from the input means for inputting information about driving of the vehicle at the time of recording the video data or driving operation of the user by the user. The direction to be seen is, for example, the direction to look almost forward when the driving operation of the car is running straight, and when changing the lane, the room mirror, the door mirror of the driving lane on the lane change side, It is better to look at the window next to the lane change side. In addition, when operating the steering wheel relatively large after turning the winker for a right or left turn, the direction of looking diagonally forward and diagonally behind the side where the steering wheel is operated is used to drive the car. Later, when the steering wheel is operated relatively small, it is better to look in the room mirror, the door mirror of the traveling lane on the lane change side, the side window on the side of the lane change.

  (9) For example, the processing process acquires information indicating whether or not the order viewed by the user at the time of recording video data matches the order to be viewed in advance, and displays the information on the video based on the acquired information. It is good to process it.

  In this way, it becomes easy to understand whether the order seen by the user matches the order to be seen in advance. In particular, based on information from detection means for detecting whether or not the order viewed by the user at the time of recording video data matches the order to be viewed in advance, the order viewed by the user at the time of recording video data is viewed in advance. Information indicating whether or not the order matches should be displayed on the video. The order that the user sees when recording the video data can be found, for example, by analyzing the video data obtained by photographing the user driving the car and detecting the user's line of sight in time series. The order to be viewed in advance can be understood based on information input from input means for inputting information indicating the order. For example, the recorded video data may be reproduced, and the order in which the instructor should view the video represented by the reproduced video data may be input from the input means. The order to be viewed in advance may vary depending on the recording situation, for example. For example, if the video data is from the start of the car, look at the front, look at the rear view mirror or rear, look at the right door mirror or fender mirror, and look at the right window. This is an example of the order to see. The degree of coincidence between the order viewed by the user and the order to be viewed in advance may be calculated.

  (10) For example, the processing process may be a processing process for displaying a portion to be viewed by the user on a video.

  In this way, the user should be able to easily understand the part to be seen from the video. In particular, it is preferable that the input processing unit obtains information input from an input unit that inputs information indicating a portion to be viewed by the user, and displays the portion to be viewed by the user on the video based on the strict information. For example, if the video data is viewed from the driver while driving, it is often useful for driving guidance because it is easy to understand the location that the driver should see. For example, if the processing should be a place where the room mirror should be seen, the video part of the room mirror should be marked, or if the door mirror should be seen, the video part of the door mirror should be marked. Good.

  (11) For example, when recording video data, an image of the scene may be displayed in response to the user not seeing a portion to be viewed.

  In this way, it becomes easier to understand what the scene is when the user is not looking at the part to be viewed. In particular, the screen of the scene is displayed if the user does not see the part to be viewed based on the information input from the input means for inputting information indicating that the user does not see the part to be viewed when recording the video data. It is good to display. Whether or not the user is looking at a portion to be viewed can be determined by using line-of-sight information obtained from a detection device that detects the line of sight of the user. For example, if the video data represents the video while the user is driving, it will be easier to see when the user is driving and where he / she is not looking, so it may help improve driving skills. Rise. Further, for example, if the video data represents a video while the user is driving, the evaluation can be performed based on an image of a scene where the user is not looking at a portion to be viewed.

  (12) For example, the video may be displayed faster than the display speed of the video portion where the movement of the subject does not change compared to the display speed of the video portion where the movement of the subject changes.

  In this way, there is a high possibility that the entire video can be browsed quickly. In particular, as to whether the video part has no change in subject movement or the video part has a change in subject movement, it detects whether the video part has no change in the subject movement or the video part in which the subject movement changes. It is sufficient to use a detecting means to do this. The detection means detects the difference between the images between frames, and if the difference is less than a certain value, there is no change in the movement of the subject, and if the difference is greater than a certain value, the change in the movement of the subject is preferable. For example, if a video part with no change in subject movement is not a relatively important part, and a video part with change in subject movement is a relatively important part, the time is shortened for the relatively unimportant part. It is possible to see, and it is highly likely that relatively important parts can be seen carefully. The video portion having no change in the movement of the subject includes not only that there is no change in the movement of the subject, but also a case where the change in the movement of the subject is less than a certain level. In addition, a video portion with a change in subject movement includes not only that there is a change in subject movement if there is even a slight movement of the subject, but also a video portion with a change in subject movement exceeding a certain level.

  (13) For example, the video data is recorded by a recording device, and it is preferable that the user evaluates the driving of the video portion of the video where the movement of the subject is changed.

  In this way, it becomes easier for the user to evaluate the driving of the vehicle in the video portion where the movement of the subject changes. In particular, as to whether the video part has no change in subject movement or the video part has a change in subject movement, it detects whether the video part has no change in the subject movement or the video part in which the subject movement changes. It is sufficient to use a detecting means to do this. The detection means detects the difference between the images between frames, and if the difference is less than a certain value, there is no change in the movement of the subject, and if the difference is greater than a certain value, the change in the movement of the subject is preferable. In particular, car driving is evaluated by analyzing video. The closer to driving according to a predetermined traffic rule, the higher the rating, and the closer to driving that does not follow the predetermined traffic rule. It is better to use an evaluation means for lower evaluation. For driving evaluation, for example, it is more important for a place where there is a change in the subject's movement depending on when it turns right, left, or lane than a place where there is no change in the subject's movement because it stops at a signal. Can think. Driving evaluation can be performed in such a situation.

  (14) For example, the video data is recorded by a recording device, and the video based on the video portion including the customer may be displayed.

  In this way, it becomes easier to view the video based on the video portion that includes the customer. The video portion including the customer may be determined by analyzing the video data and detecting a person other than the driver in the vehicle. For example, if a recording device is installed in a business vehicle such as a bus or taxi, and video data is recorded by such a recording device, it is possible to display an image including a customer in those business vehicles.

  (15) For example, a video portion related to the keyword may be found from the video based on a keyword representing the status of the video portion.

  In this way, it is easy to find the video portion related to the keyword from the video. In particular, it is preferable to detect a keyword input from an input means for inputting a keyword representing the situation of the video portion, and to find out a video portion related to the detected keyword by analyzing the video by the analysis means. The situation of the video portion may be, for example, an abstract situation such as bright or dark, or a situation in which a specific subject such as a bullet train was included or a red car was included.

  (16) For example, the video data is recorded by a recording device, and a video portion related to the keyword may be found from the video based on a keyword representing a vehicle condition at the time of recording the video data. .

  In this way, there is a high possibility that the video portion related to the keyword representing the car condition at the time of recording can be found. It is preferable to detect a keyword input to an input means for inputting a keyword representing a vehicle condition at the time of recording video data, and to find a video portion related to the detected keyword by analyzing the video with an analysis means. For example, the keyword representing the vehicle status may be that the vehicle has accelerated, that the vehicle has made a certain speed, or that the turn signal has been issued.

  (17) For example, the video data may be recorded by a recording device, and a warning may be given when the user has not seen the direction to be seen while driving the car.

  This makes it easier to warn the user that he was not looking in the direction to view. In particular, it is good to warn based on the information input by the input means for inputting information indicating that the user was not looking in the direction to be viewed. Such input means displays the user's line of sight detected by the detecting means for detecting the line of sight of the driving user on the reproduced image, and the displayed line of sight indicates a predetermined viewing direction. It is recommended to input information that is determined not to have been viewed. The warning may be, for example, adding a warning mark to the displayed video, adding a specific color to a part or all of the displayed video, or outputting an alarm.

  (18) For example, the video data is recorded by a recording device, and the processing process distinguishes between the range that is visible by the user and the range that is not visible by the user while driving the vehicle. It is good for the processing to be displayed.

  This makes it easy to understand the range that the user can see and the range that the user cannot see. In particular, based on the information input from the input means for inputting information indicating the range visible by the user, the processing for displaying the video by distinguishing the range visible by the user from the range not visible by the user. Good. For example, you may want to blur areas that are not visible to the user, fill them with a translucent color, or fill them completely.

  (19) For example, in the processing, the recorded video data may be processed so that the display range of the video is changed according to the orientation of the device that displays the video based on the video data after the processing.

  In this way, it becomes easier to view the video according to the orientation of the device that displays the video. It is preferable to change the display range of the video based on the information from the detecting means for detecting the orientation of the device that displays the video based on the processed video data. For example, it is good to record all 360 degree | times ranges at the time of recording, and to display the image | video corresponding to the direction according to the direction of the apparatus which displays an image | video.

  (20) For example, the video data is recorded by a recording device, and the processing is performed with a vehicle traveling direction as a reference direction according to the orientation of the device that displays the video based on the processed video data. The recorded video data should be processed to change the video display range.

  In this way, it is highly possible that the video can be viewed in accordance with the orientation of the device that displays the video by changing the display range of the video with the traveling direction of the vehicle as the reference direction. It is preferable to change the display range of the video based on the information from the detecting means for detecting the orientation of the device that displays the video based on the processed video data. Not only images in the direction of travel when the car is running, but also images in directions other than the direction of travel can be seen.

  (21) For example, information on the state of the vehicle at the time of recording the video data may be displayed.

  In this way, the situation of the car becomes easy to understand. For example, the vehicle status information may be vehicle speed, acceleration, and position. In particular, based on the information input from the input means for inputting information on the state of the vehicle at the time of recording the video data, the information may be displayed on the display screen of the display device by the display control means. The information on the state of the car may be displayed superimposed on the video, or an area other than the area where the video is displayed may be provided and displayed in the other area. For example, information about the vehicle status may be displayed in the upper, lower, left or upper area of the video.

  (22) For example, video data is recorded by a recording device, and a map image representing a moving range of the vehicle at the time of recording the video data is displayed, and the recording device is displayed at a designated position in the displayed map image. It is preferable to display a video based on the video data recorded by.

  In particular, the moving range of the vehicle at the time of recording the video data is detected by the detecting means, the image data representing the map image representing the detected moving range is acquired by the acquiring means, and is represented by the acquired image data. The map image is displayed on the display screen of the display device by the display control means, one of the displayed map images is designated by the designation means, and the video data recorded at the designated position is The image analysis means finds out the video data, and the found video may be displayed on the display screen of the display device by the display control means. This makes it easier to see the video at the specified position from the map image. Even if you don't know the time of the video you want to see, if you know its location, you can see the video at that location.

  (23) For example, the video based on the video data recorded by the user's recording device at the designated position in the displayed map image and the third party at the designated position in the displayed map image It is preferable to display at least one of video based on video data recorded by the recording device.

  In this way, not only video based on video data recorded by the user's recording device but also video based on video data recorded by a third-party recording device can be viewed. In particular, a command for requesting video data recorded by a third-party recording device at a specified position in the displayed map image to a server or the like on which such video data is recorded is transmitted from the transmission means. The video data transmitted from the server or the like according to the command is received by the receiving means, and the video based on the video data recorded by the third party recording device is displayed on the display screen of the display device by the display control means. It is good to display. Both video based on video data recorded by a user's recording device and video based on video data recorded by a third-party recording device may be displayed at the same time, or may be switched and displayed. May be. The video based on the video data recorded by the third-party recording device may be in the same season as the video data was recorded by the user's recording device or in a different season. The video based on the video data recorded by the third-party recording device may be the same weather as when the video data was recorded by the user recording device, or may be a different weather.

  (24) For example, a name including the shooting location of the recorded video data may be displayed as a name for identifying the recorded video data.

  In this way, a name including the shooting location can be used as a name for identifying video data. This makes it easier to find the video data of the shooting location. In particular, the shooting location is detected from the data indicating the recording position of the recorded video data by the detecting means, and the name including the detected shooting location is changed to a name for identifying the recorded video data by the name changing means. The changed name may be displayed on the display screen of the display device by the display control means as a name for identifying the recorded video data. In particular, the file name for storing the recorded data may be a name including the shooting location of the recorded video data by the file name changing means. For example, the file name of the video file storing the video data may be a name including the shooting location. The name of the shooting location itself may be a name for identifying video data.

  (25) For example, a plurality of video data may be recorded, and names that identify video data of the same shooting location may be displayed together.

  In this way, there is a high possibility that it is easy to understand whether the video data is from the same shooting location. In particular, the display device may be controlled by the display control means so that names for identifying video data of the same shooting location are collectively displayed on the display screen, for example. It can be considered that shooting locations with many identical shooting locations are everyday shooting locations such as commuting and attending school, and shooting locations with few identical shooting locations are unusual shooting locations such as travel destinations. Can think. There is a high possibility that it will be easier to select video data of everyday shooting locations or video data of unusual shooting locations.

  (26) For example, names with low appearance frequency may be displayed with priority.

  In this way, a name with a low appearance frequency can be displayed with priority, and video data corresponding to that name can be easily selected. In particular, the display device may be controlled by the display control means so that names with low appearance frequency are displayed on the display screen with priority. Whether or not the appearance frequency is low may be determined to be low when the appearance frequency is a predetermined threshold value or less, for example. For example, when a plurality of names to be identified are displayed in a list format in the vertical direction, the display should be displayed at the top, and when they are displayed in order, they should be displayed in an early order. .

  (27) For example, an image of a map of the shooting location may be displayed.

  In this way, in addition to the video based on the video data, there is a high possibility that a map of the shooting location can be seen. In particular, based on the data indicating the position of the shooting location, an image of the map of the shooting location may be found by the search means, and the image of the found map may be displayed on the display screen of the display device by the display control means.

  (28) For example, the video data is recorded by a recording device, and an image of a map representing a moving range of the vehicle at the time of recording the video data is displayed, and information on the operation of the car at the time of recording the video data is displayed on the map. It should be displayed on the image.

  In this way, it becomes easy to understand what kind of vehicle operation has been performed at the location indicated by the map image. What kind of vehicle operation is likely to be required when driving in the place represented by the map image by looking at the information about the vehicle operation displayed on the map image Recognize. From the data indicating the moving range of the car, a map image representing the moving range is found by the searching means, and the display control means controls the display device so that the image of the found map is displayed on the display screen. It is preferable to control the display device by the display control means so that the information related to the operation is input from the input means and the input information is displayed on the map image. For example, the operation of the car may be a turn signal operation, a sudden handle operation, a sudden brake operation, or the like.

  (29) For example, video data is recorded by a recording device, and a video based on the processed video data is displayed and a comparison between a third party operation and a user operation at the video data recording location is performed. Information based on this should be displayed.

  In this way, it becomes easy to compare the driving of a third party and the driving of the user. This comparison increases the possibility that the user can objectively evaluate his / her driving skill compared to driving by a third party. In particular, the data indicating the recording location of the video data is input from the input means, the information indicating the operation of the third party at the recording location indicated by the input data is acquired by the acquisition means, and the acquired third By using the information about the user's driving, the comparison between the user's driving and the third party's driving is performed by the comparing means, and the display device is controlled by the display control means so as to display the information based on the comparison on the display screen. Good. Information based on comparison between third-party driving and user driving includes, for example, third-party driving ranking and user driving ranking, third-party driving evaluation average value and user driving evaluation. It may be a value.

  (30) For example, the video data is recorded by the user's recording device, and is recorded on the recording device according to the video based on the processed video data and a third party operation at the video data recording location. Video based on video data should be displayed.

  In this way, it becomes easy to compare and view the video by the user's driving and the video by the third-party driving. By looking at the driving of a third party, the user is more likely to know the goodness and badness of his / her driving. In particular, data indicating the recording location of the video data is input from the input means, and the video data recorded in accordance with the operation of a third party at the recording location indicated by the input data is acquired by the acquisition means. The display control means may control the display device so that the video based on the video data recorded according to the third party's driving and the video obtained according to the user's driving are displayed on the display screen. The recording location of the video data is, for example, a location where video data obtained by a user driving a car in which a recording device is installed is recorded.

  (31) For example, information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication is recorded in association with video data, and road-to-vehicle communication is related to the video based on the processed video data. Control for displaying information obtained by at least one of vehicle-to-vehicle communication may be performed.

  This makes it easier to understand information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication. In particular, the display device may be controlled by the display control means so that the information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication is read by the reading means and the read information is displayed on the display screen. The information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication may be information obtained based on, for example, ITS (Intelligent Transport Systems). The information obtained by road-to-vehicle communication may be, for example, information transmitted from a roadside device provided on the road, and the information obtained by vehicle-to-vehicle communication may be information communicated between vehicles. Displaying in relation to the video only needs to be related to the video, and may be displayed on the video, or may be displayed in a separate area from the video, or the video is displayed. It may be displayed at times.

  (32) For example, the processing process may be a processing process for correcting the memory color.

  This makes it easier to obtain an image based on the memory color. In particular, it is preferable to use correction means for correcting the video to the storage process. For example, there is a high possibility that the user can obtain an image relatively close to memory. The memory color may be, for example, a color stored by the user as an image or a color stored for a specific color. For correction to the memory color, for example, brightness, hue, saturation, and the like may be changed by a user operation while viewing the video.

  (33) For example, the processing process may be a processing process for blurring at least a part of the video based on the recorded video data.

  In this way, there is a high possibility that an image at least partially blurred can be seen. In particular, it is preferable to perform the processing by blurring means for blurring the image. The specified range of the video may be blurred, or the outside of the specified range of the video may be blurred. You may enable it to switch between the blurring of the designated range and the blurring outside the designated range.

  (34) For example, when audio is output for the video based on the processed video data, it is directed to a display screen for displaying the video, and when audio is output to a viewer of the video based on the processed video data, A communication robot suitable for the viewer may be further provided.

  In this way, when outputting audio for a video, it is more likely that a communication robot that faces the display screen for displaying the video and for the viewer when the audio is output to the viewer of the video will be obtained. In particular, the communication robot analyzes the video displayed on the display screen by analyzing the video displayed on the display screen, the sound output means, the head rotating means that can move the neck between the display screen and the viewer. Judgment means for determining whether to output audio or to the viewer. When outputting audio for the video, face the display screen that displays the video, and when outputting audio to the video viewer, It is preferable to have head rotation control means for controlling the head rotation means so as to face. When audio is output for a video, it is suitable for the display screen that displays the video, so the viewer of the video is focused on the video, and when the audio is output to the viewer, it is appropriate for the viewer, so the audio output from the communication robot Is more likely to listen carefully. For example, the communication robot may be suitable for a display screen and a viewer and capable of outputting sound.

  (35) For example, it is preferable to perform control to change the display mode of the video based on the processed video data based on the information on the road.

  In this way, it becomes easy to change the display mode of the video based on the information about the road. In particular, a mode in which a video represented by video data is analyzed, information on a road included in the video is detected, and the video based on the processed video data is displayed based on the detected information on the road. It is good to change. The information on the road may be, for example, a road width or a road sign. For example, the aspect may be changed by changing the brightness, hue, saturation, etc. of the video based on the information about the road, or displaying the video with different camera angles.

  (36) For example, a recording device for recording the video data to be played back by the playback device may be used.

  This increases the possibility of recording video data to be played back by the playback device. For example, it may be a drive recorder that records video data to be played back by the playback device. The recording device may be installed in a four-wheeled vehicle such as an automobile, or a two-wheeled vehicle such as a motorcycle or a bicycle.

  (37) For example, the recording device may perform control to record the video data with high image quality based on designated conditions.

  In this way, it becomes easy to record video data with high image quality based on designated conditions. In particular, the recording unit may be controlled by the recording control unit so that the condition is specified by the specifying unit, the specified condition is input by the input unit, and the video data is recorded with high image quality based on the input condition. The specified condition may be, for example, location, time, etc. For the high image quality, for example, the frame rate may be set higher than a certain threshold, or the resolution may be higher than the certain resolution.

  (38) For example, at least one of the reproducing device and the recording device includes a specifying unit for specifying a condition, and controls to record the video data with high image quality based on the condition specified by the specifying unit. Good.

  In this way, there is a high possibility that video data can be recorded with high image quality based on the conditions specified by the specifying means. In particular, the recording unit may be controlled by the recording control unit so that the condition is specified by the specifying unit, the specified condition is input by the input unit, and the video data is recorded with high image quality based on the input condition. When the reproducing apparatus includes a specifying unit, for example, data representing a condition specified by the specifying unit is recorded on a recording medium for recording video data, and such a recording medium is loaded into the recording apparatus and recorded. It is preferable to record video data with high image quality in the recording device based on the designated condition by reading data representing the designated condition from the medium.

  (39) For example, the condition may be that either the speed of the vehicle on which the recording device is installed exceeds a certain level, or that the vehicle on which the recording device is installed travels in a designated place. There should be.

  In this way, it becomes easier to record video data with high image quality when the speed of the vehicle exceeds a certain value or when the vehicle travels in a designated place. In particular, the speedometer of the car was photographed using the camera provided in the recording device, the video taken by the analyzing means was analyzed, and the speedometer of the car was judged to be above a certain level by the judging means. It is preferable that high-quality recording is performed by determining that it has been determined. Further, the position where the vehicle is traveling may be detected by the position detecting means, and high quality recording may be performed when it is determined by the determining means that the vehicle is traveling in the designated place.

  (40) For example, information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication when the video data is recorded by the recording device may be recorded in association with the video data.

  In this way, there is a high possibility that information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication can be recorded in association with video data. In particular, information transmitted by at least one of road-to-vehicle communication and vehicle-to-vehicle communication may be received by the receiving means, and the received information may be recorded in association with video data obtained by photographing. In particular, information transmitted by at least one of road-to-vehicle communication and vehicle-to-vehicle communication may be recorded in the header of a video file that stores video data obtained by shooting.

  (41) For example, control may be performed to transmit data representing a first calculation value uniquely determined from the video data recorded by the recording device to the block chain system.

  This increases the possibility that data representing the first calculation value uniquely determined from the video data can be transmitted to the block chain system. Data representing the first calculated value can be recorded in the block chain. In particular, the transmission means is configured to calculate a first calculated value uniquely determined from the video data recorded by the recording device, and to transmit the data representing the calculated first calculated value to the block chain system. It is good to control. The calculation means for calculating the first calculation value may be provided in the recording apparatus, the reproduction apparatus, the transmission means may be provided in the recording apparatus, or the reproduction apparatus It may be provided. Since the possibility of tampering with the block chain is relatively low, the data representing the first calculation value may not be tampered with when the data representing the first calculation value is recorded in the block chain. Is high, and there is a high possibility that it is possible to prove that the video data has not been tampered with using the data representing the first calculation value and the video data.

  (42) For example, the video data recorded by the recording device is video data based on MPEG, and the first calculation value that is uniquely determined for each unit is defined as a unit for dividing the video data immediately before the P frame. It is advisable to control the data to be recorded in the block chain.

  In this way, there is a high possibility that data representing the first calculation value for each unit divided immediately before the P frame can be recorded in the block chain. Since the P frame cannot be reproduced as a single image without the I frame, if the first calculated value is calculated for each unit by dividing immediately before the P frame, it is more difficult to calculate the first calculated value. Is likely to be. In particular, the immediately preceding P frame is used as a unit for dividing video data, a first calculation value that is uniquely determined for each unit is calculated, and the data representing the calculated first calculation value is stored in the block chain system. The transmission means may be controlled so as to transmit to.

  (43) For example, it may be controlled to record data representing the second calculation value uniquely determined from the event data in the block chain.

  In this way, there is a high possibility that data representing the second calculation value uniquely determined by the event data can be recorded in the block chain. It is possible to make it difficult to falsify the second calculated value. In particular, when the second calculation value uniquely determined from the event data is calculated by the calculation means, and the transmission means is controlled to transmit the data representing the calculated second calculation value to the block chain system. Good. By comparing the second calculated value with the event data, it can be determined whether or not the event data has been tampered with. Since it is difficult to tamper with the second calculated value, it is also difficult to tamper with the event data.

  (44) For example, data indicating whether the video data recorded in the recording device is for manual operation or automatic operation may be recorded in association with the video data.

  This increases the possibility of knowing whether the video data is for manual operation or automatic operation. In particular, identification data indicating whether the video data recorded in the recording device during manual operation or the video data recorded in the recording device during automatic operation is input from the input means, and the input identification data is associated with the video data. To record. Sometimes, the identification data may be recorded in the header area of the video file in which the video data is recorded. Manual driving is, for example, that a person operates by driving the steering wheel of a car, and automatic driving is one in which a person operates the steering wheel by machine control without operating the steering wheel of the car. Good.

  (45) For example, the image quality of the video data recorded by the recording device may be changed between manual operation and automatic operation.

  In this way, there is a high possibility that images with different image quality are obtained between the video data during manual operation and the video data during automatic operation. In particular, when identification data indicating whether manual operation or automatic operation is being input from the input means, and when the identification data indicates that manual operation is being performed, the image quality of the recorded video data indicates that automatic operation is being performed. The image quality of the recorded video data may be changed by changing means. Video data may be recorded with higher image quality during manual operation and lower image quality during automatic operation, and conversely, lower image quality during automatic operation and lower image quality during automatic operation. Video data may be recorded at a higher level.

  (46) For example, the communication robot may be operated during automatic operation.

  This increases the possibility that the communication robot can be operated during automatic driving. During automatic driving, for example, the user does not need to drive, so that the user can communicate with the communication robot without hindering driving. In particular, identification data indicating that the vehicle is in automatic operation is input by the input device of the recording device, and an operation command is transmitted to the communication robot in response to the input of such identification data to the input device. It is good to send from.

  (47) For example, control may be performed to display a video based on recorded video data and to change the video display mode when it is determined that an event is highly likely to occur.

  In this way, it becomes easier to change the display mode of the video according to the determination that the possibility of an event occurring is high. In particular, a display device is provided in a recording device provided in the vehicle, and an image is displayed on the display screen of the display device. The image is analyzed by an analysis means while the vehicle is running, and as a result of the analysis, an event is detected in front of the vehicle. The display device may be controlled by the display control means so as to change the mode of the video displayed on the display screen in response to the determination by the determination means that the possibility of occurrence of the image is high. For example, since it is understood that there is a high possibility that an event will occur by recognizing that the video display mode has been changed, it is possible to prepare for the event. For example, when the video data is taken by a drive recorder installed in a running car, the video mode is changed so that, for example, some event occurs, for example, a sudden pedestrian after several seconds. , It can be seen that the car may jump out.

  (48) For example, data representing the communication state of the communication radio wave received by the communication device may be recorded.

  This makes it easier to record data representing the communication state of the communication radio wave. In particular, it is preferable to receive communication radio waves by a communication device that supports reception of communication radio waves and record data representing the communication state of the communication radio waves. In particular, the data indicating the communication status should be whether communication is in progress or communication is interrupted. For example, the communication radio wave may be a radio wave based on LTE (Long Term Evolution), Wi-Fi, or Bluetooth (registered trademark). When displaying the video, the display mode may be changed according to the communication state.

  (49) For example, the recording mode of the video data may be changed based on the communication radio wave received by the communication device.

  This makes it easy to change the video data recording mode based on the communication radio wave. In particular, it is preferable to receive the communication radio wave by a communication device that supports reception of the communication radio wave, and to change the video data recording mode based on the received communication radio wave. In particular, any recording mode may be used as long as the recording method is changed. For example, a recording mode with high image quality may be set when receiving radio waves for communication, and a recording mode with low image quality may be set when receiving radio waves for communication. The reverse may be used.

  (50) For example, video data representing a video of a driver who has received a call and the video data obtained by driving the driver may be recorded in association with each other.

  In this way, there is a high possibility that the video data representing the video of the driver who has received a call and the video data obtained by driving the driver can be recorded in association with each other. In particular, video data representing the video of the driver who has received a call is input by the input means, and the video data obtained by photographing the driver's driving with the input video data and a camera provided in the recording device. Should be recorded in association with each other. In particular, these video data should be stored in the same folder. For example, an image obtained by driving the driver can be displayed in association with the image of the driver who has received a call. For example, an image of a driver who receives a call and an image of the driver's driving can be displayed at the same time.

  (51) For example, the video data obtained by a recording device installed on a truck driven by a driver is associated with the video data obtained by a recording device installed on a forklift operated by the driver. Control to record may be performed.

  This makes it easy to record the video data during truck operation and the video data during forklift operation in association with each other. In particular, video data obtained by photographing the driving of a truck driver by a camera provided in a recording device attached to the truck is transmitted to the server, and is provided in the recording device attached to the forklift. Video data obtained by photographing the driving of the forklift driver by the camera may be transmitted to the server, and the video data may be associated with each other and recorded on the server. In particular, a video folder is created for each driver in the server, and the video data when the driver drives the truck and the video data when the forklift is driven may be stored in the same video file. Also, when driving a truck, video data at the time of driving the truck is recorded on a recording medium loaded in a recording device attached to the truck, and when the forklift is driven, the recording medium is attached to the truck. The video data when the forklift is operated is stored in the same video file as the video file that stores the video data when the truck is driven. May be. For example, it becomes possible to compare and compare the image of the driver driving the truck with the image of the driver driving the forklift.

  (52) For example, control may be performed so that information that should be noted in driving is displayed over a real landscape seen from a running car.

  In this way, there is a high possibility that information to be noted in driving can be displayed on the actual landscape. When you actually drive, you will be able to understand information to watch out for while watching the actual scenery. In particular, it is preferable to display on the MR device information that should be noted in driving while viewing the actual scenery with an MR (Mixed Reality) device. In particular, for example, when the user puts on the MR device of glasses, the real scene is shown through the spectacles, and the information to be careful of driving is displayed on the surface of the spectacles in a translucent form on the real scene. Good.

  (53) For example, based on the fact that the vehicle has traveled in the same place as previously traveled, it may be controlled to notify that fact.

  In this way, it will be easier to see if you have run before. Since it is known that the vehicle has traveled before, new developments such as whether to use the same travel route or another travel route can be considered. In particular, data indicating the previous travel location is recorded on the recording medium loaded in the recording device, and the previous travel location represented by the recorded data is compared with the current travel location. If they match, a voice output from the voice output device, a display on the display screen of the display device, and the like are informed that the vehicle is traveling in the same place as the previous drive. A GPS (global positioning system) receiver provided in the recording device may be used to detect the current traveling location.

  (54) For example, it may be controlled to take a picture of a speedometer of a car and record the video data based on the taken speedometer.

  In this way, it is highly possible that video data can be recorded based on the speedometer that has been shot. In particular, in the car, a camera is installed in the recording device at a position where the speed meter can be photographed. The speed meter of the car is photographed by the camera, and the image obtained by the photographing is analyzed by the analyzing means. When the speed of the recording condition is indicated, video data recording may be started. For example, video data may be recorded when the vehicle speed meter exceeds 80 km.

  (55) For example, it may be a recording device attached to the automatic conveyance vehicle, and control for recording the video data based on the detection of the approach of the peripheral object of the automatic conveyance vehicle may be performed.

  In this way, there is a high possibility that video data can be recorded based on the detection of the approach of the peripheral object of the automated guided vehicle. In particular, the vicinity of the automatic transport vehicle is photographed by a camera provided in the recording device, and when the detection means detects the approach of the peripheral object of the automatic transport vehicle, the video data obtained by the camera photographing may be recorded. For example, when an automated guided vehicle comes into contact with surrounding objects, the situation can be understood.

  (56) For example, it may be a recording device attached to the forklift, and control for recording the video data may be performed based on at least one of the operation of the forklift and the rider riding on the forklift.

  In this way, video data can be easily recorded based on at least one of the operation of the forklift and the fact that the driver gets on the forklift. In particular, the recording of the video data may be started in response to the detection means detecting at least one of the operation of the forklift and the fact that the driver gets on the forklift. In particular, the inside of the forklift is photographed by a camera provided in the recording device, and the image data obtained by the photographing is analyzed to detect whether the forklift has been operated or whether the driver has been on the forklift. Accordingly, recording of video data may be started. The operation of the forklift may be, for example, that the fork has moved. For example, recording of video data may be stopped when the driver gets off the forklift.

  (57) Event recording trigger information may be recorded in a header of a file storing the video data.

  This increases the possibility that event recording trigger information can be recorded in the header of the file. For example, the possibility of developing various processes using the trigger information increases.

  (58) For example, a playback method for playing back recorded video data for processing the recorded video data based on the acquired information and displaying the video based on the processed video data It is good to perform control.

  In this way, it is highly likely that the user can see the video processed based on the acquired information, not the recorded video itself. By processing the processing suitable for the user viewing the video, it is possible to obtain a video suitable for the user. Since the recorded video data is processed based on the acquired information instead of processing the recorded video, the possibility of displaying a video more suitable for the user viewing the video increases.

  (59) The recording apparatus may be controlled to record video data to be reproduced in the reproduction method.

  This increases the possibility that the video data to be reproduced can be recorded in the recording device.

  (60) For example, a computer-readable program that reproduces recorded video data, processes the recorded video data based on the acquired information, and performs video processing based on the processed video data It may be a computer-readable program that performs control for displaying.

  In this way, the user can see the video processed based on the acquired information, not the recorded video itself. By processing the processing suitable for the user viewing the video, it is possible to obtain a video suitable for the user. Since the recorded video data is processed based on the acquired information instead of processing the recorded video, the possibility of displaying a video more suitable for the user viewing the video increases.

  The above-described inventions shown in (1) to (60) can be arbitrarily combined. For example, a configuration in which at least a part of at least one of the inventions after (2) is added to all or part of the configuration of the invention shown in (1) may be adopted. In particular, the invention shown in (1) may be an invention in which at least a part of at least one of the inventions after (2) is added. Further, an arbitrary configuration may be extracted from the inventions shown in (1) to (60), and the extracted configurations may be combined. The applicant of the present application has an intention to acquire the right for an invention including these configurations.

In this way, the user can see the video processed based on the acquired information, not the recorded video itself. By processing the processing suitable for the user viewing the video, it is possible to obtain a video suitable for the user. Since the recorded video data is processed based on the acquired information instead of processing the recorded video, the possibility of displaying a video more suitable for the user viewing the video increases.
The effect of the invention of the present application is not limited to this, and the effect obtained from the part of the configuration disclosed in this specification and the drawings is also disclosed, and the right for the configuration that exhibits the effect is also obtained through divisional application, amendment, etc. Have the will to do. For example, in the present specification, a portion described as “to be able to” is a description that clearly shows the effect to be achieved, and there is a portion showing an effect even if “to be able to” is not described. Even if there is no such description, there is an effect grasped by the configuration.

It is a side view of a drive recorder. It is a block diagram which shows the electric constitution of a drive recorder. The file structure of the video file is shown. It is a flowchart which shows a recording processing procedure. It is a flowchart which shows the production | generation process procedure of header data. It is a flowchart which shows the recording processing procedure of video data. It is a flowchart which shows the output process procedure of data. It is a flowchart which shows the output process procedure of data. It is an example of the image | video displayed on a display screen. It is a block diagram which shows the electric constitution of a personal computer. It is a flowchart which shows the reproduction | regeneration processing procedure. It is a flowchart which shows the reproduction | regeneration processing procedure. It is a flowchart which shows the reproduction | regeneration processing procedure. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a play list display area. It is an example of a play list display area. An I frame and a P frame are shown. It is a flowchart which shows a recording processing procedure. It is a flowchart which shows the process sequence of the drive recorder attached to the track. It is a flowchart which shows the process sequence of the drive recorder attached to the forklift. It is a flowchart which shows a recording processing procedure. It is a flowchart which shows the process sequence of an automatic conveyance vehicle. It is a flowchart which shows the process sequence of driving | running evaluation. It is a flowchart which shows the reproduction | regeneration processing procedure. It is a flowchart which shows the reproduction | regeneration processing procedure. It is a flowchart which shows the reproduction | regeneration processing procedure. It is an example of the image of a map. It is a flowchart which shows the reproduction | regeneration processing procedure. It is an example of a reproduction window. It is an example of a reproduction window. It is an example of a personal computer and a communication robot. It is a block diagram which shows the electrical structure of a communication robot. It is a flowchart which shows the process sequence of a communication robot. It shows a communication robot placed in the car.

(1) Recording Process FIGS. 1 to 9 relate to a recording process using a drive recorder.

  FIG. 1 shows an embodiment of the present invention, and is a side view of a drive recorder (for example, an example of a recording apparatus) 1.

  The drive recorder 1 includes an attachment part 2 and a camera part 4.

  The mounting portion 2 is fixed to the windshield (not shown) of the vehicle to which the drive recorder 1 is mounted, and makes the memory card detachable. In addition, a display screen 3 for displaying a photographed image is formed on a part of the outer peripheral surface of the attachment portion 2. Further, the mounting portion 2 includes a DC (direct current) jack (not shown) connected to the vehicle via a converter unit (not shown). Furthermore, the attachment part 2 is provided with predetermined buttons (not shown).

  The camera unit 4 includes a front camera (not shown in FIG. 1) that mainly captures the front (the traveling direction of the vehicle with the drive recorder 1) and a rear camera (not illustrated in FIG. 1) that mainly captures the rear. ) Is built-in. The camera unit 4 includes a front lens 5 that forms an object on the imaging surface of the front camera, and a rear lens 6 that forms an image of the object on the imaging surface of the rear camera. The front camera can shoot the front direction of the vehicle, the left and right direction in front of the vehicle, and the up and down direction in front of the vehicle. The rear camera can shoot the rear direction of the vehicle, the left and right direction in the rear of the vehicle, and the up and down direction in the rear of the vehicle. it can. Therefore, all directions around the drive recorder 1 can be photographed by the front camera and the rear camera.

  The camera unit 4 can move within a range of a predetermined angle θ around the mounting unit 2 with respect to the mounting unit 2, and can shoot at a relatively suitable angle regardless of the angle of the windshield. It becomes.

  FIG. 2 is a block diagram showing an electrical configuration of the drive recorder 1.

  The overall operation of the drive recorder 1 is controlled by the controller 10.

  The drive recorder 1 includes a memory card reader / writer 95. When the memory card 25 is attached to the drive recorder 1, the memory card reader / writer 95 reads data recorded on the memory card 25, writes data to the memory card 25, and the like. The memory card 25 stores an operation program to be described later. The controller 10 reads the recorded operation program and is installed in the drive recorder 1. The controller 10 reads the operation program installed in the drive recorder 1 and controls each part of the drive recorder 1 according to the operation program. When the operation program of the drive recorder 1 is stored in a recording medium other than the memory card 25, it may be read from such a recording medium. In this case, an interface such as a driver corresponding to the recording medium is provided in the drive recorder. Further, it may be received by the communication circuit 17 and installed in the drive recorder 1.

  The drive recorder 1 includes the front camera 11 and the rear camera 12 as described above. Video data photographed by the front camera 11 and the rear camera 12 are input to the controller 10. Further, the drive recorder 1 includes a display device having a display screen 3, and the display control device 13 controls display on the display device 14. Further, the drive recorder 1 includes a clock 15, a road-to-vehicle / vehicle-to-vehicle information receiving circuit 16, a communication circuit 17, and an acceleration sensor 18. Time data representing the time output from the clock 15 is output to the controller 10. The road-to-vehicle / vehicle-to-vehicle information receiving circuit 16 transmits, for example, data representing a surrounding situation (an example of road-to-vehicle information) transmitted from a roadside device arranged on a road or the like based on an intelligent road information system and transmitted from a vehicle. Data representing the vehicle information (which is an example of vehicle-to-vehicle information) is received, and the received data is output to the controller 10. The road-to-vehicle / vehicle-to-vehicle information receiving circuit 16 uses, for example, a communication circuit based on DSRC (Dedicated Short Range Communications). The communication circuit 17 communicates with the communication robot, for example, when the communication robot is placed in the vehicle. Output data from the communication circuit 17 is input to the controller 10. The acceleration sensor 18 detects the acceleration of the vehicle to which the drive / recorder 1 is attached, and outputs the detected acceleration data to the controller 10.

  The drive recorder 1 further includes an input device 20 such as buttons, a memory 21 such as a RAM (Random Access Memory), and a GPS (Global Positioning System) receiver 22. An output signal from the input device 20, output data from the memory 21, and output data from the GPS receiver 22 are also input to the controller 10.

  FIG. 3 shows the file structure of a video file that stores the video data output from the front camera 11 and the video data output from the rear camera 11.

  The video file includes a header recording area 31 and a video recording area 32. The header recording area 31 is an area for recording header data, and the video recording area 32 is an area for recording video data.

  FIG. 4 is a flowchart showing a recording processing procedure of the drive recorder 1.

  The recording process procedure shown in FIG. 4 is repeated for each frame (for example, other frames) until the recording process ends.

  When the engine of the vehicle to which the drive recorder 1 is attached is started, the battery of the vehicle supplies power to the drive recorder. Then, the recording process shown in FIG. 4 starts. In addition, a video file is generated on the memory card 25. When the recording process is started, video data output from the front camera 11 and the rear camera 12 is input to the display control device 13 via the controller 10. The captured image is displayed on the display screen 3 of the display device 14 (see FIG. 9). The video displayed on the display screen 3 is either a video obtained by the front camera 11 or a video obtained by the rear camera 12 in accordance with a program recorded on the memory card 25. However, both the video obtained by the front camera 11 and the video obtained by the rear camera 12 may be displayed. In addition, a video obtained by the front camera 11 or a video obtained by the rear camera 12 is displayed as a default display, a switching button is provided on the input device 20, and the front camera is operated according to the operation of the switching button. It may be switched to display the video obtained by 11 or the video obtained by the rear camera.

  First, generation of header data and temporary recording processing of the generated header data to the memory 21 are performed (step 41), and then temporary recording processing of video data to the memory 21 is performed (step 41). Step 42). Subsequently, output processing of various data and the like is performed (step 43), and data temporarily recorded in the memory 21 is written to the memory card 25 (step 44).

  In FIG. 4, after the header data is generated and the generated header data is temporarily recorded in the memory 21 (step 41), the video data is temporarily recorded in the memory 21 (step 41). 42) After that, output processing of various data and the like is performed (step 43), but the order of these processing is not limited. Also, the header data and video data are temporarily recorded in the memory 21, the header data and video data recorded in the memory 21 are read, and the read header data and video data are written to the memory card 25. However, if possible, the data may be directly written in the memory card 25 without being temporarily stored in the memory 21. Of the header data generation and recording process (step 41), the video data recording process (step 42), and the data output process (step 43), two or more desired processes are performed in parallel. It may be.

  When the engine of the vehicle to which the drive recorder 1 is attached is stopped and the power supply to the drive recorder 1 is stopped, the recording processing procedure shown in FIG. 4 ends.

  FIG. 5 is a flowchart showing the header data generation processing procedure (the processing procedure of step 41 in FIG. 4), and shows the processing procedure of the controller 10.

  If the vehicle to which the drive recorder 1 is attached is capable of automatic driving, the vehicle is automatically driving from the vehicle to the drive recorder 1 (during driving that is not based on the driver's operation). Some data is sent. For example, the drive recorder 1 is connected to the vehicle's in-vehicle network, and the data indicating whether the vehicle is in automatic operation or manual operation (during operation based on the operation of the vehicle driver) output to the in-vehicle network is detected. Thus, the controller 10 of the drive recorder 1 recognizes whether the vehicle is operating automatically or manually. When the vehicle and the drive recorder 1 can communicate wirelessly and data indicating whether the vehicle is in automatic operation or manual operation is transmitted, the data is transmitted to the communication circuit 17 of the drive recorder 1. The controller 10 of the drive recorder 1 may recognize whether the vehicle is operating automatically or manually.

  It is judged by the controller 10 of the drive recorder 1 whether the vehicle is in automatic operation or manual operation (step 51). In the case of automatic operation, data indicating that the data recorded in the memory card 25 is video data taken during automatic operation is temporarily recorded in the memory 21 as header data (step 52). ). In the case of manual operation, data indicating that the data recorded in the memory card 25 is video data shot during manual operation is temporarily recorded in the memory 21 as header data ( Step 53). For example, data indicating whether video data captured within a certain period of time is data during automatic operation or data during manual operation is temporarily recorded in the memory card 25. Of course, an automatic operation video folder for storing video data during automatic operation and a manual operation video folder for storing video data during manual operation are generated, and the video data shot during automatic operation is stored in the automatic operation video folder. However, video data captured during manual operation may be stored in the means operation video folder. Data indicating whether storage of video data in the time or automatic operation video folder or video data in the manual operation video folder is video data during automatic operation or video data during manual operation, and video data during automatic operation Alternatively, it is associated with video data during manual operation.

  Subsequently, it is confirmed by the controller 10 whether the road-to-vehicle / vehicle-to-vehicle information receiving circuit 16 has received road-to-vehicle communication information or vehicle-to-vehicle communication information (step 54). When road-to-vehicle communication information or vehicle-to-vehicle communication information is received (YES in step 54), data representing the received communication information is temporarily recorded in the memory 21 together with data representing the time at which the communication information was received (step 55). ). Since the time when the communication information is received is known, it is possible to know what kind of video was captured at that time, and when reproducing the captured video, road-to-vehicle communication information or vehicle-to-vehicle communication information can be output at the same time. Thus, for example, road-to-vehicle communication information or visual-vehicle-to-vehicle communication information can be associated with video data depending on time. If neither road-to-vehicle communication information nor vehicle-to-vehicle communication information is received (NO in step 54), the process in step 55 is skipped, and the received information is not temporarily recorded in the memory 21.

  It is also confirmed whether or not the communication radio wave has been received by the communication circuit 17 (step 56). When a communication radio wave is received by the communication circuit 17 (YES in step 56), data representing the communication state of the communication radio wave is temporarily recorded in the memory 21 (step 57). For example, when the communication circuit 17 receives a radar wave emitted from a speed control device installed on a road such as Orbis or a radio used by an emergency vehicle, data indicating the contents is stored in the memory 21. Is temporarily recorded. If no communication radio wave is received by the communication circuit 17 (NO in step 56), the process of step 57 is skipped, and data representing the communication state of the communication radio wave is not recorded in the memory 21.

  Further, the line of sight of the driver of the vehicle is detected by the controller 10 from the video data obtained by the rear camera 12 (step 58). The line-of-sight data representing the detected line of sight is also temporarily written in the memory 21 together with the data representing the time (step 59). Know when and where the driver was looking. Eyes are detected from the image, and the line of sight can be determined by the positional relationship between the pupil, iris and cornea of the eye (so-called black eye) and the conjunctiva (so-called white eye). Similarly, the video data obtained by the rear camera 12 is analyzed, the direction in which the vehicle driver is facing is detected, and the data indicating the detected direction is also temporarily stored in the memory 21 together with the data indicating the shooting time. Is written to.

  FIG. 6 is a flowchart showing the video data recording processing procedure (the processing procedure of step 42 in FIG. 4).

  In the video data recording process, the controller 10 confirms whether automatic operation or manual operation is in progress (step 61). When automatic operation is in progress, relatively low-quality video data is recorded in the memory 21 (step 62). For example, pixel thinning is performed such that the number of pixels per frame represented by the video data output from the front camera 11 and the rear camera 12 is less than a first threshold (decrease in resolution), unit time The front camera 11 and the rear camera 12 are controlled by the controller 10 so that the number of read frames per frame is made smaller than the first frame number (decrease in the frame rate). Thereby, relatively low-quality video data can be obtained. If it is during manual operation, relatively medium-quality video data is recorded in the memory 21 (step 63). For example, pixel thinning is performed such that the number of pixels per frame represented by the video data output from the front camera 11 and the rear camera 12 exceeds the first threshold, or the number of frames read out per unit time The front camera 11 and the rear camera 12 are controlled by the controller 10 so as to be larger than the first frame number. As a result, relatively medium-quality video data can be obtained. In this way, the image quality of the video data can be adjusted by adjusting the resolution and the frame rate. Video data with relatively low image quality is recorded in the memory 21 during automatic operation, and video data with relatively medium image quality is recorded in the memory 21 during manual operation. The video data with relatively medium image quality may be recorded in the memory 21, and the image data with relatively low image quality may be recorded in the memory 21 during manual operation. The image quality of the video data recorded during the automatic operation may be different from the image quality of the video data recorded during the manual operation.

  Subsequently, it is confirmed by the controller 10 whether or not the specified condition is satisfied (step 64). For example, when the vehicle speed is above a certain level, the vehicle is traveling in a designated place, and the input device 20 of the drive recorder 1 is provided with a high image quality designation switch (an example of designation means). Is an example of the designated condition that the high image quality designation switch is operated. If the drive recorder 1 is mounted on the vehicle so that the rear camera 12 can take a picture of the speedometer of the vehicle, whether the speed of the vehicle has exceeded a certain level can be obtained from the image obtained by the rear camera 12 Can also be detected from the travel distance calculated based on the GPS receiver 22 and the time required for the travel distance calculated based on the clock 15. Whether the vehicle is traveling in the designated place can be determined based on the output data from the GPS receiver 22.

  When the designated condition is satisfied (YES in step 64), relatively high-quality video data is temporarily recorded in the memory 21 (step 65). For example, stop the pixel thinning of the video data output from the front camera 11 and the rear camera 12, or set the number of read frames per unit time to be larger than the number of frames at medium resolution. The camera 11 and the rear camera 12 are controlled by the controller 10. Thereby, relatively high-quality video data can be obtained. If the specified condition is not satisfied (NO in step 64), the process of step 65 is skipped, and the process of recording the high-quality video data in the memory 21 is not performed.

  Further, it is also confirmed whether or not the controller 10 has been instructed to change the recording mode (step 66). If there is a recording mode change command (YES in step 66), the recording mode is changed (step 67). If there is no recording mode change command (NO in step 66), the recording mode is changed. Is not done. For example, as described above, when the communication circuit 17 receives a radar wave emitted from a speed control device installed on a road such as Orbis or a radio wave used by an emergency vehicle or the like, it is recorded. It may be determined that there has been a mode change command. Due to the recording mode change command, for example, the recording mode can be changed so that high-quality video data is recorded in the memory 21.

  In the video data recording process shown in FIG. 6, after confirming whether automatic operation or manual operation is being performed (step 61), it is confirmed whether the specified conditions are met (step 64). After confirming whether the specified conditions are met (step 64), confirmation of whether automatic operation or manual operation is being performed (step 61) may be performed, or both of these confirmations (step 61, 64) may be performed in parallel.

  FIG. 7 is a flowchart showing the data output processing procedure (the processing procedure of step 43 in FIG. 4).

  In the data output processing procedure, the controller 10 confirms whether automatic operation or manual operation is in progress (step 71). In the case of automatic driving, an operation start command is transmitted from the communication circuit 17 to a communication robot (not shown) placed in the vehicle (step 72). In the case of manual operation, an operation start command is not transmitted from the communication circuit 17 to the communication robot placed in the vehicle. A communication robot stop command may be sent during manual operation. During automatic driving, the driver is not driving manually, so there is no hindrance to driving even if the communication robot operates. On the other hand, the driver can communicate with the communication robot. Can be used. Since the communication robot placed in the vehicle does not operate during manual driving, it is possible to prevent troubles such as the driver talking to the communication robot and being unable to concentrate on driving. Also, if an operation stop command is sent to the communication robot during manual operation, the operation can be stopped when the communication robot is operating.

  Subsequently, the controller 10 confirms whether or not the event is highly likely to occur (step 73). For example, when the road width of a running road is narrow or when there is a lot of traffic, there is a high possibility that an event will occur due to a sudden braking by the driver. If there is a high possibility that an event will occur (YES in step 73), the display controller 13 is controlled by the controller 10 so as to change the display mode of the video displayed on the display screen 3 of the drive recorder 1 ( Step 74). For example, by displaying the letters “CAUTION!” On the display screen, or by superimposing the entire image displayed on the display screen 3 or a part of the periphery of the image with semi-transparent red, yellow, etc. It is better to change the display mode of the video. If the possibility of an event not occurring is high (NO in step 73), the display mode of the video displayed on the display screen 3 of the drive recorder 1 cannot be changed.

  Further, when the vehicle is traveling (it may be stopped), it is also confirmed by the controller 10 whether the traveling location is the same as the previously traveled location (step 75). In the memory card 25 mounted on the drive recorder 1, GPS data indicating the location where the vehicle has traveled before is recorded in the header recording area of the video file. The controller 10 compares the GPS data recorded in the header recording area with the GPS data received by the GPS receiver 22 provided in the drive recorder 1 attached to the running vehicle. , It can be confirmed whether the place where the car is running is the same as the place where the car was run before. If the vehicle is traveling in the same place as before (YES in step 75), the driver is notified of the same place from the drive recorder 1 (step 76). If the vehicle is not traveling in the same location as before (NO in step 75), the drive recorder 1 does not notify that the location is the same.

  FIG. 9 is an example of the display screen 3 of the drive recorder 1.

  On the display screen 3 of the drive recorder 1, a video image taken by the front camera 11 is displayed. At the bottom of the display screen 3, a character string 7 is displayed as “traveling the same place as previously traveled”. By looking at the character string 7, it can be seen that the driver is traveling in the same place as the place where the driver has traveled before. The driver can know whether he / she is traveling in a place with the impression that he / she has traveled based on his / her visual sense or whether he / she has actually traveled. Whether or not the place is the same as the place where you have traveled before may be a place that does not completely match but is within a certain range.

  Although it is displayed by the character string 7 that it is the same place as the place where it ran before, such a character string 7 is not displayed, a predetermined mark is displayed, or the display mode of the display screen 3 is changed. You may change it. The driver can see that he / she is traveling in the same place as previously traveled by seeing such a mark or by confirming the change of the display mode. If the drive recorder 1 is equipped with a speaker, the driver can be informed that the vehicle has traveled before by outputting voice or sound from the speaker without displaying the character string 7 or the like. May be. In any case, it is only necessary for the driver to know that he / she is traveling in the same place as previously traveled.

  Returning to FIG. 8, when one frame of video data is temporarily recorded in the memory 21, a hash value of the recorded video data (an example of a first calculation value uniquely determined from the video data). Is calculated by the controller 10 (step 77). The data representing the calculated hash value and the communication circuit 17 are transmitted to the block chain system (step 78). Data representing the calculated hash value is recorded in the block chain (block transaction) by the block chain system. Since block chains are difficult to tamper with, it is possible to check whether video data has been tampered with using a hash value. Data representing the calculated hash value is also recorded in the memory card 25, and when confirming whether the video data has been tampered with, the data representing the hash value transmitted to the block chain system Is compared with the data representing the hash value recorded on the memory card 25. If the hash values match, the video data has not been altered, and if the hash values do not match, the video data has been altered. It is judged that it was broken. Needless to say, the video data recorded on the memory card 25 and the data representing the hash value are associated with each other and recorded on the memory card 25. For example, the data representing the hash value is recorded in the header recording area 31 of the video file together with the data indicating the time of the video data from which the hash value was calculated.

  Thus, when header data and video data are temporarily recorded in the memory 21, the recorded header data and video data are read from the memory 21, and the header data and video data are read in the header recording area of the video file. Is written, and video data is written to the video recording area of the video file.

(2) Reproduction Processing FIGS. 10 to 23 relate to reproduction processing using the reproduction viewer software.

  FIG. 10 is a block diagram showing an electrical configuration of a tablet personal computer (which is an example of a playback device).

  The overall operation of the tablet personal computer (hereinafter referred to as personal computer) 80 is controlled by a CPU (Central Processing Unit) 80.

  The personal computer 80 is provided with a display device 82. The display device 82 is controlled by a display control device 81 controlled by the CPU 90. The personal computer 80 is provided with an acceleration sensor 93, and an output signal from the acceleration sensor 93 is input to the CPU 90. Further, the personal computer 80 has a solid state drive (SSD) 94 accessed by the CPU 90, a memory card that reads data recorded on the memory card 25, and writes data to the memory card 25. A reader / writer 95 is included.

  Further, the personal computer 80 includes an input device 96 such as a keyboard and a mouse, a memory 97 such as a RAM, and a communication circuit 98 connected to a network such as the Internet.

  An operation program to be described later is received by the communication circuit 98 of the personal computer 80 via the Internet and installed in the personal computer 80. The CPU 90 controls each unit by reading and executing the installed program. The operation program may be stored in a recording medium such as the memory card 25, and the operation program may be read from such a recording medium and installed in the personal computer 80.

  FIG. 11 to FIG. 13 are flowcharts showing the playback processing procedure in the personal computer 80. FIGS. 14 to 24 show an example of a playback window displayed on the display screen of the display device 92 of the personal computer 80. FIG.

The memory card 25 attached to the drive recorder 1 is removed from the drive recorder 1 and attached to the personal computer 80. When the operation program installed in the personal computer 80 is activated by the user, the display device 92
A playback window 130 shown in FIG. 14 is displayed on the display screen.

  FIG. 14 is an example of the playback window 130.

  A menu bar 131 is formed at the top of the playback window 130, and a video display area 141 is formed below the menu bar 131. Further, a map image display area 151, a vehicle information display area 161, and a play list display area 171 are formed below the video display area 141.

  The menu bar 131 displays various items, and by selecting each item, a pull-down menu is displayed and a detailed command can be given. The menu bar 131 includes character strings of “file”, “display”, “play”, “tool”, and “information”, a folder icon 132, a camera icon 133, a printer icon 134, and a reel icon. 135, an FD (flexible disk) icon 136, a log icon 137, and a gear icon 138 are displayed. By pulling down the "File", "Display", "Play", "Tool", and "Information" character strings, a pull-down menu corresponding to each item appears, giving detailed instructions. . Clicking the folder icon 132 specifies a folder, clicking the camera icon 133 converts it to a still image, clicking the printer icon 134 performs printing, and clicking the reel icon 135 When the FD (flexible disk) icon 136 is clicked, data is backed up, and when the log icon 137 is clicked, it is converted to log data, and the gear icon is converted. When 138 is clicked, the recording setting is changed. The video display area 141 is an area for displaying video recorded by the drive recorder 1 or the like. The map image display area 151 is an area for displaying a map image near the shooting location of the video displayed in the video display area 141. The vehicle information display area 161 is an area for displaying information such as the vehicle speed at the time of video recording. In the vehicle information display area 161, a vehicle status display area 162 for displaying the status of the vehicle to which the drive recorder 1 that records the video displayed in the video display area 141 is attached, playback, stop, etc. of the video An operation button 163 for giving the operation command, a time display area 166 for displaying the recording time of the video displayed in the video display area 141, an acceleration graph display area 168 for displaying the acceleration of the vehicle in a graph, and the like. . The play list display area 171 is an area for displaying a list of file names of video files recorded on the memory card 25.

  When the folder icon 132 is clicked and the folder in which the video file is stored is selected, the file name of the video file stored in the folder is displayed in the play list display area 171 as shown in FIG. , The file name of the video file is displayed as clickable. Although the video recording start time is the file name, it goes without saying that a file name other than the recording start time may be used.

  When one of the file names displayed in the play list display area 171 is clicked with the mouse included in the input device 96, the corresponding video file is read from the memory card 25. It is. Playback of the video data stored in the read video file starts (step 111 in FIG. 11). In the header recording area of the video file, various types of header data are recorded corresponding to the recording time of the video data. The header data recorded when the video at the recording time is displayed is also read and read. Various superimposition processes and the like are performed on the video in accordance with the contents of the output header data.

  Playback of video data (The video data to be played back may be recorded and recorded when the user viewing the video drives, or may be recorded and recorded when a user other than the user browsing the video drives. As shown in FIG. 15, the video represented by the video data is displayed as a moving image in the video display area 141. Further, the data representing the GPS information recorded in the video file in which the video data is stored is transmitted via the Internet to a web site that transmits the data representing the map image. Then, image data representing a map near the place where the video displayed in the video display area 141 is recorded is transmitted from the site to the personal computer 80. When image data representing a map is received by the personal computer 80, a map image is displayed in the map image display area 151. In the map image, an arrow icon 152 indicating the location displayed in the video display area 141 is also displayed. In the vehicle status display area 162 of the vehicle information display area 161, the speed of the vehicle when the video displayed in the video display area 141 is recorded, the longitudinal acceleration (X) of the vehicle, Direction acceleration (Y), vertical acceleration (Z) of the vehicle, latitude (N) indicating the position of the vehicle, and longitude (E) indicating the position of the vehicle are displayed. The time display area 166 displays the recording time of the video displayed in the video display area 141, and the acceleration graph display area 168 displays an acceleration graph.

  Since the video data is recorded in all directions, not only the image of the subject seen from the direction of travel of the vehicle, but also the image of the subject behind (the direction opposite to the direction of travel), the left direction of the vehicle (the direction of travel of the vehicle) It is also possible to display a subject in the left direction based on the reference) or the right direction of the vehicle (right direction based on the traveling direction of the vehicle). FIG. 16 shows the playback window 130 in which the video of the rear subject is displayed in the video display area 141, and FIG. 17 shows the playback window 130 in which the video of the subject in the right direction is displayed in the video display area 141. FIG. 18 shows the playback window 130 in which the video of the subject in the left direction is displayed in the video display area 141. For example, if the mouse is dragged to the right in the state shown in FIG. 15, the video of the subject in the direction of travel is gradually switched from the video of the subject in the direction of travel to the video of the subject in the right direction as shown in FIG. It is displayed in the display area 141. When the mouse is further dragged to the right in the state shown in FIG. 17, the video of the subject in the right direction is gradually switched, and the video of the rear subject is displayed in the video display area 141 as shown in FIG. When the mouse is further dragged in the right direction in the state shown in FIG. 16, the image of the subject behind is gradually switched, and the image of the subject in the left direction is displayed in the image display area 141 as shown in FIG. When the mouse is further dragged in the right direction in the state shown in FIG. 18, the video of the subject in the left direction is gradually switched, and the video of the subject in the traveling direction is displayed in the video display area 141 as shown in FIG. In this manner, the video of the omnidirectional subject can be displayed in the video display area 141. In the embodiment described above, the mouse is used to drag the mouse to the right. However, even if the mouse is dragged to the left, as shown in FIG. As shown in FIG. 16, the video image is gradually switched to the left subject image, as shown in FIG. 16, and is gradually switched to the rear subject image, and as shown in FIG. 17, the video image is gradually switched to the right subject image. As shown in FIG. 15, the video is gradually switched to the subject image in the traveling direction.

  In this embodiment, when a video is displayed in the video display area 141, the visual field range is superimposed on the video (step 111 in FIG. 11).

  FIG. 19 is an example of a playback window 130 showing a state in which the user's visual field range is displayed.

  In the video display area 141, a frame 143 indicating a visual field range is superimposed on the video represented by the video data by the CPU 90 (which is an example of a processing process displayed on the video). The video portion of the area 142 outside the visual field range is blurred by the CPU 90 (hatching is shown to indicate that it is blurred). The visual field range is determined in advance for each age of the user, and data representing the visual field range is recorded in advance in the SSD 94. By designating the user's age, data representing the visual field range corresponding to the designated age is read from the SSD 94, and the frame 143 indicating the visual field range and the region 142 outside the visual field range are blurred as shown in FIG. This is an example of control for processing video data based on the processed information and displaying video based on the processed video data). Of course, the user's visual field range may be detected in advance for each user, and data representing the visual field range unique to the user may be recorded in the SSD 94 in advance. A frame 143 indicating the visual field range for each user is superimposed on the video. Since the user knows the visual field range, the user can recognize which range is visible and which range is not visible.

  Further, the CPU 90 also determines whether or not there is an object to be noted (for example, an infant) in the region 142 outside the visual field range (step 113 in FIG. 11). If there is an object to be noted in the region 142 outside the visual field range (YES in step 113 in FIG. 11), a warning (an example of notification to the user) is given to the user (step 114). For example, a portion where an object to be noted is displayed is surrounded by a frame or a mark is displayed. Whether or not there is an object to be noted in the region 142 outside the visual field range is determined in advance, the CPU 90 performs video analysis, and an image of the object is displayed in the region 142 outside the visual field range. It may be performed based on whether or not the CPU 90 detects the display. The user knows that there are objects to watch out of the field of view, so understand that driving while shaking the head as necessary to substantially widen the field of view will help prevent accidents. it can. If there is no object to be noted in the area 142 outside the field of view (NO in step 113 in FIG. 11), the process in step 114 is skipped and no warning is given. When there is an object to be noted in the area 142 outside the visual field range, it is only necessary to notify the user, so that it is not necessarily displayed in the area 142 outside the visual field range. For example, the user may be notified by sound output.

  Further, a mark 144 indicating the user's line of sight is superimposed on the video display area 141 by the CPU 90 (this is an example of processing for displaying the user's line of sight on the video) (step 115 in FIG. 11). Since the data indicating the user's line of sight is recorded in the header recording area 31 of the video file in association with the recording time of the video, it is displayed by reading the data indicating the user's line of sight from the header recording area 31. A mark representing the user's line of sight at the recording time of the video can be superimposed on the video displayed in the video display area 141. Since the user's line of sight is superimposed on the video, it is possible to confirm whether or not the user is looking at a subject (for example, a traffic light, an oncoming vehicle, a pedestrian, etc.) that the user should originally see.

  In the example shown in FIG. 19, a field-of-view range frame 143 and a mark 144 indicating the user's line of sight are displayed regardless of the user's line of sight. That is, the field-of-view range frame 143 indicates the range that this range will become the field-of-view range when the user views the video displayed in the video display area 141. Regardless of the line of sight when the user is driving, a field-of-view range frame 143 is displayed at substantially the center of the video display area 141. For example, even when the user's line of sight is not at the center of the video but at the edge of the video displayed in the video display area 141, the field-of-view frame 143 is displayed at the approximate center of the video display area 141. Is done. On the other hand, the frame 143 of the visual field range around the user's actual line of sight may be displayed in the video display area 141. The visual field range during actual driving of the user can be known. Also in this case, blurring processing of the area 142 outside the visual field range may be performed. An example of the range within the field-of-view range frame 143 is an example of a range that is visible to the user while the user is driving the vehicle. This is an example of distinguishing and displaying these ranges.

  If the direction in which the user is facing changes at the recording time of the video displayed in the video display area 142 (YES in step 116 in FIG. 11), the view range frame 143 is moved in the changed direction and superimposed on the video. (Step 117 in FIG. 11). Whether or not the direction in which the user is facing has changed can be determined based on data recorded in the header recording area of the video file and indicating the direction in which the user is facing. If the direction in which the user is facing does not change (NO in step 116 in FIG. 11), the field-of-view range frame 143 is not moved.

  FIG. 20 shows an example in which the field-of-view range frame 143 is moved.

  It is assumed that the direction in which the user is facing at the time of recording of the video displayed in the video display area 141 has changed from the front in the traveling direction to the lower right. Then, it is moved from the position of the field-of-view range frame 143 to the position of the field-of-view range frame 143A. Further, the position is moved from the position of the mark 144 indicating the line of sight to the position of the mark 144A indicating the line of sight. The user can recognize that the visual field range has changed due to the change in the direction in which he is facing. When the direction in which the user is facing changes, the relative position of the image displayed in the image display area 141 and the frame 143 (143A) indicating the visual field range also changes. For this reason, the relative position of the frame 143 indicating the visual field and the visual field range may not be changed (for example, the frame 143 indicating the visual field range may be displayed in the approximate center of the video). For example, a video in a direction in which the direction the user is facing may be displayed in the same manner as the video displayed in the video display area 141 when dragged with the mouse.

  Subsequently, it is determined whether or not the user's line of sight matches the direction that the user should see (step 118 in FIG. 12). If they do not match (NO in step 118 in FIG. 12), a mark indicating the part to be viewed is displayed on the video display area 141 (step 119 in FIG. 12), and if they match (YES in step 118 in FIG. 12), A mark indicating a portion to be viewed is not displayed on the video display area 141. However, if they match, the user may be notified of the match (displayed on the video display area 141, sound output, etc.). Needless to say, the direction to be seen differs depending on the driving at the time of recording (right turn, left turn, lane direction, etc.) or the driving operation of the car (brake operation, turn signal lever operation, etc.) by the user.

  FIG. 21 is an example in which a mark indicating a portion to be viewed is displayed.

  If the user had to see the lower right part of the video displayed in the video display area 141 but the user was not watching (for example, looking at the front), the lower right Mark 144 is displayed in the video display area 141 as an example of processing for displaying the part to be viewed by the user on the video. Analyzing the displayed video or recording event data (such as blinker lever operation or sudden braking) indicating the event during video recording in the header recording area of the video file The CPU 90 determines where to read the read event data. For example, if you change the lane from the left lane to the right lane by operating the turn signal lever, if you are not looking at the right side mirror, the mark 145 is displayed as the place to see the right side mirror . In addition, when a predetermined place such as a right turn or a left turn must be confirmed, it may be displayed as a place to be seen when such a place is not seen.

  Further, when the user is not looking at the portion to be viewed, the video display in the video display area 141 is temporarily stopped and the image (still image) of the scene is displayed in the video display area 141. May be. In the moving image, the scene where the user does not see the portion to be viewed ends in an instant, whereas the stopped image is displayed in the video display area 141, so that the user can be more alerted.

  Further, for a video portion in which the movement of the subject of the video displayed in the video display area 141 does not change (small) (YES in step 120 in FIG. 12), the display speed is relatively increased by the CPU 90 (FIG. 12). Step 121). For a video portion in which the movement of the subject of the video is changed (large) (NO in step 120 in FIG. 12), the display speed is not relatively increased. Whether there is no change in the movement of the subject (small) or there is (large) can be found by comparing the differences between the frames of the video. Since it is considered that the video part where the movement of the subject does not change (small) is not an important scene such as a pedestrian jumping out or an oncoming vehicle protruding, there is no problem even if the display speed is increased. In addition, the video portion where the position of the vehicle has not changed can be considered to be less important because the vehicle is stopped and the accident is less likely to occur. For this reason, the display speed may be increased even for the video portion where the position of the vehicle has not changed.

  Further, the CPU 90 determines whether or not the orientation of the display device 92 has been changed (step 122 in FIG. 12). When the orientation is changed (YES in step 122 in FIG. 12), the display range of the video displayed in the video display area 141 is changed in accordance with the orientation (step 123 in FIG. 12). If the orientation has not been changed (NO in step 122 in FIG. 12), the video display range is not changed in accordance with the changed orientation. The acceleration sensor 93 can detect whether or not the direction of the display device 92 has been changed and in which direction. It is assumed that an image of the traveling direction of the vehicle (see FIG. 17) is displayed on the display screen of the display device 92 facing in a certain direction. When the display device 92 facing in a certain direction is directed rightward, the rightward image is displayed in the same manner as when the image displayed in the image display area 141 is dragged rightward (see FIG. 17). Is displayed in the video display area 141. Similarly, when the display device 92 that is oriented in a certain direction is directed to the left, the image displayed in the left direction (see FIG. 5) is displayed in the same manner as when the image displayed in the image display area 141 is dragged to the left. 18) is displayed in the video display area 141. Further, when the display device 92 that has been directed in a certain direction is directed backward, a backward video (see FIG. 18) is displayed in the video display area 141. In this way, changing the display range of the video with the traveling direction of the vehicle as the reference direction is an example of video data processing. A pseudo VR (virtual reality) display can be performed.

  Further, it is determined by the CPU 90 whether or not information relating to the vehicle status is recorded in the header recording area 31 of the video file at the recording time of the video displayed in the video display area 141 (step 124 in FIG. 12). If information related to the vehicle status is recorded (YES in step 124 in FIG. 12), information related to the vehicle status is displayed in the video display area 141. When information related to the vehicle status is not recorded (NO in step 124 in FIG. 12), the information related to the vehicle status is not displayed in the video display area 141.

  FIG. 22 is an example in which information relating to the vehicle status is displayed in the video display area 141.

  A balloon 146 in the first display mode is displayed in the video display area 141. In this balloon 146, information regarding the vehicle status at the recording time of the video displayed in the video display area 141 is displayed. In the example shown in FIG. 22, a character string “Brake was stepped on!” Is displayed in the balloon 146, and the vehicle brake (rapid braking) is performed at the recording time of the video displayed in the video display area 141. It can be seen that was stepped on. Data representing information relating to the vehicle status is also recorded in the header recording area 31 of the video file in association with the time data, and is read from the header recording area 31. However, for example, a situation that has occurred in the vehicle due to a sudden change in acceleration may be estimated by the CPU 90 and displayed on the balloon 146 as information on the situation of the vehicle. For example, if the acceleration in the front-rear direction of the vehicle suddenly changes in the negative direction at a certain recording time, it is considered that sudden braking was stepped on. Therefore, the balloon shown in FIG. The same balloon as 146 may be displayed.

  Further, when any position of the map image displayed in the map image display area 151 is designated by the user using the mouse (YES in step 126 in FIG. 13), data representing the designated position is stored in the server. The data indicating the latitude and longitude of the position is transmitted from the server to the personal computer 80. When data indicating the latitude and longitude is received by the personal computer 80, a scene of the video shot at the position closest to the latitude and longitude is found out of the video displayed in the video display area 141. The video from the scene is displayed in the video display area 141 (step 127 in FIG. 13). If any position of the map image is not specified (NO in step 126 in FIG. 13), the process of step 127 is skipped, and no video is displayed by specifying the position in the map image. In addition, the video at the designated position in the map image is displayed in the video display area 141, but the video displayed in the video display area 141 is recorded by a drive recorder installed in the vehicle on which the user gets. One or both of the recorded video and the video recorded by a drive recorder installed in a third-party vehicle may be displayed in the video display area 141. In that case, the server stores the data representing the video recorded by the drive recorder installed in the third-party vehicle, and the video data recording the location at the position specified by the user is read from the server. And transmitted to the personal computer 80. When a large number of data representing videos recorded by a drive recorder installed in a third-party vehicle is recorded on the server, the user is prompted to select a video to be displayed on the personal computer 80. The selected video may be displayed on the display screen of the display device 92.

  Further, the CPU 90 determines whether or not road-to-vehicle communication or inter-vehicle communication information is recorded in the header recording area 31 of the video file at the recording time of the video displayed in the video display area 141 (step 128 in FIG. 13). ). If road-to-vehicle communication or vehicle-to-vehicle communication information is recorded (YES in step 128 in FIG. 13), the road-to-vehicle communication or vehicle-to-vehicle communication information is displayed in the video display area 141. When road-to-vehicle communication and vehicle-to-vehicle communication information is not recorded (NO in step 128 in FIG. 13), the road-to-vehicle communication or vehicle-to-vehicle communication information is not displayed in the video display area 141.

  FIG. 23 shows an example in which information on road-to-vehicle communication (the same applies to vehicle-to-vehicle communication) is displayed in the video display area 141.

  In the video display area 141, a balloon 147 in a second display mode that is different from the first display mode of the balloon 146 described above (see FIG. 22) is displayed. In this balloon 147, information on road-to-vehicle communication at the recording time of the video displayed in the video display area 141 is displayed. In the example shown in FIG. 23, a character string “There is a traveling vehicle on the left in front” is displayed in the balloon 147, and the traveling vehicle is on the left in front of the vehicle at the recording time of the image displayed in the image display area 141. It can be seen that existed. Data representing road-to-vehicle communication and inter-vehicle communication information is also recorded in the header recording area 31 of the video file in association with the time data, and is read from the header recording area 31. A user who has obtained information on road-to-vehicle communication and vehicle-to-vehicle communication can check what kind of vehicle operation (for example, whether the vehicle has decelerated) based on the information during video recording.

  In the reproduction processing procedure shown in FIG. 11, processing for determining whether or not there is a target object outside the visual field range (step 113 in FIG. 11), processing for determining whether the direction in which the user is facing has changed (step 113 in FIG. 11), Whether the user's line of sight coincides with the direction to be viewed by the user (step 118 in FIG. 12), whether there is no change in the movement of the subject (step 120 in FIG. 12), and the orientation of the display device 92 is changed. Processing (step 122 in FIG. 12), processing whether there is information on the vehicle status (step 124 in FIG. 12), processing whether the position in the map image is specified (step 126 in FIG. 13), Each process is performed in the order of whether or not the information of inter-vehicle communication or road-to-vehicle communication has been obtained (step 128 in FIG. 13). However, the order of these processes may be arbitrary, and each process is performed in parallel. It may be done.

(3) Modification FIG. 24 shows a part of the play list display area 171 included in the playback window 130.

  In the above-described embodiment, the video data recording date is used as the file name of the video file displayed in the play list display area 171, but in this embodiment, the video data recording date and time is not used. The recording location of the video data (which is an example of the shooting location) is used as the file name of the video file.

  The video data recording location is used as the file name of the video file as follows. For example, when a video file is generated in the drive recorder 1, the latitude and longitude of the generated location are read by the GPS receiver 22, and the latitude and longitude data are read from the communication circuit 17 via the Internet. Send to. The server finds the latitude and longitude locations, receives data representing the found location via the Internet, and uses the location obtained from the received data as the file name of the video file. However, the latitude and longitude data recorded in the header recording area 31 of the video file corresponding to the recorded date and time is transmitted to the server via the Internet at the time of playback, and data indicating the location found on the server is displayed. The location obtained from the received data via the Internet may be used as the file name of the video file. In FIG. 24, the file names are displayed in the recording order. The file name includes the recording location, so you can see at a glance where the image was taken.

  FIG. 25 also shows a part of the play list display area 171 included in the playback window 130.

  In FIG. 25, the play list is displayed so that the file name of the video file that includes the recording place with low appearance frequency is displayed at the upper (upper) position (an example in the case of displaying with priority). It is displayed in the display area 171. The file name of the video file that contains the location at the time of recording with high appearance frequency is displayed in the lower (lower) position. Where the frequency of occurrence is high, it is considered that there are many records in daily life, such as when commuting. Whereas, where the frequency of occurrence is low, it is unusual, such as when recording travel. It is thought that there are many records in life. The file name of the video file including the location at the time of recording with a low appearance frequency is displayed at the top so that the video file recorded in daily life can be easily reproduced.

  Further, the same place may be displayed together in the play list display area 171. It is easy to distinguish between video files at the same location and video files at different locations. Furthermore, the file name of the video file only needs to include the location at the time of recording, and the recording date and time may be included in the file name of the video file in addition to the location at the time of recording. Further, a map image of a location corresponding to the video file name displayed in the play list display area 171 may be displayed in the video display area 141, for example. Since the map is displayed rather than displaying only the name, it is easier to see where the video file is. For example, the file name of the video file including the location is transmitted from the communication circuit 98 to a map server (not shown) on the Internet, the map data transmitted from the map server is received by the personal computer 80, and the map is displayed in the video display area 141. The image of is displayed. By selecting a map image displayed in the video display area 141, playback of the corresponding video file may be started.

  FIG. 26 is an example of a frame configuration based on MPEG (Moving Picture Experts Group).

  In FIG. 26, “I” indicates an I frame, and “P” indicates a P frame. Three P frames follow one I frame, and a GOP (Group Of Picture) is composed of these one I frame and three P frames.

  When calculating the hash value as shown in step 77 of FIG. 8, the controller 10 is caused to calculate the hash value for each unit, with the unit immediately before the P frame instead of just before the I frame as a unit for dividing the video data. For example, a hash value is calculated in the controller 10 with a P frame, an I frame, and three P frames after the I frame as one unit. The hash value calculated in this way is transmitted to the block chain system.

  Also, instead of calculating the hash value from the video data, if various events occur in the drive recorder (for example, there was a sudden braking or a side slip), the hash value ( The controller 10 may calculate the calculated hash value (which is an example of a second calculated value uniquely determined from the event data), and transmit the calculated hash value to the block chain system.

  FIG. 27 is a flowchart showing an example of a recording processing procedure of the drive recorder 1.

  In this embodiment, when a driver (for example, a professional driver) calls, the state of the driver at the time of the call is photographed and recorded. The recorded video data is stored in the video file, transmitted to the server for each driver, and stored in the server. The drive recorder 1 accesses the server and reads a video file that stores video data at the time of the driver's call (step 181). The video file at the time of the call is recorded on the memory card 25 mounted on the drive recorder 1 by the controller 10 of the drive recorder 1 (step 182).

  Subsequently, the driver name and date / time of the driver are used as the file name of the video file storing the video data during driving, and the video file is generated by the controller 10 (step 183). The driver name may be stored in advance in the memory 21 of the drive recorder 1 or may be input from the input device 20. The video data is stored in the video file as described above until the engine of the vehicle to which the drive recorder 1 is attached starts, video data recording during driving starts, and recording ends (YES in step 185). Continue.

  In this way, the video file storing the video data during the call and the video file storing the video data during the operation are recorded in the memory card 25. When such a memory card 25 is inserted into the personal computer 80, the video at the time of the call and the video at the time of driving can be displayed in the video display area 141 of the playback window 130. The video file storing the video data at the time of the call and the video file storing the video data at the time of driving are associated by the driver name (an example of association).

  In this embodiment, the drive recorder 1 stores the video file at the time of call and the video file at the time of operation in the memory card 25, but the video file at the time of the call and the video file at the time of operation are stored in the memory card 25 during playback. The video file may be stored. For example, the memory card 25 storing the video file during operation is loaded into the personal computer 80, and the file name of the video file is displayed in the play list display area 172. When any video file name is selected from the video file names displayed in the play list display area 172, it is recorded in the header recording area 31 of the video file corresponding to the selected video file name. The data representing the name of the driver is transmitted to the server recording the video file at the time of the call, and the video file at the time of the call is transmitted from the server to the personal computer 80. When the video file at the time of the call is received by the personal computer 80, the video at the time of the call represented by the video file at the time of the driver's call and the video at the time of driving represented by the video file at the time of the driver's driving are displayed. The video is displayed in the video display area 141. The video at the time of the call and the video at the time of driving are preferably displayed side by side in the video display area 141 at the same time, but it is not always necessary to do so.

  28 and 29 are flowcharts showing an example of a recording processing procedure of the drive recorder 1. FIG. FIG. 28 shows an example of a recording processing procedure when the drive recorder 1 is attached to a truck. FIG. 29 shows a case where a driver driving the truck uses a forklift to load the cargo loaded on the truck. It is a flowchart which shows the recording processing procedure of the drive recorder 1 attached to the forklift when moving a load.

  Referring to FIG. 28, during the operation of the truck, the video data is recorded on the memory card 25 attached to the drive recorder 1 by the drive recorder 1 attached to the truck (step 191). When the recording of the video data to the memory card 25 is completed, the data indicating the name of the driver and the date and time are stored in the header recording area of the video file, and the video data is stored in the video recording area of the video file. The recorded video file is transmitted from the drive recorder 1 to the server (step 192). Data representing the driver's name is stored in the memory 21 of the drive recorder 1 in advance. Further, a command for associating with the video file from the forklift is transmitted from the drive recorder to the server (step 193). For example, it is a video file transmitted from the same location as the last location (track stop location) represented by the video data stored in the video file transmitted from the drive recorder 1 of the track, and the stop time of the track Within a few minutes from the drive recorder attached to the forklift, a video file storing the video data that was recorded by the drive recorder and a command that associates it are sent from the drive recorder attached to the track to the server. The

  Referring to FIG. 29, when the drive recorder 1 attached to the forklift detects that the driver has approached the forklift, the front camera 11 and the rear camera 12 included in the drive recorder 1 are detected. The shooting starts with (Step 201).

  When it is analyzed from the video taken by the front camera 11 or the rear camera 12, and it is detected that the driver has taken the forklift and the forklift has started operating or the driver has taken the forklift (step 202). YES), recording of video data to the memory card 25 attached to the drive recorder 1 attached to the forklift is started (step 203). When the recording is completed, the video file is transmitted to the server (step 205).

  In the server, if there are two video files where the recording end time and the recording start time are almost the same, and the location at the end of recording and the location at the start of recording are almost the same, those video files are As described above, for example, the same driver handles the video file as a transfer from a truck to a forklift. By transmitting the video file representing a series of videos to the personal computer 80, the video during truck operation and the video during forklift operation can be displayed in the video display area 141 of the playback window 130.

  In the above-described embodiment, the truck is operated and then the forklift is operated. Conversely, the forklift may be operated and then the truck may be operated to obtain the respective video files. In addition, a series of video files can be obtained in which a forklift is driven to load the cargo on the truck, and then the truck is driven to the destination, and the truck's luggage is unloaded at the destination using the forklift. May be.

  FIG. 30 is a flowchart showing an example of a recording processing procedure of the drive recorder 1 attached to the vehicle.

  The drive recorder 1 is attached to the inside upper part of the windshield of the vehicle at a position where the vehicle speedometer can be photographed. When the vehicle engine is started, photographing by the front camera 11 and the rear camera 12 is started, and the vehicle speed meter is photographed by the rear camera 12 (step 211). The image of the vehicle speedometer is analyzed by the controller 10 to determine whether the vehicle speed is, for example, 30 km / h or more (an example of a speed above a certain level, but other speeds may be used). (Step 212). When the speed exceeds 30 km / h (YES in step 212), recording of video data to the memory card 25 starts (step 213). When the vehicle is less than 30 km / h (YES in step 214), the recording of video data to the memory card 25 is stopped (step 215).

  As described above, when the vehicle speed exceeds 30 km / h, the recorded video data is recorded in the memory card 25, and when the vehicle speed is less than 30 km / h, the recorded video data is recorded in the memory card 25. Is stopped. When the vehicle is driven at a certain speed or higher, video data obtained by photographing is recorded in the memory card 25. In this embodiment, when the vehicle speed exceeds 30 km / h, the recorded video data is recorded in the memory card 25, and when the vehicle speed is less than 30 km / h, the captured video data is stored in the memory card 25. However, when the vehicle speed exceeds 30 km / h, the recorded video data is recorded on the memory card 25. Even if the speed is less than 30 km / h, It is not necessary to stop recording the recorded video data to the memory card 25, and the recorded video data is recorded to the memory card 25 regardless of the speed of the vehicle, and it is less than 30 km / h. In this case, recording of the captured video data to the memory card 25 may be stopped.

  FIG. 31 is a flowchart showing an example of a recording process procedure of a drive / recorder attached to an automatic conveyance vehicle (automatic conveyance vehicle).

  The drive recorder 1 mentioned above is attached to an automatic conveyance vehicle. A laser sensor for detecting the approach of a peripheral object to the automated guided vehicle is attached to the automated guided vehicle.

  When the engine of the automatic transport vehicle is started (the power of the automatic transport vehicle is turned on), the supply of power to the drive recorder 1 is started. Then, photographing is started by the front camera 11 and the rear camera 12 provided in the drive recorder 1 (step 221). When an approach of an object (an example of a peripheral object, which may be another automatic conveyance vehicle or the like) may be detected by the laser sensor (YES in step 222), it is attached to the drive recorder 1. Recording of video data to the memory card 25 starts (step 223). If the approach of the peripheral object to the automatic conveyance vehicle is not detected by the laser sensor (step NO), the recording of the video data to the memory card 25 is not started. Even if a nearby object accidentally touches the automated guided vehicle, the situation can be recorded. As described above, the vehicle includes not only a driver on board but also a vehicle on which the driver does not board.

  FIG. 32 is a flowchart illustrating an example of a processing procedure for driving evaluation.

  The user drives the vehicle to which the drive recorder 1 is attached, and the memory card 25 on which the video data is recorded is removed from the drive recorder 1 and attached to the personal computer 80. The playback window 130 shown in FIG. 14 is displayed on the display screen of the display device 92, and the video data recorded on the memory card 25 is played back (step 231). When the subject of the video being played has a motion (YES in step 232), the video is analyzed and driving evaluation is performed from the video (step 233). For example, when the subject is moving, sudden braking is stepped on, or when other vehicles such as pedestrians, bicycles, motorcycles, and cars are too close, the driving evaluation is low. Whether the brake is suddenly applied can be determined from the acceleration data, and whether the pedestrian or other vehicle is too close can be determined from the relative size of the image of the pedestrian or other vehicle in the image. When there is no movement in the subject of the image (NO in step 232), driving evaluation is not performed for the image portion. Steps 232 and 233 are repeated until the video ends. In the video portion where there is no movement of the subject, it is considered that the vehicle is stopped, so there is not much meaning for evaluation of driving. Since evaluation of driving in such a place is not performed, there is a high possibility that unnecessary evaluation will not be performed. Evaluation of driving is performed when there is movement of the subject, and evaluation of driving is not performed when there is no movement of the subject, but evaluation of driving is performed when there is movement of the vehicle, and when there is no movement of the vehicle Driving evaluation may not be performed.

  FIG. 33 is a flowchart showing an example of a reproduction processing procedure for video data recorded by the drive recorder 1.

  In this embodiment, the drive recorder 1 is attached to a vehicle that transports passengers, such as a bus, taxi, hire, train, etc., but is not necessarily attached to such a vehicle.

  The memory card 25 attached to the drive recorder 1 is removed from the drive recorder 1 and attached to the personal computer 80. A playback window 130 shown in FIG. 14 is displayed on the display screen of the display device 14 of the personal computer 80, and the video data recorded on the memory card 25 is played back (step 241).

  The video is analyzed by the CPU 90, and it is determined by the CPU 90 whether the customer is included in the video (step 242). For example, if a person is sitting on a vehicle seat except for the driver, it may be determined that there is a customer. If the customer is included in the video (YES in step 242), the video is displayed in the video display area 141 (step 243). If the customer is not included in the video (NO in step 242), the video display in the video display area 141 is stopped. Until the video ends (NO in step 244), the processing in steps 242 and 243 is repeated. In the above-described embodiment, when the customer is not included in the video, the video display in the video display area 141 is stopped. However, although the video is displayed, the display speed is increased or the portion of the video including the customer is displayed. You may skip the video.

  FIG. 34 is a flowchart showing an example of a reproduction processing procedure for recorded video data. It is preferably recorded by the drive recorder 1, but may be recorded by another recording device. This reproduction process is to find a video of a desired scene from the video.

  The memory card 25 in which the video data is recorded is mounted on the personal computer 80, and the playback window 130 is displayed on the display screen of the display device 92. When the user clicks on the word “tool” included in the menu bar 131 of the playback window 130, a pull-down menu including a “search” item appears. When the “search” item is designated from the pull-down menu, a pop-up window for inputting a keyword appears on the playback window 130. In the pop-up window, a keyword representing the situation of the video portion that the user wants to find is input using the input device 96 (step 251). The CPU 90 analyzes the video data and finds the video of the scene related to the input keyword (step 258). The video of the found scene is displayed in the video display area 141 (step 254). The keyword representing the situation of the video part input by the user may be not only a clear one such as a video including the Shinkansen but also an ambiguous one such as a bright video. The video portion corresponding to the ambiguous keyword is found. For example, in the case of a bright video, a video portion having a relatively high luminance is found in the video. In addition, a keyword representing the situation of the vehicle at the time of recording the video data may be input to find a picture of the situation. For example, using the keywords such as the state of the vehicle where the drive recorder that recorded the video data was installed, the speed was increased, the vehicle was accelerated rapidly, and the turn signal was output, the video portion corresponding to the keyword was found. it can. Since the data representing the state of the vehicle is recorded together with the recording time in the header recording area 31 of the video file in which the video data is stored, the video portion can be found using the data. Alternatively, a keyword that searches for a video after a dynamic movement may be input to find a corresponding video portion, such as finding a video portion after a red car overtakes a blue car.

  FIG. 35 is a flowchart showing an example of a reproduction processing procedure of video data recorded by the tribe recorder 1.

  The memory card 25 attached to the drive recorder 1 is removed from the drive recorder 1 and attached to the personal computer 80. A playback window 130 shown in FIG. 14 is displayed on the display screen of the display device 92 of the personal computer 80.

  Data indicating the latitude and longitude indicating the moving position of the vehicle recorded in the header recording area 31 of the video file stored in the memory card 25 is read, and the moving range of the vehicle is determined by the CPU 90 of the personal computer 80. It is detected (step 261). A request command for map image data including the detected moving range is transmitted from the personal computer 80 to the server, and the map image data is transmitted from the server to the personal computer 80. When the map image data is received by the personal computer 80, the map image represented by the received image data is displayed in the video display area 141 (step 262). Further, data representing vehicle operation information at the time of recording the video data is read from the header recording area 31 of the video file, and the vehicle is displayed at each position on the map image displayed in the video display area 141. Is displayed (step 264).

  FIG. 35 is an example of a map image displayed in the video display area 141.

  In the map image, the movement state of the vehicle is indicated by a chain line 148. The chain line 148 representing the movement status is obtained from data indicating the movement position of the vehicle recorded in the header recording area 31. Furthermore, the operation state of the vehicle is displayed by a balloon 146 in the movement state indicated by the chain line. The user can grasp the moving range of the vehicle relatively easily by looking at the map image, and can grasp relatively easily what kind of vehicle is operated at what place during the movement.

  FIG. 37 is a flowchart showing an example of a reproduction processing procedure for video data recorded by the drive recorder 1. In this embodiment, the video obtained by the user's driving and the video obtained by the third party's driving are displayed in the video display area 141.

  The memory card 25 attached to the vehicle the user was driving is removed, and the removed memory card 25 is attached to the personal computer 80. Video data obtained by driving the vehicle by the user is read from the memory card 25 and reproduced (step 271). In addition, data (data indicating latitude and longitude) indicating the recording location (vehicle movement range) of the video data obtained by the user's driving is read from the header recording area 31 of the video file, and third party driving is performed. Is sent to a server that stores a large number of video files obtained. In the server, a video file storing video data obtained by driving the same location as the location where the user has driven is found and transmitted to the personal computer 80. It is only necessary to find a third-party video file that almost matches the moving direction and moving range of the user even if they do not completely match. The found third-party video file is received by the personal computer 80 (step 273), and the video obtained by the user's operation and the video obtained by the third-party's operation are displayed in the video display area 141. (Step 274).

  FIG. 38 is an example of the playback window 130.

  The video display area 141 is divided into two video display areas 141A and 141B on the left and right (not on the left and right but on the top and bottom). A video obtained by the user's operation (an example of a video based on the processed video data) is displayed in the video display area 141A on the left, and the video found on the server in the video display area 141B on the right An image obtained by driving a third party represented by the file is displayed. In the video display area 141A, a balloon 146A indicating the operation information of the vehicle by the user when the video displayed in the video display area 141A is recorded is displayed. Needless to say, the operation information displayed in the balloon 146A is obtained from acceleration data or the like recorded in the header recording area 31 of the video file in which the video data is stored. Similarly, a balloon 146B indicating vehicle operation information by a third party when the image displayed in the image display area 141B is recorded is also displayed in the image display area 141B. Playback control is performed by the CPU 90 so that the video display is synchronized so that the position indicated by the video displayed in the video display area 141A and the position indicated by the video displayed in the video display area 141B substantially coincide. Preferably, it is done.

  Since the user's driving image displayed in the video display area 141A and the third-party driving image displayed in the video display area 141B can be compared and viewed, Driving skills can be improved. In particular, the balloons 146A and 146B can be used to know whether the operation is the same or different.

  Furthermore, by comparing the user's driving with the third party's driving, information indicating the user's driving evaluation (an example of information based on the comparison between the third party's driving and the user's driving) is displayed in the video display area. 141 may be displayed. For example, if it is evaluated that driving skills are worse than third-party driving, display warning information such as "Let's improve driving skills with reference to third-party driving." Or, if it is possible to obtain an evaluation that the driving skill is higher than that of a third party, information indicating high evaluation such as “It seems that the driving skill is high” may be displayed. .

  FIG. 39 is an example of the playback window 130.

  In the video recording area 141, when the video is recorded, alphabetical characters indicating the locations and the order that the vehicle driver should see are superimposed on the video. The example shown in FIG. 39 is, for example, an image at the time of lane change, and it is preferable to view the parts indicated by alphabets in alphabetical order. At the time of recording the video data, the driver's line of sight is detected as described above, and the CPU 90 detects whether the driver's line of sight moves in the alphabetical order in the part indicated by the alphabet. When the driver's line of sight moves in alphabetical order at the location indicated by the alphabet, for example, a character string “ideal driving” is displayed in the video display area 141. The user can confirm that the driving skill is not bad. If the driver's line of sight does not move in the alphabet, a character string such as “There is an unconfirmed part” is displayed in the video display area 141, and the user has confirmed that there was an unconfirmed part. To inform. When the driver's line of sight does not move in alphabetical order, a character string such as “the confirmation order is not ideal” is displayed in the video display area 141 to inform the user that the confirmation order is not good. . The user can know whether or not the movement of the line of sight during driving is appropriate.

  Further, in the example shown in FIG. 19, the processing for blurring the region 142 outside the visual field range is performed. However, the range that the user has not seen is detected within a certain time, and the range that is not seen is blurred. May be. For example, a range that the user has not seen between the start of the right / left turn and the end of the right / left turn may be detected, and the range that is not seen may be blurred. It goes without saying that the line of sight of the user who is the driver is detected at the time of recording the video data, and the range that the user is not looking at is detected using the line of sight data. For example, when a non-viewing range is detected, the non-viewing range is blurred or translucent as in the region 142 outside the visual field range as shown in FIG.

  Further, when the video data recorded by the drive recorder 1 is reproduced, the CPU 90 may perform correction (an example of processing) that becomes the memory color of the driver. In order to correct to the memory color, the contrast, tone, and saturation of the obtained image are adjusted, but the degree of adjustment may be determined in advance, or several preset adjustment values may be determined. Alternatively, it may be selected during playback.

  Furthermore, a communication robot may be used together with the personal computer 80 during video playback.

  FIG. 40 shows an example of a communication robot 280 placed near the personal computer 80.

  Communication robot 280 includes a torso 281 and a head 282. An eye camera is provided inside the eye 283 of the head 282, and a speaker is provided in the mouth 284. The head 282 is rotatable clockwise and counterclockwise with respect to the body portion 281. A communication robot 280 is arranged on the right side of the personal computer 80. A user sits in front of the personal computer 80. Thus, the arrangement positions of the personal computer 80, the communication robot 280, and the user are determined in advance. When the playback window 130 is displayed on the display screen of the display device 92 of the personal computer 80 and a comment is output as a voice for the video displayed in the video display area 141, the player is directed to the display device 92 and is viewing the video. The communication robot 280 is controlled so as to face the user when a comment is output to the user.

  41 is a block diagram showing an electrical configuration of the communication robot 280. As shown in FIG.

  The communication robot 280 is connected to a CPU 291 that controls the overall operation, a memory 292 that stores data, a wireless communication circuit 294 that communicates with the personal computer 80, the drive recorder 1, and the like, and a wireless communication circuit 294. A wireless local area network (LAN) board 293 is included. The communication robot 280 includes a head motor 296 that rotates the head 282, an eye camera 298, a speaker 300, and a microphone 301. The head motor 296 is controlled by a motor control board 295, and video data captured by the eye camera 298 is taken into the communication robot 280 by the sensor board 297. Further, the sound output from the speaker 300 and the sound input from the microphone 301 are controlled by the sound input / output board 299.

  FIG. 42 is a flowchart showing the processing procedure of the communication robot 280. Needless to say, the operation program of the communication robot 280 is stored in the memory 292.

  The playback window 130 described above is displayed on the display screen of the display device 92 of the personal computer 80, and the video recorded by the drive recorder 1 is displayed in the video display area of the playback window 130. The personal computer 80 and the communication robot 280 communicate with each other, and acceleration data is transmitted from the personal computer 80 to the communication robot 280 to the communication robot 280 (data other than acceleration data, video file Data, event data, etc. recorded in the header recording area 31 may be transmitted from the personal computer 80 to the communication robot 280. Data that allows the communication robot 280 to give advice to the user by watching the video. May be transmitted from the personal computer 80 to the communication robot 280).

  Based on the acceleration data transmitted to the communication robot 280, a sudden acceleration change in the front-rear direction of the vehicle to which the drive recorder 1 on which the CPU 291 of the communication robot 280 is recorded is attached is shown. If it is determined that there was a failure (step 311), it is considered that the vehicle was suddenly braked. Then, as shown in FIG. 40, the communication robot 280 facing the user turns the head 282 90 degrees clockwise (step 312), and faces the display device 92 of the personal computer 80. It is done. The display screen of the display device 92 displays an image of a scene of sudden braking, and when the communication robot 280 faces the display device 92, a sound is output from the speaker 300 that it is a dangerous driving situation. (Step 313). For example, a voice saying “Such driving is dangerous” is output. The audio data is stored in the memory 292.

  Thereafter, the head 282 of the communication robot 280 is moved 90 degrees counterclockwise (step 314), and the communication robot 280 faces the user. When the communication robot 280 faces the user, a sound is output from the speaker 300 to urge the user not to perform dangerous driving such as a video scene displayed on the display screen of the display device 92 (step 315). ). For example, the voice “Let's keep driving safely” is output. Since the attention is not from a human like an instructor but from the communication robot 280, the user listens to the attention honestly.

  FIG. 43 shows a state in which the communication robot 280 described above is placed on the dashboard 311 in the vehicle.

  As described above, the drive recorder 1 is attached to the upper part of the windshield 310. When the drive recorder 1 and the communication robot 280 communicate with each other and the drive recorder 1 recognizes that the vehicle is in automatic operation as described above, the drive recorder 1 starts the operation to the communication robot 280. A command is sent. The communication robot 280 operates and starts talking with the driver of the vehicle.

  Further, when the video data recorded in the drive recorder 1 is reproduced, the road information on which the vehicle to which the drive recorder 1 is mounted is running (for example, the road width is narrow, the road is a dead end, etc. (Information) may be analyzed by the CPU 90 from the video data, and the display of the video displayed in the video display area 141 may be changed according to the analysis result. For example, a character string indicating the detected road information may be displayed superimposed on the video, or a part of the entire video or a part of hue, brightness, and saturation may be adjusted. Since the video displayed in the video display area 141 changes, it is possible to know that there is a change in the state of the road.

  Furthermore, event recording trigger information may be recorded in the header recording area 31 of the video file. For example, information on operating a blinker, information on operating a sudden brake, information on operating a wiper, and the like are recorded as event recording trigger information. Further, during recording by the drive recorder 1, the user may sit in the passenger seat and attach the eyeglass-type display device to the user's head. On the display screen of the display device, driving caution information is displayed, and through the display screen, a scene in front of the driving vehicle (an example of a real scene seen from a running car) can be seen. The caution information when driving is displayed over the scenery in front of the vehicle. Needless to say, a road to be traveled is determined in advance, and attention information on the road is displayed on the display device. Also, a third party other than the user (for example, a car instructor) may ride on the vehicle, select the caution information to be displayed on the display device, and display the selected caution information on the user display device. .

  In the above-described embodiment, the drive recorder 1 can record all directions such as the front, side, and rear of the vehicle. However, the drive recorder 1 may not necessarily record all directions.

  Furthermore, the recording in the drive recorder 1 may be performed in addition to the normal continuous recording and event recording. For example, in the case of event recording, the front and back are recorded by an acceleration sensor and a trigger switch. Keep it as an event record separately from the regular record. One minute of 30 seconds 30 seconds before and after the acceleration sensor reacts may be recorded. For example, it may be recorded when the first event occurs and the second event occurs, for example, when it hits the first card rail and the car is shaken and hits the second guard rail. If the recording times overlap, one event may be used. If there is a space between events, they may be recorded as different events, or may be processed as two events if they do not overlap.

  Further, in order to flow the factory line properly with the line in the factory, the above-described drive recorder 1 may be used for a camera that constructs a line, monitors the line, and adjusts the line. When assembling with a machine tool, in order to image the assembly, a camera is temporarily installed where a problem is likely to occur. When a new line is set up at the factory, it may be possible to verify the defect by attaching it for about three months. It may be recorded before and after the alert is issued by the machine tool in the factory, or the front and back of the machine tool may be imaged in response to triggers such as line lights (signal lights), green, yellow, and red. Good. Video data obtained from such a camera may be displayed on the playback window 130 described above. Only events may be imaged, or images may be captured constantly.

  Even if it is an omnidirectional drive recorder (a omnidirectional drive recorder) or a wide-angle camera drive recorder, the range that humans can see is not the same as the imaging range of the camera, but can be seen depending on human age and individual differences The range changes. It is dangerous if the viewing angle is narrow during the training for elderly people and renewal of the license, and it is very difficult to get on the step, so record the video driving with the drive recorder 1 and show that you are on the step It is good to teach while. It is not necessary to deny the driver by displaying the visible range of the bow, but if you do not see it, you can take a class that you should look carefully and shake your head to see it. For example, a frame may be displayed so that the range that can be seen during playback is known.

  When the driving situation (landscape, scenery) is recorded by the drive recorder 1, the movement of the driver's eyes is recorded at the same time. May be displayed. It is preferable to record where the line of sight is directed during travel and shift the display range and frame in the direction in which the image is displayed when displayed in the playback window 130. With the drive recorder 1 capable of photographing the omnidirectional (omnidirectional), all the front, side, and rear of the vehicle are recorded, so that the direction in which the driver is facing can be recognized by image recognition. Along with this, it is recommended to move the frame to be displayed. It may be displayed on the playback window 130 not only on the current time axis, but also on how much you have confirmed now, in the past and in the future, that you are looking straight now, but you are not looking at the past. For example, it is better to fill the area you are not looking at. You can see the range you have not seen at all. You can see how far your head is shaking, your gaze, and how far you are looking. The drive recorder 1 and the line-of-sight detection sensor may be connected to display the line of sight taken by the sensor. Know where the user is not looking. The imaging time varies depending on normal driving, high-speed driving, and driving at an intersection. Driving time at the driving school, before and after the intersection stops. The range to be seen at each point in the school is predetermined, and it is judged how much it matches. What percentage should be seen if there is a standard such as passing. You may judge how much you looked when you stopped at the intersection even in normal driving, speed, 40km / h to 80km / h, over 80km / h, and how much you looked at according to that speed. If you get faster, you don't see the side, but you look at the rearview mirror. Slow driving at 20 km / h or less must be seen 360 degrees, and must be operated while checking mirrors and blind spots. The viewing range changes based on the turn angle of the blinker, brake, and steering wheel. If you try to turn to the right, you must look relatively accurately on the right. By using the reproduction window 130, it can be seen that, for example, confirmation is made before the turn signal is taken out and before the handle is turned. Furthermore, it is better to show in the playback window 130 that the elderly actually drove in the school during the training for the elderly, attached a drive recorder, and later operated in this way. You can use a simulator, but if you don't actually drive it, the elderly will not be convinced, so you can get a real understanding. There are two effects that the instructor understands and that the instructor is easy to understand. You should also give information for instructors. It may be considered as information for the instructor that the area not seen is filled. You may have a gaze point, such as a mirror, not looking at the mirror in advance, and check whether you are looking at the instrument (speed meter, etc.). The driving situation when the drunk glasses are put on may be recorded by the drive recorder 1 to show the situation.

  Since there are dozens of mirrors on the bus, the driver may make a visual evaluation in addition to the tachograph to see if they are all watching. It is possible to evaluate what percentage of driving is seen here by displaying the line of sight (line of sight). Before and after the turn signal is issued, you can evaluate the part you are looking at and the part you are not seeing. There are always routines for buses and commercial vehicles, and there are manuals to check before bus stops and departures. Forklifts also check the front, rear, left and right, so it is a normal routine for buses, trains, trucks and forklifts. Therefore, you can evaluate whether you are driving. Passenger movement is also shown.

  If the history of watching and watching is left in the replayed state, it is possible to know whether the blind spot etc. are properly seen by analyzing the front and rear of the blinker as a trigger. Driving is different from normal line-of-sight analysis because you must see the right place at the right time. The car is moving in the movie, the place to see is decided before turning the trigger, turn signal, and steering wheel. Things like conditions change over time. The timing of watching is late. Corresponding to time, it is important but important. There is a place to see originally. Shows what to look at and shows a guide-like example of whether the user was looking at the bottom. If you are approaching an intersection, look here. If you are turning, look here. Trigger type, what to trigger, speed, turn signal, location of intersection, red light, road sign, crosswalk check right and left, look back when put in back, look forward Do not back. Check by looking at the mirror. I only see the back monitor. Look left and right. Despite confirming such a place or looking forward, the back is strange. Despite looking at the back, the drive is strange. Gaze analysis and direction can be seen from the video of the driver. Whether the eyes are open may also be detected, and information on whether the eyes are open during playback may be displayed. You may make it show a thumbnail of the scene where driving was bad like a movie film. For example, there are things that should be done, such as where you need to see, not looking at the mirror when changing lanes, operating blinkers, accelerators, etc., so cut out the places that do not match You may make it display as a thumbnail.

  When scoring driving, places that have stopped may be excluded from scoring. Scoring is based on whether it moves smoothly, stops, or does not handle sudden braking or braking. The building is moving in the image, the previous car is not moving, and how much the place is moving. When the vehicle is stationary, it will not be evaluated. Evaluate without using where it has stopped. You may pass the place where the vehicle is stopped, skip the video to the next place, or fast forward. The video may be advanced to a place where the red signal has changed to the green signal. Time can be reduced when the grader sees the video. Not only the video on the outside, but only when the customer gets on or inside the vehicle. If you replay only when there is a change in the customer, it will be a special feature when the customer gets on. This is because taxis only need to know the customer's face.

  Also, when searching, if it is bright, you can find a bright image, and if there is a Shinkansen, you can find the Shinkansen image and pick up the Shinkansen image. In this way, it is better to pick up what is in the video from the general ones. When there is an image of a week, when an ambiguous thing is said, it begins to search. You can also find that it was around when you wanted to show in a presentation. You may search for the light in the supermarket parking lot that you want to show. It is good to find out whether it is a specific thing, such a situation, such a time, such a time, the state of the car that was recorded, the speed was increased, the vehicle accelerated rapidly, or the blinker was released. After the red car overtakes the blue car, look for the video after the dynamic movement, or find the desired scene after this continuous scene in the video.

  The actual image may be displayed on the top and the recognized image on the bottom, the vehicle type may be identified by the image, or it may be shown by the outline. From the ambiguity of such a scene, a candidate for a desired video scene may be generated and selected. For each image, tag it as if it was there, and how many minutes there was. If it has been stopped for more than 5 minutes, it is possible to add a voice recognition function to the software that plays the video.

  It is good to display where the driver was looking at during playback. When it is determined that the user is looking away, the playback window 130 may be marked, or the image may be red at the moment of looking away. This is because it is possible to know where you are looking by taking a picture with a spherical camera. If you are looking away, an alarm may sound. An alarm may sound if you close your eyes. Only that part may be skipped and played, or only that part may be played. If it is a camera other than a wearable camera such as a 360-degree camera, the user can see the direction it sees, so that direction can be displayed. Wearable cameras are also acceptable. Instead of a wearable camera, a wearable sensor may be placed on the head or the camera may be attached to the user using something like a bee. There may be a sensor that knows where the driver is facing. An acceleration sensor (camera) may be attached to the ear, or a sensor (camera) may be attached to a female hair clip. The sensor (camera) may be fastened with a clip at the collar of the hat. You may make it understand which is facing which is combined with those sensors and a spherical image. Analyzes with spherical images. You may notify that there is a frame area indicating the field of view on the opposite side and on the back side. You may be notified of the situation that the frame is being displayed but is not currently visible. The outer frame may be a green frame, or the visible area may be clearly visible, and the other areas may be gray. A clear area may be expanded by checking. You can see at a glance what you are not seeing. The range may be cleared when there is no head movement. You may make it display the range which is visible and the range which is not visible only before and after turning a steering wheel and taking out a blinker. The angle at which the camera is facing may be displayed on the map below. You may display both the angle of eyes (line of sight) and the angle of a car. The angle of the image itself may be displayed. You may show how much you can see by the direction of the car and the direction of your eyes. The current angle of view may be displayed, or the angle of view of the displayed area may be displayed.

  VR (virtual reality) display may be made possible on the drive recorder of the omnidirectional camera. Since the image of the omnidirectional camera is taken 360 degrees, you can get a VR-like image on a plane. At this time, the reference direction may be based on the front camera side, or may be based on the shooting direction, the north side, or the like. It is necessary to determine how much to map in the direction with the reference direction as north and the range of the viewing angle of VR. In the case of the drive recorder 1, the forward direction is the front. A playback device that can see the direction in which the main body is moved may be used. This is the range that you can see, but you can show that a 10-year-old is more visible. You may provide the function of being able to compare. Now, it can be seen that it will be so invisible in 10 years and in 30 years. The instructor may have a function of switching the angle range for each age. It may be switched according to age. You may display VR by the reference | standard of the direction which a driver | operator can see. You may provide the reproduction | regeneration software of the image | video recorded with the drive recorder 1 which can be displayed on a VR device. With a VR device, acceleration or the like may be displayed as an overlay, or may be displayed with an OSD (on-screen device). You may display the acceleration in 3D. Although the image itself cannot be 3D, it can be seen translucently in front of the surface visible in the sphere. You may make it put a panel in the area which is not needed. Just move your neck. Where the line of sight is going should be in the foreground, the overlay is in the foreground. Depending on the viewing time, it may become darker, or depending on the frequency of viewing, you may be able to create dark and light areas. If the camera is turned sideways, a horizontal image may be seen, and if it is turned upward, the upper image may be seen. The facing direction may be detected by an acceleration sensor, a geomagnetic sensor, or a gyro. Straight front means that the camera is fixed, so you can see the front direction. The center of the sphere should be in front. The camera is always looking forward. Give image data to the framework.

  From the viewpoint of viewing by the administrator, it is a video that can't be seen without waiting for traffic lights or when there is no change in the video. It is good to have it.

  On the map, the trajectory of the moving vehicle may be displayed, and if a point of the trajectory is designated, a function of jumping to the trajectory may be provided. The time at which a point on the map is an image is written in time corresponding to the point on the map. When you bring the cursor, the time is displayed, so you can find the image at that time. Street view may be displayed. A function of switching between the video of the street view and the video recorded by Dorareco may be provided. Since Street View has the past and present, it can be seen that this was a year ago. You can see the video about 3 years ago. You can see images before and after the building. You can display it in another window. The map itself should be switched to the old one. If the shooting date is included, an image of a desired season may be displayed, such as an image of autumn or an image of spring. If you are commuting to the same place, you may display summer and winter images. You may be able to represent the same video as you are running. You may make it display such a feeling on a rainy day.

  Information that this video is a video moved from this side to this side may be displayed in the play list display area 172 of the playback window 130. For example, information indicating that the video is from Okazaki City to Toyota City may be displayed. It may be displayed as text or a reduced map display. It becomes very easy to understand and easy to use. If there is a municipality and area data, it is possible to display from 00 city to xx city. When the location API (Application Programming Interface) is used and the latitude and longitude are transmitted to a search server or the like, the information of the city is returned, so that information may be output. The destination of the video file can be automatically set. If you are commuting by car every day when you are lining up in the video, if you want to see only the video of the trip when you don't care about the video of commuting, from here to here it is easier to select by categorizing as commuting . If it is the current city, categorize where the starting point and arrival point are the same, and bring the rare ones up. If you have only been there once, it is likely that you will travel.

  In the header recording area 31 of the video file, GPS data is periodically stored such as every frame, every 1 second, or every 0.5 seconds. In order to set the file name of the video file to a specific place name, for example, “Higashiokazaki”, the coordinates may be transmitted to the API of the position search server, and the video file name may be set using the information returned from the server. GPS data can be thrown to a server that stores map images, and maps can be brought from that server and displayed. If the personal computer 80 has map data and place name information, there is no need to send it to an external server. Event information may be displayed. When only the data of the event is displayed on the playback window 130 and this path is passed, it is possible to display the information that the event is occurring at this scene. You may make it show on the map where you suddenly braked. If it is a return-to-commute road, you may be able to put together events that indicate where the event occurred and changed. A road is displayed, and after passing this road, it is possible to put on the map that such an event has occurred. For example, if you hit a certain road on the map, National Route 248, the events that occurred while traveling on National Route 248 will be displayed on the map for a period of time, for example, five years. You can see that the place is intensively dangerous. When all the logs appear and you click, a log appears, a heartbeat comes out, or you may categorize the bike. When a light event occurs, you may step on a lot of accelerators here, or identify places that are prone to accidents depending on the location, and display them in total. You can categorize and display commuting video files, and click them to map them all on the map.

  Moreover, some driving | operation evaluation may be performed for every fixed area, for example, the feeling from this intersection to this intersection, and it may be made to preserve | save it automatically at a server. Since the other person's evaluation data is accumulated for each section at the time of playback, how the evaluation of one's own driving is compared to other people's driving, whether it is rough driving or safe driving is The evaluation may be displayed when the window 130 is being played back. Depending on the evaluation, a flower circle or a crying face may appear near the bottom of the video, or a score may be obtained, or the average score of another person may appear.

  Furthermore, the video may be stored in the server for each fixed section, and the same place may be compared. For example, you may compare a certain road or National Route 1 from here to here. The driving score is given by the acceleration sensor, speed, sensor, gyro, and brake method, but conversely, whether the score for that road is a red or a passing score? . Naturally, the steering wheel is cut many times on winding roads, so even if it is said that it is too meandering, the evaluation should be appropriate. Because the road is bent. Rather than an absolute evaluation, you may give a relative evaluation or something that someone else has driven. You can display the image of the first driver, you are 30th, and this is a great driving image. There is a question about whether or not the first video can be displayed, but it is only necessary to provide a function that permits it. You can indicate whether you want to offer this, display whether you want other people to be able to see it, or attach an upload button. The camera (drive recorder 1) itself has a communication function and may upload it, or may transmit score data. You can check when installing the playback software on the personal computer 80, or you can do it all at the same time during installation, or you can choose to upload video files one by one, or the moment you try to upload A permission button may be displayed. Video files may be uploaded after confirmation and uploaded without confirming the score. It is good also as a rule that a user and the information which the user existed are not linked. When uploading, date data etc. may be deleted. There may be days of the week and times, but it is better to delete information that identifies individuals. If there is no vehicle type and personal name based on location and time, it is not necessary to know who the data is.

  Since there is a low possibility of an accident on a road with nothing like a farm road, we take a picture (record) for the time being, but the resolution is lowered, and there is a jump out in the city, so we will shoot (record) at a high resolution. It is good to be able to specify every place. The range from here to here should be able to be designated as low resolution recording, here high resolution recording. You can shoot for a long time. The location is designated using the reproduction window 130. The user specifies in advance a range from here to here. It is preferable to set the playback window 130 so that it is circled on the map and shot (recorded) at a low resolution when entering this range. Set the memory card 25 set for recording in the drive recorder 1. Then, it will move as it is. If the drive recorder 1 has a liquid crystal display device, it can be set by the drive recorder 1. You can adjust the resolution here even during parking monitoring. The resolution may be changed even during traveling. This is because nothing happens here. It is only necessary to record (record) finely in the event record. If you have all the data on the cloud (server) side, you can see that events do not occur or occur at this location, so you can adjust the resolution on the cloud side. The low probability (frame rate) is recorded when the probability is low, and the high resolution is recorded when the probability is high. Since it is event switching, it is better to have high resolution when there is an event. High resolution may be recorded at the travel destination, and low resolution may be recorded along the way to the travel destination. You do not have to record when you are driving on the highway. Recording may be performed only when an event occurs (event recording). For example, if you go to Kyoto, the city of Kyoto records with high resolution, but does not record when you leave Kyoto. Recording may be performed at one frame per second or at a low frame rate. You may set in advance the location you want to upload to the video posting site. For example, when going to the circuit, the circuit may be recorded with high image quality and not recorded along the way. Instead of recording at a low frame rate (low image quality), an area to be recorded at a high frame rate (high image quality) may be designated. When parking with parking monitoring, it may be recorded at a low frame rate.

  For example, when you go to Kyoto to shoot at high resolution, you should record the return. If you don't record it, there is no meaning as a drive recorder, and even if you try to set it in Kyoto, you can't set it because it is in operation. For example, you may record at high resolution only near Kiyomizu Temple, but you can forget it because you forget to set it. Also, it is good to record at high resolution while driving on a kite. Highways may be recorded with high image quality, and ordinary roads may be recorded with low image quality. The Metropolitan Expressway may be recorded with high image quality, the normal highway may not be recorded, it may be recorded when the speed exceeds 100 km, or it may be recorded when acceleration is applied at a corner. The area setting may be switched by providing the drive recorder 1 with a slide switch indicating whether the resolution is high or low.

  760MHz ITS service system, intelligent road information, etc. started as an experimental service from around 2016, but it is good to be able to record this information together with the information of the drive recorder 1. Information includes, for example, other cars (position, direction of travel, acceleration, etc.), traffic lights (how many meters ahead, time until red), road signs (how many meters ahead, speed limit) ), Pedestrians (position, direction of movement, etc.), emergency vehicle approach notification, sudden brake warning, traffic jam warning, failure signal vehicle warning, sign notification, motorcycle approach notification, signal timing notification, construction information notification, weather warning, etc. is there. ITS includes road-to-vehicle communication and vehicle-to-vehicle communication. Road-to-vehicle communication is communication between roads and vehicles, and vehicle-to-vehicle communication is communication between vehicles. In road-to-vehicle communication, information on the machine and information obtained from sensors of surrounding pedestrians are communicated. In vehicle-to-vehicle communication, communication such as which direction the car is going and information about the current accelerator is performed. For example, when data between roads and vehicles can be received and saved together with the video, for example, if it is an LED traffic light, it blinks, and the frame where the blinking has just disappeared and the frame rate of the camera are synchronized. Then, the signal light does not appear in the image at all, and depending on the situation, it may remain dark. Even if the light of the traffic light is not reflected, the state of the traffic light can be recorded as data with the information of ITS. If the information that the signal is blue is known from the ITS information, the signal can be displayed as blue at the end of the playback window 130. Since information is beginning to be provided using a dedicated frequency, it can be received by the receiver, recorded along with the video of the drive recorder, and displayed on the playback window 130.

  ITS service information may be recorded by the drive recorder 1 and displayed. The drive recorder 1 records information such as a car coming from the side, a bicycle coming, a red signal, a yellow signal, or a yellow signal, but not stepping on the brake on the memory card 25. It should be possible. Detects information on other vehicles in the vicinity of the vehicle (position, direction of travel, acceleration), how many meters ahead there is a traffic light, how many meters ahead it takes to turn red, the type of road sign, and pedestrians Therefore, it is preferable to receive and record the information by the drive recorder 1. When an emergency vehicle approaches, the information is sent between the vehicles by a bucket relay when the previous vehicle suddenly brakes, so that the drive recorder 1 can record such information on the memory card 25 Good. In addition, it is good to be able to record that information because it is known in advance that the car ahead has suddenly braked. In the case of road-to-vehicle communication, such information is transmitted from the antenna near the intersection. The drive recorder 1 receives information without permission when it enters an area of about 5 meters from the antenna. Between cars, vehicles that can receive information from the road can also send their own information. Now, when you want to receive data at several kilometers per hour, next to the left based on the car navigation system, now stepping on the brake, or between the road and vehicle, it will be received on the drive. The information received by the next car is also received between the cars because it is the same frequency. Dorareko should receive and not send. The device for ITS is a transmitter / receiver, and the drive recorder 1 records that a car with a dorareco and a different car are communicating. Just intercept. If you put the software in the dorareko and receive it, you may send it to another car.

  When there is a building at an intersection and when a car comes from a blind spot, the behavior of the car or the fact that the brake is being applied is communicated from one car to the other to prevent an accident Good for. In addition, a camera is installed at the intersection to inform the user that there is a pedestrian. Because it is a system that takes care when turning, it is easy for the administrator to manage if he knows that he is stepping on a brake when there is a hidden car. It should be recorded that the brakes were not depressed even though there was. If the previous signal is a red signal and the information that it does not turn blue unless it is 10 seconds is displayed on the display attached to the car, if you receive an indication that the fuel economy is bad if you do not slow down Good.

  In the reproduction window 130, the information of the vehicle to which the drive recorder 1 is attached is displayed below. For example, speed and turn signal operation status. Apart from such information, the information obtained by the ITS system should be put out elsewhere.

  For example, you can see how many meters ahead the car is on the right, so if there is a traffic signal several meters ahead, such as a car on the overlay, it will blow out at the moment when the traffic light is seen, It is good to display the time to signal. It may be displayed as text. It may be displayed as text or an icon. A balloon is an example of an icon.

  Since the video of the drive recorder is used as evidence that shows the situation of the accident objectively, it is desirable that it cannot be processed. It is preferable that tampering can be detected if tampering occurs. The video recorded by the drive recorder 1 is not a record of the scenery stored by the driver, but is an objective camera (front camera) included in the drive recorder 1 on the spot. 11, Video along with the use of rear camera 12) is recorded. This is because the installation location of the drive recorder 1 is different from the position of the driver's eyes, and the recording system of the drive recorder 1 is different from the human visual system. Of course, the difference between the drive recorder's imaging system and the human eye's imaging system is its angle of view, sensitivity, head movement, eye movement, optical system difference, imaging sensor, and the structure of the eye. Although there is a difference, especially because the cognitive structure of the brain is different, the driver memorizes the image that is memorized and attaches the drive recorder 1 with the function that can display the image as close as possible. It is preferable to educate the driver or correct the driver's cognitive distortion based on the difference from the objective video recorded by the recorder 1.

  It is preferable that the video recorded by the drive recorder 1 can be processed such as color, as if it was such a video. It is advisable to process the video in a state that was objectively recognized so that the video can be displayed close to the impression the driver felt.

  For the detection of falsification, the hash value of the data to be recorded when the video of the drive recorder 1 is recorded is obtained, the hash value is stored in association with the video, and P2P (peer-to- It may be stored in a block chain on the peer) network. Until now, all the video data was stored by one person on the server, but in a data-distributed database, all people and many people connected to the Internet share the same data. Each server will have. The block that is thrown on the Internet is attached to the block chain so far, and it becomes a chain more and more. The same data is recorded on the database for all servers in the chain. The feature is that since everyone has the same data, tampering can be detected unless a majority of people tamper.

  As for how to create data, when connecting blocks, the hash value of the previous block is calculated and it is always put in the next block. Tampering with one block cannot be said, and in order to tamper with it, all subsequent blocks must be tampered with, making tampering very difficult. The calculation amount is set so that it takes about 10 minutes to calculate the value of the block chain, and it is impossible to calculate all the blocks again. The entire sequence of contracts may be recorded on the block chain, or contracts for import / export procedures, etc., those who transport in other countries, those who settle within them, exchange You may record all bundles of contracts in the chain, such as people and how to deal with orders. For example, what month and day did you pass here. You can record all the information on the ship in the chain so that you can verify it later. It may be used in a mechanism that can be verified in an area of conflict of interest. In addition, the advertisement publisher buys the advertising space, and for example, in the contract that the number of CMs of 15 seconds between 7 o'clock and 7 o'clock to 8 o'clock in the golden time will be transferred in 1 month If it is a traffic advertisement, or if it is a traffic advertisement, it is not possible to verify all where it is overhanging, and if it is a net, the display of the partner's browser is really given that much impression It is not possible to verify whether or not it has been made, but a block chain may be used when auditing is performed between the person who submitted the advertisement and the person who actually publishes the advertisement. For example, if you advertise on the block chain, you put it in the block. Then, you can verify on the block chain that you have issued 1000 times and that you are now issuing 800 times.

  Video data may be recorded on the block chain so that it cannot be tampered with. For example, when storing data in a frame-by-frame image such as a motion picture based on the motion JPEG (Joint Photographic Experts Group), the hash value of the frame is obtained, transmitted as a block, and the block chain system If you connect it to the chain, you will not be able to tamper with it. You may calculate the hash value of the whole video file for a certain range and 1 minute.

  In video data based on MPEG, it is easy to falsify if it is segmented immediately before the I frame.

  In the public type block chain, anyone can participate in the block chain like Bitcoin, and all the data of the block flowing in the block chain can be seen by himself, but the consortium type, private A type of block chain is closed within a bank association, for example, and can be used only among banks that are members of the bank association. For example, the public type block chain system may be used. For example, if you send not only the hash value but also the location information and the current location information of the drive recorder to the block chain system, the block, the month, the date, who is where Is sent. For example, when information indicating that the drive recorder 901-1 is located here and is located in Okazaki City, Aichi Prefecture is transmitted to the block chain system, the server managing all the block chains is set to P2P. To broadcast. By sending video data etc. to the block chain system, if there is a user who wants it, it can be sold to that user.

  You can distribute advertisements in the same way. For example, an advertisement for a store in a specific place, a user in Okazaki City, Aichi Prefecture, may be sent, and an advertisement may be sent pinpoint only to the person in front of the store. A block chain costs money to maintain the chain, but when a transaction is made, it is withdrawn as a small amount, a fee, and distributed to the user who manages the server and the user who puts the block first. The paid currency information can also be recorded on the block chain. For example, if you take a picture and say it is taken at 100 yen, it will be deducted from the account of the person who requested it at 100 yen, and the drive recorder user enters about 80 yen, and 20 yen You may make it the structure that it is distributed toward the person who maintains the server.

  It is good to be able to enlarge and reduce the image by remote control while playing the image. Further, for example, the frame may be moved by a cursor or the like, and the position of the moved frame may be stored in association with the video time. The frame can be moved during playback, the position of the moved frame can be recorded, and a video stream can be created with the video extracted as a stream based on the recorded frame position information later. Good.

  The user should be able to manually move the field of view without automatically detecting the field of view. For example, when a frame is moved with a joystick, mouse, keyboard, etc., the moved position may be stored so that the moved frame can be displayed during playback. This makes it possible for other people to recognize the range that the person was able to see, although the visible range differs depending on the degree of concentration during driving, age, and eye disease. For example, you can argue that this range was visible or that you were looking at this range. In addition, it is desirable to be able to correct subjectively recognized brightness, color, and memory color. In particular, it is desirable to display objective video and subjective video so that the video taken by the camera can be compared with the video that the user actually thought of. When two types of images in the same scene are displayed, it can be explained that the camera was actually recorded in this way at the time of the trial but it looked like this. As for criminal responsibility, one is objective accident and the occurrence of the result, and the other is intentional. It is important to establish whether the person has deliberately hit it or made it by mistake. Objective video cannot be tampered with, but subjective video allows you to show what you were thinking separately and show both together.

  Further, a hash value of position information and event information where the vehicle has traveled may be calculated and transmitted to the block chain system. This makes it difficult to tamper with event information such as sudden deceleration or acceleration.

  Furthermore, in order to adjust to the subjectively recognized brightness, color, and memory color, the drive recorder 1 is provided with a brightness adjustment slider, and the brightness, color, and memory color are adjusted by operating the slider. Alternatively, a brightness adjustment button, a color adjustment button, and a memory color adjustment button may be provided in the playback window 130, and the brightness may be adjusted by operating these buttons.

  Furthermore, in the automatic driving of a vehicle such as an automobile, the drive recorder 1 records during manual driving when the driver drives the vehicle, or the driving recorder 1 records during automatic driving where the driver automatically drives the vehicle. It is preferable to record data for identifying whether or not the data is in the header recording area 31 of the video file as described above. In this case, it is preferable to record the level of automatic operation in the header recording area 31 of the video file. When the identification data indicating whether the vehicle is in automatic operation or manual operation is transmitted during the CAN (Controller Area Network) of the vehicle, or data indicating the level of automatic operation is transmitted during automatic operation, the drive recorder 1 uses CAN. By receiving data communicated in the drive (for example, connecting the drive recorder 1 to the CAN or receiving data communicated in the CAN in the communication circuit 17), the drive recorder 1 can receive the video file. In the header recording area 31, identification data indicating whether automatic operation or manual operation is being performed, and data indicating the level of automatic operation can be recorded if automatic operation is being performed. When playing back video data, the playback window 130 can display whether the video displayed in the video display area 141 is in automatic operation or manual operation. For example, the level of automatic operation can be displayed.

  The image data may be switched between automatic operation and manual operation, and the video data may be recorded in the drive recorder 1. It may be recorded with relatively high image quality in the case of automatic operation, and may be recorded with relatively low image quality in the case of manual operation, and vice versa. You may record with relatively high image quality when driving. Furthermore, the image quality may be changed according to the level of automatic driving. The higher the level of automatic driving, the higher the image quality may be recorded, and the higher the level of automatic driving, the lower the image quality may be recorded.

  Further, when a plurality of cameras (front camera 11 and rear camera 12) are included as in the drive recorder 1, the camera to be photographed can be switched depending on whether it is in automatic operation or manual operation. Good. For example, video data obtained only by the front camera 11 may be recorded during automatic operation, and video data obtained only by the rear camera 12 may be recorded during manual operation, or vice versa. . Furthermore, in the reproduction, the video only for the automatic operation may be reproduced and the video for the manual operation may be skipped, or the video for the manual operation may be reproduced and the video for the automatic operation may be skipped. Further, the video data recorded at any level of the automatic operation levels may be reproduced, and the video data recorded at any other level may be skipped.

  Furthermore, when reproducing the video data, the communication robot may instruct about the driving technology of the reproduced video. If the instructor explains directly to the user who receives the instruction, the user who receives the instruction may get angry. However, if the communication robot says "It was dangerous here", the psychological burden on both the instructor and the user is reduced. The communication robot is arranged in the vicinity of an instructor and a user who are viewing the display device 92 of the personal computer 80 to be reproduced. For example, a communication robot is always placed on the right side of the display device 92 of the personal computer 80, and the positions where the instructor and the user are seated may be determined in advance. Whether the communication robot is placed on the right side or the left side of the display device 92 of the personal computer 80 may be set by video data reproduction software (program). Of course, the communication robot may be provided with a camera, and the camera may be used to photograph 360 degrees around the communication robot to recognize the positions of the surrounding display device 92, the instructor, the user, and the like. A person wearing a uniform may be recognized as an instructor and other persons as users.

  Further, the road width of the road included in the video obtained by shooting by the drive recorder 1 or the video data obtained by recording of the drive recorder 1 is detected, and the video processing is changed based on the road width. You may make it do. For example, in a place where the road width is narrow, a video in the left-right direction may be displayed, or the type of video during playback may be changed according to the road conditions (narrow, gravel road, one-way street, etc.). Further, at the intersection, if the drive recorder 1 can display video during recording, the front video may be displayed or the front video may be displayed during playback. Further, for example, a right or left image that shows a road on the right or left side of the road may be displayed on the display screen 3 of the drive recorder 1.

  Furthermore, when video data is recorded by the drive recorder 1, a video of a vehicle ahead of the vehicle to which the drive recorder is attached is analyzed to analyze whether a dangerous situation has occurred, and a danger arises. You may make it switch the image | video to the camera where the danger is easy to see several seconds ago. The display mode may be switched so that the video currently displayed is dangerous after 2 seconds. For example, if there is a car crossing in front two seconds later, the car is displayed in the celestial sphere mode (the mode displaying the front / rear / left / right situation of the vehicle), but it may be switched to the mode for displaying only the front. As a result, a dangerous scene can be seen in 2 seconds. You may return to the original celestial sphere mode after that. In this way, the display form may be automatically changed when something strange happens. It is also possible to automatically analyze all the video files in advance, detect the strange place, and mark the video to be played back. Whether it is dangerous or not can be judged by whether the change in the image is large or the change in the acceleration is large. The display can be changed without the user operating the switching button. For example, it is preferable to switch to a few seconds before an event such as a danger may occur, for example, five seconds before.

  Furthermore, communication data from Ensta and car security may be received by the drive recorder 1, and event recording may be performed using the received data as a trigger. The drive recorder 1 is provided with a communication circuit based on LTE (Long Term Evolution), a communication circuit based on Wi-fi, and a communication circuit based on Bluetooth (registered trademark), and records data representing each communication state. You may make it perform the change process of the state of the image | video displayed according to a communication state. The display change process may be a change in the display form of the video displayed on the display screen 3 of the drive recorder 1 or a change in the display form of the video in the playback window 130 during playback. For example, when a command signal for turning on or off the car security is received, it may be automatically switched to an image for photographing the left and right direction of the vehicle and the vicinity of the door. In addition, if you receive a Wi-fi signal, you may have stopped the video because it is considered that you have entered the home area. When there are a plurality of communication means, it is preferable to determine which video is to be output according to each communication means. You may make it switch a display mode according to the content of the communication means or communication. If the vehicle door is unlocked and the engine is started using Bluetooth (registered trademark), the vehicle image is displayed from the vehicle surrounding image display state according to the reception of the Bluetooth signal. You may switch to, or you may take pictures not only around the vehicle but also inside the car. This makes it possible to know the state of the car as soon as the engine starts. Ensta is restored in about 30 seconds, and when the door is unlocked, both the vehicle periphery and the interior of the vehicle are maintained until the door is locked, and then only the vehicle periphery or the vehicle front is switched back. You may do it.

  In addition, the operation manager, buses, taxis, logistics, etc. always make a call. For example, alcohol checkers are obligatory, such as whether they are in good health today. The video of the call is recorded. The video of the call and the video of the drive recorder may be viewed together in the playback window 130. For example, it is preferable that the video recorded in the drive recorder 1 of the called driver can be reproduced by specifying the video file of the call. For example, if the call is made in turn and the order is taken, the call video and the video of the drive recorder 1 can be associated from the temporal relationship.

  When the drive recorder 1 is attached to a forklift and the drive recorder 1 is attached to an automobile such as a truck, the video recorded in any of the drive recorders 1 is transmitted to the server, and the same It is preferable that the images of the vehicles (trucks, forklifts) driven by the driver can be shown as a single continuous day movement. For example, if you arrive at a place where you are driving a truck, drive a forklift at a certain place, and then get on the car and go to the delivery destination, you should be able to see the series of images. By combining with the video of the call, you can see the driver's daily flow.

  In addition, driving guidance may be used with mixed reality. For example, the user operates once and the video is recorded on the drive recorder. Thereafter, in the playback window 130, the video is played back and the driving technique is automatically evaluated. At the time of this automatic evaluation, information on points of caution is added to the video data. Subsequently, the user wears the MR glasses and rides the same portion on the driver's seat or displays the information on the MR glasses. The user can see the information of the attention point superimposed on the actual landscape and scenery. For example, information on where to look at the traffic light and where to see the stop line is displayed on the lens (glass) of the MR glasses, and the information can be confirmed while looking at the actual scenery.

  Further, the travel history data may be recorded in the memory 21 of the drive recorder 1 so that when it comes close to a place visited in the past, it is possible to indicate where and where to go in order to go. With reference to the travel history data, a display indicating that the vehicle has traveled before and voice output may be performed.

  Further, the rear camera 12 of the drive recorder 1 may take a vehicle meter and recognize it as a start trigger for recording video data. In addition, when the room lamp of the vehicle is photographed and it is detected that the room lamp is on, event recording is started and data indicating that the room lamp is on may be sent to the server. . For example, data indicating that a room lamp is attached may be transmitted from the server to the vehicle user. It can be seen that the user has a room lamp.

  You may make it attach a drive recorder (camera) to the automatic conveyance vehicle in a factory. The automated guided vehicle is equipped with LIDAR (Light Detection and Ranging) sensors, which can scan the laser at high speed and detect surrounding objects. Event recording (recording for a certain period of time, for example, several tens of seconds to several minutes depending on the given trigger) may be started as a trigger when an approaching peripheral object is captured.

  Event recognition may be performed by triggering the moment when the fork of the forklift moves in image recognition. Images may be taken with the front camera 11 and rear camera 12 of the drive recorder 1, and when the forklift moves, it may be recorded as a trigger. The event recording may be started by triggering when a person wearing a helmet gets on the forklift, or on the contrary when a person not wearing the helmet gets on the forklift. In that case, recording may start when a person gets on and stop when the person goes down. The start / end of recording / reproduction may be determined by getting on and off a person. Forklifts are characterized by the fact that the owner of a forklift is a company, but not only the employees of the company but also the people of the carrier are driving. Since the driving person changes, recording may be started when such a person gets on, recording may be started when a person comes, and recording may be stopped until 3 minutes after getting off. A forklift accident is a problem, but you can see who broke it.

  Furthermore, Exif information is attached when taking a picture, and text data is embedded in JPEG data. The exposure taken at that time and the shutter speed are embedded. Such information may be displayed on the playback window 130 by playback software. A still image file may be generated from a video image and recorded as Exif information in the header recording area of the still image file. For example, information displayed on the playback window 130 is preferably recorded as header recording area Exif information. For example, a series of acceleration changes in the video may be historically entered in the header recording area of the still image file. The GPS information and speed, the maximum acceleration value when moving within a certain range, the speed of the car, whether or not the brake is stepped on, whether or not the winker is released, etc. may be recorded as Exif information in the header recording area. It is possible to record all of a certain range of speed, or all values for the types of events that occurred within plus or minus 3 seconds before and after a certain event occurred, and if there are multiple cameras in the drive recorder In addition, information indicating which camera image is recorded, how many cameras were recorded, information indicating where the camera is attached to the vehicle, and the like may be recorded as Exif information in the header recording area. In addition, when a drive recorder is installed in an autonomous vehicle in the factory, the cause of the trigger, whether the lighting error was red or yellow, the state of the forklift, the amount of rotation of the forklift, the gyroscope, the battery Or the like may be recorded as Exif information in the header recording area. Information obtained in AWS (Automatic Guided Vehicle), CWS (Collision Warning System), stopper, vehicle-to-vehicle communication, road-to-vehicle communication, etc. may also be recorded as Exif information in the header recording area. There are people, no people, there are drivers, there are no drivers, there are people in the passenger seat, no, sitting in the back seat, not sitting, commercial vehicles, different vehicles, taxis, buses, buses Information such as whether or not there is a person may be used as a trigger, or such information may be recorded as Exif information in the header recording area. Furthermore, information recorded as Exif information may be transmitted to the block chain system and recorded as a transaction in the block chain.

  Further, points may be given to the user in accordance with the use of the playback software (program) that displays the playback window 130. For example, it is also possible to connect to the Internet, upload data in response to pressing of the “import” button, and add points. The communication type drive recorder 1 can automatically transmit video data once it is licensed.

  The scope of the present invention is not limited to the configurations explicitly described in the specification, and includes combinations of various aspects of the present invention disclosed in the present specification. Of the present invention, the configuration for which a patent is sought is specified in the appended claims. However, the present invention is disclosed in this specification even if the configuration is not specified in the claims. I intend to make this configuration a claim in the future.

  The present invention is not limited to the configuration described in the above embodiment. The components of the above-described embodiments and modifications may be arbitrarily selected and combined. In addition, any component of each embodiment or modification, and any component described in the means for solving the invention or any component described in the means for solving the invention And may be combined arbitrarily. We also intend to acquire rights in these amendments or divisional applications.

The scope of the present invention is not limited to the configurations explicitly described in the specification, and includes combinations of various aspects of the present invention disclosed in the present specification. Of the present invention, the configuration for which a patent is sought is specified in the appended claims. However, the present invention is disclosed in this specification even if the configuration is not specified in the claims. I intend to make this configuration a claim in the future.
The present invention is not limited to the configuration described in the above embodiment. The components of the above-described embodiments and modifications may be arbitrarily selected and combined. In addition, any component of each embodiment or modification, and any component described in the means for solving the invention or any component described in the means for solving the invention And may be combined arbitrarily. We also intend to acquire rights in these amendments or divisional applications.
In addition, the applicant intends to acquire rights for the entire design or partial design by filing an application for conversion to a design application. The drawing shows the entire apparatus as a solid line, but includes not only the entire design but also a partial design that is claimed for a part of the apparatus. For example, it is a drawing that includes a part of the apparatus as a partial design as well as a part of the apparatus as a partial design. A part of the device may be a part of the device or a part of the member. In addition to the overall design, we have the intention to make a partial design with any part of the solid line part of the drawing as a broken line part.

  1: drive recorder, 2: mounting part, 3: display screen, 4: camera part, 5: front lens, 6: rear lens, 7: character string, 10: controller, 11: front camera, 12: Rear camera, 13: Display control device, 14: Display device, 15: Clock, 16: Road-to-vehicle / vehicle-to-vehicle information receiving circuit, 17: Communication circuit, 18: Accelerometer, 20: Input device, 21: Memory, 22 : GPS receiver, 25: Memory card, 31: Header recording area, 32: Video recording area, 80: Computer, 81: Display control device, 82: Display device, 90: CPU, 92: Display device, 93: Acceleration Sensor: 95: Memory card reader / writer, 96: Input device, 97: Memory, 98: Communication circuit, 130: Playback window, 131: Menu bar, 132: Folder icon, 133: Camera icon, 134 : Printer icon, 135: Reel Eye 136: FD icon, 137: Log icon, 138: Gear icon, 141: Video display area, 141A: Video display area, 141B: Video display area, 142: Area outside visual field range, 143: Frame, 143A : Frame, 144: mark, 144A: mark, 145: mark, 146: balloon, 146A: balloon, 146B: balloon, 147: balloon, 148: chain line, 151: map image display area, 152: icon, 161: vehicle information Equivalent display area, 162: Vehicle state display area, 163: Operation button, 166: Time display area, 168: Acceleration graph display area, 171: Play list display area, 172: Play list display area, 280: Communication robot 281: trunk, 282: head, 283: eyes, 284: mouth, 291: CPU, 292: memory, 293: communication LAN board, 294: wireless communication circuit, 295: motor control board, 296: head motor 297: Sensor board 298: Camera, 299: voice input and output boards, 300: speaker, 301: microphone, 310: windshield, 311: Dashboard

Claims (60)

A playback device for playing back recorded video data,
The recorded video data is processed based on the acquired information, and control for displaying a video based on the processed video data is performed.
Playback device. Processing to display the user's visual field range on the video,
The playback apparatus according to claim 1. When there is an object to be noted in the video outside the user's field of view, this is notified.
The reproducing apparatus according to claim 2. Processing to display the user's line of sight when recording video data on the video,
The playback apparatus according to any one of claims 1 to 3. Processing to display the video by moving the visual field range in the direction that the user is facing when recording video data.
The playback device according to any one of claims 1 to 4. Processing to display on the video the range that the user has not seen during a certain time when recording the video data.
The playback device according to any one of claims 1 to 5. Detects whether the user's line of sight when recording video data matches the direction the user should see,
The playback device according to any one of claims 1 to 6. The video data is recorded by a recording device,
The direction in which the user sees differs depending on the driving of the vehicle when recording video data or the user's operation of driving the vehicle.
The playback device according to claim 7. Detects whether the order viewed by the user when recording video data matches the order to be viewed in advance.
The playback device according to any one of claims 1 to 7. Processing the user's point of view on the video,
The playback device according to any one of claims 1 to 9. When the video data is recorded, the scene image is displayed in response to the user not seeing the part to be viewed.
The playback device according to any one of claims 1 to 10. Display the video faster than the display speed of the video part where there is a change in the movement of the subject.
The playback device according to any one of claims 1 to 11. The video data is recorded by the recording device, and the user evaluates the driving of the video portion of the video where the movement of the subject changes.
The playback device according to any one of claims 1 to 12. The video data is recorded by the recording device, and the video based on the video part that the customer is included is displayed.
The playback device according to any one of claims 1 to 13. Find the video part related to the keyword from the video based on the keyword indicating the situation of the video part.
The playback device according to any one of claims 1 to 14. The video data is recorded by a recording device, and the video portion related to the keyword is found out from the video based on the keyword representing the vehicle condition at the time of recording the video data.
The playback device according to any one of claims 1 to 15. The video data is recorded by the recording device and warns when the user is not looking in the direction to see while driving the car.
The playback device according to any one of claims 1 to 16. The video data is recorded by the recording device, and the video is displayed by distinguishing the range that is visible by the user and the range that is not visible by the user while the user is driving the car.
The playback device according to any one of claims 1 to 17. Process the recorded video data so that the display range of the video is changed according to the orientation of the device that displays the video based on the processed video data.
The playback device according to any one of claims 1 to 19. The video data is recorded by the recording device, and is recorded so as to change the display range of the video with the direction of travel of the car as the reference direction according to the orientation of the device that displays the video based on the processed video data Processing video data,
The playback device according to claim 19. To display information about the situation of the vehicle when recording video data,
21. The playback device according to claim 20. The video data is recorded by the recording device, and a map image representing the moving range of the car at the time of recording the video data is displayed, and the video recorded by the recording device at the specified position in the displayed map image. Display video based on data,
The playback device according to any one of claims 1 to 21. Video based on video data recorded by the user's recording device at the specified position in the displayed map, and video recorded by a third-party recording device at the specified position in the displayed map image Display at least one of video based on data,
23. A playback apparatus according to claim 22. The name including the shooting location of the recorded video data is displayed as a name for identifying the recorded video data.
The playback device according to any one of claims 1 to 23. Multiple video data are recorded,
Display names that identify video data from the same shooting location in a batch,
The playback device according to claim 24. Give priority to names with low appearance frequency,
The playback device according to claim 25. Display an image of the location map,
27. A playback device according to any one of claims 24 to 26. The video data is recorded by a recording device, and a map image representing the moving range of the car at the time of recording the video data is displayed, and information regarding the operation of the car at the time of recording the video data is displayed on the map image.
The playback device according to any one of claims 1 to 27. The video data is recorded by the recording device, and the video based on the processed video data is displayed, and the information based on the comparison between the third party driving and the user driving at the video data recording location is displayed. ,
The playback device according to any one of claims 1 to 28. The video data is recorded by the user's recording device, the video based on the processed video data, and the video based on the video data recorded on the recording device according to the third party operation at the video data recording location. , Display,
30. A playback device according to any one of claims 1 to 29. Information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication is recorded in association with video data.
In order to display the information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication in relation to the video based on the processed video data,
31. A playback device according to any one of claims 1 to 30. Processing is correction to memory color,
32. The playback device according to any one of claims 1 to 31. The processing process is a process of blurring at least a part of the video based on the recorded video data.
33. The playback device according to any one of claims 1 to 32. When audio is output for video based on the processed video data, it is directed to the display screen that displays the video, and when audio is output to the viewer of the video based on the processed video data, the communication Further equipped with a robot,
The playback device according to any one of claims 1 to 33. Based on the information about the road, control to change the display mode of the video based on the processed video data,
35. A playback device according to any one of claims 1-34.   A recording apparatus for recording video data to be reproduced in the reproducing apparatus according to claim 1. Control to record video data with high image quality based on specified conditions.
The recording apparatus according to claim 36. At least one of the reproducing device and the recording device according to claim 1 includes a specifying means for specifying a condition,
Based on the conditions specified by the specifying means, control is performed to record video data with high image quality.
The recording apparatus according to claim 36. The above condition is either that the speed of the vehicle in which the recording device is installed exceeds a certain level, or that the vehicle in which the recording device is installed travels in the designated place.
The recording apparatus according to claim 36. When the video data is recorded by the recording device, the information obtained by at least one of road-to-vehicle communication and vehicle-to-vehicle communication is recorded in association with the video data.
The recording apparatus according to claim 36. Control to transmit data representing a first calculation value uniquely determined from the video data recorded by the recording device to the block chain system;
The recording apparatus according to claim 36. The video data recorded by the recording device is video data based on MPEG, and data representing a first calculation value that is uniquely determined for each unit is defined as a unit for dividing the video data immediately before the P frame.・ Control the chain to record,
The recording apparatus according to claim 36. Control to record data representing the second calculated value uniquely determined from the event data in the block chain,
The recording apparatus according to claim 36. Record the video data recorded in the recording device in association with the video data indicating whether the video data is for manual operation or automatic operation.
The recording apparatus according to claim 36. Change the image quality of video data recorded by the recording device during manual operation and automatic operation.
The recording apparatus according to claim 36. Operate the communication robot during automatic operation
The recording apparatus according to claim 36. Displays video based on the recorded video data, and performs control to change the video display mode when it is determined that the event is likely to occur.
The recording apparatus according to claim 36. Records data representing the communication status of the communication radio waves received by the communication device,
The recording apparatus according to claim 36. Change the video data recording mode based on the communication radio wave received by the communication device.
The recording apparatus according to claim 36. Record video data representing the video of a driver who has received a call and video data obtained by driving the driver,
The recording apparatus according to claim 36. The video data obtained by the recording device installed on the truck driven by the driver and the video data obtained by the recording device installed on the forklift operated by the driver are associated and recorded.
The recording apparatus according to claim 36. Control is performed to display information that should be noted in driving, overlaid on the actual scenery seen from the running car.
The recording apparatus according to claim 36. Based on the fact that you have traveled the same place where you have traveled before, you will be notified to that effect.
The recording apparatus according to claim 36. Take a picture of a car speedometer and record video data based on the speedometer.
The recording apparatus according to claim 36. A recording device attached to an automated guided vehicle, which controls the recording of video data based on the detection of the approach of objects around the automated guided vehicle.
The recording apparatus according to claim 36. A recording device attached to a forklift,
Control the recording of video data based on the operation of the forklift and / or the driver riding on the forklift.
The recording apparatus according to claim 36. Record event recording trigger information in the header of the file that stores the video data.
The recording apparatus according to claim 36. A playback method for playing back recorded video data,
The recorded video data is processed based on the acquired information, and control for displaying a video based on the processed video data is performed.
Playback method.   59. A recording apparatus control method for controlling a recording apparatus to record video data to be reproduced in the reproducing method according to claim 58. A computer-readable program for playing back recorded video data,
A computer-readable program for processing the recorded video data based on acquired information and performing control for displaying a video based on the processed video data.

Images