JP2024045123A - System, control method, program, etc. - Google Patents

Abstract

[Problem] To provide a system, control method, and program for reducing the amount of data transmitted and suppressing data communication charges. [Solution] In a drive recorder, when an event occurs at time t3, such as when an impact is applied to a vehicle, video data with a relatively large amount of data is generated from time t2 to time t4, and video data with a relatively small amount of data is generated from time t1 to time t5, and the generated video data is transmitted to a server, etc. [Selected Figure] Figure 4

Description

This invention relates to, for example, systems, control methods, programs, etc.

In some prior art documents, the video recorded by a drive recorder is played back on a personal computer or a so-called smartphone, and displayed on the display screen of the personal computer or the smartphone (Patent Document 1). In addition, if the drive recorder has a display screen, the video is also displayed on the display screen of the drive recorder.

Japanese Patent Application Publication No. 2016-14310

The method described in Patent Document 1 is still not sufficient.

The aim is to provide something better than before.

The purpose of the invention of the present application is not limited to this, but we also intend to acquire rights through divisional applications, amendments, etc. for structures that aim to obtain effects from the parts of the structures disclosed in this specification, drawings, etc. . For example, the present specification discloses a problem in which the phrase ``can be done'' is replaced with ``the problem is.'' Each problem is described as independent, and we intend to obtain rights for the structure to solve this problem independently through divisional applications, amendments, etc. Even if the problem is understood implicitly from the description, the applicant intends to claim a part of the structure described in the specification in an amendment or divisional application. .

(1) It is preferable that the system is capable of displaying images captured in a vehicle and is equipped with a means for processing the image data for said display.

By processing video data for display, it is possible to provide something better than before.

The displayable system may be, for example, a personal computer, a smartphone, a drive recorder, or the like. Processing of video data for display includes, for example, processing for video playback, processing for video data transmission, processing for adjusting video brightness, processing for changing the video playback format, and reducing the amount of video data. It is better to use processing.

(2) The video data for display may be processed to adjust the brightness of the video based on instructions from the user.

The brightness of the image can be adjusted based on instructions from the user.

The system may be provided with instruction input means such as hardware or software buttons, and instructions from the user may be received using these instruction input means such as buttons, or a menu may be displayed on the screen displaying the image, and instruction input means may be provided that allows the user to select an instruction from the menu. Brightness may be adjusted so that the entire image or part of the image's dark parts becomes brighter, or brightness may be adjusted so that the entire image or part of the image's bright parts becomes darker.

(3) The image includes bright and dark areas within one frame, and the image data for the above display is preferably processed to adjust the brightness so that the amount of brightness adjustment in the dark areas is relatively greater than the amount of brightness adjustment in the bright areas.

The difference between the brightness of dark areas and bright areas is reduced, making the image easier to see as a whole.

It is preferable that the bright area be an area with brightness equal to or higher than a threshold value within one frame, and the dark area be an area with brightness less than the threshold value. It is also possible to provide a detection means for detecting a bright part that is equal to or higher than a threshold value, to make the detected part a bright part, and to make an undetected part a dark part. Alternatively, a detection means for detecting a dark part below the threshold value may be provided, and the detected part may be defined as a dark part, and the undetected part may be defined as a bright part. The brightness adjustment amount may be adjusted brightly by adjusting the gain of the video data. The brightness may be adjusted so that both bright and dark areas become brighter, such that the brightness adjustment amount for the dark area is relatively larger than the brightness adjustment amount for the bright area. The brightness may be adjusted so that only dark areas become bright. It is even better to provide means for adjusting this threshold value. The means for adjusting the threshold value may be a means for adjusting the threshold value by inputting a user's instruction.

(4) The above video includes a video portion inside the vehicle interior and a video portion outside the vehicle interior in one frame, and the video data for the above display is processed to adjust the brightness of the video portion inside the vehicle interior. It's good to do that.

Video data with brightness adjusted for the image area inside the vehicle is obtained.

A means for detecting an image portion inside the vehicle interior may be provided, and the detected portion may be defined as an image portion inside the vehicle interior, and the undetected portion may be defined as an image portion outside the vehicle interior. Further, a means for detecting an image portion outside the vehicle may be provided, and the detected portion may be set as the image portion outside the vehicle interior, and the undetected portion may be set as the image portion inside the vehicle interior. It is preferable to use edge detection to detect the video portion inside the vehicle interior. It is best to adjust the brightness by adjusting the gain of the video data. The brightness may be adjusted so that both the video portion inside the vehicle interior and the video portion outside the vehicle interior are bright, or the brightness may be adjusted so that only the video portion inside the vehicle interior is bright.

(5) It is advisable to process the image data for the above display so that the brightness of the captured image is adjusted so that the amount of brightness adjustment inside the vehicle is relatively greater than the amount of brightness adjustment of the image outside the vehicle.

It is believed that the brightness of the image outside the vehicle cabin is often brighter than the brightness of the image inside the vehicle cabin, so by adjusting the brightness of the captured image so that the amount of brightness adjustment inside the vehicle cabin is relatively greater than the amount of brightness adjustment of the image outside the vehicle cabin, the difference in brightness between the image inside the vehicle cabin and the image outside the vehicle cabin is reduced, making the image easier to see overall.

It is preferable to provide a means for detecting an image portion inside the vehicle interior, and make the detected portion the image portion inside the vehicle interior, and the portion not detected as the image portion outside the vehicle interior. Further, it is preferable to provide a means for detecting an image portion outside the vehicle interior, and use the detected portion as the image portion outside the vehicle interior, and the undetected portion as the image portion inside the vehicle interior. It is preferable to use edge detection to detect the video portion inside the vehicle interior. The brightness adjustment amount may be adjusted brightly by adjusting the gain of the video data. The brightness is set so that both the image area inside the vehicle interior and the image area outside the vehicle interior are brighter, so that the amount of brightness adjustment inside the vehicle interior is relatively larger than the amount of brightness adjustment for the image area outside the vehicle interior. The brightness may be adjusted so that only the video portion inside the vehicle is bright. The means for detecting the video portion inside the vehicle interior may, for example, accept a selection of the region of the vehicle interior portion in the video from the user and detect the selected portion as the video portion inside the vehicle interior, or may, for example, automatically detect the selected portion as the video portion inside the vehicle interior. Alternatively, a video portion inside the vehicle may be detected. As an automatic detection process, for example, when the movement of the vehicle is detected, parts of the image that change in response to the movement are detected as outside the vehicle, and areas that do not change in the image in response to the movement are detected as the interior of the vehicle. It is recommended that the process be performed as follows. In particular, it is preferable to perform a process of detecting an area in the video where there is movement in accordance with the speed of movement of the vehicle as outside the vehicle, and an area in which there is no movement in accordance with the speed of movement of the vehicle as inside the vehicle.

(6) It is preferable to provide a first instruction input means for inputting an instruction from the user to adjust the brightness inside the vehicle cabin.

The brightness inside the vehicle can be adjusted based on instructions from the user.

The system may be provided with hardware buttons or software buttons, and these buttons may serve as the first instruction input means, or a menu may be displayed on a screen that displays an image, and the menu may serve as the first instruction input means. If the menu serves as the first instruction input means, the user may be able to select an instruction from the menu. The keyboard of a personal computer may serve as the first instruction input means, or a keypad may be displayed on a display screen of a personal computer, a display screen of a smartphone, a display screen of a drive recorder, or the like, and the displayed keypad may serve as the first instruction input means. The brightness in the vehicle cabin may be adjusted based on an instruction from the user given by the first instruction input means.

(7) It is preferable to provide a second instruction input means for inputting an instruction from the user that does not perform the above brightness adjustment.

It is possible to prevent the brightness from being adjusted based on instructions from the user. By combining the first instruction input means and the second instruction input means, it is possible to switch between an instruction to perform brightness adjustment and an instruction not to perform brightness adjustment.

The second instruction input means may be a hardware button or a software button in the system, or a menu may be displayed on a screen that displays an image, and the menu may be used as the second instruction input means. If the menu is used as the second instruction input means, the user may be able to select an instruction from the menu. The second instruction input means may be a keyboard of a personal computer, or a keypad may be displayed on a display screen of a personal computer, a display screen of a smartphone, a display screen of a drive recorder, or the like, and the displayed keypad may be used as the second instruction input means. When an instruction is given from the second instruction input means, the instruction from the second instruction input means may be stopped, and when an instruction is given from the second instruction input means, the instruction from the first instruction input means may be stopped.

(8) It is advisable to process the image data for the above display so that the first window that displays the image and the second window that includes the operating system for operating the displayed image are separate.

The first window that displays the video and the second window that includes an operation system that operates the displayed video can be separate.

For example, by displaying the first window that displays the video over the entire display screen, the video is displayed larger and becomes easier to see. The first window that displays the video and the second window that includes the operation system that operates the displayed video may be displayed on the same screen or on different screens, but preferably It is best to display it on a different screen. A switching instruction input means may be provided for switching between an instruction to display the first window and the second window on the same screen and an instruction to display the first window and the second window on different screens. Depending on the command from the switching instruction input means, the first window and the second window can be displayed on the same screen, or the first window and the second window can be displayed on different screens. For example, it is recommended to provide a software switching button on the screen or a hardware switching button on the system. The display can be switched according to instructions from the switching button. The operating system for operating the displayed video is, for example, one that gives commands to control video playback, such as starting video playback, stopping playback, pausing playback, fast forwarding, and rewinding.

(9) The display screen where the first window for displaying the video is displayed and the display screen where the second window containing the operation system for manipulating the video is displayed are separate. It is recommended to process video data for

The display screen on which the first window for displaying the video is displayed and the display screen on which the second window including the operation system for operating the video is displayed can be separate.

For example, it is preferable to place the display screen on which the first window for displaying the video is displayed in a position that is easy to see for a person viewing the video, and the display screen on which the second window including the operation system for operating the video is displayed in a position that is easy to operate for a person operating the video. For example, when video is obtained by driving a driver managed by an administrator, the administrator operates the video while looking at the display screen on which the second window is displayed, and the driver managed by the administrator or the like views the video on the display screen on which the first window is displayed, whereby the administrator can move the display screen on which the second window is displayed to a position that is easy to see so as to easily operate the video, and the driver managed by the administrator or the like can move the display screen on which the first window is displayed to a position that is easy to see so as to easily view the video. It is preferable that the display screen on which the first window for displaying the video is displayed is larger than the display screen on which the second window including the operation system for operating the video is displayed.

(10) It is preferable to process the image data for the above display so as to generate an area for displaying the image in a second window that includes an operation system for operating the displayed image.

By doing this, the image will also be displayed in the second window, allowing you to operate while viewing the image. When the second window containing the operation system for operating the displayed image is displayed, the first window is displayed on the display screen by the user giving a command to display the first window for displaying the image. You can also make it appear. At that time, the first window may be displayed on the entire display screen.

(11) It is preferable to process the video data for the above display so that accompanying information of the video is displayed in a first window for displaying the video.

By doing this, you can view the video along with additional information about the video.

The accompanying information for the video may be, for example, vehicle speed information, acceleration information, position information, and the like. The accompanying information may be displayed on the video, or may be displayed in an area other than the area in the first window for displaying the video. For example, when video is obtained by driving a vehicle managed by a driver managed by an administrator, the administrator operates the video while looking at the second window, and the driver managed by the administrator views the video displayed in the first window. The video viewed by the managed driver displays accompanying information such as vehicle speed information and acceleration information when the driver was driving, so that the driver can have a clearer understanding of his or her own driving behavior by looking at the accompanying information.

(12) It is advisable to process the video data for the above display so as to reduce the amount of data when the time is far from the time when the recording command is given.

It is possible to reduce the amount of data when the time is far from the time when the recording command is given than the amount of data near the time when the recording command is given.

The recording command may be generated, for example, by a trigger being given to the vehicle that captures the video or by an event being applied to the vehicle. For example, an event may be generated by stepping on the brakes of the vehicle or by an impact being applied to the vehicle, and a trigger may be given to the vehicle. Also, a software button or a hardware button may be provided in the system, and the recording command may be given by operating the button. The amount of data may be reduced when the time from the time when the recording command is given to a later time point or when the time from the time when the recording command is given to an earlier time point or before is reduced. The period including the time when the recording command is given is set as the first period, and at least one of the periods after the first period has elapsed or before the first period starts is set as the second period, and the amount of data in the second period may be reduced more than the amount of data in the first period. The first period may start a certain period after the recording command is given, and the second period may start after the first period ends, and the amount of data in the second period may be reduced more than the amount of data in the first period.

The amount of data can be reduced by increasing the compression rate of the video data, decreasing the frame rate of the video data, or reducing the number of pixels in the video. The amount of data can be reduced when the video data is obtained by filming in a vehicle. Rules for reducing the amount of data, which indicate the method by which the amount of data was reduced, can also be recorded.

(13) The video data for display may be processed so as to transmit video data with a reduced amount of data.

By doing so, it becomes possible to transmit reduced video data. Since the amount of video data to be transmitted is reduced, the transmission time is shortened.

The amount of data should be the amount of data per unit time. Video data should be transmitted based on mobile phone communication standards such as LTE (Long Term Evolution) and 4G. When capturing video in a vehicle using a drive recorder or the like, the amount of video data obtained by the capture should be reduced and transmitted from the drive recorder to a server or the like.

(14) It is preferable to process the video data for display so as to reduce the amount of video data to be transmitted compared to the amount of video data recorded on the recording medium in response to the recording command.

The amount of video data to be transmitted can be reduced compared to the amount of video data to be recorded.

The recording medium may be a hard disk or semiconductor element memory built into the recording device, or it may be a portable recording medium such as an SD card or an xD picture card.

(15) The video data for display may be processed so as to change the playback speed of the captured video based on the speed of the vehicle.

The playback speed of the captured image can be changed based on the vehicle speed. The vehicle speed should be the speed of the vehicle that captured the image. The vehicle speed should be information based on vehicle speed information, particularly vehicle speed information. The vehicle speed information should be recorded in association with the image data on a medium on which the image data representing the captured image is recorded. The vehicle speed information should be obtained based on GPS (global positioning system) information, vehicle speed pulse information, etc., which are associated with the image data representing the continuously recorded image and recorded on a recording medium together with the image data. The playback speed of the captured image can be changed by changing the time required to capture the image and the time required to play the image. The playback speed can be changed by changing the frame rate of the image when it was captured and the frame rate when it is played back.

(16) It is preferable to process the video data for the above display so as to have a function of slowing down the video playback speed when the vehicle speed is slow compared to the video playback speed when the vehicle speed is fast.

In this way, the image when the vehicle is moving slowly can be clearly seen, and the image when the vehicle is moving quickly is difficult to see. The playback speed of videos taken when the vehicle is slow can be slowed down, making it easier to check videos taken when the vehicle is slow. Since the playback speed of the video when the vehicle is fast is not slow, the playback time of the entire video can be shortened. For example, when the speed of the vehicle is slow, it is particularly preferable to set the time when the vehicle is stopped, and in this way, the image while the vehicle is stopped can be viewed. It is preferable that the speed of the vehicle is high when the speed of the vehicle is faster than a threshold value. When determining whether the speed of a vehicle is slow, it is preferable to determine whether the speed of the vehicle is slow if other vehicles are captured in the video and the speed is slow compared to those other vehicles. In particular, in both control (16), control may be performed to slow down the video playback speed when the vehicle is slow compared to other vehicles. It is preferable to slow down the playback speed of the captured video by making the time required for reproducing the video longer than the time required for capturing the video. The function of slowing down the vehicle may be a function of increasing the number of frames per unit time of the video during playback compared to the number of frames per unit time of the video during shooting. The vehicle may be a vehicle that is photographing a video. For example, when the speed of a vehicle is slow so that information about a stopped vehicle can be obtained, the playback speed may be set to normal speed. When the speed of the vehicle is high, the playback speed may be set to n times the normal speed. It is preferable that n be a value larger than 1.

(17) It is preferable to process the video data for the above display so as to have a function for increasing the playback speed of the video when the vehicle speed is slow compared to the playback speed of the video when the vehicle speed is fast.

In this way, images when the vehicle is moving at a high speed can be clearly viewed, and images when the vehicle is at a slow speed are difficult to view. You can see the video slowly when the vehicle is moving at high speed. For videos taken while the vehicle being photographed is parked, skip playback is recommended because the videos are the same picture. If the video is taken while the vehicle is traveling at high speed, it is best to play it back slowly because the vehicle is moving fast and the video flows quickly. It is a good idea to fast-forward information that is not very necessary, such as images obtained when the vehicle is slow, such as when the vehicle is stopped due to a traffic signal. Browsing can be simplified. It is preferable that the speed of the vehicle is considered to be slow when the speed of the vehicle is slow below a threshold value. When determining whether the speed of a vehicle is slow, it is preferable to determine whether the speed of the vehicle is slow if surrounding vehicles are captured in the video and the speed is slow compared to those surrounding vehicles. In particular, for both controls in (17), it is recommended to increase the video playback speed when the vehicle is slow compared to other vehicles. The function for increasing the video playback speed may be a function that increases the playback speed of the shot video by making the time required for video playback shorter than the time required for video shooting. In particular, the function of increasing the video playback speed may be a function that reduces the number of frames per unit time of the video during playback compared to the number of frames per unit time of the video during shooting. For example, when the speed of the vehicle is high, the reproduction speed may be set to the normal speed or less than 1 times. When the speed of the vehicle is slow, the playback speed may be set to n times the normal speed. It is preferable that n be a value larger than 1.

(18) It is preferable to process the video data for the above display so as to increase the playback speed of the video of the front of the vehicle or the rear of the vehicle.

Playback time can be shortened. In particular, since the video of the front of the vehicle or the rear of the vehicle may not feel strange even if the playback speed is increased, the video playback time can be shortened without causing any discomfort. It is preferable to increase the playback speed of images in front of the vehicle or behind the vehicle without receiving a command to speed up the playback from the user. The playback speed will automatically increase. Whether the image is of the front of the vehicle or the rear of the vehicle may be determined, for example, by image analysis.

(19) It is advisable to process the video data for the above display so as to slow down the playback speed of the lateral image of the vehicle.

You can slowly view images in the horizontal direction. In particular, if the playback speed of the image in the lateral direction of the vehicle is fast, the image may flow and cause a sense of discomfort, but since the playback speed of the image in the lateral direction of the vehicle can be slowed down, this can be avoided, for example. . To slow down the playback speed, for example, it is preferable to make the time required for playback longer than the time required for shooting. Whether or not the image is a lateral view of the vehicle may be determined, for example, by analyzing the image.

It is preferable that the images taken in the vehicle include at least one of an image in front of the vehicle or an image behind the vehicle, and an image in the lateral direction of the vehicle. It is assumed that video data representing such a video is recorded on a recording medium. When an image of the front or rear of the vehicle is captured by a first camera that captures an image of the front or rear of the vehicle, it is recommended that the playback speed of the image obtained by such first camera be increased. . When a lateral image of the vehicle is captured by a second camera that captures an image of the vehicle in the lateral direction, it is preferable to slow down the playback speed of the image obtained by such second camera. When images are captured by a camera that can capture at least one of the front or rear images of the vehicle and the lateral images of the vehicle, the display area is changed in response to a command to change the display area of the images captured by such a camera. It is recommended that It is preferable to increase the playback speed when displaying images of the front or rear of the vehicle. Furthermore, when a lateral image of the vehicle is being displayed, the playback speed may be slowed down. When at least one image of the front or rear of the vehicle and an image of the lateral direction of the vehicle are displayed, the ratio of the display portion of the image of at least one of the front or rear of the vehicle to the display portion of the image of the lateral direction of the vehicle. It is preferable that the video playback speed be determined based on this. For example, when the display portion of at least one of the front and rear images of the vehicle is larger than the display portion of the image in the lateral direction of the vehicle, the video playback speed may be increased. On the other hand, when the display portion of the image in the lateral direction of the vehicle is larger than the display portion of the image in at least one of the front and rear directions of the vehicle, it is preferable to slow down the video playback speed.

(20) It is preferable to process the video data for the above display so that the captured video is played back at the normal playback speed based on a normal playback speed command given when the video is not being played back at the normal playback speed.

By doing this, the video can be viewed at normal playback speed. The normal playback speed command may be given by the user using a button or the like. Further, it is preferable that the occurrence occurs based on a video scene when there is some kind of impact on the vehicle. Furthermore, it is preferable to generate the information based on information recorded in association with the video (for example, so-called historical information such as acceleration information, speed information, information on when the brake was pressed, and information on when the turn signal was activated). The normal playback speed is preferably such that the time required for shooting and the time required for playback are the same. For example, if you are shooting at a rate of 1 frame every 1/30 seconds, it is a good idea to play back at a rate of 1 frame every 1/30 seconds.

(21) It is advisable to process the image data for the above display so that the area for displaying the information about the vehicle obtained while driving the vehicle is large.

Since the area for displaying information about the vehicle becomes larger, the information about the vehicle becomes easier to see. The information regarding the vehicle obtained while driving the vehicle may be data other than video data representing images captured by the vehicle. The vehicle-related information obtained while driving the vehicle may be, for example, the vehicle-related information obtained while driving the vehicle for photographing the video. Information about the vehicle is information obtained by the vehicle that takes the video (for example, map information indicating the location of the vehicle, vehicle acceleration information, speed information, information on whether the brakes are pressed, information on whether the turn signal is activated, etc.). good. It is preferable that the area for displaying information about the vehicle has at least two sizes, a small area and a large area, and a function to make the area larger is preferable. It is preferable that the area in which information about the vehicle is displayed is switched from a small area to a large area in response to a command given from a button or the like that gives a command such as an area expansion command. A default size is determined for the area for displaying information about the vehicle, and it is preferable to make the area larger than the default size. The region related to the vehicle may be enlarged to a predetermined size in response to a command from the user or a command from the system. It would be good to have a function other than the function of enlarging a window by dragging it. It is preferable to enlarge the area related to the vehicle in response to a command from a button such as an area expansion command. When an area for displaying images shot in a vehicle and an area for displaying information about the vehicle are defined in a window, it is preferable to make the area larger than the default size of the area for displaying information about the vehicle. Although it is best not to change the size of the area where the video is displayed, it is especially good to change it.

(22) It is preferable to process the video data for the above display so that the area for displaying information about the vehicle is larger than the area for displaying images shot in the vehicle.

The area displaying information about the vehicle is larger than the area displaying the image, making it easier to see information about the vehicle than the image.

The information about the vehicle may be information obtained by the vehicle capturing the image (for example, so-called historical information such as map information showing the vehicle's position, vehicle acceleration information, speed information, information on whether the brakes have been applied, and information on whether the turn signals have been turned on). Usually, the area displaying information about the vehicle may be made smaller than the area displaying the image captured by the vehicle, and the area displaying information about the vehicle may be made larger than the area displaying the image captured by the vehicle upon receipt of a command from the user or the system. The image captured by the vehicle may be displayed in a relatively large area, and information about the vehicle may be displayed in a relatively small area, and upon receipt of a command from the user or the system, the image captured by the vehicle that was displayed in the large area may be replaced and displayed in a small area, and information about the vehicle that was displayed in the small area may be replaced and displayed in a large area. The image captured by the vehicle may be displayed in a relatively large area, and information about the vehicle may be displayed in a relatively small area, and upon receipt of a command from the user or the system, information about the vehicle may be displayed in an area even larger than the relatively large area displaying the image captured by the vehicle. It is preferable to display the image captured by the vehicle in a relatively large area and display information about the vehicle in a relatively small area, and then, upon command from the user or the system, display the image captured by the vehicle in an area that is even smaller than the relatively small area. It is preferable that the information about the vehicle be displayed in an area that is relatively larger than the image captured by the vehicle.

(23) It is advisable to process the video data for the above display so that the vehicle acceleration over time is displayed in three dimensions according to the time at which the video was captured.

By doing this, the acceleration is easier to see. The vehicle acceleration should be the acceleration of the vehicle that captured the image. The vehicle acceleration should be displayed in three dimensions by displaying a three-dimensional space with degrees of freedom in each direction of width, depth, and height as if it were a plane. Data representing the acceleration should be recorded on a recording medium in association with video data representing one image. Video data representing one image should be included in one video file. The entire acceleration represented by data recorded on a recording medium in association with video information representing one image should be displayed in three dimensions. The origin representing the vehicle acceleration at the start of filming should be the same as the point in time representing the vehicle acceleration at the end of filming. A portion of the vehicle acceleration from the start to the end of filming should be displayed.

(24) The video data for the above display may be processed so that the acceleration in front of the vehicle is displayed on a first axis of a three-dimensional graph, the lateral acceleration of the vehicle is displayed on a second axis of the three-dimensional graph, and the vertical acceleration of the vehicle is displayed on a third axis of the three-dimensional graph.

By doing this, it becomes easier to see the acceleration. The first axis, the second axis, and the third axis are preferably perpendicular to each other. Vehicle acceleration can be understood relatively easily. It is preferable that the first axis is defined from the back to the front or from the front to the back, the second axis is defined in the width direction (rightward or leftward), and the third axis is defined upward or downward. It is preferable that the first axis is the X axis, the second axis is the Y axis, and the third axis is the Z axis.

(25) It is preferable to process the video data for the above display so that information regarding the vehicle is displayed superimposed on the video.

Vehicle-related information is easier to see. The vehicle-related information should be information available from the vehicle capturing the video (for example, so-called historical information, such as map information showing the vehicle's position, vehicle acceleration information, speed information, information on whether the brakes have been applied, and information on whether the turn signals have been activated). When displaying vehicle-related information superimposed on the video, it is recommended to erase the area in which the vehicle-related information is displayed. When displaying vehicle-related information superimposed on the video, it is recommended to display the video in a larger area than when vehicle-related information is not superimposed on the video.

(26) The video data for the above display may be processed so that an image of a vehicle is displayed within the frame, and vehicle acceleration information is displayed within the frame in which the image of the vehicle is displayed.

Information on the acceleration of the vehicle is displayed within the frame in which the image of the vehicle is displayed, making it relatively easy to understand the acceleration of the vehicle. It is preferable to display the acceleration in the direction of travel of the vehicle on the front side of the vehicle represented by the image. Additionally, it is preferable to display the lateral acceleration of the vehicle on the side (left or right) of the vehicle represented by the image. Furthermore, it is preferable to display the vertical acceleration of the vehicle above or below the vehicle represented by the image. It is preferable to display information on the acceleration of the vehicle within the frame in which the image of the vehicle is displayed so that the arrow points in the positive direction of acceleration. For example, when acceleration is occurring in the direction of travel, the arrow points in the direction of travel, when acceleration occurs in the backward direction, the arrow points toward the rear, and when acceleration occurs in the left direction, the arrow points toward the left. When acceleration is occurring in the right direction, the arrow points to the right, when acceleration occurs in the upward direction, the arrow points upward, and when acceleration occurs in the downward direction, the arrow points downward. It's good to do that.

(27) In the above system whose performance does not satisfy the specified conditions, the video data for the above display may be processed so as to notify the user that the system does not have the capability to process the video data for the above display.

It is known that the system does not have the capacity to process video data for display. In systems whose performance does not meet specified conditions, it can be notified that the system does not have the capacity to process video data, and there is no problem with the video or the device that captures the video. For systems whose computer or central processing unit (CPU) does not meet specified conditions, it is advisable to notify that the system does not have the capacity to process video data for display. The specified condition may be a performance that causes dropped frames when displaying video captured in the vehicle.

(28) The video data for display may be processed so as to be played back from a predetermined playback position in response to a command to move the playback position of the video.

By doing this, for example, it becomes possible to skip the video portion up to a predetermined playback position and play it back. You can quickly play back the part of the video you want to check. The predetermined playback position may be a position that satisfies specific conditions. The location that satisfies the specific condition may be a location that includes a specific scene or a predetermined location. For example, the location where a specific scene is included may be determined by analyzing a video shot in a vehicle, such as the location of a scene where a specific subject such as a specific person, object, or building is included. It is preferable to determine the position where a specific scene is included by video analysis in advance before playing the video. In particular, it is advisable to store the determined position in association with the video. The predetermined position may be determined based on information regarding the vehicle. For example, it may be the location of a scene where a specific situation that occurred in the vehicle, such as sudden braking or sudden start, occurs. Information about the vehicle includes information obtained by the vehicle that captures the video (for example, map information indicating the location of the vehicle, vehicle acceleration information, speed information, information on when the brake was pressed, information on when the turn signal was activated, etc.) information).

(29) The video data for the above display may be processed so as to display the current playback position and the predetermined playback position.

The current playback position and the specified playback position are known. When playing back video at a specified playback command in response to a video movement command, it is possible to know which part of the entire video will be played. For example, it is a good idea to display a playback bar or seek bar indicating the playback position of the video, and to display a mark such as a line indicating the specified playback position on such a bar.

(30) It is preferable to process the video data for the above display so as to change the display mode of the predetermined playback position determined based on the analysis of the video and the display mode of the predetermined playback position determined based on the information about the vehicle obtained when the video was captured.

By looking at the display of the playback position, it can be determined whether the playback position is a predetermined playback position determined based on video analysis or a predetermined playback position determined based on information about the vehicle obtained when the video was shot. The predetermined playback position determined based on video analysis may be, for example, a position obtained by analyzing a video scene that includes a scene of a predetermined person or building. The playback position determined based on information about the vehicle is determined from so-called historical information such as map information indicating the vehicle's position, vehicle acceleration information, speed information, information on when the brake was pressed, and information on when the turn signal was activated. It is best to choose a position where it can be obtained. The information regarding the vehicle may be acquired at the time of shooting the video, and may be obtained separately from the video. For example, the color (e.g., red) and shape (e.g., triangle) of a mark displayed at a predetermined playback position determined based on video analysis, and the mark displayed at a playback position determined based on information about the vehicle. It is preferable to change the color (for example, green) and shape (for example, circular) of the mark displayed.

(31) The video data for the display may be processed to limit the transmission of video data representing images captured in the vehicle.

By doing so, when a function for transmitting video data is provided, the amount of video data to be transmitted can be relatively reduced. When the system is installed in a vehicle and the system installed in the vehicle transmits video data, it is preferable to restrict the transmission of video data. Furthermore, when transmitting video data from a system installed in a vehicle through a telephone line, it is preferable to restrict the transmission of video data. It is preferable to limit the transmission of video data by limiting the number of transmissions. It is better to detect whether the number of transmissions has been reached. Furthermore, it is preferable to limit the transmission of video data by limiting the amount of video data to be transmitted. It is a good idea to detect whether the data limit has been reached. When the transmission of video data is restricted, it is preferable to transmit the video data using a transmission method that does not require transmission costs or is inexpensive.

(32) It is preferable to process the video data for display as described above so as to detect the amount of video data transmitted representing the video shot in the vehicle.

The amount of video data transmitted can be detected. When transmitting video data representing images taken in each of a number of vehicles from each vehicle, it is advisable to detect the amount of video data transmitted from each vehicle. It is advisable to have a function for displaying the detected amount of transmission. In particular, it is advisable to have a function for displaying a list of the amount of transmission from each of a number of vehicles. The list display should be displayed in order of the amount of transmission, either large or small. For example, a ranking of the amount of transmission can be obtained, and the vehicles with the largest amount of transmission can be identified. In a company that owns multiple vehicles, it is advisable to detect the amount of video data transmitted from each vehicle, representing images taken in each of the multiple vehicles. It can be determined which vehicle in the company's vehicles transmits the largest amount of video data.

(33) Perform a communication speed test before recording video data representing images taken in a vehicle, and process the video data for the above display so that the video data is transmitted under the conditions obtained based on the communication speed test. It's good to do that.

Video data can be transmitted under conditions obtained based on communication speed tests. For example, it is preferable to determine the video recording resolution, frame rate, bit rate, etc. based on the transmission speed based on a communication speed test, and then transmit the video data. If a communication error occurs during communication, it is recommended to perform the communication speed test again, change the conditions, and then transmit the video data. The process of transmitting the video data under the conditions obtained based on the communication speed test may be a process of processing the original video data so that the rate of the video data is lowered as the communication speed becomes relatively slower.

(34) When an image taken in a vehicle differs from an image that can be visually recognized by a human, the above-mentioned display is displayed so as to at least either notify or record that there is an image that is different from an image that can be visually recognized by a human. It is recommended to process video data for

By doing this, it can be seen that the captured video is different from the video that humans can actually see. For example, it can be seen that the image that was visible to the driver of the vehicle and the recorded image are different. Therefore, for example, when a video of an accident or the like occurring is played back, it can be seen that the video may not have been visible to the driver. As a result, for example, the police, court, insurance company, etc. can use this notification or recorded information to determine whether or not the driver was negligent at the time of the accident. For example, when it is possible to attach a polarizing filter to a camera that takes images, it is possible to record or record the image so that it can be seen whether the image was taken with the polarizing filter attached or without the polarizing filter attached. It is preferable to perform at least one of the notifications. For example, it is preferable to install a switch on the camera that takes the image and detect the state of the switch to determine whether the image was taken with a polarizing filter attached. Furthermore, it is preferable to detect whether the image was shot with a polarizing filter attached by analyzing the shot image. For example, it would be a good idea to analyze the video and detect whether the video was taken with a polarizing filter attached, based on how things like the dashboard are reflected in the window glass.
In addition, for example, when an image taken in a vehicle is not an image that can be visually recognized by a human, the video data for the above display may be processed to notify that the image is not obtained in a state that is visible to a human. You can also do this.

(35) It is preferable to process the video data for the above display so as to communicate with a videophone device.

The system can be used as a videophone device. When the system is installed in a vehicle, the system installed in the vehicle can be used as a videophone device. The system should have a function for sending and receiving video data with the videophone, and a function for sending and receiving audio data with the videophone to make a call. The system should have a function for recording on a recording medium, and record audio data, video data, etc. indicating the contents of a call made on the videophone on the recording medium.

(36) It is advisable to process the video data for the above display so as to display multiple images of the movements of a particular person in succession.

By doing so, multiple images related to the movements of a specific person can be displayed in succession. For example, a series of videos of a specific person, such as footage before a specific person gets into a vehicle and drives the vehicle, footage of the specific person driving the vehicle, and footage after the specific person drives the vehicle, are It is best to display the video continuously as a video representing the action. You can check whether a specific person is behaving appropriately. For example, it would be good to display a driver's movements throughout the day in succession, such as a video of him before leaving the office, a video of him driving, and a video of him returning to the office. For example, when multiple videos are represented by multiple video data, those multiple video data are identified by an ID that identifies a specific person, and the multiple data identified by that ID are arranged in the order of recording time of the video data. It is best to display them continuously.
The function of continuously displaying multiple videos related to the movements of a specific person is often used to identify a person through image recognition, such as whether a person in a captured video resembles an image of a person registered in advance. It is often possible to play back parts of a video in which a specific person is shown in succession, or to play back different files of the video in which the specific person is shown in chronological order, or to It is often useful to extract and play a portion of a single file of a video, or to play a combination of these, especially when video files shot at different times of the day are played continuously. It is a good idea to process it.

(37) It is preferable to process the video data for the display, which represents the video captured in the vehicle, so that the video data recorded on the first recording medium is different from the video data recorded on the second recording medium.

By doing so, different images can be obtained. The image data recorded on the first recording medium and the image data recorded on the second recording medium may be shot at the same time. For example, image data representing a processed image of a celestial image may be recorded on the first recording medium, and image data representing an image closer to a raw image than the processed image may be recorded on the second recording medium. The processed image may be a partially cut-out image or a coordinate-transformed image. The image closer to the raw image may be a RAW image or a compressed image. The image data representing a forward image may be recorded on the first recording medium, and the image data representing a rearward image may be recorded on the second recording medium. The image data recorded on the first recording medium and the image data recorded on the second recording medium may be played back with their shooting times synchronized. The image represented by the image data recorded on the first recording medium may be displayed in the first window, and the image represented by the image data recorded on the second recording medium may be displayed in the second window. The image displayed on the first window and the image displayed on the second window may be displayed in a synchronized manner. It is advisable to record information on what kind of processing has been performed on the processed image, for example, the processing contents such as the frame-removal range performed on the RAW image and the contents of the coordinate system transformation, and to display the corresponding range of the processed image in the RAW image with a dashed line, etc. When the system is a drive recorder installed in a vehicle, it is advisable to generate the processed image and an image closer to the raw image than the processed image in the drive recorder. Also, when the system is not a drive recorder installed in a vehicle but a personal computer, it is advisable to generate the processed image and an image closer to the raw image than the processed image in the personal computer.

(38) It is advisable to provide the system with a button that issues a command to upload to a server, and to process the video data for the above display so that video data representing the video captured in the vehicle is uploaded to the server in response to a command from the button.

In response to a command from the button, video data representing video captured in the vehicle can be uploaded to a server. The system is preferably installed in the vehicle. If the system has a function for recording video data, the video data can be sent to the server before recording. Also, the video data can be sent to the server while recording. Furthermore, the recorded video data can be read out and sent to the server. The position of the video data when the command from the button is received can be recorded, and when the video data is played back, the position of the command from the button can be displayed together with a map using an icon or the like. When such an icon or the like is clicked, an image represented by the uploaded video data can be displayed. An image represented by the video data stored in a storage location identified by a uniform resource locator (URL) can be displayed.

(39) It is preferable to process the video data for display as described above so that the video is shot in the vehicle based on a shooting command from outside the vehicle where the video is shot.

Photography can now be performed in the vehicle based on a photographing command from outside the vehicle. For example, when the system and a mobile phone that can communicate with the system are both in the vehicle, a server outside the vehicle sends a shooting command to the mobile phone, and the mobile phone that receives the shooting command is placed inside the vehicle. It is preferable to send an imaging command to the system, and the system that receives the imaging command to start imaging. For example, a smart speaker is installed at the business office of a company that owns a vehicle, and the smart speaker is used to send trigger data for a shooting command to a specific driver's cell phone. It is preferable to send the trigger data for the photographing command from the telephone to the system installed in the vehicle driven by the particular driver. When recording video data obtained by shooting based on trigger data, it is recommended to set a trigger name. It is preferable to display the set trigger name when playing the video. For example, the trigger name may be displayed as "Voice photography trigger from manager A to driver X". For example, a lot of trigger data is sent from various managers to a popular driver or a driver who drives dangerously.

(40) The video data for display may be processed so as to display the recording frame rate and the display frame rate of the video shot in the vehicle.

You can see the frame rate of video recording and the frame rate of display. A frame complement function may also be provided. Data representing the frame rate of the video is preferably recorded in association with the video data.

(41) It is advisable to process the image data for the above display so as to give the robot operating instructions based on playback of the image captured in the vehicle.

The robot will move based on the video playback. For example, while replaying a scene where an impact occurs, it would be a good idea to give a robot, such as a communication robot, a command to move so that it is likely to fall over. The robot behaves like it's about to fall over. It is best to give a motion command that causes the robot to fall over. It is also a good idea to give a motion command for a fallen robot to get up. Furthermore, it would be good if the robot could give warnings about driving, such as scolding the driver by saying, ``Don't drive dangerously,'' or giving movement commands. It would be a good idea to keep a robot at a driving school or other place and have the robot scold the child instead of the driving school instructor. It would also be a good idea to have robots at bus companies and transport companies and have them scold them in place of the bus company's and transport company's operation managers. If the operation manager scolds the robot, there will be an uproar, but if the robot scolds the robot, it won't have much of an effect on human relationships. When you want the robot to perform an action, the system sends an action command to the robot that describes the desired action, and the robot receives the action command to cause the robot to operate.

(42) It is advisable to process the image data for display so as to output a file for presentation software relating to the image captured in the vehicle.

A presentation software file is obtained. There is a file based on the presentation software, and it is good to output a file that evaluates the vehicle's driving performance based on the video and displays the score for the vehicle's driving.

(43) It is preferable that the image captured in the vehicle is a spherical image, and that the image data for the above display is processed so that the spherical image is displayed in the virtual reality space.

You can view spherical images in virtual reality space. It is recommended that spherical images be captured using a camera that can capture images in all directions: upward, downward, left, right, forward, and backward.

In the virtual reality space, it is a good idea to place the screen of the video playback app, PC viewer, etc. as part of a plane (board) or a gentle cylindrical surface (or gentle sphere) in three-dimensional space. This is possible. When the dual-screen display button on the PC viewer is pressed, it is a good idea to display one side as the PC viewer operation section and the other as the playback video.

It is advisable to provide a display button that expands (texture mapping) a spherical image over the entire interior of the sphere, starting from the place where the person is in the VR space. By pressing this button, you can view the video as if you were actually inside the car. It is best to display the ball at the back of the window. Further, it is preferable to hide all windows so that the display state is as if the user is completely inside the car. It would be a good idea to be able to switch between the two companies using a button on the controller. It is also a good idea to display the ball in front of the window. It is a good idea to change your position to the outside of the ball, move forward, go outside the ball, and operate the operation window. For example, it is a good idea to expand the image outside the sphere while it is outside the sphere. In this way, the image can be viewed from outside the sphere. Instead of developing it into a perfect sphere, it is better to map it onto a curved surface that is set to correct distortions in optical systems such as lenses. It is preferable to have a function to make the spherical surface on which the image is projected semi-transparent. It would be a good idea to make it semi-transparent by pressing a button on the controller. It is best to change the origin position and the radius of the sphere by moving the left and right sticks of the controller up and down. Thumbnail displays, map displays, acceleration graphs, etc. may be arranged as independent panels in the three-dimensional space inside the sphere. It is preferable to configure a controller so that playback control functions such as playback, stop, and next event can be performed.

(44) A system is installed in the vehicle, and the video data for display is preferably processed so that the system operates based on audio data transmitted from outside the vehicle.

By doing so, the system installed in the vehicle can be operated based on audio data transmitted from outside the vehicle.

It is a good idea to operate a system such as a drive recorder using a smartphone etc. in the vehicle. If the vehicle is near your home and you can receive radio waves such as WiFi, you can operate the vehicle by transmitting voice data from a smartphone, smart speaker, communication robot, dedicated device, etc. in your home. When you say "Stream video from my dash recorder" to a voice recognition device (smartphone, smart speaker, communication robot, etc.), the dash recorder will turn on and the video from "your" dash recorder will be streamed via wireless such as WiFi. It is a good idea to play the video on a TV. If the vehicle's engine is off, it is best to use battery power.

If you say "Play the footage from yesterday's dashcam," it will search for yesterday's dashcam footage on the dashcam or on the storage device (smartphone or PC) that stores data transferred from the dashcam, and if it is found, it will be played. If not, you can say "No dashcam footage from yesterday was found." It is also good to play the footage from the nearest dashcam instead, such as "I will play the dashcam footage from the day before yesterday instead." If you say "Play the dashcam footage from when I just went out," it will play the footage from the most recent dashcam.

When playing back the drive recorder, it is preferable to play back the audio recorded along with the drive record video, but it is also possible to provide a function to play back other music or the like as BGM. If you say, ``Set the background music to ___,'' it would be a good idea to change it to the drive recorder audio and play the song along with the video on a music streaming service such as Spotify. It is best to perform digest playback, focusing on the parts where events occur. It would be good to be able to specify the playback time, such as ``Play the video on the drive recorder in about 5 minutes.'' At this time, for example, the videos may be played back at a specified time. It is preferable that unplayed videos are played back with priority.

When the system recognizes a voice command to "keep this footage" while the dashcam is playing back video, the video file being played back is transferred from the dashcam to a storage device (such as a smartphone or PC) via WiFi or other means. It can also be shared by uploading it to a video sharing SNS.

When the dashcam recognizes the voice command "Keep this footage" while recording video, the dashcam can record the recorded footage from a specified time before that point and the video data from that point to a specified time ahead using WiFi or other means as a video trigger.

When a voice saying "Send video" is recognized while the drive recorder is "recording" video, the recorded video from a predetermined time before that point and the video data from that point are sent to the server, etc. using LTE, etc. It's a good idea to send it. It is a good idea to upload and share the video on SNS. When the voice saying "Stop video transmission" is recognized, it is preferable to stop transmitting the video to the server or the like. If a voice saying ``Send me the video up to this point'' is recognized while the video on the drive recorder is ``recording,'' it is a good idea to upload the recorded video from a predetermined time before that point to the video server using LTE, etc. It is a good idea to upload and share the video on SNS. When you say ``Start live streaming'' in front of the drive recorder, it is a good idea to start live distribution of the drive recorder video.

(45) There are multiple videos taken in the vehicle, and it is preferable to process the video data for the above display so that the display mode of the thumbnail image is changed for each video.

By doing this, when there are multiple videos, the display mode of the thumbnail image can be changed for each video.

It is recommended that the system has a function for changing the display method and display range of thumbnails "for each individual thumbnail." For example, right-clicking on an individual thumbnail should display a pop-up menu for selecting the display method of the clicked thumbnail. Types of thumbnail display methods may include, for example, fisheye display, panorama display, enlarged flat display, ring display, and dome display. In addition, original, twin cut, panorama cut, and angle cut should be provided. Left-clicking on an individual thumbnail should change the display range of the image. A "180 degree rotation" and "90 degree rotation" menu should be provided in the right-click menu. In the case of two cameras, a "camera switch" option should be provided.

It is recommended to provide a function to save the changed thumbnail display method and display range. It is recommended to configure it so that the state of the changes made is maintained. It is recommended to provide a function to undo and redo changes to the thumbnail display method and display range. It is recommended to provide a function to align the thumbnail display method and display range between thumbnails. It is recommended to draw a selection frame around the thumbnail when left-clicking while holding down the shift key. When there are multiple selection frames, it is recommended to right-click on any thumbnail and change all thumbnails with selection frames to the display method selected in the pop-up menu that appears. Also, when there are multiple selection frames, it is recommended to left-drag any thumbnail and change the state of all thumbnails with selection frames in the range displayed by that thumbnail in real time in conjunction with each other. It is recommended that the selection frame is released (selection state is released) when the left click on a part other than the thumbnail is released. It is recommended to provide a row that displays thumbnails that are considered to be from the same time (for example, the same frame) but have different thumbnail display methods or display ranges. For example, with a 360-degree x 2 camera, a first row of thumbnails with a fisheye view of 360 degrees forward and a second row of thumbnails with a fisheye view of 360 degrees backward can be provided, and thumbnails of the same time can be drawn in the same column. The number of thumbnail rows can be increased as desired. Thumbnails can be increased by providing a space between the rows in the thumbnail display section, right-clicking on the space and selecting "Insert Row" from the pop-up menu that appears. This pop-up menu can also have items such as "Delete Upper Row" and "Delete Lower Row". Rows or columns that exceed the display range of the screen can be scrolled using a scroll bar. For example, with a 360-degree x 2 camera, 10 rows of thumbnails can be created, and from the top, they can be displayed as follows: front fisheye display, rear fisheye display, panorama display centered on the front, panorama display centered on the rear, enlarged flat display centered on the bottom, enlarged flat display with the top cut off, ring display with the front as the most visible part, ring display with the rear as the most visible part, dome display with the front as the most visible part, and dome display with the rear as the most visible part. All of these types of images will be displayed at the same time in the same column. You can also scroll left and right to move the columns left and right and see the entire thumbnail.

It is a good idea to provide a function that plays the image of a thumbnail when the thumbnail is selected by double-clicking the left mouse button, and it is especially good to start playback in the display method and display range set as the thumbnail. A "Set this state as thumbnail" option should be provided in the pop-up menu that appears when you right-click in the playback window, and when this is selected, the image in the display method and display range at that time should be set as the thumbnail for that image. Thumbnail display is when an area is set up to display the original image corresponding to the thumbnail that was right-clicked, and a function is provided to clearly indicate the display area of the current thumbnail within that original image (by surrounding it with a line, filling it with semi-transparent paint, etc.). In this way, it is easy to see which part of the original image is set as the thumbnail.

In relation to "Improving image quality and connection accuracy," it would be good to have a function that clearly indicates "parts where images are connected." For example, you can draw a red line on the stitched part. As the stitching accuracy increases, the joints become harder to see. You don't want to use seams in commercial photography, but if it becomes difficult to see, you might end up cropping across the seams. It may be a problem if a broken joint is discovered after delivery, such as after commercial printing, but such problems can be prevented.

In relation to ``reducing reflections on the main body'', it is good to have a ``function that clearly shows the reflected parts of the main body''. For example, the area corresponding to the main body portion may be shaded or filled in semi-transparently. In connection with "automatic face recognition & blurred shooting", it is recommended to provide "an area for displaying whether or not the image has been blurred" on the viewer screen. It is preferable to display an icon indicating that the video being played is a blurred image. Additionally, it is preferable to display an icon or the like indicating that the image is a blurred image in the list of file names. Related to "wireless live streaming", it has a function to record along with live streaming, stores information that allows you to know which recorded video is being streamed, and performs live streaming when playing recorded video on a viewer. It is preferable to have a function to display whether or not it has been done. It is a good idea to simply record what was live-streamed and what was not live-streamed in separate files, and to store information on whether or not it was live-streamed in the file properties. In particular, within one file, it is preferable to record the live streaming range and the non-live streaming range in a distinguishable manner, and display the two areas on the timeline so that they can be distinguished. In relation to "time-lapse photography," it would be a good idea to add information that identifies the video as time-lapse photography and record it, and to have a function that displays whether or not it was time-lapse photography when played back on the viewer. . It would be good to have a function that handles a series of time-lapse images as one set. Regarding the "SmartDevice", it would be good to have a function to add and record information on the video, such as from which device the recording start/stop recording instruction/setting instruction came, and a function to display this information on the viewer. It would be good if the "SmartDevice" had a function to operate the parts corresponding to the buttons on the viewer using voice recognition, especially a function to change the display method and display range. It is also preferable to have a function to change the recording method and recording range using voice recognition.

(46) When communicating video data representing images captured in a vehicle using a device mounted on the vehicle, the video data for the display may be processed so as to communicate using a different communication method other than changing the communication speed depending on the type of communication contract.

By doing this, it becomes possible to communicate using different communication methods depending on the type of communication contract.

For example, a drive recorder for corporate use could have a function that supports a variety of communication fee plans depending on how the company uses its vehicles.

Examples of features that are good for a low-speed flat-rate unlimited plan that costs 300 to 500 yen per month include the following. For example, it would be good to have a function that supports SIMs that cannot communicate at high speeds and are around 200 kbps. With 200 kbps, it is possible to send voice and still images (jpeg) at a speed faster than real time. Even monaural 64 kbps has sufficient sound quality to determine whether the sound is from an accident. Therefore, past data can be transmitted in a time shorter than real time. It is also good to have a function that calculates the bit rate that will make the time shorter than real time by combining past data from the current (most recent history, etc.) communication bit rate or the SIM's contract bit rate, and compresses and sends it at that bit rate. It is also good to have a function that sends past data in a compressed file and current data by streaming (IP phone is also good). It is also good to have a SIM that has a data limit of up to a certain amount of data in a certain period of time, such as 366 MB in three days. For example, it is good to have a function that displays the remaining transferable capacity on the dashcam and viewer. As an example, it would be good to display 10MB of 366MB usage (356MB remaining until December 26th). When you are approaching your data limit, it is a good idea to limit the type of information you send. For example, you could change it so that no photo data is sent and only audio data is sent. For a low-speed dedicated SIM card that is capable of burst transfers (burst function: the first 1-2 seconds will produce a few Mbps), you could start sending when an event occurs by sending several photos (even just one photo would be fine) from different points in time related to the event, and then send the audio data. It is good to transfer photos in bursts.

Functions that support night-time specialized plans should be as follows. One example of a "night-time specialized plan" is one in which download and upload speeds are limited to a maximum of 200 kbps between 6:00 and 22:00, but high-speed communication is possible at night from 22:00 to 6:00, with download speeds of up to 375 Mbps and upload speeds of up to 50 Mbps. It should be possible to set times when high-speed communication is possible or times when communication is restricted, and it should have a function that allows videos to be uploaded during times when high-speed communication is possible. In particular, it should have a function that automatically turns on the power to the dashcam of a vehicle that is parked with the engine off during times when high-speed communication is possible, and begins transmitting video data.

The following functions are recommended for use with upstream-only plans. One example of an "upstream-only plan" is a plan that limits the downstream data communication speed to a low maximum of 200kbit/s, but ensures a wide upstream data communication speed for sending data of a maximum of 50Mbit/s. Since it is likely that downstream IP telephone bandwidth can be secured, it is recommended that the server be equipped with a function that restricts communication to instruction commands and downstream IP telephone communication. In other words, even if the dashcam has a function for receiving video footage from other dashcams, for example, it is recommended that this function be restricted.

The following functions may be suitable for corporate share plans. Especially for corporate plans, it is recommended to use a data sharing plan that allows 50 GB to be shared among 20 lines, for example.

It is recommended to have a function to scrape or obtain information from the management screen provided by the SIM provider via API, count the usage of the SIM in the dashcam, obtain the information at the center, and display it in the viewer. It is also recommended to have a function to display information comparatively. It is also recommended to have a function to display the total packet usage and remaining available capacity of the dashcams that share packets in the viewer. It is also recommended to have a function to issue an alert when the remaining capacity is low, and to display a graph of the predicted capacity usage. It is also recommended to have a function to display the individual packet usage and remaining available capacity of the dashcams that share packets in a ranking in the viewer. For example, by looking at the event status of the vehicle with the top dashcam, it is easy to verify whether the driver is driving poorly or the dashcam settings are poor. For companies that have multiple sharing groups, it is recommended to have a function to display the usage status between the sharing groups. In this way, it can be used as a reference for optimizing the allocation of SIMs of each dashcam to each group. It is also possible to use automatic analysis such as AI to give advice to move a specific SIM to another group. It would be a good idea to display the file size in the selection field for what the viewer displays.

If you have an SMS-compatible SIM, it is recommended to do the following. It is recommended that when a trigger occurs, a function is provided to generate a string that includes information about the severity of the trigger factor, such as maximum G, and send this via SMS to the center phone number. The center (e.g. a viewer) should then decide whether or not to send a transmission request instruction to the dashcam based on the SMS data. The center should then decide information such as the type of data to be sent, such as video, and the transmission range, and send a transmission request instruction to the dashcam.

If your SIM supports voice calls, you can do the following. It would be a good idea to equip the drive recorder with a voice call function and equip the center with a function to transfer outside calls made to the center (sales office). The center should have a function that obtains the operating status of the drive recorder using LTE, etc., and prevents outside line transfers under set conditions, such as when the vehicle is in motion. It is also a good idea to equip the drive recorder with a function that calls the center using the appropriate method based on the situation of the drive recorder, such as comparing charges between IP phones and voice calls, the other party to call, past driving history, etc. It would be good to have a function that allows calls to be made by voice in the event of a strong shock, or by IP phone in the case of a weak shock, and a function to communicate with the center using VoIP and connect to an outside line by telephone.

When using public Wi-Fi and LTE at the same time, it is recommended to do the following: Equip your device with the ability to connect to public Wi-Fi, send restricted data over LTE, and send unrestricted or loosely restricted video data over public Wi-Fi. It is also a good idea to have the ability to upload from free Wi-Fi at convenience stores, etc.

(47) It is preferable to obtain information regarding the posture of the device held by the user's hand and process the image data for the display so as to change the display range of the image data based on the information regarding the posture.
In this way, the user can change the display range of the captured image data by changing the position of the device held in the hand. In particular, the device may be a smartphone, the image may be an image from a celestial camera, and when the smartphone is tilted or rotated based on information from the smartphone's gyro or G sensor regarding the viewpoint of the celestial camera, the viewpoint of the image may be switched to that direction.
(48) It is preferable that the program be a computer-readable program that controls a computer of the system described in any one of (1) to (47) above.

By processing the video data for display, we can provide something better than ever before.

The displayable system may be, for example, a personal computer, a smartphone, a drive recorder, or the like. Processing of video data for display includes, for example, processing for video playback, processing for video data transmission, processing for adjusting video brightness, processing for changing the video playback format, and reducing the amount of video data. It is better to use processing.

(49) A method for controlling a system capable of displaying images shot in a vehicle, which may include a means for processing image data for the display.

By processing the video data for display, we can provide something better than ever before.

The displayable system may be, for example, a personal computer, a smartphone, a drive recorder, or the like. Processing of video data for display includes, for example, processing for video playback, processing for video data transmission, processing for adjusting video brightness, processing for changing the video playback format, and reducing the amount of video data. It is better to use processing.

The inventions shown in (1) to (47) above can be combined arbitrarily. For example, at least a part of the structure of at least one invention described in (2) and subsequent ones may be added to all or part of the structure of the invention shown in (1). In particular, it is recommended that the invention be an invention in which at least a part of the structure of at least one invention following (2) is added to the invention shown in (1), (48), or (49).

In addition, any configuration may be extracted from the inventions shown in (1) to (47) and the extracted configurations may be combined. The applicant of this application intends to obtain rights to inventions including these configurations.

This invention can provide a better display than ever before by processing video data for display.

The effect of the invention of this application is not limited to this, and the effect achieved from the configuration disclosed in the specification and drawings, etc. is also disclosed, and the intention is to obtain rights for the configuration achieving said effect through divisional application, amendment, etc. For example, in this specification, the part that states "can..." is a description that clearly indicates the effect achieved, and there are parts that show the effect even without the description "can...". Also, there are effects that can be understood from the configuration even without such a description.

FIG. 3 is a perspective view of the drive recorder seen from the back. The photo shows the interior of a vehicle equipped with a drive recorder. FIG. 2 is a block diagram showing an electrical configuration of the drive recorder. 3 is a time chart of event recording video data and transmission video data. It is a flowchart which shows a transmission processing procedure. 13 is an example of a recording setting window. FIG. 2 is a block diagram showing the electrical configuration of a personal computer. 3 is a flowchart showing a processing procedure of a personal computer. 3 is a flowchart showing a reproduction processing procedure. 13 is a flowchart showing a brightness correction process procedure. It is a flowchart which shows the brightness stop processing procedure. This is an example of a playback window. This is an example of a playback window. 13 is an example of an image before brightness correction. This is an example of an image after brightness correction. 13 is an example of an image before brightness correction. This is an example of an image after brightness correction. This is an example of an image before brightness correction. 13 is an example of an image after brightness correction. 1 is an example of a brightness correction curve. This is an example of a brightness correction curve. This is an example of a processing procedure for displaying a separate window. 1 is an example of a playback window. 1 is an example of a playback window. 13 is an example of a processing procedure for displaying a video on a separate display screen. This is an example of a playback window and a video display window displayed on separate display screens. This figure shows how to use a playback window and a video display window that are displayed on separate display screens. 13 is a flowchart illustrating an example of a playback process procedure. This shows the relationship between vehicle speed, playback speed, and video time. It is an example of a flowchart showing a reproduction processing procedure. It is an example of a flowchart showing a video analysis processing procedure. 13 is an example of a flowchart illustrating a video analysis process procedure. 13 is a flowchart illustrating an example of a playback process procedure. It is an example of a flowchart showing a reproduction processing procedure. It is an example of a flowchart showing a processing procedure of a personal computer. 1 is an example of a playback window. 1 is an example of a playback window. 1 is an example of an acceleration graph. This is an example of a playback window. 1 is an example of a playback window. 1 is a flowchart showing an example of a processing procedure of a personal computer. 13 is an example of a flowchart illustrating a video analysis process procedure. 1 is a flowchart showing an example of a processing procedure of a personal computer. This is an example of a playback window. 11 is an example of a flowchart showing a first skip playback process procedure. 11 is an example of a flowchart showing a second skip playback process procedure. 13 is a flowchart illustrating an example of a transmission process procedure. It is an example of the flowchart which shows a ranking display processing procedure. This is an example of a ranking display. 13 is a flowchart illustrating an example of a recording process procedure. It is an example of the flowchart which shows a recording processing procedure. It is an example of a flowchart showing a reproduction processing procedure. 13 is a flowchart illustrating an example of a videophone recording process procedure. 13 is a flowchart illustrating an example of a playback process procedure. 13 is a flowchart illustrating an example of a recording process procedure. 13 is a flowchart illustrating an example of a playback process procedure. 13 is a flowchart illustrating an example of a transmission process procedure. It is an example of a flowchart showing a reproduction processing procedure. 11 is a flowchart illustrating an example of a processing procedure of a smartphone. 13 is a flowchart showing an example of a processing procedure between a playback device and a robot. It is an example of a flowchart showing the processing procedure of the virtual reality device. 11 is an example of a flowchart showing a processing procedure of a drive recorder, a smartphone, and a television device. This is an example of a processing procedure for displaying thumbnail images. This is an example of thumbnail image display. (A) to (E) are examples of thumbnail images.

[First example]
1 to 6 show a first embodiment, which concerns a drive recorder.

FIG. 1 is a perspective view of a drive recorder 1 (an example of a system) viewed diagonally from the rear. An SD card insertion slot 10 is formed on one side of the housing of the drive recorder 1. A display 11 is formed on almost the entire back surface of the housing of the drive recorder 1, and a plurality of operation buttons 12 are provided on both left and right sides with the display 11 in between. A joint rail 13 is provided on the top surface of the drive recorder 1. Although not shown in Figure 1, a camera lens is provided on the front of the drive recorder. A DC jack of the drive recorder 1 is formed on the side surface not shown in FIG. 1, and a speaker and an HD (high definition) output terminal are formed on the bottom surface of the drive recorder 1.

A camera including a lens captures an image in front of a vehicle, for example. Further, preferably, images of the interior of the vehicle and the exterior of the vehicle (the front of the vehicle) may be captured. The DC jack is a jack for connecting to a DC power source via a power cable. The SD card insertion slot 10 is used to insert an SD card [this is an example of a memory card, and may be other memory cards such as an xD picture card, or other memory such as a USB (Universal Serial Bus) memory other than a memory card]. It is an insertion port for A speaker outputs sound or voice. The HD output terminal is a terminal for connecting to other information equipment via a cable. The joint rail 13 is used to attach a joint for mounting the drive recorder 1 on a vehicle. The display 11 displays various images such as images captured by the camera of the drive recorder 1. The operation button 12 is used by the user to input various commands to the drive recorder 1.

FIG. 2 shows a view of the vehicle in which the drive recorder 1 is mounted, viewed from the inside of the vehicle toward the front.

A rearview mirror 4 is provided near the center of the upper part of the vehicle's windshield 3. A drive recorder 1 is fixed to the vehicle by a joint at a position adjacent to the rearview mirror 4 on the passenger side (on the left side as viewed from the front in FIG. 2).

The DC jack of the drive recorder 1 is connected to the cigarette lighter socket 5 via a power cable 6. When the vehicle's accessory power is turned on, power is supplied to the drive recorder 1 from the cigarette lighter socket 5.

Figure 3 is a block diagram showing the electrical configuration of the drive recorder 1.

The drive recorder 1 includes a controller 20. This controller 20 includes a CPU (Central Processing Unit) 20a that controls the overall operation of the drive recorder 1, a ROM (Read Only Memory) 20b in which the operation program of the drive recorder 1 and the like are stored, a RAM (Random Access Memory) 20c that temporarily stores data and the like, and a timer 20d. The controller 20 has functions such as a GPS information processing program, an image processing program, and a communication processing program, as described below.

The drive recorder 1 also includes a GPS (Global Positioning System) receiver 16, a camera 17, an SD card reader/writer 14, and an acceleration sensor 18. The GPS receiver 16 detects the position of the drive recorder 1, and determines the position of the vehicle in which the drive recorder 1 is mounted. As described above, the camera 17 captures images of the front of the vehicle in which the drive recorder 1 is mounted. When the SD card 23 is inserted into the SD card insertion slot 10 as described above, the SD card reader/writer 14 reads data recorded on the inserted SD card 23 and writes the data to the SD card 23. The acceleration sensor 18 detects the up-down, left-right, and front-back accelerations applied to the drive recorder 1, and determines the up-down, left-right, and front-back accelerations of the vehicle in which the drive recorder 1 is mounted.

GPS data representing the position of the drive recorder 1 output from the GPS receiver 16, video data representing the video imaged by the camera 17, and a signal representing the acceleration detected by the acceleration sensor 18 are input to the controller 20, respectively. . By executing the GPS information processing program, the controller 20 can record the GPS data output from the GPS receiver 16 onto the SD card 23 inserted into the SD card insertion slot 10. Furthermore, by executing the video processing program, the controller 20 can record video data obtained from the camera 17 in the SD card 23 in association with time.

The drive recorder 1 further includes a speaker 15 for outputting the above-mentioned audio, a display 11 for displaying images, an operation button 12, a communication circuit 19, and an LTE module 21.

By outputting audio data etc. from the controller 20 to the speaker 15, audio etc. are output from the speaker 15, and by outputting video data etc. from the controller 20 to the display 11, images etc. are displayed on the display 11. Various commands from the operation button 12 are input to the controller 20.

The communication circuit 19 functions as a communication means for wirelessly communicating with an external device, such as a server, a personal computer, a smartphone, a tablet terminal, etc. The controller 20 has a function of transmitting data such as video to an external device via the communication circuit 19 by executing a communication processing program. The communication circuit 19 may be one that complies with a short-range wireless communication standard such as the WiFi standard or Bluetooth (registered trademark). The short-range wireless communication standard may be applied to communication between a work vehicle (such as a forklift) operating within a premises and an external device. The mobile communication system standard may be applied to communication between a vehicle moving within a wider area and an external device.

The LTE (Long Term Evolution) module 21 is a communication circuit that complies with the mobile phone communication standard. Instead of the LTE module 21, a communication circuit that complies with the standards of other mobile communication systems such as 4G may be used. The LTE module 21 can transmit video data captured by the camera 17 to an external server, etc.

As described below, the operating program of the drive recorder 1 may be pre-recorded on the SD card 23, or may be received by the LTE module 21 via the Internet or the like and recorded on the SD card 23, or the SD card 23 may be inserted into a personal computer or the like, connected to the Internet via the personal computer, downloaded from the personal computer, and recorded on the SD card 23.

FIG. 4 is an example of a time chart when an event occurs in a vehicle in which the drive recorder 1 is mounted.

In this embodiment, continuous recording and event recording are possible. Continuous recording continues, for example, while the drive recorder 1 is powered on, until the recording area for continuous recording on the SD card 23 is exhausted. If the setting is set to allow overwriting of video data for continuous recording, when the recording area for continuous recording is exhausted, the video data obtained by continuous recording is overwritten in the recording area for continuous recording. Event recording temporarily stores video data obtained by shooting in the RAM 20c or the like in sequence for a fixed period such as 20 seconds, and repeats overwriting unless an event occurs. When an event occurs, the video data temporarily stored in the RAM 20c or the like is read out and recorded in the recording area for event recording on the SD card 23. When it is deemed that some change has occurred in the vehicle in which the drive recorder 1 is mounted (for example, detection of acceleration above a threshold, detection of speed above a threshold, detection of sudden braking, etc.), or when it is deemed that an instruction to record an event has been given to the drive recorder 1 (for example, an instruction from the operation button 12), an event is generated from the controller 20 and event recording is performed.

In this embodiment, when an event occurs, video data captured by the camera 17 during the period before and after the event is recorded on an SD card 23 (a recording medium, which is an example of a portable recording medium), and the LTE module 21 transmits the data to a server or the like. In particular, in this embodiment, the amount of video data to be transmitted (amount of data per unit time) that the LTE module 21 transmits to a server or the like is reduced as time passes from the time the event occurs.

When an event (an example of a recording command) occurs at time t3 (YES in step 41 in FIG. 5), video data temporarily stored in the RAM 20c from time t1 (for example, 10 seconds before time t3) before time t3 when the event occurred is read and recorded as event recording video data in the event recording area of the SD card 23. Video data obtained by shooting during the period from time t3 to time t5 (for example, 10 seconds after time t3) after time t3 is also recorded as event recording video data in the event recording area of the SD card 23. Video data shot during the period from time t1 to t5 (for example, 20 seconds) before and after time t3 when the event occurred is recorded as event recording video data in the event recording area of the SD card 23. The event recording video data represents, for example, a video with a high frame rate and relatively high image quality, with a period of 30 frames per second, and one frame is recorded based on HD (high definition) (for example, effective vertical resolution of 1080 lines).

Furthermore, when an event occurs at time t3, the video data temporarily stored in RAM 20c from time t1, which is before time t3 when the event occurred, is read, and from time t1 to time t2, which is after time t1, the controller 20 generates video data with a reduced amount of data compared to the amount of video data temporarily stored in RAM 20c. The LTE module 21 transmits the reduced amount of video data to a server, etc. as video data for transmission. From time t2 to time t3 when the event occurred, the LTE module 21 transmits the same video data as the event recording video data to a server, etc. as video data for transmission. From time t3 to time t4, the same video data as the event recording video data is generated from the video data captured by camera 17, and the LTE module 21 transmits the generated video data to a server, etc. as video data for transmission. From time t4 to time t5, the controller 20 generates video data with a reduced data amount compared to the data amount of the event recording video data, as in the case of the time from t1 to time t2, and the LTE module 21 transmits the reduced data amount as the transmission video data to the server, etc. The data amount of the video data of the video from time t2 to time t4 around time t3 when the event occurs becomes relatively large, and the data amount of the video data representing the video from time t1 to time t2 and the video from time t4 to time t5 [for example, one frame of video per second, and one frame may be the number of pixels based on VGA (Video Graphics Array)] becomes relatively small. From time t2 to time t4, as long as the video data has a data amount larger than the data amount of the transmission video data from time t1 to time t2 or the transmission video data from time t4 to time t5, it is not necessary to use the same data amount (data amount per unit time) as the event recording video data as the transmission video data. In addition, the amount of video data to be transmitted from time t1 to time t2 may be different from the amount of video data to be transmitted from time t4 to time t5. Furthermore, the amount of video data to be transmitted from time t2 to time t3 may be different from the amount of video data to be transmitted from time t3 to time t4.

Videos before and after an event occur are considered to be relatively important, as they may depict the scene of an accident. Since the amount of video data for the period before and after the occurrence of an event is large, it is possible to transmit the video of important scenes and leave important video on a server, etc. Since the amount of data is reduced for video data after a certain period of time has elapsed from the occurrence of an event and video data from a certain period of time before, the transmission time can be shortened, and if there is a cost for data transmission, the cost can be suppressed.

In the example shown in FIG. 4, data before and after the occurrence of an event are generated as video data for transmission, but data before and after the occurrence of an event may be generated as video data for transmission. Further, data obtained after a certain period of time has elapsed or before a certain period of time from the occurrence of an event may be generated as video data for transmission. Furthermore, although the period of the video represented by the transmission data and the period of the video represented by the event recording video data are assumed to be the same, they may not be the same. In any case, it is sufficient to reduce the amount of data for which time has elapsed since the time when a recording command was given, such as when an event occurred.

Figure 5 is a flowchart showing the transmission process procedure of the drive recorder 1.

When an event occurs as described above (step 41), the controller 20 reads the video data temporarily stored in the RAM 20c, and the controller 20 generates event recording video data as described above. The controller 20 records the generated event recording video data in the event recording area of the SD card 23 (step 42).

The event recording video data recorded on the SD card 23 is read out, and the low data amount video representing the video of the period from time t1 to time t2 and from time t4 to time t5 is generated from the read event recording video data as described above. The controller 20 generates the data and high data amount video data representing the video for the period from time t2 to time t4 as video data for transmission (step 43) (the data amount is larger than the amount of video data recorded on the recording medium). (This is an example of a process for reducing the amount of video data to be transmitted.) The LTE module 21 transmits the generated transmission video data (which is an example of video data with a reduced data amount) to a server or the like (step 45).

In the process shown in FIG. 5, the transmission video data is generated from the event recording video data, but the event recording data and the transmission video data described above may be generated in parallel. For example, during the period from time t1 to time t3 when the event occurs, the event recording video data and the transmission video data may be generated simultaneously using video data temporarily stored in RAM 20c, and after time t3 when the event occurs, the event recording video data and the transmission data may be generated simultaneously using video data captured by camera 17.

Figure 6 shows an example of a recording settings window where you can set the amount of video data to be transmitted, etc.

As described with reference to FIGS. 4, 5, etc., in addition to constant recording, event recording and video data transmission are performed. Using the recording setting window 30 shown in FIG. 6, the user makes settings such as constant recording, event recording, and video data transmission.

The SD card 23 to be inserted into the drive recorder 1 is inserted into, for example, an SD card slot of a personal computer (not shown), and the recording setting program recorded on the SD card 23 is read out. Then, a recording setting window 30 shown in FIG. 6 is displayed on the display screen of the personal computer.

The recording setting window 30 includes a recording method selection frame 30a, a recording resolution selection frame 30b, a continuous recording frame rate selection frame 30c, an event recording frame rate selection frame 30d, an event recording time selection frame 30e, a transmission setting frame 30f, a first transmission resolution setting frame 30g, a first transmission frame rate setting frame 30h, a second transmission resolution setting frame 30i, a second transmission frame rate setting frame 30j, and a save to SD card button 30k. The recording setting window 30 also includes other frames, buttons, etc., but their explanations will be omitted.

The recording method selection frame 30a is a frame for setting the type of recording. By pulling down, a menu appears in which the type of recording can be set, such as continuous recording only, or both continuous recording and event recording, and the user selects the desired type of recording. The recording resolution selection frame 30b is a frame for setting the resolution of one frame for continuous recording. By pulling down, a menu appears in which various resolutions can be set, and the user selects the desired resolution. When event recording is also set, the resolution of one frame for event recording is set to the same as the resolution of one frame for continuous recording. Of course, the resolution of event recording may be set to be higher than the resolution of continuous recording. The continuous recording frame count selection frame 30c is a frame for setting the number of frames per second (frame rate) for continuous recording. By pulling down, a menu appears in which various frame counts can be set, and the user selects the desired resolution. The event recording frame count selection frame 30d is a frame for setting the number of frames per second (frame rate) for event recording. By pulling down the menu, various frame rates can be set, and the user can select the desired resolution.

The event recording time selection frame 30e is a frame for setting the time to be recorded when an event occurs. By pulling down, a menu appears that allows the user to set various times before and after the event occurs, and the user sets the desired time. The user may be able to set the time to be recorded before or after the event occurs, or the user may be able to set the time to be recorded from a certain time after the event occurs, or the time to be recorded going back a certain time before the event occurs. The transmission setting frame 30f is a frame for setting whether or not to generate and transmit video data for transmission to a server, etc., as described above. By pulling down, a menu of "enabled" or "disabled" appears, and "enabled" is selected when transmitting video data for transmission, and "disabled" is selected when not transmitting video data for transmission. The first transmission resolution setting frame 30g is a frame for setting the resolution of the video data for transmission for the period from t2 to t4 near the event occurrence, including the event occurrence time t3, as described with reference to FIG. 4. By pulling down, a menu of various resolutions appears, and the user selects the desired resolution. The first transmission frame rate setting frame 30h is a frame for setting the number of frames per second (frame rate) of video data to be transmitted in the period from t2 to t4 around the event occurrence time t3 as described with reference to FIG. 4. By pulling down, a menu showing various frame rates appears, and the user selects the desired number of frames. The second transmission resolution setting frame 30i is a frame for setting the resolution of video data to be transmitted after (for example, the period from t4 to t5) or before (for example, the period from t1 to t2) a time distant from (before) the event occurrence time t3 (a time has elapsed or a time that goes back). By pulling down, a menu showing various resolutions appears, and the user selects the desired resolution. The second transmission frame rate setting frame 30j is a frame for setting the number of frames per second (frame rate) of video data to be transmitted after (for example, the period from t4 to t5) or before (for example, the period from t1 to t2) a time distant from (before) the event occurrence time t3 (a time has elapsed or a time that goes back). By pulling down the menu, a menu showing various numbers of frames appears, and the user selects the desired number of frames. The save to SD card button 30k is clicked when saving the contents set as described above to the SD card 23 inserted in the SD slot of the personal computer.

The contents set using the recording setting window 30 are saved in the SD card 23, and when the SD card 23 is inserted into the SD card insertion slot 10 of the drive recorder 1, the SD card is saved as described above. Event recording video data is recorded in 23, and transmission data is generated and transmitted.

The number of drive recorders for communication is increasing, and when you want to send video data such as 4K or 8K, the communication charges will increase if you send a large amount of video data, so it is necessary to reduce the amount of data as described above. communication charges can be reduced. The drive recorder only needs to send video data of scenes of accidents or dangerous driving, and does not need to send video of normal scenes. If you want to send the video data where the event occurred, the amount of data will increase even if you send only the video data where the event occurred, so you may want to reduce the amount of data further. For this reason, it is best to send video data with a large amount of data before and after the moment when an event occurs so that a clear video is obtained, and to send video data with a small amount of data or coarse video data at other times. An event occurs when the vehicle's acceleration exceeds a threshold, and 20 seconds before and after the event are recorded on the SD card. Since the amount of data increases when you want to send the video immediately on the spot, you can use clear video for the front and back parts, and VGA for the scene where the accident occurred, which greatly reduces the amount of data you need to send. Continuous recording records all the time, and event recording records the 20 seconds before and after the event occurs. Continuous recording overwrites the oldest video data. SD where the constant recording area and event recording area are the same
It is divided by There are ways to reduce the amount of data when sending it via communication, such as reducing the frame rate, reducing the resolution, and increasing the compression rate.

There are drive recorders that can set event recording and constant recording separately, and drive recorders that cannot. For example, one video data with a large amount of data is set to an effective vertical resolution of 1080 lines, and the other video data with a small amount of data is set to VGA, or data is shot with two cameras and one camera has an effective vertical resolution of 1080 lines. It is also possible to obtain a large amount of video data and obtain a small amount of video data to be converted into VGA by the other camera. The sent data may also be recorded in SD data. Video data for transmission may be generated from video data recorded on the SD card. Constantly recorded data may also be transmitted. Basically, if it is sent via communication, it will be recorded on the server, so there is no need to record it on the SD card 23 of the drive recorder 1.

A backup of the transmitted video data may be recorded on the SD card 23. Information (rules) on how the generated video data was transmitted as the transmission video data may be stored in the header of each frame of the transmission video data or recorded in the header of the SD card 23, or the data generated according to the rules may be recorded on the SD card 23. Information that video data different from the video data recorded on the SD card 23 of the drive recorder 1 is being transmitted may be stored in the header of the video file that stores the transmitted video data, the header of the SD card 23, or the like. It is preferable that video data (raw data) that shows a clear image is recorded on the SD card 23, or that processed video data is transmitted. It is preferable to obtain information on the posture of the device held by the user in his/her hand, and process the video data for display so that the display range of the video data is changed based on the information on the posture. In this way, the user can change the display range of the captured video data by changing the posture of the device held in his/her hand. In particular, the device should be a smartphone, the image should be from a celestial camera, and when the smartphone is tilted or rotated based on information from the smartphone's gyro or G sensor about the viewpoint of the celestial camera, the viewpoint of the image should be switched to that direction.

[Second example]
FIGS. 7 to 21 show a second embodiment, which concerns reproduction of video captured by the drive recorder 1. FIG. In this embodiment, the brightness of the image captured by the drive recorder 1 is adjusted (for example, adjusted brightly) based on instructions from the user. When an image of a bright area (for example, an image of the outside of the vehicle) is captured, the amount of brightness adjustment for the image of the dark area is set to be higher than that of the image of the bright area based on instructions from the user. Make it relatively larger than the brightness adjustment amount.

Figure 7 is a block diagram showing the electrical configuration of a personal computer (one example of a system) 50.

As described above, the video recorded by the drive recorder 1 can be played back using the personal computer 50. However, the video may also be played back on the drive recorder 1 without using the personal computer 50.

The overall operation of the personal computer 50 is controlled by the CPU (Central Processing Unit) 58.

The personal computer 50 is provided with a display device 52. This display device 52 is controlled by a display control device 51 which is controlled by a CPU 58. The personal computer 50 also includes an SSD (solid state drive) 53 accessed by the CPU 58, and an SD card reader/writer 54 which reads data and the like recorded on the SD card 23 and writes data and the like to the SD card 23.

The personal computer 50 further includes input devices 55 such as a keyboard and a mouse, memory 56 such as RAM, and a communication circuit 57 for connecting to a network such as the Internet.

An operating program, which will be described later, is received by the communication circuit 57 of the personal computer 50 via the Internet and installed on the personal computer 50. The CPU 58 controls each section by reading and executing the installed program. The operating program is stored in a recording medium such as the SD card 23, and the operating program may be read from such a recording medium and installed in the personal computer 50.

When the SD card 23 removed from the drive recorder 1 is inserted into the SD card slot of the personal computer 50 and the detection program recorded on the SD card 23 is started, the video recorded on the SD card 23 will be displayed. The CPU 58 reads data (for example, constantly recorded video data, event recording video data), and detects a video portion inside the vehicle interior and a video portion outside the vehicle interior. The image portion inside the vehicle interior and the image portion outside the vehicle interior can be determined by, for example, edge detection between the windshield 3 and the dashboard, and image analysis. The CPU 58 records data indicating the boundary between the detected video portion inside the vehicle interior and the video portion outside the vehicle interior, for example, in the header of the video file in which the video data is stored. A detection device (which is an example of a means for detecting) that detects a video portion inside a vehicle interior receives, for example, a selection of a region of a vehicle interior portion in a video from a user, and detects the selected portion as a video portion inside the vehicle interior. Alternatively, for example, the video portion inside the vehicle may be automatically detected. As an automatic detection process, for example, when the movement of the vehicle is detected, parts of the image that change in response to the movement are detected as outside the vehicle, and areas that do not change in the image in response to the movement are detected as the interior of the vehicle. It is recommended that the process be performed as follows. In particular, it is preferable to perform a process of detecting an area in the video where there is movement in accordance with the speed of movement of the vehicle as outside the vehicle, and an area in which there is no movement in accordance with the speed of movement of the vehicle as inside the vehicle.

When the playback program installed in the personal computer 50 is started by the user, the display control device 51, under the control of the CPU 58, displays the playback window 100 shown in FIG. 12 on the display screen of the display device 52 of the personal computer 50.

Referring to FIG. 12, a menu bar 101 is formed at the top of a playback window 100, and a video display area 111 is formed below this menu bar 101. Furthermore, a map image display area 121, a vehicle information display area 131, and a play list display area 141 are formed below the video display area 111.

The menu bar 101 displays various items, and by selecting each item, a pull-down menu is displayed and detailed commands can be given. The menu bar 101 includes the text strings ``File,''``View,''``Play,''``Tool,'' and ``Information,'' a folder icon 102, a camera icon 103, a printer icon 104, and a reel icon. 105, an FD (flexible disk) icon 106, a log icon 107, and a gear icon 108 are displayed. By pulling down the strings ``File,''``Display,''``Playback,''``Tool,'' and ``Information,'' a pull-down menu corresponding to each item will appear, allowing detailed commands to be given. . A folder is specified by clicking the folder icon 102, a still image is converted by clicking the camera icon 103, printing is performed by clicking the printer icon 104, and a reel icon 105 is clicked. By clicking, video conversion is performed, by clicking the FD (flexible disk) icon 106, the data is backed up, by clicking the log icon 107, it is converted to log data, and by clicking the gear icon By clicking 108, the recording settings are changed.

The video display area 111 is an area for displaying video recorded by the drive recorder 1 or the like. The map image display area 121 is an area that displays an image of a map near the shooting location of the video displayed in the video display area 111. By transmitting data representing the vehicle's position from the personal computer 50 to a map server existing on the Internet, and transmitting data representing a map near the vehicle's position from the map server to the personal computer 50, the map image display area is An image of the map is displayed on 121. The vehicle information display area 131 is an area that displays information such as the speed of the vehicle at the time of video recording. The vehicle information display area 131 includes a vehicle status display area 132 that displays the status of the vehicle to which the drive recorder 1 that recorded the video displayed in the video display area 111 is attached, and a vehicle status display area 132 that displays the status of the vehicle, such as video playback, stop, etc. an operation button 133 that gives an operation command for displaying an image inside the vehicle interior; an interior emphasis button (an example of a first instruction input means) 134 that gives an instruction for processing to brightly display an image inside the vehicle interior; a normal display button 135 (an example of a second instruction input means) for giving instructions for normal display processing; a time display area 136 for displaying the recording time of the video displayed in the video display area 111; It includes an acceleration graph display area 138 that displays the acceleration of the vehicle in a graph form. The play list display area 141 is an area where file names of video files recorded on the SD card 23 are displayed in a list. It is preferable to adjust the brightness of the vehicle interior based on an instruction from the user given by the interior enhancement button (first instruction input means) 134.

When the folder icon 102 is clicked and a folder containing video files is selected, the file names of the video files stored in that folder are displayed in the play list display area 141, as shown in FIG. , the file name of the video file is displayed in a clickable manner. Although the video recording start time is used as the file name, it goes without saying that the file name may be anything other than the recording start time.

FIG. 8 is a flowchart showing the processing procedure of the personal computer 50.

As described above, when the folder icon 102 is clicked and the desired folder is selected, the file name of the video file is displayed in the play list display area 141. When any of the file names displayed in the play list display area 141 is clicked using the mouse included in the input device 96, the file is selected (step 61). The corresponding video file is read from the SD card 23. Playback of the video data stored in the read video file is started, and the video is displayed in the video display area 111 as shown in FIG. 13 (step 62). Various header data are recorded in the header recording area of the video file corresponding to the recording time of the video data, and the recorded header data is also read when the video at the recording time is displayed, and various superimposition processing, etc. is performed on the video depending on the contents of the read header data. In addition, the map image display area 121 displays an image of a map in the vicinity of the location where the image displayed in the image display area 111 was taken, and the vehicle status display area 132 displays the numerical values of the speed, acceleration (for example, forward/backward acceleration is expressed as an X value, left/right acceleration as a Y value, and up/down acceleration as a Z value) and position (for example, latitude and longitude) of the vehicle to which the drive recorder 1 that recorded the image displayed in the image display area 111 is attached, and displays the numerical values, status, etc. In addition, the acceleration graph display area 138 displays a graph of the vehicle's acceleration.

FIG. 9 is a flowchart showing the reproduction processing procedure.

When a video file to be played is selected, the first frame of the video represented by the selected video file is displayed as a still image, as shown in FIG. In this state, when the user presses the playback button (triangular button pointing to the right) included in the operation buttons 133 (YES in step 63), video playback of the video represented by the selected video file starts ( Step 64). A video is displayed in the video display area 111.

FIG. 10 is a flowchart showing the brightness correction processing procedure.

When the user presses the interior highlight button 134 while a moving image is being played back in the image display area 111 or a still image is being displayed in the image display area 111 (YES in step 71), the image data representing the image displayed in the image display area 111 is subjected to brightness correction within the position (step 72), and the CPU 58 processes the image data so that the amount of brightness adjustment of the interior (vehicle interior) image portion is relatively greater than the amount of brightness adjustment of the exterior (outside the vehicle interior) image portion. Generally, the interior is darker than the exterior, but if the brightness is adjusted so that both the interior and exterior image portions are uniformly bright, the bright exterior image portions may be blown out. In this embodiment, the amount of brightness adjustment of the interior (vehicle interior) image portion is relatively greater than the amount of brightness adjustment of the exterior (outside the vehicle interior) image portion, so that the interior image portion can be brightened to be easily seen while preventing blown out highlights in bright portions such as the exterior image portion.

Brightness correction can be achieved by applying digital gain processing in the CPU 58 so that the image data becomes brighter. At that time, the amount of gain that brightens the detected indoor image portion should be made greater than the amount of gain that brightens the detected outdoor image portion.

When the normal display button 135 is pressed (YES in step 73), the process shifts to the process shown in FIG. 11, which will be described later.

14 and 15 are examples of videos displayed in the video display area 111, and both are examples of videos taken by the drive recorder 1 during the day.

FIG. 14 is an example of an image before the above-mentioned brightness correction, and FIG. 15 is an example of an image after the above-mentioned brightness correction.

Referring to FIG. 14, the image portion 112a on the left side of the image 112 is the image portion outside the room, and the image portion 112b on the right side of the image 112 is the image portion inside the room. The image portion 112a outside the room is relatively bright, whereas the image portion 112b inside the room is relatively dark. There is a difference in brightness between the inside and outside of the room, making the image 112 difficult to see.

With reference to Figure 15, the image portion 112a on the left side of the image 112 is the outdoor image portion after brightness correction, and the image portion 112b on the right side of the image 112 is the indoor image portion after brightness correction. The outdoor image portion 112a is slightly brighter than before brightness correction, and the indoor image portion 112b is also brighter than before brightness correction. Because the amount of brightness adjustment for the indoor image portion 112b is relatively greater than the amount of brightness adjustment for the outdoor image portion 112a, the difference in brightness between the outdoor image portion 112a and the indoor image portion 112b is smaller than before brightness correction, making it easier to see. Furthermore, adjusting the brightness prevents the outdoor image portion from becoming too bright, and prevents whiteout in bright areas.

Figures 16 and 17 are examples of images displayed in the image display area 111, both of which are examples of images captured at night by the drive recorder 1.

Figure 16 is an example of an image before the brightness correction described above is applied, and Figure 17 is an example of an image after the brightness correction described above is applied.

With reference to Figure 16, the image portion 113a on the left side of the image 113 is the image portion outside the room, and the image portion 113b on the right side of the image 113 is the image portion inside the room. The image portion 113a outside the room is slightly bright, but it is dark because it is nighttime. In contrast, the image portion 113b inside the room is quite dark. Overall, the image 113 is quite dark and difficult to see.

Referring to FIG. 17, a video portion 113a on the left side of video 113 is an outdoor video portion after brightness correction, and a video portion 113b on the right side of video 112 is an indoor video portion after brightness correction. The outdoor image portion 113a is a little brighter than before the brightness correction, and the indoor image portion 113b is also brighter than before the brightness correction, so that the situation inside the room can be seen a little better.

18 and 19 are examples of videos displayed in the video display area 111, and both are other examples of videos taken by the drive recorder 1 at night.

FIG. 18 is an example of an image before the above-mentioned brightness correction, and FIG. 19 is an example of an image after the above-mentioned brightness correction.

Referring to FIG. 18, a video portion 114a on the left side of the video 114 is an outdoor video portion, and a video portion 114b on the right side of the video 114 is an indoor video portion. The outdoor video portion 114a is a little bright, but it is dark because it is nighttime. In contrast, the indoor video portion 114b is quite dark. Image 114 is overall quite dark and hard to see.

Referring to FIG. 19, a video portion 114a on the left side of video 114 is an outdoor video portion after brightness correction, and a video portion 114b on the right side of video 114 is an indoor video portion after brightness correction. The outdoor image portion 114a is brighter than before the brightness correction, and the indoor image portion 114b is also brighter than before the brightness correction, making it relatively easy to understand the situation inside the room.

FIG. 11 is a flowchart showing the brightness correction stop processing procedure.

When the user presses the normal display button 135 (YES in step 81), the CPU 58 stops the brightness correction (indoor brightness correction) process described above (step 82).

When the indoor emphasis button 134 is pressed, the process moves to FIG. 10, and the brightness correction described above is performed.

In the above embodiment, the brightness of the outdoor area is adjusted, but the amount of adjustment of the brightness of the image part of the interior (inside the vehicle) is relative to the amount of adjustment of the brightness of the image part of the exterior (outside the vehicle). If you increase the brightness, you don't necessarily have to adjust the outdoor brightness.

In the above embodiment, the brightness adjustment amount of the image part of the interior (inside the vehicle) is relatively larger than the brightness adjustment amount of the image part of the exterior (outside the vehicle). However, when a dark area and a bright area are included in one frame of the image, instead of the interior and exterior, the brightness adjustment amount of the dark area may be relatively larger than the brightness adjustment amount of the bright area to adjust the brightness. In this way, it is not necessary to detect the interior and exterior. In one frame, it is preferable to set the area having a brightness equal to or greater than the threshold value, and the dark area to an area having a brightness less than the threshold value. A detection device (one example of a detection means) that detects bright areas equal to or greater than the threshold value may be provided, and the detected areas may be set as bright areas, and the undetected areas may be set as dark areas. Also, a detection device (one example of a detection means) that detects dark areas less than the threshold value may be provided, and the detected areas may be set as dark areas, and the undetected areas may be set as bright areas. The brightness adjustment amount may be adjusted to be bright by adjusting the gain of the image data. The brightness adjustment amount may be adjusted so that both the bright area and the dark area are brightened, so that the brightness adjustment amount of the dark area is relatively larger than the brightness adjustment amount of the bright area, or the brightness adjustment may be adjusted so that only the dark area is brightened. It is more preferable to provide an adjustment device (one example of an adjustment means) for adjusting the threshold value. The adjustment device (one example of an adjustment means) for adjusting the threshold value may be an adjustment device that adjusts the threshold value by inputting a user's instruction.

20 and 21 show conversion curves for adjusting the brightness of video data.

Figure 20 shows that when one frame contains a dark area and a bright area, the brightness is adjusted by making the brightness adjustment amount for the dark area relatively larger than the brightness adjustment amount for the bright area. This is an example of a brightness conversion curve that performs the following.

In Figure 20, the horizontal axis shows the brightness level (input level) before brightness conversion, with the left side indicating darker and the right side indicating brighter. The vertical axis shows the brightness level (output level) after brightness conversion, with the bottom side indicating darker and the top side indicating brighter.

By performing brightness conversion based on the brightness conversion curve C1 shown in Figure 20, the brightness before the brightness conversion is darker than the brightness before the brightness conversion is brighter than the brightness after the brightness conversion. The rate at which the brightness becomes brighter increases. In brightness conversion based on the brightness conversion curve C1 shown in FIG. 20, if the brightness before conversion is extremely dark, the brightness after brightness conversion becomes brighter is not very large. In this way, when the brightness before conversion is extremely dark, the brightness after brightness conversion may be set not to increase in brightness. For example, assuming a first threshold and a second threshold that is larger than the first threshold, a brightness value that is greater than or equal to the first threshold and less than or equal to the second threshold is determined. The adjustment amount may be set to be brighter than the adjustment amount for brightness below the first threshold and brightness brighter than the first threshold.

When the indoor emphasis button 134 is pressed, brightness adjustment may be performed using the brightness conversion curve C1 shown in FIG. 20, or a button such as a dark area emphasis button may be used instead of the indoor emphasis button 134. The brightness may be adjusted using the brightness conversion curve C1 shown in FIG. 20 when the button is pressed.

Figure 21 shows an example of a brightness conversion curve C2 that is used when the brightness adjustment described above is not performed.

In FIG. 21 as well, the horizontal axis indicates the brightness before brightness conversion, with the left side being darker and the right side being brighter. The vertical axis shows the brightness after brightness conversion, with the lower side being darker and the upper side being brighter.

The brightness conversion curve C2 shown in Figure 21 has linearity, and by using the brightness conversion curve C2, brightness correction is performed at a constant rate regardless of the brightness before the brightness conversion.

It is recommended that when the normal display button 135 is pressed, brightness adjustment is performed using the brightness conversion curve C2 shown in FIG. 21.

In the above, the brightness conversion curve C1 shown in FIG. 20 is used when one frame contains dark and bright areas without taking indoors into consideration, and the brightness adjustment amount for dark areas is made relatively larger than the brightness adjustment amount for bright areas. However, it is also possible to detect indoor and outdoor image parts within one frame, and perform brightness correction for the detected indoor image part using the brightness conversion curve C1 shown in FIG. 20, and perform brightness correction for the detected outdoor image part using a brightness conversion curve having linearity, for example the brightness conversion curve C2 shown in FIG. 21.

In the above embodiment, buttons 134 and 135 are used to instruct brightness correction and to instruct the stopping of brightness correction, but instead of providing these buttons 134, 135, etc. on the playback window 100, a menu may be displayed on the playback window 100 as described below, and the brightness correction instruction and the brightness correction stop instruction may be selected from the displayed menu.

Drive recorders are increasingly using lenses that can record not only the front but also the front and rear, 240 degrees, the front as well as the inside of the car. If the image is corrected to match, the interior of the car or other interior will become dark. In nighttime images, it is easier to see inside the office than in the daytime in places with streetlights, but it becomes harder to see in darker places or when there are fewer streetlights. If you increase the brightness, the outside will be blown out, and it's a waste to increase the brightness when recording. With digital images, if the highlights are blown out, the data will be lost, but if the blown out highlights are blown out, the data will remain. Even in pitch-black images, the driver can be seen by correcting the brightness. If you correct the overall brightness to make the inside of the car visible, the bottleneck will be that the outside of the car will become too bright, but we will add a button to make it easier to see inside or outside the car. It is possible to create images that emphasize the outside of the vehicle or images that emphasize the outside of the vehicle. In the above-mentioned embodiment, only two types of brightness adjustment, ie, brightness adjustment or not, have been described, but it is also possible to perform brightness correction linearly. The brightness correction may be changed to an intermediate level.

As mentioned above, if you move the cursor over the displayed image and right-click, a menu will appear, and you can use that menu to perform interior priority correction (interior emphasis correction, in-car priority correction, in-car interior priority correction).

The brightness conversion curve C1 shown in Figure 20 is used to increase the degree of brightness in the dark areas, and not to correct the brightness so much in the bright areas. The amount of brightness adjustment is different for bright and dark areas. Brightness adjustment is done for both day and night.

Although the brightness is corrected during playback, it is recommended that the brightness be corrected in the same way when playing back the video on the display 11 of the main body of the drive recorder 1. A menu may be displayed on the display 11 of the drive recorder 1, and a button for switching or setting brightness correction instructions and stopping may be selected from the menu, or a touch panel may be formed on the display 11, and the display Such a switching button or a button for setting may be provided. When reproducing video data while recording it on the drive recorder 1, the above-described brightness correction may be performed on the video data to be reproduced.

[Third Example]
22 to 27 show a third embodiment, in which the video of the playback window 100 is displayed separately from the playback window 100. FIG.

In the same way as described above, the display control device 51 displays a playback window 100 as shown in FIG. 23 on the display screen of the display device 52 of the personal computer 50. The user moves the cursor 162 onto the image displayed in the image display area 111 and right-clicks (YES in step 151). Then, the display control device 51 displays the menu 161 in a superimposed manner on the video displayed in the video display area 111 (step 152).

Menu 161 displays the following text: "Image status: normal", "Return to standard", "Invert", "Zoom in/out", "In-car priority correction", and "Show in separate window".

In the video display area 111 of the playback window 100, it is possible to display not only a video taken in the forward direction of the vehicle, but also a so-called spherical video taken in all directions above, below, left and right with the drive recorder as the center. In such spherical images, it may be difficult to tell whether the image is in a normal or reversed state, so the "image state" indicates the state of the image. :Normal rotation" indicates that the image displayed in the image display area 111 is in a "normal rotation" state. Since spherical images capture images in all directions, up, down, left and right, with the drive recorder as the center, by moving the image displayed in the image display area 111, you can see the area in front of the vehicle in which the drive recorder is installed. In addition to images, it is possible to display images viewed in all directions, including backwards, left, right, upward, and downward. ``Return to standard'' is selected to change the image displayed in the image display area 111 to an image viewed from the standard direction (for example, from the front). When "Flip" is selected, character strings such as "Flip vertically", "Flip horizontally", "Flip front and back", etc. are displayed. When "Vertical Flip" is selected, the image is flipped vertically, when "Horizontal Flip" is selected, the image is flipped horizontally, and when "Front/Front Flip" is selected, the image changes from the front image to the rear image. Or the image is reversed from the rear image to the front image. "Enlarge/Reduce" is selected when enlarging or reducing the video. As described above, the "vehicle interior priority correction" is selected when adjusting the brightness by making the brightness adjustment amount that brightens the interior of the vehicle larger than the brightness adjustment amount that brightens the exterior. "Display in separate window" is selected when displaying the video displayed in the video display area 111 in a window separate from the playback window 100.

Returning to FIG. 22, when "display in separate window" is selected (YES at step 153), the CPU 58 generates a video display window separate from the playback window 100. As shown in FIG. 24, a video display window 160 appears on the display screen of the display device 52 in addition to the playback window 100 (step 154).

Referring to FIG. 24, the video that was displayed in the video display area 111 of the playback window 100 (which is an example of a window that includes an operation system for operating the displayed video) is displayed in the video display window 160. . The video display window 160 may be displayed on the entire display screen of the display device 52 so as to hide the playback window 100, or the video display window 160 may be displayed mainly on the left or right half of the display screen. Conversely, the playback window 100 may be displayed mainly on the right half or the left half of the display screen. Further, the video display window 160 may be displayed mainly in the upper half or the lower half of the display screen, and conversely, the playback window 100 may be displayed mainly in the lower half or the right half of the display screen. Further, the size of the video display window 160 and the size of the playback window 100 may be the same or may be different.

Furthermore, when a video display window 160 is displayed separately from the playback window 100, a video may be displayed in the video display area 111 of the playback window 100. However, in that case, it is not necessary to display a video in the video display area 111 of the playback window 100. When the playback window 100 and the video display window 160 are displayed on the same display screen, it is preferable not to display a video in the video display area 111 of the playback window 100.

When you move the cursor 162 onto the image displayed in the image display window 160 and right-click, a menu 161 appears.

The menu 161 displayed on the video displayed in the video display window 160 is different from the menu 161 displayed on the video in the playback window 100, and the menu 161 that is displayed on the video in the video display window 160 is different from the menu 161 displayed on the video in the playback window 100. ” string is included. When the character string "Close window" is selected, the video display window 160 disappears and the video display area of the playback window 100
111, the video that was displayed in the video display window 160 is displayed.

The information displayed in the vehicle status display area 132 (an example of associated information) may be displayed on the image in the image display window 160. While watching the image displayed in the image display window 160, the speed, acceleration, etc. of the vehicle equipped with the drive recorder that captured the image can be confirmed. When the playback window 100 and the image display window 160 are displayed on the same display screen, it is preferable to display the information displayed in the vehicle status display area 132 on the image displayed in the image display window 160 when the vehicle status display area 132 is hidden by the image display window 160.

Figures 25 to 27 show modified examples.

In FIGS. 22 to 24, the playback window 100 and the video display window 160 may be displayed on the same display screen or on different display screens, but the modified examples shown in FIGS. 25 to 27 Now display it on a different display screen. In this modification, an external display device other than the display device 52 is connected to the personal computer 50.

Figure 25 is a flowchart showing the processing steps for displaying the playback window 100 and the video display window 160 on a separate display screen.

As shown in FIG. 23, when the image displayed in the image display area 111 is right-clicked (YES in step 171) while the image display window 160 has not been generated, a menu 161 is displayed on the image (step 172). In this modified example, the character string "Display on a separate display screen" appears in the menu 161 instead of "Display in separate window." When the user selects the character string "Display on a separate display screen" that appears in the menu 161 (YES in step 173), the CPU 58 creates the image display window 160. Data representing the created image display window 160 (data for displaying the image on a separate display screen) is output to an external display device connected to the personal computer 50 (step 74).

Figure 26 shows how a playback window 100 and a video display window 160 are displayed on different display screens.

A video display window 160 (which is an example of a first window) is displayed on a display screen 190 of an external display device different from the display device 52 of the personal computer 50, and a playback window 100 (which is an example of a first window) is displayed on the display screen 180 of the display device 52. (which is an example of the second window) is displayed.

Although no video is displayed in the video display area 111 of the playback window 100, it is preferable to display the video. When the video display window 160 is displayed on a display screen 190 that is different from the display screen 180 of the display device 52 of the personal computer 50, move the cursor 162 over the video display area 111 and right-click. Menu 161 appears. Menu 161 includes the character string "Close separate display screen." When the character string "Close separate display screen" is selected, the output of data to the external display device is stopped, and the video display window 160 displayed on the display screen 190 of the external display device disappears. If no video is displayed in the video display area 111 of the playback window 100, the video is displayed in the video display area 111.

Figure 27 shows an example of how to use the playback window 100 and the video display window 160 when they are displayed on separate display screens.

For example, video captured by a drive recorder installed in a vehicle driven by a driver 211 is played back, and the above-mentioned playback window 100 is displayed on the display screen of a personal computer 200 of an administrator 201 of the driver 211, etc. The personal computer 200 is connected to a relatively large external display device 210, and data for displaying the above-mentioned video display window 160 is output to the external display device 210. The video display window 160 is displayed on the display screen of the external display device 210.

The manager 201 or the like operates the playback window 100 displayed on the personal computer 200 at hand to control the image displayed on the display screen of the external display device 210. The driver 211 can receive guidance and warnings from the manager 201 while watching the image displayed on the display screen of the external display device 210.

In addition, in the above embodiment, the playback window 100 is displayed on the display screen of the personal computer 50, but the playback window 100 may be displayed on the display 11 of the drive recorder 1 instead of on the display screen of the personal computer 50.

For example, if a driving school has a driving recorder in its driving car and shows the driving footage of the students during a lesson to everyone, it can be hard to see on a small screen, but the footage can be made easier to see by displaying it on the display screen of the external display device 210 as described above. A manager (e.g., a driving school instructor) can operate the personal computer 200 at hand to display the driving footage of the students on the display screen of the external display device 210 and teach the students at the driving school important things to watch out for when driving. In a similar way, a truck driver can be instructed by the operations manager.

In addition to the video, a map image displayed in the map image display area 121, information displayed in the vehicle status display area 132, etc. may be displayed in a separate window or a separate display screen. Other accompanying information may also be displayed in a separate window or display screen as necessary. To open a separate window or display screen, you may right-click to display a menu and select from the menu, or you may provide a button and operate the button to open a separate window or display screen.

It is preferable to operate the video using the playback window 100, which is a window of the operation unit, and not to operate the video using the video display window 160. The video display window 160 preferably does not include an operation system or operation buttons. The video display window 160 does not include an operation unit or an operation system, and it is preferable to display the video in such a window that cannot be operated. As described above, it is preferable that the video in the video display window 160 be controlled by operating the operation button 133 or the like in the playback window 100.

An operation playback window 100 may be displayed on the screen of the drive recorder, and a video display window 160 may be displayed on a separate monitor to display the video. The drive recorder 1 may perform operations that are performed using programs, software, etc. for personal computers.

[Fourth example]
28 to 34 show the fourth embodiment.

In the fourth embodiment, the playback speed of the video can be adjusted. For example, a personal computer 50 shown in FIG. 7 can be used as a system that can adjust the playback speed of the video, but the drive recorder 1 shown in FIG. 3 can also be used.

Figure 28 is a flowchart showing an example of a video playback processing procedure.

When a video file to be played back is specified, the video data stored in the specified video file is read by the CPU 58, and a still image representing a part of the video is displayed in the video display area 111 of the playback window 100 displayed on the display screen of the display device 52 as shown in FIG. 13 (step 221). The CPU 58 also reads the vehicle speed pulse data that accompanies the video data as additional information (step 221). When the user presses the playback button (right-facing triangular button) included in the operation buttons 133 (YES in step 222), playback of the video starts. The CPU 58 judges whether the vehicle speed represented by the read vehicle speed pulse data is slow or not (step 223). For example, if the speed of the vehicle in which the drive recorder 1 that captured the video is installed is slower than a speed threshold, the vehicle speed is judged to be slow, and if the speed is equal to or greater than the speed threshold, the vehicle speed is judged to be not slow. The speed threshold may be determined in advance or may be specified by the user. The vehicle speed is also judged to be slow for video in which the vehicle is stopped.

If it is determined that the speed of the vehicle is slow (YES in step 223), the reproduction speed of the video displayed in the reproduction window 100 is slowed down by the CPU 58 (step 224). The video playback speed may be slowed down if the video playback speed is made slower than the normal playback speed. The normal playback speed is the speed at which the shooting time during shooting and the playback time during playback are the same. For example, by setting the number of video frames per unit time to be the same during shooting and playback, the shooting time during shooting and the playback time during playback will be at the same speed. For example, if the rate of shooting is one frame every 1/30 seconds, the frame will be played back at a rate of one frame every 1/30 seconds without dropping any frames. If it is determined that the speed of the vehicle is not slow (NO in step 223, the playback speed of the video displayed in the playback window 100 is set to the normal speed by the CPU 58 (step 225). In this way, the playback speed of the video is is slowed down or made normal, and the video is played back (step 226) (this is an example of changing the playback speed of the captured video based on the speed of the vehicle).

Figure 29 shows the relationship between vehicle speed and video playback speed.

In the video between time t0 and time t3, it is assumed that the speed of the vehicle is slow between time t1 and time t2. Further, it is assumed that the speed of the vehicle was not slow (normal speed or slow speed) between time t0 and time t1 and between time t2 and time t3. Then, the video playback speed between time t1 and time t2 is slowed down. The playback speed of the video between time t0 and time t1 and the video between time t2 and time t3 is set to the normal speed. It may be played at a faster speed. Further, a video when the speed is slow may be played back at the normal playback speed, and a video when the speed is not slow may be played back at a speed faster than the normal speed (for example, n times the normal playback speed).

Figure 30 is a flowchart showing an example of a video playback processing procedure. In Figure 30, the same processes as those shown in Figure 28 are given the same reference numerals and their explanations are omitted.

In the process shown in FIG. 28, when the vehicle speed is slow (YES in step 223), the video playback speed is slowed down, but in the process shown in FIG. 30, when the vehicle speed is slow (YES in step 223), the video playback speed is increased (for example, n times the normal playback speed) (step 224A). When the vehicle speed is not slow (NO in step 223), the video playback speed is made normal (or a playback speed less than 1x) (step 225). When the vehicle speed is slow, such as when the vehicle is stopped, it is assumed that important scenes are not captured in the video, and scenes where the vehicle speed is slow can be fast-forwarded, thereby shortening the video playback time. For example, when a manager who manages the driver's driving status views the video, video can be fast-forwarded when the vehicle speed is slow and not much information is needed, such as when stopped at a traffic light, simplifying viewing.

In the embodiments described above, it is determined whether the vehicle is slow based on vehicle speed pulse data, but other information such as GPS information may be used to determine whether the vehicle is slow. Furthermore, in the above-described embodiment, a mode may be used in which the information before and after the occurrence of an event, which is obtained based on vehicle history information or the like, is played back at normal speed. Furthermore, since the images of cars parked are the same, they can be skipped over, and images of cars driving at high speeds can be played back slowly because they flow quickly. In particular, images obtained with a camera that shoots in the horizontal direction have a fast flow, so the images feel fast. For this purpose, it may be played back at a slow speed.

FIG. 31 is a flowchart showing the processing procedure of video analysis.

In this embodiment, a video analysis button (not shown) is formed in the playback window 100. However, it is also possible to have no video analysis button and, for example, right-clicking on the video display area 111 causes a menu to appear and to specify video analysis processing in the menu. Also, video analysis as shown in FIG. 31 may be performed before playing the video in response to pressing the play button.

When the video to be played is specified and the video analysis button is pressed (YES in step 231), the video data representing the specified video is read (step 232). If the video data is stored in the semiconductor memory of the personal computer 50, it is read by the SSD 53, and if the video data is stored on the SD card 23, it is read by the SD card reader/writer 54.

The image represented by the read video data is analyzed by the CPU 58 (step 233). The portion of the image that includes other vehicles is detected (YES in step 234), and it is determined whether the vehicle (the vehicle capturing the image) is slower than the other vehicles (YES in step 235). If it is slower, data representing the time period when it is slower is associated with the video data and recorded (step 236). For example, data representing the time period when it is slower is recorded in the header of the video file in which the video data is stored. If the vehicle is not slower than the other vehicles (NO in step 235), the processing of step 236 is skipped. The processing of steps 234 to 236 is repeated until the video analysis is completed (step 237).

In this way, by identifying the time periods in the video where the vehicle's speed is slow, when playing back that video, the playback speed can be slowed down (step 224 in Figure 28) or sped up (step 224A in Figure 29), as shown in Figure 28 or Figure 29.

Figure 32 is a flowchart showing another example of a video analysis processing procedure.

Similar to the process in FIG. 31, when a video to be played is specified and the video analysis button is pressed (YES at step 241), the video data is read (step 242) and the video is analyzed (step 243).

If the result of the video analysis shows only the image portion of the front or rear of the vehicle (YES in step 244), identification data indicating that the image portion is a front or rear image is recorded (step 247). For example, the identification data is recorded in the header of the video file in which the video data is stored. If the result of the video analysis shows that the image portion is not only the image portion of the front or rear of the vehicle (NO in step 244) but is only the image portion of the lateral direction of the vehicle (YES in step 245), identification data indicating that the image portion is a lateral image is recorded (step 248). In this case, too, for example, the identification data is recorded in the header of the video file in which the video data is stored. If the result of the video analysis shows that the image portion is not only the image portion of the lateral direction of the vehicle (NO in step 245), it is determined whether the proportion of the image of the front or rear of the vehicle (the proportion of the image of the front and rear of the vehicle) is greater than the lateral direction (step 246). If the proportion of the image of the front or rear of the vehicle is greater than the lateral direction (YES in step 246), identification data indicating that the image portion is a front or rear image is recorded (step 247). If the lateral proportion of the vehicle is greater than the forward or rearward image proportion (the proportion of the front and rear images of the vehicle) (NO in step 246), then identification data is recorded indicating that the image portion is lateral (step 248).

The processes from steps 244 to 249 are repeated until the video analysis is completed (step 248).

FIG. 33 is a flowchart illustrating an example of a reproduction processing procedure for a video on which the video analysis processing of FIG. 32 has been performed.

When a video to be played is specified, video data and video identification data are read (step 251). When the playback button included in the operation button 133 is pressed (YES in step 252), it is determined whether the image represented by the read video data is a front image, a rear image, or a horizontal image based on the read identification data. It is determined whether the image is a directional image (step 253).

If the video is a front video or a rear video, the video is played back at a faster than normal playback speed (step 254). When the video is from the front or the rear, there is often no discomfort even if the playback speed is slowed down. It is possible to shorten the playback time while playing back without feeling any discomfort. When the video is switched (YES in step 255), if the playback has not ended (NO in step 258), the process from step 253 is repeated again.

If the video is in the horizontal direction, the video is played back at a slower playback speed than usual (step 256). When viewing images in a horizontal direction, the flow of the images may seem fast, which may create a sense of discomfort. When playing horizontal images, the playback speed is slowed down, which often eliminates the sense of discomfort. When the video is switched (YES in step 257), if the playback has not ended (NO in step 258), the process from step 253 is repeated again.

Although the process shown in Figure 33 is performed on the video that has undergone the video analysis process shown in Figure 32, the process shown in Figure 33 is not necessarily performed on the video that has been subjected to the video analysis process shown in Figure 32; Processing similar to the processing shown in FIG. 33 may be performed on the video on which the video analysis processing shown in 32 has not been performed.

For example, if a first camera photographs the front or rear of the vehicle and a second camera photographs the side of the vehicle, the image photographed by the first camera will represent the front or rear of the vehicle, and the second camera will photograph the front or rear of the vehicle. It can be seen that the image taken by camera 2 represents the lateral direction of the vehicle. In such a case, the video taken by the first camera may be played back at a faster playback speed, and the video taken by the second camera may be played back at a slower playback speed. Data indicating whether the video was shot by the first camera or the second camera would be recorded in the header of the video file in which video data representing the video is stored.

Furthermore, when playing back images captured by a camera that can capture images in all directions, up, down, left, right, front, and back, it is possible to display the front or rear of the vehicle, or to display the lateral direction. In such videos, it is detected during playback whether the front or rear of the vehicle is displayed at a high rate, and when the front or rear of the vehicle is displayed at a high rate, the playback speed is increased and the vehicle is displayed at a higher rate. It is a good idea to slow down the playback speed when a large proportion of the horizontal direction is displayed.

Figure 34 is a flowchart showing an example of the playback processing procedure.

In this embodiment, it is preferable to provide a normal playback command button in the playback window 100, but it is also possible to give a normal playback command to the personal computer 50 even without the normal playback command button, by displaying a menu by clicking on the video display area 111 and giving a normal playback command from that menu.

When the video is being played back, it is determined whether or not it is being played back at the normal playback speed (step 261). If the playback speed is faster than the normal playback speed or slower than the normal playback speed, it is determined that the playback is not at the normal playback speed. When the normal playback command is given to the personal computer 50 by pressing the normal playback button etc. when the playback is not being performed at the normal playback speed (YES at step 261), the normal playback speed is set. The video that is not being played starts to be played at the normal playback speed (step 263). Videos that are not being played back at normal playback speed can now be played back at normal playback speed.

When driving, the image in front of you looks natural, but when you look at the image from the side, it is difficult to see if it flows, so the display speed of the image can be slowed down. Since it looks slow when viewed from the front, the playback time can be shortened by playing it faster. When stopped, the image is played back normally, and the image when driving at high speed flows, so it can be played slowly when the speed is high, and automatically played at about double speed when the vehicle is stopped. It is recommended that normal playback is the playback at the time of actual recording. For example, when waiting at a traffic light, the user would have to press the fast-forward button himself, but it will automatically speed up. The speed should be displayed as a number on the PC viewer. The speed information stored in the drive recorder is GPS information and vehicle speed pulse, so it is recommended to use this information. The GPS information and vehicle speed pulse are stored in the header of the image file in which the image data is stored, so they can be used. The vehicle speed pulse is the original information from the vehicle's speedometer, and is output based on the signal output according to the number of tire rotations.

[Fifth example]
35 to 40 show the fifth embodiment. The fifth embodiment relates to the display form of the playback window.

FIG. 35 and FIG. 36 display map images in a large size.

FIG. 35 is a flowchart showing the processing procedure of the personal computer 50, and FIG. 36 is an example of the playback window 100.

When the display software for the playback window 100 is activated by the user, the process shown in FIG. 35 starts. Then, as shown in FIG. 12, a playback window 100 in which the video display area 111, map image display area 121, etc. are blank is displayed on the display screen of the display device 52 of the personal computer 50 (step 271). In the list display area 141, a tab is displayed that allows you to give instructions for reproducing the recorded video as well as historical information (vehicle position information, speed information, acceleration information, etc.) of the vehicle that photographed the video ( (Illustration is omitted in FIG. 36 etc.). By selecting that tab (which is an example of an enlargement command button) and selecting a history information file, an instruction to reproduce the history record data represented by the selected history information file is given to the personal computer 50. When an instruction to reproduce history record data is given to the personal computer 50 (YES in step 272), a command to replace the video display area 111 and the map image display area 121 is given to the display control device 51 of the personal computer 50. The area of the video display area 111 is replaced with the area of the map image display area 121 (step 273). As shown in FIG. 36, the map image and video are displayed by exchanging the video display area 111 and the map image display area 121 (this is an example of a two-stage area of a large area and a small area) (step 274). ). Since the map image is displayed in a large size, it is relatively easy to check the location where the image was taken and the position of the vehicle at the time of the image.

In the examples shown in Figures 35 and 36, the map image is enlarged, but the area for displaying information about the vehicle obtained while the vehicle capturing the video is being driven may be enlarged. Information such as vehicle acceleration information, vehicle speed information, brake information, and turn signal information may be displayed enlarged. For example, a speed graph and an acceleration graph may be displayed enlarged. The area for displaying information about the vehicle may be switched from a small area to a large area in response to a command given from a button that gives a command such as an area enlargement command.

In the example shown in FIG. 35 and FIG. 36, the area of the video display area 111 and the area of the map image display area 121 are swapped, but this is not necessary. It is sufficient that the size of the map image displayed when an instruction to play back history record data is given is larger than the size of the map image displayed when an instruction to play back history record data is not given (one example of the default size). Instead of increasing the size in response to dragging, for example, an enlargement command button may be provided in the playback window 100, and information about the vehicle, such as a map image of a predetermined size, may be displayed in an area larger than the predetermined size in response to an enlargement command button from the enlargement command button. Information about the vehicle, such as a map image of a predetermined size, may be displayed in an area larger than the size of the video, or in an area smaller than the size of the video. It is not necessary to change the size of the video display area 111, but it is particularly preferable to change the size of the video display area 111 as shown in FIG. 36.

The history record data and the video data are linked, and the video captured at the same time and the information about the vehicle are synchronized and displayed in the video display area 111, and it goes without saying that, for example, a map image is displayed in the map image display area.

Figures 37 and 38 show a three-dimensional display of the acceleration of the vehicle whose video was captured. The processing shown in Figures 37 and 38 may be performed in response to either an instruction to play back a video recording or an instruction to play back history record data.

Referring to FIG. 37, the playback window 100 displayed has an acceleration graph display area 142 on the right side of the play list display area 141. The acceleration of the vehicle that captured the video is displayed three-dimensionally in the acceleration graph display area 142. In FIG. 37 and FIG. 38, the X axis is formed in the depth direction, the Y axis is formed in the horizontal direction, and the Z axis is formed in the vertical direction. The X axis is the axis showing the acceleration in the front and rear of the vehicle, the Y axis is the axis showing the acceleration in the lateral direction of the vehicle, and the Z axis is the axis showing the acceleration in the vertical direction of the vehicle. Acceleration in the front of the vehicle (positive acceleration) is graphed upward on the X axis, and acceleration in the rear of the vehicle (negative acceleration) is graphed downward on the X axis. Acceleration in the right direction toward the vehicle is graphed upward on the Y axis, and acceleration in the left direction toward the vehicle is graphed downward on the Y axis. Acceleration in the upward direction of the vehicle is graphed leftward on the Z axis, and acceleration in the downward direction of the vehicle is graphed rightward on the Z axis. Of course, if the acceleration is known, it is not necessary to specify it in this way.

When the acceleration graph display area 142 is formed, it is a good idea to display a speed graph in the acceleration graph display area 138.

FIG. 38 shows an enlarged view of the acceleration graph displayed in the acceleration graph display area 142 compared to FIG. 37.

The longitudinal acceleration of the vehicle is represented by graph 281, the lateral acceleration of the vehicle is represented by graph 282, and the vertical acceleration of the vehicle is represented by graph 283. In the acceleration graph display area 142, the acceleration of the vehicle (the vehicle that captured the image) per time is displayed in three dimensions according to the time when the image was captured. The acceleration of the vehicle displayed in the acceleration graph display area 142 may be the acceleration of a part of the captured image, and in particular, may be the acceleration for a certain period of time (for example, several seconds to several minutes before and after) before and after the image displayed in the image display area 111. For example, if the current image displayed in the image display area 111 is an image of time t12, it is preferable that a graph representing the acceleration of the vehicle from time t11 before time t12 to time t13 after time t12 is displayed in the acceleration graph display area 142. Data representing the acceleration is recorded in a header attached to each frame of the image represented by the image data, and the graph representing the acceleration is displayed by reading out the data. Also, when the acceleration is recorded in the header of a video file that contains video data, or in a file that contains information about the vehicle other than the video file, it is a good idea to read the acceleration from these files and display a graph showing the acceleration.

In Figures 37 and 38, a graph showing acceleration is shown in a coordinate space consisting of the X-axis, Y-axis, and Z-axis, but as long as the first axis (an example of the X-axis) shows the acceleration in the longitudinal direction of the vehicle, the second axis (an example of the Y-axis) shows the acceleration in the lateral direction (width direction) of the vehicle, and the third axis (an example of the Z-axis) shows the acceleration in the vertical direction of the vehicle, the X-axis, Y-axis, and Z-axis do not necessarily have to be used. The first axis, second axis, and third axis do not have to be perpendicular to each other. Also, a graph of acceleration may be displayed that changes in the longitudinal direction in response to changes in the acceleration in the longitudinal direction of the vehicle, changes in the lateral direction in response to changes in the acceleration in the lateral direction of the vehicle, and changes in the vertical direction in response to changes in the acceleration in the vertical direction of the vehicle.

FIG. 39 shows a modification and is an example of the playback window 100.

The acceleration graph display area 142 in the playback window 100 shown in FIG. 37 is formed to the right of the play list display area 141, but in the playback window 100 shown in FIG. 38, it is displayed superimposed on the video displayed in the video display area 111. This makes it relatively easy to check the acceleration while watching the video.

The information superimposed on the video is not limited to the acceleration graph, but may be other information regarding the vehicle. This makes it easier to check other information about the vehicle while viewing the video. In particular, as described with reference to FIGS. 26 and 27, when displaying the playback window 100 and the video display window 160 on separate display screens, it is preferable to display information regarding the vehicle on the video. Furthermore, when displaying the playback window 100 and the video display window 160 on separate display screens, information about the vehicle is displayed on the video, and information about the vehicle displayed on the video is also displayed in the playback window 100. It's good to do that. When displaying the playback window 100 and the video display window 160 on separate display screens, the video with the acceleration graph display area 142 formed on the video is displayed on the video display window 160 as shown in FIG. , it is preferable to form an acceleration graph display area 142 in the playback window 100 displayed on another display screen as shown in FIG.

Figure 40 shows another modified example, an example of a playback window 100.

An acceleration display area 143 is formed on the right side of the play list display area 141 formed in the playback window 100. In the acceleration display area 143, an image of a car is displayed. In front of the image of the car, the letters "+X" are displayed with an arrow pointing forward, next to the image of the car, the letters "+Y" are displayed with an arrow pointing horizontally, and above the image of the car, the letters "+Z" are displayed with an arrow pointing upward. The acceleration of the car in the forward or backward direction is displayed in front of the image of the car, the acceleration of the car in the lateral direction is displayed to the side of the image of the car, and the acceleration of the car in the vertical direction is displayed above the image of the car. Since the acceleration of the car is displayed together with the appearance of the car, it is relatively easy to understand in which direction the acceleration is acting on the car. The image of the car will be stored in the setting file of the program that displays the playback window 100.

The direction of the arrow may also be changed depending on the acceleration. For example, if acceleration is applied to the front of the car, the arrow will point forward, and if acceleration is applied to the rear of the car, the arrow will point backward. If acceleration is applied to the right side of the car, the arrow will point to the right, and if acceleration is applied to the left side of the car, the arrow will point to the left. If acceleration is applied to the top of the car, the arrow will point upward, and if acceleration is applied to the bottom of the car, the arrow will point downward.

An image of a type of automobile corresponding to the type of vehicle that captured the video may be displayed in the acceleration display area 143. For example, if the vehicle is a forklift and the video is captured by the forklift, an image of the forklift may be displayed in the acceleration display area 143, and if the vehicle is a truck and the video is captured by the truck, an image of the truck may be displayed in the acceleration display area 143. In this way, an image of a vehicle corresponding to the type of the captured video may be displayed in the acceleration display area 143. Furthermore, an image of a vehicle of a manufacturer corresponding to the captured vehicle may be displayed in the acceleration display area 143. For example, when the video is captured in a vehicle of automobile manufacturer A, an automobile of that company A may be displayed in the acceleration display area 143, and when the video is captured in a vehicle of automobile manufacturer B, an automobile of that company B may be displayed in the acceleration display area 143.

There is a concept of history. Until now, the spotlight has been on video recording, but with GPS information, we are trying to capture a lot of information on a different level. With just history, it is text information, so the amount of data is smaller than with video. Information such as what time and where you passed is also history information. The map is displayed small, but as mentioned above, it is better to display the map large when on the history recording screen. When you load a history record, the map is displayed large. The recording area of the SD card is also divided into an event recording area, a continuous recording area, and a history recording area. Continuous recording can only record for about an hour, but history recording can record for 24 hours, or 500 hours. History records location information, speed information, acceleration information, brake information, and turn signal information. History recording is different from event recording and continuous recording. History recording is simply continuous recording without video data. You can record up to 500 hours depending on the settings. History also remains in video data such as continuous recording and event recording. History information with video can be linked and the video can also be displayed.

[Sixth Example]
FIG. 41 shows the sixth embodiment, and is a flowchart showing an example of the processing procedure of the personal computer 50.

When the playback software that displays the playback window 100 is activated, the process shown in FIG. 41 starts. Then, data representing the clock frequency of the CPU 58 of the personal computer 50 is read (step 291). Based on the read clock frequency of the CPU 58, it is determined whether frames will be dropped in the reproduction of the specified video (step 292). If it is determined that dropped frames will occur (YES in step 292), a message is displayed on the display screen of the display device 52 to the effect that frames may be dropped in the video because the processing capacity of the personal computer 50 is low (step 293). ). If frame drop does not occur (NO in step 292), the process in step 293 is skipped.

Thereafter, the playback window 100 is displayed on the display screen of the display device 52 (step 294), and the video is displayed in the video display area 111 (step 295). The user understands that the frame dropout is not due to a problem with the captured video or the device that takes the video, but rather due to the ability of the personal computer 50 that plays back the video. Although the playback window 100 is displayed after the display that a frame drop will occur, the playback window 100 may also be displayed together with the display that a frame drop will occur. In particular, it is preferable to display on the playback window 100 that a frame drop will occur.

In the example shown in FIG. 41, it is determined whether frame drop occurs based on the clock frequency of the CPU 58, but it is not limited to the clock frequency, but also the capacity of the RAM (random access memory) included in the personal computer 50, The capacity of VRAM (video random access memory), the reading speed of the SD card reader when video data is recorded on the SD card 23, the reading speed of the hard disk driver when video data is recorded on the hard disk, etc. It may also be possible to display that frame drop will occur based on the capability, performance, etc. of a system such as the personal computer 50. In addition, when the ability or performance of the personal computer 50 is low (for example, when the ability or performance is such that it cannot play back in the same situation as the one at the time of shooting), instead of dropping the video frame, it is possible to You can also reduce the number of videos or play them in slow motion. In that case as well, it is preferable to display (this is an example of notification) that slow playback will be performed due to the ability, performance, etc. of the personal computer 50. It is only necessary to notify that the device does not have the ability to process images.

Moving images or opening images in a separate window takes a lot of CPU power from your PC. Some PCs do not allow you to display video, such as playing in a separate window or changing the display range of the video at double speed. If you have a PC that cannot be moved, it may be a good idea to restrict it so that it can only be moved when it is paused. If you set up a separate window button and set the playback window 100 and the video window as separate windows, you can press the separate window button. You can't play it in a separate window if you don't have it. Please have a computer with these specs.''

[Seventh Example]
42 to 46 show a seventh embodiment, in which playback is performed from a predetermined playback position.

Figure 42 is a flowchart showing the processing procedure for video analysis. The processing shown in Figure 42 begins when the video to be analyzed is specified and a video analysis command is given to the personal computer 50. For example, the processing shown in Figure 42 begins when a playback window 100 with a video analysis button formed therein is displayed, a video is specified, and the video analysis button is pressed.

Video data representing the video to be analyzed is read (step 301), and the user inputs the conditions for the scene to be found in the video (step 302). For example, a menu may be displayed by right-clicking on the video display area 111 of the playback window 100, and the desired scene may be selected from the menu, or a word describing the desired scene may be input from the menu. Once the scene conditions are input, the video data is analyzed, and video portions that match the input scene conditions are detected (step 303). The times of the video portions detected for each scene condition are stored in the header of the video file in which the video data representing the analyzed video is stored (step 304).

FIG. 43 is a flowchart showing the processing procedure of the personal computer 50. When the software of the playback window 100 is activated, the processing shown in FIG. 43 starts.

The playback window 100 is displayed on the display screen of the display device 52 of the personal computer 50 (step 311). Data representing the time of the video portion that matches the scene conditions found in the video analysis is read from the header of the video file (step 312). In addition, data representing the history information associated with the video file is read (step 313). A first mark is added to the position indicating the time of the video portion that matches the scene conditions (step 314), and a second mark is added to the position indicating the time of the video portion based on the history information (step 315).

FIG. 44 is an example of the playback window 100.

In the playback window 100 shown in FIG. 44, a playback bar (seek bar) 300 is formed below the video display area 111. This playback bar 300 indicates the position of the video currently displayed in the video display area 111 among the entire video. A circular circle mark 351, a first cross mark 361, and a square second mark 362 are displayed on the playback bar 300. The circle mark 351 indicates the position of the video currently displayed in the video display area 111. The first mark 361 indicates the video position of a scene that matches the scene condition. For example, if "a scene showing a child" is specified as a scene condition, the video corresponding to the position of the first mark 361 is a video showing a child. Multiple scene conditions may be specified. The mark does not need to be changed according to the type of scene condition, but it is recommended to change the mark according to the type of scene condition. The second mark 362 indicates the video position of the scene based on the history information (information about the vehicle). For example, if information on sudden braking is specified as the history information, the image corresponding to the position of the second mark 362 will be an image of sudden braking. Multiple pieces of history information may be specified. It is not necessary to change the mark depending on the type of history information, but it is preferable to change the mark depending on the type of history information.

Below the play bar 350, a first skip play button 341 and a second skip play button 342 are formed. The first skip playback button 341 displays the character string "skip 1". The character string “Skip 2” is displayed on the second skip playback button 342.

FIG. 45 is a flowchart showing the processing procedure of the first skip playback.

When the first skip playback button 341 is pressed (YES in step 321), the circle mark 351 is moved to the position of the first mark 361 that is closest to the circle mark 351 (step 322). If video is being played back, the video is skipped up to the position of the first mark 361 to which the circle mark 351 has been moved, and playback resumes from the position of the first mark 361 to which the circle mark 351 has been moved. If video is not being played back, a still image of the video corresponding to the position of the first mark 361 to which the circle mark 351 has been moved is displayed in the video display area 111. When the first skip playback button 341 is pressed again, the circle mark 351 moves to the position of the next first mark 361.

By using the first skip play button 341, you can view the video in a relatively short time while finding the video portion that matches the scene conditions.

Figure 46 is a flowchart showing the processing steps for the second skip playback.

When the second skip playback button 342 is pressed (YES in step 331), the circle mark 351 is moved to the position of the second mark 362 that is closest to the circle mark 351 (step 332). If video is being played back, the playback of the video is skipped up to the position of the second mark 362 to which the circle mark 351 has been moved, and playback is resumed from the position of the second mark 362 to which the circle mark 351 has been moved. If video is not being played back, a still image of the video corresponding to the position of the second mark 362 to which the circle mark 351 has been moved is displayed in the video display area 111. When the second skip playback button 342 is pressed again, the circle mark 351 is moved to the position of the next second mark 362.

By using the second skip playback button 342, the video can be viewed in a relatively short time while finding the video portion of the scene based on the history information. The first mark 361 and the second mark 362 need only have different display formats, and may have different shapes or colors.

When triggering an event search, you can play back each one to check, or remember the time and play it back, but as mentioned above, if you enter scene conditions such as "There was a person in the picture at that time. The traffic light was red. It was where and what time it was," events will be found according to that input. Continuous recording and event recording are recorded separately, but there is no correlation between them. When playing back continuous recording, you can see the points where the event recording is located by looking at the date of the event recording file. A line is displayed in the slide bar of the continuous recording file to indicate that an event is located at this point. You can jump directly to the position of such a line. It would be convenient if there was a button to jump directly to that line. Instead of pressing a button to jump directly to the event location, it would be better to use image analysis to jump directly to the location where the person was in the picture earlier. It would be good to display the location of the intersection, a person crossing the road, or a cute girl in the picture one after another. In addition to the event recording, you can use image analysis of the continuous recording video to extract traffic lights, people crossing the road, road signs, etc. as triggers. You can then display these locations one after another. It would be a good idea to change the line color for each type of trigger and repeat playback for each type. The playback command can be a button or a menu. It would be good to have an option for "jump" in the menu with various types of options.

[Eighth Example]
47 to 49 show the eighth embodiment.

FIG. 47 is a flowchart showing the transmission processing procedure of the drive recorder 1.

The processing procedure shown in FIG. 47 is for restricting the transmission of video data from the drive recorder 1.

When an event or the like occurs as described above and a transmission command is generated by the CPU 20a of the drive recorder 1, it is checked whether the number of times video data has been transmitted from the drive recorder 1 has reached the limit (step 341). . The limited number of times is a limited number of times within a certain period of time, and may be any number of limited times such as hourly, daily, weekly, or monthly. If the limited number of times has not been reached (NO in step 341), it is checked whether the total amount of transmitted data has reached the limited data amount (step 342). The total amount of restricted data is also the total amount of transmitted data within a certain period of time, and may be any of the total amount of transmitted data on an hourly, daily, weekly, or monthly basis. If the total amount of data to be transmitted does not reach the data limit (NO in step 342), the video data for transmission is transmitted to a predetermined server, etc. using the LTE module 21 of the drive recorder 1, as described above. (Step 343).

When the transmission is completed, the number of transmissions is increased by one (step 344). Data representing the number of transmissions is stored in the RAM 20c of the drive recorder 1. The amount of data to be transmitted is also stored in the RAM 20c of the drive recorder 1 (step 345).

If the number of transmissions has reached the limit (YES in step 341) or the total amount of data to be transmitted has reached the limit (YES in step 342), data indicating that data transmission is not possible due to the transmission limit is transmitted to the server, etc., using the LTE module 21 of the drive recorder 1 (step 346). As a result, data that has not been received can be transmitted to the server, etc., using Wi-Fi, etc., without using the LTE module 21. Also, video data may be read from a memory card.

Communication using the LTE module 21 is expensive, but since the data to be transmitted is limited, the cost can be kept down. Further, if there is data that has not been received, the existence is notified, so the data can be received by a method other than the method using the expensive LTE module 21.

FIG. 48 is a flowchart showing the processing procedure for ranking display.

The server detects the amount of communication data for each user (step 351). For example, if a SIM (Subscriber Identity Module) card is inserted into the LTE module 21 of the drive recorder 1 and LTE-based communication is performed using that SIM card, the amount of communication data can be detected for each user by accessing the server of the contracted company of that SIM card. When a display command is given to the server (YES in step 352), the amount of communication data is displayed for each user on the display screen of a display device connected to the server (step 353).

FIG. 49 is an example of a graph showing the amount of communication data.

Figure 49 shows the communication data volumes of users 1 to 6. It can be seen that, among the communication data volumes of users 1 to 6, the communication data volume of user 4 is larger than that of the other users. For example, if the communication data volume of user 4 is compared with the video data volume of user 4 sent to the server and there is a mismatch, it can be seen that user 4 is not sending video data from drive recorder 1, but rather, for example, removing the communication SIM card inserted in drive recorder 1 and misusing it for personal use. If the communication data volume of user 4 is compared with the video data volume of user 4 sent to the server and there is a match, it can be seen that if the driving is rough, many events will occur and the amount of video data sent will be large. This shows that user 4 drives rough. It can also be seen that the amount of video data is large due to poor video data transmission settings in drive recorder 1.

[Ninth Example]
50 to 52 show a ninth embodiment.

FIG. 50 is a flowchart showing the processing procedure of the drive recorder 1. For example, the process starts when the engine of the vehicle in which the drive recorder 1 is installed is turned on and the power of the drive recorder 1 is turned on.

A video data communication speed test is performed between the drive recorder 1 and the server (step 361). If the communication speed test is successful (YES in step 362), the resolution, frame rate, bit rate, etc. of the video data for transmission are determined in the CPU 20a of the drive recorder 1 based on the test results (step 363). . For example, if the communication speed is fast, the resolution, frame rate, bit rate, etc. are determined so that the video represented by the video data for transmission has relatively high quality; if the communication speed is slow, the video data for transmission The resolution, frame rate, bit rate, etc. are determined so that the video represented by the data has relatively low quality.

When a recording command is generated in the CPU 20a of the drive recorder 1 due to an event or the like (step 364: YES), video data for transmission is recorded at the determined resolution (step 365).

If the communication speed test is not successful (NO in step 362), it is confirmed whether the number of test failures has reached a predetermined number (step 366), and if the predetermined number has not been reached (NO in step 366), the communication speed test is retried (step 361). It goes without saying that the number of failures of the communication speed test is counted in the controller 20 of the drive recorder 1. If necessary, a counter is provided in the drive recorder 1. If the number of failures of the communication speed test has reached a predetermined number (YES in step 366), when a recording command is generated (YES in step 367), video data is recorded at a predetermined resolution, etc. (step 368).

51 and 52 show the processing procedure when the drive recorder 1 is equipped with a polarizing filter.

Figure 51 is a flowchart showing the processing procedure of the drive recorder 1.

When a recording command is generated, the process shown in FIG. 51 starts. The CPU 20a of the drive recorder 1 confirms whether a polarizing filter is attached to the camera 17 of the drive recorder 1 (step 371). For example, if the drive recorder 1 is provided with a switch that indicates that a polarizing filter is attached, the attachment of the polarizing filter is detected by detecting the state of the switch. If the drive recorder 1 is provided with a sensor that indicates that a polarizing filter is attached, the sensor detects that the polarizing filter is attached. The CPU 20a analyzes (image recognition) the image represented by the image data taken by the camera 17 (for example, analyzes whether there is reflection on the window glass of the interior of the car or the polarizing filter on the dashboard, etc.). Attachment of a filter may also be detected.

The video data is recorded on the SD card 23 (step 372), and identification data indicating that the video data was recorded with the polarizing filter attached is also recorded in the header of the file in which the video data is stored (step 374). A display device such as a light-emitting diode may be provided in the drive recorder 1, and the light-emitting diode may be lit when the polarizing filter is attached.

If the drive recorder 1 is not equipped with a polarizing filter (NO in step 371), the video data is recorded on the SD card 23 without recording the above-mentioned identification data (step 374). However, it is preferable that identification data indicating that the video data is recorded without a polarizing filter attached is recorded in the header of the file in which the video data is stored.

Figure 52 is a flowchart showing the playback process procedure in the playback window 100.

The process shown in Figure 52 begins when the file containing the video data to be played is specified and a play command is given using a play button or other means.

The header of the file in which the video data is stored is searched, and it is checked whether identification data representing video data recorded with the polarizing filter attached to the drive recorder 1 is recorded in the header ( step 381).

Subsequently, the video data is played back and the video is displayed (step 382). During playback of video data, the user is informed (by display, audio output, etc.) that the video data was shot with a polarizing filter attached (step 383).

Even if the identification data is not recorded, the video data is played back and the video is displayed (step 384). When playing back video data, the user is not notified (by display, audio output, etc.) that the video data was shot with a polarizing filter attached. It is best to notify the user that the image was taken without a polarizing filter attached.

As the image quality of drive recorders continues to improve, even things that cannot actually be seen may be recorded. If you were a driver who was involved in an accident, you would want to say in court that the situation was different from what you actually saw, but if it were to be shown as evidence in court, it would be a clearer image that would be disadvantageous to the driver. There is a possibility that it will happen. By including information such as the presence or absence of a polarizing filter at that time, it becomes possible to claim that ``this is a video taken when a polarizing filter was attached, so it is different from what I saw.'' Become. serves as proof of such a claim.

[Tenth embodiment]
53 to 56 show a tenth embodiment.

Figure 53 shows the processing procedure of drive recorder 1.

The drive recorder 1 has a function that allows it to make calls (communicate) with the smartphone of a user other than the driver of the vehicle in which the drive recorder 1 is installed. Of course, it can also make calls (communicate) with the smartphone of the user of the driver of the vehicle. When the drive recorder 1 is connected to a predetermined communication device such as a smartphone held by a user outside (or inside) the vehicle (YES in step 391), it is confirmed whether the videophone recording mode is set in the drive recorder 1 (step 392). It goes without saying that the drive recorder 1 is provided with a mode switch that can set the videophone recording mode. When the videophone recording mode is set (YES in step 392), data representing the contents of the call with the communication device is recorded in the SD card 23. For example, a call recording area is defined in the SD card 23, and data representing the contents of the call is recorded in the call recording area. A microphone is provided in the drive recorder 1, and voice is input to the drive recorder 1 using the microphone.

The drive recorder 1 and the communication device may communicate (call) by receiving a call from the communication device, or the drive recorder 1 and the communication device may communicate by placing a call from the drive recorder 1 to the communication device. Good too. Even while driving, it becomes possible to talk on the phone using the drive recorder 1. By providing the drive recorder 1 with a camera capable of photographing the interior of the vehicle, the drive recorder 1 can be used as a videophone.

Figure 53 is a flowchart showing the playback process steps using the playback window 100.

An SD card 23 on which a large number of files containing video data are recorded is loaded into a personal computer 50 for reproduction. The SD card stores not only files storing video data captured by the drive recorder 1, but also video data captured by surveillance cameras, etc. inside and outside the user's office, company, etc. It is assumed that many files are also recorded. In the headers of these files, data representing a user ID for identifying the user recorded in the video and the date of shooting are also recorded by image recognition or the like. Therefore, you can see who is in which file by shooting date.

For example, the user ID of the user who wants to check the date and trend of the video data to be played back is input, and one of the video files that stores the video data shot on that date is identified by the input user ID. Video data showing the user is found by the CPU 58 of the personal computer 50 (step 401). A plurality of pieces of video data that are found are continuously played back in chronological order (step 402).

The user's daily movements can be viewed on a continuous timeline, including camera footage when leaving the company or office, camera footage from the drive recorder 1, and camera footage when returning to the company or office. It is easy to see whether the user (employee) was working appropriately for a day, for example.

It will be possible to seamlessly play back footage from the dashcam and footage from the office. A dashcam can only tell you what the driver was like while they were in the car, but you can also see what the driver was like before they got in the car, what their face looked like when they came into the office, and whether they had been drinking. You can now see their movements throughout the day. In addition to footage from the dashcam, you can also get footage of them arriving at the office and when they report back home, and you can play back footage with the same driver ID on the same day in succession. If a driver goes to several places and turns off the engine at each place, the files will be separate even within a day, so you can link them together and play them back. You can also link footage from the office's surveillance cameras to play back the flow of a day. You can play back footage from the office, the first visit, the second visit, and so on, in succession. For example, the operation managers of trucks, buses, and taxis need to take roll calls, and by recording this footage, the company and managers can confirm that they are checking in the morning, on the way home, etc.

FIG. 55 is a flowchart showing the processing procedure of the drive recorder 1.

The process shown in FIG. 55 starts when a recording command is generated in the CPU 20a of the drive recorder 1. The process shown in FIG. 55 is performed in the drive recorder 1 which has a configuration in which two SD cards, a first SD card and a second SD card, can be loaded.

The video data photographed by the camera 17 is temporarily stored in the RAM 20c. The video data is read from the RAM 20c and processed by the CPU 20a (step 411). For example, processing such as cutting out a part of a video (particularly a celestial video) and converting coordinates is performed. The processed video data is recorded on the first SD card (step 412). Data representing the processing content is recorded in the header of the file in which the video data is stored (step 413). Further, unprocessed video data is read from the RAM 250c and recorded on the second SD card (step 414). The video data recorded on the second SD card is video data that represents video closer to raw video than processed video data, and is, for example, RAW video data, video data compressed based on H246, etc. .

Record unprocessed video data on a second SD card, read and process the second unprocessed video data from the second SD card, and display processed video data and processed video data. It is preferable that the data be recorded on the first SD card.

In addition, video data representing the front image of the camera's drive recorder (especially spherical drive recorder) is recorded on the first SD card (one SD card), and video data representing the rear image is recorded on the second SD card. It is preferable to have a configuration in which the information is recorded on the SD card (the other SD card). If the video represented by the video data recorded on the first SD card and the video represented by the video data recorded on the second SD card are at least partially overlapped at the same time, good.

FIG. 56 is a flowchart showing a procedure for reproducing video data recorded on two SD cards as described using FIG. 55.

The first and second SD cards are loaded into a personal computer 50 or the like for playback.

The processed video data (first video data) and data indicating the processing details recorded on the first SD card are read from the first SD card (step 421). Also, the unprocessed video data (second video data) recorded on the second SD card is read from the second SD card (step 422).

A video represented by the second video data and a video represented by the first video data are displayed. At this time, a processing range indicating the processed portion of the unprocessed video is displayed (step 423). You can see which part of the entire video has been processed or displayed. In particular, it is preferable to synchronize two videos taken at the same time and display each video in two windows (display areas).

The video data may not be processed in the drive recorder 1, but may be processed in a playback device that plays back the video, such as a personal computer, and both the processed video and the unprocessed video (e.g., RAW video) may be displayed.

In playback devices such as personal computers, the two videos are recorded on separate SD cards, so it is necessary to understand the correspondence between the files, but this can be done by looking at the time.

[Eleventh embodiment]
57 to 59 show an eleventh embodiment.

FIG. 57 is a flowchart showing the processing procedure of the drive recorder 1.

In the processing procedure shown in FIG. 57, a share button is provided on the drive recorder 1. A signal indicating that the share button has been pressed is input to the controller 20 of the drive recorder 1. The share button does not necessarily have to be a physically existing button, but may be a software button displayed on the display screen of the display 11.

When the user presses the share button (YES in step 431), the video data recorded continuously, which represents the video shot within a certain period before and after the share button was pressed, is sent to a predetermined cloud server (step 432). The video data sent to the cloud server is saved in a storage location identified by a predetermined URL (Uniform Resource Locator).

In addition, data indicating the location of the vehicle when the share button was pressed, the time when the share button was pressed, and the URL that specifies the storage location of the cloud server where constantly recorded video data is stored is stored. is recorded in the header of the file (step 433).

Not only when the share button is pressed, but also when an event occurs as described above. It may be a function to send video data (which may also be video data) to a cloud server.

FIG. 58 is a flowchart showing the playback processing procedure in the personal computer 50.

The SD card 23 on which video data is recorded in the drive recorder 1 is inserted into the personal computer 50, and the playback button in the playback window 100 is pressed, starting the process shown in Figure 58.

A map showing the vicinity of the shooting location of the video being played back is displayed in the map image display area 121 of the playback window 100 (step 441). If the location represented by the map displayed in the map image display area 121 includes the location when the share button was pressed, an icon representing that location is displayed on the map (step 442). . Data indicating the location where the share button was pressed is recorded in the header of the file in which the video data is stored, so the icon is displayed on the map by reading from the header. In addition, the icon is clickable and has a URL link indicating the storage location of the video data. This URL is also recorded in the header of the file in which the video data is stored, so it is read from the header and linked to the icon.

When a user clicks on an icon displayed on the map (YES in step 445), request data for the URL linked to the clicked icon is sent. Then, the image data stored in the storage location specified by the URL is sent to the personal computer 50 that is playing the map. The user can view the image in the vicinity of the location where the share icon was clicked.

For example, by publishing a map on the Internet that displays the icon described above, a third party can view the image near the icon by looking at the map and clicking on the icon, enabling the captured image to be shared.

FIG. 59 is a flowchart showing the processing procedure of a smartphone that can communicate with the drive recorder 1.

The smartphone is placed within a range where it can communicate with the drive recorder 1 installed in the vehicle via Wi-Fi, Bluetooth (registered trademark), or the like. For example, when the drive recorder 1 is installed in a car, a smartphone is placed inside the car. Smartphones also have the ability to connect to the Internet via wireless LAN (local area network) with smart speakers placed in homes, offices, offices, etc. that have a wireless LAN (local area network) environment.

The smart speaker is used to send a command (trigger) to send, for example, video data to the smartphone. When the command is received by the smartphone (YES in step 451), the received command is sent by the smartphone to the drive recorder 1 (step 452). For example, if a command such as "Give me a video of Mr. A" is spoken to the smart speaker, the command is sent to Mr. A's smartphone, and a command to send video data is sent from the smartphone to the drive recorder 1 installed in the car that Mr. A is driving.

When the drive recorder 1 receives a transmission command from the smartphone, the video data recorded in the drive recorder 1 is transmitted from the drive recorder 1 to the smartphone in response to the command. The video data transmitted to the smartphone may be video data recorded immediately before the command was received, video data before or after the timing at which the command was received, or video data recorded on the day the command was received.

When the smartphone receives the video data sent from the drive recorder 1 (YES in step 453), the received video data is sent from the smartphone to the server (step 454).

In this way, the smartphone can be connected to the cloud, and the trigger can be pushed from the cloud to the smartphone and sent from the smartphone to the drive recorder connected to the smartphone via Wi-Fi or Bluetooth. It would be extremely convenient to be able to work in conjunction with IFTTT etc. For example, if Administrator X says to a smart speaker installed in the office, ``I would like to receive the video of Mr. A,'' a notification will be sent to Driver A's smartphone, and the smartphone will send a trigger to the dash recorder and record it on the dash recorder. Allow the user to set the trigger name. The viewer displays the set trigger name. For example, it may be displayed as ``Voice trigger for shooting from administrator

The smartphone is connected to the cloud. Since the smartphone is connected to the Internet, if the drive recorder does not have the function to directly connect to LTE, the smartphone can connect to the Internet. The smartphone and the drive recorder are paired and connected via Bluetooth. The server issues instructions to the smartphone, which then issues instructions to the drive recorder. If you instruct a smart speaker installed in the office to send a video of a certain driver, the smart speaker will issue instructions to the smartphone, which will then issue instructions to the drive recorder. The name of the trigger is important. Currently, the names of triggers are fixed, for example, acceleration triggers, switch press triggers, and other fixed triggers, but it would be good if triggers could be named. It would be good to be able to set a trigger such as X-san giving Y-san an instruction to shoot. It would be good if users could change the name of the trigger themselves in the viewer. To display the trigger name in the viewer, a green line is attached to the slide bar during an event, and if you move the mouse over the green line, the trigger name will pop up there. It would be good if the trigger name popped up, such as a yellow line indicating a smartphone trigger, or the smartphone trigger being a trigger from administrator A.

Also, since gamers are concerned about FPS (frames per second), it is a good idea to provide a PC viewer with a function that displays the recording frame rate and display frame rate. The viewer may be provided with a frame completion function. Although the recording frame rate is fixed, playback may not be able to reproduce the recording frame rate depending on the PC's capabilities. Both the recording frame rate and the playback (display) frame rate are displayed on the display screen. Displays something like a superimpose on the top left of the video being played. It is displayed at 30fps for recording and 25fps for playback, and the playback will change. It turns out that the video is not displayed smoothly, not because the specs of the drive recorder are bad, but because the specs of the PC are bad.

[12th Example]
60 to 62 show the twelfth embodiment.

FIG. 60 shows the processing procedure when playing back video data, and includes a flowchart showing the processing procedure of the playback device of the personal computer 50 and a flowchart showing the processing procedure of the robot that can communicate with the personal computer 50. Showing.

The robot is, for example, a humanoid robot with a head, arms, and legs attached to a torso. The robot has a communication function with a personal computer 50, such as Wi-Fi. The robot's movements are controlled by a computer built into the robot, and the robot has a function of performing movements according to the contents of communication with the personal computer 50. The robot is not limited to a humanoid robot, and may be an animal-shaped robot such as a dog or cat.

When the SD card 23 on which video data is recorded is loaded into the personal computer 50 and the playback button is clicked after starting the playback program, the video data is played back (step 461). During reproduction of the video data, when an impact point such as a sudden brake is reproduced (YES in step 462), a command to perform an impact action is sent from the personal computer 50 to the robot (step 469).

When the robot receives the command sent from the personal computer 50 (YES in step 471), the robot performs a falling motion in response to receiving the command (step 472). The robot gets up and warns the user about dangerous driving (step 473). For example, it outputs a voice message to inform the user that the driving is dangerous.

If the reproduction of the video data is not completed (NO in step 464, NO in step 474), the reproduction device repeats the processing from step 461, and the robot repeats the processing from step 471.

Send motion instructions from the PC viewer to the communication robot. For example, when playing back the part where the impact occurred, the communication robot behaves as if it would fall over. Then he gets up and makes a scolding motion telling him that he shouldn't drive in such a dangerous manner. It is extremely effective when placed in driving schools, etc. It would be upsetting to be scolded by an operator of a bus or transportation vehicle, but if it is scolded by a robot, it has no effect on human relationships. Normally, when a person called a traffic manager instructs a driver, the traffic manager gives the guidance, but instead, the robot objectively tells the driver. The contents of the trigger are associated with the contents of the robot's speech, and the robot speaks when the trigger is played. Remember the movements as well. It moves and adjusts the volume according to the magnitude of acceleration such as a G sensor. The correspondence relationship is recorded, and the robot instructs it when it is time to play it back.

Also, in the personal computer 50, it is a good idea to give up on reports and provide a function for exporting presentation files. Commercial driving recorders have a function for printing out paper reports for business use. These include verbal warnings such as, "How many sharp turns did you make?" Reports can be output using the print function of a PC viewer. Instead of printing out reports, there are presentation files, something like PowerPoint templates, which output a file showing how many points you received for your driving.

FIG. 61 is a flowchart showing the processing procedure of the virtual reality device.

A video data reproducing device such as a personal computer 50 and a virtual reality device are connected. The virtual reality device includes a VR controller and a head-mounted display, and a user wears the head-mounted display and operates the head-mounted display using the VR controller. When the user wears the head mounted display, the playback window 100 is virtually displayed (step 481).

When the dual screen display button formed on the VR controller of the virtual reality device is pressed (YES at step 482), the user wearing the head mounted display can see the first window and the second window. . The first window corresponds to the playback window 100 shown in FIG. 26 and displays operation buttons, and the second window corresponds to the video display window 160 shown in FIG. 26 and displays video. (Step 483).

When the unfolding display button formed on the VR controller of the virtual reality device is pressed (YES in step 484), the user wearing the head-mounted display will see an unfolded spherical image displayed ( step 485).

A Windows application window can be positioned in three-dimensional space as a plane (board) or as part of a gentle cylindrical surface (or sphere). When the PC viewer (playback software that controls the playback window 100) is launched, the application screen can be similarly positioned in three-dimensional space as a plane (board) or as part of a gentle cylindrical surface (or sphere). Therefore, when the PC viewer's dual-screen display button is pressed, one side is displayed as the PC viewer operation section, and the other side is displayed as the playback image.

As mentioned above, there is a display button that expands (texture mapping) a spherical image over the entire interior of the sphere, starting from the location where the person is in the VR space. By pressing this button, you can view the video as if you were actually inside the car. The sphere may be displayed at the back of the Windows window, but the window may also be displayed in a state where all windows are hidden so that the user appears completely inside the car. It would be a good idea to be able to switch between the two companies using a button on the controller. The ball may also be displayed in front of the window. Change your position to the outside of the sphere (if you move forward, you will go outside the sphere and can operate the operation window etc. For example, it is a good idea to expand the image outside the sphere while you are outside the sphere. If you do this The image can also be viewed from outside the sphere.Instead of developing it into a perfect sphere, it may be mapped onto a curved surface that is set to correct distortions of optical systems such as lenses.Projecting the image It would be good to have a function to make the spherical surface semi-transparent.It would be good to be able to make it semi-transparent by pressing a button on the controller.The origin position and the radius of the sphere should be changed by moving the left and right sticks of the controller up and down, etc.Thumbnail Display, map display, acceleration graph, etc. should be arranged as independent panels in the three-dimensional space inside the sphere.Playback control functions such as play, stop, and next event should be configured so that they can be performed using a controller.

There is a VR headset, and when you start up a PC viewer, the VR image is displayed like a board. When you play the image, the celestial sphere image is played on that board. When trying to display two screens, it is best to configure it so that the viewer's controls are on the left and the boards of the images being played are on the right. A display button is provided that expands the celestial sphere image inside the sphere, with the location of a person in the VR space as the origin, and pressing this button switches to VR mode. It is best to configure the display so that you feel as if you are inside the celestial sphere. It's like you're sitting in the driver's seat. In reality, it feels like you are in the installed position.

It is recommended that the ball be displayed at the back of the Windows window. You can view the image of the ball while watching the image on your computer (while operating your computer). You can also hide the window operation window so that you are inside the image. Use the control button to switch between the two. Use the stick on the controller to adjust the radius of the ball. The position of the origin can also be adjusted with the stick. The ball can be in front of the window. If you look behind in this state you will be looking at the ball, but if the user moves and breaks the ball you will be able to see the image. If you look behind in this state you will see the ball, so if you attach an image to the back of the ball as well, the image can be seen from outside the ball.

In reality, there is lens distortion, so the image develops into the shape of a rugby ball or egg. You can view images with lens distortion corrected. The window contains a map display, acceleration graph, and operation buttons, and these buttons and objects are assigned to the VR screen. Something like an operation panel is displayed as a panel in three-dimensional space.

Figure 62 is a flowchart showing the processing procedures of the drive recorder 1, smartphone, and television device.

The process shown in Figure 62 involves viewing the video data recorded on the SD card 23 loaded in the drive recorder 1 on a television device located at home, in the office, at a business establishment, etc.

A user at home, in an office, or at a business uses a smartphone to send a playback command to the drive recorder 1 installed in the vehicle (step 501). When the vehicle engine is turned off, the drive recorder 1 is powered by a mobile battery or the like and receives the playback command.

When the playback command sent from the smartphone is received by the drive recorder 1 (YES in step 491), the video data recorded on the SD card 23 is read, and the read video data is transferred from the drive recorder 1 to the smartphone. (step 492).

When the video data transmitted from the drive recorder 1 is received by the smartphone (YES in step 502), the received video data is transmitted from the smartphone to the television device (step 503).

When the video data transmitted from the smartphone is received by the television device (YES in step 511), the video is played back and the video captured by the drive recorder 1 is displayed on the display screen of the television device. becomes (step 512). Television equipment has the ability to connect to smartphones via Wi-Fi, and uses Wi-Fi to receive and play video data sent from smartphones. Alternatively, the television device may be connected to a LAN in a home, office, office, etc., and connected to the Internet. Video data will be transmitted from the smartphone to the television device via the Internet.

When you say something like ``play pandas on a video playback site'' to the smart speaker, the TV connected to the Wi-Fi device turns on and the panda video plays on that TV. When you don't need to make detailed instructions, such as when you want a video to be played on your TV as BGV, it is very convenient to be able to give rough instructions via voice and have it played back on your TV. Many people do not play back the video on their dash record unless an accident occurs, and the video they take is rarely used. Furthermore, even though the drive recorder was not working properly before the accident occurred, if an accident occurs while using it without knowing this, the important accident video will not be recorded. Such a situation is possible.

Make it possible to play dashcam footage by voice. It is possible to operate it from a smartphone in the car, but if the car is near the house and has Wi-Fi or other signals, it is better to operate it from a smartphone, smart speaker, communication robot, dedicated device, etc. at home. When you say "Play dashcam footage" to a voice recognition device (smartphone, smart speaker, communication robot, etc.), it will turn on the dashcam, stream the footage from "your" dashcam wirelessly via Wi-Fi or other means, and play the footage on a TV (it will run on battery power if the engine is off). When you say "Play yesterday's dashcam footage," it will search for yesterday's dashcam footage or a storage device (smartphone or PC) that stores data already transferred from the dashcam, and if there is any, it will play it. If there is no dashcam footage, it will say "Yesterday's dashcam footage was not found." It is better to play the footage from the nearest dashcam instead, such as "I will play the dashcam footage from the day before yesterday instead." If you say, "Play the dashcam footage from when I just went out," the most recent dashcam footage will be played. When playing back dashcam footage, it is a good idea to play the audio recorded along with the dashcam footage, but it would also be good to have a function to play other music as background music. If you say, "Set the background music to XX," it will change to the dashcam audio, and that song will be played along with the video on a music streaming service such as Spotify. It is a good idea to play a digest of the part where an event is occurring. It is a good idea to be able to specify the playback time, such as "Play the dashcam footage for about 5 minutes." In this case, for example, the footage will be played all at once at the specified time. It is a good idea to prioritize unplayed footage when playing back.

When a voice saying "Save this video" is recognized while the video on the drive recorder is "playing", the video file being played is transferred from the drive recorder to a storage device (smartphone, PC, etc.) via Wi-Fi etc. Forward. You can also upload it to video posting SNS and share it. When a voice saying "Save this video" is recognized while the video on the drive recorder is "recording", the record is transferred from the drive recorder to a storage device (smartphone, PC, etc.) via Wi-Fi, etc., a predetermined time before that point. The recorded video from the beginning and video data from that point until a predetermined time later are used as an audio instruction trigger to record the video on the drive recorder. When a voice saying "Send video" is recognized while the drive recorder is "recording" video, the recorded video from a predetermined time before that point and the video data from that point are sent to the server, etc. using LTE, etc. Send. You can also upload it to video posting SNS and share it. When the voice saying "Stop video transmission" is recognized, the transmission of the video to the server etc. is stopped. When a voice saying ``Send me the video up to this point'' is recognized while the camera recorder is ``recording'' video, the video that has been recorded from a predetermined time up to that point is uploaded to the server using LTE, etc. You can also upload it to video posting SNS and share it. When you say ``Start live streaming'' in front of the drive recorder, live distribution of the drive recorder video starts.

There are AI speakers, speakers connected to the cloud, and devices that connect smartphone images to a TV. On a smartphone, you have to specify each video one by one, but if you say ``play a panda video,'' the related video will continue to play automatically. The video on the drive recorder will not be played unless an accident occurs. In some cases, the drive recorder may not be working properly when an accident occurs. Play video on a drive recorder using voice instructions. In the car, use voice commands to operate the drive recorder on your smartphone. If your house and car are close to each other and the Wi-Fi signal from your home can reach your car, you can play the video from your car's dash recorder from home via Wi-Fi, and then watch the video from your dash recorder on the TV inside your house. Reproduce. Voice recognition technology allows you to stream images from your dash recorder to smartphones, smart speakers, robots, etc., which automatically turns on the power to a dash recorder near your house and broadcasts the image from your own dash recorder over Wi-Fi. Transfer and play on TV. Instead of giving a playback command to an AI speaker and playing a YouTube video, it gives a playback command to an AI speaker and plays pre-registered video on a smartphone, TV, etc. If the car's engine is off, it will run on battery power. The drive recorder itself only needs to function to receive instructions. When instructions come via Wi-Fi, the entire device is turned on and runs on battery power to transfer images. The cigarette socket burns out when the engine is turned off. The cigarette lighter socket connects to a mobile battery, and the mobile battery supplies power to the drive recorder. Up until now, I had to remove the SD card and put it into my computer to play it, but now I can easily view it.

If you ask me to play the video from yesterday's drive record, the video from yesterday's drive record will be played. You can specify the date of playback video. If it's not found, you can say ``Not found,'' or ``You can play the video from the day before instead of yesterday's video.'' If you say the video from when you just went out, you can play the ``latest drive record video.'' There is a designation function called "when". The drive recorder also records audio. Continuous recording and event recording also include audio. You can play the music as is by streaming, but if you want to do something about the BGM, the BGM will be played from a music streaming service instead of the audio from the drive recorder. You can watch driving record videos with music as BGM. The playback is a digest playback focusing on the part where the event occurs. There's no point in letting the long ones flow lazily. Skips about 30 seconds of the event and plays it back. To enable specifying the playback time of video on a drive recorder. Adjust by playing a digest of the event for about 5 minutes. Give priority to playing unplayed videos. Record that it has been played on your drive recorder, smartphone, etc. If you want to watch a video later while playing a video on your dash record, you can say ``Save this video,'' and the file will be transferred from your dash record to your smartphone via Wi-Fi.

If you are driving in the car while recording video on your dash recorder and say, ``Save this video to your smartphone,'' the dash recorder will transfer it to your smartphone if you have one in the car. If you say, "Save this video on your drive recorder," it will be recorded on your drive recorder as an event record. You can also say, "Start recording this video" or "Stop recording this video." It may be recorded in a separate area as voice instruction recording data. If you want to send this video while recording, it will be sent to the server using LTE. If you say "Stop sending video," it will stop sending the video to the server. If you want to send the video up to this point during recording, the constantly recorded data up to the previous set time will be sent to the server via LTE. When you say "Start live streaming" on Dorareko, the live streaming starts. Keep uploading it on stream.

[Thirteenth embodiment]
63 to 65(A), 65(B), 65(C), 65(D) and 65(E) show a thirteenth embodiment.

The 13th embodiment concerns thumbnail image display.

FIG. 63 is a flowchart showing the processing procedure for displaying thumbnail images in a playback device such as the personal computer 50. FIG. 64 is an example of displaying thumbnail images. FIGS. 65(A) to 65(E) are examples of display formats of thumbnail images.

This embodiment is suitable for displaying thumbnail images of circularly recorded video captured by a semi-spherical camera or a spherical camera, but can also be applied to displaying thumbnail images of other types of video.

Referring to FIG. 64, when an SD card 23 on which video data representing a plurality of videos is recorded is inserted into a personal computer 50, the playback software is started, and a playback window 100 is displayed on the display screen of a display device 52, thumbnail images Ith1-Ithn of the plurality of videos are displayed, for example, in a play list display area 141 of the playback window 100. When a cursor 531 is placed on one of the thumbnail images Ith1-Ithn of the plurality of videos and clicked (YES in step 521 in FIG. 63), a pop-up menu 530 for selecting the display format of the thumbnail image is displayed on the clicked thumbnail image (step 522 in FIG. 63).

Referring to Figure 64, the pop-up menu includes thumbnail image display menus for "Fisheye display," "Enlarged flat display," "Panorama display," "Ring display," and "Dome display." There is.

"Fisheye display", as shown in FIG. 65(A), displays a still image of a video shot using a fisheye lens as a thumbnail image. As shown in FIG. 65(B), the "enlarged flat display" is for displaying a part of interest to the user as a thumbnail image, enlarged more than other parts. As shown in FIG. 65(C), the "panoramic display" displays a horizontally long 360-degree image in the form of a thumbnail image. "Ring-type display" is to display thumbnail images in a ring-type manner, as shown in FIG. 65(D). The "dome-shaped display" is to display thumbnail images in a dome shape, as shown in FIG. 65(E).

The display method for one of the thumbnail images is specified using the pop-up menu 530 (step 523). If specified (YES in step 523), the clicked thumbnail image is displayed in the specified display method (step 524). Even if there are multiple thumbnail images, each thumbnail image can be displayed using a different display method.

In software for managing the playback of video files, thumbnail displays are known that display a reduced version of the first image of a video in order to view the video for the purpose of selecting a desired video. Such thumbnail displays usually display a reduced version of the first image of a file or a still image of a specified frame. However, since the video from a hemispherical camera is recorded in a circular shape, it is desirable to have a thumbnail display that allows you to select the display state, but it is generally not possible to change the display form of the thumbnails, and it is not possible to change the display range either. On the other hand, in some smartphone apps, you can switch between thumbnail displays by tapping the icon, you can change the display form of the thumbnail display, and you can move the display range of the video by flicking the thumbnail, but the thumbnail display method is switched all at once.

To this end, as described above, a function is provided to change the thumbnail display method and display range "for each individual thumbnail." Right-clicking on an individual thumbnail displays a pop-up menu that allows you to select how the clicked thumbnail is displayed. The above-mentioned methods are suitable for displaying thumbnails. As described above, display methods such as fisheye display, panoramic display, enlarged flat display, ring-shaped display, and dome-shaped display may be provided. Further, original, twin cut, panoramic cut, and angle cut may be provided. Left-click on an individual thumbnail to change the video display range. It is a good idea to change the display range. It is a good idea to provide menus such as "Rotate 180 degrees" and "Rotate 90 degrees" in the right-click menu. In the case of two cameras, it is recommended to provide "camera switching". It has a function to save the changed thumbnail display method and display range.

As a general rule, it is best to configure the configuration so that the changes made are maintained. It has the ability to undo and redo changes to the thumbnail display method and display range. It has a function to match the display method and display range of thumbnails among thumbnails. If you left-click while holding down the shift key, a selection frame will be drawn around the thumbnail. Displayed by right-clicking on one of the thumbnails when there are multiple selection frames. Changes all thumbnails with selection frames in the display method selected in the pop-up menu. Also, when there are multiple selection frames, if you drag one thumbnail to the left, the status of all the thumbnails with selection frames in the range displayed by that thumbnail will be linked and changed in real time. Note that the selection frame is preferably released (selected state is released) when the left click on a portion other than the thumbnail is released.

It is advisable to provide rows that display thumbnails that are considered to be of the same time (for example, the same frame) but have different thumbnail display methods or display ranges. For example, with a 360-degree x 2 camera, a row of thumbnails with a 360-degree fisheye view of the front and a row of thumbnails with a 360-degree fisheye view of the rear are provided, and thumbnails of the same time are drawn in the same column. It is advisable to provide a function that allows the number of thumbnail rows to be increased arbitrarily. To increase the number of thumbnails, it is advisable to provide a space between the rows in the thumbnail display area, right-click on the space, and select "Insert Row" from the pop-up menu that appears. It is also advisable to provide items such as "Delete Upper Row" and "Delete Lower Row" in this pop-up menu. It is advisable to provide a scroll bar to scroll through the rows or columns that exceed the display range of the screen. For example, ten rows of thumbnails can be created for two 360-degree cameras, and displayed from top to bottom as follows: front fisheye display, rear fisheye display, panoramic display centered on the front, panoramic display centered on the rear, enlarged flat display centered on the bottom, enlarged flat display with the top cut off, ring display with the front as the most visible part, ring display with the rear as the most visible part, dome display with the front as the most visible part, and dome display with the rear as the most visible part. Each column will display all of these types of images at the same time. By scrolling left and right, the columns can be moved left and right, allowing the user to see all the thumbnails.

It is a good idea to provide a function that plays the image of a thumbnail when the thumbnail is selected by double-clicking the left mouse button, and it is especially good to start playback in the display method and display range set as the thumbnail. A "Set this state as thumbnail" option should be provided in the pop-up menu that appears when you right-click in the playback window, and when this is selected, the image in the display method and display range at that time should be set as the thumbnail for that image. Thumbnail display is when an area is set up to display the original image corresponding to the thumbnail that was right-clicked, and a function should be provided to clearly indicate the display area of the current thumbnail within that original image (by surrounding it with a line, filling it with semi-transparent paint, etc.). In this way, it is easy to see which part of the original image is set as the thumbnail.

It would be good to have a function that clearly shows "the parts that connect images." For example, draw a red line on the stitched part. As the stitching accuracy increases, the joints become harder to see. You don't want to use seams in commercial photographs, etc., but if it becomes difficult to see, you may end up cropping across the seams, and it may become a problem if broken seams are discovered after delivery, such as after commercial printing. If you have such a function, you can deal with it.

Equipped with a "function to clearly indicate the reflected parts of the main body". For example, it is recommended to have a function to fill the parts corresponding to the main body with a shaded or semi-transparent fill. On the viewer screen, an "area to indicate whether the image is blurred or not" is provided. An icon may be displayed to indicate that the image being played is a blurred image, or an icon to indicate that the image is blurred may be displayed in the list of file names. In relation to "wireless live streaming", it is recommended to have a function to record along with live streaming, store information that indicates which of the recorded images are streaming, and display whether the recorded image is live streamed or not when playing it in the viewer. It is possible to simply record live streamed and non-live streamed files separately and store information on whether the file is live streamed or not in the file properties, but it is particularly recommended to record the live streamed range and non-live streamed files in a distinguishable manner within one file, and display the two areas on the timeline in a way that makes them distinguishable.

It is recommended that the system be provided with a function for recording footage that identifies it as time-lapse footage, and for displaying whether or not it was time-lapse footage when the footage is played back in the viewer. It is recommended that the system be provided with a function for handling a series of time-lapse footage as a single collection. It is recommended that the system be provided with a function for recording footage by adding information about which device the recording start, recording end, and setting instructions came from, and for displaying that information in the viewer. It is recommended that the system be provided with a function for operating the parts equivalent to the viewer's buttons using voice recognition, in particular a function for changing the display method and display range. It is also recommended that the system be provided with a function for changing the recording method and recording range using voice recognition.

The semi-spherical camera records in a circle. Some allow you to select the state of the thumbnail. There are long thumbnails, ones that can be switched between two, and ones that spin around when you flick. When you switch thumbnails, multiple thumbnails switch at once. For this file, you cannot change the thumbnail to a spherical one or a long one, so it would be good to have a function that allows you to do so. It would be good to have a function that allows you to right-click on the thumbnail and have a pop-up menu that allows you to select the type of display method. There are display methods for thumbnails on the forklift drive recorder, such as fisheye display, panorama display, and flat display, and it would be good to be able to specify these display methods for each thumbnail. It would be good to have a function that allows you to change the display method of the image when you left-click. It would be good to have a function that allows you to move by dragging inside the thumbnail. In the right-click menu, you can rotate 90 degrees, 180 degrees, etc. In the case of two cameras, you can provide a camera switch. It would be good to have a function that allows you to save the display method and display range of the changed thumbnail. It would be good to be able to save the state of the thumbnail. When you rotate it, the rotated state is saved. This can be used when you want to see only the driver.

Add a button to undo the change in thumbnail display method and display range. Return to initial state after operation. Cancel a small movement and return to original state. It would be good to have a function to align thumbnails. To align all thumbnails in the range in which the driver is shown, it is troublesome to align them one by one, so for example, by holding down the control key and left-clicking, an outer frame will be created, and by right-clicking, a pop-up menu will appear with display methods. Selecting will switch the display method all at once. It would be good to drag the contents with the selection frame so that they all move. Clicking an unrelated area will cancel the selection frame. It would be good to have rows that display thumbnails that are considered to be of the same time but have different thumbnail display methods or display ranges. I want to create thumbnail rows with different views. There is only one thumbnail row for each, but it would be good to have a function to display thumbnails from different views. For example, it would be good to display thumbnails from the front camera and the rear camera with a 360-degree camera. Add rows, but make the columns the same time. It would be good to be able to add thumbnail rows as desired. It would be good to be able to view them from various display methods and angles. It would be good to have space between the rows of thumbnails, and then when you right-click on that space, a new row of thumbnails would be inserted and displayed. When you insert a row, it would be good to have the copied items displayed as a basic rule. You can change them individually, or you can display a selection frame and change them all at once.

When you select a thumbnail with a left double click, the image in the thumbnail will be played. This will be done in the display method and display range set for the thumbnail when playback begins. If a circular thumbnail is displayed, double-clicking will play it in circular form. If a thumbnail is displayed in a long and narrow form, the image will be played in the same way. The image being played will be made into a thumbnail. Right-clicking on the playback window will display a menu for making it into a thumbnail, and the displayed image will be made into a thumbnail. It is recommended that the default be the first frame of the file.

It would be good to have a function that shows where it is in the whole. Displays the part of the displayed video that the thumbnail is showing.

With a full celestial sphere, it is necessary to connect the front image and the rear image, but since the connecting part is noticeable, it would be good to have a function that clearly draws a line where it is connected. When you press the button on the PC viewer, a line will be displayed. Reduces glare. Parts of the camera body, such as hands, are processed and erased, but it would be good to have a function that clearly indicates these parts, such as by shading them, so that they can be seen. In the case of a video with automatic face blurring, it is preferable to display on the PC viewer that the video has face blurring. You may also want to automatically blur faces on sites where you upload video from your drive recorder. A recording function is provided along with live streaming, and commands to start and end streaming are always recorded. You can see where in the recorded video you streamed. It may be displayed in pink in the live streaming section and slide bar. You can set time-lapse photography to, for example, take still images every hour or take 10 seconds. It is a good idea to always include a mark in the record to indicate that the photograph was taken as a time-lapse photograph. Videos shot in a time-lapse manner may be combined into one video.

Shooting starts based on instructions from some device. For example, when a door opens, an instruction comes. Record the device from which recording started and ended. Receive and record device ID, etc. Give each viewer button a name. Change settings by voice. Once set, the drive recorder will respond with the settings and begin recording with those settings.

Additionally, a SIM contract is required in order to upload video data shot from a drive recorder using a mobile phone network such as LTE to the cloud. Up until now, drive recorder video viewers have not had any functions related to fees or data capacity. Therefore, there was a problem in that the viewer could not tell how much communication was being done or whether the rate plan was appropriate.

Dash cams for businesses can be equipped with features that accommodate a variety of communication fee plans depending on how the company uses its vehicles.

Low-speed flat-rate unlimited capacity plans, nighttime special plans, uplink special plans, corporate share plans, etc. It would be nice to have a feature related to low-speed, flat-rate unlimited services that cost 300 yen to 500 yen per month. A function that supports SIMs that do not allow high-speed communication and have a speed of around 200 kbps. With 200 kbps, it is possible to send audio and still images (jpeg) at speeds faster than real time. Even at monaural 64 kbps, the sound quality is sufficient to determine whether or not the sound is an accident sound. Therefore, past data can be transmitted in a shorter time than real time. A function that calculates a bit rate that is shorter than the actual time by combining past minutes from the current (recent history, etc.) communication bit rate or SIM contract bit rate, compresses it at that bit rate, and sends it. . A function to send the past part as a compressed file and the current part by streaming (IP phone may also be used). A SIM that has a data limit of up to a certain amount of data for a certain period of time, such as 366MB for 3 days. It would be good to have a function to display the remaining transferable capacity on the drive recorder and viewer. As you near your data limit, it's a good idea to limit the types of information you send. For example, you may want to change the settings so that only audio data is sent without sending photo data. A low-speed dedicated SIM that allows burst transfer (burst function: outputs about several Mbps for the first 1-2 seconds). At the beginning of sending when an event occurs, several photos (or even just one photo) taken at different times related to the event are sent, and then audio data is sent. Photos are transferred in bursts.

Functions to support nighttime specialized plans. One company's "nighttime specialized plan" limits download and upload speeds to a maximum of 200kbps between 6am and 10pm, but allows high-speed data transfers of up to 375Mbps download and 50Mbps upload at night from 10pm to 6am, at a low price of 3GB/month. It would be good to have a function that allows you to set times when high-speed data transfer is possible or when data transfer restrictions are imposed, and upload videos during times when high-speed data transfer is possible. In particular, it would be good to have a function that automatically turns on the power to the dashcam of a parked vehicle with the engine off during times when high-speed data transfer is possible, and starts transmitting video data.

Features compatible with upstream specialized plans. One company's ``uplink specialized plan'' keeps the downlink data communication speed as low as a maximum of 200kbit/s, but instead secures a wide uplink data communication speed of up to 50Mbit/s for sending data. The plan I did. 1.1GB is relatively low cost. Since it seems possible to secure the downlink IP phone bandwidth, it would be a good idea to have a function from the server that limits the downlink communication to instruction commands and IP phone communication. In other words, even if a drive recorder has a function of receiving video from another drive recorder, for example, it is preferable to limit that function.

Functions to support corporate share plans. In particular, corporate plans are expected to use data share plans, such as 50GB shared among 20 lines. It is recommended to have a function to scrape or obtain information from the management screen provided by SIM providers via API, count the SIM usage status on the dashcam, obtain the information at the center, and display it on the viewer. It is also recommended to have a function to display information comparatively. It is recommended to have a function to display the total packet usage and remaining available capacity of the dashcams that are sharing packets on the viewer. It is also recommended to have a function to issue an alert when the remaining capacity is low, and to display a graph of the predicted capacity usage. It is recommended to have a function to display the individual packet usage and remaining available capacity of the dashcams that are sharing packets in a ranking on the viewer. For example, by looking at the event status of the vehicle with the top dashcam, it is easy to verify whether the driver is driving poorly or the dashcam settings are poor. For companies that have multiple sharing groups, it is recommended to have a function to display the usage status between the sharing groups. This can be used as a reference for optimizing the allocation of SIMs for each dashcam to each group. It is also possible to use automatic analysis such as AI to advise on moving specific SIMs to other groups. It is a good idea to display the file size in the selection field for the object to be displayed in the viewer.

In the case of an SMS-compatible SIM, it is recommended to have a function that, when a trigger occurs, generates a character string with the importance of the trigger factor, such as information about the degree of maximum G, and sends it to the center phone number. It is preferable that the center (for example, a viewer) determines whether or not to send the transmission request instruction to the drive recorder based on the SMS data. It is preferable that the center determines information such as the type of data to be transmitted, such as video, and the transmission range to the drive recorder, and sends a transmission request instruction to the drive recorder.

If the SIM supports voice calls, it is a good idea to provide the dashcam with a voice call function and the center with a function to forward outside calls to the center (office). The center should obtain the driving status of the dashcam via LTE, etc., and have a function that does not forward outside calls when set conditions are met, such as when the dashcam is in driving mode. The dashcam should have a function to call the center using the appropriate method based on the status of the dashcam, such as the price comparison between IP phone and voice phone, the person being called, and past driving history. It is a good idea to provide a function to call the center by voice when a strong impact occurs and by IP phone when a weak impact occurs, and a function to call the center using VoIP and connect to outside lines by phone.

When public wireless LAN and LTE are used together, a connection function is provided to the public wireless LAN, and LTE sends restricted data, while public wireless LAN sends unrestricted or loosely restricted video data. It would be good to have a function that allows you to upload from convenience stores' free Wi-Fi, etc.

There are many types of pricing plans for drive recorders for corporations. In the case of low speed and low rate 200k, only the audio is sent first. The server identifies whether the sound of the accident is included, and then sends a video transmission request to the drive recorder to see the accident. You may also send several still images. It is better to vary the bit rate. The past portion is sent as a compressed file, and the current portion is sent as a streaming file. Past events are made into files and sent little by little, and current events are sent as audio and video stream data. The image is that if an accident occurs, an IP phone will be connected. Audio comes into the center. For example, SIM has a limit on the amount of data sent within three days. Restrict users who use a large amount. For such SIMs, the usage amount is displayed on the display screen of the drive recorder. You can see the remaining transmission amount. The viewer can also send the capacity in real time and display it in a list. As you near your data limit, it's a good idea to limit the types of information you send.

Among the low-speed SIMs there are some that are specially designed for burst transfers. A few megabits can be obtained for the first 1-2 seconds, but thereafter the speed is limited to 200k. Event-related video can be sent first, followed by audio. Video can be sent during times when high-speed transmission is possible, such as with a nighttime special plan, and only audio can be sent during restricted times. Video can be sent from a dashcam in a parked car at night. With an upload special plan, downloads are restricted. For example, when receiving footage from someone else's dashcam, this is restricted. With a corporate share plan, the footage can be obtained and viewed on the viewer. The viewer can also obtain SIM usage information.

It would be good to display a comparison between carrier usage and actual measured values. Display when you are approaching the limit. It would be good to display a ranking of packet usage. Display usage by group. It would be good to display file size.

In the case of a SIM that supports SMS, a character string indicating the time and minute of the trigger occurrence is generated and sent to the drive recorder based on the SMS data. It's best to use something like an old-fashioned pager. Send only important data by instant SMS.

With a voice-enabled SIM, calls can be made using a normal phone number, and external calls to the center are forwarded to the dashcam's phone number. The dashcam can be used to talk hands-free. In the event of a strong impact, a call is made by voice, and in the event of a weak impact, an IP phone call is made. In cases of emergency, a stable network is used. Calls with the center are made via VOIP, packet communication, or IP phone.

In the case of public wireless LAN, the dashcam is equipped with a public wireless LAN connection function, and when connected via public wireless LAN, it constantly records and uploads the data.

The scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of various aspects of the invention disclosed herein. Of the present invention, the structure for which a patent is sought has been specified in the attached claims, but currently, even if the structure is not specified in the claims, it is not disclosed in this specification. The applicant intends to make such a configuration the scope of a patent claim in the future.

The present invention is not limited to the configuration described in the embodiments described above. The components of each of the embodiments and modifications described above may be arbitrarily selected and combined. Also, any component of each embodiment or modification, any component described in the means for solving the invention, or a component that embodies any component described in the means for solving the invention. It may be configured in any combination. The applicant intends to obtain rights to these matters through amendments to the application or divisional applications.

In addition, the applicant intends to acquire rights to the entire design or partial design by filing a conversion application to a design application. Although the drawing depicts the entire device using solid lines, the drawing includes not only the overall design but also a partial design that claims some parts of the device. For example, it is a drawing that not only includes some parts of the device as a partial design, but also includes some parts of the device as a partial design regardless of the components. The part of the device may be a part of the device or a part of the device. We intend to obtain rights not only for the entire design, but also for partial designs in which any part of the solid line part of the drawing is a broken line part.

1: Drive recorder, 3: Windshield, 4: Room mirror, 5: Cigarette socket, 6: Power cable, 10: SD card slot, 11: Display, 12: Operation buttons, 13: Joint rail , 14: Memory card reader/writer, 15: Speaker, 16: GPS receiver, 17: Camera, 18: Acceleration sensor, 19: Communication circuit, 20: Controller, 20b: ROM, 20c: RAM, 20d: Timer , 21: LTE module, 23: SD card, 30: Recording settings window, 30a: Recording method selection frame, 30b: Recording resolution selection frame, 30c: Recording frame number selection frame, 30d: Event recording frame number selection frame, 30e: Event recording time selection frame, 30f: Transmission setting frame, 30g: First transmission resolution setting frame. 30h: First transmission frame number setting frame, 30i: Second transmission resolution setting frame, 30j: Second transmission frame number setting frame, 30k: Save instruction button, 50: Computer, 51: Display control device, 52: Display device, 54: Memory card reader/writer, 55: Input device, 56: Memory, 57: Communication circuit, 58: CPU, 96: Input device, 100: Playback window, 101: Menu bar, 102: Folder・Icon, 103: Camera icon, 104: Printer icon, 105: Reel icon, 106: FD icon, 107: Log icon, 108: Gear icon, 111: Video display area, 112: Video, 112a: Video part, 112b: video part, 113: video, 113a: video part, 113b: video part, 114: video, 114a: video part, 114b: video part, 121: map image display area, 131: vehicle information display area , 132: Vehicle status display area, 133: Operation button, 134: Interior emphasis button, 135: Normal display button, 136: Time display area, 138: Acceleration graph display area, 141: List display area, 160: Video display window , 161: Menu, 162: Cursor, 180: Display screen, 190: Display screen, 200: Computer, 201: Administrator, 210: External display device, 211: Driver, C1: Brightness conversion curve, C2: Brightness Conversion curve, t3: Time of event occurrence

Claims (2)

A program executed on another computer to play back video recorded by a drive recorder on the other computer,
A program for causing the other computer to realize a function of displaying both a frame rate of video recording on the drive recorder and a frame rate of playback on the other computer. The program according to claim 1,
A program for causing the other computer to realize a function of displaying both the frame rate of video recording on the drive recorder and the frame rate of playback on the other computer on the video being played back.