JP2023002213A - Terminal device, management system, and video image management method - Google Patents

Abstract

To provide persons under education with educational videos with high educational effect.SOLUTION: A terminal device comprises a generation unit and upload unit. The generation unit generates search tags associated with capture time of driving video captured by a camera. The upload unit uploads a video clip obtained by clipping a portion of the driving image corresponding to a specified capture time based on the search tags generated by the generation unit.SELECTED DRAWING: Figure 1

Description

The present invention relates to a terminal device, management system and video management method.

2. Description of the Related Art Conventionally, there is an information collection system that uploads images captured by an in-vehicle camera to a center every time a vehicle passes a preset point. In such an information system, for example, when an accident occurs, the uploaded video is used for accident verification (see, for example, Patent Document 1).

JP 2009-237945 A

However, in the conventional technology, since all the videos shot by each vehicle are uploaded, even unnecessary videos are uploaded, so it cannot be said to be efficient. Therefore, in the prior art, there is room for improvement in terms of efficiently managing videos shot in vehicles.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a terminal device, a management system, and a video management method capable of efficiently managing video captured by a vehicle.

In order to solve the above-described problems and achieve the object, a terminal device according to the present invention includes a generator and an uploader. The generation unit generates a search tag associated with the imaging time of the driving image captured by the camera. The upload section uploads a clipped video obtained by clipping the driving video at the imaging time specified based on the search tag generated by the generation section.

ADVANTAGE OF THE INVENTION According to this invention, the image|video image|photographed by the vehicle can be managed efficiently.

FIG. 1 is a diagram showing an outline of a management system. FIG. 2 is a block diagram of an in-vehicle device. FIG. 3 is a block diagram of the management device. FIG. 4 is a diagram showing an example of a display mode of search tags. FIG. 5 is a diagram showing an example of a playback screen of cut video. FIG. 6 is a flow chart showing a processing procedure executed by the in-vehicle device. FIG. 7 is a flow chart showing a processing procedure executed by the management device.

Hereinafter, embodiments of a terminal device, a management system, and a video management method disclosed in the present application will be described in detail with reference to the accompanying drawings. In addition, this invention is not limited by embodiment shown below.

First, an outline of a terminal device, a management system, and a video management method according to an embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an outline of a video management method. Note that the video management method according to the embodiment is executed by the in-vehicle device 1 shown in FIG.

In the example shown in FIG. 1, the in-vehicle device 1 is a drive recorder having a communication function installed in each vehicle, and captures a driving image while the vehicle is running. Note that the in-vehicle device 1 is an example of a terminal device, and the terminal device may be, for example, a smartphone, a tablet terminal, or other portable communication device having a camera, and may be a terminal that can be removed from the vehicle. . The management device 100 is a device that aggregates the driving images captured by each in-vehicle device 1 . For example, when an accident occurs, the management device 100 extracts and provides an image of the accident from the collected driving images.

By the way, for example, as a general drive recorder, there is a system that, when a vehicle collision is detected, uploads driving images before and after the collision to a server device. On the other hand, in such a system, if a collision is not detected, such as when the vehicle is scraped, the driving video is not uploaded to the server.

Therefore, for example, the driver uploads a driving video for several minutes before and after the time specified based on his/her own memory, and confirms it on the server side. However, it is rare for the driver to directly recall the time, making these tasks difficult.

Therefore, in the image management method according to the embodiment, search tags associated with time are generated for the driving images, and the driving images are managed based on these search tags. Specifically, as shown in FIG. 1, the in-vehicle device 1 generates search tags for the driving image Ia (step S1).

Here, the search tag is information indicating a predetermined event that occurred at the corresponding imaging time, and for example, information regarding a point passed through or a point visited is used as the search tag. Note that the example shown in FIG. 1 shows a case where search tags Ta, Tb, and Tc are generated for the driving image Ia.

Information about the generated search tag is also transmitted to the management device 100 . As shown in FIG. 1, the management device 100 displays the travel route of the vehicle on the map M by arranging the search tags in chronological order and superimposing them on the map M. FIG.

For example, by specifying an icon displayed on the map M, the administrator can specify the driving image of the search tag corresponding to the specified icon. For example, the administrator hears from the driver where the vehicle may have been scraped and selects the appropriate icon displayed on the map M. As a result, the corresponding tag is selected, and the specified information about the specified search tag is transmitted from the management device 100 to the in-vehicle device 1 .

Upon receiving the designation information (step S2), the in-vehicle device 1 generates a cut image Ic obtained by cutting the image taken at the imaging time designated by the designation information from the driving image Ia, and uploads the generated cut image (step S3). .

This enables the administrator to check the driving video of the designated search tag. As described above, the management system S according to the embodiment generates a search tag using information that indirectly reminds the user of the shooting time, and uploads the cut image Ic specified based on the generated search tag.

As a result, in the management system S according to the embodiment, even if the imaging time is not directly known, it is possible to check the corresponding driving image using other information associated with the imaging time.

Further, in the management system S according to the embodiment, by uploading a portion of the driving video specified by the search tag, the management device 100 can efficiently manage the driving video.

Therefore, according to the management system S according to the embodiment, it is possible to efficiently manage the images captured by the vehicle.

Next, a configuration example of the in-vehicle device 1 according to the embodiment will be described with reference to FIG. FIG. 2 is a block diagram of the in-vehicle device 1. As shown in FIG. As shown in FIG. 2 , the in-vehicle device 1 includes an in-vehicle camera 10 , a communication section 11 , a storage section 20 and a control section 30 .

The in-vehicle camera 10 includes various imaging elements, and generates a driving image by imaging the surroundings of the vehicle. The communication unit 11 is realized by, for example, a NIC (Network Interface Card) or the like. The communication unit 11 is connected to a predetermined communication network so as to be capable of two-way communication, and transmits and receives information to and from the management apparatus 100 and the like.

The storage unit 20 is, for example, a storage unit configured by a storage device such as a nonvolatile memory, data flash, or hard disk drive. As shown in FIG. 2 , the storage unit 20 has a driving image storage unit 21 and a search tag storage unit 22 .

The driving video storage unit 21 is a storage area that stores the driving video captured by the vehicle-mounted camera 10 . The search tag storage unit 22 is a storage unit that stores information regarding the above search tags.

The control unit 30 includes a generation unit 31 and an upload unit 32, and is a computer having, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, an input/output port, and the like. and various circuits.

The CPU of the computer functions as the generation unit 31 and the upload unit 32 of the control unit 30 by reading and executing programs stored in the ROM, for example.

Moreover, at least a part or all of the generation unit 31 and the upload unit 32 of the control unit 30 can be configured by hardware such as ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

The generation unit 31 generates a search tag associated with the imaging time of the driving video. For example, the generating unit 31 generates, as a search tag, information about an event that occurred at the corresponding imaging time.

For example, the generating unit 31 can generate, as a search tag, information about the imaging position linked to the imaging time, such as information about the surrounding facilities that the vehicle has passed through and information about the stopover point that the vehicle has stopped by.

For example, the generation unit 31 generates a search tag related to the imaging position based on image recognition of the current location or destination obtained from a car navigation device (not shown) or driving video. In this way, by using the information about the imaging position as the search tag, it is possible to specify the imaging time according to the location, so that it is possible to improve the searchability of the driving video.

Note that, when generating a search tag by image recognition, the generation unit 31 may use information that indirectly reminds of position information as the search tag. Specifically, for example, a search tag may be generated from the result of image recognition as an event such as passing an impressive car or passing an impressive passerby. In this case, the voice inside the vehicle may also be used. For example, the result of image recognition may be generated as a search tag based on voice such as "What is that?" in the car.

Moreover, the generation unit 31 may generate a search tag based on the operation information for the vehicle. For example, the generation unit 31 acquires information about operation information from various sensors (not shown) and generates search tags.

As a specific example, for example, information such as right turn, left turn, lane change, slow down, etc. is generated as a search tag. In this way, it is also possible to improve searchability for driving images by generating search tags based on operation information.

When generating a search tag, the generation unit 31 associates the imaging time with each generation and transmits it to the management device 100 , and also writes it to the search tag storage unit 22 .

The upload unit 32 uploads a clipped video obtained by clipping the driving video at the imaging time designated based on the search tag generated by the generation unit 31 . For example, the upload unit 32 generates a clipped video obtained by clipping a portion of the driving video based on the imaging time designated by the management device 100 and uploads it to the management device 100 .

Next, a configuration example of the management device 100 will be described with reference to FIG. FIG. 3 is a block diagram of the management device 100. As shown in FIG. Note that FIG. 3 also shows a display unit 150 and an operation unit 151 in addition to the management device 100 .

The display unit 150 is a so-called display, and displays information input from the management device 100 . The operation unit 151 receives various operations by the administrator and outputs information regarding the received operations to the management device 100 .

Management device 100 includes communication unit 110 , storage unit 120 , and control unit 130 . The communication unit 110 is implemented by, for example, a NIC (Network Interface Card) or the like. The communication unit 110 is connected to a predetermined communication network so as to be capable of two-way communication, and transmits and receives information to and from the in-vehicle device 1 and the like.

The storage unit 120 is, for example, a storage unit configured by a storage device such as a nonvolatile memory, data flash, or hard disk drive. As shown in FIG. 3, the storage unit 120 has a search tag database 121 and a clipped video database 122 .

The search tag database 121 is a database that stores information on search tags received from each in-vehicle device 1 . The clipped video database 122 is a database that stores information on clipped video received from each in-vehicle device 1 .

The control unit 130 includes a display control unit 131 and an instruction unit 132, and includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, an input/output port, and the like. Including computers and various circuits.

The CPU of the computer functions as the display control unit 131 and the instruction unit 132 of the control unit 130 by reading and executing programs stored in the ROM, for example.

At least one or all of the display control unit 131 and the instruction unit 132 of the control unit 130 can be configured by hardware such as ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

The display control unit 131 controls various information displayed on the display unit 150 . For example, the display control unit 131 performs various processes for displaying search tags. For example, the display control unit 131 reads search tags from the search tag database 121 and displays them on the display unit 150 .

FIG. 4 is a diagram showing an example of a display mode of search tags. For example, as shown in FIG. 4, a list of search tags in chronological order is displayed. At this time, for example, the display control unit 131 may display only items related to a predetermined reason based on the operation on the operation unit 151 .

That is, for example, when "convenience store" is specified, only search tags including "convenience store" can be displayed in a list. By displaying the search tags as a list in this way, the administrator can grasp the search tags at a glance, and thus can easily grasp the search tags.

Further, the display control unit 131 may superimpose the search tag on the map M as shown in FIG. In this case, the administrator can easily grasp the relationship between the search tag and the location information, and even in this case, it is possible to easily grasp the search tag.

Further, the display control unit 131 may display the search tags as chapters when reproducing the clipped video. FIG. 5 is a diagram showing an example of a playback screen of cut video. For example, as shown in FIG. 5, the display control unit 131 displays the search tag as text along with the seek bar.

That is, the display control unit 131 controls the screen so that, when the seek bar moves, the search tag of the moved playback position is displayed as text. This allows the administrator to easily grasp the relationship between the actual clipped video and the search tag.

Returning to the description of FIG. 3, the instruction unit 132 will be described. The instruction unit 132 instructs the in-vehicle device 1 to upload the clipped video based on the manager's predetermined operation on the search tag displayed on the display unit 150 .

For example, the predetermined operation may be an operation of selecting a search tag, or an operation of designating an imaging time starting from the search tag (for example, 10 minutes after the search tag). When an operation to select a search tag is performed, the instruction unit 132 instructs the in-vehicle device 1 to upload a driving video for 3 minutes before and after the search tag, for example. Generation/uploading of the cut video is executed on the in-vehicle device 1 side according to the instruction from the instruction unit 132 .

Next, a processing procedure executed by the in-vehicle device 1 according to the embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing a processing procedure executed by the in-vehicle device 1. As shown in FIG. Note that the processing procedure described below is executed by the control unit 30 .

As shown in FIG. 6, the vehicle-mounted apparatus 1 acquires a driving image (step S101) and generates a search tag (step S102). Subsequently, the in-vehicle device 1 uploads the generated search tag (step S103), and then acquires instruction information from the management device 100 (step S104).

Subsequently, the in-vehicle device 1 uploads the clipped video specified based on the instruction information, and ends the process (step S105).

Next, a processing procedure executed by the management device 100 will be described with reference to FIG. FIG. 7 is a flowchart showing a processing procedure executed by the management device 100. As shown in FIG. Note that the processing procedure described below is executed by the control unit 130 .

As shown in FIG. 7, when the management device 100 displays the search tag received from the in-vehicle device 1 (step S201), it transmits instruction information to the in-vehicle device 1 based on the administrator's operation (step S202). .

Subsequently, the management device 100 receives the clipped video from the in-vehicle device 1 (step S203), reproduces the received clipped video (step S204), and ends the process.

As described above, the in-vehicle device 1 (an example of a terminal device) according to the embodiment includes the generator 31 and the uploader 32 . The generation unit 31 generates a search tag associated with the imaging time of the driving image captured by the vehicle-mounted camera 10 (an example of a camera). The upload unit 32 uploads a clipped video obtained by clipping the driving video at the imaging time designated based on the search tag generated by the generation unit 31 . Therefore, according to the in-vehicle device 1 according to the embodiment, it is possible to efficiently manage images captured by the vehicle.

By the way, in the above-described embodiment, the case where the in-vehicle device 1 uploads the search tag as the initial stage has been described, but the present invention is not limited to this. For example, in addition to search tags, moving images and still images may be uploaded together. In this case, moving images and still images may be displayed together on the map M and the like (see FIG. 1).

Further, in the above-described embodiment, the case where the search tag is generated for the driving image has been described, but the present invention is not limited to this. That is, search tags may be generated by applying the present invention to various videos other than driving videos.

Further effects and modifications can be easily derived by those skilled in the art. Therefore, the broader aspects of the invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various changes may be made without departing from the spirit or scope of the general inventive concept defined by the appended claims and equivalents thereof.

1 In-vehicle device (an example of a terminal device)
31 generation unit 32 upload unit 100 management device (an example of a server device)
131 display control unit 132 instruction unit S management system

Claims (7)

a generation unit that generates a search tag associated with the imaging time of the driving video captured by the camera;
and an uploading unit that uploads a clipped video obtained by clipping the driving video at the imaging time specified based on the search tag generated by the generating unit. The generating unit
2. The terminal device according to claim 1, wherein said search tag is generated for information relating to surrounding facilities passed by said vehicle equipped with said camera or information relating to a drop-off point at which said vehicle has stopped. The generating unit
3. The terminal device according to claim 1 or 2, wherein said search tag is generated for operation information relating to an operation on a vehicle on which said camera is mounted. a generation unit that generates a search tag associated with the imaging time of the driving video captured by the camera;
a terminal device comprising: an upload unit for uploading a clipped video obtained by clipping the driving video at the imaging time specified based on the search tag generated by the generating unit;
and a server device that displays the search tag uploaded from the terminal device. The server device
5. The management system according to claim 4, wherein when the search tag is information about an imaging position, the imaging position is superimposed on the map and displayed. The server device
6. The management system according to claim 4, wherein the corresponding search tag is displayed in text according to the position of the seek bar when the cut video is reproduced. a generation step of generating a search tag associated with the imaging time of the driving video captured by the camera;
and an uploading step of uploading a clipped video obtained by clipping the driving video at the imaging time specified based on the search tag generated in the generating step.

Images