JP7386008B2 - Display control device, data collection system, display control method, and display control program - Google Patents

Description

The present invention relates to a display control device, a data collection system , a display control method , and a display control program .

Conventionally, there is a display control device that reproduces and displays various data acquired from a drive recorder. In addition to image data, such display control devices reproduce and display animations showing the behavior of the vehicle and sensor data (for example, see Patent Document 1).

Japanese Patent Application Publication No. 2009-211509

However, in the conventional technology, since multiple contents are displayed on the same screen, the user may not be able to easily recognize the temporal relationship between each content, and there is still room for improvement in improving user convenience. was there.

The present invention has been made in view of the above, and an object of the present invention is to provide a display control device, a data collection system, and a display control method that can improve user convenience.

In order to solve the above-mentioned problems and achieve the purpose, a display control device according to an embodiment includes an acquisition section, a playback section, and a display control section. The acquisition unit acquires a plurality of time-series data indicating changes in vehicle data obtained from each vehicle. The reproduction unit reproduces dynamic content based on first time series data among the plurality of time series data acquired by the acquisition unit. The display control unit displays static content based on the second time series data on a playback screen of the dynamic content played by the playback unit, and displays a time difference between the dynamic content and the static content on the playback screen. Display an auxiliary image that shows the relationship.

According to the present invention, user convenience can be improved.

FIG. 1A is a diagram showing an overview of a data collection system. FIG. 1B is a diagram showing an overview of the data collection system. FIG. 1C is a diagram showing an overview of the data collection system. FIG. 2 is a block diagram of the user terminal. FIG. 3 is a diagram showing an example of metadata. FIG. 4 is a diagram showing an example of collected data. FIG. 5 is a diagram illustrating an example of a screen for accepting selection conditions for thumbnail images. FIG. 6A is a diagram illustrating an auxiliary image. FIG. 6B is a diagram illustrating the auxiliary image. FIG. 6C is a diagram illustrating the auxiliary image. FIG. 7 is a diagram illustrating the auxiliary image. FIG. 8 is a diagram showing the relationship between the travel locus and the display range of the graph image. FIG. 9 is a flowchart showing the processing procedure executed by the user terminal.

Hereinafter, a display control device, a data collection system, and a display control method according to embodiments will be described with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

First, an overview of the data collection system according to the embodiment will be explained using FIGS. 1A to 1C. 1A to 1C are diagrams showing an overview of a data collection system.

As shown in FIG. 1A, the data collection system 1 according to the embodiment includes a data collection device 10 and vehicle-mounted devices 100-1, 100-2 mounted on vehicles V-1, V-2, V-3, respectively. , 100-3... and a user terminal 200. In addition, below, when referring to a vehicle in general, it is written as "vehicle V", and when referring to a vehicle-mounted device in general, it is described as "vehicle-mounted device 100", respectively. Further, in the first embodiment, a case will be described using as an example a case where the communication status display device according to the present application is included in the data collection device 10.

The data collection device 10 is configured as a cloud server that provides cloud services via a network such as the Internet or a mobile phone network, and receives requests from data users to collect predetermined vehicle data regarding the vehicle V. Vehicle data is collected from each in-vehicle device 100 based on the collection request. The data collection device 10 then provides the collected vehicle data to the user.

The in-vehicle device 100 is a device that includes various sensors such as a camera, an acceleration sensor, a GPS (Global Positioning System) sensor, a vehicle speed sensor, an accelerator sensor, a brake sensor, and a steering angle sensor, a storage device, a microcomputer, and the like. The in-vehicle device 100 acquires a collection instruction from the data collection device 10 in response to the collection request received by the data collection device 10, and collects (acquires) vehicle data from the vehicle V based on the collection instruction.

The above-described camera can, for example, image the surroundings of the vehicle V and output video data. Further, the acceleration sensor detects acceleration acting on the vehicle V, and the GPS sensor detects the position of the vehicle V. The vehicle speed sensor detects the vehicle speed of the vehicle V. Further, the accelerator sensor detects the amount of operation of the accelerator pedal, and the brake sensor detects the amount of operation of the brake pedal. Further, the steering angle sensor detects the steering angle of the steering wheel of the vehicle V. Note that, as the in-vehicle device 100, for example, a drive recorder can be used.

Additionally, the in-vehicle device 100 uploads the collected vehicle data to the data collection device 10 as appropriate. By using the drive recorder as the in-vehicle device 100 in this way, the in-vehicle components mounted on the vehicle V can be made more efficient. Note that the in-vehicle device 100 and the drive recorder may be configured as separate bodies without being used together.

The user terminal 200 is a terminal used by a data user, such as a notebook PC (Personal Computer), a desktop PC, a tablet terminal, a PDA (Personal Digital Assistant), a smartphone, a glasses-shaped information processing device, or a watch-shaped information processing device. These include wearable devices that are terminals. Note that the user terminal 200 is an example of a display control device, and the data user is an example of a user.

In the data collection system 1 according to the present embodiment, the data collection device 10 collects vehicle data from the in-vehicle device 100 based on collection conditions specified via the user terminal 200, and provides it to the user terminal 200. I can do it. The data user of the user terminal 200 can use the provided vehicle data to analyze the behavior of the vehicle V from which the vehicle data was collected, events occurring in the vehicle V, and the like.

Hereinafter, a series of steps until vehicle data is provided to a data user in the data collection system 1 will be explained using FIGS. 1A to 1C. As shown in FIG. 1A, first, a data user specifies collection conditions using a user terminal 200 connected to the data collection device 10.

Here, the collection conditions described above include various parameters such as conditions that trigger collection, and an example of the conditions that trigger collection is, for example, when the vehicle speed exceeds a predetermined speed.

Furthermore, when the collection conditions are specified, the data collection device 10 adds index data to the actual data R (an example of vehicle data) to be collected, and is used to search and understand the overview of the actual data R. Generate data for generating tag data T having the characteristics. That is, the tag data T is metadata obtained by converting the actual data R into metadata. Note that the data for generating the tag data T is generated based on the operations of the data user using a program and generation data stored in the user terminal 200 or the data collection device 10.

Then, the specified collection conditions and the data for generating the generated tag data T are stored in the data collection device 10, and are also distributed to the vehicle V that is the object of data collection and stored in the in-vehicle device 100. be done.

Next, each in-vehicle device 100 monitors the output data of various sensors, and when an event that satisfies the stored collection conditions occurs (for example, when the vehicle speed exceeds a predetermined speed), the output data or video Actual data R such as data is stored in a storage device.

Each vehicle-mounted device 100 generates and stores tag data T corresponding to the actual data R based on the stored tag data T generation data and the actual data R. Then, each in-vehicle device 100 uploads the tag data T to the data collection device 10, and the data collection device 10 stores the tag data T. At this time, the actual data R is not uploaded to the data collection device 10. In other words, as shown in FIG. 1A, the data collection device 10 is in a state where only the tag data T is held.

When the data user connects to the data collection device 10 using the user terminal 200 to check the collection status and collect the actual data R, metadata based on the tag data T collected by the data collection device 10 is Displayed on the user terminal 200.

As shown in FIG. 1B, when a data user wishes to collect and transmit predetermined actual data R (vehicle data, for example, video data, etc.), the user terminal 200 transmits the actual data R to be collected. Specify the corresponding tag data T. Thereby, the user terminal 200 outputs a request to the data collection device 10 to transmit predetermined actual data R (vehicle data). Then, the data collection device 10 outputs an instruction to transmit the actual data R in response to the transmission request (in other words, instruction data specifying the actual data R) to the corresponding in-vehicle device 100.

Thereafter, as shown in FIG. 1C, the specified actual data R is transmitted (uploaded) from each in-vehicle device 100 to the data collection device 10 based on the transmission instruction, and is stored in the data collection device 10. Then, the data user accesses the actual data R stored in the data collection device 10 using the user terminal 200, and transfers the actual data from the data collection device 10 to the user terminal 200, such as viewing or downloading the actual data R. R transmission processing is performed.

Note that from the viewpoint of the data capacity of the in-vehicle device 100, the actual data R uploaded to the data collection device 10 and the corresponding tag data T are deleted from the in-vehicle device 100 after being uploaded to the data collection device 10. is preferred.

In addition, the tag data T is not data that is simply an excerpt of a part of the actual data R, but when the data user refers to it, he or she can grasp the outline of the actual data R and determine whether or not the actual data R is necessary. It is preferable that the information be converted into metadata to a certain degree.

In this way, in the data collection system 1 according to the embodiment, the data collection device 10 collects the tag data T that matches the collection conditions specified by the user from each in-vehicle device 100, and then collects the tag data T according to the tag data T. The metadata provided to the user terminal 200 is provided to the user terminal 200.

The user specifies actual data R to be actually collected on the user terminal 200 based on such metadata, so that the data collection device 10 collects such actual data R from each in-vehicle device 50, and The actual data R is transmitted to the user terminal 200.

In such a data collection system 1, if the user is, for example, an engineer involved in the evaluation or development of autonomous driving, the engineer may analyze multiple pieces of real data R of different data types arranged in chronological order. be.

For this reason, the user terminal 200 divides the playback screen 210 into a plurality of areas, and displays different content in each divided area, as shown in FIG. 1C. The example shown in FIG. 1C shows a case where the playback screen 210 is divided into a total of five areas, first area A1 to fifth area A5, and different content is displayed in each of the first area A1 to fifth area A5.

In the example of FIG. 1C, the first area A1 is an area where content related to the target vehicle, which is the vehicle V for which data is collected, and basic information of the data to be reproduced is displayed. Further, the second area A2 is an area where content related to the driving position of the target vehicle is displayed, and the driving trajectory T of the target vehicle is displayed on the map image.

The third area A3 is an area where content related to images captured on the target vehicle is displayed. The fourth area A4 is an area where thumbnail images, which are static content of the image data displayed in the third area A3, are displayed. A thumbnail image is, for example, one piece of image data in a corresponding playback range, and is a still image.

Further, the fifth area A5 is an area where a graph image showing the transition of each sensor data regarding each sensor data obtained by the vehicle V is displayed. Note that, for example, each sensor data is an example of the above-mentioned metadata (or tag data T), and the image data corresponds to an example of the above-mentioned actual data R. That is, by collecting only image data with a large amount of data later, it is possible to reduce communication load and the like.

Note that among the image data, thumbnail images may be used as metadata, or arbitrary sensor data may be used as actual data R. That is, in the data collection system 1, it is possible to arbitrarily change the metadata and the actual data R according to the user's request.

In this way, the user terminal 200 reproduces the data desired by the user by linking the image data displayed in the third area A3 and the graph image displayed in the fifth area A5. This allows a person to grasp the time relationship between image data and a graph image.

However, when displaying multiple contents on the same screen, the travel trajectory T displayed in the second area A2 and the thumbnail image displayed in the fourth area A4 are still images, so they cannot be compared with image data or graph images. It is difficult for users to understand time relationships.

Therefore, the user terminal 200 can make the user easily understand the time relationship of each content by superimposing and displaying the auxiliary image showing the time relationship.

Specifically, the user terminal 200 displays the vehicle mark M1 as an auxiliary image on the travel trajectory T, and moves the vehicle mark M1 on the travel trajectory T according to the current playback position. That is, by linking the vehicle mark M1 with the current playback position, the position information of the vehicle V corresponding to the current playback position can be easily recognized.

Further, as shown in FIG. 1C, the thumbnail images are displayed side by side along the time axis of the graph image, and a seek bar M2 indicating the current reproduction position of the thumbnail image and the graph image is displayed as an auxiliary image.

This allows the user to easily understand the temporal relationship between the thumbnail image and the graph image. In this way, the user terminal 200 displays the vehicle mark M1 and the seek bar M2 as auxiliary images on the playback screen 210.

This allows the user to easily understand the temporal relationship of each content displayed on the playback screen 210. Therefore, according to the user terminal 200, it is possible to improve convenience for the user.

Next, a configuration example of the user terminal 200 will be described using FIG. 2. FIG. 2 is a block diagram showing a configuration example of the user terminal 200. Note that in FIG. 2, the data collection device 10 and the data collection system 1 including the plurality of in-vehicle devices 100 are shown together.

As shown in FIG. 2, the user terminal 200 includes an operation section 201, a communication section 202, a display section 203, a storage section 204, and a control section 205.

The operation unit 201 is an input device that accepts various operations from a data user. For example, the operation unit 201 can accept a request to collect or transmit vehicle data through an operation by a data user. The operation unit 201 then outputs information indicating the content of the operation received from the data user to the control unit 205.

The communication unit 202 is realized by, for example, a NIC. The communication unit 101 is wirelessly connected to the network N, and transmits and receives information to and from the data collection device 10 via the network N.

The display unit 203 is, for example, a liquid crystal display. For example, the display unit 203 can display a screen for accepting collection conditions, a screen for accepting transmission instructions based on metadata, the above-mentioned playback screen 210, and the like.

The storage unit 204 is realized by, for example, a semiconductor memory device such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk, and in the example of FIG. to remember.

The collection condition information DB 204a stores collection conditions that are input by the data user through operation of the operation unit 201 and are included in the above-described collection request.

The metadata DB 204b stores metadata transmitted from the data collection device 10 based on the collection request. The metadata stored in the metadata DB 204b is data obtained by processing tag data T collected from each in-vehicle device 50 by the data collection device 10 for the user.

FIG. 3 is a diagram showing an example of metadata. In the example shown in FIG. 3, the metadata includes items such as "tag ID", "vehicle ID", "location", "vehicle type", "date and time", and "event".

“Tag ID” is identification information that identifies tag data T. “Vehicle ID” is identification information that identifies the vehicle V. "Position" indicates the location of the vehicle V where the tag data T was generated, and "Vehicle type" indicates the model of the vehicle V that generated the corresponding tag data T.

Further, "date and time" indicates the date and time when the tag data T was generated in the vehicle V, and "event" indicates based on which collection condition the tag data T was generated. In the example shown in FIG. 3, for convenience, "event" is described abstractly as "event F1", but it is assumed that "event F1" stores concrete information.

Returning to the explanation of FIG. 2, the collected data DB 204c will be explained. The collected data DB 204c stores collected data collected by the data collecting device 10 and transmitted from the data collecting device 10. In other words, the collected data DB 204c stores the same collected data as the collected data DB (not shown) of the data collection device 10, or a part of the collected data of such collected data DB. Note that the collected data may include the above-mentioned tag data T, actual data R, and the like.

FIG. 4 is a diagram showing an example of collected data. In the example shown in FIG. 4, the collected data includes items such as "tag ID", "vehicle ID", "video data", "vehicle speed", "accelerator", "brake", and "steering angle". .

“Tag ID” is identification information that identifies tag data T. “Vehicle ID” is identification information that identifies the vehicle V. "Video data" is information indicating video data captured by a camera. Note that in the example shown in FIG. 4, for convenience, "video data" is described abstractly such as "video C1", but it is assumed that "video C1" stores concrete information.

“Vehicle speed” is information indicating the vehicle speed of the vehicle V. "Accelerator" is information indicating the amount of operation of the accelerator pedal, and "Brake" is information indicating the amount of operation of the brake pedal. Moreover, "steering angle" is information indicating the steering angle of the steering wheel of the vehicle V.

In the example shown in FIG. 4, the data identified by the tag ID "T1" has the vehicle ID "B01", the video data "video C1", the vehicle speed "vehicle speed D1", the accelerator "E1", and the brake " Brake F1" and the steering angle are "steering angle G1."

Returning to the explanation of FIG. 2, the control unit 205 will be explained. The control unit 205 is a controller, and is realized by, for example, a CPU, an MPU, or the like executing various programs stored in a storage device inside the user terminal 200 using the RAM as a work area. Further, the control unit 205 can be realized by, for example, an integrated circuit such as an ASIC or an FPGA.

The control unit 205 includes a reception unit 205a, a transmission unit 205b, an acquisition unit 205c, a playback unit 205d, and a display control unit 205e, and realizes or executes information processing functions and operations described below.

The reception unit 205a accepts requests for collection and transmission of vehicle data input via the operation unit 201. Then, for example, the reception unit 205a stores the collection conditions included in the received collection request in the collection condition information DB 204a. Further, for example, the reception unit 205a outputs the received transmission request to the transmission unit 205b. Further, the receiving unit 205a receives various operations on the playback screen 210 (see FIG. 1C).

The transmitter 205b transmits information indicating collection conditions and the like to the data collection device 10. For example, the transmitter 205b accesses the collection condition information DB 204a and transmits a collection request including the collection conditions to the data collection device 10. Further, the transmitting unit 205b transmits the transmission request input from the receiving unit 205a to the data collection device 10 via the communication unit 202.

The acquisition unit 205c acquires a plurality of time-series data indicating changes in vehicle data obtained from each vehicle. Specifically, the acquisition unit 205c acquires vehicle data (actual data R) collected and transmitted by the data collection device 10 via the communication unit 202, and stores it in the collected data DB 204c.

Note that vehicle data is a concept that includes tag data T, actual data R, and metadata. Further, among the vehicle data, time-series data is defined as time-series data.

The reproduction unit 205d reproduces dynamic content based on the first time series data among the plurality of time series data acquired by the acquisition unit 20dc. The playback unit 205d plays back dynamic content based on the designated time-series data, for example, by reading out the time-series data corresponding to the user's operation accepted by the reception unit 205a from the collected data DB 204c.

Here, the sensor data is data detected by each sensor (speed sensor, brake sensor, steering angle sensor, etc.) of the vehicle V, and is an example of first time series data. Since sensor data changes along the time axis, a graph image based on sensor data becomes dynamic content. Note that the reproduction unit 205d may generate the graph image based on the sensor data, or the graph image may be generated on the data collection device 10 side. In this case, the acquisition unit 205c described above may generate the graph image based on the sensor data. A graph image will be acquired as time series data.

Further, as shown in FIG. 1C, the reproduction unit 205d synchronizes and simultaneously reproduces the image data with the graph image. Here, the image data is an example of second time series data, and the reproduction unit 205d reproduces the image data as dynamic content.

The display control unit 205e displays static content based on the second time series data on the reproduction screen 210 reproduced by the reproduction unit 205d.

As shown in FIG. 1C, a graph image and image data are displayed on the reproduction screen 210, as well as a traveling trajectory T and a thumbnail image. The display control unit 205e generates the travel trajectory T and thumbnail images and displays them on the playback screen 210, and also displays on the playback screen 210 an auxiliary image showing the time relationship between the travel trajectory T and the thumbnail images and other dynamic content. to be displayed.

For example, the display control unit 205e generates a travel trajectory T by connecting time-series position data, selects one image data per predetermined playback range from the image data, and generates a thumbnail image.

The traveling trajectory T and the thumbnail images are static contents because the display mode basically does not change after they are displayed.

Here, the display control unit 205e can also select thumbnail images from the image data based on selection conditions specified by the user. FIG. 5 is a diagram illustrating an example of a screen for accepting selection conditions for thumbnail images.

In the example shown in FIG. 5, each selection condition and checkbox are displayed on the selection condition reception screen, and the user can select the selection condition by operating the operation unit 201.

The example shown in FIG. 5 shows a case where the selection conditions include items such as "event occurrence", "intersection", and "detailed settings". “Event Occurrence” indicates that image data at the occurrence time of an event specified by the collection condition is selected as a thumbnail image. Further, "intersection" indicates that image data when the vehicle V is located at an intersection is selected as the thumbnail image.

Further, in "detailed settings", it is also possible to set more detailed selection conditions. Specifically, for example, it is possible to set the priority order of each selection condition, or to set the playback range of each thumbnail image.

Then, the display control unit 205e selects a thumbnail image from the image data based on the selection conditions specified by the user, and displays the selected thumbnail image in the fourth area A4 as the fourth content C4.

In this way, the display control unit 205e selects a thumbnail image based on the selection conditions specified by the user, so that the user can easily understand the contents of the corresponding image data (video) from the thumbnail image. be able to.

Note that the user terminal 200 may transmit selection conditions specified by the user to the data collection device 10, and the data collection device 10 may select the thumbnail images. In this case, the user terminal 200 may decide to present the thumbnail image to the user and then acquire image data of the playback range indicated by the thumbnail image selected by the user from the data collection device 10.

Next, processing for the auxiliary image by the display control unit 205e will be explained. First, of the vehicle mark M1 and seek bar M2, which are auxiliary images, processing for the seek bar M2 will be described.

6A to 6C and FIG. 7 are diagrams illustrating auxiliary images. Note that the playback screen 210 is shown in a simplified manner below. First, the relationship between the seek bar M2, thumbnail images, and graph images will be described using FIG. 6A. Note that, in the following, from the viewpoint of making the explanation easier to understand, the graph image is shown divided into a plurality of graph images G1 to G7 corresponding to the playback range of the thumbnail image.

In the example shown in the upper diagram of FIG. 6A, a total of seven thumbnail images S, thumbnail images S1 to S7, are displayed in the fourth area A4. Each thumbnail image S is one piece of image data in the corresponding reproduction range.

Specifically, the thumbnail image S1 is one image data in the reproduction range from time t10 to t11, and the thumbnail image S2 is one image data in the reproduction range from time t11 to t12.

When playback starts from the state shown in the upper diagram of FIG. 6A and a predetermined period of time has elapsed, for example, with the seek bar M2 fixed at the center of the screen, the graph image G and the thumbnail image S slide to the left, and the graph image G and the thumbnail image S slide to the left in the lower diagram of FIG. 6A. Displayed as shown.

Further, as shown in the upper diagram of FIG. 6A, a balloon mark M3 indicating the reproduction position is displayed on the thumbnail image S4 corresponding to the image data currently being reproduced. The user can easily recognize which thumbnail image reproduction range corresponds to the image data being reproduced in the third area A3 (see FIG. 1C) by the balloon mark M3.

Here, as shown in FIG. 6A, the seek bar M2 indicates the current reproduction location of the graph image G, and also indicates the thumbnail image S corresponding to the image data currently being reproduced in the third area A3. In other words, the seek bar M2 indicates the time relationship between the graph image G, which is dynamic content, and the thumbnail image S, which is static content (and the time relationship between these and the playback position of the image data being played). become.

Further, as shown in FIG. 6A, the seek bar M2 is a double-arrow-shaped frame, and the inside thereof is transparent. In other words, the seek bar M2 has a shape that suppresses a decrease in the visibility of the graph image G.

Therefore, by displaying the seek bar M2, the user terminal 200 allows the user to understand the temporal relationship of each content without impairing the visibility of each content. Note that the shape of the seek bar M2 shown in FIG. 6A is an example, and any other shape may be used as long as it indicates the temporal relationship between the graph image G and the thumbnail image S.

Further, as shown in FIG. 6B, it is also possible to move the seek bar M2 and the balloon mark M3 in accordance with the playback position while the graph image G and the thumbnail image S are fixedly displayed. In this case, the balloon mark M3 indicates where in the reproduction range of the thumbnail image S the image data currently being reproduced is located.

In this way, by displaying the balloon mark M3 in conjunction with the current playback position, the user can easily recognize which playback range of the thumbnail image S corresponds to the image data being played back. becomes.

Although the case where the seek bar M2 and the balloon mark M3 move in accordance with the current playback location has been described here, the present invention is not limited to this. That is, either the seek bar M2 or the balloon mark M3 may be displayed in a fixed manner, and the image data G or the thumbnail image S may be moved and played back. That is, the display method shown in FIG. 6A and the display method shown in FIG. 6B may be combined.

Note that the seek bar M2 may indicate the correspondence between the thumbnail image S corresponding to the image data currently being reproduced and the current graph image G, and the balloon mark M3 may indicate the reproduction position in the thumbnail image S. In this case, the thumbnail image corresponding to the current playback position will be displayed at the center of the screen, and the balloon mark M3 will move within the thumbnail image S. When the playback range corresponding to the thumbnail image S is deviated from, the next thumbnail image S is sequentially displayed at the center of the screen.

Further, here, a case has been described in which the balloon mark M3 is moved in accordance with the playback position, but it may be displayed by moving the seek bar M2 while the graph image G is fixed.

By the way, as described above, in the data collection system 1, the data collection device 10 can suppress the communication load etc. by acquiring the minimum amount of image data from each in-vehicle device 100. Therefore, it is conceivable that the image data that the user terminal 200 acquires from the data collection device 10 is not all continuous data, but some of it is discrete data.

In this case, the user terminal 200 may decide to blank B the thumbnail images in the playback range for which no image data has been acquired, as shown in FIG. 6C. Note that in the example shown in FIG. 6C, a blank B is shown between the thumbnail image S4 and the thumbnail image S6.

In this way, by displaying the blank B in advance in the thumbnail image S, it becomes possible for the user to easily understand that the blank B exists in the image data.

Note that a display method may be considered in which a thumbnail image is generated and displayed when the conditions for generating a thumbnail image are satisfied, but with this method, blank B will be generated even if the distance between thumbnail images becomes long. The user can understand from the blank B that no event that would generate a thumbnail image has occurred in that section. In addition, if the conditions for generating thumbnail images are met within a short period of time, the thumbnail images may be reduced, displayed overlapping each other, or displayed with appropriate shifts, so that the thumbnail images and graph images G, etc. It is desirable to use a display that makes it easy to understand the relationship between time and location.

Next, the processing of the playback section 205d and the display control section 205e based on the user's operation will be explained using FIG. 7. As shown in FIG. 7, the user terminal 200 can accept an operation to move the seek bar M2.

In this case, the playback unit 205d changes the playback position so that the playback position corresponding to the moved seek bar M2 is played back. The example in FIG. 7 shows a case where the seek bar M2 is changed to time ta. Therefore, the playback unit 205d restarts playback from time ta.

Then, the display control unit 205e controls the reproduction screen 210 so that the seek bar M2 returns to the reference position, which is the center of the screen, as shown in the lower diagram of FIG. That is, the display mode is controlled so that the thumbnail image S and the graph image G as a whole slide to the left with respect to time ta.

At this time, it is preferable that the display control unit 205e gradually slide the thumbnail image S and the graph image G so that the seek bar M2 gradually comes to the reference position. By doing so, the next operation range (playback range) for the seek bar M2 can be expanded while making the user aware that the current playback position has changed the time ta.

Although a case has been described here in which an operation is accepted for the seek bar M2, a similar operation may be accepted for the balloon mark M3 as well.

Furthermore, it is also possible to accept a sliding operation of the graph image G or the thumbnail image S, and in this case, the playback position can be changed while the seek bar M2 and the balloon mark M3 are fixed.

In this way, the user can easily adjust the playback position while recognizing the temporal relationship between the graph image G and the thumbnail image S using the seek bar M2.

Next, processing for the reproduction unit 205d and the display control unit 205e for the vehicle mark M will be described using FIG. 8. FIG. 8 is a diagram showing the relationship between the travel trajectory T and the display range of the graph image G. Note that in FIG. 8, the reproduction screen 210 is simplified and only the second area A2 and the fifth area A5 are shown in an abstract manner.

As shown in FIG. 8, a travel trajectory T and a vehicle mark M1 are displayed on the travel trajectory T in the second area A2. Note that, as described above, the traveling trajectory T is an example of static content, and the position data that is the original data of the traveling trajectory T is an example of second time series data.

The display control unit 205e moves and displays the vehicle mark M1 on the travel trajectory T in accordance with the current playback position, so that the acquisition position of each content can be easily grasped.

The user terminal 200 can also accept a movement operation for the vehicle mark M1, and can also reproduce the graph image G, image data, etc. from the position of the vehicle mark M1 after the movement by the movement operation.

Here, the display control unit 205e can also change the display range of the dynamic content based on the travel trajectory T shown on the map image. Specifically, the display range of the graph image G is set according to the starting point Sp and the ending point Ep of the travel trajectory T.

Specifically, the display control unit 205e sets the display range so that the sensor data at the start point Sp becomes the start time ts of the display range of the graph image, and the sensor data at the end point Se becomes the end time te.

That is, the display control unit 205e sets the display range of the graph image G so that the transition of sensor data during all travel periods in the travel trajectory T displayed on the map image is displayed. Thereby, the user can recognize all the graph images G on the travel trajectory T. Note that although a case has been described in which the scale of the graph image G is changed based on the travel trajectory T, the scale of the thumbnail image S may be changed in accordance with the scale of the graph image G.

Note that the display control unit 205e is also capable of displaying the map image and the traveling trajectory T in enlargement or reduction based on the user's operation. For example, when the map image and the traveling trajectory T are enlarged, it is possible to display the map image and the traveling trajectory T in the second area A2. A part of the trajectory T may be displayed. In this case, the display range of the graph image may be set based on the starting point Sp and ending point Ep of the travel trajectory T displayed in the second area A2. Further, the display control unit 205e may change the scale of the map image or the travel trajectory T based on the enlargement/reduction operation on the graph image G.

Next, the processing procedure executed by the user terminal 200 according to the embodiment will be described using FIG. 9. FIG. 9 is a flowchart showing the processing procedure executed by the user terminal 200. Note that, in FIG. 9, a series of processing steps up to the start of reproduction of the reproduction screen 210 will be described.

As shown in FIG. 9, the user terminal 200 first transmits a transmission instruction based on metadata to the data collection device 10 based on the user's operation (step S100). The data collection device 10 collects actual data R from the corresponding in-vehicle device 100 based on the transmission instruction.

Next, the user terminal 200 accesses the data collection device 10, acquires time series data (step S101), and creates static content (travel trajectory T, A thumbnail image S) is generated (step S102). Note that, as described above, the process of step S102 may be performed by the data collection device 10 or may be performed by the in-vehicle device 100.

Next, the user terminal 200 superimposes the auxiliary image (vehicle mark M1, seek bar M2) on the playback screen 210 (step S103), and then starts playing the dynamic content based on the user's operation ( Step S104), the process ends. Note that as the dynamic content is played back, the auxiliary images (vehicle mark M1, seek bar M2) are also changed and superimposed.

As described above, the user terminal 200 (an example of a display control device) according to the embodiment includes an acquisition section 205c, a playback section 205d, and a display control section 205e. The acquisition unit 205c acquires a plurality of time-series data indicating the transition of vehicle data obtained from the vehicle V, respectively. The reproduction unit 205d reproduces dynamic content based on the first time series data among the plurality of time series data acquired by the acquisition unit 205c.

The display control unit 205e displays the static content based on the second time series data on the dynamic content playback screen 210 played by the playback unit 205d, and displays the dynamic content and static content on the playback screen. Display auxiliary images showing temporal relationships. Therefore, according to the display control device according to the embodiment, user convenience can be improved.

Incidentally, in the above-described embodiment, the display control device is the user terminal 200, but the display control device may be the data collection device 10. That is, the data collection device 10 may generate the display content of the reproduction screen 210, and the user terminal 200 may receive the display content from the data collection device 10 and reproduce it.

Further advantages and modifications can be easily deduced by those skilled in the art. Therefore, the broader aspects of the invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various changes may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

1 Data collection system 10 Data collection device 100 In-vehicle device 200 User terminal 205 Control unit 205a Reception unit 205b Transmission unit 205c Acquisition unit 205d Playback unit 205e Display control unit S Thumbnail image (an example of static content)
T Driving trajectory (an example of static content)
M1 vehicle mark (example of auxiliary image)
M2 seek bar (an example of auxiliary image)
M3 speech bubble mark

Claims (11)

A display control device having a control unit,
The control unit includes:
Playing back the video imaged by the vehicle, and displaying a plurality of thumbnail images of the video as chronological still images on the screen along the time axis of a graph image showing the transition of sensor data obtained by the vehicle;
A display control device that displays an auxiliary image indicating a playback position of the video in the plurality of thumbnail images. The control unit includes:
In addition to the video, the thumbnail image, the graph image , and the auxiliary image, a map image is displayed on the screen, and the traveling position of the vehicle corresponding to the playback position of the video is displayed on the map image. The display control device according to item 1. The control unit includes:
The display control device according to claim 1, wherein a balloon mark is displayed on the thumbnail image as an auxiliary image indicating the playback position of the video. The control unit includes:
The display control device according to claim 1, wherein thumbnail images are selected from image data based on selection conditions set by a user. The control unit includes:
Accepts operations by users,
The display control device according to claim 1, wherein when a movement operation of the auxiliary image is accepted, a playback position is changed in accordance with the movement operation. The control unit includes:
The display control device according to claim 5, wherein the playback screen is controlled so that the auxiliary image returns to a reference position after the movement operation. The control unit includes:
accepting a slide operation for sliding the thumbnail image or the graph image displayed on the screen;
The display control device according to claim 5, wherein a playback position is changed in accordance with the slide operation. The control unit includes:
The display control device according to claim 1, wherein a travel trajectory of the vehicle is displayed on the screen, and a vehicle mark is displayed on the travel trajectory. A display control device according to any one of claims 1 to 8,
a data collection device that collects vehicle data that satisfies collection conditions set by a user via the display control device from an in-vehicle device of each vehicle, and transmits the data to the display control device;
A data collection system comprising: the in-vehicle device that transmits vehicle data that satisfies collection conditions transmitted from the data collection device to the data collection device. A display control method executed by a control unit, the method comprising:
Playing back the video imaged by the vehicle, and displaying a plurality of thumbnail images of the video as chronological still images on the screen along the time axis of a graph image showing the transition of sensor data obtained by the vehicle;
A display control method comprising: displaying an auxiliary image indicating a playback position of the video in the thumbnail image. Reproducing the video imaged by the vehicle, and displaying a plurality of thumbnail images of the video as chronological still images on the screen along the time axis of a graph image showing the transition of sensor data obtained by the vehicle. and,
A display control program that causes a computer to display an auxiliary image indicating a playback position of the video in the thumbnail image.

Images