JP2008216841A - Map display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To synchronize and reproduce video and positions on a route associated with the video. <P>SOLUTION: A map display system has a recording section in which map data and video data having route information along a route connecting a start point and an end point on a map corresponding to map data and changing in content associated with the route information, with time are recorded. Further, the map display system has a display section which displays the map corresponding to the map data and video corresponding to the video data. The map display system has a control section which performs display control for map display, including positions on the route associated with the reproduced video, on the display section in timing to the reproduction of the video. In the recording section, relation information on two or more points of time during the reproduction of the video, and points of time and positions associated with two or more positions on the route corresponding to the two or more points of time is recorded for the display control. The control section performs interpolation processing based upon the relation information on the points of time and the positions during the reproduction of the video to calculate correspondence relationship between a point of time between the two or more points of time and a position between the two or more positions. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a map display system, and more particularly to a map display system that reproduces a route on a map and a video related to a point on the route in synchronization.

Conventionally, as in Patent Document 1, a map display system that reproduces a route on a map and a video related to a point on the route in synchronization has been proposed.
JP 2004-191902 A

  However, it takes time and effort to plot measurement positions on a map in advance and scan them to create a raster map, and to record the distance to each measurement position by looking at the meter of the moving object.

  Accordingly, an object of the present invention is to provide a map display system that easily reproduces a video and a map including a point on a route related to the video.

  The map display system according to the present invention includes map data, and video data having route information along a route connecting a start point and an end point on a map corresponding to the map data, and contents relating to the route information change according to time. In a recording unit for recording the above, an input unit used for specifying a start point and an end point, a map corresponding to map data, a display unit displaying video corresponding to video data, and a display unit, And a control unit that performs display control to display a map including a point on the route related to the reproduced video in accordance with the reproduction timing of the video, and the recording unit via the input unit for display control Record the relevant information of the time point and the point related to two or more time points at the time of playback of the set video and two or more points on the route corresponding to the two or more time points, and the control unit Time Based on the associated information point, performs interpolation processing to calculate the time between two or more time points, the correspondence between the point between the two or more points, performs display control.

  Preferably, as a display control, the display unit displays a map centering on a point on the route related to the reproduced video in accordance with the reproduction timing of the video.

  Preferably, the display unit displays the map as a display control in a state indicating a point on the route related to the reproduced video in accordance with the reproduction timing of the video.

  Preferably, the display unit includes a time indication area for specifying two or more time points, a video display area for displaying a still image of a video at two or more time points, and a point for specifying two or more points. A display screen used to record related information having an instruction area and a map display area for displaying a map in the recording unit is displayed.

  More preferably, the time indicating area has a time specifying slider for specifying a video playback time via the input unit, and the point indicating area corresponds to the video playback time on the route via the input unit. A point specifying slider for specifying the point is provided.

  Preferably, the apparatus includes a server having a recording unit and a control unit, and a user-side client that is connected to the server through a network and has an input unit and a display unit. The map display including the point on the route related to the reproduced video tailored to is displayed on other clients connected in a communicable state with the server through the network.

  Preferably, the route is formed by connecting a start point and an end point along a road corresponding to the road network data.

  Preferably, the interpolation processing is one of linear interpolation, parabola interpolation, spline interpolation, or a combination of linear interpolation and parabola interpolation, and for each section composed of adjacent points and points among two or more points. Is set.

  As described above, according to the present invention, it is possible to provide a map display system that easily reproduces a video and a map including a point on a route related to the video.

  Hereinafter, the configuration of the map display system in the present embodiment will be described with reference to the drawings. The map display system 1 according to the present embodiment includes a user side client A and a server C (see FIG. 1). The user side client A is in a state capable of communicating with the server C through the network.

  The user side client A is a computer used by a user, and includes a control unit 30A, an input unit 40A, and a display unit 50A. The control unit 30A controls each unit of the user-side client A and communicates with the server C. The input unit 40A is an input device such as a keyboard or a pointing device for inputting a command to be sent to the server C via the control unit 30A. The display unit 50A includes map information based on the map data recorded in the recording unit 60C of the server C, a moving image based on the moving image data, and input information (association between the moving image and a route on the map) by the input unit 40A. First to third display screens 100 to 300 are displayed. The first to third display screens 100 to 300 are recorded in the recording unit 60C of the server C.

  The recording unit 60C may be divided into a plurality of recording media (servers), each of which may record map data, lap data, moving image data, and route data. One recording medium may be map data, lap data. The data, moving image data, and route data may all be recorded.

  In the present embodiment, based on the input operation of the input unit 40A by the user, the control unit 30C performs route creation processing, video association processing, and route and video playback processing.

  During the route creation process, a map based on the map data recorded in the recording unit 60C of the server C is displayed on the display unit 50A of the user side client A (see the first display screen 100, FIG. 2). Using the input unit 40A of the user side client A, an arbitrary place on the displayed map is set as a start point, an end point, and a waypoint.

  The control unit 30C of the server C creates a route rt (a route connecting at least the coordinate sequence of the start point PS and the end point PF) from the start point PS to the end point PF through the transit point PV. The route rt is selected by the user from a pattern formed along a road on the map and a pattern formed by connecting arbitrary locations with a straight line (see the first region 101 in FIG. 2). FIG. 2 shows the display of the route rt along the road on the map (thick solid line) when the starting point PS, the first waypoint PV1, the second waypoint PV2, and the end point PF are set using the input unit 40A. The 1st display screen 100 which has the 2nd area | region 102 which performs is shown.

  The route rt is a pattern in which a part of the section (for example, from the starting point PS to the second waypoint PV2) is formed along the road on the map, and another section (for example, the second waypoint PV2 to the end point). (Up to PF) may be formed by connecting two types of patterns.

  The route rt of the pattern along the road on the map means a route calculated so that the time or distance using the road included in the road network data from the start point PS to the end point PF through the transit point PV is the shortest. To do. Road network data has latitude and longitude information of road connection points and connections on the map corresponding to the map data, and component points (road connection points and points set on the road) as data, independent of map data Is recorded in the recording unit 60C.

  The control unit 30C includes the latitude and longitude information of the constituent points (the constituent points pc, in FIG. 2, the first to fifth constituent points pc1 to pc5) on the route rt from the start point PS to the end point PF, and the start point to each constituent point. A first table Ta1 indicating the relationship with the distance on the route rt is created (see FIG. 3). The more detailed the first table Ta1 can be created, the more the number of component points pc increases. However, even if the first table Ta1 is created in a state where the component points set on the road are thinned out to some extent in consideration of the processing speed. Good. Route data including the created route rt and the first table Ta1 is recorded in the recording unit 60C.

  The waypoint PV used for setting the route rt is also used as a constituent point. In the example of FIG. 2, the third composing point pc3 corresponds to the first waypoint PV1 and the fourth composing point pc4 corresponds to the second waypoint PV2.

  When the route rt is a pattern that connects arbitrary locations (such as the start point PS and the waypoint PV) with a straight line, the start point PS, the waypoint PV, and the end point PF are set as the constituent points.

  At the time of the moving image association process for associating the point on the route rt with the moving image reproduction timing, the route data recorded in the recording unit 60C of the server C, and map data including an area for displaying the route rt corresponding to the route data, A second display screen 200 having a map display region 201 with a route based on the image and a still image display region 202 for displaying a still image corresponding to the moving image data recorded in the recording unit 60C is displayed on the display unit 50A (see FIG. 4).

  The moving image data has route information related to the area along the route rt while moving from the start point PS to the end point PF of the route, and the content of the corresponding video (moving image) changes with time. In the present embodiment, a mode is described in which route information regarding a region along the route rt is displayed using a moving image. However, the present embodiment may be configured by a combination of a plurality of still images.

  The moving image association process is performed by associating a specific time point when the displayed moving image is reproduced with a point on the route rt corresponding to the specific time point (creating lap data) using the input unit 40A.

  Specifically, by using the input unit 40A, the moving image playback position slider 202s on the second display screen 200 is moved, and a still image that forms a moving image in the still image display area 202, on the corresponding route rt. The point at which the point can be specified is displayed. Next, the route position slider 201s on the second display screen 200 is moved using the input unit 40A, and a point on the route rt corresponding to the displayed still image (from the start point on the route rt at that point). Distance). The determination is made by clicking the association button 203.

  In the map display area with route 201, a map display centering on a point corresponding to the slider position of the route position slider 201s is performed. In the still image display area 202, a video reproduced at a time corresponding to the slider position of the moving image reproduction position slider 202s is displayed as a still image. In FIG. 4, as a point on the route rt, a map display centering on a point with a distance of 3493 m along the route rt from the start point is performed on the map display area 201 with the route, and the video playback time is 349.9 seconds. A state in which a still image of a video reproduced at the time is displayed on the still image display area 202 is shown.

  The associating process sets at least two points, for example, a moving image reproduction time point for the start point on the route rt and a moving image reproduction time point for the end point. By setting the video playback time point at which the association processing is performed to the minimum necessary, it is possible to easily synchronize the video playback timing with the position on the route. In the present embodiment, a mode of associating points on the route rt at 10 moving image playback times t1 to t10 including the start point PS and the end point PF will be described (FIG. 6 showing a graph related to lap data, a table related to lap data). See FIG. 5). The second table Ta2 shown in FIG. 5 is recorded in the recording unit 60C.

  In a state where the point on the route rt and the video playback timing are synchronized, a route simulation that sequentially shows points along the route rt from the start point PS to the end point PF and a video playback are performed (playing a map and a video on the route rt) In the route and moving image reproduction process, the route-added map display area 301 based on the route data recorded in the recording unit 60C of the server C and the map data including the area for displaying the route rt corresponding to the route data, and the recording A third display screen 300 having a moving image display area 302 for displaying a moving image corresponding to the moving image data recorded in the unit 60C is displayed on the display unit 50A (see FIG. 7).

  When the reproduction instruction area 302s having a moving image reproduction start key or the like is operated using the input unit 40A, reproduction of a moving image is started. The control unit 30C performs map display (display control) indicating points on the route corresponding to the image reproduced as the moving image in accordance with the reproduction timing of the moving image. Specifically, based on the first and second tables Ta1 and Ta2, map display centering on a point on the route rt corresponding to the reproduced moving image is performed. Accordingly, the map display is performed in a state where the center position changes in accordance with the moving image reproduction. In addition, a map display showing a point on the route rt corresponding to the reproduced moving image (in FIG. 7, display by a circle and an arrow shown in the circle) is performed.

  Specifically, the control unit 30C of the server C at the first to tenth points t1 to t10, the time from the start of reproduction at the time of moving image reproduction and the distance from the start point on the route of the associated points t1 to t10. Is interpolated based on the relationship (second table Ta2) to calculate the distance from the start point PS on the route rt of the point corresponding to the specific time point between the time points. Subsequently, the control unit 30C of the server C performs an interpolation process based on the distance from the start point PS on the route rt of the point corresponding to the calculated reproduction time at the specific time point, and the first table Ta1. Calculate the latitude and longitude of the point. Based on these, the route indicating the point on the route rt synchronized with the playback timing of the moving image and the moving image playback are performed. Examples of the interpolation processing include linear interpolation, parabolic interpolation (equal acceleration interpolation), spline interpolation, and the like. These interpolation processes are arbitrarily set for each associated point.

  In linear interpolation, it is assumed that the relationship between the reproduction time between the related points and the distance from the start point PS on the route rt is linear (it is assumed that the relationship can be expressed by a linear expression), and the time between these ( A distance value (point) with respect to (time) is calculated from a linear expression (see the broken line in FIG. 14).

  In linear interpolation, since interpolation processing is performed using a linear expression (for example, s = vt + b, s is a distance, t is time, v is a speed between points, and b is a constant), there is a merit that the calculation can be simplified. Since the point-to-point speed v is constant, when the point-to-point speed changes greatly, such as before and after a stationary state where the position at the time of moving image acquisition does not change, the actual movement may not match the movement of the route simulation. .

  In the parabolic interpolation, the relationship between the reproduction time between the associated points and the distance from the start point PS on the route rt is regarded as a combination of a part composed of a parabola and a part composed of a straight line (two It is considered that the relationship can be expressed by a combination of the following equation and the primary equation), and a distance value (point) with respect to the time (time point) between them is calculated from the combination of the secondary equation and the primary equation (see the bold line in FIG. 14).

Parabolic interpolation, a linear expression (e.g. s = vt + d, s is the distance, t is time, v is the velocity, d is a constant) and the secondary equation ^{(s = at 2/2 +} bt + c, a is acceleration, b, c are constants) Interpolate using. Since the linear expression (s = vt + d) is an extension of the previous section (point 1 and point 2 in FIG. 14) of the interpolation section, it is uniquely determined (that is, v and d can be easily obtained). Quadratic and ^{(s = at 2/2 +} bt + c), a linear equation and the secondary equation boundary points also four boundary conditions (1 point 3 linearly and .2. Point 3 and the point 4 is a point on the parabola The slope of the tangent of the parabola on point 3 and the slope of the parabola on point 3 match 3. At the boundary point, s of the primary and secondary equations match 4. The slope of the parabola's tangent and v at the boundary point Can be obtained analytically. In this way, parabolic interpolation can be easily performed, and in a section that can be expressed by a quadratic expression, the speed between points changes with constant acceleration as represented by at + b, so that the position when moving image acquisition does not change When the speed between points changes greatly, such as before and after the state, it is possible to perform a route simulation close to the actual movement. However, depending on conditions, the primary expression may not be combined and only the secondary expression may be used.

  FIG. 14 is a graph showing the reproduction time of points 1 to 5 on the horizontal axis and the distance from the start point PS on the vertical axis, and the sections of points 1 to 2, 2 to 3, 3 to 4, and 4 to 5 are shown. A linear interpolation process is indicated by a broken line that is connected by a straight line, and a parabolic interpolation process is indicated by a thick line that connects sections 2 to 3 by a combination of a straight line and a parabola.

  In the parabolic interpolation process at points 2 and 3 in FIG. 14, the side (points 1 and 2) on the side where the speed between points in the preceding and following sections (the slope of the linear equation used in linear interpolation: the speed between points v) is large Interpolation processing is performed using a linear expression using the inter-speed v, and interpolation processing is performed using a quadratic expression on the side where the inter-point speed v is small (points 3 to 4).

  Thereby, the route rt connecting the start point PS and the end point PF on the map and the video having the peripheral information on the route rt are synchronized with the route rt that guides the point on the route rt in accordance with the playback timing of the video. Playback (synchronized playback of video and route simulation) can be performed easily.

  When the route rt and the video are reproduced synchronously, the altitude corresponding to the point on the route rt may also be reproduced synchronously (see the altitude display area 303 in FIG. 7).

  The input operation for displaying the playback image and the playback instruction in the route and moving image playback processing is performed not only on the user side client A used for the input operation such as the association processing but also on the client connected to the other server C over the network. Done.

  Next, the procedure of the moving image association process will be described with reference to the flowchart of FIG. When the second display screen 200 is displayed on the display unit 50A by the operation of the input unit 40A by the user of the client A, lap data creation processing for moving image association processing is started. In step S11, the route data to be displayed in the route-added map display area 201 by inputting the URL specifying the area where the route data corresponding to the route rt is recorded by the operation of the input unit 40A by the user of the client A. Is specified. In step S <b> 12, a URL for specifying an area in which moving image data is recorded is input by the operation of the input unit 40 </ b> A by the user of the client A, and moving image data to be displayed in the still image display area 202 is designated.

  In step S13, the specified moving image data is read, a still image at a specific time (for example, a still image at the start of playback) in the corresponding moving image is displayed in the still image display area 202, and the specified route data is read. A corresponding route rt and a map including the route rt are displayed in the map display area 201 with a route.

  In step S14, the point in time of moving image reproduction and a point on the route rt are identified, and the specific point in time of moving image reproduction and the point on the route rt corresponding to the specific point of time are associated (creation of lap data). Main processing is performed.

  Next, details of the lap data creation main process performed in step S14 of FIG. 8 will be described using the flowchart of FIG. When the lap data creation main process is started, in step S21, the user of the client A operates the input unit 40A to adjust the slide position of the route position slider 201s and the moving image playback position slider 202s, and becomes a target of association. A point in time for reproducing the moving image and a point on the route rt are specified. In step S22, the association process is performed when the association button 203 is clicked. Specifically, the time point at which the second table Ta2 is configured based on the information at the time point specified in step S21 (video playback time) and the point information (the distance along the route rt from the start point PS). The relationship between the number, the playback time at the specified time point, and the distance along the route rt from the start point PS at the specified point is added to one of the lap data.

  In step S23, it is determined whether the addition of lap data is completed (whether there is no more point to add lap data). When the process ends, the lap data creation main process ends. When the process does not end, the process returns to step S21, and the procedure for adding lap data is repeated.

  Next, a procedure for reproducing a route and a moving image in synchronization (a route and a moving image reproduction process) will be described with reference to the flowchart of FIG. When the user of the client A operates the input unit 40A, the third display screen 300 is displayed on the display unit 50A, the route rt and the moving image to be synchronously reproduced are designated, and the reproduction start instruction is performed. Processing is performed. Details will be described later with reference to FIG. In step S52, synchronization processing is performed. Details will be described later with reference to FIG.

  Details of the initialization process in step S51 will be described with reference to the flowchart of FIG. In step S61, route data corresponding to the designated route rt is read. In step S62, lap data corresponding to the second table Ta2 is read.

  Details of the synchronization processing in step S52 will be described with reference to the flowchart of FIG. In step S71, moving image data corresponding to the designated moving image is read out as needed and displayed in the moving image display area 302 to start moving image reproduction. In step S72, a synchronized main process for synchronizing the playback timing of the moving image and the map display including the route rt is performed. Details of the synchronization main process will be described later with reference to the flowchart of FIG.

  In step S73, it is determined whether or not the moving image reproduction is finished. If not completed, the process returns to step S71 to read out the moving image data as needed. Thereby, the reproduction of the moving image is performed, and the map display (route simulation) centering on the point on the route rt is performed in synchronization with this.

  Next, details of the synchronous main process in step S72 will be described using the flowchart of FIG. When the synchronization main process is started, time information at the time when the moving image reproduction is performed is acquired in step S81. In step S82, the distance from the start point PS of the point on the route rt corresponding to the time point when the moving image is being reproduced is calculated by interpolation processing based on the acquired time information and the second table Ta2 (lap data). The

  In step S83, the calculated distance from the starting point PS is converted into latitude and longitude information based on the first table Ta1. When the calculated distance from the starting point PS is a point between the constituent points of the first table Ta1, it is assumed that the constituent points are connected by a straight line, and linear interpolation is performed to calculate the latitude and longitude. In step S84, a map including the route rt is displayed based on the converted latitude / longitude information. Specifically, the map display is displayed in the map display area with route 301 so that the point corresponding to the converted latitude and longitude is the center. In addition, the altitude display indicating the altitude of the corresponding point is performed in the altitude display area 303.

It is a block diagram of the map display system in this embodiment. It is a block diagram which shows a 1st display screen. It is a table | surface (1st table) which shows the relationship between the latitude and longitude in a starting point, a component point, and an end point, and the distance from a starting point. It is a block diagram which shows a 2nd display screen. It is a table | surface (2nd table) which shows the relationship between the reproduction time (time point) in the 1st-10th point, and the distance from a starting point. It is a graph which shows the relationship between the reproduction | regeneration time (time) in the 1st-10th point, and the distance from a starting point. It is a block diagram which shows a 3rd display screen. It is a flowchart which shows the procedure of a lap data creation process. It is a flowchart which shows the procedure of the lap data creation main process. It is a flowchart which shows the procedure which reproduces | regenerates a route simulation and a moving image synchronously. It is a flowchart which shows the procedure of the initialization process. It is a flowchart which shows the procedure of a synchronous process. It is a flowchart which shows the procedure of a synchronous main process. It is a graph which shows the relationship between the reproduction time which shows the example of linear interpolation and parabolic interpolation, and the distance from a starting point.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Map display system A User side client C Server 30A, 30C Control part 40A Input part 50A Display part 60C Recording part 100-300 1st-3rd display screen 201 Map display area with route 201s Route position slider 202 Still image display area 202s moving image reproduction position slider 203 association button 301 map display area with route 302 moving image display area 302s reproduction instruction area 303 altitude display area pc1 to pc5 first to fifth constituent points PS start point PV1, PV2 first and second waypoints PF end point rt route t1 to t10 first to tenth points Ta1, Ta2 first and second tables

Claims (8)

A recording unit for recording map data and video data having route information along a route connecting a starting point and an ending point on a map corresponding to the map data, and contents relating to the route information changing according to time; ,
An input unit used to identify the start point and the end point;
A display unit for displaying a map corresponding to the map data and a video corresponding to the video data;
The display unit includes a control unit that performs display control to display a map including a point on the route related to the reproduced video in accordance with the reproduction timing of the video,
For the display control, the recording unit has two or more time points when the video set through the input unit is reproduced, and the two or more points on the route corresponding to the two or more time points. Record the relevant point and point information about
The control unit performs an interpolation process based on the related information of the time point and the point at the time of playing the video, and includes a time point between the two or more time points and a point between the two or more point points. The map display system characterized by calculating the correspondence relationship and performing the display control.   The said display part performs the said map display centering on the point on the said route relevant to the said reproduced | regenerated image | video according to the reproduction | regeneration timing of the said image | video as said display control. Map display system.   2. The display unit according to claim 1, wherein, as the display control, the map display is performed in a state indicating a point on the route related to the reproduced video in accordance with the reproduction timing of the video. The map display system described in 1.   The display unit includes a time indication area for specifying the two or more time points, a video display area for displaying a still image of the video at the two or more time points, and a point for specifying the two or more points. The map display system according to claim 1, wherein a display screen used for recording the related information having an instruction area and a map display area for displaying the map in the recording unit is displayed. The time point indication area has a time point specifying slider for specifying a reproduction time point of the video via the input unit,
5. The map display system according to claim 4, wherein the point indicating area includes a point specifying slider for specifying a point on the route and corresponding to the playback time of the video via the input unit. A server having the recording unit and the control unit;
Connected to the server in a communicable state through a network, and comprising a user side client having the input unit and the display unit,
The map display including the video and the point on the route related to the reproduced video in accordance with the reproduction timing of the video is also displayed on other clients connected to the server through a network. The map display system according to claim 1.   The map display system according to claim 1, wherein the route is formed by connecting the start point and the end point along a road corresponding to road network data. The interpolation process is one of linear interpolation, parabolic interpolation, and spline interpolation, or a combination of the linear interpolation and the parabolic interpolation, and is set for each section composed of adjacent points among the two or more points. The map display system according to claim 1, wherein:

Images