JP2002341755A - Video display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video display device with which a video can be easily observed while grasping the variation of photographing range on the map without moving the line of sight between the map and the video. SOLUTION: The video display device reproduces video data varying in a photographing range with time and displaying them on a display screen 11 overlapping them on a map including the photographing range of the video, and is characterized in varying a display state of the video or the map correspondingly to the variation in the photographing range. Moreover, the video display device is provide with a position specifying means for specifying and inputting a desired position to display on the map displayed on the display screen, and a video frame determining means for determining a corresponding video frame from among the video data based on the desired position to display specified and inputted by the position specifying means.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display device for displaying an image taken by a camera whose photographing range changes with time, such as a moving camera or a turning camera, together with a map including the photographing range. .

[0002]

2. Description of the Related Art FIG. 19 shows, for example, "Kaneko et al." High-performance helicopter television system ", Mitsubishi Electric Technical Report, Vol.
1, No. 8, pp. 43-48, 1997] is a diagram for explaining the conventional video display device shown in "1997", and shows its configuration and a display screen. In FIG. 19, 1 is video data, 2 is attribute data such as a shooting time and a shooting range of the video, 3 is entity data which is a time series set of video frames,
4 is map data, 5 is display means, 7 is video display means for displaying entity data, 8 is attribute display means for displaying attribute data, 9 is map display means for displaying a map, and 10 is interactive operation with a user. Interactive means for managing, 11 a display screen for displaying a video or a map, 12 a map window for displaying a map, 13 a video window for displaying a video, 14 a video playback button for performing a video reproduction operation, and 15 a video being reproduced A time display panel that displays the time when the video frame was shot,
Reference numeral 16 denotes a mouse for performing an interactive operation; 17, a curve indicating a trajectory of a camera-equipped helicopter (hereinafter, sometimes simply referred to as a trajectory of a camera-equipped helicopter); (Hereinafter, may be simply abbreviated as a photographing position), 1
Reference numeral 9 denotes a rectangle indicating the shooting range of the currently reproduced video frame (hereinafter, may be simply referred to as a shooting range).

[0003] Video data 1 includes entity data 3 which is a time-series set of video frames, attribute data 2 which is composed of a photographing time indicating when each video frame was photographed and a photographing range indicating where the photographed. And transmitted or stored in association with each other. The shooting range is GPS
(Global Positioning Senso
r) can be obtained by geometric calculation using camera data such as the position data of the camera obtained from r) or the like, the direction, the shooting direction (pan, tilt), and the zoom output from the camera itself.

The display means 5 comprises a video display means 7, an attribute display means 8, and a map display means 9. Image display means 7
Reproduces the video entity data 3 in the video window 13 of the display screen 11. In synchronization with this video reproduction, the map display means 9 arranges a map including the area (photographing range 19) where the currently displayed video frame is being photographed at a position different from the video window 13 on the display screen 11. The attribute display means 8 displays the trajectory 17 of the helicopter, the photographing position 18, and the photographing range 19 on the map. With such a display, it is possible to confirm on the map how the imaging range 19 changes with time while observing the video.

[0005]

The conventional video display apparatus is configured as described above, and the map window 12 and the video window 13 are arranged at different positions on the display screen 11 (that is, the map window 12 and the video window 13 are different). Since the image and the image are displayed at different positions on the display screen 11), there is a problem that when the photographing range 19 displayed on the map is compared with the image, the line of sight shifts and it is difficult to concentrate and observe. Was. Further, when there are a plurality of video windows 13 as in the case of shooting with a plurality of cameras, there is a problem that it is difficult to recognize the video windows 13 in correspondence with the shooting range 19 displayed on the map.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems of the related art, and it is possible to grasp a change in a photographing range on a map without moving a line of sight between a map and an image. It is an object of the present invention to provide an image display device that can easily observe an image.

[0007]

An image display apparatus according to the present invention reproduces data of a video whose photographing range changes over time, and superimposes the data on a map including the photographing range of the video to display the data on a display screen. And changing the display state of the video or map in response to the change in the shooting range.

[0008] Further, a position specifying means for specifying and inputting a desired display position on a map displayed on the display screen, and a corresponding image from the video data based on the desired display position specified and input by the position specifying means. Video frame specifying means for specifying a frame.

The video data is composed of a plurality of video data shot by a plurality of cameras and time-synchronized with each other, and the plurality of video data are reproduced synchronously.

[0010] Further, a camera designating means for designating and inputting a camera is provided, and at least video data of the camera designated by the camera designating means is always reproduced and displayed.

Further, a plurality of images are displayed on a map without overlapping each other.

Further, when a plurality of videos overlap on a map, they are superimposed and displayed according to the priority given to each of the videos.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 1 to 6 are diagrams for explaining a video display device according to a first embodiment of the present invention. More specifically, FIG. 1 is a diagram showing a configuration and a display screen of the video display device, and FIG. FIGS. 3 to 6 are flowcharts showing the flow of the image display processing, and FIGS.

In these figures, 1 is video data, 2
Is attribute data such as a photographing time and a photographing range of a video, 3 is entity data which is a time series set of video frames, 4 is map data, 5 is display means, and 6 is a superimposed display of the video window 13 on the map window 12. Display layout deciding means for deciding the method, 7 is a video display means for displaying the entity data 3,
8 is an attribute display means for displaying the attribute data 2; 9 is a map display means for displaying the map data 4; 10 is an interactive means for managing an interactive operation with the user; 11 is a display screen for displaying a video or a map; Map window displaying a map, 13
Is a video window for displaying a video, 14 is a video playback button for performing a video playback operation, 15 is a time display panel for displaying the time at which the video frame being played back was captured, 16 is a mouse for interactive operation, and 17 is a camera Is the movement trajectory of
For example, the trajectory of a camera-equipped helicopter. 18
Is a position where the currently reproduced video frame was photographed (camera position), 19 is a photographing range of the currently reproduced video frame, and 20 (FIG. 4) is a camera icon indicating the camera position and the photographing range. .

The video data 1 includes entity data 3 which is a time-series set of video frames, attribute data 2 comprising a shooting time indicating when each video frame was shot, and a shooting range indicating where the video frame was shot. And transmitted from the shooting site in association with each other, or recorded and stored on a hard disk, an optical disk, or the like. Therefore, the video data 1 transmitted from the shooting site may be reproduced and displayed live without being recorded and stored. The photographing range is the same as the conventional case, with GPS (Global Position).
It can be obtained by geometric calculation using camera position data output from the camera itself, such as the direction of the camera itself, panning, tilting, zooming, and the like. Also, map data 4
Is recorded on a hard disk, an optical disk, or the like.

The display means 5 comprises a display layout determining means 6, an image display means 7, an attribute display means 8 and a map display means 9, and is a software program mounted on a computer having a graphics function such as a personal computer or a workstation. Or a combination thereof with a video reproduction board or the like that realizes real-time moving image reproduction by hardware. The image display means 7 reproduces the entity data 3 of the image in the image window 13 of the display screen 11. In synchronization with this video playback, the map display means 9
A map including the area (shooting range 19) where the currently displayed video frame is being shot is displayed in the map window 12 of the display screen 11, and the attribute display means 8 displays the helicopter's trajectory 17 and the shooting position on the map. 18, shooting range 19
Is displayed. The display layout deciding means 6, as will be described later in detail, changes the image window 13 so as to change the display state of the map or the image in response to the change of the shooting range 19.
Is determined on the map window 12 (that is, how the video is superimposed on the map).

Interactive means 1 for managing an interactive operation with a user
0 is constituted by a software program similarly to the display means 5. The display screen 11 displays the CRT ((Catho
de Ray Tube) Displayed by a display device such as a monitor or a liquid crystal display.

Next, with reference to FIG. 2, the video display processing on the display means 5 will be described by taking as an example the case of reproducing video data recorded and stored on a hard disk, an optical disk or the like. In step S1, a reproduction start time Ts (imaging time at which reproduction starts) specified by the user is set as the reproduction time t. In step S2, the video data 1 at the playback time t is read, and in step S3, the video window 13 is displayed on the map using the shooting range of the attribute data 2 and the display parameters (such as scale and display position) of the map. A display layout indicating whether to perform superimposed display is determined. Step S4
, The video frame at the playback time t is
In step S5, the attribute data 2 such as the photographing time and the photographing range of the reproduction time t are displayed on the map window 12 and the time display panel 15, and in step S6, the reproduction time t is updated. In step S7, it is checked whether or not the reproduction time t has exceeded the reproduction end time Te specified by the user.
Steps S7 to S7 are repeated, and if it exceeds, the video display process ends.

The display layout in step S3 is as follows:
Although it is determined that the positional relationship between the map and the display of the image changes according to the change in the shooting range 19, in the first embodiment, the display state of the image is changed while the display state of the map is particularly kept unchanged. Here, the shooting range indicates where each video frame is shooting on the map,
As before, the camera position, direction (yoke),
It can be obtained by geometric calculation from the shooting direction (pan and tilt) and the angle of view (zoom). The calculation method is publicly known and the description is omitted. In the case of a mobile camera mounted on a helicopter or car, or a surveillance camera that can remotely control the shooting direction and angle of view, the shooting range can change for each video frame, but information for calculating these shooting ranges is The camera itself or GPS (Global Positionion)
ng Sensor) at the time of shooting, and can be stored and transmitted in synchronization with video. This realization method is also known, and the description is omitted.

Next, a specific method for changing the positional relationship between the map and the display of the image according to the change in the photographing range will be described. FIG. 3 shows an example in which the video window 13 is moved and displayed on a stationary map when the photographing range is temporally changed by the moving camera. Shooting range 19 on the map
Video window 13 in the vicinity of (in the upper right of the figure)
Is displayed, and the video window 13 moves in synchronization with the video reproduction process (that is, in response to a change in the shooting range) as shown in FIGS. Also, attribute data such as a camera position 18, a photographing range 19, a movement locus (a navigation locus) 17, and a photographing time are dynamically changed and displayed in synchronization with the reproduction. This display method is based on the shooting range 1 on the map.
By moving the video window 13 in response to the change of No. 9, it is possible to intuitively grasp where the image is being captured and to concentrate on observation without moving the viewpoint between the map and the video.

FIG. 4 is a diagram showing a case where the shooting range changes with time by a turning surveillance camera.
FIG. 4A shows an example in which the video window 13 is moved and displayed as shown in FIG. Video window 13
Are arranged and displayed near the center of the shooting range indicated by the broken line in FIG. The camera icon 20 indicates the position of the camera and the radial shooting range, and changes dynamically in synchronization with video playback. In this display method, by moving the video window 13 in response to the change of the shooting range on the map, it is possible to intuitively grasp where the shooting is being performed, and to observe without moving the viewpoint between the map and the video. Has the effect of being able to concentrate on

FIG. 5 shows a video window 13 as shown in FIG. 5 (a) → (b) on a stationary map when the shooting direction (azimuth) changes in the sky video shot by the camera equipped with a helicopter. The example which displays by rotating is shown. Helicopter-equipped cameras have two modes: one is to point the camera at a fixed direction (for example, control the camera so that the upper side of the imaging surface is always north), and the other is to change the direction of shooting according to the direction of the helicopter is there. Here, corresponding to the latter case, the display is performed such that the direction of the map matches the direction of the displayed image. Thereby, in addition to the effects described in the display method shown in FIG. 3, even if the shooting direction changes, the image can be observed in the same direction as the map, and the map and the image can be more easily illuminated. This has the effect.

FIG. 6 shows the relationship between the size of the subject in the video and the scale of the map at a fixed ratio when the angle of view of the video captured by the moving camera changes with time (in other words, , The size of the video window 13 is changed according to the angle of view, and displayed at the same magnification). For example, when zooming in, the image is displayed in a small video window 13 as shown in FIG. 6B, and when zooming out, the image is displayed in a large video window 13 as shown in FIG. FIG. 6C shows, for reference, a case where the image is displayed in the video window 13 having the same size as the case where the object is zoomed in and the case where the object is zoomed out. Thereby, in addition to the effects described in the display method shown in FIG. 3, even when the angle of view of the video changes over time by zooming in or out,
It is possible to intuitively grasp the actual size of the subject.

In FIGS. 3, 5, and 6, the display position of the video window 13 is set in the vicinity of the photographing range 19. However, the display position may be superimposed on the photographing range 19 or displayed on a map. The relationship between the photographing range 19 and the photographing position (camera position) 18 may be clearly indicated by connecting them with a leader line or the like. This is the same in each of the following embodiments, although not particularly specified. In FIG. 4, the display position of the video window 13 is set near the center of the shooting range.
It may be near the camera. Further, the photographing range displayed by the camera icon 20 on the map and the relationship with the camera may be clearly indicated by connecting them with a leader line or the like.
This is the same in each of the following embodiments, although not particularly specified.

Further, the layout may be such that an important label of the map is not hidden by the video window 13 by using a known map labeling technique. This is the same in each of the following embodiments, although not particularly specified.

In addition, even if the video is not only played in the forward direction but also in special playback such as fast-forward or reverse playback, the above display can be performed in synchronization with the shooting range of the image frame being played back. . This is the same in each of the following embodiments, although not particularly specified.

Although the map does not move, means for interactively scrolling the map and changing the scale are provided, and the display described above is performed according to the display range of the map. It is also possible.

Embodiment 2 7 to 10 are diagrams for explaining the video display device according to the second embodiment of the present invention, and more specifically, diagrams showing how the display state of the video changes. The configuration of the video display device according to the second embodiment and the flow of the video display process are the same as those in the first embodiment.

In the following, only different display methods will be described. Whereas the first embodiment changes the display state of the video while keeping the map in accordance with the change in the shooting range, the second embodiment changes the display state of the map while keeping the display state of the video. different. As described in detail below, in the second embodiment, the video and the map are displayed while intuitively grasping changes in the spatial relationship such as the shooting range and the position of the map, the direction (azimuth) of the camera, and the angle of view. In addition to having the same effect as in Embodiment 1 in which observation can be performed without moving the line of sight, the display state of the video does not change.
There is an effect that the video can be observed more concentratedly.

FIG. 7 corresponds to FIG. 3 of the first embodiment. When the shooting range is changed by the moving camera as shown in FIGS. And scroll the map.

FIG. 8 corresponds to FIG. 4 of the first embodiment. As shown in FIGS. 8A to 8B, the video window 13 is positioned near the center in response to the turning of the camera. Display and rotate the map.

FIG. 9 corresponds to FIG. 5 of the first embodiment. In the case where the shooting direction (direction) changes in the sky image shot by the helicopter-mounted camera, the direction of the map and the displayed image are changed. Fig. 9 (a) →
As shown in (b), the map is rotated and displayed without changing the display position of the video window 13.

FIG. 10 corresponds to FIG. 6 of the first embodiment. In the case where the angle of view of an image taken by a moving camera changes with time, the size of the subject shown in the image and the scale of the map are reduced. Video window 1 to keep the relationship at a certain ratio
The scale of the map is changed and displayed without changing the size of 3. For example, if the user zooms in, the map is enlarged as shown in FIG. 10B, and if the user zooms out, the map is reduced and displayed as shown in FIG. 10A.

The display methods according to the first and second embodiments may be used in combination according to the purpose of monitoring or the user's preference.

Embodiment 3 FIG. 11 to 13 are diagrams for explaining the video display device according to the third embodiment of the present invention. More specifically, FIG. 11 is a diagram showing a configuration and a display screen of the video display device, and FIG. FIG. 13 is a flowchart showing the flow of the video display processing, and FIG. 13 is a diagram showing how the display state of the video changes. In these drawings, the components denoted by the same reference numerals as those in FIGS. 1 to 10 are the same or equivalent. Reference numeral 21 denotes the position of the gazing point on the map specified by the mouse cursor 24 (FIG. 13) (the desired display position).
The position designation means is realized by, for example, a software program, and constitutes, together with the mouse cursor 24, a position designation means for designating and inputting a desired display position on a map displayed on the display screen. Reference numeral 22 denotes a video frame specifying unit that specifies a corresponding video frame from the video data 1 based on the acquired position information, and is realized by, for example, a software program. 23 (FIG. 1
3) is the gazing point indicated by the mouse cursor 24;
4 is a mouse cursor.

Next, a process of displaying an image based on a desired display position specified and input by the position specifying means will be described with reference to FIG. In step S11, it is checked whether or not the position of the gazing point acquired by the position indicating means 21 has changed. If the position has changed, the corresponding video frame is specified in step S12. The corresponding video frame compares the position information of the point of interest and the shooting range of the video.For example, if the video frame includes the point of interest in the shooting range, or if multiple video frames are shooting the point of interest, the The video frame closest to the center of the shooting range is selected. In order to perform this comparison at high speed, the data set of the imaging range may be structured using a spatial tree. The spatial tree and its search algorithm are known, and the description thereof is omitted here. In step S13, the video data of the specified video frame is read, and in step S14, the display layout is determined. For example, as in the first embodiment, a video window is arranged near a gazing point and a shooting range, and a display layout is determined in consideration of a change in a shooting range such as a camera direction and an angle of view. Then, step S15 and step S
At 16, the entity data and the attribute data of the video are displayed. If there is no change in the position of the gazing point in step S11, it is checked in step S17 whether or not the display mode based on this gazing point has been completed (instructed by the user). Check for changes.

FIG. 13 shows a state in which a video frame that captures the position of the gazing point designated by the mouse cursor 24 and its attribute data are displayed in the video window 13 on a map. In FIG. 13, as an example, the center point of the photographing range 19 displayed on the map is set as the gazing point, and the gazing point (display desired position) is moved by dragging and moving the photographing range 19 with the mouse cursor 24. This shows that the video window 13 is also moving in conjunction therewith. In this manner, by moving the point of interest interactively, the corresponding video data is dynamically changed and displayed. Thus, while searching for a desired position on the map, it is possible to observe a nearby image without moving the line of sight.

Although the number of specified video frames is one, it is not limited to this. For example, when a plurality of videos capture the position of the point of interest, the video may be automatically played back in order, or an attribute list of the corresponding video frame may be displayed to allow the user to interactively select and play. Alternatively, a corresponding video frame may be specified based on the position of the gazing point and the reproduction time while the reproduction time is advanced in the video reproduction mode.

Instead of the gaze point, for example, an area on the map (area having a two-dimensional spread) specified by the mouse may be set as the gaze area, and a video frame or a set of video frames for capturing the gaze area may be displayed. .

Although the map is not moved, means for interactively scrolling the map and changing the scale are provided so that the above-described display is performed according to the display range of the map. It is also possible.

Embodiment 4 FIG. FIG. 14 is a diagram for explaining an image display device according to Embodiment 4 of the present invention, and more specifically, a diagram for explaining how a display state of an image changes. FIG. 14A shows the route of three helicopters, and FIGS. 14B and 14C show the display screen at each time. The configuration of the video display device according to the fourth embodiment and the flow of the video display process are the same as in the first embodiment.

In the following, only different display methods will be described. Embodiment 1 differs from Embodiment 1 in that only one image is displayed, whereas Embodiment 4 displays a plurality of images simultaneously on a map. That is, for example, FIG.
As shown in FIG. 1 to No. 3 helicopters have different routes 17a, 17b, 17
The images shot at No. c are displayed on the map as shown in FIGS. 14 (b) and (c), respectively. 1 to No. 3. Synchronous reproduction is performed in three video windows 13a, 13b, and 13c. At the time point in FIG. 14B, that is, at 10:25:33 on April 11, 2001, No. The route 17c of the helicopter of No. 3 is not within the display range of the map window, and accordingly, No. 1 and No. 2, two video windows 13a and 13b are displayed so as to be superimposed on the map, and are reproduced synchronously. After that, No. The route 17c of the helicopter 3 enters the display range of the map window, and FIG.
At the time of (c), that is, 10:04 on April 11, 2001
At 0 minutes 27 seconds, No. 1 to No. 3, three video windows 13a, 13b, 13c are displayed superimposed on the map and are reproduced synchronously.

In the fourth embodiment, the display of the map is not changed, and the image frames (image windows 13a, 13
b, 13c) are displayed near the shooting range. The display layout is determined in accordance with the position of the shooting range, the direction of the camera, the change in the angle of view, and the like, as in the case of the first embodiment. This has the effect that, for a plurality of videos, the user can easily observe the videos and the map without moving the line of sight, while intuitively grasping the change in the spatial relationship between the shooting range and the map.

Although the map is not moved, means for interactively scrolling the map and changing the scale are provided so that the display as described above is performed according to the display range of the map. It is also possible.

Also, a case has been described in which images captured by a plurality of cameras are reproduced synchronously. However, images of the same camera at different times may be displayed simultaneously, or images of different cameras at different times may be displayed simultaneously. Good.

Embodiment 5 FIG. FIGS. 15 and 16 are diagrams for explaining the image display device according to the fifth embodiment of the present invention, and more specifically are diagrams for explaining how the display state of the image changes. FIG. 15A and FIG.
(A) shows the route of three helicopters, and FIG.
FIGS. 16B and 16C and FIGS. 16B and 16C show the state of the display screen at each time. The configuration of the video display device according to the fifth embodiment and the flow of display processing are the same as those of the fourth embodiment.

In the following, only different display methods will be described. In the above-described fourth embodiment, the case where an image whose shooting range is within the display range of the map window is displayed. However, in the fifth embodiment, a camera designating unit for designating and inputting a camera is provided. Is always displayed, and a plurality of images are simultaneously displayed on the map.

That is, for example, in FIG. 15, as shown in (b) and (c), the designated No. No. 2 photographed by camera No. 2 The video window 2 is always displayed at the center of the map window, and the map is scrolled, rotated, or scaled according to the change of the shooting range. In response to a change in the displayed map area, the image of another camera is dynamically switched on the map to display the image capturing the map area. Therefore, it is easy to observe the image of the designated camera.

Also, for example, in FIG.
o. No. 2 camera is always displayed. The display of the map is not changed unless the shooting range of the second camera falls outside the map area displayed in the map window. When going out of the displayed map area, the displayed map area is changed and The video of the second camera is always displayed. As a result, an important image and its photographing range can always be observed, and the other images can be viewed while grasping the positional relationship.

The camera designating means for designating and inputting a camera includes, for example, a keyboard for inputting a camera number, a mouse for pointing a video window displayed on the screen, and a camera designated by interpreting the input. Consists of a software program to be specified.

Although one camera is specified, the present invention is not limited to this. A plurality of cameras are specified, and a map display is performed so that images shot by the cameras are always displayed. Can be changed.

Embodiment 6 FIG. FIG. 17 is a diagram for explaining an image display device according to Embodiment 6 of the present invention, and more specifically, is a diagram showing a display state of an image. The configuration of the video display device according to the sixth embodiment and the flow of the video display process are the same as those of the fourth or fifth embodiment.

In the following, only different display methods will be described. Embodiment 6 is different from Embodiments 4 and 5 in that the display layout is determined so that a plurality of video windows do not overlap. That is, for example, as shown in FIG.
a and 13b at a predetermined position (for example, shooting range 1 on a map)
9a and 19b).
There are cases where two video windows 13a and 13b are displayed overlapping. In such a case, in the sixth embodiment, the layout is determined so that the two video windows 13a and 13b do not overlap near the shooting ranges 19a and 19b, and are displayed on a map. The process of determining the arrangement so that the video windows 13a and 13b do not overlap can be realized by applying a known map labeling process, and a description thereof will be omitted. Accordingly, it is possible to prevent the video windows from being overlapped due to, for example, the closeness of the photographing range, and to prevent poor observation, and to observe a plurality of videos without fail.

FIG. 17 shows the case where two video windows overlap, but the same processing can be performed when three or more video windows overlap.

Embodiment 7 FIG. FIG. 18 is a diagram for explaining an image display device according to Embodiment 7 of the present invention, and more specifically, is a diagram showing a display state of an image. The configuration of the video display device according to the seventh embodiment and the flow of the video display process are the same as those of the fourth or fifth embodiment.

In the following, only different display methods will be described. The seventh embodiment is different from the fourth and fifth embodiments in that, when a plurality of videos are displayed in a superimposed manner, the superimposed display method is determined based on a predetermined camera or video data priority. That is, for example, FIG.
Shows an example in which, when two video windows 13a and 13b overlap, the lower priority is displayed lower and the higher priority is displayed higher. (A) shows the video window 13a in the video window 13b. Higher priority than
(B) shows the opposite case. This allows
You can observe important images well.

Although the case where two video windows overlap has been described, the same processing can be performed when three or more windows overlap.

The priority order is not limited to a fixed order given in advance, but may be changed interactively by the user or dynamically changed according to the purpose of observation.

In each of the above embodiments, the case where the map is a general map has been described. However, the present invention is not limited to this, and may be, for example, an indoor facility layout. In this case, the camera used is, for example, a moving camera that moves along a rail mounted on the ceiling or floor, a turning camera mounted on the ceiling, etc., and remotely controls the shooting direction and angle of view like a surveillance camera It may be something that can be done.

[0060]

As described above, according to the present invention, data of a video whose photographing range changes over time is reproduced and displayed on a display screen so as to be superimposed on a map including the photographing range of the video. Since the display state of the video or the map is changed in response to the change in the shooting range, the video is captured while grasping the change in the shooting range on the map without moving the line of sight between the map and the video. It can be easily observed. Also, when the image is changed, observation can be performed with emphasis on grasping the state of the shooting range changing on the map, and when the map is changed, the shooting range changes with emphasis on image observation You can grasp the situation.

Further, a position specifying means for specifying and inputting a desired display position on the map displayed on the display screen, and a corresponding image from the video data based on the desired display position specified and input by the position specifying means. Since the image frame specifying means for specifying the frame is provided, it is possible to easily specify the desired display position on the map and observe the image without moving the line of sight between the map and the image.

The video data is composed of a plurality of video data shot by a plurality of cameras and time-synchronized with each other, and the plurality of video data are reproduced in synchronization. There is an effect that the video and the map can be easily observed without moving the line of sight while intuitively grasping the change in the spatial relationship between the range and the map.

Further, since a camera designating means for designating and inputting a camera is provided, and at least the video data of the camera designated by the camera designating means is always reproduced and displayed, an important picture can be always observed. In addition, it is possible to observe other images and how the photographing range changes.

Since a plurality of images are displayed on the map without overlapping each other, the plurality of images can be observed without fail.

Further, when a plurality of videos overlap on the map, they are superimposed and displayed in accordance with the priority given to each video, so that important videos can be observed well.

[Brief description of the drawings]

FIG. 1 is a diagram for explaining a video display device according to a first embodiment of the present invention.

FIG. 2 is a diagram for explaining the video display device according to the first embodiment of the present invention.

FIG. 3 is a diagram for explaining the video display device according to the first embodiment of the present invention.

FIG. 4 is a diagram for explaining the video display device according to the first embodiment of the present invention.

FIG. 5 is a diagram for explaining the video display device according to the first embodiment of the present invention.

FIG. 6 is a diagram for explaining the video display device according to the first embodiment of the present invention.

FIG. 7 is a diagram for explaining a video display device according to a second embodiment of the present invention.

FIG. 8 is a diagram for explaining an image display device according to a second embodiment of the present invention.

FIG. 9 is a diagram for explaining an image display device according to a second embodiment of the present invention.

FIG. 10 is a diagram for explaining a video display device according to a second embodiment of the present invention.

FIG. 11 is a diagram for explaining a video display device according to a third embodiment of the present invention.

FIG. 12 is a diagram for explaining a video display device according to a third embodiment of the present invention.

FIG. 13 is a diagram for explaining a video display device according to a third embodiment of the present invention.

FIG. 14 is a diagram illustrating a video display device according to a fourth embodiment of the present invention.

FIG. 15 is a diagram for explaining a video display device according to a fifth embodiment of the present invention.

FIG. 16 is a diagram for explaining an image display device according to a fifth embodiment of the present invention.

FIG. 17 is a diagram for explaining an image display device according to a sixth embodiment of the present invention.

FIG. 18 is a diagram for explaining a video display device according to a seventh embodiment of the present invention.

FIG. 19 is a diagram for explaining a conventional video display device.

[Explanation of symbols]

1 video data, 2 attribute data, 3 entity data, 4 map data, 5 display means, 6 display layout determining means, 7 video display means, 8 attribute display means, 9 map display means, 10 interactive means, 11
Display screen, 12 Map window, 13, 13a, 1
3b, 13c video window, 14 video playback button, 15 time display panel, 16 mouse, 1
7, 17a, 17b, 17c Navigation trajectory of a helicopter equipped with a camera, 18 Position where the currently reproduced video frame was shot, 19, 19a, 19b Shooting range, 2
0 camera icon, 21 position indicating means, 22
Video frame specifying means, 23 gazing points, 24 mouse cursor.

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Shunji Nozawa 2-3-2 Marunouchi, Chiyoda-ku, Tokyo F-term (reference) 2C032 HB22 HC24 HC25 HC26 HC32 HD03 HD16 5B069 AA01 BA01 BA04 BB16 CA15 DD15 JA02 5E501 AA02 AA23 AC15 AC33 BA03 BA05 CA02 CB09 EA11 EA13 EB05 FA14 FB43

Claims (6)

[Claims] 1. A system for reproducing data of a video whose photographing range changes over time and displaying the data on a display screen so as to be superimposed on a map including the photographing range of the video. And changing the display state of the image or map. 2. A position specifying means for specifying and inputting a desired display position on a map displayed on a display screen, and a corresponding image from the video data based on the desired display position specified and input by the position specifying means. The video display device according to claim 1, further comprising: a video frame specifying unit that specifies a frame. 3. The video data is composed of a plurality of video data shot by a plurality of cameras and time-synchronized with each other.
The video display device according to claim 1, wherein the plurality of video data are reproduced synchronously. 4. The image according to claim 3, further comprising a camera designating means for designating and inputting a camera, wherein at least image data of the camera designated by said camera designating means is always reproduced and displayed. Display device. 5. The image display device according to claim 3, wherein a plurality of images are displayed on the map without overlapping each other. 6. The video display device according to claim 3, wherein when a plurality of videos overlap on a map, the videos are superimposed and displayed according to a priority given to each of the videos.