JP2005268972A - Video display system and video display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video display system, wherein a monitoring person can easily grasp the photographing position and the moving direction of a mobile camera. <P>SOLUTION: The mobile camera 1 photographs a video image at an arbitrary position, while moving, recognizes the photographed position, and transmits information of a photographed video image and the photographed position to a network section 105. An image processing section 109 generates a display video image displayed on a monitor 104, on the basis of the photographed video image received by the network section 105. When detecting the movement of the mobile camera 1 on the basis of the information of the photographed position received by the network section 105, a CPU 106 determines the display position of the display video image on the monitor 104, on the basis of the information of the photographed position and informs the image processing section 109 of this. The image processing section 109 displays the display video image of the mobile camera 1 at the display position notified from the CPU 106. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image display system and an image display method for displaying an image captured at an arbitrary position while a mobile camera moves on a screen.

  Conventionally, as a surveillance camera system, a video display system that divides and displays videos taken by a plurality of fixed cameras on one screen is generally used. According to this conventional video display system, video transmitted from a plurality of fixed cameras can be viewed on one screen.

  In addition, as a conventional video display system, there is a video display system that displays video transmitted from a plurality of fixed cameras on one screen at a position corresponding to the shooting position (height, horizontal direction) of the fixed camera. Published (for example, see Patent Document 1). According to this video display system, when the same subject is photographed from various directions by a plurality of fixed cameras and displayed on one screen, the shooting position of each fixed camera is intuitively determined from the display on the screen. Can grasp.

  On the other hand, the video display system used in the surveillance camera system for monitoring a wide surveillance area such as a parking lot or a store reduces the blind spot and easily grasps the shooting position from multiple shot images on one screen. It is required to be able to do it. The blind spot can be reduced by installing a plurality of fixed cameras and a mobile camera and supplementing the blind spot of the fixed camera with the mobile camera.

  However, in the conventional video display system, even when a mobile camera is installed to reduce the blind spot, the captured video is divided and displayed on one screen together with the captured video of other fixed cameras. There was a problem that it was difficult to grasp the shooting position and moving direction of the mobile camera.

In addition, a conventional video display system that displays images transmitted from a plurality of fixed cameras on one screen at a position corresponding to the shooting position (height, horizontal direction) of the fixed camera is the same shooting target. When shooting images from various directions with a plurality of cameras, the shooting position of each camera can be intuitively grasped from the shot images of each camera displayed on one screen. It is a system suitable for the system, and cannot be applied to a system that monitors a wide surveillance area.
JP 2000-261794 A

  In view of the above problems, the present invention displays an image captured while the mobile camera is moving on the screen at a position corresponding to the shooting position, and moves the screen according to the movement. It is an object of the present invention to provide a video display system and a video display method that enable a monitor to easily grasp the shooting position and moving direction of a mobile camera and reduce the blind spot in a wide monitoring area.

  The present invention also displays on the screen images taken by a plurality of fixed cameras on the screen at positions corresponding to the shooting positions of the respective fixed cameras, and images taken while the mobile camera moves The position of the mobile camera is displayed on the screen, and in response to the movement, the monitor moves the screen where the images taken by the fixed cameras are displayed. It is an object of the present invention to provide a video display system and a video display method capable of easily grasping a moving direction and reducing a blind spot in a wide monitoring area.

  In addition, the present invention divides and displays images taken by the mobile camera and the plurality of fixed cameras on the screen at positions corresponding to the shooting positions of the mobile camera and the plurality of fixed cameras. By changing the divided display position according to the movement, a video display system and a video that enable the supervisor to easily grasp the shooting position and moving direction of the mobile camera and reduce the blind spot in a wide monitoring area, and video An object is to provide a display method.

  In addition, the present invention divides and displays on the screen the images captured by the mobile camera and the plurality of fixed cameras on the screen at positions corresponding to the initial shooting positions of the mobile camera and each fixed camera, and the divided display. In contrast to this, the video captured while the mobile camera is moving is displayed on a small screen at a position corresponding to the shooting position, and this small screen is displayed in accordance with the movement of the mobile camera and a plurality of images. By moving the image captured by the fixed camera on the divided screen, the monitor can easily grasp the shooting position and moving direction of the mobile camera and can reduce the blind spot in a wide monitoring area. An object is to provide a video display system and a video display method.

  The video display system according to claim 1 of the present invention captures video at an arbitrary position while moving, and also captures the video and the information on the shooting position transmitted from at least one mobile camera that recognizes the shot position. Receiving means for receiving, display video creating means for creating a display video of a predetermined size to be displayed on the screen based on the received photographed video, and the screen based on the received information on the photographing position. Display position determining means for determining the display position of the display video on the display, and display means for displaying the display video at the determined display position on the screen, and the shooting position of the mobile camera The display position of the display image is moved according to the movement.

  The video display system according to claim 2 of the present invention is the video display system according to claim 1, wherein the mobile camera recognizes at least one of a shooting direction or a moving direction and information on the shooting direction. Alternatively, it has a function of transmitting at least one of movement direction information to the reception unit, and the reception unit receives at least one of the shooting direction information or the movement direction information transmitted from the mobile camera. The display position determining means determines the display position based on at least one of the information on the photographing position and the information on the photographing direction or the information on the moving direction.

  The video display system according to claim 3 of the present invention is the video display system according to claim 1, wherein the mobile camera recognizes at least one of a shooting direction and a moving direction, and information on the shooting direction. Alternatively, it has a function of transmitting at least one of movement direction information to the reception unit, and the reception unit receives at least one of the shooting direction information or the movement direction information transmitted from the mobile camera. A shooting direction mark creating means for creating a shooting direction mark representing a shooting direction of the display image based on the received information on the shooting direction or the display based on the received information on the moving direction. At least one of a moving direction mark creating means for creating a moving direction mark representing a moving direction of the video, and the display means adds the display direction to the display video. Characterized in that it has at least one of the features that are denoted the moving direction mark function or the display image shaded direction mark displayed on the screen to display on the screen.

  The video display system according to claim 4 of the present invention is the video display system according to claim 3, wherein the display position determining means is information on the photographing position and information on the photographing direction or information on the moving direction. The display position is determined based on at least one of the above.

  The video display system according to claim 5 of the present invention captures an image at an arbitrary position while moving with at least one fixed camera that recognizes the captured position while capturing an image at a specific position. And at least one mobile camera for recognizing the photographed position, receiving means for receiving the photographed image and information on the photographed position, and a predetermined display for displaying on the screen based on each of the received photographed images. Display image creation means for creating display images each having a size of the display, display position determination means for determining the display position of each of the display images on the screen based on the received information on the shooting position, and on the screen Display means for simultaneously displaying each of the display images at the determined display position according to the movement of the shooting position of the mobile camera. Wherein the display position of the display image of the mobile camera moves.

  The video display system according to claim 6 of the present invention is the video display system according to claim 5, wherein each of the fixed camera and the mobile camera recognizes a shooting direction and information on the shooting direction. To the receiving means, and the receiving means has a function of receiving information on the photographing direction transmitted from each of the fixed camera and the movable camera, and determines the display position. A means determines the display position based on the information on the photographing position and the information on the photographing direction.

  The video display system according to claim 7 of the present invention is the video display system according to claim 5, wherein each of the fixed camera and the mobile camera recognizes a shooting direction and information on the shooting direction. Is transmitted to the receiving means, and the receiving means has a function of receiving the shooting direction information transmitted from each of the fixed camera and the movable camera, and the received And a shooting direction mark creating means for creating a shooting direction mark representing a shooting direction of each of the display videos based on information of a shooting direction, wherein the display means attaches the shooting direction mark to each of the display videos. It has a function of displaying above.

  The video display system according to claim 8 of the present invention is the video display system according to claim 7, wherein the display position determining means is configured to display the display position based on the information on the shooting position and the information on the shooting direction. It is characterized by determining.

  The video display system according to claim 9 of the present invention is the video display system according to any one of claims 5 to 8, wherein the mobile camera recognizes the direction of movement and displays information on the direction of movement. A function of transmitting to the receiving means, the receiving means has a function of receiving information on the moving direction transmitted from the mobile camera, and the display position determining means includes information on the photographing position. The display position of the display image of the mobile camera is determined based on the information on the moving direction.

  The video display system according to claim 10 of the present invention is the video display system according to any one of claims 6 to 8, wherein the mobile camera recognizes the direction of movement and displays information on the direction of movement. A function of transmitting to the receiving means, the receiving means has a function of receiving information on the moving direction transmitted from the mobile camera, and the display position determining means includes information on the photographing position. The display position of the display image of the mobile camera is determined based on the information on the photographing direction and the information on the moving direction.

  An image display system according to an eleventh aspect of the present invention is the image display system according to any one of the fifth to eighth aspects, wherein the mobile camera recognizes the direction of movement and displays information on the direction of movement. Having a function of transmitting to the receiving means, the receiving means having a function of receiving information on the moving direction transmitted from the mobile camera, and based on the received information on the moving direction. A moving direction mark creating means for creating a moving direction mark representing a moving direction of the display image of the mobile camera, wherein the display means attaches the moving direction mark to the display image of the mobile camera and the screen; It has a function of displaying above.

  A video display system according to a twelfth aspect of the present invention is the video display system according to any one of the ninth or tenth aspects, wherein the mobile camera is configured to receive the moving direction based on the received information on the moving direction. A function of creating a moving direction mark creating means for creating a moving direction mark representing a moving direction of a display image, and the display means attaching the moving direction mark to the display image of the mobile camera and displaying it on the screen; It is characterized by having.

  A video display system according to a thirteenth aspect of the present invention is the video display system according to any one of the fifth to twelfth aspects, wherein there are a plurality of the fixed cameras, and the plurality of the fixed types are fixed. The display image of the camera is divided and displayed on the screen, and the display image of the mobile camera is superimposed and displayed on the divided and displayed screen.

A video display system according to a fourteenth aspect of the present invention is the video display system according to the thirteenth aspect, wherein the display video of the mobile camera is displayed on a small screen.
According to a fifteenth aspect of the present invention, there is provided a video display system according to any one of the fifth to twelfth aspects, wherein there are a plurality of the fixed cameras, the movable camera and the plurality of the fixed cameras. The display image of the fixed camera of the unit is divided and displayed on the screen, and the display image of the mobile camera and the plurality of fixed cameras is divided according to the movement of the shooting position of the mobile camera The display position is changed.

  According to a sixteenth aspect of the present invention, there is provided a video display system according to any one of the fifth to twelfth aspects, wherein there are a plurality of the fixed cameras, the movable camera and the plurality of the fixed cameras. The display image of the fixed camera of the stand is divided and displayed on the screen, and the display image of the mobile camera is displayed on a small screen on the divided display, and the small screen display It moves on the screen according to the movement of the photographing position of the mobile camera.

  The video display system according to claim 17 of the present invention is the video display system according to any one of claims 1 to 16, wherein each of the display videos is shot based on the received information of the shooting position. A photographing position mark creating means for creating a photographing position mark representing the position is provided, and the display means has a function of attaching the photographing position mark to each of the displayed images and displaying it on the screen.

  The video display method according to claim 18 of the present invention is a video display method and a video shooting position transmitted from at least one mobile camera that captures video at an arbitrary position while moving and recognizes the video shooting position. A receiving step for receiving the information on the screen, and creating a display video of a predetermined size to be displayed on the screen based on the received video, and on the screen based on the received information on the shooting position. A display step of determining a display position of the display image and displaying the display image at the determined display position on the screen, and displaying the display image in accordance with movement of a shooting position of the mobile camera The display position is moved.

  The video display method according to claim 19 of the present invention is the video display method according to claim 18, wherein the mobile camera recognizes at least one of a shooting direction or a moving direction and information on the shooting direction. Alternatively, it has a function of transmitting at least one of movement direction information, and in the receiving step, receives at least one of the shooting direction information or the movement direction information transmitted from the mobile camera, and In the display step, when the display position is determined, the display position is determined based on at least one of the information on the photographing position and the information on the photographing direction or the information on the moving direction.

  The video display method according to claim 20 of the present invention is the video display method according to claim 18, wherein the mobile camera recognizes at least one of a shooting direction or a moving direction and information on the shooting direction. Alternatively, it has a function of transmitting at least one of movement direction information, and in the receiving step, receives at least one of the shooting direction information or the movement direction information transmitted from the mobile camera, and In the display step, a shooting direction mark indicating a shooting direction of the display image is created based on the received information of the shooting direction, or a moving direction of the display image is determined based on the received information of the moving direction. The moving direction mark to be displayed or both the shooting direction mark and the moving direction mark are created, and the shooting direction is displayed on the display image. Over click or subjected to at least one of the moving direction mark and displaying on the screen.

  The video display method according to claim 21 of the present invention is the video display method according to claim 20, wherein in the display step, when determining the display position, the information on the shooting position and the shooting direction are determined. The display position is determined based on at least one of information or information on the moving direction.

  According to a twenty-second aspect of the present invention, there is provided a video display method for shooting a video at a specific position and moving a video at an arbitrary position while moving with at least one fixed camera that recognizes the shot position. And a reception step for receiving information on the captured image and the captured position transmitted from each of at least one mobile camera that recognizes the captured position, and a predetermined display on the screen based on each of the received captured images. Each of the display images of the size is determined, the display position of each of the display images on the screen is determined based on the received information of the shooting position, and the determined display position on the screen is A display step of displaying each display video simultaneously, and the display video of the mobile camera according to the movement of the shooting position of the mobile camera It characterized in that for moving the display position.

  The video display method according to claim 23 of the present invention is the video display method according to claim 22, wherein each of the fixed camera and the mobile camera recognizes the shooting direction and information on the shooting direction. In the receiving step, the information on the shooting direction transmitted from each of the fixed camera and the movable camera is received, and the display position is determined in the display step. In this case, the display position is determined based on the information on the photographing position and the information on the photographing direction.

  The video display method according to claim 24 of the present invention is the video display method according to claim 22, wherein each of the fixed camera and the mobile camera recognizes the shooting direction and information on the shooting direction. In the receiving step, the information on the shooting direction transmitted from each of the fixed camera and the mobile camera is received, and the received shooting direction is received in the display step. On the basis of the above information, a shooting direction mark representing the shooting direction of each display video is created, and the display direction mark is attached to each display video and displayed on the screen.

  The video display method according to claim 25 of the present invention is the video display method according to claim 24, wherein in the display step, the information on the shooting position and the shooting direction are determined when the display position is determined. The display position is determined based on information.

  An image display method according to claim 26 of the present invention is the image display method according to any one of claims 22 to 25, wherein the mobile camera recognizes the direction of movement and displays information on the direction of movement. A function of transmitting, in the receiving step, receiving the information on the moving direction transmitted from the mobile camera, and in the displaying step, in determining the display position, The display position of the display image of the mobile camera is determined based on the information on the moving direction.

  The image display method according to claim 27 of the present invention is the image display method according to any of claims 23 to 25, wherein the mobile camera recognizes the direction of movement and displays information on the direction of movement. A function of transmitting, in the receiving step, receiving the information on the moving direction transmitted from the mobile camera, and in the displaying step, in determining the display position, The display position of the display image of the mobile camera is determined based on the information on the photographing direction and the information on the moving direction.

  The video display method according to claim 28 of the present invention is the video display method according to any of claims 22 to 25, wherein the mobile camera recognizes the direction of movement and displays information on the direction of movement. A function of transmitting, in the receiving step, receiving information on the moving direction transmitted from the mobile camera, and in the displaying step, the moving type based on the received information on the moving direction. A moving direction mark representing a moving direction of the display image of the camera is created, and the moving direction mark is attached to the display image of the mobile camera and displayed on the screen.

  The video display method according to claim 29 of the present invention is the video display method according to claim 26 or 27, wherein, in the display step, the video display method is based on the received information on the moving direction. A moving direction mark representing a moving direction of the display image of the mobile camera is created, and the moving direction mark is attached to the display image of the mobile camera and displayed on the screen.

  The video display method according to claim 30 of the present invention is the video display method according to any one of claims 22 to 29, wherein there are a plurality of the fixed cameras, and the plurality of the fixed type cameras. The display image of the camera is divided and displayed on the screen, and the display image of the mobile camera is superimposed and displayed on the divided and displayed screen.

The video display method according to a thirty-first aspect of the present invention is the video display method according to the thirty-third aspect, wherein the display video of the mobile camera is displayed on a small screen.
A video display method according to a thirty-second aspect of the present invention is the video display method according to any one of the twenty-second to twenty-ninth aspects, wherein there are a plurality of the fixed cameras, and the mobile camera and the plurality The display image of the fixed camera of the unit is divided and displayed on the screen, and the display image of the mobile camera and the plurality of fixed cameras is divided according to the movement of the shooting position of the mobile camera The display position is changed.

  The video display method according to claim 33 of the present invention is the video display method according to any one of claims 22 to 29, wherein there are a plurality of the fixed cameras, and the mobile camera and the plurality of The display image of the fixed camera of the stand is divided and displayed on the screen, and the display image of the mobile camera is displayed on a small screen on the divided display, and the small screen display The display position is moved according to the movement of the photographing position of the mobile camera.

  Further, the video display method according to claim 34 of the present invention is the video display method according to any one of claims 18 to 33, wherein the display step is based on the received information on the photographing position. A shooting position mark representing a shooting position of each display image is created, and the shooting position mark is attached to each display image and displayed on the screen.

  As described above, according to the present invention, the video captured while the mobile camera is moving is displayed on the screen at a position corresponding to the shooting position, and the screen is moved according to the movement. The person can easily grasp the shooting position and moving direction of the mobile camera. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced. Furthermore, for example, if the video is superimposed and displayed on a screen displaying a map of the monitoring area, the photographing position and moving direction of the mobile camera can be more easily grasped.

  In addition, images taken by multiple fixed cameras are displayed on the screen at positions corresponding to the shooting positions of each fixed camera, and images shot while the mobile camera moves are associated with the shooting positions. The position is displayed on the screen, and the screen is moved according to the movement of the images taken by multiple fixed cameras. It becomes possible to easily grasp the shooting position and moving direction of the mobile camera. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

  In addition, images taken by multiple fixed cameras are divided and displayed on the screen at positions corresponding to the shooting positions of each fixed camera, and images taken while the mobile camera moves are associated with the shooting positions. The position is displayed on the screen, and the screen is moved on the screen where the images of multiple fixed cameras are divided according to the movement. It becomes possible to easily grasp the shooting position and moving direction of the mobile camera. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

  In addition, images taken by the mobile camera and multiple fixed cameras are divided and displayed on the screen at positions corresponding to the shooting positions of the mobile camera and each fixed camera. Since the divided display position is changed, the monitor can easily grasp the shooting position and moving direction of the mobile camera from the change and the display position relationship of each camera. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

  In addition, images taken by the mobile camera and multiple fixed cameras are displayed separately on the screen at positions corresponding to the initial shooting positions of the mobile camera and each fixed camera. In addition, the video captured while the mobile camera is moving is displayed on a small screen on the screen at a position corresponding to the shooting position, and this small screen display is fixed to the mobile camera according to the movement. Since the video of the camera is moved on the screen on which the video is divided and displayed, the monitor can easily grasp the shooting position and moving direction of the mobile camera from the relationship of the movement and the display position of each camera. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

Embodiments of the present invention will be described below in detail with reference to the drawings.
FIG. 1 is a schematic configuration diagram of a video display system according to the present embodiment.
In FIG. 1, reference numeral 101 denotes a video display system main body, and 102 denotes a photographing unit. The photographing means 102 includes a mobile camera 1 and fixed cameras 2 to 9. The mobile camera 1 captures an image at an arbitrary position while moving, and the fixed cameras 2 to 9 capture an image at a specific position. The mobile camera 1 can recognize the position where the video is shot, the direction of shooting, and the direction of movement. The fixed cameras 2 to 9 can recognize the position where the video is shot and the direction of shooting. These pieces of information are transmitted together with the data of the captured video (captured video).

  Reference numeral 103 denotes a video display processing device. The video display processing device 103 associates each captured video transmitted from each camera 1 to 9 with its shooting position or shooting area (shooting range) based on the shooting position information transmitted together with the shot video. The processing for displaying on the monitor (screen) at the same position is performed. Reference numeral 104 denotes a monitor (screen). The monitor 104 displays a captured video (display video) processed by the video display processing device 103. Therefore, the video imaged by the mobile camera 1 moves on the screen according to the movement of the mobile camera 1.

  In the video display processing apparatus 103, reference numeral 105 denotes a network unit (reception means). The network unit 105 transmits / receives data to / from the photographing unit 102. Reference numeral 106 denotes a CPU. The CPU 106 controls the entire video display system 101 and detects the shooting position, shooting direction, and movement direction of each camera based on data from each camera 1 to 9 received by the network unit 105.

  Here, the CPU 106 serves as a display position determination unit. That is, the CPU 106 uses the information on the photographing position from the mobile camera 1, the information on the photographing direction, the information on the moving direction, the information on the photographing position from the fixed cameras 2 to 9, and the information on the photographing direction, to The display position of the captured images (display images) of the cameras 1 to 9 is determined. As described above, by using the information on the shooting position and the information on the shooting direction, the shooting area (shooting range) of each camera can be reflected on the display position. Of course, the display position may be determined using only the information of the photographing position. When only the information on the shooting position is used, the display position of each display image is a display position reflecting the positional relationship of each camera. Further, regarding the display position of the mobile camera, the positional relationship with the fixed camera and the relationship of the photographing range can be more accurately reflected by using information on the moving direction.

  Reference numeral 107 denotes a video decoding unit. Each of the cameras 1 to 9 transmits encoded data as a photographed video to the network unit 105 of the video display processing device 103. The video decoding unit 107 decodes each encoded data received by the network unit 105.

  Reference numeral 108 denotes a memory. The memory 108 holds a photographed image from the photographing unit 102 received by the network unit 105, information on a photographing position, and the like. Reference numeral 109 denotes an image processing unit. Here, the image processing unit 109 serves as display video creation means, display means, shooting position mark creation means, shooting direction mark creation means, and movement direction mark creation means.

  That is, the image processing unit 109 creates a display image of a predetermined size to be displayed on the monitor 104 based on the captured images of the cameras 1 to 9 decoded by the video decoding unit 107. Then, the image processing unit 109 synthesizes each display video based on the information on the display position of each display video notified from the CPU 106, outputs the synthesized video to the monitor 104, and outputs each synthesized video to each display position on the monitor 104. Display the displayed image at the same time.

  Further, the image processing unit 109 creates a shooting position mark indicating the shooting position of the shot video (display video) of each camera 1 to 9 based on the information of the shooting position from each camera 1 to 9 held in the memory 108. . Then, the image processing unit 109 combines each display video and the shooting position mark, and displays the display video with the shooting position mark on the monitor 104.

  Further, the image processing unit 109 creates a shooting direction mark indicating the shooting direction of the shot video (display video) of each camera 1 to 9 based on the shooting direction information from each camera 1 to 9 held in the memory 108. . Then, the image processing unit 109 combines each display video with the shooting direction mark and displays the display video with the shooting direction mark on the monitor 104.

  Further, the image processing unit 109 creates a movement direction mark indicating the movement direction of the captured video (display video) of the mobile camera 1 based on the information on the movement direction from the mobile camera 1. Then, the image processing unit 109 combines the display image of the mobile camera 1 and the movement direction mark, and displays the display image of the mobile camera 1 with the movement direction mark on the monitor 104.

  In this way, by attaching the shooting position mark to each display image, the monitor supervisor can more easily grasp the shooting position of each display image. In addition, by attaching a shooting direction mark to each display video, the monitor of the monitor can more easily understand the shooting direction of each camera, and the relationship between the shooting areas of each display video can be more easily understood. Become. Further, by attaching a movement direction mark to the display image of the mobile camera, the monitor supervisor can more easily grasp the movement direction of the mobile camera.

  Here, the image processing unit 109 creates each display video (divided display video) so that the display video of the mobile camera 1 and each of the fixed cameras 2 to 9 is divided and displayed on the monitor 104, and the mobile type For the camera 1, a small screen display image is generated in which the display position moves in accordance with the movement of the mobile camera 1. Further, the CPU 106 determines the display position (divided display position) of the divided display video of each camera 1 to 9 based on the initial value such as the shooting position from each camera 1 to 9. It should be noted that it is arbitrary at which time the shooting position or the like is set as the initial value. Further, the CPU 106 determines the display position (small screen display position) of the small screen display video of the mobile camera 1 according to the movement. Here, there are two types of display images of the mobile camera 1 as described above (divided display image and small screen display image), but the shooting position mark or the like may be attached to one or both. Also good.

FIG. 2 is a plan view showing an example of the camera installation position (shooting position) in the building (monitoring area).
In the following description, it is assumed that the cameras 1 to 9 included in the photographing unit 102 shown in FIG. 1 are installed as shown in FIG.

In FIG. 2, 201 denotes a mobile camera, and 202 to 209 denote fixed cameras. Reference numeral 210 denotes a moving rail of the mobile camera 201.
As a method of recognizing the shooting position of each fixed camera 202 to 209, when installing each fixed camera 202 to 209, the monitor displays the shooting position of each fixed camera 202 to 209 with video display processing. There is a method of setting the shooting position of each of the fixed cameras 202 to 209 by transmitting from the apparatus 103 to each of the fixed cameras 202 to 209. For example, when the video display processing device 103 shown in FIG. 1 has map information such as a small store or one floor, and each of the fixed cameras 202 to 209 is installed, a code indicating the map and its code The coordinate position (X, Y) indicating the shooting position (installation position) on the map is transmitted to each fixed camera 202 to 209 by the network unit 105 in the video display processing device 103. For example, when a parking lot, a ranch, a farm, or the like is used as a monitoring area, for example, the camera itself has a GPS so that each of the fixed cameras 202 to 209 can recognize its own shooting position. It may be.

  As a method for recognizing the shooting direction of each fixed camera 202 to 209, for example, an azimuth meter and a gyro indicating the direction are mounted on each fixed camera 202 to 209, for example. Each of the fixed cameras 202 to 209 can recognize the shooting direction by recognizing the horizontal position by the direction meter and the vertical position by the gyro.

  In addition, as a method for the mobile camera 201 to recognize its own shooting position, for example, in a small store or one floor as shown in FIG. 2, the mobile camera 201 is placed on the rail 210 shown in FIG. There is a method in which a coordinate code indicating a position in a small store, one floor, or the like is installed, and the mobile camera 201 reads the coordinate code to recognize its own shooting position. Similarly to the above-described fixed cameras 202 to 209, for example, when a parking lot, a ranch, a farm, or the like is used as a monitoring area, the camera itself has a GPS. The shooting position may be recognized.

  As a method for the mobile camera 201 to recognize its own shooting direction, for example, an orientation meter and a gyro indicating the orientation are mounted on the mobile camera 201 as in the case of the fixed cameras 202 to 209. The mobile camera 201 can recognize the shooting direction by recognizing the horizontal position by the direction meter and the vertical position by the gyro.

  In addition, as a method for the mobile camera 201 to recognize its own moving direction, there is a method for recognizing the moving direction based on an azimuth meter mounted on the mobile camera 201 and a moving distance on the rail 210 within a predetermined time. . Further, the moving direction may be recognized by comparing photographing positions of the mobile camera 201 before and after a predetermined time in a predetermined time unit. When the mobile camera 201 is constantly moving, it is necessary to periodically correct the display position of the display image of the mobile camera 201.

Next, the operation of the video display system will be described.
FIG. 3 is a diagram showing an operation flowchart of the video display processing apparatus 103, and shows a series of operations until the video shot by each camera is displayed on the monitor 104.

  When shooting is started, the mobile camera 1 and the fixed cameras 2 to 9 as the shooting means 102 start shooting the video, encode the shot video, and the fixed cameras 2 to 9 Recognizing the current shooting position and shooting direction, the mobile camera 1 recognizes the current shooting position, shooting direction, and moving direction, and displays the shooting position information and the like along with the shot video (encoded data). Transmit to device 103.

  In step S <b> 301 (reception step), the captured video and the information on the shooting position transmitted from the shooting unit 102 are received by the network unit 105 in the video display processing device 103. When the network unit 105 receives a captured video transmitted from the imaging unit 102, the CPU 106 reads the received information from the network unit 105 and stores it in the memory 108.

  In step S <b> 302, the CPU 106 reads out each encoded data (captured video) transmitted from the imaging unit 102 held in the memory 108, and transfers it to the video decoding unit 107. The video decoding unit 107 decodes each encoded data transferred from the memory 108 and transfers the decoded data to the image processing unit 109.

  In step S303, the image processing unit 109 receives each decoded data transferred from the video decoding unit 107 and creates a divided display video based on each data in order to display the divided data on the monitor 104. Keep it.

  In step S <b> 304, the CPU 106 captures information on the photographing position of the fixed cameras 2 to 9 and information on the photographing direction held by the memory 108, information on the photographing position of the mobile camera 1, information on the photographing direction, and information on the moving direction. Detect information. And CPU106 determines the division | segmentation display position of the picked-up image (display image | video) of the mobile camera 1 and the fixed cameras 2-9 based on initial values, such as the imaging | photography position of each camera 1-9. Note that the small-screen display position of the captured video of the mobile camera 201 is also determined based on the initial value because the mobile camera 1 has not moved at the start of imaging. Thereafter, when the mobile camera 1 moves, the small screen display position is determined based on the information of the shooting position after the movement. The CPU 106 notifies the image processing unit 109 of the determined display position.

  In step S305, the image processing unit 109 creates and holds a small screen display video for displaying the captured video of the mobile camera 1 on a small screen separately from the temporarily displayed split display video.

  In step S306, the image processing unit 109 captures the shooting position, the shooting direction, and the moving direction of the mobile camera 1 so that the observer can easily grasp the shooting position, the shooting direction, and the moving direction of the mobile camera 1. Create and hold a mark that represents.

  In step S307, the image processing unit 109 displays the divided display video of each camera created in step S303 and the small screen display video of the mobile camera 1 created in step S305 at the display position notified from the CPU 106 in step S304. In addition to combining based on the information, the marks of the shooting position, shooting direction, and moving direction created in step S306 are combined with the small screen display video of the mobile camera 1, and this combined video is displayed on the monitor 104.

  The CPU 106 detects the shooting position, shooting direction, and movement direction information of the mobile camera 1 sent via the network unit 105 at predetermined time intervals, and the movement of the shooting position of the mobile camera 1 is detected. In this case, in step S304, the image processing unit 109 is notified of a new small screen display position so that the display position of the small screen display video of the mobile camera 201 moves in accordance with the movement.

In addition, although step S302-step S307 become a display process here, each process order of step S302-step S306 can be changed arbitrarily.
FIG. 4 is a diagram showing a display example of a monitor when each camera is installed as shown in FIG.

  In the example shown in FIG. 4, the video of the fixed camera 202 is encoded based on the shooting position and shooting direction of each of the fixed cameras 202 to 209 and the initial shooting position and shooting direction of the mobile camera 201 (see FIG. 2). In the area indicated by 404, the image of the fixed camera 203 is indicated by an area indicated by reference numeral 406, the image of the fixed camera 204 is indicated by an area indicated by reference numeral 409, and the image of the fixed camera 205 is indicated by an area indicated by reference numeral 408. The video of the camera 206 is indicated by the reference numeral 407, the video of the fixed camera 207 is indicated by the reference numeral 405, the video of the fixed camera 208 is indicated by the reference numeral 402, and the video of the fixed camera 209 is indicated by the reference numeral 403. The video of the mobile camera 201 is divided and displayed in the area denoted by reference numeral 401 in the area shown.

  In FIG. 4, reference numeral 410 denotes a small screen display image of the mobile camera 201, 411 denotes a movement direction mark of the mobile camera 201, and 412 denotes a shooting direction mark of the mobile camera 201.

  As shown in FIG. 4, by displaying the split display video and the small screen display video on the monitor, the supervisor can easily grasp the shooting position, shooting direction, and moving direction of the mobile camera. Further, since the shooting direction mark and the movement direction mark are attached to the small screen display image, it is easier to grasp the shooting direction and the movement direction of the mobile camera.

  Here, a triangle is displayed as the shooting direction mark and an arrow is displayed as the movement direction mark. However, the mark is not limited to a figure (symbol), and it is of course possible to use letters, numbers, or a combination thereof. . Further, although the mark is given only to the small-screen display image of the mobile camera, it goes without saying that other display images may be similarly marked.

  In addition, when the monitor of the monitor 104 wants to grasp the detailed position of the shooting position of the mobile camera 201, the monitor selects the small screen display image 410, so that the map code of the monitoring area and the mobile camera 201 are displayed. The shooting position coordinates may be displayed on the monitor 104.

  As described above, the video shot by each camera is divided and displayed on the screen at a position corresponding to the shooting area of each camera, and the video shot by the mobile camera is displayed on a small screen and moved on the split display screen. Therefore, the monitor supervisor can easily grasp the positional relationship of each camera, the current shooting position of the mobile camera, the moving direction, and the like.

In addition, although the system by the structure of eight fixed cameras and one mobile camera was demonstrated here, it is not restricted to this combination.
Also, here, the video shot by each camera is divided and displayed on the screen at a position corresponding to the shooting area of each camera, and the video shot by the mobile camera is displayed on a small screen and moved on the split display screen. However, the divided display positions of the mobile camera and the fixed camera may be changed according to the movement of the mobile camera without performing the small screen display. In this way, the supervisor can easily grasp the shooting position and moving direction of the mobile camera from the change and the relationship between the display positions of the cameras. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

  Alternatively, only the captured video of the fixed camera may be divided and displayed, and the captured video of the mobile camera may be combined with the divided display screen to be displayed in a superimposed manner. The display image of the mobile camera at this time is not limited to the small screen display. In this way, since the display image of the mobile camera moves on the screen on which the images of the plurality of fixed cameras are divided and displayed, the observer can move from the relationship of the movement and the display position of each camera. It becomes possible to easily grasp the shooting position and moving direction of the camera. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

  Even if the display is not divided, a display image of a predetermined size is simultaneously displayed on the monitor (screen) at a position corresponding to the shooting position or shooting area (shooting range) of each camera, and the mobile camera is displayed. The video may be moved on the screen. In this way, since the display image of the mobile camera moves on the screen on which the images of the plurality of fixed cameras are displayed, the monitor can move the mobile camera based on the movement and the display position of each camera. It becomes possible to easily grasp the shooting position and moving direction of the camera. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

  Alternatively, the map video of the surveillance area and the display video of each camera may be combined, and the display video of each camera may be superimposed and displayed at a position corresponding to the shooting position on the map video of the surveillance area. In this way, the photographing position and moving direction of the mobile camera can be easily grasped.

  Further, the system may be configured with only a mobile camera. For example, if the display image of the mobile camera is displayed on the map image as described above, the monitor monitor can easily grasp the shooting position and the moving direction of the mobile camera. In addition, the monitor can easily grasp the shooting position and moving direction of the mobile camera from the relationship between the display positions of the display images of the plurality of mobile cameras. Moreover, since the monitoring with a mobile camera can be performed, the blind spot of a monitoring area can be reduced.

  According to the video display system and the video display method according to the present invention, the video captured by the mobile camera moves on the screen according to the movement of the mobile camera. It is possible to easily grasp the shooting position and moving direction of the camera, which is useful in a surveillance camera system using a mobile camera.

Schematic configuration diagram of a video display system in an embodiment of the present invention The top view which showed the example of the camera photographing position in the building in embodiment of this invention The figure which shows the operation | movement flowchart of the video display processing apparatus in embodiment of this invention. The figure which shows the example of a display of the monitor in embodiment of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Image display system 102 Image | photographing means 103 Image | video display processing apparatus 104 Monitor 105 Network part 106 CPU
DESCRIPTION OF SYMBOLS 107 Video decoding part 108 Memory 109 Image processing part 201 Mobile camera 202-209 Fixed camera 210 Rail 401 Display image of a mobile camera 402-409 Display picture of a fixed camera 410 Small screen which displays the video of a mobile camera 411 Triangle indicating shooting direction 412 Arrow indicating moving direction

Claims (34)

Receiving means for capturing a video at an arbitrary position while moving and receiving information of a captured video and a shooting position transmitted from at least one mobile camera that recognizes the captured position;
Display image creation means for creating a display image of a predetermined size to be displayed on a screen based on the received photographed image;
Display position determining means for determining a display position of the display image on the screen based on the received information of the shooting position;
Display means for displaying the display image at the determined display position on the screen;
And the display position of the display image moves in accordance with the movement of the shooting position of the mobile camera. The video display system according to claim 1,
The mobile camera has a function of recognizing at least one of a shooting direction or a moving direction and transmitting at least one of shooting direction information or moving direction information to the receiving means;
The receiving means has a function of receiving at least one of the information on the photographing direction or the information on the moving direction transmitted from the mobile camera;
The video display system, wherein the display position determining means determines the display position based on at least one of the information on the photographing position and the information on the photographing direction or the information on the moving direction. The video display system according to claim 1,
The mobile camera has a function of recognizing at least one of a shooting direction or a moving direction and transmitting at least one of shooting direction information or moving direction information to the receiving means;
The receiving means has a function of receiving at least one of the information on the photographing direction or the information on the moving direction transmitted from the mobile camera;
A shooting direction mark creating means for creating a shooting direction mark indicating a shooting direction of the display image based on the received information on the shooting direction or a moving direction of the display image based on the received information on the moving direction. Comprising at least one of movement direction mark creating means for creating a movement direction mark;
The display means has at least one of a function of attaching the shooting direction mark to the display image and displaying it on the screen or a function of attaching the movement direction mark to the display image and displaying it on the screen. Characteristic video display system.   4. The video display system according to claim 3, wherein the display position determining means determines the display position based on at least one of the information on the photographing position and the information on the photographing direction or the information on the moving direction. Video display system. At least one movable camera that captures an image at a specific position and captures an image at an arbitrary position while moving with at least one fixed camera that recognizes the captured position and recognizes the captured position Receiving means for receiving information on the shooting image and the shooting position transmitted from each of the
Display video creation means for creating a display video of a predetermined size to be displayed on the screen based on each of the received video shots;
Display position determining means for determining a display position of each of the display images on the screen based on the received information of the shooting position;
Display means for simultaneously displaying each of the display images at the determined display position on the screen;
And the display position of the display image of the mobile camera moves according to the movement of the shooting position of the mobile camera. The video display system according to claim 5,
Each of the fixed camera and the mobile camera has a function of recognizing a shooting direction and transmitting information of the shooting direction to the receiving unit.
The receiving means has a function of receiving information on the shooting direction transmitted from each of the fixed camera and the movable camera;
The video display system, wherein the display position determining means determines the display position based on information on the photographing position and information on the photographing direction. The video display system according to claim 5,
Each of the fixed camera and the mobile camera has a function of recognizing a shooting direction and transmitting information of the shooting direction to the receiving unit.
The receiving means has a function of receiving information on the shooting direction transmitted from each of the fixed camera and the movable camera;
A shooting direction mark creating means for creating a shooting direction mark representing a shooting direction of each of the display images based on the received shooting direction information;
The video display system characterized in that the display means has a function of displaying the shooting direction mark on each display video and displaying it on the screen.   8. The video display system according to claim 7, wherein the display position determining means determines the display position based on information on the shooting position and information on the shooting direction. The video display system according to any one of claims 5 to 8,
The mobile camera has a function of recognizing the direction of movement and transmitting information of the direction of movement to the receiving means;
The receiving means has a function of receiving information of the moving direction transmitted from the mobile camera;
The video display system, wherein the display position determining means determines the display position of the display video of the mobile camera based on the information on the photographing position and the information on the moving direction. The video display system according to any one of claims 6 to 8,
The mobile camera has a function of recognizing the direction of movement and transmitting information of the direction of movement to the receiving means;
The receiving means has a function of receiving information of the moving direction transmitted from the mobile camera;
The video display system, wherein the display position determining means determines the display position of the display video of the mobile camera based on the information on the photographing position, the information on the photographing direction, and the information on the moving direction. The video display system according to any one of claims 5 to 8,
The mobile camera has a function of recognizing the direction of movement and transmitting information of the direction of movement to the receiving means;
The receiving means has a function of receiving information of the moving direction transmitted from the mobile camera;
A moving direction mark creating means for creating a moving direction mark representing a moving direction of the display image of the mobile camera based on the received moving direction information;
The video display system, wherein the display means has a function of attaching the moving direction mark to the display video of the mobile camera and displaying it on the screen. The video display system according to claim 9 or 10,
A moving direction mark creating means for creating a moving direction mark representing a moving direction of the display image of the mobile camera based on the received moving direction information;
The video display system, wherein the display means has a function of attaching the moving direction mark to the display video of the mobile camera and displaying it on the screen.   The video display system according to any one of claims 5 to 12, wherein there are a plurality of the fixed cameras, and the display videos of the plurality of the fixed cameras are divided and displayed on the screen, An image display system, wherein the display image of the mobile camera is superimposed and displayed on the divided and displayed screen.   14. The video display system according to claim 13, wherein the display video of the mobile camera is displayed on a small screen.   13. The video display system according to claim 5, wherein there are a plurality of the fixed cameras, and the display videos of the mobile camera and the plurality of the fixed cameras are displayed on the screen. 2. A video display system that performs split display and changes a split display position of the display video of the mobile camera and the plurality of fixed cameras in accordance with movement of a shooting position of the mobile camera.   13. The video display system according to claim 5, wherein there are a plurality of the fixed cameras, and the display videos of the mobile camera and the plurality of the fixed cameras are displayed on the screen. In addition to the split display, the display image of the mobile camera is displayed on a small screen on the split display, and the small screen display is displayed on the screen according to the movement of the shooting position of the mobile camera. A video display system characterized by moving. The video display system according to any one of claims 1 to 16,
A shooting position mark creating means for creating a shooting position mark representing the shooting position of each of the display images based on the received shooting position information;
The video display system, wherein the display means has a function of displaying the shooting position mark on each display video and displaying it on the screen. A receiving step of capturing a video at an arbitrary position while moving and receiving information of a captured video and a shooting position transmitted from at least one mobile camera that recognizes the captured position;
A display image having a predetermined size to be displayed on a screen is created based on the received photographed image, and a display position of the display image on the screen is determined based on the received information on the photographing position. A display step of displaying the display image at the determined display position on the screen;
And a display position of the display image is moved in accordance with the movement of the shooting position of the mobile camera. The video display method according to claim 18, wherein
The mobile camera has a function of recognizing at least one of a shooting direction or a moving direction and transmitting at least one of shooting direction information or moving direction information,
In the receiving step, at least one of the information on the photographing direction or the information on the moving direction transmitted from the mobile camera is received,
In the display step, when determining the display position, the display position is determined based on at least one of the information on the photographing position and the information on the photographing direction or the information on the moving direction. . The video display method according to claim 18, wherein
The mobile camera has a function of recognizing at least one of a shooting direction or a moving direction and transmitting at least one of shooting direction information or moving direction information,
In the receiving step, at least one of the information on the photographing direction or the information on the moving direction transmitted from the mobile camera is received,
In the display step, a shooting direction mark indicating a shooting direction of the display image is created based on the received information of the shooting direction, or a moving direction of the display image based on the received information of the moving direction. Or a moving direction mark representing the moving direction mark, or both the shooting direction mark and the moving direction mark are created, and at least one of the shooting direction mark or the moving direction mark is attached to the display image. An image display method characterized by displaying on the top.   21. The video display method according to claim 20, wherein in the display step, the display position is determined based on at least one of the information on the photographing position and the information on the photographing direction or the information on the moving direction. An image display method characterized by determining a position. At least one movable camera that captures an image at a specific position and captures an image at an arbitrary position while moving with at least one fixed camera that recognizes the captured position and recognizes the captured position A receiving step of receiving information on a shooting image and a shooting position transmitted from each of the
A display image of a predetermined size to be displayed on a screen is created based on each of the received captured images, and a display position of each of the display images on the screen is determined based on the received information on the captured position. A display step of simultaneously displaying each of the display images at the determined display position on the screen;
And moving the display position of the display image of the mobile camera according to the movement of the shooting position of the mobile camera. The video display method according to claim 22, wherein
Each of the fixed camera and the mobile camera has a function of recognizing a shooting direction and transmitting information of the shooting direction.
In the receiving step, information on the shooting direction transmitted from each of the fixed camera and the movable camera is received,
In the display step, when the display position is determined, the display position is determined based on information on the photographing position and information on the photographing direction. The video display method according to claim 22, wherein
Each of the fixed camera and the mobile camera has a function of recognizing a shooting direction and transmitting information of the shooting direction.
In the receiving step, information on the shooting direction transmitted from each of the fixed camera and the movable camera is received,
In the display step, a shooting direction mark indicating the shooting direction of each display video is created based on the received information of the shooting direction, and the shooting direction mark is attached to each display video and displayed on the screen. A video display method characterized by:   25. The video display method according to claim 24, wherein, in the display step, when the display position is determined, the display position is determined based on information on the shooting position and information on the shooting direction. Video display method. The video display method according to any one of claims 22 to 25, wherein:
The mobile camera has a function of recognizing the direction of movement and transmitting information of the direction of movement;
In the receiving step, information on the moving direction transmitted from the mobile camera is received,
In the display step, when determining the display position, the display position of the display image of the mobile camera is determined based on the information on the photographing position and the information on the moving direction. . A video display method according to any of claims 23 to 25, wherein
The mobile camera has a function of recognizing the direction of movement and transmitting information of the direction of movement;
In the receiving step, information on the moving direction transmitted from the mobile camera is received,
In the display step, when determining the display position, determining the display position of the display image of the mobile camera based on the information on the photographing position, the information on the photographing direction, and the information on the moving direction. Characteristic video display method. The video display method according to any one of claims 22 to 25, wherein:
The mobile camera has a function of recognizing the direction of movement and transmitting information of the direction of movement;
In the receiving step, information on the moving direction transmitted from the mobile camera is received,
In the display step, a movement direction mark indicating a movement direction of the display image of the mobile camera is created based on the received information of the movement direction, and the movement direction mark is added to the display image of the mobile camera. And displaying the image on the screen.   28. The video display method according to claim 26, wherein, in the display step, a movement direction mark indicating a movement direction of the display video of the mobile camera based on the received information on the movement direction. And displaying the movement direction mark on the screen with the movement direction mark added to the display image of the mobile camera.   30. The video display method according to claim 22, wherein there are a plurality of the fixed cameras, and the display videos of the plurality of the fixed cameras are divided and displayed on the screen, An image display method, wherein the display image of the mobile camera is superimposed and displayed on the divided and displayed screen.   31. The video display method according to claim 30, wherein the display video of the mobile camera is displayed on a small screen.   30. The video display method according to claim 22, wherein there are a plurality of the fixed cameras, and the display videos of the mobile camera and the plurality of the fixed cameras are displayed on the screen. A video display method comprising: split-displaying and changing a split display position of the display video of the mobile camera and the plurality of fixed cameras according to movement of a shooting position of the mobile camera.   30. The video display method according to claim 22, wherein there are a plurality of the fixed cameras, and the display videos of the mobile camera and the plurality of the fixed cameras are displayed on the screen. In addition to the split display, the display image of the mobile camera is displayed on a small screen on the screen where the split display is made, and the display position of the small screen display is changed according to the movement of the shooting position of the mobile camera An image display method characterized by moving. 34. The video display method according to claim 18, wherein, in the display step, a shooting position mark representing a shooting position of each of the display videos is created based on the received information of the shooting position, A video display method, wherein each of the display videos is displayed on the screen with the shooting position mark added thereto.

Images