JP3188084B2 - Video information retrieval system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention searches for a surveillance video camera installed in a plant or the like or inside or outside a building and a facility or the like shown in a mobile surveillance video camera for patrol and the like.
The present invention relates to a video information search system used to provide equipment information to a supervisor or the like.

[0002]

2. Description of the Related Art Conventionally, video cameras have been widely used for monitoring equipment such as plants, and video information of equipment captured by the video cameras can be monitored by a monitoring television monitor in a monitoring room. It has become.

[0003]

However, in general, video information basically has only video information consisting of color and sound information, and the video information is specified on a monitoring television monitor as video video display means. Facilities cannot be searched. In other words, the equipment that can be identified by looking at the video image can be specified only by those who can determine the equipment by viewing it on the display screen, and the judgment is also made by humans and is ambiguous, and from the video image There was a problem that it was impossible to call the specifications of the equipment.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned conventional problems. The present invention specifies a predetermined monitoring target such as equipment in a plant based on video information from a video camera, and enables recognition and retrieval. It is an object of the present invention to obtain a video information search system capable of easily and reliably obtaining design information and the like to be monitored.

[0005]

A video information retrieval system according to the present invention comprises: coordinate conversion means for converting the position coordinates of a monitoring target on the display screen of a video image display means into coordinates on mapping data; Mapping data creation means for creating the mapping data based on the monitoring target shape data and the camera position data obtained by searching the database according to the coordinate-converted monitoring target position data;
Bitmap creating means for creating a bitmap in which the monitoring target is color-changed from the mapping data from the mapping data creating means, and the bitmap information created by the bitmap creating means is provided to the mapping data synthesizing means on the display screen. And overwritten on the display screen.

[0006]

The video camera according to the present invention outputs video information and camera position information of the video camera, and uses the information and the monitoring target shape data stored in advance in the database in the same manner as the video information. By creating mapping data of a viewpoint and synthesizing the mapping data and video information, it is possible to search and recognize a monitoring target designated by a mouse or a pointer on a video screen.

[0007]

BRIEF DESCRIPTION OF THE DRAWINGS FIG.
It will be described based on the following. In FIG. 1, reference numeral 1 denotes a video camera that outputs captured video information a and camera position information b;
Reference numeral 2 denotes a database that stores monitoring target information including the position and shape of the monitoring target 3 by the video camera.

Reference numeral 4 denotes video image display means for displaying the video information a, and enabling coordinates of a monitoring target in the video information a to be set on a display screen. Reference numeral 5 denotes a position of the monitoring target on the display screen. Coordinate conversion means 6 for converting the coordinates into coordinates on the mapping data, based on the monitoring target shape data c and the camera position data b obtained by searching the database 2 according to the coordinate converted monitoring target position data. And mapping data creating means for creating the mapping data.

Reference numeral 7 denotes a bitmap creating means for creating a bitmap in which the monitoring target is color-changed from the mapping data from the mapping data creating means 6, and 8 denotes the bitmap creating means 7.
Is mapping data synthesizing means for converting the bitmap information created in step (1) into coordinates on a display screen and overwriting and displaying the coordinates on the display screen. Reference numeral 9 denotes a display unit of target facility information obtained through bitmap information.

Next, the operation will be described. First, the video camera 1 captures an image of the monitoring target 3 while moving above the monitoring robot 10, and is further registered in the audio recording unit.
The video information a is output together with the camera position data b of the video camera. Here, the position information of the video camera is
Shows the equipment installation site (real space) as a three-dimensional rectangular coordinate system
Measure the initial position coordinates of the monitoring robot,
Of the movement information to the value of
The reference point is set to the coordinate value of the reference point whose coordinates are known in the Cartesian coordinate system.
Known techniques such as measuring and correcting the relative distance and direction from
Calculated on the surveillance robot
The position of the imaging point of the video camera and the reference
This is information representing the illuminated point position as coordinate data.

For this reason, the video image display means 4 displays the image information a on the screen as it is (step S1), and designates a monitoring target on the screen with the mouse 11 (step S2). Is set (step S3).

In addition, as described above, in parallel with the display of the video information a, a three-dimensional shape model is created based on the monitoring target information of the database 2 (step S4). In, the camera position of the three-dimensional shape model is set to the same position as that of the video camera 1, and mapping data similar to the video information from the video camera 1 is created (step S5). Here, the monitoring target information is the trigonometric method
Design drawings of multiple monitored objects represented by
3D coordinates representing each vertex of the shape of the monitored object calculated from
Mark data and surface data of the shape surface represented as a sequence of vertices
Data, the three-dimensional location in the real space where the monitoring target is located
Mark data and the names and attributes required to identify the object
You. The method of creating a three-dimensional shape model is described in the design drawings
Based on multiple basic shapes such as cylinders and spheres
The 3D shape model surface data combined like
Virtual space inside the computer (the sky where the 3D shape model is created)
Interim).

Further, the coordinates of the designated position on the screen (X, Y
Value) is converted to the coordinate value on the mapping data by the coordinate conversion means 5.
(X ', Y') (step S6), and the X ',
From the Y 'value, for example, monitoring target shape data as equipment data is searched using the monitoring target information (step S).
7). Here, a method of creating mapping data will be described. Real sky
Information (3D) in the coordinate system (X'Y'Z ') between
Shape model coordinates and video camera position information (imaging
Point, reference point coordinate value)
Local coordinate system of the camera reference point position and the upper z-axis as (X
YZ) is coordinate-converted for each vertex coordinate value of the three-dimensional model. Sa
XY plane of the local coordinate system including the reference point position (reference plane
3D shape model surface data on a perspective view
Projection, the values of each plane data in the real space coordinate system
(X ′, Y ′, Z ′) and coordinates (X, Y) on the reference plane
Are obtained as mapping data. At this time, local coordinates
When multiple surface data correspond to the value of (X, Y)
Is Z in the local coordinate system to obtain one-to-one mapping data.
Associating the positive and smallest surface data
I do. Note that the method of creating this mapping data is
Z-basis is a basic method for creating graphics for computer graphics.
It is a known technique called a buffer algorithm. Also,
The meaning of the coordinates (X ', Y') on the mapping data is
(X, Y) coordinate value specified by
Designated on the reference plane of the local coordinate system with the reference point on the Z axis
The coordinate data of the position
In the coordinate system of the real space corresponding to the (X, Y) coordinate value
Coordinates of 3D shape model surface data in the monitoring target information
The value (X ', Y') is shown. In addition, mapping day
From the coordinates (X ', Y') on the monitor
Explaining how to search, multiple monitors in the database
It has three-dimensional shape data for each object as viewing object information
I have. (X ', Y') coordinate values and mapping data specified on the screen
3D surface data associated with the
-In the database, among multiple monitored information
The monitoring target information that includes this surface data in the three-dimensional shape data
Select a report and extract all its 3D shape data
Can be searched for.

For this reason, the bitmap creating means 7
Mapping data obtained by changing the color of the searched monitoring target shape data is created (step S8), and only the bitmap whose color has been changed is extracted (step S9). The extracted bitmap data is converted into the coordinates of the screen by the mapping data synthesizing means 8 and overwritten on the screen of the video information (step S10), so that the operator can easily recognize the searched monitoring target. At the same time, information such as the name and attribute of the monitored object searched for is stored in the facility information extracting means 9.
(Step S11). here
Now, the bitmap creating means and configuration will be described. Search result
3D shape data of monitoring target information including fruit surface data
For all included surface data, refer to "How to create mapping data
Local coordinate values on the reference plane in the same way as
(X, Y) is obtained, and the coordinate value (X, Y) is displayed on the screen.
Within the displayable coordinate range determined by the hardware specifications (after
(-Xmax to Xmax, -Ymax to Ymax))
Only when it is included in the coordinate value (X, Y).
The specific color information is written at the pixel position on the screen. Pixel position
Means (X, Y) on the reference plane and the coordinate system of the display screen,
The center of the plane is defined as (0,0) on the reference plane, and the
The Y coordinate of the upper end position is Ymax, the coordinate of the lower end is -Yma
x, where the right end corresponds to Xmax and the left end corresponds to -Xmax
Vertical and horizontal pixels determined by the hardware specifications of the screen
This corresponds to the position of each grid point equally divided by a number. bitmap
Create the memory corresponding to each pixel position, and
The state is all black (all three primary color components are 0).
After processing all surface data, a specific color
Search by extracting all pixel positions written in the report
Bitmaps can be created from the resulting surface data
You. Note that this bitmap creation method uses a three-dimensional compilation.
Raster graphics as part of the computer graphics
Same as the method for setting the color information of each pixel
It is a technology of knowledge. Create mapping data with color change
The method and the meaning of the color-changed bitmap will be described. Electric
The child computer calculates the coordinates (X ', Y') on the mapping data
Recognize the monitoring target (three-dimensional shape model) and
By changing the color attribute of the original shape model surface,
Perform color change. After that, follow the `` How to create mapping data ''
Create new mapping data. The meaning of color change is monitor
Mouse over the monitoring target of the video camera image displayed on the screen.
When the monitoring target is selected,
I can't decide. Therefore, the selected monitoring
You can recognize the selection by changing the color of the object
You. To achieve this, video camera video and color change
Of the monitored object (three-dimensional shape model)
This is possible by combining the tops. In addition, the extracted video
Map to the screen coordinates in the mapping data synthesis means
Explaining how to convert, the camera displayed on the screen
The color information of each pixel position of the video shot with
Configuration as a bitmap according to the configuration of
(X, Y) coordinates of the pixel position where the color information of
Overwrite the image for the corresponding surface data on the image data
Color information from the database and convert it to (X, Y) coordinates
By rewriting the memory data at the corresponding pixel position,
Because of the writing and display, the coordinate transformation is already
Method in the same way as the coordinate transformation method described in
I can. Further, the configuration of the equipment information extracting means and
The search method will be described. The electronic computer is operated by the operator on the screen.
Receives the specified (X, Y) coordinate value, and
Create mapping data from the location information of the
From the result of the above, the surface data associated with the (X, Y) coordinate value
Monitor information (three-dimensional shape data) including data
Select from the viewing target information, and
The equipment information such as the names and attributes are displayed on a monitor screen.

FIG. 3 shows an embodiment in which the video information retrieval system is applied to a video monitoring device of a plant monitoring robot. The monitoring robot 16 and a video camera mounted on the monitoring robot 16 are shown. 17, a camera information obtaining device 18, a monitoring television monitor 19 in a monitoring room, a computer 20 for processing data, and a video information transmission cable 21.

In this apparatus, a video image captured by a video camera 17 mounted on a surveillance robot 16 and a camera obtained from a camera information acquisition device 18 in accordance with the motion of the surveillance robot 16 and the video camera 17 The position data is input to the computer 20 through the video information transmission cable 21. The memory of the electronic computer 20 has equipment three-dimensional position data and equipment attribute information such as equipment names as data.

Therefore, in the monitoring room, the monitoring television monitor 1
When there is a facility that the watchman who has watched 9 wants to know, the watchman points the equipment shown on the monitor TV monitor 19 with a mouse or the like, and the two-dimensional position information of the screen indicated on the monitor TV monitor 19 is displayed. Input to the electronic computer 20,
Searches can be performed by this method to obtain necessary information.

[0018]

As described above, according to the present invention, the coordinate conversion means for converting the position coordinates of the monitoring target on the display screen of the video image display means into the coordinates on the mapping data, and A mapping data creation unit that creates the mapping data based on the monitoring target shape data and the camera position data obtained by searching the database according to the monitoring target position data, and a mapping data from the mapping data creation unit. A bitmap creating means for creating a bitmap in which the monitoring target is color-changed, wherein the mapping data synthesizing means converts the bitmap information created by the bitmap creating means into coordinates of the display screen and displays the coordinates on the display screen. So that it is possible to easily search for the equipment name shown on the video camera, so that surveillance personnel during video surveillance etc. In addition to supporting equipment recognition, it is also possible to simultaneously provide information on equipment searched using design information and the like, and to obtain practical effects such as eliminating the need to search for information from printed materials and the like. .

[Brief description of the drawings]

FIG. 1 is a block diagram showing a video information search system according to an embodiment of the present invention.

FIG. 2 is a flowchart showing a flow of an operation of the video information search system in FIG.

FIG. 3 is a conceptual diagram showing a plant monitoring system using the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Video camera 2 Database 3 Monitoring target (facility) 4 Video image display means 5 Coordinate conversion means 6 Mapping data creation means 7 Bitmap creation means 8 Mapping data synthesis means

Claims (1)

(57) [Claims] 1. A video camera for outputting photographed video information and camera position information, a database storing monitoring target information including a position and a shape of a monitoring target by the video camera, and displaying the video information Video image display means for enabling a monitoring target in the video information to be set on a display screen, coordinate conversion means for converting position coordinates of the monitoring target on the display screen into coordinates on mapping data, Mapping data creation means for creating the mapping data based on the monitoring target shape data and the camera position data obtained by searching the database according to the coordinate-converted monitoring target position data; and a mapping from the mapping data creation means. Bitmap creating means for creating a bitmap in which a monitoring target is color-changed from data, and the bitmap creating means And a mapping data synthesizing means for converting the bitmap information created in step (1) into coordinates on a display screen and overwriting and displaying the coordinates on the display screen.