JPH04157882A - Camera operation interlocking type character/graphic information composite display system - Google Patents

Abstract

PURPOSE:To constitute the system so that a user can recognize easily a photographing object by setting one or more small photographing ranges thin the whole photographing range in which photographing can be executed, superposing character/graphic information corresponding to this small photographing range set in advance onto video information from camera and executing its composite display. CONSTITUTION:One or more small photographing ranges and character/graphic information corresponding to this small photographing range are stored in advance in an accumulating device 7. When a camera control value P1 is received from a movable universal head with a zoom lens control function, a controller 4 sets this P1 as a retrieval condition, and retrieves small photographing range values Aa-An accumulated in advance in the accumulating device 7. In such a state, in the case P1 is contained in one of the small photographing range values Aa-An, the character/graphic information corresponding to the small photographing range value is transferred to an image processor 5 from the accumulating device 7. The image processor 3 superposes this character/graphic information onto an image from a camera 1 with a zoom lens and displays it on an image display device 6.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention provides a camera operation-linked text/graphic information system that provides image providing services such as remote monitoring and video conference communication using a movable pan head that can be remotely controlled. This relates to a composite display method.

[Prior Art] In conventional camera shooting systems installed on movable pan heads that can be remotely controlled and used in conventional surveillance systems and video conference systems, the objects that the camera can be operated on are limited. Since the operator who is familiar with the operation performs the operation, there is no need to supplement what appears in the camera image displayed on the surveillance monitor or the like by operating the camera.

[Problem to be solved by the invention] However, in recent years, the method of using images from a camera installed on a movable platform that can be remotely controlled has been used in many fields, such as traffic information, event information, nature observation, and sports broadcasting. There is an increasing demand for the use of the Internet, and there is also an increasing desire to use it via public communication networks. In this type of usage, it is likely that the number of amateur users (operators) who operate the camera for the first time and view images from the camera will increase. It has become anticipated that there will be a need for guidance displays to supplement and notify users of what is being displayed and how it is being displayed.

[Means for Solving the Problems] In order to solve these problems, the camera operation-linked character/graphic information synthesis display method according to the present invention is one of the methods that can be used in the entire range of images that can be taken by a camera with a zoom lens. A setting means for setting the above-mentioned small shooting range, a zoom lens control value of a camera with a zoom lens obtained by driving a movable pan head with a zoom lens control function, and a movable pan head control value of a movable pan head with a zoom lens control function. A search means for searching the small shooting range value being set from The apparatus includes display control means for displaying graphic information superimposed on video information from a camera with a zoom lens.

[Function] One or more small shooting ranges are set within the entire shooting range that can be taken by a camera with a zoom lens, and when operating the camera, character/graphic information corresponding to the preset small shooting range is displayed. is synthesized and displayed on the same image display device as guidance.

[Example] Next, the present invention will be explained with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of the camera operation-linked character/graphic information composite display system of the present invention. In the figure, 1 is a camera with a zoom lens for manual imaging;
2 is a movable pan head with a zoom lens control function, 3 is an image processing device, 4 is a control device, 5 is a camera operating device, 6 is an image display device such as a surveillance monitor, and 7 is a storage device. The control device 4 is composed of a microprocessor and a memory in which a program is stored, and the movable pan head 2 with a zoom lens control function pans and tilts the camera 1 with a zoom lens according to control information transmitted from the control device 4. , to change the zoom out/in of the zoom lens. In addition, the movable pan head with zoom lens control function 2 changes the operating position of the camera 1 with a zoom lens according to control information from the control device 4, and as a result, the zoom-out/in ratio of the zoom lens and the zoom lens after the operating position is changed. It has a function of transmitting the panning and tilting inclinations of the attached camera 1 to the control bag w4 as zoom lens control values and movable pan head control values (hereinafter collectively referred to as camera control values). Further, the image processing device 3 synthesizes video information from the camera 1 with a zoom lens and character/graphic information read out from the storage device 7 according to control information from the control device 4 and displays the synthesized image on the image display device 6. It is.

The detailed operation of the present invention will be explained below. First, it is assumed that one or more small photographing ranges and character/graphic information corresponding to the small photographing ranges have already been stored in the storage device 7. In other words, the control range value of the movable pan head with zoom lens control function, which indicates the pan/tilt inclination of camera 1, and the control range value of the zoom lens, which indicates the zoom-out/in ratio of the zoom lens, are collectively referred to as "small shooting". (referred to as a range value), and one or more character/graphic information corresponding to this small shooting range value are defined.

FIG. 2 is an explanatory diagram showing an example in which the above-mentioned small shooting range value and text/graphic information are stored in the storage bag W7.

When the user (camera operator) arbitrarily changes the camera shooting direction or lens zoom ratio while viewing the camera image displayed on the image display device 6 using the camera operation device 5, the control device 4 identifies whether the received operation request is for camera pan/tilt or lens zoom-out/in, and converts it into control information based on this operation request. The control device 4 transmits the converted control information to the movable pan head with zoom lens control function 2. After changing the camera shooting direction or lens zoom requested by the user based on the received control information, the movable pan head with zoom lens control function 2 changes the pan/tilt direction of the camera 1 with a zoom lens and the zoom of the zoom lens after the change. and the camera control value (Pl
) to the control device 4. The control device 4 receives camera control values (Pl) from the movable pan head 2 with a zoom lens control function.
After receiving the camera control value (Pl), the small shooting range value (Pl) stored in advance in the storage device 7 is searched.
Aa to An), and if the camera control value (pl) is included in any of the small shooting range values (Aa to An), the character/graphic information corresponding to the small shooting range value is stored in the image from the storage device 7. Transfer to processing device 3. The image processing device f3 superimposes this character/graphic information on the video from the zoom lens equipped camera 1 and displays it on the image display device 6.

After displaying text/graphic information corresponding to the small shooting range including the camera control value (pl) on the image display device 6, when continuing camera operation, the control device 4 controls the camera each time the camera is operated. In order to receive the control value and search the small shooting range values stored in the storage device 7 using the camera control value as a search condition, text/graphic information can be superimposed on or deleted from the camera image as many times as desired. can be displayed on the image display device 6. Furthermore, it is also possible to easily display one or more pieces of character/graphic information depending on the method of setting search conditions.

Furthermore, it is easily possible to set a small shooting range within the shooting range of the camera in which shooting is not allowed, and to not display images in such small shooting range values. The explanatory diagrams in FIGS. 3(a) to 3(c) are examples of monitor displays when camera operations are performed in this embodiment.

Next, FIG. 4 is a block diagram showing another embodiment of the camera operation-linked character/graphic information composite display system of the present invention. In this figure, the same parts as those in the block configuration diagram of FIG. 1 are given the same reference numerals, and the explanation thereof will be omitted. In FIG. 4, 8 is a camera installation side control device, 9 is an image encoding device, 10 is a camera installation side network control device, 11 is a camera installation side digital line termination device, 12 is a remote operation side control device,
13 is an image decoding device, 14 is a remote control side network control device,
15 is a remote control side digital line termination device, 16 is l5
DN public communication network, 1.7 and 1.8 are l5DN subscriber lines. That is, in this embodiment, a camera-linked character/graphic information composite display method is applied to the 15DN public communication network 16.

Camera installation side control device 8 and remote operation side control device 12
consists of a microprocessor and a memory that stores programs. Further, the movable pan head with zoom lens control function 2 changes the pan/tilt of the camera 1 with a zoom lens and the zoom out/in of the zoom lens based on control information transmitted from the camera installation side control device 8. In addition, as a result of changing the operating position of the zoom camera 1 based on the control information from the camera installation side control device 8, the movable pan head with zoom lens control function 2 changes the camera control value after changing the operating position to camera installation = 9 - It has a function of transmitting to the side control device 8. Image processing bag W3
The image information from the zoom lens equipped camera 1 and the character/graphic information read from the storage device 7 based on the control information from the remote control device 12 are combined and displayed on the image display device 6.

The detailed operation of this embodiment will be described below, but as described above, as a prerequisite, one or more small photographing ranges and text/graphic information corresponding to this small photographing range are stored in advance in the storage bag W7. Assume that it is stored in .

When a user views the camera image of the zoom lens equipped camera 1 from the remote control side, the remote control side control device 12 sends an outgoing connection request to the remote control side network control device 14 in order to establish a line connection with the camera installation W side. Transfer and initiate an outgoing connection. IS
After receiving the outgoing connection request from the remote control side to the camera installation side by the remote control side network control device 14, the DN public communication network 16 transmits an incoming connection request to the camera installation side network control device 10. t The camera installation side network control device 10, which has received the incoming call connection request from the SDN public communication network 16, notifies the camera installation side control device w8 of the detection of the incoming call, and establishes a communication path.

After the communication path is established, on the communication path, the camera image is transferred from the camera 1 with a zoom lens on the camera installation side to the image display bag W6 on the remote control side as image information. The operation request transferred to the installation side and the camera control value transferred from the camera installation side to the remote control side after camera operation are multiplexed and transmitted as character information by the image encoding device 9 and the image decoding device 13. Ru.

Camera images from the zoom lens equipped camera 1 are always encoded when transferred to the image encoding device W9, and transferred as image information to the camera installation side network control bag W10. This image information is transmitted from the network control device 10 on the camera installation side to the 15DN.
Public communication network 16. After being transferred to the image decoding device 13 via the remote operation side network control device 14, the image decoding device 13
decodes this image information and transfers it to the image processing device 3. The decoded image information is transferred to the image processing device 3 and then displayed on the image display device 6.

When the user arbitrarily changes the camera shooting direction or lens zoom ratio using the camera operation device 5 while viewing the camera image from the camera installation side displayed on the image display bag W6, the remote control side control The device 12 receives an operation request from the camera operating device 5. The remote control side control device 1.2 transfers the received operation request to the remote control side network control device 14 as character information. And this operation request is l5
DN public communication network16. It is transferred to the image encoding device 9 via the camera installation side network control device 10. Image encoding device 9
transmits the transferred operation request as character information to the camera installation side control device 8. The camera installation side control device 8 identifies whether the received operation request is for pan/tilt of the camera or zoom out/in of the lens, converts it into control information based on the operation request, and converts it into control information. is transmitted to the movable pan head 2 with zoom lens control function.

Then, after changing the camera shooting direction or lens zoom requested by the user based on the received control information, the movable pan head with zoom lens control function 2 changes the pan/tilt direction and zoom of the camera 1 with a zoom lens after the change. The zoom ratio of the lens is transmitted to the camera installation side control device 8 as a camera control value (Pl).

After receiving the camera control value (Pl) from the movable pan head with zoom lens control function 2, the camera installation side control device 8 transfers the camera control value (Pl) to the image encoding device 9. transfers the transferred camera control value (Pl) to the camera installation side network control device 10 as character information. Then, the transferred camera control value (Pl) is
DN public communication network16. The image is transferred to the image decoding device] 3 via the remote control side network control device 14, and is transferred to the image decoding device 13.
transmits the transferred camera control value (Pl) to the remote control side control device F12 as character information.

This remote control side control device 12 uses the received camera control value (Pl) as a search condition to search for small shooting range values (Aa to An) stored in advance in the storage device 7, and searches for this camera control value ( Pl) is this small shooting range value (Aa~An
), the character/graphic information corresponding to the corresponding small shooting range value stored in the storage bag W7 is transferred to the image processing device 3. The image processing device 3 superimposes character and graphic information on the image from the zoom lens equipped camera 1 and displays the superimposed image on the image display device 6.

In this way, the present invention can obtain similar effects even when the public communication network 16 is used. In this embodiment, the storage bag W7 is arranged on the remote control side, but the same effect can be obtained even if it is arranged on the camera installation side.

As described above, according to the present invention, by displaying text and graphic information related to camera images as guidance in conjunction with camera operations, the operator can move within the shooting range of the camera when operating the camera. It is possible to make it easier to understand the photographed object that can be seen, and also to protect the privacy of non-photographers.

[Effects of the Invention] As explained above, the camera operation-linked character/graphic information synthesis display method according to the present invention sets one or more small shooting ranges within the entire shooting range that can be taken by a camera with a zoom lens. When operating this camera, text and graphic information corresponding to this small shooting range that has been set in advance is superimposed on the image information from the camera and displayed in a composite manner, so that the currently displayed camera image Guidance in the form of text and graphics information is displayed to show what appears in the image, and as a result, the user can easily recognize the object to be photographed.

[Brief explanation of the drawing]

FIG. 1 is a block configuration diagram showing an embodiment of a system to which the character/graphic information synthesis display method linked to katara motion according to the present invention is applied, and FIG. FIG. 3 is an explanatory diagram illustrating an example of storing character information, etc., FIG. 3 is an explanatory diagram illustrating a display example of this system, and FIG. 4 is a block configuration diagram illustrating another embodiment of the present invention. ■...Camera with zoom lens, 2...Movable pan head with zoom lens control function, 3...Image processing device, 4
...Control device, 5...Camera operation device, 6...
- Image decoding device, 7... Storage device, 8... Camera installation side control device, 9... Image encoding device, 10
...Camera installation side network control device, 11...Camera installation side digital line termination device, 12...Remote fabrication side control device, 13...Image decoding device, 14...
・Remote operation side network control device, 15...Remote operation side digital line termination device, 16...ISDN public communication network, 17.18...15DN subscriber line. Patent applicant Nippon Telegraph and Telephone Corporation

Claims (1)

[Claims] By driving the movable pan head with a zoom lens control function from an operation panel at hand, the zoom ratio and direction of the camera with a zoom lens installed on the movable pan head with a zoom lens control function can be changed. In the camera operation-linked character/graphic information composite display method for displaying images, a setting means for setting one or more small photographing ranges within the entire photographable range of the camera with a zoom lens, and the zoom lens control Search for the small shooting range value being set from the zoom lens control value of the camera with the zoom lens obtained by driving the movable pan head with the function and the movable pan head control value of the movable pan head with the zoom lens control function. means, and when the zoom lens control value and the movable pan head control value are included in the small shooting range value, text/graphic information corresponding to the small shooting range stored in advance is sent to the image from the zoom lens equipped camera. 1. A camera operation-linked character/graphic information composite display system, characterized by comprising a display control means for displaying information superimposed on the information.