JPH04323990A - Designation method of portrait camera image pickup position in image pickup system - Google Patents

Abstract

PURPOSE:To realize the designation method able to move an image pickup position easily to an optional position with respect to the movement of the image pickup position of a portrait camera in the image pickup system. CONSTITUTION:The system is made up of a full scene camera 1, a portrait camera 2, a turning base 3 turning the portrait camera 2, a zoom lens 4, a camera control section 9 giving a prescribed control signal, and a hand-written character graph input display section 8 superimposing the hand-written character graph onto a picture. When a position desired to be displayed is inputted by using a manual input means 7 in a form of a graph to revise the image pickup position of the portrait camera 2, the hand-written character graph input display section 8 decodes the coordinate as the graph, the graph is superimposed on the video image of the full scene camera 1 and in the case of a camera of its own station, the image is monitored on a monitor 5 and in the case of a camera of an opposite station, the image is displayed on a monitor 6, a camera control section 9 moves the turning base 3 and the zoom lens 4 from its coordinate information to move the portrait camera 2 to the position desired to be displayed.

Description

[Detailed description of the invention]

0001

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic conference system, and more particularly to a method for specifying a moving destination of an imaging position of a camera of an imaging system used in an electronic conference system. In order to smoothly proceed with electronic conferences, there is a need for a method that makes it easier to move the imaging position of a camera in an imaging system.

0002

[Prior Art] Cameras normally used in conventional imaging systems used in general electronic conferences, etc. include a panoramic camera that images the entire conference room, etc., and a camera that captures images of a specific person or a group of people. There is also a portrait camera that is used when projecting images. Panoramic cameras display the entire conference room, etc., so they are normally used with the imaging position fixed in one direction. On the other hand, the imaging position of a portrait camera can be changed as needed during a meeting to show the speaker or samples of items used in the conference, and it is now common to operate the portrait camera using a remote control. There is. Additionally, the person camera can also be operated from the other party's station.

FIG. 6 shows an example of the configuration blocks of an imaging system currently used. In the figure, 1 is a panoramic camera that images the entire conference room, etc., 2 is a person camera that images a specific person or several people, 3 is a swivel base that supports the portrait camera 2 and rotates the portrait camera 2 according to a control signal; 4 is a zoom lens that is attached to the portrait camera 3 and is capable of photographing from close to distant; 5 is a monitor for transmitted video; and 6 is for received video. 7 is a manual input means for inputting handwritten characters, figures, etc.; 8 is a handwritten character/figure input/display unit for processing the handwritten characters, figures, etc. input by the manual input means 7; 9 is a swivel base for the person camera 2; 3 and a camera control unit 10 that provides a predetermined control signal to the zoom lens 4.
1 is a remote controller, 11 and 12 are monitor screen changeover switches, and 20 is an image CODEC.

[0004] In FIG. 6, a panoramic camera 1 is fixed in one direction and images an entire conference room or the like. The captured image is
In addition to being displayed on the transmission video monitor 5, the image CO
The data is encoded by the DEC 20 and transmitted to the other party. When an operator (not shown) operates the person camera 2, the switch 11 causes the image on the transmission monitor 5 to be transferred to the panoramic camera 1.
The user switches from to the portrait camera 2, and while viewing the image captured by the portrait camera 2, operates the remote controller 10 to move the imaging position in the desired direction. The image taken by the person camera 2 is compressed and encoded together with the image taken by the panoramic camera 1 by the image CODEC 20, and then transmitted to the partner station.

[0005] Also, when you want to move the imaging position of the person camera (not shown, but corresponds to 2) of the other station, switch 12
is switched, and the image captured by the person camera (not shown, but equivalent to 2) of the other station is displayed on the received video monitor 6. Then, under the control of the camera control unit 9, the control performed by the remote control unit 10 is switched from the camera control unit 9 of the own station to the camera control unit (corresponding to 9) of the other station, and the received video is displayed on the monitor 6. While looking at the image taken by the person camera of the other station, the user operates the remote controller 10 to move the imaging position of the person camera (corresponding to 2) of the other station in the desired direction.

[0006] Note that the general handwritten characters and figures inputted by the manual input means 7 are data-processed in the handwritten character/figure input/display unit, and are switched to an image of the entire conference room, etc., and displayed on the transmitting video monitor. 5 and simultaneously transmitted to the other station.

The upper diagram of FIG. 7 shows conventional general handwritten characters.
The figure input/display section (handwritten character/figure input/display section 8 in Figure 6), and the conventional general camera control section (Figure 6) are shown below.
The configuration of the camera control unit 9) is shown. In the above figure, 81 is MP
U, 82 is RAM, 83 is ROM, 85 is handwritten character.
A graphic I/F, 86 is an image I/F, and 87 is a video RAM.

Further, in the lower diagram of FIG. 7, 91 is an MPU, 92
is RAM, 93 is ROM, 94 is remote control input section, 96
, 97 is a general peripheral device I/F, and 98 is a swivel/zoom lens I/F.

In the figure below, input information for moving the imaging position of the person camera using a remote controller (not shown, but 10 in FIG. Lens I/
It is output as a control signal from the F98 and moves the swivel base 3 and zoom lens 4 in the designated direction.

[0010] Furthermore, when the imaging position of the person camera 2 is moved by operation from the other station, the own person camera control signal sent by the operation from the other station is transmitted to the general peripheral equipment I/O.
The signal is input to the F97, sent to the MPU 91, and under the control of the MPU 91 is output as a control signal from the swivel base/zoom lens I/F 98 to move the swivel base 3 and zoom lens 4 in the specified direction.

[0011] Also, a general camera operation function includes a preset function, which determines several positions that the person camera 2 wants to capture, stores those positions, and then presses the remote controller (see Fig. 6). By specifying the numbers of those positions in step 10), the camera control unit 9 can automatically direct the swivel base 3 of the person camera 2 to the specified positions.

The camera control unit 9 controls the person camera 2 at a specified position.
In order to direct the swivel base 3 of the person camera 2, the position information of the direction in which the person camera 2 is currently facing is obtained from the swivel base 3, and the calculation is made to add/subtract that information and the specified position information. By moving the zoom lens 4 to a designated position, the imaging position of the person camera 2 is controlled.

[0013]

In the above-described conventional method for controlling the imaging position of the person camera 2, the camera operator (not shown), while viewing the screen imaged by the person camera 2 on the transmission video monitor 5, When moving the person camera of the other station, while watching the screen of the receiving video monitor 6, determine in which direction the person camera 2 should move the image from one corner of the panoramic view to another corner. Sometimes it is difficult to know if there is a place for that purpose.

It is sufficient if the operator (not shown) knows the entire conference room, etc.; however, if the operator (not shown) knows the entire conference room, etc., if the operator (not shown) knows the entire conference room, etc. Since I don't know where it is, I have to look around for it. Sometimes I move the image in the completely opposite direction, or I change the image to a full-view screen, or I zoom out the portrait camera 2 to view the full screen, confirm the desired position, and then turn the portrait camera 2 back on. There is a problem in that it requires a lot of effort such as moving it.

Although the preset function allows the person camera 2 to be moved to several predetermined positions, a similar problem occurs if the desired position is not preset.

SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide a method for specifying an imaging position that allows the imaging position of the person camera 2 to be easily moved to a desired imaging position regardless of the current imaging position. be.

[0017]

[Means for solving the problem] This will be explained with reference to FIGS. 1 and 4. FIG. 1 is a diagram showing the principle of the present invention, and FIG. 4 shows an example in which a person camera 2 is moved with respect to an entire image captured by a panoramic camera 1 to designate a desired position using a graphic.

In FIG. 1, the same reference numerals as in FIG. 6 indicate the same parts, and numeral 13 inputs, by manual input means, graphical input information of the imaging position of the camera of the person to be moved, on the transmitting video monitor 5 if the camera is the own camera. In the case of a station camera, switches 14 and 15 for switching to the received video monitor 6 are adders for superimposing figures input by manual input means on the screen displayed on the monitor 5 or 6.

FIG. 1 shows a panoramic camera 1, a portrait camera 2,
A swivel base 3 that supports the person camera 2 and rotates the person camera 2, a camera control section 9 that provides a predetermined control signal to the swivel base 3, and a manual input means 7 for manually inputting handwritten characters and figures. and a handwritten character/figure input/display unit 8 for displaying handwritten characters and figures input by the manual input means 7 on an external monitor screen. etc., and uses the manual input means 7, the handwritten characters, and the graphic input/display unit 8 to display the moving destination of the imaging position of the person camera 2 on the transmitted video monitor 5. Instructions are given by superimposing hand-drawn figures on the image of the panoramic camera 1. The handwritten character/figure input/display unit 8 reads the position coordinates of the handwritten figure, and the camera control unit 9 calculates the handwritten figure position coordinate data as a preset value of the movement destination position of the person camera 2. Next, in the camera control unit (9), the value obtained by adding and subtracting this preset value and the current position data of the person camera 2 is used as a control signal for the person camera 2 to control and move the swivel base 3, and the image capturing of the person camera 2 is performed. Move the position to the desired position.

The system also includes an adder 15 that superimposes figures, etc. on the image displayed on the external monitor screen, and uses the manual input means 7, the handwritten characters, and the figure input/display section 8 to determine the person at the other station. The destination of the imaging position of the camera (corresponding to 2) is instructed by superimposing a hand-drawn figure on the image of the other station's panoramic camera (corresponding to 1) displayed on the received video monitor 6. The handwritten character/figure input/display unit 8 reads the position coordinates of the handwritten figure, and the handwritten character/figure input/display unit 8 transmits the position coordinates to the partner station. In the partner station, the camera control unit (corresponding to 9) of the partner station receives the position coordinates of the handwritten figure, and the camera control unit (corresponding to 9) of the partner station receives the position coordinate data of the handwritten figure by the person of the partner station. Calculate as a preset value of the movement destination position of the camera (corresponding to 2). Next, the partner station camera control unit (corresponding to 9) adds and subtracts this preset value and the current position data of the partner station person camera (corresponding to 2), and adds or subtracts the value to the control unit of the partner station person camera (corresponds to 2). The remote station swivel table (corresponding to 3) is controlled to move, and the imaging position of the remote station person camera (corresponding to 2) is moved to the target position.

[0021]

[Operation] As described above, in the present invention, the position to be photographed by the person camera 2 is input in the form of a figure (rectangle) using the manual input means 7. The handwritten character/figure input/display unit 8 reads the coordinates of the input figure and sends it to the camera control means 9. The camera control section 9 calculates the coordinate data of this figure as each preset value of the moving position of the person camera 2, sends it as a person camera imaging position control signal, and moves the swivel base 3. As a result, regardless of the current position captured by the person camera 2, the person camera 2 automatically images the position specified by the manual input means 7, and the captured image is captured by the panoramic camera 1. The image is compressed and encoded,
Transmitted to the other station.

Also, when it is desired to move the imaging position of the person camera (corresponding to 2) of the other station, the manual input means 7 is used to move the panoramic camera (1) of the other station displayed on the received video monitor 6. Enter the position you want to project in the image (equivalent to ) as a shape (rectangle). The handwritten character/figure input/display unit 8 reads the coordinates of the input figure, and transmits the coordinates to the partner station. In the other station, the other station camera control means (corresponding to 9) calculates the coordinates transmitted from the own station as each preset value of the movement position of the human camera (corresponding to 2), and sends it as a human camera imaging position control signal, Swivel base (equivalent to 3)
move. As a result, the person camera (2
(equivalent to 1) takes an image of the position specified by the own station manual input means 7, and the taken image is compressed and encoded with the image taken by the panoramic camera (equivalent to 1), and then transmitted to the own station. come.

[0023]

[Example] A specific example will be explained using FIGS. 2 to 5. FIG. 2 shows an implementation block diagram of the present invention, and in the figure, the same reference numerals as in FIG. 1 indicate the same parts. A tablet 7-1 is used as an example of the manual input means 7, and
The portrait camera 2 is equipped with a zoom lens 4.

FIG. 3 is a diagram showing an example of coordinates when an image capturing position 202 desired to be captured by a person camera is inputted graphically using the manual input means 7 on a screen 101 of the entire conference room etc. captured by the panoramic camera 1. It is. When a tablet 7-1 is used as the manual input means 7, a method of manually inputting an image capturing position desired to be captured by a person camera while treating the entire screen as a monitor screen displayed by a panoramic camera 1 will be described. The manual input method is the same for both the person camera 2 of the own station and the person camera 2 of the other station (corresponding to 2).

FIG. 4 shows an example in which the person camera 2 is moved with respect to the entire image taken by the panoramic camera 1 and the desired position to be imaged is specified graphically. FIG. 5 is a diagram showing a connection example for each configuration example of the handwritten character/figure input/display section 8 and the camera control section 9 in relation to the configuration diagram for realizing the present invention shown in FIG. The symbols are the same as those in FIG. 7, and the same symbols indicate the same objects.

Next, a method will be described in which the tablet 7-1 is used as an example of the manual input means 7 to move the imaging position of the person camera of the other station. First, the image taken by the person camera (corresponding to 2) of the other station is displayed on the screen of the received video monitor 6 using the switch 12 of the imaging system of the own station. Next, the switch 13 is changed so that the graphic input by the manual input means 7 can be superimposed on the received video monitor 6. Next, as shown in Figure 3 on tablet 7-1, use the tablet 7-1's light pen to use the other station's person camera (
(equivalent to 2), input the position to be imaged using a figure (rectangle) 202. Then, this figure 202 is input via the manual input I/F 85 of the handwritten character/figure input/display unit 8, and the MPU 81 calculates point a and point b of the figure 202 on the coordinates with the upper left of the tablet as the origin. The coordinates are read, and the image I/F 86 and adder 15 superimpose the coordinates on the image captured by the panoramic camera (corresponding to 1) of the other station on the screen of the received video monitor 6, as shown in the example of FIG. will be displayed. On the other hand, the coordinate information of the figure 202 includes handwritten characters, figure input,
It is transmitted from the general peripheral I/F 88 of the display section 8 to the other station.

In the other station, the coordinate information transmitted from the own station is input to the general peripheral I/F (corresponding to 97) of the camera control unit (corresponding to 9), and the MPU (corresponding to 91)
From the coordinates of point a and point b in the coordinate information of 2, line c is the preset value in the pan direction of the swivel base (corresponding to 3), line d is the preset value in the tilt direction of the swivel base (corresponding to 3), and , is calculated as the zoom preset value of the zoom lens (corresponding to 4) from the area of the rectangle 202. Next, MPU (9
For each of these preset values, the current position information of the person camera (corresponding to 2) is sent to the swivel base (corresponding to 3) and the zoom lens (corresponding to 4) from the swivel base/zoom lens I. /F (corresponds to 98), calculates the difference between each of these preset values and the current position information of the person camera (corresponds to 2), and sends the difference as a control signal.
The swivel table (corresponding to 3) and the zoom lens (corresponding to 4) are controlled to move the imaging position of the person camera (corresponding to 2) to a predetermined position. Note that the image captured by the person camera (corresponding to 2) is compressed and encoded together with the image captured by the panoramic camera (corresponding to 1), and then transmitted to the local station.

Next, a method will be described in which the tablet 7-1 is used as the manual input means 7 to move the imaging position of the person camera of the own station. First, an image captured by the panoramic camera 1 of the own station is displayed on the screen of the transmission video monitor 5 using the switch 11 of the imaging system of the own station. Next, the switch 13 is changed so that the graphic input by the manual input means 7 can be superimposed on the transmission video monitor 5.

Next, as shown in FIG. 3, use the tablet 7-1 as a monitor screen.
Using the light pen, the user inputs the position to be imaged by the person camera 2 of his/her station using a figure (rectangle) 202. Then, this figure 202 is input via the manual input I/F 85 of the handwritten character/figure input/display section 8 . Next, the MPU 81 reads the coordinates of point a and point b of the figure 202 on the coordinates with the upper left of the tablet as the origin, and the image I/F 86 and adder 14 transmit the image to be transmitted as shown in the example of FIG. The image is displayed on the screen of the computer monitor 5, superimposed on the image taken by the panoramic camera 1 of the local station. On the other hand, the coordinate information of this figure 202 is the general peripheral I/O of the handwritten character/figure input/display section 8.
The data is sent from the F84 to the general peripheral I/F 95 of the camera control unit 9.

The coordinate information sent to the general peripheral I/F 85 of the camera control section 9 is sent to the MPU 91 as a graphic 20.
From the coordinates of point a and point b in the coordinate information in step 2, line c is the preset value in the pan direction of the swivel base 3), line d is the preset value in the tilt direction of the swivel base 3), and from the area of the rectangle 202, , is calculated as the zoom preset value of the zoom lens 4. Next, the MPU 91 transmits the current position information of the person camera 2 to the swivel base 3, for each of these preset values.
And zoom lens 4 to swivel base/zoom lens I/F9
8, these preset values and portrait camera 2
and the current position information, and the difference is sent as a control signal to control the swivel base 3 and zoom lens 4 to move the imaging position of the person camera 2 to a predetermined position. Note that the image captured by the person camera 2 is multiplexed with the image captured by the panoramic camera 1, and then transmitted to the partner station. The image taken by the person camera 2 is the image captured by the panoramic camera 1.
It is compressed and encoded together with the captured image, and then transmitted to the other station.

Note that the manual input means 7 may use a mouse instead of the tablet 7-1. Furthermore, in order to realize the present invention, it is necessary to distinguish between using the manual input means 7 for its original purpose and when using it for specifying the imaging position. It is only necessary to provide a switching function.

Furthermore, while the image screen of the person camera 2 is moving, the image of the panoramic camera 1 may be temporarily displayed to prevent a large shift in the image pickup screen. After moving, if you want to further zoom in, you may use the remote controller 10.

[0033]

[Effects of the Invention] As explained above, according to the present invention,
By inputting the position you want to image using a manual input method, you can easily move the image to the desired position regardless of the current position of the person camera, making electronic conferences, etc. smoother. You can proceed to

[Brief explanation of the drawing]

FIG. 1 is a diagram showing the principle of the present invention.

FIG. 2 is a diagram showing an implementation configuration of the present invention.

FIG. 3 is a diagram showing a coordinate display of an imaging position.

FIG. 4 is a diagram showing an example of movement of an imaging position.

FIG. 5 is a configuration diagram of a handwritten character/figure input/display unit and a configuration diagram of a camera control unit in the present invention.

FIG. 6 is a diagram showing an example of a conventional general imaging system configuration block.

FIG. 7 is a diagram showing a configuration example of a conventional general handwritten character/figure input/display means and a configuration example of a general camera control means.

[Explanation of symbols]

1 Panoramic camera 2 Portrait camera 3 Swivel base 4 Zoom lens 5 Monitor for transmitted video 6 Monitor for received video 7 Manual input means 7-1 Tablet 8 Handwritten character/figure input/display section 9 Camera control section 10 Remote control operation device 11, 12 Monitor screen changeover switch 13
Manual input means input information changeover switch 14, 15
Adder 20 Image CODEC 81, 91 MPU 82, 92 RAM 83, 93 ROM 84, 88, 95, 96, 97 General peripheral I/F
85 Manual input means I/F 86 Image I/F 87 Video I/F 94 Remote controller

Claims (2)

[Claims] Claim 1: A panoramic camera (1), a person camera (2), and a person camera (2) that supports the person camera (2).
a swivel base (3) for rotating the swivel base (3); a camera control unit (9) for giving a predetermined control signal to the swivel base (3); a manual input means (7) for manually inputting handwritten characters and figures; A handwritten character/figure input/display unit (that displays handwritten characters and figures entered by the manual input means (7) on an external monitor screen)
8) An imaging system comprising: an adder (14) for superimposing a figure, etc. on an image displayed on an external monitor screen, the manual input means (7), the handwritten character, figure input/display unit (8) is used to instruct the movement destination of the imaging position of the person camera (2) by superimposing it on the image of the panoramic camera (1) displayed on the transmission video monitor (5) using a hand-drawn figure. By doing so, the handwritten character/figure input/display section (8) reads the position coordinates of the handwritten figure, and the camera control section (9) reads the handwritten figure position coordinate data into the person camera (2).
) is calculated as a preset value of the movement destination position, and the value obtained by adding or subtracting this preset value and the current position data of the person camera (2) is used as a control signal for the person camera (2) to control and move the swivel base (3). Let the person camera (2)
A method for specifying an imaging position, the method comprising: moving the imaging position of the image to a target position. 2. An adder (15) according to claim 1, which superimposes a figure, etc. on an image displayed on an external monitor screen.
), and uses the manual input means (7), the handwritten character and graphic input/display unit (8) to
(equivalent to)) move the imaging position to the receiving video monitor (6).
By superimposing a handwritten figure on the image of the other station's panoramic camera (corresponding to 1) displayed on the screen, the position coordinates of the handwritten figure can be determined in the handwritten character/figure input/display section (8). The handwritten character/figure input/display unit (8) transmits the position coordinates of the handwritten figure to the other station, and the camera control unit (corresponding to 9) of the other station receives the position coordinates of the handwritten figure. Opposite station camera control unit (9
(equivalent to 2), the handwritten figure position coordinate data is calculated as a preset value of the movement destination position of the person camera of the other station (equivalent to 2), and this preset value and the current position data of the person camera of the other person station (equivalent to 2) are calculated. The value obtained by adding and subtracting is used as a control signal for the partner station's human camera (corresponding to 2) to control and move the partner station's swivel table (corresponding to 3), and the imaging position of the partner station's human camera (corresponding to 2) is set to the target position. A method for specifying an imaging position, characterized by moving the imaging position.