JP4162644B2 - Camera system - Google Patents

Description

Industrial application fields

  The present invention relates to a camera system that can change a shooting range of a camera, and more particularly to a camera system that gives an instruction to change a shooting range by operating a display on a display.

  As a camera system for shooting while changing the shooting range of the camera by remote control, a camera having a driving means and a zoom means for changing the shooting direction, a camera control device for controlling the driving means and the zoom means, and a camera shooting And a display for displaying the recorded video. In this camera control device, when the user changes the shooting range, the user presses a button for changing the shooting direction and angle of view of the camera (a quantity corresponding to the shooting magnification in a one-to-one relationship). The camera control device outputs a drive signal for driving the drive means and the like to the camera at a remote position while the button is pressed in order to change the shooting range of the camera.

  Such a camera system is used, for example, to monitor a high-temperature place or a place where the irradiation intensity of radiation is high, which is difficult or dangerous for an operator to approach. In this system, the camera remotely controlled by the camera control device cannot capture the entire imageable range at a time. Therefore, it is necessary to change the shooting magnification of the camera or change the shooting direction to change the shooting range of the camera.

  In a system in which the shooting direction of the camera is changed by button operation and the image is viewed while changing the shooting range of the camera, for example, when the button for operating the shooting direction is pressed once, the camera control device By changing the shooting direction by a certain angle, the user can view videos with different shooting ranges.

  In addition, in order to change the shooting magnification of the camera or change the shooting direction, conventionally, the user directly inputs parameters such as the shooting magnification and the angle indicating the shooting direction to the camera control device. Then, in accordance with the input parameter value, the camera control device sends a drive signal for changing the shooting range of the camera to the drive means of the camera, etc., and detects the angle and the shooting magnification provided in the drive means etc. The camera is set in a predetermined shooting direction and the like while detecting the camera angle and shooting magnification by the output of the potentiometer.

  Further, Japanese Patent Laid-Open No. 63-284990 discloses a technique for changing a shooting range when it is desired to enlarge and shoot a part of an image captured by a camera displayed on a screen. In this technique, both ends of a diagonal line of a portion (rectangular portion) to be enlarged in the screen are designated using a light pen, and the portion to be enlarged is input to a CPU in the camera system. The CPU performs a calculation for obtaining the shooting magnification and the shooting direction of the camera from the information of the portion to be enlarged input with the light pen. The calculation result is sent to a servo mechanism for changing the photographing magnification and the photographing direction, and the photographing magnification and the photographing direction of the camera are changed by the servo mechanism.

  When changing the shooting direction or the like of the camera by button operation, it is necessary to repeat the button operation and perform trial and error when changing the shooting direction or expanding a specific range in the screen.

  When entering the above parameters directly, for example, if the user wants to see the left side of the current shooting range and the user does not know the currently set parameter, enter the numerical value repeatedly, It is necessary to point the camera in the desired direction by trial and error. Therefore, complicated labor must be paid. In addition, when the camera is displaying the entire subject and you want to magnify only a specific part and magnify only that part to fit within the screen, both the magnification and direction are required. Need to be set, and more labor is required.

  As described above, the conventional technique using the camera control device has a problem that it is difficult to use unless the user is familiar with the setting operation of the camera control device.

  When changing the shooting range using a light pen, it is not necessary to perform trial and error as described above, but changing the shooting range is limited to expanding a part of the displayed screen. No mention is made of the reduction. In addition, it is not possible to instruct to shoot a portion that is not displayed.

  Furthermore, regarding any range of the camera system as a whole, and what range the camera is currently shooting in the entire system, any information can be displayed on any screen. Is not displayed, and unless the operation for confirming the shootable range is performed, the relative position between the shootable range and the currently captured range is unknown.

  A first object of the present invention is to provide a camera system that can easily change a shooting range so that a shooting range that is not actually shot can also be shot.

  A second object of the present invention is to provide a camera system that can indicate a relative position between a shootable range and a currently captured range.

  Therefore, in order to achieve the first object, in the present invention, an area indicating a camera provided with an imaging range changing means for changing the imaging range and an area for receiving an operation for changing the imaging range of the camera. Video generating means for generating video information corresponding to display; video information output by the camera; and video information generated by the video generating means into video information on a single screen; The display that receives the video information synthesized by the means and displays the display, and the area display includes a display corresponding to the type of change of the shooting range, and a change reception that receives an operation performed on the display. A change instruction determining means for determining change instruction information for changing the imaging range of the camera based on the received operation, and on the basis of the determined change instruction information. Generates a driving signal for driving the imaging range changing means, it was to have a camera operation means for outputting to the image capturing range changing means.

  In order to achieve the second object, the shooting range changing means changes the shooting range of the camera by changing the shooting direction of the camera, and the video generation means As a display corresponding to the type of change of the shooting range, a display including a display object for indicating the shooting direction of the camera, and a display indicating the shooting direction of the camera according to the position of the display object on the screen. The change receiving means generates and accepts an operation for moving the display position of the display object.

  Further, when the shooting range changing means includes a position changing means for changing the shooting position of the camera, the video generation means displays the shooting position of the camera as a display corresponding to the type of change of the shooting range. The display includes a display object for display, and a display indicating the position of the camera is generated according to the position of the display object on the screen, and the change receiving unit moves the display position of the display object. Is to accept.

  Since the present invention is configured as described above, images taken by the camera can be operated with the same feeling as graphics, and the user interface can be unified. Therefore, there are the following effects. That is, (1) it is easy to remember the operation and it is difficult to forget, (2) fewer erroneous operations, (3) the camera can be operated even by a first person, and (4) it is not necessary to be aware of the camera.

Action

  Since the present invention is configured as described above, the user operates the region display displayed on the screen by using the change instruction unit, so that the currently captured portion and An instruction to shoot a portion that has not been shot can be easily made without trial and error. Then, the change instruction determination unit determines the shooting range of the camera in accordance with the operation, and outputs the determined shooting range to the camera operation unit. In this way, the user can easily operate the camera without being aware of the shooting direction and the shooting magnification of the camera currently being operated.

  In addition, a display object indicating the position and direction in which the camera is actually shooting is displayed, and the position and direction in which the camera is shooting is displayed. Therefore, it is possible to recognize the shootable range and the position and direction of the current shooting without performing an operation for checking the shootable range.

  A first embodiment according to the present invention will be described with reference to the drawings. In this embodiment, the camera has a zoom function and a function of changing the shooting direction. Then, the change of the shooting magnification of the camera and the change of the shooting direction can be performed by using a GUI (Graphical User Interface), that is, by operating an icon or the like displayed on the display.

  FIG. 1 is a block diagram of a camera system according to the first embodiment. As shown in FIG. 1, the camera system includes a camera 101, a camera control device 102, a workstation 150, a display 108 that displays images taken by the camera 101 and displays for GUI, and a GUI for GUI. A mouse 109 for operating the display; The workstation 150 includes a calculation unit 1501, a video composition unit 1504, a graphic drawing unit 1503, a memory 1502, a disk 107, and an input / output control unit 1505.

  First, the configuration of the camera 101 will be described with reference to FIG. FIG. 2 shows a block diagram of the camera 101. The camera 101 includes a camera main body 1011 having zoom photographing means for changing the photographing magnification of the camera, and a drive unit 2208 for changing the photographing direction of the camera main body to a vertical direction and a horizontal direction. The camera body 1011 has a zoom lens 1012. The position of some of the lenses 1013 of the zoom lens 1012 is changed by the step motor 1017. As a result, the focal length of the zoom lens 1012 changes. A signal for driving the step motor 1017 is sent from the camera control apparatus 102 through the control signal line 2201.

  The position of the lens 1013 is detected by a potentiometer 1018 that is directly connected to the drive shaft of the motor 1017, and the detection result (voltage signal determined by the rotational position) is output to the camera control device 102 via the status signal line 2205. The voltage signal is converted into an angle of view by a CPU 1028 in FIG. 3 described later in the camera control apparatus 102 using a conversion table. The conversion table is stored in the memory 1029.

  The camera body 1011 has an autofocus function (not shown).

  The optical signal that enters from the zoom lens 1012 is converted into an electrical signal by the CCD 1014. From this electrical signal, the video signal generation unit 1015 generates a video signal. The generated video signal is output to the video generation unit 1504 via the camera video line 2204.

  The drive unit 2208 detects the rotation angle of the shaft 2209 and the drive unit 1019 including a motor and a gear for changing the direction of the camera body 1011 in the vertical direction by rotating the camera body 1011 around the axis 2209. Potentiometer 10111 is included. Furthermore, a rotating base 2210 that rotates (pans) the camera body 1011 in the horizontal plane by rotating in the horizontal plane, a driving unit 10112 that includes a motor and gears for rotating the rotating base 2210, and the rotary base 2210 A potentiometer 10113 for detecting the rotation angle is included.

  A control signal for driving the drive units 1019 and 10112 is sent from the camera control apparatus 102 through control signal lines 2203 and 2202. The drive units 1019 and 10112 rotate at a constant speed while receiving the control signal. The direction of rotation is determined by the polarity of the control signal. Detection results (voltage signals determined by the rotational position) detected by the potentiometers 10111 and 10113 are sent to the camera control apparatus 102 through status signal lines 2207 and 2206. The voltage signal is converted into a rotation angle by the CPU 1028 shown in FIG. 3 using a conversion table. The conversion table is stored in the memory 1029.

  Next, the camera control apparatus 102 will be described. The camera control apparatus 102 has an auto mode and a manual mode as operation modes, and has an auto / manual switch 1021 for switching between the auto mode and the manual mode.

  In the auto mode, a control signal for controlling the shooting direction and magnification of the camera 101 is output to the camera 101 via the control signal lines 2201, 2202, 2203 in accordance with the setting parameters input from the data line 1506. To do.

  When in the manual mode, the camera control device 102 follows the pan (right) button 1022, pan (left) button 1023, tilt (up) button 1024, tilt (down) button 1025, enlarge button 1026, and reduce button 1027. A control signal for controlling the shooting direction and shooting magnification of 101 is output to the camera 101 via the control signal lines 2201, 2202, 2203.

  The operation of the camera control apparatus 102 in the auto mode will be described. In the auto mode, the CPU 1028 receives setting parameters sent from the computing unit 1501 of the workstation 150 via the data line 1506. The setting parameters will be described below.

  The setting parameter includes a set of a command indicating the type of operation of the camera 101 and data (imaging parameter) indicating the target value of the operation. The types of commands are shown in FIG. In FIG. 4, commands “P”, “T”, and “Z” command the camera control device 102 to drive the camera 101, and the command “Q” instructs the camera control device 102 to It is requested to report the state of 101 to the calculation unit 1501. When the camera control apparatus 102 receives the command “Q”, the camera control apparatus 102 sends the horizontal angle, the vertical angle, and the shooting magnification of the camera 101 at that time to the calculation unit 1501 through the data line 1506.

  The data indicating the target of operation is the target horizontal or vertical angle when the shooting direction is changed (when the command is “P” or “T”), and when the shooting magnification is changed (when the command “Z” is changed). ) Is the target angle of view.

  Next, the angle of view of the camera 101 used to determine the shooting direction will be described with reference to FIG. The angle of view of the camera 101 is an angle of the shooting range of the camera 101, and there are a horizontal angle of view and a vertical angle of view. In this embodiment, when changing the photographing magnification, the angle of view is changed, and the target angle of view value calculated by the calculation unit 1501 is sent to the camera control apparatus 102. The vertical angle of view is shown in FIG. In the figure, θ is the angle of view, T is the size of the imaging surface, f is the focal length, L is the distance to the object to be imaged, and T ′ is the range moving to the imaging surface. Regarding the lens, a lens system composed of a plurality of lenses is replaced with an equivalent virtual single lens. At this time, the angle of view is given by the following equation.

なお、カメラ１０１の画角は、カメラ１０１の撮影倍率の程度を表しているともいえる。撮影倍率（ｂとする）は、図５より、ｂ＝Ｔ／Ｔ’＝ｆ／Ｌである。一方、数１より、θが小さいときは、θ≒Ｔ／ｆであるため、ｂ＝Ｔ／（Ｌθ）である。ＴおよびＬはほぼ一定であるため、ｂとθは反比例の関係にあり、画角と撮影倍率は１対１に対応しているからである。

It can be said that the angle of view of the camera 101 represents the degree of the shooting magnification of the camera 101. The photographing magnification (b) is b = T / T ′ = f / L from FIG. On the other hand, from θ, when θ is small, since θ≈T / f, b = T / (Lθ). This is because T and L are substantially constant, and b and θ are in an inversely proportional relationship, and the angle of view and the shooting magnification have a one-to-one correspondence.

  The definition of the horizontal or vertical angle in this embodiment will be described later.

  The CPU 1028 controls the camera 101 according to the setting parameters as follows. Which of the step motor 1017 and the drive units 1019 and 10112 is to be driven is determined according to the type of command received from the calculation unit 1501. Next, a detection result indicating the current state of the step motor 1017 and the drive units 1019 and 10112 to be driven is obtained by the status signal lines 2205, 2206 and 2207. The detection result is converted into an angle representing an angle of view and a shooting direction by a conversion table stored in the memory 1029 in advance. The target value given by the setting parameter is compared with the numerical value obtained by converting the detection result to determine the direction in which the drive target is driven. For example, when the shooting direction is changed, it is determined whether the angle is increased or decreased. When changing the angle of view, it is determined whether to increase or decrease the angle of view. When the driving direction is determined, the rotation directions of the step motor 1017 and the driving units 1019 and 10112 are determined.

  After the object to be driven and the rotation direction are determined, the input / output control unit 1020 is instructed to send a signal corresponding to the rotation direction to the control signal lines 2201, 2202, 2203 corresponding to the drive object.

  The input / output control unit 1020 sends a signal to the control signal lines 2201, 2202, 2203 in accordance with this instruction. The CPU 1028 monitors the state of the drive target through the status signal lines 2205, 2206, 2207. When the value obtained by converting the detection result falls within a predetermined vicinity of the value specified by the setting parameter, the signal input to the input / output control unit 1020 is stopped from flowing through the control signal lines 2201, 2202, 2203. To instruct.

  Next, the operation of the camera control apparatus 102 in the manual mode will be described. When in the manual mode, the camera control device 102 follows the pan (right) button 1022, pan (left) button 1023, tilt (up) button 1024, tilt (down) button 1025, enlarge button 1026, and reduce button 1027. 101 is controlled. The CPU 1028 that has determined that it is in the manual mode from the state of the auto / manual switch 1021 determines whether the input / output control unit 1020 is in a state where these buttons 1022, 1023, 1024, 1025, 1026, and 1027 are pressed. Depending on the pressed button, the control signal for turning the camera 101 to the right, the control signal for turning the camera 101 to the left, the control signal for turning the camera 101 upward, the control signal for turning the camera 101 downward, the shooting magnification of the camera 101 And a control signal for decreasing the photographing magnification of the camera 101 are output.

  Note that the CPU 1028 always detects the rotation angle and the like by the status signal lines 2205, 2206, and 2207. The detection result is compared with the rotation angle and field angle limit values stored in the memory 1029. When the detection result reaches the limit value, the control signal output to the input / output control unit 1020 is stopped. Instruct to do.

  Next, the mouse 109 for inputting an instruction to change the shooting direction of the camera 101 will be described. The mouse 109 has a function of outputting a signal indicating the amount of movement of the mouse 109 and a signal indicating that a button (not shown) provided on the mouse 109 has been turned on / off. In order to input an instruction to change the photographing range such as a change in direction, the user operates. In order to change the shooting range, the user performs the above-described instruction by operating a GUI display (described later) on the display 108 with the mouse 109 as described later. A signal indicating the amount of movement of the mouse and a signal indicating on / off of the button obtained as a result of the operation of the mouse 109 are input to the calculation unit 1501 via the input / output control unit 1505. The arithmetic unit 1505 obtains the position that the mouse is currently instructing by integrating the amount of movement of the mouse.

  The operation of the button of the mouse 109 includes click and drag. When the user presses down (turns on) a button provided on the mouse 109 and does not move the position of the mouse 109, the button is released (turned off) is called "clicking". For example, when the user moves the mouse 109, a pointer that moves on the screen according to the movement of the mouse is moved to the position of a tool (icon, etc.) displayed on the screen, and an operation of clicking at that position is performed. , "Click that tool". The tool and the pointer will be described later.

  Moving the position of the mouse 109 in a state where the user presses a button provided on the mouse 109 is called “dragging”. The operation of dragging the user after moving the mouse 109 to move the pointer to the position of the tool on the screen is called “drag the tool”.

  Next, the workstation 150 will be described. A calculation unit 1501 in the workstation 150 is configured by a CPU, and receives an instruction to change the shooting range of the camera 101 via the mouse 109. The calculation unit 1501 calculates shooting parameters such as a shooting magnification and a shooting direction after the change of the camera 101 based on a change instruction (signal from the mouse) and a program and data stored in the memory 1502. Details of the shooting parameters and how to obtain them will be described later.

  In order to remotely operate the camera 101, the arithmetic unit 1501 sends the imaging parameters via the data line 1506 to the camera control apparatus 102 via the input / output control unit 1505 in accordance with a protocol specification such as RS232C.

  In addition, the calculation unit 1501 sends a drawing command for drawing a display for accepting a change operation by the mouse 109 to the graphic drawing unit 1503. The display for accepting the change operation includes a horizontal scroll bar 510, a vertical scroll bar 520, a horizontal scroll icon 512, a vertical scroll icon 522, a left scroll arrow 514, a right scroll arrow 516, and an up scroll arrow as shown in FIG. This is an image other than a video shot by a camera such as 524, a downward scroll arrow 526, and a pointer 550.

  The memory 1502 includes a RAM and a ROM, and stores a program executed by the arithmetic unit 1501 and data used for execution.

  The disk 107 is composed of a magnetic disk, an optical disk, or the like, and stores the current value and limit value of the shooting parameters (angle indicating the shooting direction and shooting magnification) of the camera 101. The arithmetic unit 1501 writes the data of the disk 107 to the RAM in the memory 1502 as necessary. The arithmetic unit 1501 writes the data in the memory 1502 to the disk 107 as necessary.

  The graphic drawing unit 1503 is also called a graphic generator, a graphic accelerator, or a graphic processor, and is realized by a CPU, a RAM, a ROM, various CMOSs, and the like. The graphic drawing unit 1503 receives an instruction and data for drawing a display for accepting the change operation from the arithmetic unit 1501, generates an image signal representing the display for accepting the change operation, and generates the generated image signal. The image is output to the video composition unit 1504.

  The video composition unit 1504 includes a frame memory. The video composition unit 1504 synthesizes a high-resolution graphic such as a pointer or icon output from the graphic drawing unit 1503 and a low-resolution camera video output from the camera 101 into a high-resolution video using a frame memory. The synthesized video signal is sent to the display 108.

  The display 108 is realized by a CRT display device or a liquid crystal display, and receives and displays a video signal synthesized from the video synthesis unit 1504. The user can check the video after changing the shooting range obtained as a result of his / her instruction by looking at the display 108.

  Next, an example of a screen displayed on the display 108 in this embodiment is shown in FIG. The screen is for a GUI that displays a camera image display unit 201 that displays a camera image captured by the camera 101, and icons and the like that are provided on the right side and the lower side of the camera image display unit 201 and that are output by the graphic drawing unit 1503. Display units 202, 203, and 204 are included. The camera video display unit 201 displays a boiler. In the following, the camera system will be described with this boiler as a subject of photographing.

  On the screen, a pointer 550 indicating where the position designated by the mouse 109 is on the screen is displayed. When the user moves the mouse 109, the pointer 550 can be moved on the screen.

  The GUI display units 202, 203, and 204 include a horizontal scroll bar 510, a vertical scroll bar 520, a horizontal scroll icon 512, a vertical scroll icon 522, left and right as tools for changing the shooting range of the camera. Scroll arrows 514 and 516, up and down scroll arrows 524 and 526, an enlargement icon 570, and a reduction icon 580 are displayed.

  The horizontal scroll bar 510, the vertical scroll bar 520, the horizontal scroll icon 512, and the vertical scroll icon 522 are used for a page turning operation that is one of the operations for changing the shooting direction.

  The horizontal scroll icon 512 and the vertical scroll icon 522 are also used for a jump operation that is an operation for changing the shooting direction by an amount specified in a direction specified on the screen.

  The left and right scroll arrows 514 and 516 and the up and down scroll arrows 524 and 526 are used for a scroll operation for changing the shooting direction by a predetermined amount set in advance.

  The enlargement icon 570 and the reduction icon 580 are respectively used for a screen enlargement operation and a reduction operation that are operations for changing the shooting magnification.

  Details of the page turning operation, scroll operation, jump operation, enlargement operation, and reduction operation will be described later.

  The scroll bars 510 and 520 and the scroll icons 512 and 522 also have a function that indicates which part of the range that the camera 101 can shoot now. Scroll bars 510 and 520 indicate ranges that can be imaged in the horizontal and vertical directions, and scroll icons 512 and 522 indicate ranges that are currently being imaged among the imageable ranges. For this reason, the ratio of the horizontal length of the horizontal scroll icon 512 to the horizontal length of the horizontal scroll bar 510 corresponds to the horizontal direction that the camera 101 is currently shooting relative to the range in which the camera 101 can be shot in the horizontal direction. It matches the percentage of the range. The ratio of the vertical length of the vertical scroll icon 522 to the vertical length of the vertical scroll bar 520 is the ratio of the vertical range that the camera 101 is currently capturing to the range that the camera 101 can capture in the vertical direction. To match.

  Next, the change of the shooting range in this camera system will be described. First, the page turning operation will be described. The page turning operation means that an object that was shot at one end of the screen (for example, the left end) before performing this operation is shot at the other end (right end) of the screen after the page turning operation. As described above, this is a function for changing the shooting range of the camera 101.

  In page turning, the mouse 109 is used as follows. When the user turns the left (right) page, he uses the mouse 109 to click on the left (right) side of the horizontal scroll icon 512 in the horizontal scroll bar 510. As a result, the range captured by the camera 101 can be turned left (right) in the horizontal direction, and the horizontal scroll icon 512 moves to a position indicating a new shooting range.

  Similarly, when the user clicks on the vertical scroll bar 520, the range captured by the camera 101 can be turned in the vertical direction, and the vertical scroll icon 522 moves to a position corresponding to the result. Specifically, when the user clicks on the vertical scroll bar 520 above the vertical scroll icon 522, the camera video can be turned up. When the user clicks below the vertical scroll icon 522 of the vertical scroll bar 520, the camera video can be turned down.

  When the camera 101 is photographing one end within the range that can be photographed, the scroll icons 512 and 522 are displayed at the end corresponding to the one end of the scroll bars 510 and 520, and the scroll icons 512 and 522 As seen, only the other end side of the scroll bars 510, 520 can be clicked to turn the page.

  Next, taking a case where the camera 101 is zooming up the above-described boiler flame monitoring window as an example, a user's page turning operation and a change in the screen will be specifically described.

  First, a case where the camera image is turned to the left will be described with reference to FIG. FIG. 7A shows a screen displayed on the display 108 before the left page turning operation, and 3001 is a camera-captured image. FIG. 7B shows a screen after the left page turning operation, and 3002 is a camera-captured image. FIG. 7C is a diagram showing which part of the flame monitoring window of the boiler is captured by the camera captured images 3001 and 3002. In FIG. 7A, an image 3001 of the lower right portion of the boiler flame monitoring window is displayed on the display 108.

  At this time, if the camera 101 wants to photograph the left portion of FIG. 7A, the portion of the horizontal scroll bar 510 on the left side of the horizontal scroll icon 512 on the screen shown in FIG. Is clicked with the mouse 109, the video image 3001 of the camera 101 is turned to the left. As a result, as shown in the image 3002 of the display 108 in FIG. 7B, the left end of the image 3001 captured by the camera 101 moves to the right end of the image 3002, and the image is captured in FIG. 7A. The part on the left side of the video 3001 that has not been captured is captured. The position of the horizontal scroll icon 512 moves to the left from the position in FIG. In FIG. 7C, reference numeral 3003 denotes an overlapping photographing range of the camera 101 that is displayed before and after the page turning operation in the horizontal direction.

  Next, with reference to FIG. 8, a case where the camera image is turned up will be described. FIG. 8A shows a screen displayed on the display 108 before the page turning operation is performed upward, and reference numeral 4001 denotes a camera-captured image. FIG. 8B shows a screen after an upper page turning operation, and 4002 is a camera photographed image. FIG. 8C is a diagram showing which part of the flame monitoring window of the boiler is captured by the camera captured images 4001 and 4002. In FIG. 8A, an image of the lower left portion of the boiler flame monitoring window is displayed on the display 108.

  At this time, if the camera 101 wants to photograph the portion above FIG. 8A, the portion where the user is above the vertical scroll icon 522 of the vertical scroll bar 520 on the screen shown in FIG. Clicking with the mouse 109 turns the video of the camera 101 upward. As a result, as shown in the image 4002 on the display 108 in FIG. 8B, what was at the upper end of the image captured by the camera 101 so far is captured at the lower end of the image 4002. A portion on the upper side of the video 4001 that has not been shot in FIG. 8A is shot. The position of the vertical scroll icon 522 moves above the position in FIG. In FIG. 8C, reference numeral 4003 denotes an overlapping photographing range of the camera 101 that is displayed both before and after the page turning operation in the vertical direction.

  Next, with reference to FIG. 9, a description will be given of shooting parameters used for page turning, and a method for determining shooting parameters for page turning, among shooting parameters that define the shooting direction and angle of view of the camera. FIG. 9A shows the definition of the horizontal angle of the camera 101 and how to obtain the horizontal angle when turning the left page. FIG. 9B shows the definition of the angle in the vertical direction of the camera 101 and how to obtain the angle in the vertical direction when turning the upper page.

  The horizontal angles 51 and 52 of the camera 101 are set to 0 degrees in the horizontal direction in the reference state defined in this camera system (the state where the camera 101 faces the right end direction). It is the angle which the camera 101 rotated to left direction measured from. The left is the + direction and the right is the-direction. If the camera 101 rotates to the left, the horizontal angle increases. The angle 51 is a horizontal angle when the camera 101 is photographing the front, and the angle 52 is a horizontal angle when the left direction is photographed. The angles 51 and 52 are data values included in the setting parameters described above.

  For the vertical angles 53 and 54 of the camera 101, the vertical angle in the reference state (the state where the camera 101 faces the lower end direction) is set to 0 degree, and the camera 101 is measured from that direction. The angle rotated upward. The top is the + direction and the bottom is the-direction. If the camera 101 rotates upward, the vertical angle increases. The angle 53 is an angle in the vertical direction when the camera 101 is photographing the front, and the angle 54 is an angle in the vertical direction when an image above the angle is photographed. The angles 53 and 54 are data values included in the setting parameters.

  Next, a method for determining an angle in the horizontal / vertical direction that can be set for turning pages using such parameters will be described. For example, when turning the left page, the horizontal direction of the camera 101 can be realized by increasing the horizontal direction of the camera 101 according to the size of the horizontal angle of view. Note that there is an overlapping shooting range of the camera 101 that is displayed both before and after the page turning operation in the horizontal direction. The horizontal angle in this range is called “horizontal overlap shooting angle”. Even if the horizontal angle of view changes, the horizontal overlapping shooting angle changes according to the size of the horizontal angle of view so that the amount of overlapping portions on the display is the same. As shown in FIG. 9A, when the horizontal angle before turning the left page is pb degree 51, the horizontal field angle is zh degree 56, and the horizontal overlap shooting angle is dzh degree 55, the horizontal direction angle is If the degree is changed to (pb + zh-dzh) degree 52, the left page can be turned. The movement amount at this time is ΔH = zh−dzh.

  Similarly, the page turning operation in the vertical direction of the camera 101 can be realized, for example, when turning the upper page, by increasing the vertical direction of the camera 101 according to the vertical angle of view. Similar to the horizontal overlap shooting angle, the vertical angle of the shooting range of the camera 101 displayed before and after the vertical page turning operation is called “vertical overlap shooting angle”. Even if the vertical angle of view changes, the vertical overlap shooting angle changes according to the size of the vertical angle of view so that the amount of overlapping portions on the display is the same. As shown in FIG. 9B, when the vertical direction is tb degree 53, the vertical field angle is zv degree 57, and the vertical overlap shooting angle is dzv degree 58, the vertical direction is changed to (tb + zv-dzv) degree 54. , You can turn the upper page. The moving amount at this time is ΔV = zv−dzv.

  Next, data stored in the disk 107 and used by the calculation unit 1501 to determine an angle in the page turning operation will be described. As such data, the current value of the horizontal angle and the current value of the horizontal angle of view, the upper and lower limits of the horizontal angle, the horizontal overlap shooting angle, the data described later regarding the horizontal scroll bar and the horizontal scroll icon, There are data to be described later regarding the current value of the angle in the vertical direction and the current value of the vertical angle of view, the upper and lower values and the lower limit value in the horizontal direction, the vertical overlap shooting angle, the vertical scroll bar, and the vertical scroll icon.

  The current values of the horizontal angle and the horizontal angle of view are values such as a horizontal angle of 0 degrees and a horizontal angle of view of 10 degrees, for example. The current value of the horizontal angle and the current value of the horizontal angle of view are obtained from the camera control device 102 by sending the command “Q” in FIG. 4 to the camera control device 102. The upper limit value and the lower limit value of the angle in the horizontal direction are angles corresponding to both ends of the shootable range. These angles are stored in the disk 107 in advance by the user. When the camera 101 is photographing either the left or right end of the shootable range, the current value of the horizontal angle is equal to one limit value. The horizontal overlap shooting angle stores the current horizontal overlap shooting angle. For example, if the amount of the overlapping portion on the display is 1/10, the value is {10 degrees × (1/10) = 1 degree}. This value is freely set by the user and stored in the disk 107.

  Data relating to the horizontal scroll bar 510 includes data relating to the size (for example, 100) and data relating to the position on the screen. Data relating to the horizontal scroll icon 512 includes data relating to the size and the size of the scroll bar 510. There is data (for example, 50) indicating the position of the scroll icon 512 as a reference.

  The current values of the vertical angle and the vertical angle of view are values such as a vertical angle of 0 degrees and a vertical angle of view of 6 degrees, for example. The upper limit value and the lower limit value of the angle in the vertical direction are angles corresponding to both ends of the shootable range. When the camera 101 is photographing either the upper or lower end, the current value of the angle in the vertical direction is equal to one limit value. The vertical overlap shooting angle stores the current vertical overlap shooting angle. For example, if the amount of the overlapping portion on the display is 1/10, the value is {3.6 degrees × (1/10) = 0.6 degrees}. The angles related to the vertical direction are obtained or set in the same manner as the angles related to the horizontal direction and stored in the disk 107.

  The data related to the vertical scroll bar 520 is data indicating the size of the scroll bar 520 (for example, 60), and the data related to the vertical scroll icon 522 indicates the position of the scroll icon 522 based on the size of the scroll bar 520. Data (for example, 30).

  Next, the processing procedure when the camera system performs horizontal page turning using these data when the user's instruction is horizontal page turning will be described with reference to FIG.

When the calculation unit 1501 detects that the horizontal scroll bar 510 has been clicked by the mouse 109, the calculation unit 1501 changes the following processing depending on whether the clicked horizontal scroll bar 510 is the left side or the right side of the horizontal scroll icon 512. . In the case of the left side, the following steps 311 to 314 are performed, and in the case of the right side, the following steps 315 to 318 are performed. (Step 310)
The computing unit 1501 temporarily determines the value of the horizontal angle as (current value of horizontal angle + horizontal angle of view−horizontal overlap shooting angle) (step 311). In step 312, it is checked whether the temporarily determined value exceeds the upper limit value of the horizontal angle. This is because, for example, when the pages are continuously turned to the same side, the limit of the shootable range of the camera 101 may be reached without turning over one page. As a result of the examination, if it is within the shootable range, the temporarily determined value is set as the determined value. If the upper limit is exceeded, the upper limit is taken as the decision value.

  In step 315, the value of the angle in the horizontal direction is temporarily determined as (current value of the angle in the horizontal direction−horizontal angle of view + horizontal overlap shooting angle). In step 316, it is checked whether or not the temporarily determined value exceeds the lower limit value of the horizontal angle. If it is larger than the lower limit value, the provisionally determined value is used as the determined value. If it is smaller than the lower limit, the lower limit is taken as the decision value.

  Next, the calculation unit 1501 needs to change the position of the horizontal scroll icon 512 on the screen so that the new position of the horizontal scroll icon 512 in the horizontal scroll bar 510 corresponds to the new shooting position in the shootable range. There is. In step 320, the calculation unit 1501 determines the position of the new horizontal scroll icon 512 on the screen based on the determined value of the angle in the horizontal direction. The position is determined by the ratio between the determined value of the horizontal angle and the angle indicating the horizontal imageable range, and the length from the right end of the horizontal scroll bar 510 at the center position of the horizontal scroll icon 512 and the length of the horizontal scroll bar 510. Are determined so as to match. The determined position is output to the graphic drawing unit 1503.

  In step 330, the graphic drawing unit 1503 creates an image of the horizontal scroll bar 510 and the horizontal scroll icon 512 in which the position of the horizontal scroll icon 512 is changed to a new position, and outputs the image to the video composition unit 1504.

  In step 340, the calculation unit 1501 outputs a setting parameter to the camera control device 102 based on the determined horizontal angle.

  In step 350, the camera control apparatus 102 receives a setting parameter from the calculation unit 1501. The camera control device 102 points the camera 101 in the instructed horizontal direction as described above.

  In step 360, the camera 101 shoots at the designated horizontal angle and sends the camera video to the video composition unit 1504.

  In step 370, the video composition unit 1504 receives the video from the camera 101 and synthesizes it with the graphic image from the graphic drawing unit 1503 and sends it to the display 108.

  The display 108 receives the composite video from the video synthesis unit 1504 and displays it on the display screen.

  Next, the processing procedure when the camera system performs the vertical page turning when the user instruction is the vertical page turning will be described with reference to FIG.

When the arithmetic unit 1501 detects that the vertical scroll bar 520 is clicked by the mouse 109, the arithmetic unit 1501 performs the following processing depending on whether the clicked vertical scroll bar 520 is above or below the vertical scroll icon 522. Change. In the case of the upper side, the following steps 411 to 414 are performed, and in the case of the lower side, the following steps 415 to 418 are performed. (Step 410)
In step 411, the calculation unit 1501 temporarily determines the value of the vertical angle as (current value of vertical angle + vertical angle of view−vertical overlapping shooting angle). In step 412, it is checked whether or not the temporarily determined value exceeds the upper limit value of the angle in the vertical direction. If the upper limit is not exceeded, the provisionally determined value is used as the determined value. If the upper limit is exceeded, the upper limit is taken as the decision value.

  In step 415, the value of the angle in the vertical direction is temporarily determined as (current value of the angle in the vertical direction−vertical field angle + vertical overlapping photographing angle). In step 416, it is checked whether or not the temporarily determined value exceeds the lower limit value of the angle in the vertical direction. If it is larger than the lower limit value, the provisionally determined value is used as the determined value. If it is smaller than the lower limit, the lower limit is taken as the decision value.

  Next, the calculation unit 1501 needs to change the position of the vertical scroll icon 522 so that the new position of the vertical scroll icon 522 in the vertical scroll bar 520 corresponds to the new shooting direction. In step 420, the calculation unit 1501 determines the new position of the vertical scroll icon 522 in the same manner as in step 320, and outputs the new position of the vertical scroll icon 522 to the graphic drawing unit 1503.

  In step 430, the graphic drawing unit 1503 creates images of the vertical scroll bar 510 and the vertical scroll icon 522 in which the position of the vertical scroll icon 522 has been changed, and outputs the image to the video composition unit 1504.

  In step 440, the calculation unit 1501 outputs a setting parameter to the camera control apparatus 102 based on the determined vertical direction parameter.

  In step 450, the camera control apparatus 102 receives a setting parameter from the calculation unit 1501. The camera control device 102 points the camera 101 in the designated vertical direction.

  In step 460, the camera 101 shoots in the designated vertical direction, and sends the camera video to the video composition unit 1504.

  In step 470, the video synthesizing unit 1504 receives the video from the camera 101, synthesizes it with the graphic image from the graphic drawing unit 1503, and sends it to the display 108.

  The display 108 receives the composite video from the video synthesis unit 1504 and displays it on the display screen.

  Next, the scroll function, the jump function, and the enlargement / reduction function among the photographing range changing functions will be described.

  The scroll function is such that the camera 101 shoots while slightly shifting the current shooting range of the camera 101, that is, the object shot at one end of the shooting range is the other of the shooting range. This is a function for changing the photographing range of the camera 101 so that the photographing is performed with a slight shift in the direction of the end of the image.

  The jump function is a function for changing the shooting range of the camera 101 so that the camera 101 can shoot a portion that the camera 101 is not currently shooting without having an overlapping portion with the portion that is currently shooting. .

  The enlargement function is a function for reducing the shooting range of the camera 101 so that the camera 101 takes a range narrower than the range currently being shot. The reduction function is a function for expanding the shooting range of the camera 101 so that the camera 101 captures a wider range than the range currently being shot.

  As tools for using these functions, left and right scroll arrows 514 and 516, up and down scroll arrows 524 and 526, horizontal and vertical scroll icons 512 and 522, an enlarged icon 570 shown in FIG. The camera system has a reduction icon 580.

  Scroll arrows 514, 513, 524, and 526 are tools for a scroll function that changes the photographing range by a predetermined amount set in advance. When the user clicks the scroll arrows 514, 513, 524, and 526 using the mouse 109, the range that the camera 101 captures can be scrolled, and the scroll icons 512 and 522 are newly captured on the scroll bars 510 and 520. Move to a position corresponding to the range. For example, when the user clicks the left scroll arrow 514, the camera 101 video can be scrolled to the left. When the user clicks the right scroll arrow 516, the camera image can be scrolled to the right. The horizontal scroll icon 512 moves to a new position. When the user clicks up scroll arrow 524, the camera image can be scrolled up. When the user clicks down scroll arrow 526, the camera image can be scrolled down. As a result, the vertical scroll icon 522 moves to a new position.

  The scroll icons 512 and 522 are tools for arbitrarily changing the shooting range according to the amount of movement of the scroll icons 512 and 522 that are arbitrarily moved. Since it can be moved by an arbitrary amount, as a result, when the user drags the scroll icons 512 and 522 with the mouse 109, the range captured by the camera 101 can be jumped or scrolled. For example, when the user drags the horizontal scroll icon 512, the camera image can be jumped or scrolled in the horizontal direction. When the user drags the vertical scroll icon 522, the camera image can be jumped or scrolled in the vertical direction.

  Whether to jump or scroll as a result of dragging depends on the length of dragging the icons 512 and 522. If you drag so that there is no overlap with the area currently being shot, you will jump, otherwise you will scroll.

  The difference between the scroll using the scroll arrows 514, 516, 524, and 526 and the scroll using the scroll icons 512 and 522 is specified by changing the angle by a predetermined amount or by dragging the mouse 109. The difference is whether to scroll by changing the angle by the amount.

  The enlargement icon 570 and the reduction icon 580 are tools for enlarging and reducing the screen, that is, for narrowing and widening the shooting range, respectively. When the user clicks the enlarge icon 570 or the reduce icon 580 with the mouse 109, the camera image can be enlarged or reduced.

  The scroll icons 512 and 522 are changed in size according to the result. The ratio between the length in the longitudinal direction of the scroll bars 510 and 520 and the length in the longitudinal direction of the scroll icons 512 and 522 is the range (angle) that the camera 101 can shoot and the range (angle) that the camera 101 is currently shooting. This is because it is matched with the ratio. When the user clicks on the enlarge icon 570, the camera image can be enlarged, and the size of the horizontal and vertical scroll icons 512 and 522 is reduced. When the user clicks the reduction icon 580, the camera image can be reduced, and the size of the horizontal and vertical scroll icons 512 and 522 increases.

  Next, in the case where the above-described camera 101 is zooming up the boiler flame monitoring window, user operations when scrolling, jumping, enlarging, and reducing the shooting range and the resulting screen change will be described.

  First, a case where the shooting range is scrolled to the left will be described with reference to FIG. FIG. 12A shows a screen displayed on the display 108 before the left scroll operation, and 8001 is a camera-captured image. FIG. 12B shows a screen after the left scroll operation, and 8002 is a camera photographed image. FIG. 12C is a diagram showing which part of the flame monitoring window of the boiler is captured by the camera captured images 8001 and 8002. In FIG. 12A, an image of the lower right portion of the boiler flame monitoring window is displayed on the display 108.

  If the user wants to shift the shooting range of the camera 101 slightly to the left, when the user clicks the left scroll arrow 514, the camera system scrolls the shooting range to the left and displays it. As a result, as shown on the display 108 in FIG. 12B, what was photographed at the left end of the range photographed by the camera 101 is photographed slightly to the right, and a photographed image 8001 that has not been photographed. The left outer part of the camera is photographed. The position of the horizontal scroll icon 512 moves to the left.

  Next, a case where the shooting range is jumped to the left will be described with reference to FIG. FIG. 13A shows a screen displayed on the display 108 before jumping to the left, and 9001 is a camera photographed image. FIG. 13B shows a screen after jumping to the left, and 9002 is a camera photographed image. FIG.13 (c) is a figure which shows which part of the flame monitoring window of a boiler is image | photographed with the camera picked-up image 9001,9002. In FIG. 13A, an image of the lower right portion of the boiler flame monitoring window is displayed on the display 108. If the user wants the camera 101 to shoot the left shooting range as compared with FIG. 13A, when the user drags the horizontal scroll icon 512 to the left, the drag amount is large in FIG. Jump to the left and display the range. As a result, as shown on the display 108 in FIG. 13B, the left portion that has not been shot by the camera 101 until now is shot.

  Next, with reference to FIG. 14, a case where a camera image is enlarged and displayed will be described. FIG. 14A shows a screen displayed on the display 108 before the enlargement operation is performed, and reference numeral 1001 denotes a camera-captured image. FIG. 14B shows a screen after the enlargement operation, and 1002 is a camera photographed image. FIG. 14C is a diagram showing which part of the flame monitoring window of the boiler is captured by the camera captured images 1001 and 1002. In FIG. 14A, the entire image of the boiler flame monitoring window is displayed on the display 108. If the user wants to capture a part of the boiler flame monitoring window in more detail, when the user clicks on the enlarge icon 570, the camera operating system enlarges and displays the camera image. As a result, as shown on the display 108 in FIG. 14B, the upper right part of the boiler flame monitoring window, which is a part of the part that has been photographed by the camera, is greatly photographed.

  Next, with reference to FIG. 15, a case where a camera image is reduced and displayed will be described. FIG. 15A shows a screen displayed on the display 108 before the reduction operation, and reference numeral 1101 denotes a camera-captured image. FIG. 15B shows a screen after the reduction operation, and 1102 is a camera photographed image. FIG. 15C is a diagram showing which part of the flame monitoring window of the boiler is captured by the camera captured images 1101 and 1102. In FIG. 15 (a), the entire image of the boiler flame monitoring window is displayed on the display 108. If the user wants to capture a wider range than the captured image 1101, when the user clicks the reduction icon 580, the camera operation system widens the imaging range, that is, displays the video in a reduced size. As a result, as shown on the display 108 in FIG. 15B, the entire image of the boiler including the portion that has been photographed by the camera is photographed.

  Next, a description will be given of a method for determining shooting parameters for defining the shooting direction and angle of view of the camera shown in FIG. 9 in the case of scroll operation, jump operation, enlargement operation, and reduction operation.

  First, a horizontal scroll operation performed using the horizontal scroll arrows 514 and 516 will be described. For example, when scrolling left, the horizontal angle of the camera is increased in consideration of the horizontal angle of view. Specifically, the horizontal angle is increased by a certain percentage of the horizontal angle of view (= horizontal scroll rate; for example, 1/16, 1/9, etc.) for each click. When the current horizontal angle is pb degrees, the horizontal angle of view is zh degrees, and the horizontal scroll rate is kh, if the horizontal angle is changed to (pb + zh × kh) degrees, left scrolling can be performed.

  Similarly, a vertical scroll operation performed using the vertical scroll arrows 524 and 526 will be described. For example, when scrolling up, the vertical angle of the camera is increased in consideration of the vertical angle of view. Specifically, each time a click is performed, the angle in the vertical direction is increased by a certain percentage of the vertical angle of view (= vertical scroll rate; for example, 1/16, 1/9, etc.). When the current vertical angle is tb degrees, the vertical angle of view is zv degrees, and the vertical scroll rate is kv, if the vertical angle is changed to (tb + zv × kv) degrees, it is possible to scroll up.

  Next, a jump operation performed using the scroll icons 512 and 522 will be described. For example, when jumping to the left or right, the horizontal angle of the camera is changed based on the amount of movement of the horizontal scroll icon 512.

  Since the position and length of the horizontal scroll icon 512 are set in consideration of the horizontal angle of view, the angle in the horizontal direction can be determined by the amount of movement of the horizontal scroll icon 512 on the screen.

  This will be described with reference to FIG. FIG. 16A shows the amount of movement of the horizontal scroll icon 512 on the screen (horizontal icon movable amount L) when the horizontal angle of view is small (when it is enlarged, that is, when the angle of view is small). It is a figure explaining. In the figure, reference numeral 512a denotes a horizontal scroll icon displayed when the camera 101 is shooting at the leftmost position in the shootable range. Reference numeral 512b denotes a horizontal scroll icon displayed when the camera 101 is shooting at the rightmost position in the shooting range.

  FIG. 16B is a diagram for explaining the horizontal icon movable amount L when the horizontal angle of view is large. Reference numeral 512c denotes a horizontal scroll icon displayed when the camera 101 is shooting at the leftmost position in the shootable range. The horizontal icon movement amount L varies depending on the horizontal angle of view as described above, but the ratio between the length of L on the screen and the length of the horizontal scroll bar 510 in the longitudinal direction can change the actual shooting direction of the camera 101. This corresponds to the ratio between the amount (angle) and the shootable range (angle) of the camera 101. Reference numeral 512d denotes a horizontal scroll icon displayed when the camera 101 is shooting at the rightmost position in the shooting range. When L is used, the horizontal angle specified by operating the horizontal scroll icon 512 is expressed by the following equation.

同様に、上や下にジャンプする場合、カメラの垂直方向の角度を、垂直スクロールアイコン５２２の操作量に基づいて変更する。垂直画角を考慮して垂直スクロールアイコン５２２の位置と長さを設定しているので、垂直スクロールアイコン５２２の移動量により数２と同様な式で垂直方向の角度を決定できる。

Similarly, when jumping up or down, the vertical angle of the camera is changed based on the operation amount of the vertical scroll icon 522. Since the position and length of the vertical scroll icon 522 are set in consideration of the vertical angle of view, the angle in the vertical direction can be determined by the same expression as Equation 2 depending on the amount of movement of the vertical scroll icon 522.

  Next, an enlargement / reduction operation performed using the enlargement / reduction icons 570 and 580 will be described. For example, in the case of enlarging, every time the enlargement icon 570 is clicked, the horizontal angle of view and the vertical angle of view are reduced by a certain ratio (this is called an enlargement ratio. The enlargement ratio is 0.5, for example). The shooting direction is not changed. When the current values of the horizontal field angle and the vertical field angle are zh and zv, the enlarged horizontal field angle and vertical field angle are 0.5 × zh and 0.5 × zv.

  In the case of reduction, every time the reduction icon 580 is clicked once, the horizontal angle of view and the vertical angle of view are increased at a constant rate (this is called a reduction rate. The reduction rate is, for example, 2.0).

  When the image is enlarged or reduced, the positions and lengths of the scroll icons 512 and 522 change as illustrated in FIG. 16, so the position and length of the horizontal scroll icon are changed based on the changed horizontal angle of view. Change the position and length of the vertical scroll icon based on the changed vertical angle of view.

  Next, data stored in the disk 107 used by the calculation unit 1501 to determine an angle or a field angle in a scroll operation, jump operation, enlargement operation, and reduction operation will be described.

  In order to implement scrolling using the scroll arrows 514, 516, 524, and 526, items such as the current value of the horizontal / vertical angle, the horizontal / vertical angle of view, the horizontal scroll rate, and the vertical scroll rate are included. As described above, the horizontal scroll rate and the vertical scroll rate are values such as (1/16, 1/9), for example.

  In order to realize scrolling or jumping using the scroll icons 512 and 522, each of the horizontal direction and the vertical direction has a current value of the angle, an upper limit value and a lower limit value of the angle, and an icon movable amount.

  In order to realize the enlargement / reduction operation using the enlargement icons 570 and 580, the current value of the horizontal / vertical angle of view, the enlargement rate, and the reduction rate are provided. The enlargement ratio and reduction ratio are, for example, values (0.5) that halve the current angle of view in the case of enlargement, and values that double the current angle of view in the case of reduction. Further, for the angle of view, an upper limit value and a lower limit value are held in addition to the current value. The upper and lower values of the angle of view are values such as (50 degrees (horizontal direction), 30 degrees (vertical direction)), (5 degrees (horizontal direction), 3 degrees (vertical direction)). As will be described in detail later, in order to change the size of the scroll icons 512 and 522, the length of the scroll bars 510 and 520 and the upper and lower limit values of the horizontal / vertical angle are provided.

  These data can be changed according to the desire of the user by setting default values in the disk 107.

  Next, a processing procedure when the camera system performs scroll, jump, enlargement, and reduction using these data will be described.

  First, a processing procedure when horizontal scrolling is performed when the user clicks the left scroll arrow 514 or the right scroll arrow 516 with the mouse 109 will be described with reference to FIG.

  When the calculation unit 1501 detects that the left scroll arrow 514 or the right scroll arrow 516 has been clicked by the mouse 109, the calculation unit 1501 determines whether the clicked scroll arrow 514, 516 is the left scroll arrow 514 or the right scroll arrow 516. The following processing is changed depending on. In the case of the left scroll arrow 514, the calculation unit 1501 performs the processing from the following steps 211 to 214, and in the case of the right scroll arrow 516, the processing from the following steps 215 to 218 is performed (step 210). .

  In step 211, the calculation unit 1501 temporarily determines the value of the angle in the horizontal direction as (current value + angle of view × horizontal scroll rate). In step 212, it is checked whether the temporarily determined value exceeds the upper limit value of the horizontal angle. For example, when scrolling continues on the same side, the limit of the camera may be reached without shifting by one scroll. As a result of the examination, if it is within the limit, a value determined temporarily is set as the determined value. If the limit is exceeded, the upper limit is taken as the decision value.

  In step 215, the value of the angle in the horizontal direction is temporarily determined as (current value−view angle × horizontal scroll rate). In step 218, it is checked whether or not the temporarily determined value exceeds the lower limit value of the horizontal angle. If it is within the limit, the temporarily determined value is set as the determined value. If the limit is exceeded, the lower limit is taken as the decision value.

  Next, the calculation unit 1501 needs to change the position of the horizontal scroll icon 512 so that the new position of the horizontal scroll icon 512 in the horizontal scroll bar 510 corresponds to the new shooting position in the shootable range. In step 220, the calculation unit 1501 determines the position of the new horizontal scroll icon 512 in the same manner as in step 320, and outputs the new position of the horizontal scroll icon 512 to the graphic drawing unit 1503. In step 230, the graphic drawing unit 1503 creates an image in which the horizontal scroll icon 512 is displayed at a new position, and outputs the image to the video composition unit 1504.

  In step 240, the calculation unit 1501 outputs a setting parameter to the camera control device based on the determined horizontal direction parameter.

  In step 250, the camera control apparatus 102 receives a change command from the calculation unit. The camera control device 102 points the camera 101 in the designated horizontal direction.

  In step 260, the camera 101 shoots at a designated horizontal angle and sends the camera video to the video composition unit 1504.

  In step 270, the video synthesizing unit 1504 receives the video from the camera 101, synthesizes it with the graphic image from the graphic drawing unit 1503, and sends it to the display 108.

  The display 108 receives the composite video from the video synthesis unit 1504 and displays it on the display screen.

  Next, a processing procedure when performing vertical scrolling when the user clicks the up scroll arrow 524 or the down scroll arrow 526 with the mouse 109 will be described with reference to FIG.

  When the arithmetic unit 1501 detects that the up scroll arrow 524 or the down scroll arrow 526 is clicked by the mouse 109, the arithmetic unit 1501 determines whether the clicked scroll arrow 524, 526 is the up scroll arrow 524 or the down scroll arrow 526. Change the following process. In the case of the up scroll arrow 524, the calculation unit 1501 performs the processing from the following steps 911 to 914, and in the case of the down scroll arrow 526, the processing from the following steps 915 to 918 is performed (step 910). .

  In step 911, the calculation unit 1501 temporarily determines the angle value in the vertical direction as (current value + angle of view × vertical scroll rate). In step 912, it is checked whether or not the temporarily determined value exceeds the upper limit value of the angle in the vertical direction. If it is within the limits, the provisionally determined value is taken as the determined value. If the limit is exceeded, the upper limit is taken as the decision value.

  In step 915, the value of the angle in the vertical direction is temporarily determined as (current value−view angle × vertical scroll rate). In step 916, it is checked whether or not the temporarily determined value exceeds the lower limit value of the angle in the vertical direction. If it is within the limit, the temporarily determined value is set as the determined value. If the limit is exceeded, the lower limit is taken as the decision value.

  Next, the calculation unit 1501 needs to change the position of the vertical scroll icon 522 so that the new position of the vertical scroll icon 522 in the vertical scroll bar 510 corresponds to the new shooting range in the shooting possible range. In step 920, the calculation unit 1501 determines the position of the new vertical scroll icon 522 and outputs the new position of the vertical scroll icon 522 to the graphic drawing unit 1503. In step 930, the graphic drawing unit 1503 creates an image in which the vertical scroll icon 522 is displayed at a new position, and outputs the image to the video composition unit 1504.

  In step 940, the calculation unit 1501 outputs the shooting parameter to the camera control device based on the determined vertical parameter.

  In step 950, the camera control apparatus 102 receives a change command from the calculation unit 1501. The camera control device 102 points the camera 101 in the designated vertical direction.

  In step 960, the camera 101 captures an image at the designated vertical angle, and sends the obtained camera image to the image composition unit 1504.

  In step 970, the video synthesizing unit 1504 receives the video from the camera 101, synthesizes it with the graphic image from the graphic drawing unit 1503, and sends it to the display 108.

  The display 108 receives the composite video from the video synthesis unit 1504 and displays it on the display screen.

  Next, a processing procedure for performing a horizontal jump when the user drags the horizontal scroll icon 512 with the mouse 109 will be described with reference to FIG. As described above, depending on the amount of dragging, there is a case where it corresponds to scrolling instead of jumping, but in FIGS. 19 and 20, the operation when the scroll icons 512 and 522 are dragged will be called jumping.

  When the arithmetic unit 1501 detects that the horizontal scroll icon 512 is dragged by the mouse 109, the arithmetic unit 1501 selects the following processing depending on which direction the horizontal scroll icon 512 is dragged. If the horizontal scroll icon 512 is dragged to the left, the process of step 611 is performed. If the horizontal scroll icon 512 is dragged to the right, the process of step 612 is performed (step 610).

  In step 611, the calculation unit 1501 determines the angle in the horizontal direction to a value given by the expression shown in step 611 in FIG. In step 612, the calculation unit 1501 determines the angle in the horizontal direction to a value given by the expression shown in step 612 in FIG.

  Next, the calculation unit 1501 needs to change the position of the horizontal scroll icon 512 so that the position of the horizontal scroll icon 512 in the horizontal scroll bar 510 corresponds to the new shooting position. In step 620, the calculation unit 1501 determines the position of the new horizontal scroll icon 512 in the same manner as in step 320, and outputs the new position of the horizontal scroll icon 512 to the graphic drawing unit 1503.

  In step 630, the graphic drawing unit 1503 creates an image in which the horizontal scroll icon 512 is displayed at a new position, and outputs the image to the video composition unit 1504.

  In step 640, the calculation unit 1501 outputs the shooting parameter to the camera control device based on the determined horizontal direction parameter.

  In step 650, the camera control apparatus 102 receives a change command from the calculation unit 1501. The camera control device 102 points the camera 101 in the designated horizontal direction.

  In step 660, the camera 101 captures an image at the designated horizontal angle, and sends the obtained camera image to the image composition unit 1504.

  In step 670, the video synthesizing unit 1504 receives the video from the camera 101, synthesizes it with the graphic image from the graphic drawing unit 1503, and sends it to the display 108.

  The display 108 receives the composite video from the video synthesis unit 1504 and displays it on the display screen.

  Next, a processing procedure for performing a vertical jump when the user drags the vertical scroll icon 522 with the mouse 109 will be described with reference to FIG.

  When the calculation unit 1501 detects that the vertical scroll icon 512 is dragged by the mouse 109, the calculation unit 1501 changes the following processing depending on which direction the vertical scroll icon 512 is dragged. When the vertical scroll icon 512 is dragged up, the process of step 711 is performed. If the vertical scroll icon 522 is dragged downward, the process of step 712 is performed (step 710).

  In step 711, the calculation unit 1501 determines the angle in the vertical direction to a value given by the expression shown in step 711 in FIG. In step 712, the calculation unit 1501 determines the angle in the vertical direction to a value given by the expression shown in step 712 in FIG.

  Next, the calculation unit 1501 needs to change the position of the vertical scroll icon 522 so that the new position of the vertical scroll icon 522 in the vertical scroll bar 520 corresponds to the new shooting position in the shootable range. In step 720, the calculation unit 1501 determines the position of the new vertical scroll icon 522 and outputs the new position of the vertical scroll icon 522 to the graphic drawing unit 1503. In step 730, the graphic drawing unit 1503 creates an image in which the vertical scroll icon 522 is displayed at a new position, and outputs the image to the video composition unit 1504.

  In step 740, the calculation unit 1501 outputs the shooting parameters to the camera control device based on the determined vertical direction parameters.

  In step 750, the camera control apparatus 102 receives a change command from the calculation unit 1501. The camera control device 102 points the camera 101 in the designated vertical direction.

  In step 760, the camera 101 captures an image in the designated vertical direction, and sends the obtained camera image to the image composition unit 1504.

  In step 770, the video synthesizing unit 1504 receives the video from the camera 101, synthesizes it with the graphic image from the graphic drawing unit 1503, and sends it to the display 108.

  The display 108 receives the composite video from the video synthesis unit 1504 and displays it on the display screen.

  Next, a processing procedure when performing enlargement or reduction when the user clicks the enlargement icon 570 or reduction icon 580 with the mouse 109 will be described with reference to FIG.

  When the calculation unit 1501 detects that the reduction icon 570 or the enlargement icon 580 has been clicked with the mouse 109, the calculation unit 1501 changes the following processing depending on which icon is clicked. When the reduction icon 580 is clicked, the following processing from steps 811 to 814 is performed. When the enlarge icon 570 is clicked, the following processing from step 815 to 818 is performed (step 810).

  In step 811, the calculation unit 1501 temporarily determines the horizontal angle of view and the vertical angle of view as (current value × reduction rate), respectively. For example, it is doubled. In step 812, it is checked whether or not the temporarily determined value exceeds the upper limit value of each of the horizontal field angle and the vertical field angle. This is because, for example, when the reduction is continued, there may be an upper limit of the angle of view of the camera before changing by the reduction ratio. As a result of the examination, if it is within the limit, a value that is tentatively determined is set as the determined value. If the limit is exceeded, the upper limit is taken as the decision value.

  In step 815, the horizontal field angle and the vertical field angle are temporarily determined as (current value × magnification ratio), respectively. For example, 0.5 times. In step 816, it is checked whether or not the temporarily determined value exceeds the lower limit values of the horizontal field angle and the vertical field angle. If it is within the limit, the temporarily determined value is set as the determined value. If the limit is exceeded, the lower limit is taken as the decision value.

  Next, the calculation unit 1501 causes the new positions and sizes of the horizontal and vertical scroll icons 512 and 522 in the horizontal and vertical scroll bars 510 and 520 to correspond to the new shooting position and shooting range in the shootable range. It is necessary to change the position and length of the horizontal and vertical scroll icons 512 and 522.

  In steps 820, 821, and 822, the calculation unit 1501 determines the positions and lengths of the new horizontal and vertical scroll icons 512 and 522, and sends the new positions and lengths of the horizontal and vertical scroll icons 512 and 522 to the graphic drawing unit 1503. Is output.

  The method for determining the position and length will be described below with reference to FIG. FIG. 22 shows a case where the camera 101 captures an image while changing the angle in the horizontal direction. In FIG. 22, reference numeral 2102 denotes the left end of the imageable range, and the angle is maxh degrees. Reference numeral 2105 denotes the right end of the imageable range, which is minh degrees. A portion engraved between 2101 and 2103 is a photographing range when the camera 101 is located at a position 2102. The angle of the engraved portion is a horizontal angle of view, which is zh degrees. Reference numerals 2104 and 2106 denote shooting ranges when the camera 101 is at the position 2105, and the angle of view is zh degrees.

  An angle corresponding to the length of the horizontal scroll bar 510 (referred to as a scroll bar corresponding angle) is set to barh shown in the figure. An angle barh corresponding to the length of the horizontal scroll bar 510 is obtained, and the ratio of the angle barh to the angle of view zh is set so that the ratio of the length of the horizontal scroll bar 510 and the length of the horizontal scroll icon 512 matches. The length of the scroll icon 512 is determined. The position of the horizontal scroll icon 512 is a horizontal angle at a position where the center of the angle of view is located. When the camera 101 is on the left end, this angle is maxh degrees.

  In step 821, for each of the horizontal and vertical directions, angles barh and barv (vertical direction) corresponding to the lengths of the scroll bars 510 and 520 are obtained by the equation (a) described in step 821. Next, according to the expression (b) in step 821, the ratio between the angle barh, barv and the angle of view zh, zv, and the ratio between the length of the scroll bars 510, 520 and the changed length of the scroll icons 512, 522 are obtained. The lengths of the scroll icons 512 and 522 are determined so as to match. The positions of the scroll icons 512 and 522 are respectively determined by the expression of step 822.

  In these equations, for example, when calculating in the horizontal direction, each numerical value uses a numerical value in the horizontal direction. That is, in the equation (a), “the upper limit value of the direction” means the upper limit value maxh of the angle in the horizontal direction when calculating in the horizontal direction.

  In step 830, the graphic drawing unit 1503 creates a graphic image in which the new position and length of the horizontal scroll icon 512 are displayed, and outputs the graphic image to the video composition unit 1504.

  In step 840, the calculation unit 1501 outputs shooting parameters to the camera control device based on the determined horizontal field angle and vertical field angle.

  In step 850, the camera control apparatus 102 receives a change command from the calculation unit 1501. The camera control device 102 sets the camera 101 to the designated angle of view.

  In step 860, the camera 101 captures an image with the designated angle of view, and sends the obtained camera image to the image composition unit 1504.

  In step 870, the video synthesizing unit 1504 receives the video from the camera 101 and synthesizes it with the graphic image from the graphic drawing unit 1503 and sends it to the display 108.

  The display 108 receives the composite video from the video synthesis unit 1504 and displays it on the display screen.

  According to the present embodiment, when it is desired to capture a range that is not displayed on the screen, it is possible to easily change the capture range. In addition, a scroll bar and a scroll icon are always displayed as to what range the camera can shoot and what range the camera is currently shooting in the whole. Therefore, an operation for confirming the shootable range is unnecessary, and the position of the shootable range and the currently captured range can be easily confirmed.

In addition, since the GUI is realized, the video of the camera can be operated with the same feeling as computer graphics. That is, since the computer graphics and the user interface are unified, the following effects are obtained.
・ Easy to learn and less forgetful to operate ・ Reduces misoperations ・ Even the first person who operates the camera system according to this embodiment can operate the camera if he / she knows how to operate computer graphics ・ Be aware of camera setting parameters As a result, an operating system that is more natural for humans is provided.

  In the above-described embodiment, the enlargement / reduction is shown for the case of enlargement / reduction at a fixed rate. However, as in the case of scrolling, an enlargement / reduction bar and icon are displayed, and the icon is arbitrarily set in the bar. It is good also as enlarging / reducing by arbitrary magnification by moving.

  The scroll rate, enlargement rate, and reduction rate can be set to arbitrary values desired by the user by rewriting the contents of the disc.

  Next, a second embodiment according to the present invention will be described. In the first embodiment, the number of dots in the camera image is the same as the number of dots in the display display range. However, in the second embodiment, the display display range (number of dots) is the camera image shooting range. Greater than (dot count). In the present embodiment, the peripheral portion of the range currently being photographed is displayed as a still image in an empty portion other than the portion where the video currently photographed by the camera on the display surface is displayed. For this purpose, a shootable range of the camera other than the range currently being shot is shot in advance and stored in the disk 107.

  The page turning, scrolling, jumping, enlargement, and reduction functions described in the first embodiment are also included in this embodiment.

  FIG. 23 shows a block diagram of the camera system according to the present embodiment. Elements having the same reference numerals as those in FIG. 1 have the same configurations / functions as those in the first embodiment, and thus detailed description thereof is omitted.

  In this embodiment, the video composition unit 2701 has a frame memory for synthesizing the camera video and the video from the graphic drawing unit 1503. Further, position data indicating where the camera image is displayed on the display surface of the display 108 is input from the calculation unit 1501 via the data line 2702. The position data is two-dimensional coordinate data (X, Y) indicating where the upper left portion of the camera image is on the display surface of the display 108.

  The video composition unit 2701 digitizes the video from the camera video and the graphic drawing unit 1503 to obtain video data. Next, in accordance with the position data received from the calculation unit 1501, video data obtained by digitizing the camera video is written at a position on the frame memory corresponding to the designated position on the display 108. Except for the portion of the frame memory where this data is written, video data obtained by digitizing the video from the graphic drawing unit 1503 is written to synthesize the video. The synthesized result is converted into a video signal and output to the display.

  The disk 107 stores a range of images that can be captured by the camera 101 in advance, which is captured by the camera 101 and the obtained video is converted into still image data.

  A video capture board 2703 is used to acquire still image data. The video capture board 2703 receives a video signal from the camera 101 and converts the video signal into a digital signal. Further, the digital signal is compressed and then transferred to the disk 107.

  The computing unit 1501 causes the camera 101 to shoot the entire shootable range of the camera 101 when the power of the camera system is turned on or when an instruction is given from the user. The video signal output from the camera 101 is captured by the video capture board 2703 frame by frame for each shooting location. The digital data compressed by the video capture board 2703 is stored in the disk 107.

  A display example in this embodiment is shown in FIG. FIG. 24A shows a display in the case where only the video currently captured by the camera 101 is displayed on the display 108. FIG. 24B shows a display displayed on the display 108 when the window becomes the maximum size as a result of clicking the window size maximum icon 2801.

  In the initial state, the image 2801 of the camera is displayed on the upper left of the display 108 as shown in FIG. 24A. However, when the window is enlarged, the image is displayed in the window as shown in FIG. Can be displayed at any position. The display position is changed by dragging at an arbitrary position in the image 2801 with the mouse 109.

  When the size of the window reaches the maximum, the area for displaying the camera video (camera video display area) is expanded to the maximum extent possible. The possible range is a range excluding an area for displaying the GUI display unit 2806 in FIG. In the enlarged area, a still image 2804 that has already been shot and stored in the disk 107 is displayed for the area that can be shot by the camera 101.

  The user operates the window size maximum icon 2801 to enlarge the camera video display area to the maximum possible range, thereby confirming the relationship between the camera's shootable range and the current shooting range in the form of an image. be able to.

  When the window size maximum icon 2801 is clicked with the mouse 109, the calculation unit 1501 determines the still image data stored in the disk 107 in advance as a display target. The displayed still image is determined to have the same angle of view (shooting magnification) as that of the camera video 2802.

  After the determination, the calculation unit 1501 reads still image data from the disk 107, decodes it, and outputs it to the graphic drawing unit 1503.

  Furthermore, this camera system has a window size changing function. This is a function for changing the size of the window to the size designated by the user dragging the mouse 109. The user drags four corners of the window, for example, 2805 with the mouse 109. The calculation unit 1501 receives a signal from the mouse 109 and obtains the size of the window. After determining the size, it can be realized in the same manner as in the case of maximizing the size of the window.

  According to the second embodiment, the user can change the size of the window in the camera system by the same operation as a conventional operation for changing the size of the graphics window.

  Further, since the periphery of the part currently being photographed can be viewed at the same time, it is convenient for determining how to change the photographing range.

  Next, a third embodiment according to the present invention will be described. The camera system according to this embodiment has a jump guide function and a jump destination guide function.

  The in-jump guide function is the position of the scroll icon on the screen that is specified momentarily by moving the mouse while using the jump function described in the first and second embodiments (dragging the scroll icon with the mouse). This is a function for displaying an image captured in advance and stored as a still image with respect to the image capturing range of the camera corresponding to. Whether or not the mouse is moving is determined by whether or not the position of the mouse has changed within a predetermined time while the button of the mouse is down.

  In the following, a case where still images are stored will be described. However, the present invention is not limited to this, and moving images may be accumulated and displayed.

  With the jump destination guide function, when the jump destination is specified by the jump function described in the first and second embodiments, the shooting range of the camera that is the jump destination is shot in advance and stored as a still image. It is a function to display what you put.

  Whether or not the jump destination has been designated is determined as the jump destination has been designated when the mouse button does not change within a predetermined time while the mouse button is down. The jump destination still image is then displayed. When the mouse button is pushed up, it is determined that the jump destination has been finally determined at that position, and a camera image as a moving image is displayed.

  The difference between the jump destination guide function and the jump guide function is that the still guide image is displayed while the mouse is moving in the jump guide function. Still images are not displayed. Whether to select the guide function during jump or the jump destination guide function depends on the user's specification.

  With these functions, the user can immediately know whether or not the jump destination desired by the user has been properly specified.

  Below, the guide function during jump will be described first. The configuration of the camera system according to the present embodiment is the same as the configuration of the camera system according to the first embodiment shown in FIG.

  The screen displayed on the display 108 in this embodiment is the same as the screen in the first embodiment shown in FIG.

  In the shooting site, there is a panel 2901 written with numbers as shown in FIG. 25, and a part of the panel 2901 is zoomed up as an example, and the user operation in this embodiment and the corresponding operation The processing of the camera system and the displayed screen will be described. In FIG. 25, reference numerals 2902, 2903, and 2904 indicate the ranges displayed in FIGS.

  With reference to FIG. 26, an example will be described in which the shooting range is guided from time to time during the operation of changing the shooting range to the left (during a jump). FIG. 26A shows a display on the display 108 before the operation of dragging the scroll icon 550 with the mouse 109 is performed. In FIG. 26A, an image of a portion of the panel 2901 where 62 is written is displayed on the display 108.

  When the user wants to cause the camera 101 to shoot a left-side shooting site that has not been shot before, and drags the horizontal scroll icon 550 to the left, the display 108 shown in FIG. As described above, the still image of the portion 42 of the panel 2901 that has not been shot by the camera 101 until now is displayed. If the user further drags and then stops moving the mouse 109 with the button of the mouse 109 depressed, the camera 101 has not taken a picture as shown in the display 108 of FIG. 26C. A still image of the portion 22 of the panel 2901 is displayed. When this part is the user's desired shooting site, the user releases the button of the mouse 109, that is, ends the drag. As a result, as shown on the display 108 shown in FIG. 26D, a camera video (moving image) of the portion 22 of the panel 2901 that has not been shot by the camera 101 until now is shot.

  During the jump in the vertical direction, the vertical scroll icon 522 is dragged. At this time, in order to guide the shooting range, the corresponding still image is displayed during the drag, as in the case of jumping in the horizontal direction, and dragged. When is finished, a camera image (moving image) is taken.

  Regardless of the size of the horizontal angle of view or vertical angle of view, the guide function during jump is realized by determining a still image to be displayed based on the drag amount of the horizontal scroll icon or the vertical scroll icon.

  Since the position and length of the horizontal scroll icon is set based on the current shooting direction and horizontal angle of view within the horizontal shooting range of the camera, the drag amount on the screen It can be translated into the change amount of the shooting direction.

  Similarly, the position and length of the vertical scroll icon are set for the shooting direction of the camera in the vertical direction, and the drag amount can be translated into the change amount of the shooting direction of the camera in the vertical direction. A still image to be displayed is determined based on the obtained horizontal and vertical shooting directions and angle of view.

  Data used in this embodiment will be described. In this embodiment, in addition to the data used in the first embodiment, still image data is held in the same manner as in the second embodiment in order to realize the guide function during jumping.

  There are various methods for acquiring still image data. In one method, when the system is activated, the entire shootable range is shot while changing the direction at the maximum angle of view. The obtained camera image is stored in the disk 107 as a still image. Another method accumulates still images little by little while performing a shooting operation for monitoring with a camera.

  Furthermore, for each data unit of still images (data for one screen at the time of shooting for acquiring still image data), the position on the coordinate plane set as the shooting target corresponds to the position on the upper left of the screen. There are coordinate values x and y (used for identifying still image data) and data w (horizontal direction) and h (vertical direction) indicating the size of the photographed area on the coordinate plane.

  In addition, for each data unit of a still image, there is data relating to the shooting direction and the angle of view when the image is shot.

  In the clicks and drags in the embodiments already described, processing such as jumping and scrolling is performed when the button is released (button up). In the present embodiment, necessary processing is performed in accordance with each operation of pressing down the button (button down), moving the mouse, and releasing the button during the drag operation.

  FIG. 27 shows an example of display in the case where the horizontal scroll icon 550 is dragged with the mouse and jumped to a desired position among the displays when guiding while jumping in the horizontal direction, but the button is held down. (FIG. 27A. Still image) and an example of display when the button is released at the same position (FIG. 27B. Moving image) are shown.

  Next, processing contents of the camera system being dragged in the horizontal direction will be described with reference to the flowchart of FIG.

  When the arithmetic unit 1501 detects that the horizontal scroll icon 512 is being dragged from the change of the position of the mouse 109 within a predetermined time (for example, 0.5 seconds), the arithmetic unit 1501 performs horizontal scrolling to the graphic drawing unit 1503. The moving position of the icon 512 is output (step 3210). In step 3220, the graphic drawing unit 1503 creates an image of the graphic at the position where the horizontal scroll icon 512 is detected, and outputs it to the video composition unit 1504.

  Next, in step 3230, it is determined from the change in the position of the mouse 109 whether the moving direction of the horizontal scroll icon 512 is left or right. If the traveling direction of the horizontal scroll icon is left, the process proceeds to step 3231, and if it is right, the process proceeds to step 3232.

  In steps 3231 and 3232, the shooting direction is determined so that the new shooting range in the entire shooting range corresponds to the positional relationship on the display between the horizontal scroll bar 510 and the horizontal scroll icon 512. When the traveling direction of the horizontal scroll icon 512 is the left, it is determined by the formula of step 3231, and when it is right, it is determined by the formula of step 3232.

  In step 3240, the calculation unit 1501 calculates the coordinate value and the screen size of the upper left corner of the still image data to be displayed based on the current horizontal angle of view value and the determined horizontal value. .

  In step 3250, the arithmetic unit 1501 reads out still image data within the still image range obtained in step 3240 from the still image data stored in the disk 107, and sends it to the figure drawing unit 1503. Data relating to the position and size to be displayed on the display 108 is also sent to the graphic drawing unit 1503.

  In step 3260, the graphic drawing unit 1503 draws the still image to be displayed at the position instructed by the calculation unit 1501 based on the received still image data in the designated size. At this time, if the field angle of the stored still image data does not match the current horizontal or vertical field angle, the stored still image data is interpolated (when enlargement is required) or thinned. (If you need to reduce). Further, the graphic drawing unit 1503 draws the GUI display units 202, 203, and 204.

  In step 3270, the video composition unit 1504 receives an instruction from the computation unit 1501 so as not to perform composition with the video from the camera 101, and an image including the still image and the GUI display units 202, 203, and 204. Only to the display 108.

  Next, a description will be given of a case where the user releases the button in the processing procedure when guiding in the horizontal jump. At this time, the horizontal scroll icon 512 is drawn at the position where the button is released. Also, the video (moving image) from the camera 101 is synthesized.

  The processing procedure when the user jumps in the vertical direction using the vertical scroll icon can be processed in the same manner as in the horizontal direction.

  In order to realize the jump destination guide function, a still image may be drawn as in FIG. 28 when the mouse 109 does not move within a predetermined time while the button of the mouse 109 is pressed.

  Note that the jump destination guide function can be used in place of the during-jump guide function in a system that takes time when the during-jump guide function is executed.

  According to the third embodiment, since the user can see the shooting range of the camera corresponding to the drag amount of the scroll icon as a still image, the user can use the scroll icon without worrying about the excessive operation of the scroll icon. , You can use the jump function of the camera.

  Next, a fourth embodiment according to the present invention will be described. In this embodiment, the change of the shooting direction and the shooting magnification of the camera described in the first embodiment is realized by a method different from that of the first embodiment.

  FIG. 29 shows the overall configuration of the camera system according to the present embodiment. As illustrated in FIG. 29, a carriage 111 is added to the camera system according to the first embodiment, and the camera 101 is mounted on the camera installation unit 1704 of the carriage 111. The carriage 111 can move on a plane, and the installation unit 1704 of the camera 101 can move up and down. The carriage 111 can receive the drive signal from the camera control device 1701 through the control signal line 1702 and move the camera 101 in the three-dimensional space.

  The difference from the first embodiment is that the movement of the carriage 111 copes with an instruction to change the shooting range. This will be described with reference to FIG. FIG. 30 is a top view of the camera 101 shooting the shooting target 2501 from the front. In this way, the carriage 111 is normally facing the front, and the camera 101 is set to have a photographing direction so as to photograph the photographing object 2501 from the front. If there is an instruction to scroll or jump in the horizontal direction, the carriage 111 moves in the horizontal direction 2502 according to the instruction. When there is an instruction for vertical scrolling or jumping, the camera installation unit 1704 moves up and down according to the instruction. When there is an instruction for enlargement or reduction, the carriage 111 moves in the vertical direction 2503 according to the instruction.

  The carriage 111 has two sets of tires for moving in the horizontal direction 2502 and the vertical direction 2503, respectively. When moving in the horizontal direction 2502, a tire for horizontal movement is used, and the tire for vertical movement has a mechanism that floats from the floor so as not to cause running resistance during horizontal movement. When moving in the vertical direction 2503, the tire for horizontal movement also has a mechanism for floating from the floor surface.

  Further, at least one of the tires in each set has a tachometer that detects the rotation speed of the tire, and the detected rotation speed is sent to the camera control device 1701. The camera control device 1701 is used to determine whether or not the carriage 111 has moved to the position indicated by the rotation speed. When it is determined that the camera has moved to the instructed position, the camera control device 1701 stops the rotation of the tire.

  The carriage 111 also has a hydraulic circuit 1705 for moving the camera installation unit 1704 up and down. The amount of displacement in the vertical direction is measured using a displacement sensor. Based on the measurement result, it is determined whether or not the position specified by the setting parameter has been reached.

  Only when an instruction is given to shoot a range that cannot be dealt with by movement of the carriage 111 (outside the movable range of the carriage 111), the change is made by changing the shooting direction and the angle of view as in the first embodiment. .

  A display for changing the photographing range displayed on the display 108 is shown in FIG. The display is almost the same as in the first embodiment, but in order to indicate the range that can be dealt with by movement of the carriage 111 and the range that can not be dealt with by movement, the display colors of the horizontal and vertical scroll bars 510 and 520 according to the range change. In the horizontal scroll bar 510, the area on the left side of the line 2601 and the area on the right side of the line 2602 are set to display colors different from the areas surrounded by the lines 2601 and 2602. Similarly, the display color of the vertical scroll bar 520 is changed with the lines 2603 and 2604 as boundaries.

  The line 2605 is displayed at the center of the horizontal scroll icon 512 so that the user can easily check whether the shooting range is in the area on the left side of the line 2601 or on the right side of the line 2602. When the line 2605 is in the area on the left side of the line 2601 or the right side of the line 2602, the shooting direction is changed to correspond to the change of the shooting range. Note that the line 2601 may be a solid line or a dotted line. Further, in order to show the center of the horizontal scroll icon 512, the display color of the horizontal scroll icon 512 may be made different between the left side and the right side of the horizontal scroll icon 512 instead of displaying the line 2605.

  Similarly, for the vertical scroll icon 522, a line 2606 is displayed at the center of the vertical scroll icon 522.

  When it is possible to cope with the movement of the carriage 111, in order to move the carriage 111, the calculation unit 1511 performs the commands “H”, “U”, “F” and data indicating the movement amount (the unit is “m”). Is sent to the camera control unit 1701. The command “H” is a command for moving the carriage 111 in the horizontal direction 2502. The command “U” is a command for moving the camera installation unit 1704 up and down. The command “F” is a command for moving the carriage 111 in the vertical direction 2503.

  The commands “P”, “T”, and “Z” shown in the first embodiment are used by the camera control unit 1701 when the calculation unit 1511 determines that a range that cannot be handled by the movement of the carriage 111 is specified. Is output from.

  Upon receiving the commands “H”, “U”, and “F”, the camera control device 1701 drives the above-described tire or hydraulic circuit to move the camera 101 to the instructed position.

  The operation of changing the shooting range using the user's mouse 109 is performed in the same manner as in the first embodiment.

  The definition of the position in a present Example is demonstrated. The position of the camera 101 is represented by a three-dimensional coordinate (x, y, z) from the position where the reference position is defined as (0, 0, 0). If the camera 101 moves left in the horizontal direction 2502, the value of the x coordinate decreases, and if it moves upward, the value of the y coordinate increases. Moving forward will decrease the value of the z coordinate.

  In addition to the data stored in the disk 107 in the first embodiment, the data used in this embodiment and stored in the disk 1071 include the following. For the position of the camera 101 in the horizontal, vertical, and height directions, the current value, upper limit value, and lower limit data are held. Further, the current value, the upper limit value, and the lower limit value of the distance L (shown in FIG. 30) from the object 2501 are also stored in the disk 1071.

  Regarding the page turning and scrolling processing procedures in this embodiment, the difference from the first embodiment is that the parameter to be changed based on the angle of view is the position instead of the shooting direction. This will be described with reference to FIG. In the case of turning the left page, in FIG. 30, for example, it is assumed that the position coordinates of the camera 101 are changed from (0, 0, 0) to (−5, 0, 0). This is because there is a dzh degree overlap between the image of the object to be photographed viewed from the camera 101 ′ after the change and the image of the object to be photographed 2501 viewed from the camera 101 before the change, as in FIG. This is because the result obtained under the condition of moving in the horizontal direction is obtained by calculation as long as it moves 5 m to the left.

  Assuming that the moving distance of the camera 101 is r, r is obtained by the following equation.

r = L (tan (zh / 2) + tan (zh / 2−dzh))
In the case of upward scrolling, it can be obtained in the same manner. For example, when the amount to be moved up is calculated to be 0.5 m, the position coordinates are changed from (0, 0, 0) to (0, 0.5, 0).

  The processing procedure for jumping determines the amount of change of the camera position from the operation amount obtained based on the angle of view, and changes the position. For example, in FIG. 31, it is assumed that the distance between the line 2601 and the line 2602 is 20 cm on the screen, and the amount that the carriage 111 can actually move in the horizontal direction is 10 m. At that time, when the horizontal scroll icon 512 moves 15 cm to the right on the screen, the actual movement amount is (15 × 10/20) m, that is, 7.5 m, and the jump is 7.5 m. Become. In this case, for example, the camera parameter is changed from the position (0, 0, 0) to the position (7.5, 0, 0).

  The processing procedure for enlarging and reducing the position is changed based on the angle of view while changing the distance from the focused object so that the camera can shoot the same subject. When enlarging, shorten the distance from the one that is in focus. For example, when the initial value of the camera position parameter is (0, 0, 0), the position parameter is reduced to the coordinate value in the z direction as in (0, 0, −10), and the camera is advanced. In the case of reduction, the distance from the focused object is increased so that the camera can shoot the same object. For example, when the initial value of the camera position parameter is (0, 0, 0), the coordinate value in the z direction is increased as in (0, 0, 10), and the camera is moved backward.

  At this time, when the enlargement / reduction is performed at the same rate as the enlargement / reduction by changing the angle of view using the enlargement icon or reduction icon of the first embodiment, the position is determined as follows. For example, when it is desired to achieve the same effect as that in the case where the enlargement ratio of the first embodiment is 0.5 by changing the position, the distance L to the object 2501 is halved. As a result, even if the angle of view is not changed, an enlarged image can be taken as in the case where the angle of view of the first embodiment is halved. The case of reduction can be considered similarly.

  That is, if the enlargement ratio or reduction ratio in the first embodiment is k, in the second embodiment, the distance from the object to be imaged may be increased by k times.

  According to the present embodiment, in a system capable of shooting by changing the position of the camera, it is possible to easily change the shooting range so that a range not displayed on the screen is shot.

  In addition, lines 2601, 2602, 2603, and 2604 for identifying the range that can be captured by changing the position and the range that is necessary until the change of the shooting direction / angle of view are displayed. The user can easily recognize the range that can be captured by changing the position and the range that is necessary until the change of the shooting direction / angle of view.

  Furthermore, the user can easily confirm which range the camera is currently capturing in the entire range that can be captured.

  In addition, since the graphics and the user interface are unified, the operation procedure is easy to remember and difficult to forget, as in the first embodiment.

  In the fourth embodiment, in principle, the camera shoots the object to be photographed from the front, and changes the position in the range corresponding to the line 2601 and the line 2602. In principle, the camera may change the shooting range by changing the shooting range / angle of view. The camera position may be changed only when a shooting range that cannot be dealt with by changing the shooting range / angle of view is designated.

  Next, a fifth embodiment of the present invention will be described. In this embodiment, a window for displaying graphics is displayed on the same display in addition to the window for displaying camera images described in the first to fourth embodiments. The graphics operation is the same GUI as the camera image operation. Here, graphics refers to an image created by a computer based on graphic data, a word processor document, etc. (hereinafter referred to as image original data) and displayed on a display.

  The page turning function in the window for displaying graphics is for viewing image original data not displayed when there is a lot of image original data and there is image original data not displayed in this window. When the user performs a page-turning operation on a window that displays graphics, the graphics are displayed on the window so that the portion of the graphics that is only slightly visible at one end of the window is displayed at the other end of the window. To the other end.

  The graphics scrolling function is a function for shifting the graphics up, down, left, and right in order to see a portion that is not displayed.

  The graphics enlargement function is a function that enlarges the currently displayed graphic and displays a part of the graphic in detail.

  The graphics reduction function is a function for reducing a currently displayed graphic and displaying a larger part of the image original data.

  The overall configuration of the camera system according to the present embodiment is shown in FIG. The hardware configuration of this embodiment is the same as that of the first embodiment. The display 108 displays a window 1801 for displaying the camera video 1803 and a window 1802 for displaying the graphics 1804.

  The screen configuration of the window 1801 for displaying the camera video 1803 is the same as that of the first embodiment. That is, it has GUI display portions 1805, 1806, and 1807, and a scroll bar, scroll icon, scroll arrow, enlarged icon, and reduced icon are included in the GUI display portions 1805, 1806, and 1807.

  The window 1802 for displaying graphics also has GUI display units 1808, 1809, and 1810 similar to those in the first embodiment, and a scroll bar, scroll icon, scroll arrow, enlarged icon, and reduced icon are displayed on the GUI. 1808, 1809, 1810. The operation method of the scroll bar, scroll icon, scroll arrow, enlarged icon, and reduced icon is the same as in the first embodiment.

  In order to display on the display 108 as shown in FIG. 32, the video composition unit in the workstation 150 synthesizes the video from the camera with the portion of the window 1801 where the camera video 1803 is displayed. Display data for graphics and display data for a GUI display unit are created for portions other than the portion of the display 108 where the camera video is displayed. Then, these data are output to the graphic drawing unit in the workstation 150. The video composition unit in the workstation 150 synthesizes the output from the graphic drawing unit and the output from the camera 101.

  In order to display the camera image at an arbitrary position on the display surface of the display 108 at an arbitrary size when combining, the calculation unit displays the position and size of the camera image on the image combining unit. It is good also as sending the information. The video composition unit may have a frame memory, and based on this information, the camera video and the image output from the figure drawing unit may be synthesized using the frame memory.

  According to the first to fourth embodiments, the interface (GUI) used when the user operates the graphics even when the user does not directly operate the camera control device to change the shooting range. The same interface can be used to operate the video.

  According to the fourth embodiment, since the user can move and shoot the camera, it exists when the plane shot by the shooting target camera is not orthogonal to the camera direction. Some distortions can be eliminated.

  According to the fifth embodiment, the user can operate the camera video and the graphics with the same interface in the camera system that displays the camera video and the graphics on one display.

  In the above embodiments, a camera system including a camera, a camera control device, and a workstation has been described. Actually, the present invention can be applied to a system including a camera and performing an operation of changing the shooting range of the camera. For example, in a plant operation system and a monitoring system, an operation for changing the photographing range of a plant monitoring camera is performed. The present invention can be applied to such an operation system. By using a plant control computer as a substitute for the workstation in the above embodiment, and operating the camera video from the plant monitoring terminal as in the above embodiment, the image taken by the monitoring camera is used for monitoring. It can be operated in the same way as graphics.

It is a block diagram which shows the structure of the camera system of the 1st Example of this invention. It is a block diagram which shows the structure of a camera. It is a block diagram of a camera control apparatus. It is explanatory drawing of the command which a calculating part outputs. It is explanatory drawing of an angle of view. It is a figure which shows the example of a display in 1st Example of this invention. It is a figure which shows the left page turning operation in a 1st Example. It is a figure which shows the upper page turning operation in a 1st Example. It is a figure which shows the determination method of the imaging | photography direction in 1st Example of this invention. It is a flowchart which shows the process of the horizontal page turning in a 1st Example. It is a flowchart which shows the process of the vertical page turning in a 1st Example. It is a figure which shows the left scroll operation in a 1st Example. It is a figure which shows the left jump operation in a 1st Example. It is a figure which shows expansion operation in a 1st Example. It is a figure which shows reduction operation in a 1st Example. It is explanatory drawing of the movable amount of a horizontal scroll icon. It is a flowchart which shows the process of the horizontal scroll in a 1st Example. It is a flowchart which shows the process of the vertical scroll in a 1st Example. It is a flowchart which shows the process of the horizontal jump in a 1st Example. It is a flowchart which shows the process of the vertical jump in a 1st Example. It is a flowchart which shows the process of the expansion / contraction in a 1st Example. It is a figure which shows the determination method of the position and length of a scroll icon. It is a block diagram of the camera system which concerns on a 2nd Example. It is a figure which shows the example of a display concerning a 2nd Example. It is a figure which shows the imaging | photography object in a 3rd Example. It is a figure which shows the left jump operation in a 3rd Example. It is a figure which shows the left jump operation in a 3rd Example. It is a flowchart which shows the process of the horizontal jump guide in a 3rd Example. It is a block diagram which shows the structure of the camera system of the 4th Example of this invention. It is a figure which shows the determination method of the imaging position in a 4th Example. It is a figure which shows the display for changing the imaging | photography range in a 4th Example. It is a block diagram which shows the structure of the camera system of the 5th Example of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 101 ... Camera, 102 ... Camera control apparatus, 150 ... Workstation, 107 ... Disk, 108 ... Display, 109 ... Mouse, 510 ... Horizontal scroll bar, 520 ... Vertical scroll bar, 512 ... Horizontal scroll icon, 522 ... Vertical scroll icon 514 ... Left scroll arrow, 516 ... Right scroll arrow, 524 ... Up scroll arrow, 526 ... Down scroll arrow, 550 ... Pointer, 570 ... Enlarge icon, 580 ... Reduce icon

Claims (3)

A camera,
Shooting range changing means for changing the shooting range of the camera;
Means for displaying video captured by the camera;
A page turning request receiving means for receiving a page turning request;
Means for storing overlapping shooting angles when turning pages,
The overlapping shooting angle is determined according to the current angle of view so that the amount of the overlapping portion on the display of the video is the same before and after turning the page,
The photographing range changing means is
When the page turning request accepting unit accepts the page turning request, a change angle of the camera shooting direction obtained by the formula: (current angle of view) − (overlapping shooting angle) is set in the current shooting direction of the camera. The shooting direction is changed by adding or subtracting depending on the page turning direction so that there is an overlap in the shooting range before and after the change in the shooting range next to the current shooting range. Camera system. In claim 1,
Still image data storage means for storing, as still image data, an image of a range that can be captured by the camera, which is previously captured by the camera;
Still image data reading means for reading still image data in the periphery of the current shooting range of the camera from among the still image data stored in the still image data storage means,
Display means for combining and displaying still image data read out by the still image data reading means and video data obtained from the camera;
Jump guide means for accepting designation of the shooting range,
When the above jump guide means accepts the specification of the shooting range, until the specification of the shooting range is confirmed,
The reading means reads still image data corresponding to the designated range and its surroundings,
The camera system according to claim 1, wherein the display unit displays the still image data read by the reading unit. In claim 2 ,
When the above jump guide means accepts specification of the shooting range and the shooting range is confirmed,
The shooting range changing means changes the shooting range of the camera so that a fixed shooting range is shot,
The reading means reads still image data corresponding to the periphery of the determined shooting range,
The camera system characterized in that the display means combines and displays still image data read by the still image data reading means and video data obtained from the camera.

Images