JPH10290412A - Image pickup, storage, processing, display, reproduction transmitter and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a panorama image without a sense of incongruity against a change in an image pickup condition. SOLUTION: A video signal from an image pickup device 10 as an image pickup means is fed to a video capture board 31 of a computer 30. A magnification lens of a lens block section 11 is driven by a drive instruction from a camera controller 41. The image pickup device 10 is installed on a universal head 50, and driven in each direction by a drive instruction from a pan/tilt controller 43. A mode controller 42 controls the image pickup device 10 and the universal head 50 with respect to an absolute position drive request from the computer 30. The computer 30 is provided with a storage device 32, an image processing unit 33 and a controller 34, video signal processing and the control to generate a panorama image is conducted by the devices above and in the case of storing the video signal to the storage device 32, various image pickup conditions such as image pickup time, exposure and white balance are added and stored.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup, storage, processing, display, reproduction, transmission apparatus and recording medium suitable for use in remote viewing using, for example, a computer network. It is.

[0002]

2. Description of the Related Art For the purpose of observing, monitoring, and guiding events, it has been considered to view images from remote locations using, for example, a computer network (Internet). When viewing from such a remote location, a so-called panoramic image with a wide angle of view in the horizontal direction is suitable for viewing.

[0003] As a method for obtaining such a panoramic image, for example, a method using a wide-angle lens is known. However, a wide-angle lens is generally expensive, and a normal wide-angle lens is not used. Since the angle of view in the vertical direction is also widened, the number of scanning lines in the range of the panoramic image may be reduced and the resolution may be reduced.

On the other hand, a method has been implemented in which a panoramic image is captured in advance and stored in a storage device such as a hard disk, and a newly captured image is inserted into the image and synthesized to form a panoramic image. I have. However, in this method, only a pseudo panoramic image is formed, and a sense of incongruity is generated between the new image fitted and combined and the stored image with respect to changes in the imaging time, imaging conditions, and the like. And so on.

[0005]

SUMMARY OF THE INVENTION The present invention has been made in view of the above points, and the problem to be solved is that even if an expensive wide-angle lens is used in a conventional apparatus, it is difficult to solve the problem. There is a risk that the resolution will be reduced, and in the method of forming a panoramic image by embedding and combining with the stored image,
For example, there is a problem that the user feels uncomfortable with changes in the imaging time and imaging conditions.

[0006]

Therefore, in the present invention, an image pickup range of the image pickup means is changed, and a video signal from such an image pickup means is synthesized to form a video signal having a wide angle of view. In this case, the imaging time and / or imaging conditions are stored, and according to this, a panoramic image that does not cause a sense of incongruity with changes in the imaging time, imaging conditions, and the like with a simple configuration. Can be obtained with high resolution.

Further, in the present invention, the video signal of another partial area is corrected in accordance with the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. According to this, even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS That is, the present invention provides imaging means for imaging a subject to generate a video signal, control means for controlling the operation of the imaging means, storage means for storing the captured video signal, And a processing unit for linking the stored video signals to form a video signal having an angle of view wider than one imaging range of the imaging unit, and an imaging time and / or an imaging condition when imaging is performed by the imaging unit. Is stored in the storage means together with the video signal.

According to the present invention, there is provided an image pickup means for picking up an image of a subject to generate a video signal, a control means for controlling the operation of the image pickup means, a storage means for storing the picked-up video signal, Processing means for concatenating the video signals to form a video signal having an angle of view wider than one imaging range of the imaging means, wherein the imaging time and / or the imaging conditions when the imaging means performs imaging together with the video signals It is something to memorize.

The present invention also provides imaging means for imaging a subject to generate a video signal, control means for controlling the operation of the imaging means, imaging time and time when imaging is performed by the imaging means together with the captured video signal. And / or storage means for storing imaging conditions, and connecting the imaged and stored video signals to form a video signal having an angle of view wider than one imaging range of the imaging means.

According to the present invention, there is provided an image pickup means for picking up an image of a subject and generating a video signal, a control means for controlling the operation of the image pickup means, a storage means for storing the picked-up video signal, A processing unit for connecting the video signals to form a video signal having an angle of view wider than one imaging range of the imaging unit; and a display unit for displaying the formed video signal. Storing the imaging time and / or the imaging conditions of the imaging device together with the video signal in the storage means, and connecting the video signal imaged by the imaging means to a partial area of the video signal specified on the display means to form a video signal It is.

The present invention also relates to a reproducing means for reproducing a recording medium in which the operation of the imaging means is controlled and the imaging time and / or the imaging conditions at which the imaging was performed by the imaging means together with the image signal captured by the imaging means. A video signal having an angle of view wider than one imaging range of the imaging means by connecting the video signals reproduced by the reproduction means.

According to the present invention, there is further provided an image pickup means for picking up an image of a subject to generate a video signal, a control means for controlling the operation of the image pickup means, an image pickup time and a time when the image pickup means picks up an image together with the picked up video signal. Storage means for storing imaging conditions; processing means for connecting the imaged and stored video signals to form a video signal having an angle of view wider than one imaging range of the imaging means; and And transmission means for transmitting the video signal.

According to the present invention, there is provided an image pickup means for picking up an image of a subject and generating a video signal, a control means for controlling the operation of the image pickup means, and connecting one of the image pickup means to the image pick-up means. An imaging time and / or imaging when imaging is performed by an imaging unit together with a video signal captured by an imaging unit using a processing unit that forms a video signal having an angle of view wider than a range and an imaging unit that generates a video signal. The conditions are recorded.

Further, according to the present invention, the imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connect video signals close in imaging time and / or imaging conditions. Thus, a video signal having an angle of view wider than one imaging range of the imaging means is formed.

Further, according to the present invention, the image pickup conditions include one or more of information of exposure, white balance, focus, magnification, size, and position coordinates. In forming a video signal having an angle of view wider than one of the imaging ranges, the video signal is corrected according to the imaging conditions.

Further, according to the present invention, the imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and are instructed on a display means for displaying the formed video signal. A video signal is formed by connecting the video signal captured by the imaging means to the partial region of the video signal thus obtained.

Further, according to the present invention, the imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and the image pickup means is connected to the imaged and stored video signals. When forming a video signal having a wider angle of view than one imaging range, the video signal of the other partial area is formed according to the imaging condition of the video signal of the partial area specified on the display means for displaying the video signal formed. It is to be corrected.

[0019]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of an example of an apparatus to which the present invention is applied.

In FIG. 1, an image pickup apparatus 10 as an image pickup means is a video camera as a whole, and image pickup light arriving from a subject (not shown) is transmitted to a lens block section 11.
Solid-state imaging device, such as CCD
12 is imaged. After the CCD 12 converts an arbitrary visual field image into a video signal, it is supplied to a signal separation (sample and hold: SH) / automatic gain control (AGC) device 13.

In the signal separation / automatic gain control device 13, C
The video output signal from the CD 12 is sampled and held in accordance with, for example, a predetermined pixel clock, and automatic gain control is performed so as to have a predetermined gain by, for example, a control signal of an auto iris (AE). The video output signal thus obtained is supplied to the signal processing device 15 via the A / D conversion device 14.

In the signal processing device 15, the input signal is converted into various signals such as luminance, chrominance, and video signals, and is converted into a video signal by a video monitor of a television monitor 20 or a computer device 30 to be described later such as a personal computer. It is supplied to the board 31. As a result, the video signals supplied to the video capture board 31 are sequentially taken into the computer device 30.

The lens block 1 of the image pickup device 10
Reference numeral 1 denotes a zoom lens that can change the angle of view for imaging by driving a zoom lens. In response to a driving command from a camera controller 41 described later, a motor, for example, the zoom stepping motor 1
6 is rotated to drive the above-described lens for zooming.

The camera controller 41 controls the imaging device 10
Lens control (focus, zoom), exposure control (aperture, gain, electronic shutter speed), white balance control, image quality control, etc., are always performed, and an interface with the mode controller 42 is performed. For example, in response to a zoom drive request, a control signal for driving the variable power lens to the required position is output to a drive circuit (not shown) of the motor 16, and the position information of the variable power lens is always in the mode. It is communicated to the controller 42.

Further, the imaging device 10 is installed on a device having two degrees of freedom in the rotation direction such as pan (left and right) and tilt (up and down), for example, a rotary pan head 50 as a driving means. And a pan tilter controller 4 to be described later.
3, motors such as a pan stepping motor 51 and a tilt stepping motor 5
2 is rotated so that the rotary head 50 is driven in each direction.

The pan / tilt controller 43 interfaces with the mode controller 42. For example, in response to a drive request in each of the pan and tilt directions, a control signal for driving the rotary head 50 in the requested direction is output to a drive circuit (not shown) for the motors 51 and 52 and the rotation is performed. For example, positional information of the camera platform 50 in each of the pan and tilt directions is constantly communicated to the mode controller 42.

Further, the mode controller 42 controls the entire system in accordance with the internal states of the image pickup device 10 and the rotating platform 50 and interface information from outside the device. The mode controller 42 is, for example, RS
232C is connected to the computer device 30, and controls the absolute position drive request from the computer device 30.

That is, in response to the absolute position drive request from the computer device 30, the mode controller 42 controls the motor 16 of the lens block 11 and the motors 51, 5
The drive command for driving the camera 2 is distributed to the camera controller 41 and the pan / tilt controller 43.

At the same time, various photographing conditions such as position information, lens control information, exposure control information, white balance control information, and image quality control information from these controllers 41 and 43 are transmitted to the computer device 30 through the mode controller 42. You.

Further, the computer device 30 is provided with a storage device 32, an image processing device 33, and a control device 34.
Is used, for example, as a video signal processing unit for forming a panoramic image and as a control unit. The video signal generated by the computer device 30 is transmitted to the computer monitor 6.
0 is provided as a user interface, and the conditions of internal processing and the like are determined using an image graphically displayed on the screen.

Further, the above-mentioned video capture board 3
In 1, the captured video signal is displayed on the monitor 60 at an arbitrary quality, and an arbitrary image format (for example, a bitmap format, JP
Still images, moving images, etc. in the EG format) can be captured at an arbitrary quality and stored in the storage device 32 such as a hard disk.

At this time, the image capturing time at which the video signal was captured and the various shooting conditions provided by the mode controller 42 are stored in the storage device 32 together with the captured video signal.

Further, a control algorithm executed by the computer 30 will be described with reference to FIG.

When the program is started in FIG. 2, a process for setting each display area of the captured video and the panoramic image on the monitor 60 is first performed in step [1]. As a result, a display area 61 for a captured video and a display area 62 for a panoramic image are set on the monitor 60, as shown in FIG. 1, for example. Then, a video signal input from, for example, the imaging device 10 is displayed in the display area 61 within the display area 61.

In step [2], a timer for periodically communicating with the mode controller 42 is set. When these initial settings are completed, in step [3], a transition is made to a standby state for various kinds of generated events. The events to be generated are the timer event set in the above step [2] (details will be described later) and a panorama image creation request event described later.

Here, the details of the timer event will be described with reference to FIG. The timer event is an event generated for performing periodic communication with the mode controller 42, for example.

When this event occurs, it is determined in step [11] whether or not the communication port setting has been completed. Since the communication port setting has not been completed only for the first time, the communication port is set in step [12]. Is established. In the device described above, for example, an RS232C port on the computer device 30 is opened as a communication port.

In the second and subsequent timer events, the presence or absence of received data is determined in step [13].
If there is received data, the received data is analyzed in step [14]. That is, in this step [14], for example, by communication with the mode controller 42,
The position information of the zoom lens of the lens block unit 11 and the position information of the pan head 50 in the pan and tilt directions are acquired. Then, zoom magnification information and pan / tilt angle information are extracted from these pieces of information.

Next, in step [15], the presence or absence of a data transfer request (Flag so) is confirmed. When there is a transfer request (True), since the data has already been stored in the transmission buffer, the transfer process is immediately performed using the data in this transmission buffer in step [16], and there is no transfer request ( Flag so = Fa
1se).

If there is no transfer request (False) in step [15], steps [17] and [18]
At [19], the value of the internal counter (req cnt) is determined. Here, if (req cnt = 0), the process proceeds from step [17] to step [20] to transfer the communication data of the absolute position drive request for driving the motors 51 and 52 of the rotary head 50. Is performed.

If (req cnt = 1), the process proceeds from step [18] to step [21] to transfer the absolute position drive request communication data for driving the motor 16 of the lens block unit 11. Is performed. When (req cnt = 2), the process proceeds from step [19] to step [22], and a panorama image creation process described later is performed.

After steps [20] and [21] are executed, a process of counting up (req cnt) is performed in step [23]. Step [2
After [2] is executed, (req) is executed in step [24].
cnt) is returned to 0. As a result, the processes of steps [20], [21], and [22] are executed cyclically for each event.

The above-described panoramic image creation processing is performed as described below. That is, the panorama image creation processing is performed, for example, in step [30] shown in FIG.
, The panorama creation request (Flag pa) is set, so that this process is executed in step [22] of the above timer event.

Here, details of the panorama image creation processing will be described with reference to FIG. In this example, the processing procedure is performed according to an internal counter (Pano cnt).

Therefore, first, in steps [31] and [32], the value of the internal counter (Pano cnt) is determined. Here, when (Pano cnt = 1), step [3
1] to step [33], where the imaging device 10
Lens block 11 so that the angle of view of
Is performed while the motor 16 is driven, and (Pa)
No cnt) is counted up.
By setting the angle of view to the widest angle, a panoramic image is formed with a smaller number of image acquisitions.

When (Pano cnt = 2), the process proceeds from step [32] to step [34], and the image pickup range of the image pickup apparatus 10 is set to the position where image acquisition is first performed in the panorama image creation processing. The process of driving the motors 51 and 52 of the rotary head 50 is performed so as to set, and the process of counting up (Pano cnt) is performed.

Further, when (Pano cnt) is 3 or more, the above steps [3] and [36] are performed in steps [35] and [36].
3] It is confirmed that the zoom position and the imaging range set in [34] have been moved. When these set positions are reached, the first image acquisition is performed in step [37]. Further, in step [38], a process of driving the motors 51 and 52 of the rotary head 50 to the next image acquisition position is performed.

In step [39], the previously acquired image is compressed in the horizontal and vertical directions, and the like, and in step [40], the state of creation of the panoramic image is displayed in the display area 62 of the monitor 60. . Further, in step [41], (P
ancnt) is counted up,
In step [42], it is determined whether or not the panoramic image has been completed. If not, the above operation is repeated.

When the panorama image is completed in step [42], there is no panorama creation request (Flag pa) in step [43] (Flag pa = Fals).
In step e), the panoramic image completed in step [44] is saved, and the operation is terminated.

In this way, for example, the images obtained while the imaging range of the imaging device 10 is sequentially moved by the rotary camera platform 50 are connected while being compressed, and a panoramic image is formed. Here, the rotary head 50 is operated so as to always enter the commanded target position from the same direction. As a result, it is possible to correct a shift of the connected image due to a play in the mechanism of the drive system (gear backlash or the like) that may occur when the images are connected.

In this apparatus, the original video signals connected in the formation of the above-mentioned panoramic image are not uniform because the imaging conditions are not constant. Panoramic images cannot be obtained. Therefore, in the above-described apparatus, image processing is performed in the image processing device 33 of the computer device 30 to obtain a panoramic image of uniform image quality.

FIG. 6 shows an example of image processing for that purpose. In FIG. 6, each imaging signal for forming a panoramic image is accompanied by its imaging time and imaging conditions such as position information lens control information, exposure control information, white balance control information, and image quality control information, and is stored. ing.

Therefore, for example, average luminance information is extracted from each connected video signal as shown in FIG. 6A, weighted according to each imaging condition, and compared with a preset reference luminance. To determine the correction amount of each pixel (see FIG.
B). By performing this correction, the overall exposure of the panoramic image is made uniform.

Then, for example, the integration of red (R) green (G) blue (B) of a pixel having a certain level of brightness or more is calculated, the amount of deviation from white is calculated, and the white balance for each pixel is calculated. Is adjusted (C in FIG. 6). Thereby, for example, a panoramic image having a uniform image quality as shown in FIG. 6D can be obtained.

Therefore, in this device, the image pickup range of the image pickup means is changed, and the image signals from such image pickup means are combined to form a video signal having a wide angle of view.
By storing the imaging time and / or imaging conditions at that time, a panoramic image with a simple configuration that does not cause a sense of incongruity with changes in the imaging time and imaging conditions can be obtained with high resolution.

As a result, in the conventional apparatus, even if an expensive wide-angle lens is used, there is a risk that the resolution may be reduced. According to the present invention, these problems can be solved, for example, when there is a problem that the user feels uncomfortable with a change in imaging conditions.

Further, in the apparatus described above, the created panoramic image is displayed in the panoramic image display area 62 of the computer monitor 60 described above. In this case, on the monitor 60, for example, operation buttons 63 as shown in FIG. 7 are displayed together with the display areas 61 and 62 described above.

And such a computer monitor 60
In the above, when the user designates an arbitrary pixel in the display area 62 by input means such as a pointing device (mouse), for example, the coordinates of the designated pixel with the origin at the upper left corner of the display area 62 are acquired and acquired. The coordinates of the designated pointing point are transferred to the computer device 30.

Therefore, the computer device 30 determines an imaging area including the pixel of the designated point from the transferred coordinates, and the coordinates of the imaging area and the movement command are transmitted to the mode controller 42.
Sent to. As a result, the mode controller 42 analyzes the data received in step [14] of the timer event described above, drives the rotary head 50 according to the analyzed data, and captures an image of the target including the designated pixel. Control is performed so as to capture an image of the area.

That is, while confirming the panoramic image on the computer monitor 60, for example, the user uses the input device such as a pointing device (mouse) to specify a place to be observed in detail. With this instruction, the imaging device 10 is turned in the direction instructed by the rotating camera platform 50, and the current video at that location is displayed in the captured video display area 61.

While observing the image displayed in the display area 61 of the captured image, the user presses the recording start button of the operation button 63 on the monitor 60 with a pointing device (mouse) or the like when the image to be recorded is obtained. By pressing the button, necessary images are stored in a storage device 3 such as a hard disk.
2 can be stored (saved).

The stored video may be a still image at the moment when the user presses the recording start button, or a video of a desired length may be stored by operating an arbitrary operation button 63. Can also. Alternatively, if there is not enough space in the storage device 32, an intermittent moving image using a still image may be stored. When the still image, the moving image, and the intermittent moving image are stored (saved), the above-described data of the image capturing time and the image capturing condition is additionally stored.

Therefore, a panoramic image is created using the video stored (saved) in this manner as follows.

That is, when the user designates an arbitrary pixel in the display area 62 by input means such as a pointing device (mouse) on the display of the computer monitor 60 as shown in FIG.
The coordinates of the designated pixel are acquired with the upper left corner of 2 as the origin, and the acquired coordinates of the designated point are transferred to the computer device 30.

Then, the computer device 30 determines an imaging region including the pixel of the designated point from the transferred coordinates, and when a partial image including the imaging region is stored,
The area is displayed on the panoramic image by, for example, enclosing the area with a colored boundary line, and the image stored therein is displayed. As a result, a stored image of a desired area can be viewed on the panoramic image.

In this case, since the image is displayed in a compressed form on the panoramic image, the image can be enlarged and displayed outside the display area 62 for detailed viewing. In that case, for example, the captured image can be displayed on the display area 61 or can be enlarged and complemented and displayed on the entire screen of the monitor 60.

When a plurality of images are stored in the same designated area, a desired image can be retrieved by operating the operation buttons 63 on the monitor 60, for example. In this case, the image search can be performed by designating the imaging time, the imaging condition, and the like stored together with the video signal.

Further, when the stored image is viewed on the above-mentioned panoramic image, if the image of the designated area is simply displayed so as to be superimposed on the panoramic image, the image becomes unnatural if the photographing conditions are different. I will. Therefore, in such a case, by performing the same processing as shown in FIG. 6 described above,
A panoramic image with uniform image quality can be obtained.

Therefore, in this apparatus, by correcting the video signal of another partial area according to the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal, only a part of the panoramic image is corrected. Is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

As a result, in the conventional apparatus, even if an expensive wide-angle lens is used, the resolution may be reduced. For example, a panorama image is formed by fitting and synthesizing the video signal of the specified partial area. According to the present invention, the present invention can solve such a problem that there is a problem such as a sense of incongruity with a change in the imaging time or the imaging condition.

In the above-described apparatus, the panorama creation request (Flag) in step [30] of FIG.
The setting of pa) can be performed, for example, by a user operating a button shown on the monitor 60 or a so-called remote control. However, setting by specifying a photographing time, image recognition (processing), various sensors, etc. The setting can be automatically performed by the detection or the like.

That is, for example, when the setting is performed by designating the photographing time, for example, the computer 30 shown in FIG.
The panoramic image capturing time is set by an input device 35 such as a keyboard attached to the camera or a pointing device such as a mouse, and the time is stored in the storage device 32.

For example, in the event determination step [3] of FIG. 2, a clock (not shown) built in the computer device 30 is compared with a stored set time. A creation request is instructed, and shooting is performed. In addition, you can set multiple times,
Also, continuous shooting can be automatically performed by designating a certain time interval.

Alternatively, video information obtained from the imaging device 10 may be compared between the present and the past, and the difference may be detected to automatically issue a panorama image creation request. The video information obtained here includes luminance, color difference, contour, color balance, and the like of the image.

For example, in the method using the luminance information, the luminance average of the part of the image currently projected from the imaging device 10 is calculated by comparing the luminance average of a part of the panoramic image captured and stored in the storage device 32 with the luminance average. Be compared. When the difference is greater than a certain value, a request for creating a panoramic image is issued, and shooting is performed. The created panoramic image is immediately displayed on the monitor 60 or the like.

In this method, when the surrounding brightness changes with the lapse of time in photographing a landscape or the like, the panoramic image is automatically photographed and updated.
This makes it possible to always provide a panoramic image close to the video imaged by the current imaging device 10.

Further, as shown in FIG. 8, for example, a representative point is designated for a subject imaged by the image pickup device 10,
A model is created by combining the luminance and color difference information, and is stored in the storage device 32 together with the position information. Then, the same range is always imaged by the imaging device 10, and when a difference occurs in the position coordinates of the subject model, a panorama image creation request is instructed and shooting can be performed.

That is, in FIG. 8A, when the position coordinates (X0, Y0) of the original subject model become the position coordinates (X1, Y1) as shown in FIG. 8B, X0 ≠ X1
Alternatively, by judging Y0 ≠ Y1, it is recognized that the subject has moved as shown in FIG. 8C, and a request to create a panoramic image can be issued to start shooting. With this method, the above-described device can be used as a dynamic monitoring system.

In addition, it is also possible to provide a means for obtaining audio information such as a microphone, and to start photographing by instructing a request to create a panoramic image in accordance with the detection of audio. In this case, as shown in FIG. 9, for example, a plurality of directional microphones are installed in a range where the imaging device 10 can be moved by a driving means such as the rotary camera platform 50 and imaged. The voice information collected by these directional microphones is input to the computer device 30 of FIG.

When the computer device 30 detects specific voice information from the voice information collected by the microphone, it issues a panorama image creation request and changes the directivity of the microphone that has detected the voice information. The panoramic image can be updated by storing the direction and, if necessary, photographing from that direction.

In this manner, the change of the subject can be recognized by detecting the specific audio information, and a panorama image creation request can be instructed to start photographing. Further, in this method, similarly, various sensors such as an optical sensor and a pyroelectric sensor can be used to perform detection as needed and update a panoramic image.

Further, by providing the storage device 32 as a recording means in the above-described device of FIG. 1, this device can be implemented as a recording device. In this case, in the storage device 32, the image capturing time and the image capturing condition at the time of the image capturing are recorded together with the video signal from the image capturing device 10.

Therefore, in this apparatus, the imaging range of the imaging means is changed, and the video signal from such imaging means, and the imaging time and imaging conditions at the time of the imaging are recorded. A panoramic image that does not cause a sense of incongruity with changes in time, imaging conditions, and the like can be recorded with high resolution.

Further, the apparatus shown in FIG. 1 is provided with an image processing device 33 as a processing means for a video signal, so that this device can be implemented as a processing device. In this case, in the image processing device 33, the imaging device 1
A video signal from 0 is concatenated to form a panoramic image, and the concatenated video signal is corrected for changes in imaging time, imaging conditions, and the like.

Therefore, in this apparatus, the imaging range of the imaging means is changed, and the video signal from such imaging means, and the imaging time and imaging conditions at the time of the imaging are recorded, so that the imaging can be performed with a simple configuration. It is possible to form a panoramic image with a high resolution without causing a sense of incongruity with changes in time, imaging conditions, and the like.

Further, by providing the computer monitor 60 as a display means in the apparatus shown in FIG. 1, this apparatus can be implemented as a display apparatus.

Therefore, in this device, the image pickup range of the image pickup means is changed, and the image signals from such an image pickup means are synthesized to form a video signal having a wide angle of view.
By displaying this video signal on the display means, it is possible to view a high-resolution panoramic image with a simple configuration that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like. .

Further, by providing the storage device 32 as a reproducing means in the above-described device of FIG. 1, this device can be implemented as a reproducing device. In this case, in the storage device 32, the video signal from the imaging device 10, and the imaging time and imaging conditions at the time of the imaging are recorded and reproduced.

Therefore, in this apparatus, the video signal whose imaging range is sequentially changed, the imaging time and the imaging conditions at the time of the imaging are reproduced, and the reproduced video signal is synthesized to form a video signal having a wide angle of view. With a simple configuration,
A panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like can be reproduced with high resolution.

Further, in the apparatus shown in FIG. 1 described above, by transmitting a signal sent from the computer apparatus 30 to the computer monitor 60 through a modem (not shown) to a computer network such as the Internet, for example, It can be implemented as a transmission device.

In other words, in such a computer network, the configuration of the imaging device 10 to the computer device 30 to the rotary head 50 installed at a remote location is different from that of a user having an arbitrary computer device, a display device, and a modem. Access from the device through the network. Thereby, the captured image at that time and the panoramic image stored in, for example, the storage device 32 of the computer device 30 can be obtained on the display device on the user side, for example, with the same screen configuration as the monitor 60 in FIG.

Therefore, in this device, by synthesizing the video signals picked up by the image pickup means installed at a remote place to form a video signal having a wide angle of view, it is possible to change the weather, time, etc. with a simple configuration. It is possible to view a high-resolution panoramic image that does not cause discomfort to the user.

Further, in the above-described apparatus shown in FIG. 1, the recording medium of the storage device 32 is made detachable, and the recording medium is taken out, whereby this apparatus can be implemented as a recording medium.

Accordingly, in this apparatus, the recording medium is reproduced by changing the imaging range of the imaging means and recording the video signal from such imaging means, the imaging time and the imaging conditions at the time of the imaging. By linking, it is possible to obtain a high-resolution panoramic image with a simple configuration that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

In these apparatuses, a part of the panoramic image is corrected by correcting the video signal of another partial area according to the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only the value is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

Further, in the above-described apparatus, when information such as an imaging time and / or an imaging condition at the time of imaging is stored together with an imaged video signal, for example, as shown in FIG. Add this information to the beginning of the format and save it. Alternatively, as shown in B of FIG. 7, a method of collectively storing only information such as imaging time and / or imaging conditions separately from each video file and associating each information with each video file can be used.

In the above-described apparatus, for example, one of the image pickup apparatuses 10 is used to change the image pickup range by the rotating camera platform 50 to pick up a panoramic image. However, this is limited to such means. Not something. That is, as a means for capturing such a panoramic image, for example, a panoramic image is created based on a series of videos captured using a digital still image camera or a moving image captured by a video camera. be able to.

Instead of using the rotary camera platform 50, for example, a plurality of imaging devices may be arranged in each direction for forming a panoramic image, and video signals from these imaging devices may be sequentially switched to serve as driving means. , And a similar video signal can be obtained.

Further, in the above-described apparatus, it is possible to quickly and easily search for a video signal captured using information such as the stored imaging time and imaging conditions. Thus, for example, even when a desired image is searched by operating the operation button 63 on the monitor 60, the search can be performed extremely smoothly.

[0100]

According to the first aspect of the present invention, the imaging range of the imaging means is changed, and the video signals from such imaging means are synthesized to form a video signal having a wide angle of view. By storing the imaging time and / or imaging conditions, a panoramic image with a simple configuration that does not cause a sense of incongruity with changes in the imaging time and imaging conditions can be obtained with high resolution. Was.

As a result, in the conventional apparatus, even if an expensive wide-angle lens is used, there is a risk that the resolution may be reduced. According to the present invention, these problems can be solved, for example, when there is a problem that a sense of incongruity is caused by a change in the imaging condition.

According to the second to fifth aspects of the present invention, the video signal of another partial area is corrected according to the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

According to the sixth aspect of the present invention, the imaging range of the imaging means is changed, and the video signal from such imaging means, and the imaging time and imaging conditions at the time of the imaging are recorded. With this configuration, a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like can be recorded with high resolution.

According to the seventh to tenth aspects of the present invention, the video signal of another partial area is corrected according to the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

According to the eleventh aspect of the present invention, the imaging range of the imaging means is changed, and the video signal from such imaging means, and the imaging time and imaging conditions at the time of the imaging are recorded, so that a simple operation can be achieved. With this configuration, it is possible to form a panoramic image with a high resolution without causing a sense of incongruity with changes in imaging time, imaging conditions, and the like.

According to the twelfth to fifteenth aspects of the present invention, the video signal of another partial area is corrected in accordance with the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

According to the sixteenth aspect of the present invention, the imaging range of the imaging means is changed, and the video signals from such imaging means are combined to form a video signal having a wide angle of view. By displaying on the display means,
With a simple configuration, a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like can be viewed with high resolution.

According to the seventeenth to twentieth aspects of the present invention, the video signal of another partial area is corrected in accordance with the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

According to the twenty-first aspect, a video signal having a wide angle of view is reproduced by reproducing a video signal whose imaging range is sequentially changed, an imaging time and imaging conditions at the time of the imaging, and synthesizing the reproduced video signal. By forming a signal, it is possible to reproduce a panoramic image with a simple configuration that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like, with high resolution.

According to the twenty-second to twenty-fifth aspects of the present invention, the video signal of another partial area is corrected in accordance with the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

According to the twenty-sixth aspect of the present invention, a video signal having a wide angle of view is formed by synthesizing video signals picked up by the image pickup means installed at a remote place, thereby providing a simple configuration for weather and weather conditions. It is possible to view a high-resolution panoramic image that does not cause a feeling of strangeness due to a change in time or the like.

According to the twenty-seventh to thirty-seventh aspects of the present invention, the video signal of another partial area is corrected according to the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

According to the thirty-first aspect of the present invention, by changing the imaging range of the imaging means and recording the video signal from such imaging means and the imaging time and imaging conditions at the time of the imaging, this recording is achieved. By reproducing and linking the media, a panoramic image with a simple configuration that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like can be obtained with high resolution.

According to the inventions of claims 32 to 35, the video signal of another partial area is corrected in accordance with the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal. Even when only a part of the panoramic image is changed, it is possible to obtain a panoramic image that does not cause a sense of incongruity with changes in imaging time, imaging conditions, and the like.

Further, according to the present invention, it is possible to quickly and easily search for a video signal captured using information such as stored imaging time and imaging conditions.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an entire system as an example of an imaging and display device to which the present invention is applied.

FIG. 2 is a flowchart for explaining the operation.

FIG. 3 is a flowchart for explaining the operation.

FIG. 4 is a flowchart for explaining the operation.

FIG. 5 is a flowchart for explaining the operation.

FIG. 6 is a diagram for explaining this.

FIG. 7 is a diagram for explaining this.

FIG. 8 is a diagram for explaining this.

FIG. 9 is a diagram for explaining this.

FIG. 10 is a diagram for the explanation.

[Explanation of symbols]

10 imaging device, 11 lens block unit, 12 CC
D, 13 signal separation / automatic gain control device, 14 A / D
Conversion device, 15 signal processing device, 16 stepping motor for zoom, 20 television monitor, 30 computer, 31 video capture board, 32 storage device, 33 image processing device, 34 control device, 35 input device, 41 camera controller, 42 mode Controller, 43 pan / tilt controller, 50 rotating head, 51 stepping motor for pan, 52 stepping motor for tilt, 60 computer monitor, 6
1. Display area for captured video, display area for 62 panoramic images

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Naoyasu Hosunuma 6-7-35 Kita-Shinagawa, Shinagawa-ku, Tokyo Inside Sony Corporation (72) Inventor Ken Tamayama 6-35, Kita-Shinagawa, Shinagawa-ku, Tokyo No. Sony Corporation

Claims (35)

[Claims] An imaging unit configured to image a subject to generate a video signal; a control unit configured to control an operation of the imaging unit; a storage unit configured to store the captured video signal; Processing means for forming a video signal having an angle of view wider than one imaging range of the imaging means by concatenating the video signals, wherein the imaging time and / or the imaging conditions when imaging is performed by the imaging means An image pickup apparatus characterized by storing in the storage means together with a video signal. 2. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connects the video signals having similar imaging times and / or imaging conditions. And forming a video signal having an angle of view wider than one imaging range of said imaging means.
An imaging device according to any one of the preceding claims. 3. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connects the imaged and stored video signals to the imager. 2. The imaging apparatus according to claim 1, wherein when forming a video signal having an angle of view wider than one of the imaging ranges, the video signal is corrected according to the imaging conditions. 4. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. 2. The image pickup apparatus according to claim 1, wherein the image signal is formed by connecting a video signal picked up by the image pickup means to a partial area of the video signal specified on the display means. 5. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. An imaging condition of the video signal of the partial area specified on the display unit when forming the video signal having an angle of view wider than one imaging range of the imaging unit by connecting the captured and stored video signals; 2. The imaging apparatus according to claim 1, wherein the image signal of another partial area is corrected according to the following. 6. An imaging means for imaging a subject to generate a video signal, a control means for controlling an operation of the imaging means, a storage means for storing the imaged video signal, Processing means for forming a video signal having an angle of view wider than one imaging range of the imaging means by concatenating the video signals, wherein the imaging time and / or the imaging conditions when imaging is performed by the imaging means A storage device for storing together with a video signal. 7. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connect the video signals having similar imaging times and / or imaging conditions. 7. A video signal having an angle of view wider than one imaging range of said imaging means.
A storage device as described. 8. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and links the imaged and stored video signals to the imager. 7. The storage device according to claim 6, wherein when forming a video signal having an angle of view wider than one of the imaging ranges, the video signal is corrected according to the imaging conditions. 9. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. 7. The storage device according to claim 6, wherein said video signal is formed by connecting a video signal imaged by said imaging means to a partial area of said video signal specified on said display means. 10. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. An imaging condition of the video signal of the partial area specified on the display unit when forming the video signal having an angle of view wider than one imaging range of the imaging unit by connecting the captured and stored video signals; 7. The storage device according to claim 6, wherein the video signal of another partial area is corrected according to the following. 11. An imaging means for imaging a subject to generate a video signal, a control means for controlling the operation of the imaging means, an imaging time when the imaging means performs imaging together with the imaged video signal, and And / or storage means for storing imaging conditions, wherein the imaging and stored video signals are connected to form a video signal having an angle of view wider than one imaging range of the imaging means. Processing equipment. 12. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connect the video signals having similar imaging times and / or imaging conditions. And forming a video signal having an angle of view wider than one imaging range of said imaging means.
2. The processing apparatus according to claim 1. 13. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and link the imaged and stored video signals to the imager. 12. The processing apparatus according to claim 11, wherein when forming a video signal having an angle of view wider than one of the imaging ranges, the video signal is corrected in accordance with the imaging conditions. 14. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. 12. The processing apparatus according to claim 11, wherein the video signal is formed by connecting a video signal imaged by the imaging means to a partial area of the video signal specified on the display means. 15. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. An imaging condition of the video signal of the partial area specified on the display unit when forming the video signal having an angle of view wider than one imaging range of the imaging unit by connecting the captured and stored video signals; 12. The processing apparatus according to claim 11, wherein the video signal of another partial area is corrected according to the following. 16. An imaging means for imaging a subject to generate a video signal, a control means for controlling an operation of the imaging means, a storage means for storing the captured video signal, Processing means for linking video signals to form a video signal having an angle of view wider than one imaging range of the imaging means; display means for displaying the formed video signals; The imaging time and / or the imaging condition at the time of performing is stored in the storage unit together with the video signal, and the video signal captured by the imaging unit is connected to a partial area of the video signal specified on the display unit. A display device for forming the video signal. 17. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connect the video signals having similar imaging times and / or imaging conditions. And forming a video signal having an angle of view wider than one imaging range of said imaging means.
6. The display device according to 6. 18. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connects the imaged and stored video signals to the imager. 17. The display device according to claim 16, wherein when forming a video signal having an angle of view wider than one of the imaging ranges, the video signal is corrected in accordance with the imaging conditions. 19. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and includes a partial area of the video signal specified on the display means. 17. The display device according to claim 16, wherein the image signals are formed by connecting the image signals picked up by the image pickup means. 20. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connects the imaged and stored video signals to the imager. When forming a video signal having an angle of view wider than one of the imaging ranges, the video signal of another partial area is corrected according to an imaging condition of the video signal of the designated partial area. 17. The display device according to item 16. 21. A reproduction means for reproducing a recording medium on which the operation of the imaging means is controlled and the imaging time and / or the imaging conditions at which the imaging was performed by the imaging means together with the video signal imaged by the imaging means; A reproducing apparatus comprising: connecting a video signal reproduced by a reproducing unit to form a video signal having an angle of view wider than one imaging range of the imaging unit. 22. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connect the video signals having similar imaging times and / or imaging conditions. And forming a video signal having an angle of view wider than one imaging range of said imaging means.
The playback device according to claim 1. 23. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and link the imaged and stored video signals to the imager. 22. The reproducing apparatus according to claim 21, wherein when forming a video signal having an angle of view wider than one of the imaging ranges, the video signal is corrected according to the imaging conditions. 24. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. 22. The reproducing apparatus according to claim 21, wherein the video signal is formed by connecting a video signal imaged by the imaging means to a partial area of the video signal specified on the display means. 25. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. When connecting the imaged and stored image signals to form an image signal having an angle of view wider than one imaging range of the image pickup means, the other portion according to the imaging condition of the image signal of the designated partial area 22. The reproducing apparatus according to claim 21, wherein the video signal in a region is corrected. 26. An image pickup means for picking up an image of a subject to generate a video signal, a control means for controlling the operation of the image pickup means, an image pick-up time when the image pickup means picks up an image together with the picked-up video signal Storage means for storing imaging conditions; processing means for linking the imaged and stored video signals to form a video signal having an angle of view wider than one imaging range of the imaging means; A transmission unit for transmitting the formed video signal. 27. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connect the video signals having similar imaging times and / or imaging conditions. And forming a video signal having an angle of view wider than one imaging range of said imaging means.
7. The transmission device according to 6. 28. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connects the imaged and stored video signals to the imager. 27. The transmission apparatus according to claim 26, wherein when forming a video signal having an angle of view wider than one of the imaging ranges, the video signal is corrected according to the imaging condition. 29. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and has display means for displaying the formed video signal. 27. The transmission device according to claim 26, wherein the video signal is formed by connecting a video signal captured by the imaging unit to a partial area of the video signal specified on the display unit. 30. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, position coordinates, and display means for displaying the formed video signal. An imaging condition of the video signal of the partial area specified on the display unit when forming the video signal having an angle of view wider than one imaging range of the imaging unit by connecting the captured and stored video signals; 27. The transmission apparatus according to claim 26, wherein the video signal of another partial area is corrected according to the following. 31. An imaging means for imaging a subject to generate a video signal, a control means for controlling the operation of the imaging means, and connecting the imaging and the stored video signal to one of the imaging means Using a processing unit that forms a video signal having an angle of view wider than the range and an imaging unit that generates a video signal, an imaging time and / or an imaging time when imaging is performed by the imaging unit together with the video signal captured by the imaging unit Alternatively, a recording medium on which imaging conditions are recorded. 32. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and connect the video signals having similar imaging times and / or imaging conditions. 4. A video signal having an angle of view wider than one imaging range of said imaging means.
2. The recording medium according to 1. 33. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and link the imaged and stored video signals to the imaging means. 32. The recording medium according to claim 31, wherein the video signal is corrected according to the imaging conditions when forming a video signal having a wider angle of view than one of the imaging ranges. 34. The imaging condition includes one or more of exposure, white balance, focus, magnification, size, and position coordinates, and is instructed on display means for displaying the formed video signal. 32. The recording medium according to claim 31, wherein the video signal is formed by connecting the video signal captured by the imaging unit to the partial area of the video signal. 35. The imaging conditions include one or more of exposure, white balance, focus, magnification, size, and position coordinates, and link the imaged and stored video signals to the imaging means. When forming a video signal having an angle of view wider than one of the imaging ranges of the other partial areas according to the imaging condition of the video signal of the partial area specified on the display means for displaying the formed video signal The recording medium according to claim 31, wherein the video signal is corrected.