JP2005348449A - Imaging, displaying, recording, reproducing, transmitting device and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a panorama image free from strange feeling for variation in weather, time, or the like. <P>SOLUTION: A video signal from an imaging apparatus 10 as an imaging means is supplied to the video capture board 31 of a computer 30. A magnification zoom lens at a lens block section 11 is driven with a drive instruction from a camera controller 41. The imaging apparatus 10 is arranged on a rotary universal head 50 and driven in each direction with a drive instruction from a pan/tilter controller 43. A mode controller 42 controls the imaging apparatus 10 and the rotary universal head 50 in response to an absolute position drive request from the computer 30. The computer 30 is provided with a storage 32, an image processor 33 and a controller 34, and video signal processing and control are carried out by them. A video signal formed by the computer 30 is supplied to a computer monitor 60 as user interface. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging, display, recording, reproduction, transmission device, and recording medium suitable for use when monitoring from a remote location using a computer network, for example.

  For the purpose of observing, monitoring, and guiding events, it is considered to view images from a remote location using, for example, a computer network (Internet). When viewing from such a remote place, a so-called panoramic image with a wide angle of view in the horizontal direction is suitable for viewing.

  Therefore, as a method for obtaining such a panoramic image, for example, a method using a wide-angle lens is known, but in general, a wide-angle lens is expensive, and a normal wide-angle lens is perpendicular. Since the angle of view is also widened, there is a possibility that the number of scanning lines in the panoramic image range is reduced and the resolution is lowered.

  On the other hand, a method has been implemented in which a panoramic image is captured in advance and stored in a storage device such as a hard disk, and the newly captured image is inserted and synthesized therein to form a panoramic image. However, with this method, only a pseudo panoramic image is formed, and there is a problem such as a feeling of incongruity between a new image that has been fitted and synthesized and a stored image due to changes in weather and time. there were.

  This application has been made in view of the above points, and the problem to be solved is that the resolution of conventional devices may be reduced even if an expensive wide-angle lens is used. In addition, in the method of forming a panoramic image by fitting and synthesizing with a stored image, there is a problem that, for example, a sense of incongruity occurs with respect to changes in weather and time.

  Therefore, in the present invention, the imaging range of the imaging means is changed, and the video signals from such imaging means are synthesized to form a video signal having a wide angle of view. For example, it is possible to obtain a panoramic image with high resolution with a simple configuration and without causing a sense of incongruity with changes in weather, time, and the like.

  In the present invention, the imaging range of the imaging unit is curved, and the video signal from such an imaging unit is normalized to form a video signal having a wide angle of view. For example, it is possible to obtain a panoramic image with high resolution with a simple configuration and without causing a sense of incongruity with changes in weather, time, and the like.

  Furthermore, in the present invention, imaging necessary for monitoring is performed by imaging with an imaging unit and panoramic image formation at set time intervals or under specific conditions, and is always good. Can be seen.

  According to the first aspect of the present invention, by changing the imaging range of the imaging means and synthesizing the video signals from such imaging means to form a video signal having a wide angle of view, the weather can be achieved with a simple configuration. A panoramic image that does not feel uncomfortable with changes in time and time can be obtained with high resolution.

  As a result, in the conventional apparatus, there is a risk that the resolution may be lowered even if an expensive wide-angle lens is used, and in the method of forming a panoramic image by fitting into a stored image, for example, weather or time According to the present invention, these problems can be solved in the case where there is a problem such as an uncomfortable feeling with respect to the change of the above.

  According to the second aspect of the present invention, the imaging range of the imaging unit is curved, and the video signal from such an imaging unit is normalized to form a video signal having a wide angle of view. It is possible to obtain a panoramic image with high resolution that does not give a sense of incongruity to changes in time and time.

  According to the third to eighth aspects of the present invention, imaging of an event necessary for monitoring is performed by performing imaging with the imaging unit and formation of a panoramic image at set time intervals or under specific conditions. Therefore, it is always possible to perform a good viewing.

  According to the invention of claim 9, the imaging range of the imaging means is changed, and the video signals from such imaging means are synthesized to form a video signal having a wide angle of view, and this video signal is used as the display means. By displaying it, it is possible to view a panoramic image with a high resolution with a simple configuration and without causing a sense of incongruity with changes in weather, time, and the like.

  According to the invention of claim 10, the imaging range of the imaging means is curved, the video signal from such an imaging means is normalized to form a video signal having a wide angle of view, and this video signal is displayed on the display means. By displaying, it is possible to obtain a panoramic image with high resolution with a simple configuration and without causing a sense of incongruity with respect to changes in weather, time, and the like.

  According to the inventions of claims 11 to 16, an image of an event necessary for monitoring is performed by performing imaging with the imaging unit and formation of a panoramic image at a set time or under specific conditions. Therefore, it is always possible to perform a good viewing.

  According to the seventeenth aspect of the present invention, the image pickup range of the image pickup means is changed, and the video signal from such an image pickup means is recorded directly or sequentially, or the panoramic image synthesized by the video signal processing means is recorded. With this configuration, it is possible to record a panoramic image with high resolution that does not cause a sense of incongruity with changes in weather, time, and the like.

  According to the invention of claim 18, by curving the imaging range of the imaging means and recording the video signal from such an imaging means directly sequentially or by recording the panoramic image normalized by the video signal processing means, With a simple configuration, it is possible to record a panoramic image with high resolution that does not cause a sense of incongruity with changes in weather, time, or the like.

  According to the nineteenth to twenty-second aspects of the present invention, an image of an event necessary for monitoring is performed by performing imaging with the imaging unit and formation of a panoramic image at set time intervals or under specific conditions. As a result, good recording can always be performed.

  According to the invention of claim 23, by reproducing a video signal whose imaging range has been sequentially changed and synthesizing the reproduced video signal to form a video signal having a wide angle of view, the weather and A panoramic image that does not cause a sense of incongruity with changes in time or the like can be reproduced with high resolution.

  According to the invention of claim 24, by reproducing the curved video signal of the imaging range of the imaging means and normalizing the reproduced video signal to form a video signal having a wide angle of view, with a simple configuration, A panoramic image that does not give a sense of incongruity to changes in weather, time, etc. can be reproduced with high resolution.

  According to the invention of claim 25, by forming a video signal having a wide angle of view by synthesizing the video signals picked up by the image pickup means installed at a remote place, the weather, time, etc. can be obtained with a simple configuration. A panoramic image that does not cause a sense of incongruity with changes can be viewed with high resolution.

  According to the invention of claim 26, by normalizing the curved video signal in the imaging range imaged by the imaging means installed at a remote place to form a video signal having a wide angle of view, with a simple configuration. A panoramic image that does not cause a sense of incongruity with changes in weather, time, etc. can be viewed with high resolution.

  According to the twenty-seventh to thirty-second aspects of the present invention, the imaging of the event necessary for monitoring is performed by imaging by the imaging means and formation of a panoramic image at set time intervals or under specific conditions. Therefore, it is always possible to perform a good viewing.

  According to the invention of claim 33, it is easy to change the imaging range of the imaging means and directly record the video signals from such imaging means or record the panoramic image synthesized by the video signal processing means. With this configuration, it is possible to obtain a recording medium on which a panoramic image that does not cause a sense of incongruity with changes in weather, time, etc. is recorded with high resolution.

  According to the invention of claim 34, by curving the imaging range of the imaging means and recording video signals from such imaging means directly sequentially or by recording a panoramic image normalized by the video signal processing means, With a simple configuration, it is possible to obtain a recording medium in which a panoramic image that does not cause a sense of incongruity with changes in weather, time, or the like is recorded with high resolution.

  According to the inventions of claims 35 to 38, an image of an event necessary for monitoring is performed by performing imaging by the imaging means and formation of a panoramic image at a set time or under specific conditions. Thus, a good recording medium can always be obtained.

  That is, the present invention provides an image pickup means for generating a video signal, a drive means for changing the image pickup range of the image pickup means, and a video signal supplied with a video signal from the image pickup means and having a wider angle of view than one image pickup range of the image pickup means. And a control means for controlling the imaging by the imaging means, the driving by the driving means, and the processing by the video signal processing means.

  Alternatively, according to the present invention, an imaging unit that generates a video signal, an optical unit that curves the imaging range of the imaging unit to perform imaging with a wider angle of view than the original imaging range of the imaging unit, and the video signal from the imaging unit The video signal processing means for normalizing the supplied and distorted video signal to form a video signal having a wider angle of view than the original imaging range of the imaging means, and the imaging by the imaging means and the video signal processing means And control means for controlling the processing.

  The present invention also provides an imaging means for generating a video signal, a driving means for changing the imaging range of the imaging means, and a video signal supplied with the video signal from the imaging means and having a wider angle of view than one imaging range of the imaging means. Video signal processing means for forming the image, control means for controlling imaging by the imaging means, driving by the driving means, and processing by the video signal processing means, and a display for displaying the video signal formed by the video signal processing means Means.

  Alternatively, according to the present invention, an imaging unit that generates a video signal, an optical unit that curves the imaging range of the imaging unit to perform imaging with a wider angle of view than the original imaging range of the imaging unit, and the video signal from the imaging unit The video signal processing means for normalizing the supplied and distorted video signal to form a video signal having a wider angle of view than the original imaging range of the imaging means, and the imaging by the imaging means and the video signal processing means It comprises control means for controlling the processing and display means for displaying the video signal formed by the video signal processing means.

  The present invention also provides an image pickup means for generating a video signal, a drive means for changing the image pickup range of the image pickup means, and a video signal from the image pickup means directly and sequentially recorded, or an image pickup means from a video signal whose image pickup range is changed Recording means for recording through a video signal processing means for forming a video signal having a wider angle of view than one imaging range, imaging at the imaging means, driving at the driving means, processing at the video signal processing means, and recording at the recording means And a control means for controlling recording.

  Alternatively, the present invention relates to an imaging unit that generates a video signal, an optical unit that curves an imaging range of the imaging unit to perform imaging with a wider angle of view than the original imaging range of the imaging unit, and a video signal from the imaging unit. Recording means for recording through a video signal processing means for normalizing a video signal picked up by direct recording or distortion and forming a video signal having a wider angle of view than the original imaging range of the imaging means; It comprises control means for controlling imaging, processing by the video signal processing means, and recording by the recording means.

  The present invention also provides a reproducing means for reproducing a recording medium in which a video signal with a changed imaging range is sequentially recorded, and a wider angle of view than the one imaging range of the imaging means supplied with the video signal reproduced by the reproducing means. Video signal processing means for forming a video signal having a control signal and control means for controlling reproduction by the reproduction means and processing by the video signal processing means.

  Alternatively, the present invention normalizes a playback unit that plays back a recording medium in which video signals having a curved imaging range are sequentially recorded, and a video signal that is supplied with the video signal played back by the playback unit and is distorted. The video signal processing means for forming a video signal having a wider angle of view than the original imaging range of the imaging means, and the control means for controlling the reproduction by the reproduction means and the processing by the video signal processing means. .

  The present invention also provides an image pickup means for generating a video signal, a drive means for changing the image pickup range of the image pickup means, and a video signal from the image pickup means directly or sequentially transmitted from a video signal whose image pickup range has been changed. Transmission means for transmitting through a video signal processing means for forming a video signal having a wider angle of view than one imaging range, imaging by the imaging means, driving by the driving means, processing by the video signal processing means, and transmission means And control means for controlling transmission.

  Alternatively, the present invention relates to an imaging unit that generates a video signal, an optical unit that curves an imaging range of the imaging unit to perform imaging with a wider angle of view than the original imaging range of the imaging unit, and a video signal from the imaging unit. Transmission means for direct transmission or normalization of image signals captured by distortion and transmission through image signal processing means for forming an image signal having a wider angle of view than the original imaging range of the imaging means; It comprises control means for controlling imaging, processing by the video signal processing means, and transmission by the transmission means.

  The present invention also provides an imaging means using an imaging means for generating a video signal, a driving means for changing an imaging range of the imaging means, and a control means for controlling imaging by the imaging means and driving by the driving means. Video signals are recorded directly or sequentially through video signal processing means for forming a video signal having an angle of view wider than one imaging range of the imaging means from the video signal whose imaging range has been changed.

  Alternatively, the present invention controls an imaging unit that generates a video signal, an optical unit that curves the imaging range of the imaging unit to perform imaging with a wider angle of view than the original imaging range of the imaging unit, and imaging by the imaging unit The video signal from the imaging means is directly recorded or distorted to normalize the video signal and form a video signal having a wider angle of view than the original imaging range of the imaging means. It is recorded through video signal processing means.

  Further, the present invention provides a method for detecting a difference at a set time or when a captured video signal is detected, or detecting or recognizing a sound at a location where an imaging means is provided, or provided with an imaging means. When a change in the physical state of the place is detected or recognized, control by the above-described control means is performed.

  Hereinafter, the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of an example of an apparatus to which the present invention is applied.

  In FIG. 1, an image pickup apparatus 10 as an image pickup means shows a video camera as a whole, and image pickup light reaching from a subject (not shown) passes through a lens, a diaphragm, etc. of a lens block unit 11 to a solid-state image pickup device, for example, a CCD 12. Imaged. An arbitrary visual field image is converted into a video signal by the CCD 12, and is then supplied to a signal separation (sample hold: SH) / automatic gain control (AGC) device 13.

  In the signal separation / automatic gain control device 13, the video output signal from the CCD 12 is sampled and held according to a predetermined pixel clock, for example, and automatic gain control is performed so as to have a predetermined gain by an auto iris (AE) control signal, for example. Done. The video output signal thus obtained is supplied to the signal processing device 15 via the A / D conversion device 14.

  In the signal processing device 15, the input signal is converted into each signal such as luminance, color difference, and video signal, and supplied as a video signal to the television monitor 20 or a video capture board 31 of a computer 30 described later. As a result, the video signals supplied to the video capture board 31 are sequentially taken into the computer device 30.

  The lens block unit 11 of the imaging device 10 is a zoom lens that can change the angle of view for imaging by driving a zoom lens. A motor, for example, a zooming stepping motor 16 is rotated by a drive command from a camera controller 41, which will be described later, and the above-described zoom lens is driven.

  The camera controller 41 always performs lens control (focus, zoom), exposure control (aperture, gain, electronic shutter speed), white balance control, image quality control, and the like of the imaging apparatus 10 and also interfaces with the mode controller 42. . For example, in response to a zoom drive request, a control signal for driving the zoom lens to the required position is output to a drive circuit (not shown) of the motor 16, and the zoom lens position information is always in the mode. Communicated to the controller 42.

  Further, the imaging device 10 is installed on a device having a degree of freedom in two-axis rotational directions, such as pan (left and right) and tilt (up and down), for example, as a driving unit, for example, a rotating pan head 50. In accordance with a drive command from a pantilter controller 43 described later, a motor, for example, a panning stepping motor 51 and a tilting stepping motor 52 are rotated, and the rotary head 50 is driven in each direction.

  In the pantilter controller 43, an interface with the mode controller 42 is performed. For example, in response to a drive request in each direction of pan and tilt, a control signal for driving the rotary head 50 in the requested direction is output to a drive circuit (not shown) of the motors 51 and 52 and rotated. The position information of the pan head 50 in, for example, pan and tilt directions is always communicated to the mode controller 42.

  Further, the mode controller 42 controls the entire system in accordance with the internal state of the imaging device 10 and the rotary pan head 50 and interface information from outside the device. The mode controller 42 is connected to the computer apparatus 30 by, for example, RS232C, and controls the absolute position drive request from the computer apparatus 30.

  That is, the mode controller 42 drives to drive the motor 16 of the lens block unit 11 and the motors 51 and 52 of the rotary head 50 in order to image the position by the imaging device 10 in response to the absolute position drive request from the computer device 30. The command is distributed to the camera controller 41 and the pantilter controller 43. At the same time, position information from these controllers 41 and 43 is transmitted to the computer apparatus 30 through the mode controller 42.

  Further, the computer device 30 is provided with a storage device 32, an image processing device 33, and a control device 34. With these devices, the computer device 30 can control, for example, video signal processing means for forming a panoramic image, and control. Used as a means. A video signal formed by the computer device 30 is supplied to the computer monitor 60 to be used as a user interface, and internal processing conditions and the like are determined using an image displayed graphically on the tube surface.

  In addition, for example, a video signal input from the imaging device 10 is taken into the computer device 30 through the video capture board 31. In the video capture board 31, the captured video signal is displayed on the monitor 60 with an arbitrary quality, and an arbitrary image format (for example, a bitmap format, a JPEG still image, a moving image, etc.) is displayed with an arbitrary quality by the capture signal. It can be captured and stored in a storage device 32 such as a hard disk.

  Further, a control algorithm executed by the computer device 30 will be described with reference to FIG.

  When the program is started in FIG. 2, first, in step [1], a process of setting the display areas of the captured video and the panoramic image on the monitor 60 is performed. Thereby, on the monitor 60, as shown in FIG. 1, for example, a display area 61 for captured images and a display area 62 for panoramic images are set. Then, for example, a video signal input from the imaging device 10 is displayed in the display area 61.

  Furthermore, in step [2], for example, a timer for periodically communicating with the mode controller 42 is set. When these initial settings are completed, in step [3], a transition is made to a waiting state for various events to be generated. The generated events are a timer event set in step [2] described above (details will be described later) and a panorama image creation request event described later.

  Details of the timer event will be described with reference to FIG. Note that this timer event is an event that is generated in order to periodically communicate with the mode controller 42, for example.

  When this event occurs, it is determined in step [11] whether or not the communication port setting has been completed. Since the communication port setting has not been completed only for the first time, the communication port establishment process is performed in step [12]. Is done. In the above-described device, for example, an RS232C port on the computer device 30 is opened as a communication port.

  Further, in the second and subsequent timer events, the presence / absence of received data is determined in step [13], and when there is received data, the received data is analyzed in step [14]. That is, in this step [14], for example, the position information of the zoom lens of the lens block unit 11 and the pan and tilt position information of the rotary head 50 are acquired by communication with the mode controller 42, for example. From these pieces of information, zoom magnification information and pan / tilt angle information are extracted.

  Next, in step [15], it is confirmed whether or not there is a data transfer request (Flag so). When there is a transfer request (True), since the data has already been stored in the transmission buffer, the transfer processing is immediately performed using the data in this transmission buffer in Step [16], and there is no transfer request ( Flag so = False).

  If there is no transfer request (False) in step [15], the value of the internal counter (req cnt) is determined in steps [17] [18] [19]. Here, when (req cnt = 0), the process proceeds from step [17] to step [20] to transfer the communication data of the absolute position drive request for driving the motors 51 and 52 of the rotary head 50. Is done.

  When (req cnt = 1), the process proceeds from step [18] to step [21], and communication data transfer processing for absolute position drive request for driving the motor 16 of the lens block unit 11 is performed. . When (req cnt = 2), the process proceeds from step [19] to step [22], and a panoramic image creation process to be described later is performed.

  After steps [20] and [21] are executed, a process of counting up (req cnt) is performed in step [23]. After step [22] is executed, a process of returning (req cnt) to 0 is performed in step [24]. As a result, the processes of these steps [20], [21] and [22] are executed in a circulating manner for each event process.

  Further, the above panoramic image creation process is performed as described below. That is, this panorama image creation process is executed in step [22] of the above-described timer event by setting a panorama creation request (Flag pa) in step [30] shown in FIG. 3, for example. .

  Details of the panorama image creation process will be described with reference to FIG. In this example, the processing procedure is performed according to an internal counter (Pano cnt).

  Therefore, first, in steps [31] and [32], the value of the internal counter (Pano cnt) is determined. Here, when (Pano cnt = 1), the process proceeds from step [31] to step [33], and the motor 16 of the lens block unit 11 is driven so as to set the angle of view of the imaging device 10 to the widest angle. Along with the process, a process of counting up (Pano cnt) is performed. In addition, by setting the angle of view to the widest angle, a panoramic image is formed with a smaller number of image acquisitions.

  When (Pano cnt = 2), the process proceeds from step [32] to step [34], and the imaging range of the imaging device 10 is set to a position where the first image acquisition is performed in the panorama image creation process. In addition, processing for driving the motors 51 and 52 of the rotary head 50 is performed, and processing for counting up (Pano cnt) is performed.

  Further, when (Pano cnt) is 3 or more, it is confirmed in steps [35] and [36] that the zoom position and the imaging range set in steps [33] and [34] are moved. When these set positions are reached, the first image acquisition is performed in step [37]. Further, in step [38], processing for driving the motors 51 and 52 of the rotary head 50 to the next image acquisition position is performed.

  In step [39], the previously acquired image is compressed in the horizontal and vertical directions, and the panorama image creation status is displayed in the display area 62 of the monitor 60 in step [40]. Further, in step [41], a process of counting up (Pano cnt) is performed. In step [42], it is determined whether or not the panoramic image is completed. When the panorama image is not completed, the above operation is repeated.

  When the panorama image is completed in step [42], the panorama creation request (Flag pa) is not made (Flag pa = False) in step [43], and the panorama image completed in step [44] is Saved and the operation is finished.

  In this manner, for example, images acquired while the imaging range of the imaging device 10 is sequentially moved by the rotating pan head 50 are connected while being compressed, and a panoramic image is formed. Here, the rotary head 50 is operated so as to always enter the commanded target position from the same direction. As a result, for example, it is possible to correct the shift of the linked image due to play of the drive system mechanism (gear backlash, etc.) that may occur when the images are linked.

  Therefore, in this apparatus, by changing the imaging range of the imaging means and synthesizing the video signals from such imaging means to form a video signal having a wide angle of view, the weather, time, etc. A panoramic image that does not give a sense of incongruity to the change can be obtained with high resolution.

  As a result, in the conventional apparatus, there is a risk that the resolution may be lowered even if an expensive wide-angle lens is used, and in the method of forming a panoramic image by fitting into a stored image, for example, weather or time According to the present invention, these problems can be solved in the case where there is a problem such as a sense of incongruity with respect to the change of.

  In the above-described apparatus, for example, one imaging apparatus 10 is used to capture a panoramic image by changing the imaging range by the rotating pan head 50. However, instead of using the rotating pan head 50, a plurality of units are used. The same image signal can be obtained by arranging the image pickup devices in the respective directions for forming the panoramic image and sequentially switching the video signals from these image pickup devices as a driving means.

  Alternatively, in the above-described apparatus, it is conceivable to install means for capturing a wide range of images by curving a surrounding image such as a fisheye lens or the like in front of the lens block unit 11 itself of the imaging apparatus 10. In this case, for example, the image processing device 33 of the computer device 30 constituting the video signal processing means converts the coordinates in the latitude and longitude directions, performs image processing so as to be projected onto a plane, and generates a panoramic image. Can be formed.

  Accordingly, in this apparatus, the imaging range of the imaging unit is curved, and the video signal from such an imaging unit is normalized to form a video signal having a wide angle of view, so that the weather, time, etc. can be obtained with a simple configuration. It is possible to obtain a high-resolution panoramic image that does not cause a sense of incongruity with respect to the change.

  Further, in the above-described apparatus, the panorama creation request (Flag pa) in step [30] of FIG. 3 described above may be set by, for example, a user operating a button shown on the monitor 60 or by so-called remote control. However, the setting can be automatically performed by setting by specifying the photographing time, image recognition (processing), detection of various sensors, and the like.

  That is, for example, when setting is performed by specifying the shooting time, the panorama shooting time is set by the input device 35 such as a keyboard or a pointing device such as a mouse attached to the computer device 30 of FIG. The time is stored in the storage device 32.

  Then, for example, in the event determination step [3] of FIG. 2, a clock (not shown) built in the computer device 30 is compared with the stored set time, and when they match, a panoramic image creation request is issued. Commanded and taken. Note that continuous shooting can be automatically performed by setting a plurality of times or by instructing a certain time interval.

  Alternatively, the video information obtained from the imaging device 10 can be compared between the present and the past, and the difference can be detected to automatically issue a panoramic image creation request. The video information obtained here is image brightness, color difference, contour, color balance, and the like.

  Therefore, for example, in a method using luminance information, the average luminance of the portion of the image currently displayed from the imaging device 10 is compared with the average luminance of a portion of the panoramic image that has been captured and stored in the storage device 32. . When the difference is larger than a certain level, a panoramic image creation request is instructed and photographing is performed. The created panoramic image is immediately displayed on the monitor 60 or the like.

  In this method, when shooting the scenery or the like, when the ambient brightness changes with time, the panoramic image is automatically captured and updated, so that the current imaging device 10 always captures the image. It is possible to provide a panoramic image that is close to the existing video.

  For example, as shown in FIG. 6, a representative point is designated for the subject imaged by the imaging device 10, and the luminance and color difference information are combined and modeled, and stored in the storage device 32 together with the position information. The same range is always imaged by the imaging device 10, and when a difference occurs in the position coordinates of the subject model, a panorama image creation request is instructed and imaging can be performed.

  That is, in A of FIG. 6, when the position coordinates (X0, Y0) of the original subject model become the position coordinates (X1, Y1) as shown in B of FIG. 6, X0 ≠ X1 or Y0 ≠ Y1 is set. As a result of the determination, it can be recognized that the subject has moved as shown in FIG. 6C, a panoramic image creation request can be commanded, and shooting can be started. By this method, the above-described apparatus can be used as a dynamic monitoring system.

  In addition, it is also possible to provide a means for obtaining audio information such as a microphone, and start imaging by instructing a panoramic image creation request in accordance with detection of audio. In this case, for example, as shown in FIG. 7, for example, a plurality of directional microphones are installed in a range in which the imaging apparatus 10 is moved by a driving unit such as the rotary head 50 and can be imaged. Audio information collected by these directional microphones is input to the computer apparatus 30 shown in FIG.

  In the computer device 30, when specific audio information is detected in the audio information collected by the microphone, a panoramic image creation request is issued, and the directionality of the microphone from which the audio information is detected is determined in which direction. It is possible to store the panorama image by taking a picture from that direction if necessary.

  In this way, it is possible to recognize a change in the subject by detecting specific audio information, instruct a panoramic image creation request, and start shooting. In this method, similarly, various sensors such as an optical sensor and a pyroelectric sensor can be used to perform detection and update of a panoramic image as necessary.

  Furthermore, in the above description, for example, panorama images are captured and updated over the entire field of view of the imaging device 10. However, as shown in FIG. 8, for example, on the panorama image displayed on the monitor 60. It is also possible to specify an area to be imaged and updated using an input device 35 such as a keyboard or a pointing device (mouse).

  In addition, when a change is detected in a part of the imageable range by a captured image or information from various sensors, the part is displayed on the panoramic image as necessary, and the part is included. It is also possible to image and update only the area.

  Furthermore, such a method that uses only a specific area as an imaging and update area is particularly effective as a monitoring purpose application such as the above-described dynamic detection by modeling of a subject or automatic imaging by detection of various directional sensors. .

  Therefore, in the above-described apparatus, an image of an event necessary for monitoring is performed by performing imaging with an imaging unit and formation of a panoramic image at a set time or under a specific condition. It is possible to perform a good viewing.

  Further, in the apparatus of FIG. 1 described above, by providing a computer monitor 60 as a display means, this apparatus can be implemented as a display apparatus.

  Therefore, in this apparatus, by changing the imaging range of the imaging means, combining the video signals from such imaging means to form a video signal having a wide angle of view, and displaying this video signal on the display means With a simple configuration, it is possible to view a panoramic image with high resolution that does not cause a sense of incongruity with changes in weather, time, or the like.

  Alternatively, in this apparatus, by curving the imaging range of the imaging means, normalizing the video signal from such imaging means to form a video signal having a wide angle of view, and displaying this video signal on the display means With a simple configuration, it is possible to obtain a panoramic image with high resolution that does not cause a sense of incongruity with changes in weather, time, or the like.

  In these devices, the imaging means picks up an image of an event necessary for monitoring by performing imaging with an imaging means and formation of a panoramic image at a set time or under specific conditions, and is always good. It is possible to perform a proper viewing.

  Further, in the apparatus of FIG. 1 described above, by providing the storage device 32 as a recording means, this apparatus can be implemented as a recording apparatus. In this case, in the storage device 32, the video signal from the imaging device 10 is recorded directly or sequentially, or the panoramic image formed by the video signal processing device 33 is recorded.

  Therefore, in this apparatus, by changing the imaging range of the imaging means, recording video signals from such imaging means directly sequentially, or recording a panoramic image synthesized by the video signal processing means, with a simple configuration, A panoramic image that does not give a sense of incongruity to changes in weather or time can be recorded with high resolution.

  Alternatively, in this apparatus, the imaging range of the imaging unit is curved, and a video signal from such an imaging unit is recorded directly or sequentially, or a panoramic image normalized by the video signal processing unit is recorded with a simple configuration. Further, it is possible to record a panoramic image with high resolution without causing a sense of incongruity with changes in weather, time, and the like.

  In these devices, the imaging means captures an event necessary for monitoring by performing imaging with the imaging means and formation of a panoramic image at a set time or under specific conditions, and is always good. Recording can be performed.

  Further, in the apparatus of FIG. 1 described above, by providing the storage device 32 as reproducing means, this apparatus can be implemented as a reproducing apparatus. In this case, in the storage device 32, the video signal from the imaging device 10 is directly recorded and reproduced sequentially, or the panoramic image formed by the video signal processing device 33 is recorded and reproduced.

  Therefore, in this device, the video signal with the imaging range sequentially changed is reproduced, and the reproduced video signal is synthesized to form a video signal having a wide angle of view, thereby changing the weather, time, etc. with a simple configuration. Therefore, a panoramic image that does not cause a sense of incongruity can be reproduced with high resolution.

  Alternatively, in this apparatus, by reproducing a curved video signal of the imaging range of the imaging means and normalizing the reproduced video signal to form a video signal having a wide angle of view, the weather, time, etc. can be obtained with a simple configuration. It is possible to reproduce a panoramic image that does not cause a sense of incongruity with the change in the high resolution.

  Further, in the apparatus of FIG. 1 described above, a signal transmitted from the computer apparatus 30 to the computer monitor 60 is transmitted to a computer network such as the Internet via a modem (not shown), so that the apparatus becomes a transmission apparatus. Can be implemented.

  That is, in such a computer network, with respect to the configuration of the imaging device 10 to the computer device 30 to the rotary head 50 installed in a remote place, a network from an arbitrary computer device, a display device, and a user side device having a modem. Access through. As a result, a captured image at that time and a panoramic image stored in the storage device 32 of the computer device 30, for example, can be obtained on the display device on the user side with the same screen configuration as that of the monitor 60 of FIG.

  Therefore, in this apparatus, by synthesizing the video signals picked up by the image pickup means installed at a remote place to form a video signal having a wide angle of view, it is possible to cope with changes in weather, time, etc. with a simple configuration. A panoramic image that does not cause a sense of incongruity can be viewed with high resolution.

  Alternatively, in this apparatus, by normalizing the curved video signal of the imaging range imaged by the imaging means installed at a remote place to form a video signal having a wide angle of view, the weather and time can be obtained with a simple configuration. It is possible to view a panoramic image that does not cause a sense of incongruity with respect to such changes at a high resolution.

  In these devices, the imaging means captures an event necessary for monitoring by performing imaging with the imaging means and formation of a panoramic image at a set time or under specific conditions, and is always good. It is possible to perform a proper viewing.

  Further, in the apparatus of FIG. 1 described above, the recording medium of the storage device 32 is removable, and this apparatus can be implemented as a recording medium by taking out the recording medium.

  Therefore, in this apparatus, by changing the imaging range of the imaging means, recording video signals from such imaging means directly sequentially, or recording a panoramic image synthesized by the video signal processing means, with a simple configuration, It is possible to obtain a recording medium in which a panoramic image that does not cause a sense of incongruity with changes in weather, time, or the like is recorded with high resolution.

  Alternatively, in this apparatus, the imaging range of the imaging unit is curved, and a video signal from such an imaging unit is recorded directly or sequentially, or a panoramic image normalized by the video signal processing unit is recorded with a simple configuration. In addition, it is possible to obtain a recording medium on which a panoramic image that does not cause a sense of incongruity with changes in weather, time, etc. is recorded with high resolution.

  In these devices, the imaging means picks up an image of an event necessary for monitoring by performing imaging with an imaging means and formation of a panoramic image at a set time or under specific conditions, and is always good. Can be obtained.

It is a block diagram of the whole system of an example of the imaging and display apparatus with which this invention is applied. It is a flowchart figure for description of the operation. It is a flowchart figure for description of the operation. It is a flowchart figure for description of the operation. It is a flowchart figure for description of the operation. It is a figure for the description. It is a figure for the description. It is a figure for the description.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Imaging device, 11 ... Lens block part, 12 ... CCD, 13 ... Signal separation / automatic gain control device, 14 ... A / D conversion device, 15 ... Signal processing device, 16 ... Stepping motor for zoom, 20 ... Television Monitor 30. Computer 31 Capture video board 32 Storage device 33 Image processing device 34 Control device 35 Input device 41 Camera controller 42 Mode controller 43 Pantilter controller 50 Rotating head, 51 ... Stepping motor for panning, 52 ... Stepping motor for tilting, 60 ... Computer monitor, 61 ... Display area for captured image, 62 ... Display area for panoramic image

Claims (38)

Imaging means for generating a video signal;
Driving means for changing the imaging range of the imaging means;
Video signal processing means for supplying a video signal from the imaging means and forming a video signal having a wider angle of view than one imaging range of the imaging means;
An imaging apparatus comprising: control means for controlling imaging by the imaging means, driving by the driving means, and processing by the video signal processing means. Imaging means for generating a video signal;
An optical unit configured to bend the imaging range of the imaging unit and perform imaging with a wider angle of view than the original imaging range of the imaging unit;
A video signal processing unit configured to normalize the video signal supplied with the video signal from the imaging unit and distorted to form a video signal having a wider angle of view than an original imaging range of the imaging unit;
An imaging apparatus comprising: control means for controlling imaging by the imaging means and processing by the video signal processing means. Provide time setting means,
The imaging apparatus according to claim 1, wherein the control unit performs control according to a time set in the time setting unit. Storage means for storing a video signal from the imaging means;
A comparison unit for detecting a difference between the video signal from the imaging unit and the video signal stored in the storage unit;
The imaging apparatus according to claim 1, wherein the control unit performs control when a difference is detected by the comparison unit. Means for detecting or recognizing the sound of the place where the imaging means is provided;
The imaging apparatus according to claim 1, wherein the control unit performs control when the sound is detected or recognized. A means for detecting or recognizing a change in a physical state of the place where the imaging means is provided;
The imaging apparatus according to claim 1, wherein control by the control unit is performed when a change in the physical state is detected or recognized. Means for designating an arbitrary range in the video signal formed by the video signal processing means;
Every time set or when a difference is detected in the imaged video signal, or when a sound at a location where the imaging means is provided is detected or recognized, or at a location where the imaging means is provided The imaging apparatus according to claim 1, wherein when the change in the physical state is detected or recognized, the control unit controls the arbitrary range. When a difference is detected in the imaged video signal, or when a change in the physical state of the place where the imaging means is provided is detected or recognized, the difference or change is detected or recognized. While the control by the control means is performed,
3. The imaging apparatus according to claim 1, further comprising means for displaying a range in which the difference or change is detected or recognized in a video signal formed by the video signal processing means. Imaging means for generating a video signal;
Driving means for changing the imaging range of the imaging means;
Video signal processing means for supplying a video signal from the imaging means and forming a video signal having a wider angle of view than one imaging range of the imaging means;
Control means for controlling imaging by the imaging means, driving by the driving means, and processing by the video signal processing means;
A display device comprising: display means for displaying the video signal formed by the video signal processing means. Imaging means for generating a video signal;
An optical unit configured to bend the imaging range of the imaging unit and perform imaging with a wider angle of view than the original imaging range of the imaging unit;
A video signal processing unit configured to normalize the video signal supplied with the video signal from the imaging unit and distorted to form a video signal having a wider angle of view than an original imaging range of the imaging unit;
Control means for controlling imaging by the imaging means and processing by the video signal processing means;
A display device comprising: display means for displaying the video signal formed by the video signal processing means. Provide time setting means,
11. The display device according to claim 9, wherein control by the control unit is performed according to a time set in the time setting unit. Storage means for storing a video signal from the imaging means;
A comparison unit for detecting a difference between the video signal from the imaging unit and the video signal stored in the storage unit;
11. The display device according to claim 9, wherein control by the control unit is performed when a difference is detected by the comparison unit. Means for detecting or recognizing the sound of the place where the imaging means is provided;
11. The display device according to claim 9, wherein control by the control means is performed when the voice is detected or recognized. A means for detecting or recognizing a change in a physical state of the place where the imaging means is provided;
11. The display device according to claim 9, wherein control by the control means is performed when a change in the physical state is detected or recognized. Means for designating an arbitrary range in the video signal formed by the video signal processing means;
Every time set or when a difference is detected in the imaged video signal, or when a sound at a location where the imaging means is provided is detected or recognized, or at a location where the imaging means is provided The display device according to claim 9 or 10, wherein when the change in the physical state is detected or recognized, the control by the control unit is performed on the arbitrary range. When a difference is detected in the imaged video signal, or when a change in the physical state of the place where the imaging means is provided is detected or recognized, the difference or change is detected or recognized. While the control by the control means is performed,
11. The display device according to claim 9, further comprising means for displaying a range in which the difference or change is detected or recognized in a video signal formed by the video signal processing means. Imaging means for generating a video signal;
Driving means for changing the imaging range of the imaging means;
Recording the video signal from the imaging unit directly or sequentially through the video signal processing unit that forms a video signal having a wider angle of view than the one imaging range of the imaging unit from the video signal whose imaging range has been changed. Means,
A recording apparatus comprising: control means for controlling imaging by the imaging means, driving by the driving means, processing by the video signal processing means, and recording by the recording means. Imaging means for generating a video signal;
An optical unit configured to bend the imaging range of the imaging unit and perform imaging with a wider angle of view than the original imaging range of the imaging unit;
Through video signal processing means for recording video signals from the image pickup means directly sequentially or normalizing the video signals picked up by the distortion and forming a video signal having a wider angle of view than the original image pickup range of the image pickup means. Recording means for recording;
A recording apparatus comprising: control means for controlling imaging by the imaging means, processing by the video signal processing means, and recording by the recording means. Provide time setting means,
19. The recording apparatus according to claim 17, wherein control by the control unit is performed according to a time set in the time setting unit. Storage means for storing a video signal from the imaging means;
A comparison unit for detecting a difference between the video signal from the imaging unit and the video signal stored in the storage unit;
19. The recording apparatus according to claim 17, wherein control by the control unit is performed when a difference is detected by the comparison unit. Means for detecting or recognizing the sound of the place where the imaging means is provided;
The recording apparatus according to claim 17 or 18, wherein control by the control means is performed when the sound is detected or recognized. A means for detecting or recognizing a change in a physical state of the place where the imaging means is provided;
19. The recording apparatus according to claim 17, wherein control by the control unit is performed when a change in the physical state is detected or recognized. Playback means for playing back a recording medium in which video signals having a changed imaging range are sequentially recorded;
Video signal processing means for supplying a video signal reproduced by the reproducing means and forming a video signal having a wider angle of view than one imaging range of the imaging means;
A playback device comprising: control means for controlling playback by the playback means and processing by the video signal processing means. Playback means for playing back a recording medium in which video signals having a curved imaging range are sequentially recorded;
Video signal processing means for normalizing the video signal that is supplied with the video signal reproduced by the reproducing means and distorted to form a video signal having a wider angle of view than the original imaging range of the imaging means;
A playback device comprising: control means for controlling playback by the playback means and processing by the video signal processing means. Imaging means for generating a video signal;
Driving means for changing the imaging range of the imaging means;
Transmission of video signals from the image pickup means directly in sequence, or transmission through video signal processing means for forming a video signal having a wider angle of view than one image pickup range of the image pickup means from the video signal whose image pickup range has been changed. Means,
A transmission apparatus comprising: control means for controlling imaging by the imaging means, driving by the driving means, processing by the video signal processing means, and transmission by the transmission means. Imaging means for generating a video signal;
An optical unit configured to bend the imaging range of the imaging unit and perform imaging with a wider angle of view than the original imaging range of the imaging unit;
Through the video signal processing means for transmitting the video signal from the imaging means directly in sequence or normalizing the distorted video signal to form a video signal having a wider angle of view than the original imaging range of the imaging means. Transmission means for transmitting;
A transmission apparatus comprising: control means for controlling imaging by the imaging means, processing by the video signal processing means, and transmission by the transmission means. Provide time setting means,
27. The transmission apparatus according to claim 25 or 26, wherein control by the control means is performed according to a time set in the time setting means. Storage means for storing a video signal from the imaging means;
A comparison unit for detecting a difference between the video signal from the imaging unit and the video signal stored in the storage unit;
27. The transmission apparatus according to claim 25 or 26, wherein control by the control means is performed when a difference is detected by the comparison means. Means for detecting or recognizing the sound of the place where the imaging means is provided;
27. The transmission apparatus according to claim 25 or 26, wherein control by the control means is performed when the voice is detected or recognized. A means for detecting or recognizing a change in a physical state of the place where the imaging means is provided;
27. The transmission apparatus according to claim 25 or 26, wherein control by the control means is performed when a change in the physical state is detected or recognized. Means for designating an arbitrary range in the video signal formed by the video signal processing means;
Every time set or when a difference is detected in the imaged video signal, or when a sound at a location where the imaging means is provided is detected or recognized, or at a location where the imaging means is provided 27. The transmission apparatus according to claim 25 or 26, wherein when the change in the physical state is detected or recognized, the control by the control means for the arbitrary range is performed. When a difference is detected in the imaged video signal, or when a change in the physical state of the place where the imaging means is provided is detected or recognized, the difference or change is detected or recognized. While the control by the control means is performed,
27. The transmission apparatus according to claim 25 or 26, further comprising means for displaying a range in which the difference or change is detected or recognized in a video signal formed by the video signal processing means. Imaging means for generating a video signal;
Driving means for changing the imaging range of the imaging means;
Using control means for controlling imaging by the imaging means and driving by the driving means,
The video signal from the imaging means is recorded directly or sequentially through the video signal processing means for forming a video signal having a wider angle of view than the one imaging range of the imaging means from the video signal whose imaging range is changed. A recording medium characterized by Imaging means for generating a video signal;
An optical unit configured to bend the imaging range of the imaging unit and perform imaging with a wider angle of view than the original imaging range of the imaging unit;
Using control means for controlling imaging by the imaging means,
Video signal processing means for forming a video signal having an angle of view wider than the original imaging range of the imaging means by normalizing the video signals picked up by the image pickup means-directly sequentially recorded or distorted Recording medium characterized by being recorded through. Provide time setting means,
The recording medium according to claim 33 or 34, wherein the control by the control means and the processing by the video signal processing means are performed according to the time set in the time setting means. Storage means for storing a video signal from the imaging means;
A comparison unit for detecting a difference between the video signal from the imaging unit and the video signal stored in the storage unit;
The recording medium according to claim 33 or 34, wherein when the difference is detected by the comparison means, the control by the control means and the processing by the video signal processing means are performed. Means for detecting or recognizing the sound of the place where the imaging means is provided;
The recording medium according to claim 33 or 34, wherein when the sound is detected or recognized, control by the control means and processing by the video signal processing means are performed. A means for detecting or recognizing a change in a physical state of the place where the imaging means is provided;
The recording medium according to claim 33 or 34, wherein when the change in the physical state is detected or recognized, the control by the control means and the processing by the video signal processing means are performed.

Images