WO2007018097A1

WO2007018097A1 - Monitor camera apparatus, image processor and photographing apparatus

Info

Publication number: WO2007018097A1
Application number: PCT/JP2006/315316
Authority: WO
Inventors: Yoshito Saji; Teruyuki Takizawa; Masanari Mohri; Satoshi Kondo
Original assignee: Matsushita Electric Industrial Co., Ltd.
Priority date: 2005-08-05
Filing date: 2006-08-02
Publication date: 2007-02-15
Also published as: JP2008263251A

Abstract

Provided is a monitor camera apparatus, which can monitor a plurality of moving images corresponding to a plurality of discretionary directions in the entire circumference within 360° by one video camera at the same time, and can cover a wide range at a low cost. Reflection light from a mirror surface body (200) which rotates at a high speed in one direction is photographed by a video camera (100), image sampling is performed using a signal synchronous with the rotating angle of the mirror surface body (200), while being adjusted by a unit of frame. Furthermore, an image which can be monitored by a plurality of monitors (801-804) is formed by correcting tilt of the images.

Description

Surveillance camera device, image processing device, and photographing device

Technical field

[0001] The present invention relates to a surveillance camera device capable of simultaneously displaying moving images in a plurality of directions with one camera.

The present invention also relates to an image processing apparatus and a photographing apparatus that constitute a monitoring camera apparatus.

Background art

[0002] With the rapid increase in the number of crimes in recent years, the scale of the security industry is also expanding dramatically. Surveillance cameras are particularly prominent in places where traffic is low at night, such as under parks, guards, and back streets of downtown areas. If these surveillance cameras are used to monitor a wide area, the number of cameras will increase or expensive wide-angle lenses will be used, which will increase costs.

Therefore, there have been proposed a method of rotating the camera as shown in Patent Document 1 and a method of photographing the reflected light by swinging the mirror body and fixing the camera as shown in Patent Document 2. Patent Document 1: Japanese Patent Laid-Open No. 5-191946

Patent Document 2: JP-A-60-169840

Disclosure of the invention

[0003] (Problems to be solved by the invention)

However, in the configuration used in the above method, in the case of Patent Document 1, since the tip of the power supply line and the video output line connected to the camera is connected to the fixed part, the camera cannot be continuously rotated. The reciprocating motion must be repeated within the specified turning angle. Even in the case of Patent Document 2 where the camera is fixed, if the mirror body rocking angle exceeds a certain value, the reflected light will also lose the field of view of the camera, so the range that can be swung and monitored is limited. It is. In addition, in either case, if the turning speed of the camera or mirror is too fast, the monitor cannot see the monitor image, so it is necessary to make the turning speed very slow, and even if the monitoring range is widened, In a certain direction, there are problems such as being able to monitor, and taking a long time, not being able to catch the scene of the crime occurrence, and likely. The present invention solves the above-mentioned problem, and any number of images can be obtained over a 360-degree circumference with a single camera. The purpose is to realize a low-cost surveillance camera device that can simultaneously monitor moving images in the same direction.

(Means for solving problems)

The first invention includes a mirror body that continuously rotates around an axis inclined with respect to the mirror surface, an angle information acquisition unit that acquires information based on the rotation angle of the mirror body as angle information, and angle information of the mirror body Images that capture the mirror surface of the specular body at a plurality of different positions and output it as a video signal, and the video signal output from the imaging unit and the angle information output from the angle information acquisition unit in association with each other. And a processing unit. The image processing unit extracts video signals having the same angle information from the video signals shot at a plurality of positions with different angle information, and distributes the video signals for each angle information.

. Then, the image processing unit synthesizes the distributed video signal into one continuous moving image corresponding to the angle information, and outputs the combined moving image as a moving image corresponding to the angle information. Perform synthesis processing.

As a result, it is possible to acquire a plurality of moving images in any direction over the entire 360-degree circumference with one photographing unit, sort the acquired moving images for each direction, and synthesize them into continuous moving images. Therefore, by using this surveillance camera device, it is possible to monitor and monitor moving images in any direction from 360 degrees simultaneously and in parallel over the entire circumference of 360 degrees.

Here, since “acquired as angle information”, it is not always necessary to actually detect and acquire angle information as long as the angle information is acquired. For example, the physical quantity serving as a reference for rotating the mirror body may be simply sent out by feedforward control, and the angle information may be acquired by grasping the sent physical quantity.

In addition, “a plurality of positions where the angle information of the mirror body is different” means a plurality of positions that are not the same, through which the mirror body passes when the mirror body makes one rotation around the axis.

The second invention is the first invention, and the moving image composition processing includes processing for rotating a video formed by a video signal.

Thereby, it is possible to convert a moving image acquired in a state where the mirror body is rotated into a moving image in a predetermined state (tilt angle). For example, motion acquired with the mirror body rotated By rotating the image by an angle corresponding to the rotation angle of the mirror body, it can be converted into a moving image with an inclination angle of 0 °.

The third invention is the first invention, and the moving image composition processing includes mirror inversion processing for inverting the left and right of the video formed by the video signal.

As a result, it is possible to convert an image obtained by inverting the real image power by the image generated from the reflected light of the mirror body into an image corresponding to the real image.

The fourth invention is the first invention, wherein the angle formed by the rotation axis of the mirror body and the incident optical axis of the imaging unit can be set to an arbitrary angle.

Thereby, the area to be monitored by the monitoring camera can be arbitrarily set. Here, the “incident optical axis” means the optical axis of the lens for incident light of the imaging unit when light from the subject enters the imaging unit. For example, light of subject power enters the camera. Force of case This corresponds to the optical axis of the lens installed at the entrance of the incident light of the camera.

The fifth invention is the first or fourth invention, wherein the image processing unit sets a rotation angle in a state where the mirror body is in a predetermined position as a reference rotation angle, and the mirror body is in that state. The video formed by the video signal output from the imaging unit is used as the reference video. Then, the image processing unit acquires the video formed by the video signal output from the imaging unit as the current video in a state where the mirror is in an arbitrary position, and sets the current video at the position of the mirror that acquired the current video. The corresponding rotation angle is acquired as the current rotation angle, and the current image is converted into the predetermined reference inclination according to the relative rotation angle between the reference rotation angle and the current rotation angle and the inclination angle of the reference image from the predetermined reference inclination angle. Performs processing to convert to angle video.

As a result, a plurality of moving images acquired while the mirror body rotates can be converted into an image having a predetermined reference inclination angle. Therefore, it is possible to convert a plurality of moving images acquired while the mirror body is rotating into an upright image. In addition, a plurality of moving images acquired while the mirror body rotates can be converted from an upright image into, for example, an image inclined at 90 °, 180 °, and 270 °. “Erect state” means that an image (upright image) with the same spatial posture as the actual object (subject) is displayed! The same image as when the object (subject) is viewed is displayed. In addition, “reference tilt angle” refers to the reference image (image) from the upright image (image). For example, if the reference tilt angle is 0 °, the image (image) of the reference tilt angle becomes an upright image (image), and the reference tilt angle is 18 0 Assuming that the image (image) at the reference tilt angle is an image (image) at the reference tilt angle, the image (image) at the reference tilt angle is an inverted image (image).

The sixth invention is the fifth invention, wherein the reference image is an upright image, and the predetermined reference inclination angle is an inclination angle of the erect image.

As a result, since the upright video can be used as a reference, the process of converting the current video into the upright video can be simplified.

The seventh invention is the sixth invention, wherein the process of converting the current image into an upright image includes a rotation process of rotating the current image, and the rotation angle of the current image is a mirror surface in the rotation process. It is the same as the relative rotation angle of the body.

As a result, it is possible to obtain an upright image by simply rotating the current image by the same angle as the relative rotation angle of the mirror body, so the conversion process for obtaining an upright image is simplified. can do.

The eighth invention is the fifth invention, wherein the process of converting the current image into an image having a predetermined reference tilt angle includes a mirror inversion process for inverting the left and right of the current image.

As a result, it is possible to convert an image based on an image generated from the reflected light of the specular body into an image having a predetermined reference tilt angle.

The ninth invention is the fifth invention, further comprising a mirror surface angle changing unit that changes an angle formed by the mirror surface of the mirror body and the rotation axis of the mirror body.

Thereby, the monitoring area of the monitoring camera can be set to an arbitrary area.

The tenth invention is the fifth invention, wherein the angle between the mirror surface of the mirror body and the rotation axis of the mirror body is an angle between 10 degrees and 80 degrees.

As a result, it is possible to realize a monitoring power apparatus that can monitor a monitoring area required for actual monitoring.

The eleventh aspect of the invention is the fifth aspect of the invention, in which the mirror body rotates around the axis by an intermittent operation that repeats the rotation and stop, and the stop time of the mirror body during the intermittent operation is 1 One frame of video signal, which is the amount of video signal that can form two images, is captured. It is longer than the time-lapse time, which is the time required for insertion. The image processing unit performs a moving image synthesis process using the video signal captured by the imaging unit within the stop time of the mirror body.

Thereby, using a stepping motor or the like that performs intermittent drive control, it is possible to output a moving image without blurring and the power of the monitoring camera device. Note that “a video signal of an amount that can form one image” means a video signal for one frame. For example, in the case of an interlaced NTSC system, a video signal for two fields is used. In the case of non-interlaced NTSC, this corresponds to a video signal for one field.

The twelfth invention is the eleventh invention, wherein the image processing unit has an input unit, an extraction timing adjustment unit, and an extraction timing selection unit. Extraction timing instruction information for instructing an extraction timing for extracting a video signal is input to the input unit. The extraction timing adjustment unit is the unit of the time-lapse period, which is the period from the time when the shooting unit starts to capture the video signal for one frame until the time when the video signal for the next frame starts to be captured. Adjust with. The extraction timing selection unit selects the extraction timing from the extraction timings adjusted by the extraction timing adjustment unit based on the extraction timing instruction information input by the input unit. Then, the image processing unit performs moving image synthesis processing at the extraction timing selected by the extraction timing selection unit.

As a result, the extraction timing can be determined on a frame-by-frame basis, and a moving image without blurring can be selected and displayed reliably.

The thirteenth aspect of the present invention is the eleventh aspect of the present invention, in which the rotational period of the mirror body is the time when the imaging unit starts to capture one frame of video signal. It is a value that is an integral multiple of the time-lapse period that is the period up to the time point.

As a result, the rotation period of the mirror body is an integral multiple of the time-lapse period. Therefore, if a moving image is selected, the selected moving image is always related to the rotation of the mirror body. Therefore, it is possible to continue to monitor the moving image without blurring by displaying the moving image.

14th invention is 11th invention, Comprising: The stop time in the predetermined rotation angle of a mirror surface body can be set to arbitrary time.

This makes it possible to stop at a specific position for a long time by setting the stop time to a long time. Therefore, it is possible to realize a surveillance camera device that can centrally monitor a specific direction. The fifteenth aspect of the present invention is the fourteenth aspect of the present invention, wherein the stop time during the intermittent operation of the specular body is longer than the sum of the time-lapse time and the time-lapse period of the imaging unit.

This makes it possible to realize a monitoring camera device that outputs a moving image without blurring even when a shooting unit (for example, a video camera having an electronic shirt function) with a short time-lapse time is used.

The sixteenth invention is the first invention, wherein the mirror body is rotated by pulse control driven by the number of pulses, and the angle information acquisition unit is an absolute mirror object detected by a fixed position sensor. The angle value and the relative rotation angle value for which the pulse number force is also calculated are combined and output to the image processing unit as angle information calculated.

As a result, a monitoring camera device can be realized by using feed forward control using a motor or the like for controlling the drive of noise.

The seventeenth invention is the sixteenth invention, wherein the angle information acquisition unit corrects the angle information of the mirror body by the position sensor.

Thus, for example, by checking the output of the position sensor at regular intervals, it is confirmed whether the feedforward control that rotates the mirror body by feedforward control is operating normally. By performing correction processing, it is possible to realize a surveillance camera device that can return control to normal operation.

According to an eighteenth aspect of the present invention, the mirror surface of the mirror body is photographed at a plurality of positions where the information based on the rotation angle of the mirror body continuously rotating around the axis inclined with respect to the mirror surface and the rotation angles of the mirror body are different. An image processing unit for capturing a video signal is provided. The image processing unit extracts video signals having the same rotation angle from video signals photographed at a plurality of positions with different rotation angles, distributes the video signals to the respective rotation angles, and distributes the distributed video signals to the rotation angles. Are combined into one continuous moving image corresponding to, and a combined moving image is output as a moving image corresponding to the rotation angle. Thereby, the image processing apparatus which can comprise a part of surveillance camera apparatus is realizable.

Note that “a plurality of positions with different rotation angles of the mirror body” means a plurality of non-identical positions through which the mirror body passes when the mirror body makes one rotation around the axis. A nineteenth aspect of the invention is the eighteenth aspect of the invention, further comprising an angle information acquisition unit that acquires information based on the rotation angle of the specular body as angle information.

Thereby, the image processing apparatus which can comprise a part of surveillance camera apparatus is realizable.

According to a twentieth aspect of the invention, the mirror surface continuously rotating around an axis inclined with respect to the mirror surface and the mirror surface of the mirror body are photographed at a plurality of positions where the rotation angle of the mirror body is different! And an imaging unit that outputs the output.

Thereby, the imaging device which can comprise a part of surveillance camera apparatus is realizable.

Note that “a plurality of positions with different rotation angles of the mirror body” means a plurality of non-identical positions through which the mirror body passes when the mirror body makes one rotation around the axis. The twenty-first invention is the twentieth invention, further comprising an angle information acquisition unit that acquires information based on the rotation angle of the mirror body as angle information.

(The invention's effect)

According to the surveillance camera device of the present invention, the reflected light of the mirror body rotating at high speed in one direction is photographed by the video camera, and the image sampling and the image inclination correction are performed using the synchronization signal based on the rotation angle of the mirror body. By doing this, a single video camera can monitor a wide range of moving images corresponding to multiple directions from all around 360 degrees simultaneously and in parallel. Further, since the number of video cameras required for the surveillance camera device of the present invention is one, it can be realized at low cost.

Brief Description of Drawings

FIG. 1 is a perspective view showing an overall outline of a surveillance camera apparatus in Embodiment 1 of the present invention. FIG. 2 is a side view showing an outline of the surveillance camera apparatus in Embodiment 1 of the invention.

FIG. 3 is a perspective view showing the monitoring direction of the monitoring camera device in the first embodiment of the present invention. FIG. 4 is a perspective view showing the monitoring direction of the monitoring camera device in the first embodiment of the invention. The top view which shows the moving image which the surveillance camera apparatus in Embodiment 1 produces

FIG. 6 is a plan view showing a moving image created by the surveillance camera device in the first embodiment of the present invention. [7] Plan view showing a moving image created by the surveillance camera device in Embodiment 1 of the present invention

8] Plan view showing a moving image created by the surveillance camera device in the first embodiment of the present invention.

[9] A timing chart showing the relationship between the rotation of the mirror body of the surveillance camera device and the image capture in the first embodiment of the present invention.

圆 10] Diagram showing image processing of surveillance camera device in Embodiment 1 of the present invention. 圆 11] Timing chart showing relationship between rotation of mirror surface of surveillance camera device and image capture in Embodiment 2 of the present invention.

FIG. 12 is a timing chart showing another example of FIG.

[Figure 13] Part of the video processing unit

FIG. 14 is an explanatory diagram of a part of processing in the video processing apparatus.

Explanation of symbols

100 beer talent mela

110 Video signal

200 mirror

201 mirror surface

300 Stepping motor

400 position sensor

500 Motor driver circuit (angle sensor)

510 Angle information

600 cases

700 Image processor

801, 802, 803, 804 monitors

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)

FIG. 1 is a perspective view showing an overview of a surveillance camera device according to Embodiment 1 of the present invention, and FIG. [FIG. 3] is a side view showing an outline of a portion for performing imaging by a surveillance camera. In FIGS. 1 and 2, reference numeral 100 denotes a video camera as a photographing unit. Reference numeral 700 denotes an image processing apparatus as a video processing unit. The video camera 100 is a video camera capable of shooting a moving image. The video camera 100 is installed vertically as shown in FIG. 1 and sends the shot image to the image processing apparatus 700 as a video signal 110. 200 is a mirror body having a mirror surface 201, 300 is a stepping motor that rotates by pulse input, and the mirror body 200 attached to the tip of the drive shaft 301 is intermittently controlled in the direction of the arrow 300R around the rotation shaft 300a. Rotate. The mirror body 200 is attached to the drive shaft 301 of the stepping motor 300 by a joint 210, and the angle 200A between the mirror surface 201 and the rotating shaft 300a can be freely set between 10 degrees and 80 degrees. The video camera 100 is also configured to be tilted by an inclination angle 100A around the intersection of the state force mirror surface 201 where the lens optical axis 100a coincides with the rotation axis 300a and the rotation axis 300a. Reference numeral 400 denotes a position sensor that detects the position of the mirror body 200 when the reflected light of the mirror surface 201 forms an erect image on the video camera 100. Reference numeral 500 denotes a motor driver circuit that drives the stepping motor 300. The motor driver circuit 500 acquires the detection position of the mirror body 200 by the position sensor 400 as an absolute angle value (in this case, 0 degree), and acquires the number of pulses input to the stepping motor 300 as a relative rotation angle value. Then, the relative rotation angle value is added to the absolute angle value, and the angle value obtained by this addition is sent to the image processing apparatus 700 as the angle information 510 of the mirror body 200. That is, the motor driver circuit 500 also has a function as an angle sensor. Reference numeral 600 denotes a case in which the video camera 100, the mirror body 200, the stepping motor 300, the position sensor 400, and the motor driver circuit 500 are accommodated. A transparent portion 601 is provided above the case 600. The image processing apparatus 700 captures the video signal 110 transmitted from the video camera 100 in association with the angle information 510 of the mirror body 200 transmitted from the motor driver circuit 500. Reference numerals 801 to 804 are motors for displaying a plurality of (four) moving image signals which are processed and transmitted by the image processing apparatus 700, respectively. An arrow 201N, an arrow 201E, an arrow 201S, and an arrow 201W respectively represent directions after the lens optical axis 100a of the video force lens 100 is reflected by the mirror body 200, and a surface 200D formed by a set of these arrows Indicates the direction of surveillance by this surveillance camera device. Here, 10N, 10E, 10S, and 10W are 90 degrees around the surveillance camera device. And the scenery.

The operation and processing of the surveillance camera device configured as described above will be described below with reference to FIGS.

First, as shown in FIG. 2, an angle 200 A between the mirror surface 201 and the rotating shaft 300a is set by the joint 210. As shown in Fig. 3, when the angle 200A force is 5 degrees, the monitoring direction 200D becomes a plane 200 DO. When the angle is 45 degrees or more, the cone 200D1 opens downward, and when the angle is 45 degrees or less, it opens upward. It becomes a conical shape 200D2. Also, if the angle 200A is 80 degrees or more, only the surveillance camera device itself can be monitored. Conversely, if the angle 200A is 10 degrees or less, the angle between the mirror surface 201 and the lens optical axis 100a becomes very small, and only a very narrow range of light is incident on the video camera. Can only monitor. For this reason, the angle 200A of the joint 210 is set between 10 degrees and 80 degrees. Next, as shown in FIG. 2, an inclination angle 100A of the lens optical axis 10 Oa of the video camera 100 with respect to the rotation axis 300a is set by means not shown. As shown in Fig. 4, the video camera is tilted at 100 forces S, and the camera monitoring direction 200D is also tilted (200D,) in the (100,) direction. Thus, the monitoring range can be set by setting the angle 200A between the mirror body 200 and the rotation axis 300a and the angle between the lens optical axis 100a of the video camera 100 and the rotation axis 300a. In the present embodiment, the lens optical axis 100a and the rotation axis 300a are set to coincide with each other. By matching, the moving image acquisition processing of the image processing apparatus 700 can be simplified. Conversely, if the lens optical axis 100a and the rotation axis 300a are not matched, correction processing must be performed in the moving image acquisition processing of the image processing apparatus 700, and the processing becomes complicated. Next, drive norse is generated from the motor driver circuit 500, and the stepping motor 300 is intermittently driven by the drive pulse to rotate the mirror body 200 in the direction of the arrow 300R. Then, the mirror body 200 faces the upper surface 100U of the video camera 100 (that is, the mirror body 200 faces the direction of 201N in FIG. 1), and light that forms an erect image is incident on the video camera 100. Then, the position sensor 400 detects the position of the mirror body 200, and this detection signal is sent to the motor driver circuit 500, and the absolute angle value of the mirror body 200 (in this example, it is an erect image at the time of detection, 0 degrees ). Then, from the time when this absolute angle value is detected, the number of drive pulses generated from the motor driver circuit 500 is counted. Thus, the relative rotation angle value is calculated, and the calculated relative rotation angle value is added to the absolute angle value (0 degree). From the angle value obtained by this addition, the upright image position of the mirror body 200 (the position where the light that forms the formed image is incident on the video camera 100) is created, and the angle information 510 indicating the rotational angle value of the force is created and created. The transmitted angle information 510 is transmitted to the image processing apparatus 700. At the same time, the video camera 100 is operated to transmit the video signal 110 to the image processing device 700.

Here, the detection of the absolute angle value by the position sensor 400 is basically performed only once at the beginning. For example, when the stepping motor 300 is stepped out due to disturbance such as train running vibration. In consideration, the position information 400 is detected every time the mirror body 200 is rotated several times, and the angle information 510 is corrected.

The subsequent processing operation by the image processing apparatus 700 will be described in four steps. In step 1, as shown in FIG. 5, a series of moving images in which the angle information 510 and the video signal 110 are associated is created. Note that FIG. 5 is a diagram for convenience of explanation, and does not show a moving image formed by an actual video signal.

Next, in step 2, video signals 110 having the same angle information 510 in the medium force of these moving images are extracted for a plurality of angle information 510 (in this example, four types of angle information every 90 degrees). As shown in Fig. 6, each is synthesized as a moving image. However, since the reflected light of the rotating mirror surface 201 is captured by the stationary video camera 100, the image is tilted or inverted depending on the rotation angle of the mirror body 200.

In step 3, the image processing apparatus 700 performs a process of rotating the image by the value of the angle information 510 in the direction opposite to the rotation direction of the mirror body 200 viewed from the video camera 100. In other words, in this example, the mirror body 200 is rotated counterclockwise when viewed from the video camera 100. Therefore, for the image whose angle information 510 is 90 degrees, the image is rotated 90 degrees to the right. Rotate 270 degrees to the right. By performing such processing, the moving images shown in FIG. 7 are obtained. These moving images are mirror images reflected on the left and right, so that the left and right images are reversed.

In step 4, as shown in FIG. 8, the moving image corresponding to each direction is converted into a moving image that is an erect image by inverting the left and right mirrors. The converted video is shown in Fig. 1. As shown, the landscape ION in the direction of the arrow 201N is on the monitor 801, the landscape in the direction of the arrow 201E is on the monitor 802, the landscape in the direction of the arrow 201S is 10S on the monitor 803, and the landscape 10W in the arrow 201W direction is on the monitor 804 , Each projected.

Next, FIG. 9 is a timing chart showing the relationship between the rotation angle of the rotating mirror body 200 and the image capture timing by the video camera 100 by the intermittent drive control of the stepping motor 300. As a general characteristic of the stepping motor 300, when a drive pulse as shown in Fig. 9 is input, its output value (in this case, the rotation angle of the mirror body 200) depends on the characteristics of the control circuit and the inertial force! / Because so-called “response delay” and “overshoot” occur, a period in which the target output value deviates as shown in Fig. 9 occurs. Therefore, during the rotational movement of the mirror body 200, the `` unstable time '' DT that combines the `` response delay '' and `` overshoot '' areas and the rotating movement area, and the Stop time "ST (shaded area in Fig. 9) occurs alternately. On the other hand, regardless of whether the video camera 100's shooting mode is 60i (60 fields per second interlace) or 30p (30 frames per second 'progressive'), the normal video camera 100 uses a single frame (1 frame). The time to capture the video signal for 1 minute (time-lapse time) is 1/30 second, the same as the time from the start of capturing one frame of video to the start of the next frame (frame-shooting cycle). Therefore, if the mirror 200 is not stopped for at least 1/30 second, the image taken by the video camera 100 will be blurred. Therefore, the stop time ST of the stepping motor 300 must be 1/30 second or more, and the step period PT with the unstable time DT added to this stop time ST is also 1/30 second or more ( The step speed must be 30pps or less).

Here, when the step angle SA of the mirror body 200 and the image extraction period (rotation period of the mirror body 200) To are

To (second Z lap) = 360 (degree Z lap) X PT (second Zstep) / SA (degree Zstep)

Therefore, if the step period PT is 1/20 second and the step angle SA is 18 degrees, the image extraction period To is 1 second.

FIG. 13 shows an example of a partial configuration of the image processing apparatus 700.

In FIG. 13, the input unit 702 is instructed the extraction timing for extracting the video signal 110. The extraction timing instruction information to be input is input. The extraction timing adjustment unit 701 adjusts the extraction timing of the video signal 110 in units of the time-lapse period. Based on the extraction timing instruction information input from the input unit 702, the extraction timing selection unit 703 selects the extraction timing for the intermediate force of the extraction timing adjusted by the extraction timing adjustment unit 701.

As shown in Fig. 9, for example, there are frames (frames) that enter stop time ST, such as A (Α ') and F (F'), and 、 (Β,) and D (D,) If there is also a stop time ST! /, And there are frames (frames), then do not enter the stop time ST, such as Β (Β,) and D (D,)! ) Is output to the monitor, a blurred moving image is displayed. Therefore, by using the image processing device 700 shown in FIG. 13, only frames (frames) that enter the stop time ST, such as A (Α ') F (F,), are selected, and a moving image without blurring is selected. Can only output to the monitor. This will be explained below.

First, the extraction timing adjustment unit 701 to which the video signal 110 has been input adjusts the extraction timing of the video signal 110 in units of a time-lapse period. That is, the images A, B, C, D, E, F, G,... Formed by the video signal 110 in FIG. The user can determine that the images A and F in FIG. 9 are unblurred images by looking at the image displayed on the monitor, so the video signal 110 is output at the timing when the images A and F are extracted. Extraction timing instruction information for instructing extraction is input from the input unit 702. In accordance with the input extraction timing instruction information, the extraction timing selection unit continues to extract the video signal 110 at the timing at which the images A and F in FIG. 9 are extracted, and the timing at which the images A and F in FIG. 9 are extracted. The moving images extracted by the imming are displayed on monitors (for example, monitors 801 and 802).

As a result, the user can select a frame (frame) with no blur while viewing the monitor screen. Then, the image extraction period (the rotation period of the mirror body 200) To is set so that the frame (frame) whose extraction timing has been adjusted by the image processing apparatus 700 always enters the stop area (area of the stop time ST). The time-lapse period of the video camera 100, that is, a value that is an integral multiple of 1 / 30th of a frame period may be used.

In addition, when the angle of the mirror body 200 is not an integer multiple of 90 degrees from the erect image position, when a moving image is formed, an image 111 formed by the reflected light of the mirror body 200 as shown in FIG. Since the display 11 is tilted with respect to the displayable image 11 If on the imaging device (eg, CCD or CMOS image sensor) of the video camera 100, a portion where they do not overlap each other is generated. When the image 11 If on the image pickup device (for example, CCD or CMOS image sensor) of the video camera 100 is rotated to an erect image, 111b in FIG. 10 is a protruding portion, and 111a is a portion having no image information. It becomes. The image processing device 700 deletes 11 lb which is the protruding portion, and adds black video information to the 11 la which is no video information and a portion (for example, in the case of an NTSC signal, a pedestal level signal Process).

In the above description, in consideration of the case where the stepping motor 300 is out of step, etc., in addition to the force of the pulse number, the position sensor 400 detects the mirror body 200 by the position sensor 400. The absolute angle value may be monitored by providing

In the above description, the video camera is inclined and installed. However, the same effect can be obtained by changing the mirror surface tilt angle 200A in synchronization with the rotation or by tilting the entire case.

In the above description, monitoring is performed while the mirror body 200 is rotated. However, the mirror body is stopped at a predetermined angle according to the necessity for each monitoring direction, the time zone, and the like, and the image processing apparatus 700 performs steps. Do only step 3 (processing to rotate the video (image)) and step 4 (processing to flip the video (image) left and right).

In the above description, the angle of the mirror body 200 for forming a moving image, that is, the angle corresponding to the direction in which the subject to be monitored by the monitor is obtained every 90 degrees is obtained. Depending on the direction, set an angle with a different value at random, acquire a moving image corresponding to that angle, and monitor it on the monitor.

In addition, the surveillance camera device described above is characterized in that it can simultaneously monitor and display moving images in multiple directions. However, according to a temporary request from the user, the mirror 200 can be stopped in any fixed direction, and the direction Needless to say, it is possible to monitor only moving images!

In the above description, the position sensor 400 detects the position of the mirror body 200 where the video camera 100 forms an erect image. The position sensor 400 detects the position where the erect image is formed. Even if the motor driver circuit 500 (angle sensor) corrects the angle shifted by a certain angle from the mounting position, the same effect can be obtained.

Further, in the above description, when tilting the video camera 100, the force that the lens optical axis 100a passes through the intersection of the mirror surface 201 and the rotation shaft 300a. As long as it is not monitored too close to the force that causes the difference, there will be no adverse effects that would hinder monitoring. Therefore, when tilting the video camera 100, the lens optical axis 100a does not have to pass through the intersection of the mirror surface 201 and the rotation axis 300a. However, the area of the mirror surface that allows the lens optical axis 100a to pass through the intersection of the mirror surface 201 and the rotating shaft 300a can be reduced, and the apparatus can be miniaturized.

Even if the image processing device 700 connects a plurality of monitor videos to form a horizontally omnidirectional image and projects it on an omnidirectional screen, the effect of the monitoring camera device described above can be obtained. It goes without saying that the same effect can be obtained. In this case, it is needless to say that it is possible to avoid the overlap between the images to be joined using the angle information of the mirror body.

As described above, according to the surveillance camera device of the present invention, the reflected light of the mirror body rotating at high speed in one direction is photographed by the video camera 100, and the synchronization signal based on the rotation angle of the mirror body 200 is used to capture the image. A video that covers a wide range of directions in a single video camera in multiple directions of any force in a 360 ° perimeter by performing sampling while adjusting in units of frames and further correcting the tilt of the image. Images can be monitored simultaneously and in parallel. In addition, since the number of video cameras required for the surveillance camera device of the present invention is one, it can be realized at a low cost. Further, by providing the transparent portion 601 on the case 600, the mirror surface of the mirror body 200 can be prevented from being contaminated, and further, troubles such as injuries to persons due to the rotating mirror body 200 can be prevented.

(Embodiment 2)

Next, the monitoring camera device according to Embodiment 2 of the present invention will be described below. The configuration of the surveillance camera device in the second embodiment of the present invention is the same as the configuration of the surveillance camera device in the first embodiment of the present invention (FIGS. 1 to 10), and thus the description thereof is omitted. The surveillance camera device in Embodiment 2 of the present invention is the surveillance camera in Embodiment 1. The difference from the apparatus is that the relationship between the rotation angle of the mirror body 200 intermittently driven by the stepping motor 300 and the image capture by the video camera 100 is set as shown in FIG. Hereinafter, this difference will be mainly described.

As shown in FIG. 11, the mirror 200 is driven by the stepping motor 300 faster than the driving by the stepping motor 300 in FIG. Then, the control using the high-speed drive pulse causes the mirror 200 to stop for a certain period of time (drive) at the angle of the mirror 200 corresponding to the monitoring direction that is preliminarily set by the operator before the operation of the monitoring camera device. The pulse stop time is HT.) After that, the mirror 200 is rotated again by the high-speed drive pulse. The time during which the mirror body 200 is actually stopped is the time (stop time ST 1) obtained by removing the response delay and overshoot from the drive pulse stop time HT. Set this stop time ST1 to be at least 1/15 second, which is the time-lapse time (1/30 second) plus the time-lapse period (1/30 second). As a result, one frame (frame) of the image (one image formed by the video signal for 1/30 second) always enters the stop time ST1 of the mirror body 200. Then, the image corresponding to the set angle is adjusted in the same way as the adjustment described in the first embodiment, and the setting is made so that a stable single frame (frame) in the stop time ST1 is continuously extracted. This makes it possible to display a moving image on the monitor without blurring. In addition, if the time required for one rotation of the mirror body 200 is set to an integer multiple of 1/5 second, the frame (frame) corresponding to each rotation speed force calculated can be selected. It is possible to continue extracting images in the same direction (same direction of the mirror body 200) regardless of the rotational movement of the mirror.

In the above explanation, the time-lapse time taken by the video camera 100 is the same as the time-lapse period, but when the time-lapse time is shorter than the time-lapse period, such as a video camera using an electronic shirt as shown in FIG. The stop time of the mirror body 200 may be set to the time when the time-lapse cycle is set to the time-lapse time. As a result, the image for one frame is surely entered within the stop time, and an image without blur can be extracted and displayed on the monitor.

According to this method, the image extraction period can be set regardless of the step angle (the angle at which the stepping motor 300 rotates the mirror body 200 by one driving norse) and the rotation speed of the mirror body 200, so that the smoothness is smooth. A monitoring image can be acquired. Mirror surface 200 The stop time can be set long enough, and a complete frame (frame) always enters within the stop time, so the monitoring direction can be set freely in any direction. In addition, since there are no restrictions on the step angle or rotation speed, direct drive control without a deceleration (acceleration) mechanism is possible. That is, the rotation of the mirror body 200 can be controlled by feedforward control without the need to control the rotation of the mirror body 200 by feedback control. Therefore, the surveillance camera device can be miniaturized as the deceleration (acceleration) mechanism becomes unnecessary.

(Other embodiments)

In the above embodiment, the processing operation by the four steps of the image processing apparatus 700 has been described, but another processing operation of the four steps will be described with reference to FIG.

FIG. 14 (a) is an explanatory diagram of the processing operation by the four steps of the image processing apparatus 700 described in the above embodiment, and FIG. 14 (b) is an explanatory diagram of another processing operation. Since the processing in step 1 and step 2 is the same as that described in the above embodiment, the description thereof is omitted.

The image shown in 14A and 14D is obtained by performing the processing in step 1 (association processing between rotation angle and video (image)) and the processing in step 2 (extraction and synthesis processing of video (image) at a predetermined angle). Acquired with angle information (in this case 90 °).

In the method of FIG. 14 (a), in the process of step 3 (process of rotating the image (image)), when the mirror body 200 is viewed from the video camera 100, the rotation direction of the mirror body 200 (300R in FIG. 1). Therefore, image 14A is rotated by 90 ° and converted to image 14B based on the angle information in the left (counterclockwise) direction and the opposite (right (clockwise) direction). Then, the image 14B is obtained by inverting the image 14B to the left and right by the process of Step 4 (the process of inverting the image in the video (image)) and converting it to the image 14C.

On the other hand, in the method of FIG. 14 (b), as the process of step 3 ′, the process of horizontally inverting the image 14D is performed first. Image 14E is acquired by performing the processing of step 3 ′. Then, the process of step 4 ′ is performed. The direction in which the image is rotated in the process of step 4 ′ is opposite to the rotation direction in the process of step 3 of FIG. 14 (a). That is, when the mirror body 200 is viewed from the video camera 100, the rotation direction of the mirror body 200 is the direction of 300R in FIG. Based on the angle information in the same direction (left (counterclockwise))), image 14A is rotated by 90 ° to obtain image 14B, which is an erect image.

In this manner, the order of the left-right reversal process and the rotation process may be switched to obtain an erect image.

In the above description, the angle information is 90 °. However, even when the angle information is an arbitrary angle, the image is converted into an erect image by the same process except that the rotation angle is different. be able to.

In the above embodiment, the monitoring camera device using the angle information 510 based on the erect image position of the mirror body 200 (the position where the light that forms the formed image is incident on the video camera 100) has been described. It is not always necessary to use the position of the upright image as a reference. Based on an arbitrary position of the specular body 200, the absolute position is calculated from it, angle information is obtained, and the angle information is used to realize a surveillance camera device. Do it!

Further, in the above embodiment, the force described for the monitoring camera device configured to rotate the mirror body 200 by the intermittent drive control of the stepping motor 300. For example, an imaging device capable of imaging at high speed such as a high-speed CMO S image sensor. A configuration in which the mirror body 200 is continuously rotated by using the video camera 100 having the above may be used for the monitoring camera device. In this case, since the video camera 100 can shoot at high speed, it is possible to display a moving image without blurring on the monitor without stopping the mirror body 200.

In the above-described embodiment, a case has been described in which a plurality of moving images acquired by the monitoring camera device are displayed on the monitor. However, a plurality of moving images acquired by the monitoring camera device are stored in the image storage device. Well, ...

In the above embodiment, a plurality of moving images acquired by the monitoring camera device are displayed on separate monitors. However, a plurality of moving images acquired by the monitoring camera device are displayed. It is also possible to embed each screen in divided areas and display it as a single screen on a single monitor as a multi-screen video.

In the above embodiment, the case where the motor 300 and the angle sensor (motor driver circuit) 500 are separate has been described. However, the monitoring camera device may be configured using a motor having an angle sensor function. . For example, a mode with an angle sensor function What is necessary is just to use what is called a motor with an encoder. In this case, the rotation angle of the motor with encoder can be obtained by counting the pulses output by the motor with encoder.

The specific configuration of the present invention is not limited to the above-described embodiment, and various changes and modifications can be made without departing from the spirit of the invention.

Industrial applicability

The surveillance camera device according to the present invention is capable of simultaneously monitoring a plurality of moving images corresponding to a plurality of directions from any one of 360 degrees with a single video camera at a low cost and covering a wide area. A camera device can be provided and is useful.

Claims

The scope of the claims

[1] A specular body that continuously rotates around an axis inclined with respect to the specular surface;

An angle information acquisition unit that acquires information based on a rotation angle of the specular body as angle information, and a photographing unit that captures the mirror surface of the specular body at a plurality of positions where the angle information of the specular body is different and outputs the image as a video signal When,

An image processing unit that captures the video signal output by the photographing unit and the angle information output by the angle information acquisition unit;

With

The image processing unit extracts the video signals having the same angle information from the video signals photographed at a plurality of positions where the angle information is different, and distributes and distributes the video signals for each angle information. The video signal is combined with one continuous moving image corresponding to the angle information, and a moving image combining process is performed to output the combined moving image as a moving image corresponding to the angle information.

Surveillance camera device.

[2] The moving image combining process includes a process of rotating an image formed by the image signal.

The surveillance camera device according to claim 1.

[3] The moving image synthesis process includes a mirror inversion process that inverts the left and right of the video formed by the video signal.

The surveillance camera device according to claim 1.

[4] The angle formed by the rotation axis of the mirror body and the incident optical axis of the imaging unit can be set to an arbitrary angle.

The surveillance camera device according to claim 1.

[5] The image processing unit sets the rotation angle in a state where the mirror body is in a predetermined position as a reference rotation angle, and the image signal output from the photographing unit when the mirror body is in the state. The video formed by the video signal output from the photographing unit in the state where the mirror body is at an arbitrary position as the reference video is defined as the current video. A rotation angle corresponding to the position of the specular body from which the current image is acquired is acquired as a current rotation angle, a relative rotation angle between the reference rotation angle and the current rotation angle, and a predetermined reference A process of converting the current image into an image having the predetermined reference inclination angle according to an inclination angle of the reference image from an inclination angle.

The surveillance camera device according to claim 1 or 4.

[6] The reference image is an upright image,

6. The surveillance camera device according to claim 5, wherein the predetermined reference inclination angle is an inclination angle of the image in the upright state.

[7] The process of converting the current image into an upright image includes a rotation process of rotating the current image, and the rotation angle of the current image is the relative rotation angle of the mirror body in the rotation process. Is the same as

The surveillance camera device according to claim 6.

[8] The process of converting the current video into the video of the predetermined reference tilt angle includes a mirror inversion process for inverting the left and right of the current video.

The surveillance camera device according to claim 5.

[9] The apparatus further includes a mirror surface angle changing unit that changes an angle formed by the mirror surface of the mirror body and the rotation axis of the mirror body.

The surveillance camera device according to claim 5.

[10] The angle between the mirror surface of the mirror body and the rotation axis of the mirror body is an angle between 10 degrees and 80 degrees.

The surveillance camera device according to claim 5.

[11] The mirror body rotates around the axis by an intermittent operation that repeatedly rotates and stops, and the imaging unit forms one image during the stop time of the mirror body during the intermittent operation. Longer than the time-lapse time, which is the time required to capture one frame of video signal.

The image processing unit performs the moving image combining process using an image signal captured by the imaging unit within the stop time of the mirror body.

The surveillance camera device according to claim 5.

[12] The image processing unit includes an input unit for inputting extraction timing instruction information for instructing an extraction timing for extracting the video signal;

The time at which the image capturing unit starts to capture the video signal for one frame. An extraction timing adjustment unit to be adjusted with,

An extraction timing selection unit that selects an extraction timing from the extraction timings adjusted by the extraction timing adjustment unit based on the extraction timing instruction information input by the input unit;

Have

The image processing unit performs the moving image synthesis process according to the extraction timing selected by the extraction timing selection unit;

The surveillance camera device according to claim 11.

[13] The rotation period of the mirror body is a time point until the photographing unit starts capturing the video signal for one frame until a time point when the capturing of the next one frame of video signal is started. It is a value that is an integral multiple of the time-lapse period.

The surveillance camera device according to claim 11.

14. The surveillance camera device according to claim 11, wherein a stop time at a predetermined rotation angle of the mirror body can be set to an arbitrary time.

[15] The stop time during the intermittent operation of the mirror body is longer than the total time of the time-lapse time of the imaging unit and the time-lapse period,

The surveillance camera device according to claim 14.

[16] The mirror body is rotated by pulse control driven by the number of pulses,

The angle information acquisition unit is configured to perform the image processing as angle information calculated by combining the absolute angle value of the mirror body detected by a fixed position sensor and the relative rotation angle value calculated by the pulse number force. Output to the

The surveillance camera device according to claim 1.

[17] The angle information acquisition unit corrects the angle information of the specular body by the position sensor. The surveillance camera device according to claim 16.

[18] Information based on the rotation angle of the mirror body rotating continuously around an axis inclined with respect to the mirror surface, and the mirror surface of the mirror body were photographed at a plurality of positions where the rotation angles of the mirror body were different. An image processing unit that captures video signals,

The image processing unit extracts the video signals having the same rotation angle from the video signals photographed at a plurality of positions having different rotation angles, and converts the video signals to the video signals for each rotation angle. The video signals that have been distributed and distributed are combined into one continuous moving image corresponding to the rotation angle, and the combined moving image is output as a moving image corresponding to the rotation angle, respectively. Process,

Image processing device.

[19] An angle information acquisition unit that acquires information based on a rotation angle of the mirror body as angle information,

The image processing apparatus according to claim 18.

[20] a specular body that rotates continuously about an axis inclined with respect to the specular surface;

An imaging unit that captures the mirror surface of the mirror body at a plurality of positions with different rotation angles of the mirror body and outputs the image as a video signal;

Comprising

Shooting device.

[21] An angle information acquisition unit that acquires information based on a rotation angle of the mirror body as angle information,

The imaging device according to claim 20.