JP4965979B2 - Image processing system - Google Patents

Description

  The present invention relates to an image processing system having a zoom function.

As a conventional image processing system having a zoom function, two imaging devices are provided, and all-field images (entire images, omnidirectional images) are captured by an imaging device for all-field images, and automatically or manually from within all-field images. There is an apparatus for confirming the occurrence of an abnormality in a monitoring area (image processing system of the first conventional example) by zooming up and capturing an image with a zoomed-up image capturing device. As another example of the above-described conventional image processing system, there is an image processing system (second conventional image processing system) that switches between a full-field image and a zoom-up image using an electronic zoom function. Further, Patent Document 1 discloses that the same subject is photographed with a camera with different in-focus positions for each frame, moving image data corresponding to each in-focus position is generated in a time-sharing manner, and a moving image is generated by an image processing unit. An image system (third conventional example image processing system) that performs digital image processing on image data is disclosed.
JP-A-9-83855 (paragraphs 0038 to 0055 and FIG. 2)

  However, since the image processing system of the first conventional example requires a plurality of imaging devices (imaging device for full-field image and imaging device for zoom-up image), the scale of the entire image processing system is large. In addition, there is a problem that the cost increases. In addition, since the full-field image cannot be acquired when the electronic zoom function is working in the image processing system of the second conventional example, information other than the range captured as a zoomed-up image can be obtained. Further, there is a problem that the user cannot grasp the position where the displayed zoom-up image is in the full-field image. Furthermore, the image processing system of the third conventional example has a problem that a plurality of different images cannot be combined to form one screen configuration.

  The present invention has been made in view of the above points, and an object of the present invention is to acquire a plurality of different images at a reduced cost and combine the acquired images into one screen configuration. An object of the present invention is to provide an image processing system capable of performing the above.

According to a first aspect of the present invention, there is provided an image pickup apparatus having an electronic zoom function, picking up an image based on an image pickup condition using the magnification and center position of the electronic zoom as parameters, and outputting image data of the picked up image, A control unit configured to set a plurality of imaging conditions including imaging conditions for a full-field image in which the entire imaging range of the imaging apparatus is imaged, and to control the imaging apparatus by switching the set imaging conditions in a time-sharing manner; Image combining means for combining a plurality of images into a single screen configuration using a plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device, and the control means includes as more of the image data of the zoom-up image from the image data of the full field of view image to increase the frame rate, the switched time a plurality of imaging conditions division, the image synthesizing means, wherein one Wherein as towards the size of size than the zoom-up image of the entire field-of-view image is larger in the screen configuration, and wherein the synthesis of the full-field image and the zoom-up image.

  According to a second aspect of the present invention, in the first aspect of the invention, the image processing apparatus includes a storage unit that stores a plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device, and the image synthesis unit includes the storage unit. The plurality of images are combined so as to have a single screen configuration using the plurality of image data stored in the screen.

  The invention of claim 3 is the invention of claim 1, further comprising storage means for storing one of a plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device, wherein the image synthesizing means. The image data stored in the storage unit and the remaining image data are used to synthesize the plurality of images into one screen configuration.

According to a fourth aspect of the present invention, in any one of the first to third aspects, the specific object is detected from one of the plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device. Specific object detection means is provided, and the control means sets an imaging condition in which the specific object detected by the specific object detection means is a target of the electronic zoom.

According to the first aspect of the present invention, since image data of a plurality of images having different imaging conditions can be output in a time-sharing manner from one imaging device, the cost can be reduced compared with the case where two imaging devices are provided. However, it is possible to acquire a plurality of different images and combine the acquired images so as to form one screen configuration. According to the first aspect of the present invention, since the entire field-of-view image is included in a plurality of different images, the entire wide field of view that can be captured by the imaging apparatus other than the zoomed-up portion can be displayed simultaneously with the zoom-in image. At the same time, it is possible to confirm which position of the full-field image the zoom-up image is zooming up. Further, according to the first aspect of the present invention, the frame rate of the zoom-up image can be made higher than that of the full-field image, so that the zoom-up image can be displayed in more detail than the full-field image. According to the first aspect of the present invention, since the resolution of the zoom-up image can be made higher than that of the full-field image, the zoom-up image can be displayed in more detail than the full-field image.

  According to the invention of claim 2, it is possible to realize a system having a high degree of freedom in screen configuration and video transmission timing for a plurality of types of image data.

  According to the invention of claim 3, it is possible to synthesize a plurality of images with a storage means having a minimum memory configuration.

According to the fourth aspect of the present invention, since the imaging condition can be set from the detected specific object, instead of determining the direction and angle of the zoom-up image in advance and setting the imaging condition, the state of the changing specific object Can be captured more reliably.

(Embodiment 1)
First, the configuration of the image processing system according to the first embodiment of the present invention will be described with reference to FIGS. As shown in FIG. 1, the image processing system includes a single imaging device 1 having an electronic zoom function, a specific object detection unit 2 that detects a specific object from image data of an image captured by the imaging device 1, The control unit 3 that sets the imaging conditions of the imaging device 1, the storage unit 4 that stores image data from the imaging device 1, and a plurality of images captured by the imaging device 1 are combined to form a single screen configuration. An image composition unit 5 and a display unit 6 for displaying a plurality of images synthesized by the image composition unit 5 are provided. In the first embodiment, the specific object detection unit 2, the control unit 3, the storage unit 4, the image synthesis unit 5, and the display unit 6 are not provided integrally with the imaging device 1, and are installed separately from the imaging device 1. Yes.

  The imaging device 1 is, for example, a video camera or the like, and when imaging conditions using the electronic zoom magnification and the center position as parameters are input from the control unit 3, the imaging device 1 captures images based on the input imaging conditions and captures the captured images. Output image data. As an image picked up by the image pickup apparatus 1, a zoom-up image 70 as shown in FIG. 2A picked up under an image pickup condition in which the magnification of the electronic zoom is set larger than 1 and the magnification of the electronic zoom are 1 ×. 2B, an entire field of view image (entire image, omnidirectional image) 71 as shown in FIG. 2B is captured. At this time, the switching period between the frame of the zoom-up image 70 and the frame of the full-field image 71 is 10 milliseconds or more and 10 seconds or less.

  When an image data signal including image data 73a to 73c (see FIG. 2C) of the full-field image 71 is output from the imaging device 1, as shown in FIG. Is input. The specific object detection unit 2 extracts the image data 73a to 73c of the entire field image 71 from the input image data signal, and the entire field image 71 (see FIG. 2B) from the extracted image data 73a to 73c. A human body is detected as a specific object. That is, the specific object detection unit 2 extracts the human body that has moved between the image data 73a to 73c of the full-field image 71 captured by the imaging device 1 at different times, and the coordinate position of the human body in the full-field image 71 and Detect the size. Information on the coordinate position and size of the human body detected by the specific object detection unit 2 is output to the control unit 3 as an object information signal. The specific object is not limited to the human body, and may be a human face or another moving body that is a part of the human body.

  The control unit 3 is a CPU, for example, and sets a plurality of imaging conditions for the imaging device 1. As the imaging conditions set by the control unit 3, the imaging conditions for the zoom-up image for causing the imaging device 1 to capture the zoom-up image 70 (see FIG. 2A), and the full-view image 71 for the imaging device 1. There are imaging conditions for full-field images for photographing (see FIG. 2B). In the imaging conditions for full-field images, the magnification of the electronic zoom is set to 1. On the other hand, the imaging condition for the zoomed-up image is that the specific object (human body) detected by the specific object detection unit 2 is a target for electronic zoom. When the object information signal is input from the specific object detection unit 2, the control unit 3 sets the electronic zoom magnification and center position as parameters based on information on the coordinate position and size of the human body included in the input object information signal. The imaging condition for the zoom-up image is set. Thereafter, the control unit 3 switches the two types of imaging conditions set (imaging conditions for zoom-up images and full-field images) in a time-sharing manner, and outputs the control signals to the imaging apparatus 1 as a control signal. To do.

  The storage unit 4 is capable of storing image data for two frames included in the image data signal output from the imaging device 1, and image data 72a to 72c of the zoom-up image 70 (see FIG. 2C). ) And image data 73a to 73c (see FIG. 2C) of the entire visual field image 71 are stored frame by frame.

  The image composition unit 5 stores image data 72a to 72c (see FIG. 2C) of the zoom-up image 70 and image data 73a to 73c of the full-field image 71 stored in the storage unit 4 (see FIG. 2C). ) To synthesize the zoom-up image 70 and the entire field-of-view image 71 into one screen configuration, and create composite image data (see FIG. 3). At this time, the zoom-up image 70 and the full-view image 71 are combined so that the size of the zoom-up image 70 is larger than the size of the full-view image 71 in one screen configuration.

  The display unit 6 is, for example, an LCD (Liquid Crystal Display) or the like. When a composite image data signal including composite image data is input from the image composition unit 5, the composite image data is extracted from the input composite image data signal. . Thereafter, based on the extracted composite image data, the display unit 6 sets the zoom-up image 70 captured by the imaging device 1 at the center of the screen and the full-field image 71 at the upper left of the screen, as shown in FIG. The composite image 8 is displayed with one screen configuration.

  Next, the operation of the image processing system according to the first embodiment will be described with reference to FIGS. First, an image data signal including image data 73 a to 73 c (see FIG. 2C) of the full-field image 71 output from the imaging device 1 illustrated in FIG. 1 is input to the specific object detection unit 2. The specific object detection unit 2 extracts image data 73 a to 73 c from the input image data signal, and detects a human body in the full-field image 71. Thereafter, the control unit 3 creates an imaging condition for a zoom-up image in which the human body detected by the specific object detection unit 2 is an object of electronic zoom, and switches between the imaging condition for the full-field image and time-division, and the control signal Is output to the imaging apparatus 1 as follows.

  Thereafter, when the imaging apparatus 1 inputs the imaging conditions for the zoom-up image and the full-field image by switching from the control unit 3 in a time division manner, image data 72a to 72c of the zoom-up image 70 (FIG. 2 ( c)) and image data 73a to 73c (see FIG. 2C) of the full-field image 71 are alternately output for each frame. The image data 72a to 72c and the image data 73a to 73c output from the imaging device 1 are stored in the storage unit 4 frame by frame. Subsequently, the image synthesis unit 5 uses the image data 72a to 72c and 73a to 73c stored in the storage unit 4 so that the zoomed-in image 70 and the full-field image 71 become a picture-in-picture. Processing is performed to create composite image data. Finally, the display unit 6 displays the zoomed-in image 70 and the combined image 8 (see FIG. 3) of the full-field image 71 based on the combined image data from the image combining unit 5.

  As described above, according to the first embodiment, the image data 72a to 72c of a plurality of images (zoom-up image 70 and full-field image 71 (see FIG. 3)) having different imaging conditions from one imaging apparatus 1 shown in FIG. 73a to 73c (see FIG. 2C) can be output in a time-sharing manner, so that a plurality of different images are acquired while suppressing costs compared to the case where two imaging devices are provided. Can be combined to form one screen configuration. At this time, by storing the plurality of image data 72a to 72c and 73a to 73c in the storage unit 4, the degree of freedom of the screen configuration and video transmission timing can be increased for the plurality of types of image data 72a to 72c and 73a to 73c. A high system can be realized.

  As shown in FIG. 3, since the entire visual field image 71 is included in a plurality of different images, the entire wide visual field that can be captured by the imaging apparatus 1 (see FIG. 1) other than the zoomed up portion is displayed simultaneously with the zoomed image 70 In addition, it is possible to confirm which position of the full-field image 71 the zoom-up image 70 is zooming up. Further, since the resolution of the zoom-in image 70 can be made higher than that of the full-field image 71, the zoom-up image 70 can be displayed in more detail than the full-field image 71.

  By detecting the specific object (human body) by the specific object detection unit 2 shown in FIG. 1, the imaging condition is set from the detected specific object, instead of setting the imaging condition by determining the orientation and angle of the zoom-up image 70 in advance. Therefore, it is possible to capture the state of the changing specific object more reliably.

(Embodiment 2)
First, the configuration of an image processing system according to the second embodiment of the present invention will be described with reference to FIGS. As shown in FIG. 1, the image processing system includes a single imaging device 1, a specific object detection unit 2, a storage unit 4, an image composition unit 5, and a display unit 6. Although it is provided in the same manner as the system, it has the following characteristic portions that are not included in the image processing system of the first embodiment.

  As illustrated in FIG. 4, the control unit 3 according to the second embodiment receives an image data signal including more image data 74 a to 74 f of the zoom-up image 70 than the image data 75 a and 75 b of the full-field image 71 from the imaging device 1. The imaging conditions for the zoom-up image and the full-field image are switched in a time division manner so as to be output. The frame ratio between the image data of the zoom-up image 70 and the image data of the full-field image 71 is 1: 1 in the first embodiment, but is 3: 1 in the second embodiment. The control unit 3 according to the second embodiment is the same as the control unit according to the first embodiment except for the points described above.

  Next, the operation of the image processing system according to the second embodiment will be described with reference to FIGS. First, under the control of the control unit 3 shown in FIG. 1, the imaging apparatus 1 converts the image data 74 a to 74 f of the zoom-up image 70 and the image data 75 a and 75 b (see FIG. 4) of the full-field image 71 to 3: 1. Output in frame ratio. The image data 74a to 74f of the zoom-up image 70 and the image data 75a and 75b of the full-field image 71 output from the imaging device 1 are stored in the storage unit 4 frame by frame as in the first embodiment. After that, as in the first embodiment, the image composition unit 5 performs composition processing using the image data 74a to 74f, 75a, and 75b stored in the storage unit 4, and the display unit 6 performs the zoom-up image 70 and all the images. A composite image 8 (see FIG. 3) of the visual field image 71 is displayed.

  As described above, according to the second embodiment, as illustrated in FIG. 4, the image data 74 a to 74 f of the zoom-up image 70 is output more from the imaging device 1 (see FIG. 1) than the image data 75 a and 75 b of the full-field image 71. That is, since the frame rate of the zoom-up image 70 can be made higher than that of the full-view image 71, the zoom-up image 70 can be displayed in more detail than the full-view image 71.

(Embodiment 3)
First, the configuration of the image processing system according to the third embodiment of the present invention will be described with reference to FIGS. As shown in FIG. 5, this image processing system includes one image pickup device 1, a specific object detection unit 2, a control unit 3, and a display unit 6 according to the first embodiment (see FIG. 1). However, the image processing system according to the first embodiment has the following characteristic portions.

  The image processing system of the third embodiment includes a storage unit 4a and an image composition unit 5a as shown in FIG. 5 instead of the storage unit 4 and the image composition unit 5 (see FIG. 1) of the first embodiment. Unlike the storage unit 4 of the first embodiment, the storage unit 4a does not store the image data 72a to 72c (see FIG. 2C) of the zoom-up image 70 from the imaging device 1, and stores the full-field image 71. Only the image data 73a to 73c (see FIG. 2C) are stored. The storage unit 4a is the same as the storage unit 4 of the first embodiment except for the points described above.

  The image composition unit 5a includes image data 73a to 73c (see FIG. 2C) of the full-field image 71 stored in the storage unit 4a and image data 72a to 72c (see FIG. 2C) of the zoom-up image 70 from the imaging device 1. 2 (c)), the zoom-up image 70 and the full field-of-view image 71 are synthesized so as to have one screen configuration (see FIG. 3). The image composition unit 5a is the same as the image composition unit 5 (see FIG. 1) of the first embodiment except for the points described above.

  Next, the operation of the image processing system according to the third embodiment will be described with reference to FIGS. First, under the control of the control unit 3 shown in FIG. 5, as in the first embodiment, the imaging apparatus 1 causes the image data 72 a to 72 c of the zoom-up image 70 and the image data 73 a to 73 c of the full-field image 71 (FIG. 2 ( c) are alternately output for each frame. Of the two types of image data 72a to 72c and 73a to 73c output from the imaging device 1, only the image data 73a to 73c of the full-field image 71 is stored in the storage unit 4a. Subsequently, when the image data 72a to 72c of the zoom-up image 70 is output from the imaging device 1, the image composition unit 5a captures the image data 73a to 73c of the full-field image 71 stored in the storage unit 4a and the imaging data. Using the image data 72a to 72c of the zoom-up image 70 from the apparatus 1, a compositing process is performed so that the zoom-up image 70 and the full-field image 71 become a picture-in-picture, and the composite image data is displayed on the display unit 6. Output to. Finally, the display unit 6 displays the zoomed-up image 70 and the composite image 8 (see FIG. 3) of the full-field image 71 based on the composite image data.

  As described above, according to the third embodiment, the zoom-up image 70 and the full-field image 71 can be synthesized with the storage unit 4a having the minimum memory configuration.

(Embodiment 4)
First, the configuration of an image processing system according to Embodiment 4 of the present invention will be described with reference to FIGS. As shown in FIG. 5, this image processing system includes a single imaging device 1, a specific object detection unit 2, a storage unit 4 a, an image composition unit 5 a, and a display unit 6. Although it is provided in the same manner as the system, it has the following features that are not included in the image processing system of the third embodiment.

  As shown in FIG. 4, the control unit 3 according to the fourth embodiment receives an image data signal including more image data 74 a to 74 f of the zoom-up image 70 than the image data 75 a and 75 b of the full-field image 71 from the imaging device 1. The imaging conditions for the zoom-up image and the full-field image are switched in a time division manner so as to be output. The frame ratio between the image data of the zoom-up image 70 and the image data of the full-field image 71 is 1: 1 in the third embodiment, but is 3: 1 in the fourth embodiment. In addition, the control part 3 of Embodiment 4 is the same as that of the control part of Embodiment 3 in points other than the above.

  Next, the operation of the image processing system according to the fourth embodiment will be described with reference to FIGS. First, under the control of the control unit 3 illustrated in FIG. 5, the imaging apparatus 1 converts the image data 74 a to 74 f of the zoom-up image 70 and the image data 75 a and 75 b (see FIG. 4) of the full-field image 71 to 3: 1. Output in frame ratio. As in the third embodiment, only the image data 75a and 75b of the zoom-up image 70 are stored in the storage unit 4a. Thereafter, as in the third embodiment, when the image data 75a and 75b of the full-field image 71 are output from the imaging device 1, the image composition unit 5a causes the image data 74a to 74f of the zoom-up image 70 and the full-field image 71 to be output. The image data 75a and 75b are used for the composition process, and the display unit 6 displays the composite image 8 (see FIG. 3) of the zoom-up image 70 and the full-field image 71.

  As described above, according to the fourth embodiment, as illustrated in FIG. 4, the image data 74 a to 74 f of the zoom-up image 70 is output more from the imaging device 1 (see FIG. 1) than the image data 75 a and 75 b of the full-field image 71. That is, since the frame rate of the zoom-up image 70 can be made higher than that of the full-view image 71, the zoom-up image 70 can be displayed in more detail than the full-view image 71.

It is a block diagram which shows the structure of the image processing system which concerns on Embodiment 1 or 2 of this invention. In the image processing system according to Embodiment 1 or 3 of the present invention, (a) is a diagram showing a zoom-up image, (b) is a diagram showing a full-field image, and (c) is image data output from the imaging device. It is a timing chart. It is a figure which shows the screen structure of the image processing system which concerns on Embodiment 1 thru | or 4 of this invention. 6 is a timing chart of image data output from an imaging apparatus in an image processing system according to Embodiment 2 or 4 of the present invention. It is a block diagram which shows the structure of the image processing system which concerns on Embodiment 3 or 4 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Specific object detection part 3 Control part 4, 4a Storage part 5, 5a Image composition part 6 Display part

Claims (4)

One image pickup apparatus having an electronic zoom function, picking up an image based on an image pickup condition using the electronic zoom magnification and the center position as parameters, and outputting image data of the picked up image;
Control means for controlling the imaging device by setting a plurality of imaging conditions including imaging conditions for full-field images in which the entire imaging range of the imaging device is imaged, and switching the set imaging conditions in a time division manner When,
Image synthesizing means for synthesizing a plurality of images into a single screen configuration using a plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device;
The control means switches the plurality of imaging conditions in a time-sharing manner so that the image data of the zoom-up image has a higher frame rate than the image data of the full-field image ,
The image synthesizing unit synthesizes the full-field image and the zoom-up image so that the size of the zoom-up image is larger than the size of the full-field image in the one screen configuration. Processing system. Storage means for storing a plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device;
2. The image processing system according to claim 1, wherein the image synthesizing unit synthesizes the plurality of images so as to have a single screen configuration using the plurality of image data stored in the storage unit. . Storage means for storing one of a plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device;
The image synthesizing unit synthesizes the plurality of images into one screen configuration using the image data stored in the storage unit and the remaining image data. Image processing system. Specific object detection means for detecting a specific object from one of a plurality of image data corresponding to each of the plurality of imaging conditions from the imaging device;
The image processing system according to any one of claims 1 to 3, wherein the control unit sets an imaging condition in which the specific object detected by the specific object detection unit is a target of the electronic zoom. .

Images