JPH09233384A - Image input device and image transmitter using it - Google Patents

Abstract

PROBLEM TO BE SOLVED: To magnify a desired and specified image without accompanying the complicated operation of the operator on an opposite side watching an image and with a constitution for which the device is small-sized and the cost is reduced, as to the image input device which is used for a video conference equipment, etc., and fetches the images of an object. SOLUTION: As to an image input device 10 connected with the communication control part, etc., of the personal computer, etc., connected with a communication line, an image dividing part 13 divides the data of the image pickup image from a camera part 12 for every previously fixed area, an image specifying part 14 recognizes specified images such as the face and the whole of a person, etc., of an object 11 from the divided images and an image magnifying part 15 automatically magnifies the specified images and outputs the images. Therefore, in relation to the camera part 12, complicated constitutions of a unversal head and the control circuit, etc., is eliminated, the device is miniaturized and the cost is reduced, complicated operations such as the detailed designation of a magnified portion by an operator is eliminated and operability is improved.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image transmission device preferably implemented as a so-called TV conference device, a TV telephone device, etc., and an image input device used therein.

[0002]

2. Description of the Related Art A TV camera equipped with a CCD (charge coupled device) or the like as an image pickup device in a computer system such as a personal computer or a workstation, a home information terminal such as a so-called home automation system, or a portable information terminal is used as an image input means. As a result, a configuration in which an image captured by the TV camera is connected to realize the TV conference device or the TV telephone device is widespread.

In a TV camera used for such an application, a subject to be imaged is a person, especially the face thereof, and materials such as documents and drawings. Therefore, it is desirable to pay attention to these subjects as appropriate and enlarge specific subjects in order to recognize them in detail. Therefore, the TV camera is equipped with an optical zoom mechanism and the like.

However, when the object to be enlarged is not in the center of the screen, there is a problem that the desired specific object cannot be appropriately enlarged simply by using the zoom mechanism.

In order to solve such a problem, in Japanese Patent Laid-Open Nos. 6-202600 and 7-135594, which are typical conventional techniques, a TV camera is provided with the optical zoom mechanism, and The pan head is a movable pan that can pan / tilt.

[0006]

Therefore, in the above-mentioned prior art, since the platform is movable, a motor and its control circuit are required, which results in high cost and large size, and complicated operation. There is a problem.

An object of the present invention is to reduce the cost and size, and to extract and enlarge a desired specific image with a simple operation, and an image input device using the same. It is to provide a device.

[0008]

An image input apparatus according to a first aspect of the present invention divides an image input means for picking up a subject and outputting the image and an image from the image input means into predetermined divided images. An image dividing unit, an image specifying unit that recognizes a divided image including a specific image among the divided images divided by the image dividing unit as a specific image, and an enlarged specific image specified by the image specifying unit And image processing means for performing the same.

According to the above configuration, in the image input device used for the TV conference device or the like, the person, particularly the face or the material of the person is detected by the image specifying device from the image of the subject imaged by the image input device such as the TV camera. A divided image including, for example, is recognized as a specific image, and the specific image is enlarged by the image processing means.

Therefore, the specific image to which the operator should pay attention can be recognized and automatically enlarged without requiring the operator to perform a complicated operation, and the operability can be improved. Further, since the specific image is enlarged by the image processing, it is not necessary to provide a movable platform, a control circuit therefor, or the like in association with the image input means, and it is possible to reduce the size and cost.

An image input device according to a second aspect of the present invention includes image input means for picking up an image of a subject and outputting the image.
An image from the image input unit is divided into predetermined image blocks while maintaining the aspect ratio, and an aspect ratio of the original whole image from among the image blocks divided by the block dividing unit, A block specifying unit that recognizes an image block including a specific image with the same aspect ratio as a specific image block; and an image processing unit that enlarges the specific image block specified by the block specifying unit. To do.

According to the above construction, in addition to the construction of claim 1, when enlarging the block of the specific image, the image block is selected so as to have the same aspect ratio as the original whole image. .

Therefore, the original aspect ratio of the entire image can be maintained, and the enlargement can be performed without distortion and without a feeling of strangeness.

Further, the image input device according to the invention of claim 3 is an image input device for picking up an image of a subject and outputting the image, and an image from the image input device, which is a predetermined image while maintaining the aspect ratio. Block dividing means for dividing the image into blocks, block extracting means for recognizing an image block including a specific image as a specific image block from the image blocks divided by the block dividing means, and the block extracting means for extracting the image block. Image processing means for enlarging the specific image block while maintaining the aspect ratio.

According to the above construction, in addition to the construction of claim 1, only the portion to be noticed is enlarged as a block of the specific image while maintaining the aspect ratio, and the portion other than the block of the specific image is displayed on the display means. The image is not displayed in the area where is, for example, a black or white background.

Therefore, as compared with the configuration of claim 2, only the notable portion can be clearly extracted and enlarged and displayed, and the communication data amount can be reduced.

An image input device according to a fourth aspect of the present invention includes image input means for picking up an image of a subject and outputting the image.
From the image dividing unit that divides the image from the image input unit into predetermined divided images, and the divided images divided by the image dividing unit, the specific aspect ratio is the same as the aspect ratio of the original whole image. It is characterized by including block specifying means for recognizing an image block including an image as a specific image block, and image processing means for enlarging the specific image block specified by the block specifying means.

According to the above arrangement, a block of a specific image is extracted from a divided image divided into minute sections without being influenced by the aspect ratio so that the original image has the aspect ratio of the entire image.

Therefore, it becomes possible to finely select the portion to be enlarged, and by this,
A large value can be obtained for the magnification.

An image input apparatus according to a fifth aspect of the present invention includes image input means for picking up an image of a subject and outputting the image, and image dividing means for dividing the image from the image input means into predetermined divided images. An image specifying unit that recognizes a divided image including a specific image as a specific image from among the divided images divided by the image dividing unit, and an aspect ratio that makes the specific image specified by the image specifying unit a desired one. And image processing means for enlarging.

According to the above arrangement, it is possible to enlarge an original whole image with a desired aspect ratio different from that of the original whole image.

Therefore, even if the original image is distorted from the aspect ratio of the image picked up by the image input means due to, for example, insertion of a superimpose or telop, the same aspect ratio as that of the image pickup means. Can be restored to. Therefore, even if the original image is distorted, the image can be restored to a natural image and enlarged.

Further, in the image input apparatus according to the invention of claim 6, the image processing means enlarges to the size of the original whole image.

According to the above arrangement, the transmission capacity of the communication line or the like, which is determined corresponding to the size of the original whole image, can be fully used.

Furthermore, an image transmission apparatus according to a seventh aspect of the invention is an image input apparatus according to any one of the first to sixth aspects, and an image signal created by the image input apparatus via a communication line. It is characterized by comprising a transmission means for transmitting and a display means for displaying an image in response to the transmitted image signal.

According to the above configuration, a unidirectional image transmission device such as a surveillance camera can be realized by using any of the image input devices described above.

An image transmission device according to an eighth aspect of the present invention transmits the image input device according to any one of the first to sixth aspects and an image signal created by the image input device via a communication line. And a display means for displaying an image in response to the transmitted image signal on each of the own station side and the partner station side.

According to the above configuration, a bidirectional image transmission device such as a TV conference device or a TV telephone device can be realized by using any one of the above image input devices.

Further, the image transmitting apparatus according to the invention of claim 9 comprises an input operating means and an input processing means, and the input processing means responds to an output from the input operating means and is displayed on the display means. The index is synthesized and displayed at the position designated by the input operation means on the image to be displayed, and the image processing means on the partner station side uses the image or image block at the designated position as the specific image or specific image block. It is characterized by expanding.

According to the above configuration, in addition to the one-way image transmission configuration according to the seventh aspect, an index such as a cursor is displayed on the receiving side, which is a receiving side, and an input operation means such as a mouse is used. The index is moved by the input operation of, and the image or image block at the position indicated by the index is recognized as a desired specific image or specific image block to be enlarged.

Therefore, when a plurality of specific images or specific image blocks are recognized, such as a person and a material, the specific image or specific image block desired by the operator can be enlarged.

An image transmitting apparatus according to a tenth aspect of the present invention includes an input operating means and an input processing means, and the input processing means responds to an output from the input operating means and is displayed on the display means. The index is combined and displayed on the image at the position designated by the input operation means, and the image processing means on the partner station side enlarges the image or image block at the designated position as the specific image or specific image block. It is characterized by

According to the above construction, in addition to the bidirectional image transmission construction according to the eighth aspect, an index such as a cursor is displayed on the receiving side, which is a receiving side, and an input operation means such as a mouse is used. The index is moved by the input operation of, and the image or image block at the position indicated by the index is recognized as a desired specific image or specific image block to be enlarged.

Therefore, when a plurality of specific images or specific image blocks are recognized, such as a person and a material, the specific image or specific image block desired by the operator can be enlarged.

Further, in the image transmitting apparatus according to the invention of claim 11, the display means combines the image of the partner station side to be displayed and the image of the own station side to be displayed by the display means on the partner station side. It is characterized by displaying as.

According to the above configuration, it is possible to recognize where the operator on the partner station side is paying attention to the image on the own station side. As a result, it is possible to reproduce a state closer to the actual conference such as making an appropriate point or changing the direction of conversation development, and smooth communication can be achieved.

Further, in the image transmitting apparatus according to the invention of claim 12, the input processing means, in response to an operation from the input operation means, synthesizes the index with the position on the image of the own station side. In addition to displaying, the image processing means on the local side enlarges the image or image block at the instructed position as the specific image or specific image block.

According to the above construction, in addition to the construction of claim 11, it is possible to point out to the other station the portion which the other station wants to pay attention to, so that the conference can proceed smoothly. Like

Furthermore, the image transmitting apparatus according to the thirteenth aspect of the present invention is characterized in that the image signal transmitted through the transmitting means can be intercepted and displayed by the display means on the third party side. .

According to the above arrangement, a conference between two parties can be watched by a third party.

An image transmitting apparatus according to a fourteenth aspect of the present invention includes an image inputting means for picking up an image of a subject and outputting the image.
An image dividing unit that divides an image from the image input unit into predetermined divided images, and an image specifying unit that recognizes a divided image including a specific image as a specific image from among the divided images that are divided by the image dividing unit. An image input device including a means, a transmission means for transmitting an image signal created by the image input device through a communication line, a display means for displaying an image in response to the transmitted image signal, and an input In response to the output from the operating means and the input operating means, the index is synthesized and displayed at the position on the image designated by the input operating means, and the image at the designated position is displayed on the image specifying means. And an input processing unit for recognizing the image as a specific image.

According to the above configuration, for example, when there are a plurality of subjects such as a person and a material to be noticed, the selection can be made by the operation of the input operation means, and the focusing can be performed. .

[0043]

BEST MODE FOR CARRYING OUT THE INVENTION A first embodiment of the present invention will be described below with reference to FIGS. FIG. 1 is a block diagram showing an electrical configuration of an image input device 10 according to the first embodiment of the present invention. The image input device 10 is used, for example, as a camera of a TV conference device, and roughly includes a camera unit 12 and an image dividing unit 13.
And an image specifying unit 14 and an image enlarging unit 15.

The camera unit 12 which is an image input means is
Realized by D digital television camera etc.,
Alternatively, the subject 11 such as documents and drawings is imaged,
Image data corresponding to the captured image is output to the image dividing unit 13.

The image dividing section 13 divides the image picked up by the camera section 12 into a large number of areas as shown in FIG. The example of FIG. 2 shows an example of division into (6 × 8 = 48) areas A1, A2, ..., A48. Further, FIG. 3 shows an example in which the captured image is divided into the areas A1 to A48 (hereinafter, indicated by reference numeral A when collectively referred to).

The image specifying unit 14 analyzes the image from the image dividing unit 13 and recognizes a divided image including a particular image to be noticed as a specific image from among the divided images.
For example, in the example of the captured image of FIG.
When 1 is a specific image, the areas A10, A11, A12; A18, A19, A2 forming the face P1 are included.
0; when the divided images of A26, A27, A28 are recognized as the specific images and the person image P2 is set as the specific image, areas A10, A11, A12; A18, A19, A
20; A26, A27, A28; A34, A35, A3
6; When recognizing the divided images of A42, A43, A44 as the specific image and making the document P3 the specific image, areas A22, A23, A24; A30, A31, A32; A
When the divided images 38, A39, A40 are recognized as the specific image and the light source P4 is set as the specific image, the area A5,
A6: The divided images of A13 and A14 are recognized as specific images.

FIG. 4 is a block diagram showing a specific structure of the image specifying unit 14. The image data from the image division unit 13 is input to the edge extraction unit 141, and the edge of the subject is extracted from the change of the luminance signal level or the like. The output from the edge extracting unit 141 is input to the block specifying unit 142, and a block of a divided image that can be recognized as a specific image is specified in each area A.

The output from the block specifying unit 142 is input to the face extracting unit 143, and this face extracting unit 143 is used.
For example, the applicant of the present application applies the method previously proposed in Japanese Patent Laid-Open No. 7-65149 to obtain the specific image forming the face P1. That is, first, an absolute difference between image data separated by a predetermined frame is obtained to detect a moving area. Next, the data of the difference value is density-projected on the X-axis coordinate (horizontal direction) and the Y-axis coordinate (vertical direction), and the uppermost portion (maximum value in the Y-axis direction) of the moving region is set as the vertex coordinate, Further, the X coordinate from which the parietal coordinates are obtained is set as the center coordinate of the human body, and the edge of the difference value within the predetermined range in the X axis coordinate from the center coordinate is set as the candidate position of the human face.

On the other hand, the output from the block specifying unit 142 is also input to the data switching unit 144. From the data switching unit 144, when the face P1 is confirmed by the face extracting unit 143, the block specifying unit 142 is used. Image data of the divided image of the face P1 is output to the image enlarging unit 15, and thus the face P1 is preferentially enlarged.

FIG. 5 shows the image specifying unit 14 shown in FIG.
5 is a flowchart for explaining the operation of FIG. In step s1, it is determined whether or not there is a divided image representing the face P1 from the divided images created by the image dividing unit 13,
When it exists, in step s4, the face P1
The divided image forming the image is extracted as a specific image, and the data of the extracted divided image is output to the image enlarging unit 15 in step s6.

In step s1, the face P
When 1 cannot be specified, the process proceeds to step s2,
It is judged whether or not there is an image to be specified other than the face P1 such as the person P2 or the document P3, and if it exists, in step s5, the division of the specific image from the edges of the specific image is performed. After the image is extracted,
In step s6, the data of the extracted divided image is output to the image enlarging unit 15.

On the other hand, when the image to be specified is not detected in the step s2, that is, when the image is a solid screen having only a single color background, an error indicating that the image enlargement unit 15 cannot be specified in the step s3. After the message data is output, the process returns to step s1.

The image recognition is performed in this manner, and the image specifying unit 14 determines any one of the recognized images of the face, the person, the document, etc. as a specific image and sets the image data thereof as described above. It is output to the image enlarging unit 15.

The image enlarging section 15 enlarges the specific image to the size of the entire original image. Therefore, for example, as shown in FIG. 6, when the face is selected with respect to the original image of FIG. 6A, the enlarged image shown in FIG. 6B is obtained, and when the person is selected, When the enlarged image shown in FIG. 6C is obtained and the document is selected, the image shown in FIG.
An enlarged image shown in (d) is obtained.

The image enlarging section 15 is constructed, for example, as shown by the applicant of the present application in Japanese Patent Laid-Open No. 7-288781. That is, the image data before conversion is alternately written into the two line memories line by line, and only one of the line memories outputs from the correspondence between the line before conversion and the line after conversion. Or by weighting the outputs from the two line memories respectively.

For example, when the enlargement ratio is 2.5, it is necessary to convert the image data of two lines into five lines, and the first and second lines have the first line. The image data from only the line memory is output, and the image data from the first and second line memories are added with weights of 1/2 and output to the third line. Image data from only the second line memory is output to the line. Similarly,
The image data of each dot in the horizontal direction is also converted according to the number of dots before conversion and the number of dots after conversion. Note that the image enlarging method is not limited to such a method, and other methods such as those disclosed in Japanese Patent Application Laid-Open No. 4-185087 may be used.

The data of the specific image magnified by the image magnifying unit 15 is output to the line 16, and when the image input device 10 is used for the TV conference device, the data conversion adapted to the communication protocol of the communication line is performed. It is input to a circuit or the like, or to a device such as a personal computer that can perform image processing. In addition, the data of all images are output from the camera unit 12 to the line 17,
When the image input device 10 is used in the TV conference device as described above, the image is input to a monitor or the like for its own station.

In this way, in the image input device 10 according to the present invention, a specific image of a person or the like is extracted from the original image shown in FIG. 3, and as shown in FIG. The image is automatically enlarged up to the size of. Therefore, it is not necessary to provide a complicated structure such as a movable platform and its control circuit in association with the camera unit 12, and it is possible to reduce the size and cost and improve the operability.

When transmitting image data from the transmitting circuit to the display device or the like via the communication line and the receiving circuit, the data for all the images specified by the transmission capacity of the communication line or the like is specified. Since the image data is output, the transmission capacity can be effectively used. That is, when all the image data from the line 17 is transmitted and the image is enlarged on the receiving side, the transmission capacity is increased to satisfy the image quality required for the enlarged image. On the other hand, by transmitting the image data enlarged to the size of the entire image in this way, it is not necessary to set the transmission capacity unnecessarily high.

When the number of pixels in each area A is small, that is, when the original image is divided into a large number of divided images, unnecessary portions such as the background other than the specific subject can be reduced.

The selection of the specific image is, for example, the face,
Corresponding to the shape of the recognized image in the order of person, document,
The priority order may be set in advance, or the recognition image having the largest enlargement ratio with respect to all the original images may be set as the specific image.

FIG. 7 shows the second embodiment of the present invention.
The following is a description with reference to FIG. FIG. 7 is a block diagram showing an electrical configuration of the image input device 20 according to the second embodiment of the present invention. The image input device 20 is similar to the image input device 10 described above, and corresponding parts are designated by the same reference numerals and the description thereof will be omitted.

It should be noted that in this image input device 20, the image data from the camera unit 12 is processed by the block division unit 23 as shown in FIG. , B2
..., B64 (referred to as reference numeral B below when collectively referred to)
Is divided into That is, with respect to the line number b1 of the entire image and the dot number b2 per horizontal scanning line, the line number b1a and the dot number b2a of each divided image B are b1: b.
It is divided so that 2 = b1a: b2a.

Further, the image data from the block dividing unit 23 is set in the block specifying unit 24 so as to include the image block in which the specific image of the person or the like is reflected and to maintain the aspect ratio of all the images. One or a plurality of image blocks are recognized as the specific image block. That is, for example, when two image blocks are selected in the vertical direction, two image blocks are also selected in the horizontal direction.

The image block specified by the block specifying unit 24 is enlarged by the image enlargement unit 15. Therefore, similar to FIGS. 3 and 6A, the original image shown in FIGS. 9 and 10A has the image block specified as shown in FIGS. 10B to 10D. Is expanded.

That is, for example, when the face P1 of a person is specified, the image blocks including the screen P1 are B10, B11, B12; B18, B19, B2.
0; B26, B27, B28, and the block identification unit 2
In order to maintain the aspect ratio, No. 4 further adds image blocks B13, B21, B29 to specify as shown in FIG. 10B, and enlarges to the size of the entire original image.

When the specified image is the person P2, the image blocks B10, B including the person P2 are included.
11, B12; B18, B19, B20; B26, B2
7, B28; B34, B35, B36; B42, B4
3, B44; B50, B51, B52; B58, B5
9, in addition to B60, in order to maintain the aspect ratio,
Image blocks B13, B14, B15; B21, B2
2, B23; B29, B30, B31; B37, B3
8, B39; B45, B46, B47; B53, B5
4, B55; B61, B62, B63 are added, and FIG.
It is specified and enlarged as shown in (c).

Further, when the document P3 is specified, the image blocks B30, B31, B3 including the document P3 are included.
2; B38, B39, B40; B46, B47, B4
8; In addition to B54, B55, B56, as shown in FIG. 10D, image blocks B29, B37, B45, B53 are specified and enlarged in order to retain the aspect ratio.

As described above, the image input device 20 enlarges the specific image while maintaining the aspect ratio of the original image.
It is possible to form a natural image with no distortion and no discomfort. In addition, as described above, in the configuration of the image input device 10,
In order to maintain the aspect ratio, it is necessary to increase the number of divisions of the area A. On the other hand, by maintaining the aspect ratio in advance and dividing the area A like the image input device 20, the division is performed. The number can be reduced, and the circuit configuration of the block division unit 23 can be simplified as compared with the image division unit 13.

FIG. 1 shows the third embodiment of the present invention.
1 and FIG. 12 are as follows. FIG. 11 is a block diagram showing an electrical configuration of the image input device 30 according to the third embodiment of the present invention. The image input device 30 is similar to the image input device 20 described above, and corresponding parts are designated by the same reference numerals and the description thereof will be omitted.

It should be noted that in this image input device 30,
In the image data from the block dividing unit 23, an image block added by the block specifying unit 24 to hold the aspect ratio in the block extracting unit 34 is a so-called solid screen such as white or black.

That is, when the face P1 of a person is extracted from the original image shown in FIG. 12A, which is the same as FIGS. 9 and 10A, the image blocks B10 and B11 including the face P1 are extracted. , B12; B18, B19, B2
0; only B26, B27 and B28 are extracted,
Image blocks B13, B21, B added with 0 (b)
Reference numeral 29 designates the solid screen, which is enlarged as shown in FIG. Similarly, when the person P2 is extracted and when the document P3 is extracted, FIG.
As shown in (c) and FIG. 12 (d).

Therefore, as compared with the image input device 10,
The image can be magnified with a natural image without distortion while maintaining the aspect ratio, and compared with the image input device 20, the light source P4
It is possible to reduce unnecessary reflection of an object such as, to clearly extract only a notable portion and enlarge it, and to reduce the communication data amount.

FIG. 1 shows a fourth embodiment of the present invention.
The following is a description with reference to FIGS.
FIG. 13 shows an image input device 4 according to the fourth embodiment of the present invention.
FIG. 3 is a block diagram illustrating an electrical configuration of a zero. The image input device 40 is similar to the image input device 20 described above, and corresponding parts are designated by the same reference numerals and the description thereof is omitted.

It should be noted that in the image input device 40, the image data from the block division unit 23 is added to the superimposing unit 41 by the reference symbol S in FIG.
Superimposing of characters such as P is performed. Therefore, the data of all images output to line 17 is
It is output from the superimposing unit 41. Therefore, the image data of all the images from the superimposing unit 41 input to the block specifying unit 24 has the aspect ratio of the image data from the camera unit 12 as shown in FIGS. 14 and 15A. The image is distorted and distorted. (In FIGS. 14 and 15 (a), the vertical direction of the image is compressed due to the superimposing.) Therefore, the image enlarging unit 45 restores the aspect ratio collapsed in the superimposing unit 41. While expanding.

Therefore, the above-mentioned FIG. 9 and FIG.
10 (b) to FIG. 10 () for the original image shown in FIG. 14 and FIG. 15 (a), which is a distorted image with a distorted aspect ratio. d)
15B to 15D, similar to the enlarged image shown in FIG.
It is possible to obtain a magnified image with the correct aspect ratio, as shown in FIG.

Needless to say, the method of enlarging the distorted original image so that the aspect ratio is normally restored can be similarly applied to the image input device 30 described above.

FIG. 1 shows the fifth embodiment of the present invention.
The following is a description based on item 6. FIG.
FIG. 9 is a diagram showing a configuration of a TV conference device 100 according to a fifth embodiment of the present invention. It is assumed that the video conference apparatus 100 is configured to be capable of bidirectionally communicating images and audio between the local station side and the partner station side. In FIG. Only the configuration for transmitting the image from the side to the partner station side is shown, and the configuration for transmitting the image from the partner station side to the own station side and the configuration regarding the voice are omitted.

The image input devices 10, 20, 30, 40
Image input device 50 (see FIG.
In the above example, the image input device 10 is configured as follows.
The data of all the images is output to the line 17, and the data of the enlarged image is output to the line 16. These image data are input to the local station side communication control unit 101, appropriately selected and image-processed, and from the local station side communication control unit 101,
For example, only one of the image data is output, or as shown in FIG. 16, the image data in which the entire image P0 and the enlarged image P1 are fitted in a window formed in a common image is output. The image data is displayed on the local station display device 112.
And is transmitted to the other station side communication control unit 111 via the communication line 102 realized by a telephone line and an exchange. The image data is displayed on the partner station display device 113 provided in association with the partner station communication control unit 111. The communication control units 101 and 111 are
It is realized by a microcomputer and its peripheral circuits, software and the like.

An input operation unit 114, which is realized by a mouse or a touch panel, is provided in association with the communication control unit 111 on the partner station side. In response to the input operation from the input operation unit 114, the partner station display device 113
An instruction pointer 115, which is an index, is also displayed at a position corresponding to an operation from the input operation unit 114 in the entire image P0. It is determined that the divided image at the position pointed by the pointing pointer 115 constitutes the specific image, and the area number at that position is transmitted from the partner station side communication control unit 111 via the communication line 102. It is transmitted to the station side communication control unit 101 as expanded area information.

Upon receiving the enlarged area information, the local station side communication control section 101 transfers it to the image specifying section 14, and the divided images forming a specific image including the divided images of the instructed area are specified as the specified image. It is recognized and the enlarged image P1 is created. Thus, by providing the input operation unit 114 and enlarging a specific image desired by the input operation, the operator on the partner station side arbitrarily selects and enlarges the desired image. be able to.

Similarly, an input operation section 116 is provided in association with the local station side communication control section 101, and the local station side display device 11 is provided.
The pointing pointer 117 may also be displayed on the display 2. As a result, the operator on the local station side can enlarge and transmit the image that the operator on the partner station side should pay attention to.

Furthermore, by displaying the same screen on the partner station side and the own station side, it is possible to recognize where the operator on the partner station side is paying attention to the image on the own station side. As a result, it is possible to reproduce a state closer to the actual conference such as making an appropriate point or changing the direction of conversation development, and smooth communication can be achieved.

FIG. 1 shows the sixth embodiment of the present invention.
The following is a description based on No. 7. FIG.
[Fig. 8] is a diagram showing a configuration of a TV conference device 120 according to a sixth embodiment of the present invention. This TV conference device 120 is similar to the above-mentioned TV conference device 100, and corresponding parts are designated by the same reference numerals and the description thereof will be omitted.

In the TV conference apparatus 120, the communication control unit on either the local station side or the remote station side (the local station side communication control unit 121 in FIG. 17) is connected to the third line via the communication line 122. The person-side communication control unit 127 is connected. The image data received by the third party communication control unit 127 is
It is displayed on the third party display device 128. Further, an image storage unit 126 realized by a memory or the like is connected to the local station side communication control unit 121. The image displayed on the local station display device 112 is temporarily stored in the image storage unit 126, and then transmitted to the third party communication control unit 127 via the communication line 122 to be displayed on the third party side. Displayed on device 128.

In this way, a third party can intercept the conference between the own station and the partner station.

The configuration on the third party side is not limited to one station, but multiple stations may be provided.

FIG. 1 shows the seventh embodiment of the present invention.
The following is a description based on No. 8. FIG.
FIG. 13 is a diagram showing a configuration of a TV conference device 130 according to a seventh embodiment of the present invention. This TV conference device 130 is similar to the above-mentioned TV conference devices 100 and 120, and corresponding parts are designated by the same reference numerals and the description thereof will be omitted.

It should be noted that in this TV conference device 130, a plurality (3 in FIG. 18) of terminal stations S, Sa, Sb are provided.
Are configured to be able to communicate with each other via the host computer 140. In this TV conference device 130, arbitrary terminal stations can be parties to have a conversation while checking the images of the local station and the remote station, and a third party can intercept the same screen as the party. It is configured to be possible. Note that in the example of FIG. 18, the terminal station S is the own station, the terminal station Sa is the partner station, a conversation is performed between these parties, and the remaining terminal station Sb is intercepting it. Is represented.

The terminal station S receives the image of the subject 11, the image input device 50, the communication control unit 131, the image storage unit 126, the input operation unit 136, and the display device 132.
It is comprised including. The display device 132 displays the entire image and the enlarged image of the own station side and the entire image and the enlarged image of the partner station side. In addition, a pointer 135 that can be operated on the own station side is displayed on all images on the other station side.
Is also displayed.

A similar configuration is also provided in the terminal stations Sa and Sb, and the corresponding portions are designated by the same reference numerals with the suffix a or b. In the example shown in FIG. 18, the terminal station S, which is the own station side, specifies the enlargement of the document P3 of the subject 11a on the other station side, whereas the terminal station Sa, which is the other station side, The enlargement of the face P1 on the office side is selected.

Each terminal station S, Sa, Sb has an input operation unit 1
Each station can be a party by an input operation to 36, 136a, 136b, etc. In this case, the host computer 140 may make the terminal station that made the last statement the other party, or at predetermined time intervals. The parties may be selected by other methods, such as replacing the parties with. In this way, communication can be promoted among many terminal stations.

[0093]

The image input device according to the first aspect of the invention is
As described above, in an image input device used for a TV conference device or the like, a divided image including a specific image such as a person, in particular, a face or a material thereof is enlarged from the divided images of an image of a subject.

Therefore, the specific image to be noticed by the operator can be automatically enlarged without requiring the operator to perform a complicated operation, and the operability can be improved. Further, since the specific image is enlarged by the image processing, it is not necessary to provide a movable platform, a control circuit therefor, or the like in association with the image input means, and it is possible to reduce the size and cost.

As described above, the image input device according to the second aspect of the present invention divides an image of a subject into image blocks while maintaining the aspect ratio, and the same aspect ratio as that of all original images. Enlarge an image block that contains a particular image in aspect ratio.

Therefore, the original aspect ratio of the entire image can be maintained, and the enlargement can be performed without distortion and without a feeling of strangeness.

Further, as described above, the image input apparatus according to the third aspect of the present invention divides the image of the subject image into image blocks while maintaining the aspect ratio, and creates an image block including a specific image. , Expand while maintaining the aspect ratio.

Therefore, on the display means, the image is not displayed on the portion other than the block of the specific image, and the background is, for example, black or white, and only the notable portion is clearly extracted and the aspect ratio is increased. The ratio can be retained and enlarged display can be performed.

Further, as described above, the image input device according to the invention of claim 4 selects a specific image from the divided images of the image of the subject with the same aspect ratio as the original whole image. Enlarge the image block containing.

Therefore, a block of a specific image is extracted with the aspect ratio of the original whole image from the divided images which are not affected by the aspect ratio and are divided into minute sections, and the portion to be enlarged is selected finely. This also makes it possible to obtain a large enlargement ratio.

Further, as described above, the image input device according to the fifth aspect of the present invention enlarges a divided image including a specific image from a divided image of an image of a subject with a desired aspect ratio. To do.

Therefore, even if the original image is distorted from the aspect ratio of the image picked up by the image input means due to, for example, insertion of a superimpose or telop, the same aspect ratio as that of the image pickup means. Can be restored to a ratio. Therefore, even if the original image is distorted, the image can be restored to a natural image and enlarged.

The image input apparatus according to the invention of claim 6 enlarges to the size of the entire original image as described above.

Therefore, it is possible to fully use the transmission capacity of the communication line or the like, which is determined corresponding to the size of the entire original image.

Further, as described above, the image transmission apparatus according to the invention of claim 7 is configured to transmit the image input apparatus according to any one of claims 1 to 6 and the image signal created by the image input apparatus. A transmission means for transmitting via a communication line and a display means for displaying an image in response to the transmitted image signal are provided.

Therefore, a unidirectional image transmission device such as a surveillance camera can be realized by using any of the image input devices described above.

Further, the image transmission device according to the invention of claim 8 communicates the image signal created by the image input device with the image input device according to any one of claims 1 to 6 as described above. Transmission means for transmitting via a line and display means for displaying an image in response to the transmitted image signal are provided on each of the own station side and the partner station side.

Therefore, a bidirectional image transmission device such as a TV conference device or a TV telephone device can be realized by using any one of the above image input devices.

Further, as described above, in the image transmitting apparatus according to the invention of claim 9, in addition to the one-way image transmitting structure of claim 7, the image is displayed by the input operation means. An index such as a cursor is synthesized and displayed at the specified position, and the image or image block at the specified position is enlarged.

Therefore, when a plurality of specific images or specific image blocks are recognized, such as a person and a material, the specific image or specific image block desired by the operator can be enlarged.

As described above, in the image transmitting apparatus according to the invention of claim 10, in addition to the bidirectional image transmitting structure of claim 8, the image is displayed by the input operation means. An index such as a cursor is combined and displayed at the position, and the image or image block at the designated position is enlarged.

Therefore, when a plurality of specific images or specific image blocks are recognized, such as a person and a material, the specific image or specific image block desired by the operator can be enlarged.

Further, as described above, the image transmitting apparatus according to the invention of claim 11 displays the image of the partner station side together with the image of the partner station side.

Therefore, it is possible to recognize where the operator on the partner station side pays attention to the image on the own station side.
As a result, it is possible to reproduce a state closer to the actual conference such as making an appropriate point or changing the direction of conversation development, and smooth communication can be achieved.

Further, as described above, the image transmitting apparatus according to the invention of claim 12 synthesizes and displays the index at the position on the image of the own station side, and displays the image or the image block at the instructed position. Expanding.

Therefore, in addition to the structure of the eleventh aspect, it is possible for the local station side to point out a portion which the remote station side desires to pay attention to, and the conference can be smoothly advanced.

Further, in the image transmitting apparatus according to the thirteenth aspect of the invention, as described above, the image signal transmitted through the transmitting means can be intercepted and displayed by the display means on the third party side. .

Therefore, a conference between two parties can be watched by a third party.

As described above, the image transmitting apparatus according to the fourteenth aspect of the invention recognizes the image at the instructed position as the specific image from the divided images of the image of the subject.

Therefore, for example, when there are a plurality of images of interest, such as a person and a document, it is possible to select the images and focus on the images.

[Brief description of drawings]

FIG. 1 is a block diagram showing an electrical configuration of an image input device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an example of image division in the image input device shown in FIG.

FIG. 3 is a diagram showing an example of division of a captured image according to the example of image division in FIG.

FIG. 4 is a block diagram showing a specific configuration of an image specifying unit of the image input device shown in FIG.

FIG. 5 is a flowchart for explaining the operation of the image specifying unit.

FIG. 6 is a diagram for explaining the function of the image input device shown in FIG.

FIG. 7 is a block diagram showing an electrical configuration of an image input device according to a second embodiment of the present invention.

8 is a diagram showing an example of image division in the image input device shown in FIG.

9 is a diagram showing an example of division of a captured image according to the example of image division in FIG.

FIG. 10 is a diagram for explaining the function of the image input device shown in FIG. 7.

FIG. 11 is a block diagram showing an electrical configuration of an image input device according to a third embodiment of the present invention.

FIG. 12 is a diagram for explaining the function of the image input device shown in FIG. 11.

FIG. 13 is a block diagram showing an electrical configuration of an image input device according to a fourth embodiment of the present invention.

FIG. 14 is a diagram for explaining the function of the image input device shown in FIG.

FIG. 15 is a diagram for explaining the function of the image input device shown in FIG.

FIG. 16 is a diagram showing a configuration of a TV conference device according to a fifth embodiment of the present invention, which uses each of the image input devices.

FIG. 17 is a diagram showing a configuration of a TV conference device according to a sixth embodiment of the present invention.

FIG. 18 is a diagram showing a configuration of a TV conference device according to a seventh embodiment of the present invention.

[Explanation of symbols]

 10 image input device 11 subject 12 camera unit (image input unit) 13 image division unit (image division unit) 14 image identification unit (image identification unit) 15 image enlargement unit (image processing unit) 20 image input device 23 block division unit ( Block dividing unit) 24 Block specifying unit (block specifying unit) 30 Image input device 34 Block extracting unit (Block extracting unit) 40 Image input device 41 Superimposing unit 45 Image enlarging unit (Image processing unit) 50 Image input device 100 TV Conference device (image transmission device) 101 Local station side communication control unit (transmission means) 102 Communication line (transmission means) 111 Remote station side communication control unit (transmission means) 112 Local station side display device (display means) 113 Remote station side Display device (display means) 114 Input operation unit (input operation means) 115 Pointer for indication (index) 11 6 Input Operation Unit (Input Operation Means) 117 Pointer for Indication (Index) 120 TV Conference Device (Image Transmission Device) 121 Local Station Side Communication Control Unit (Transmission Unit) 122 Communication Line (Transmission Unit) 126 Image Storage Unit 127 Third Person-side communication control unit (transmission means) 128 Third party display device (display means) 130 TV conference device (image transmission device) 131 Communication control unit (transmission means) 132 Display device 135 Pointer (index) 136 Input operation unit ( Input operation means) 140 host computer 141 edge extraction unit 142 block identification unit 143 face extraction unit 144 data switching unit A area (divided image) B image block P1 face P2 person P3 document S terminal station Sa terminal station Sb terminal station

Claims (14)

[Claims] 1. An image input unit for picking up an image of a subject and outputting the image, an image dividing unit for dividing an image from the image input unit into predetermined divided images, and a divided image divided by the image dividing unit. An image input apparatus comprising: an image specifying unit that recognizes a divided image including a specific image as a specific image; and an image processing unit that enlarges the specific image specified by the image specifying unit. 2. An image input unit for picking up an image of a subject and outputting the image, a block dividing unit for dividing an image from the image input unit into predetermined image blocks while maintaining an aspect ratio, and the block division. From among the image blocks divided by the means, a block specifying means for recognizing an image block including a specific image with the same aspect ratio as the original whole image as a specific image block, and the block specifying means. An image input device comprising: an image processing unit for enlarging the specified specific image block. 3. An image input unit for picking up an image of a subject and outputting the image, a block dividing unit for dividing an image from the image input unit into predetermined image blocks while maintaining an aspect ratio, and the block division. From among the image blocks divided by the means, a block extracting means for recognizing an image block including a specific image as a specific image block, and the specific image block extracted by the block extracting means while keeping the aspect ratio. An image input device comprising: an image processing unit for enlarging. 4. An image input unit for picking up an image of a subject and outputting the image, an image dividing unit for dividing the image from the image input unit into predetermined divided images, and a divided image divided by the image dividing unit. A block specifying unit that recognizes an image block including a specific image as a specific image block with the same aspect ratio as the original entire image, and a specific image block specified by the block specifying unit. An image input device comprising: 5. An image input unit for picking up an image of a subject and outputting the image, an image dividing unit for dividing the image from the image input unit into predetermined divided images, and a divided image divided by the image dividing unit. An image specifying unit that recognizes a divided image including a specific image as a specific image, and an image processing unit that enlarges the specific image specified by the image specifying unit with a desired aspect ratio. Image input device. 6. The image input device according to claim 1, wherein the image processing means enlarges the image to the original size of the entire image. 7. The image input device according to claim 1, transmission means for transmitting the image signal created by the image input device via a communication line, and the transmitted image signal. And a display unit that displays an image in response to the image transmission device. 8. The image input device according to claim 1, transmission means for transmitting the image signal created by the image input device via a communication line, and the transmitted image signal. And a display unit that displays an image in response to the image transmission apparatus. 9. An input operation means and an input processing means are provided,
The input processing means responds to the output from the input operation means, and causes the display means to synthesize and display the index at the position designated by the input operation means on the displayed image,
8. The image processing means on the partner station side enlarges the image or image block at the designated position as the specific image or specific image block.
The image transmission device as described in the above. 10. An input operation means and an input processing means are provided, said input processing means responding to an output from said input operation means, and a position indicated by the input operation means on an image displayed on display means. 9. The index is combined and displayed on the screen, and the image processing means on the partner station side enlarges the image or image block at the instructed position as the specific image or specific image block. Image transmission device. 11. The display means displays the image of the partner station side to be displayed together with the image of the own station side to be displayed by the display means of the partner station side.
The image transmission device described in 0. 12. The input processing means, in response to an operation from the input operation means, synthesizes and displays the index also at a position on the image of the own station side, and at the same time, the image processing means of the own station side. The image transmission device according to claim 11, wherein the image or the image block at the designated position is enlarged as the specific image or the specific image block. 13. The image according to claim 7, wherein the image signal transmitted through the transmission means can be intercepted and displayed by the display means on the third party side. Transmission equipment. 14. An image input unit for picking up an image of a subject and outputting the image, an image dividing unit for dividing the image from the image input unit into predetermined divided images, and a divided image divided by the image dividing unit. From among these, an image input device including an image specifying device that recognizes a divided image including a specific image as a specific image, and a transmitting device that transmits an image signal created by the image input device through a communication line, Display means for displaying an image in response to the transmitted image signal, input operation means, and in response to an output from the input operation means, synthesize an index at a position on the image designated by the input operation means. And an input processing unit that causes the image specifying unit to recognize the image at the designated position as a specific image.