JPH09214924A - Image communication equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide image communication equipment with which high-quality pictorial communication is enabled and operability is improved. SOLUTION: After an input image in the entire area of a document original is fetched and stored in a memory 107 as a still picture, this input image in the entire area of the document original is picked up by a difference/motion detection part 109 and this picked-up image is compared with the image stored in that memory 107. Then, when the difference in the comparison gets more than a reference value, only the image at the section, where that difference is detected, is extracted by a system control part 13, encoded as a moving image and transmitted.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a videophone device capable of multiplexing multimedia information such as voice information, image information and data and performing mutual communication in real time.
AV (Audio Visual) such as a video conference system
l) relates to communication devices.

[0002]

2. Description of the Related Art In recent years, communication services by ISDN (Integrated Services Digital Network) lines have been put into practical use, and multimedia information communication of image information, voice information, data, etc. using such digital lines has been realized. . ITU-
IT at T (International Telecommunication Union Electric Standardization Division)
As the U-T recommendation H series, service specifications, image encoding methods, multimedia multiplexing structure specifications, protocol specifications, etc. are recommended. In addition, a high-speed processing processor capable of sufficiently performing image processing in real time, compression / compression
Coding chips and the like have come to be supplied at low cost, and image communication is being further activated.

As a typical image communication apparatus, there is a video conference system from the past. However, promotion of the standardization, speeding up of the processing processor, cost reduction of various image processing chips, and personal computer (personal computer) workstation. Combined with the higher functionality and lower cost of PCs, personal computers (hereinafter referred to as PCs) and workstations (hereinafter referred to as W)
Realization of video conferencing and video phone functions over S) is being promoted.

In the video conference system, in addition to voice information communication, a person's image of the other party is displayed according to ITU-T Recommendation H.264. 26
By performing compression coding according to a coding algorithm such as 1 and communicating with each other, the conference proceeds while watching each other's person moving images, and the document manuscript is generally captured by a camera for capturing a document manuscript called a document camera. It is a general communication mode that mutual communication is performed as images and a common document original is displayed on a screen to advance a conference.

In actual meetings, it is often the case that not only the person's image is seen but the common document original is seen, so that clear mutual communication of document originals can be easily performed during the conference. Improvement is required.

[0006] As a mutual communication / display system of document manuscripts,
In a PC / WS-based video conference system, a method of transmitting / receiving and displaying a document created on the PC / WS as it is, or a method of transmitting / receiving and displaying a still image captured by a still video camera in advance is also tried. However, problems such as PC / WS differences, complexity of operations, complexity of pointing to the actually displayed document and replacement of documents, etc. Furthermore, it is expensive to prepare a dedicated camera / scanner separately. And there is a problem that the operation becomes more complicated,
In general, it is not popular at present.

The transmission and reception by a document camera is most widely used as a method in which anyone can easily transmit and receive a document original and can also transmit and receive a three-dimensional object. As the document camera, there are a camera dedicated to the document camera and a camera also used as a person camera.

Conventionally, the document original is set on the document camera or under the document camera, and the focus of the camera is adjusted while observing the screen.
Adjust the zoom level and document original setting position. Normal NT
In the SC / PAL image signal output camera, the character center A
Since the characters cannot be decoded even if the entire document original of 4 size or the like is displayed, the zoom control is performed so that a part of the set document original can be displayed in a decipherable manner.
An image is captured by a normal image signal such as NTSC / PAL, and a method of encoding and transmitting it as a moving image similar to a person image is used. On the receiving side, after decryption,
It is displayed like a normal person image.

[0009] In CCD cameras currently on the market, which are generally equivalent to 380,000 pixels, the number of effective read pixels is generally 450 horizontal resolutions and 350 vertical resolutions. Facsimile (FAX) for simplification of explanation
In terms of resolution, when the image of an A4 size document is picked up, it corresponds to about 2 pel / mm (about 50 dpi). In addition, recent OA monitors such as PC / WS,
A high-definition displayable one has been provided at a low price, and a display such as 1280 × 1024/1024 × 768 is possible. Fax A4 size document
When reading at 200 dpi at 1728 × 2339
The number of dots is about half of this, and if there is a resolution of about 800 × 1000, which is equivalent to about 100 dpi, it is possible to display one document of approximately A4 size on an OA monitor that supports high resolution display. It is known that when a read document is displayed, it can be displayed in a decipherable manner. The image input signal of NTSC / PAL, etc., has an aspect ratio of 4: 3, and an A4 size document original is 210 mm.
The size is 297 mm, and there is no problem with the horizontal document original at about 4: 3, but on the contrary, the vertical document original becomes 3: 4, and the directions do not match.

In the case of an A4 size document original calculated from the above resolution, an attempt to actually input data in four divisions has been made using the fact that a substantially satisfactory image can be obtained by inputting in four divisions. Since the camera is mechanically moved for inputting, there is an error in the mechanical movement, so that the finally synthesized whole image has distortion at the boundary portion.

Further, even for the same A4 size document original, it is necessary to change the image reading method depending on the horizontal and vertical directions, and much less the camera control for different size documents such as B4 and A5 documents.
The movable position of the camera also differs depending on the position on the platen where the document is actually set, but it is left to the user's operation to set, and there is no image communication device that fully considers this point. .

Further, when actually used in a meeting, it is usual to explain by pointing a document original set on a document camera stand with a hand or a pointer. With the document original transmission means
Although the resolution of the document manuscript itself becomes high, pointing is performed by using a mouse, a digitizer or the like while separately referring to the display screen.

[0013]

However, in the above-mentioned conventional apparatus, in an apparatus that transmits and receives a document image as a moving image, an input image is captured by a normal image signal such as NTSC / PAL, and therefore, in an office. In order to display the entire A4 size document manuscript created by a manual or word processor (word processor) that is usually handled, the resolution is too low except for documents with large characters, and it is impossible to capture a readable document manuscript image. Met.
In addition, a document original image is divided and input, and an attempt is made to transmit and receive a high-resolution still document image by synthesizing the input images. Therefore, a large-scale mechanism for moving the entire camera is required, which is expensive. turn into. Furthermore, for the document originals that are actually set, B4, A5, B5 sizes, etc.
There is a problem in that document manuscripts of various sizes and the respective directional differences such as a horizontal direction / a vertical direction depend on the user's operation, and a very complicated operation is required.

The present invention has been made in view of the above problems of the above-mentioned conventional technique, and an object of the present invention is to perform high quality image communication and image communication excellent in operability. It is intended to provide a device.

[0015]

In order to achieve the above object, the image communication apparatus of the first invention (Claim 1) of the present invention comprises an image information input means for inputting image information, and the image information input means. Encoding means for encoding input input image information, communication means for communicating the image information encoded by the encoding means via a communication line, and decoding received image information received from the communication means In an image communication apparatus having a decoding means and an output display means for outputting and displaying the input image information and the received image information, a camera is used as the image information input means, and when a document original is imaged and input by the camera, the document A size / direction detecting unit for detecting the size and direction of the document, and the sentence automatically based on the size information and direction information of the document document obtained by the size / direction detecting unit. Movable means for sequentially moving the camera so as to divide the document into a plurality of times, first storage means for sequentially storing the images captured in the plurality of times, and a plurality of times for dividing the plurality of times. An image synthesizing unit for synthesizing the captured image as a whole document original image into one document original image, and the document original image is encoded and transmitted as a still image to a receiving side image communication apparatus as a communication partner via the communication line. Transmitting means for transmitting the whole image of the document original, setting means for automatically setting the focus and zoom adjustment so that the whole area of the document original becomes an image pickup area, and an image of the whole area of the document original. Second storage means for capturing and storing as a still image, and an input image of the entire area of the document original is captured in the second storage means, and the captured image and the second storage means. Comparing means for comparing with the image stored in the storing means, and when the difference of comparison by the comparing means exceeds a reference value, only the image of the portion where the difference is detected is extracted and encoded as a moving image. It is characterized by comprising a transmitting means for transmitting.

In order to achieve the same object, an image communication apparatus according to a second invention (Claim 2) of the present invention is such that, in the image communication apparatus on the side of receiving the encoded moving image, the whole image of the document original image. Resolution display means for decoding the received still image and displaying the resolution of the received moving image, and the document original for decoding the received moving image and displaying the resolution of the decoded moving image Resolution conversion means for converting the resolution to match the resolution of the entire still image, and overlay display means for overlay-displaying the decoded received moving image on the entire still image of the document original. .

In order to achieve the same object, an image communication apparatus according to a third aspect of the present invention (claim 3) is an image information input unit for inputting image information, and the image information input by the image information input unit is static. In an image communication device having an encoding means for encoding as an image and a communication means for communicating the image information encoded by the encoding means via a communication line, a storage means for storing the image information, A comparison means for comparing the image information stored by the storage means with the image information input by the image information input means after the storage of the image information, and the comparison difference by the comparison means is equal to or larger than a reference value. , And a transmission unit that extracts the image area in which the difference is detected, encodes it as a moving image, and transmits the moving image.

In order to achieve the same object, an image communication apparatus according to a fourth invention (Claim 4) of the present invention is the image communication apparatus according to the third invention (Claim 3), wherein the image information input means is the The image information is divided into a plurality of areas, the image information is input for each divided area, and the input image information is combined into one frame image.

In order to achieve the same object, an image communication device of a fifth invention (claim 5) of the present invention is the image communication device of the third invention (claim 3), wherein the image input means is
Detects the size and orientation of the image consisting of the image information,
It is characterized in that it has drive means for controlling the position of the image input means according to the detection result.

To achieve the same object, an image communication apparatus according to a sixth aspect of the present invention (claim 6) is a first receiving means for receiving still image information and a detecting means for detecting the resolution of the still image. A second receiving means for receiving moving image information; a resolution converting means for converting the resolution of the moving image received by the second receiving means so as to match the resolution of the still image; And a display unit for displaying the moving image after the resolution conversion is overlaid and displayed.

In order to achieve the same object, an image communication apparatus according to a seventh invention (claim 7) of the present invention comprises: a first input means for dividing an image into a plurality of areas and inputting each area; Second input means for inputting the entire image, detection means for detecting movement between successive frames of the image input by the second input means, and a plurality of areas input by the first input means Are combined and transmitted as an image of one frame, and when a motion is detected by the detecting unit after the transmission by the first transmitting unit, an image in the image area in which the motion is detected is displayed. It has a 2nd transmission means to transmit.

In order to achieve the same object, an image communication apparatus according to an eighth invention (Claim 8) of the present invention is the image communication apparatus according to the seventh invention (Claim 7), wherein the first transmitting means is It is characterized by having an encoding unit and transmitting an encoded image.

In order to achieve the same object, an image communication device of a ninth invention (claim 9) of the present invention is the image communication device of the seventh invention (claim 7), wherein the second transmitting means is It is characterized by having an encoding unit and transmitting an encoded image.

To achieve the same object, the tenth aspect of the present invention
The image communication apparatus of the invention (Claim 10) is the image communication apparatus of the seventh invention (Claim 7), wherein the first input means is a camera.

To achieve the same object, the eleventh aspect of the present invention
The image communication apparatus of the invention (Claim 11) is the image communication apparatus of the seventh invention (Claim 7), wherein the second input means is a common input means with the first input means. Characterize.

To achieve the same object, the twelfth aspect of the present invention
The image communication apparatus of the invention (Claim 12) is the image communication apparatus of the seventh invention (Claim 7), wherein the image of one frame has a higher resolution than the image input by the second input means. Is characterized in that.

[0027]

Embodiments of the present invention will be described below with reference to the drawings.

(One Embodiment) First, one embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a video conference apparatus as an image communication apparatus according to an embodiment of the present invention. In the figure, 1 is a handset which is one of the voice input / output means of the present device, 2 is a microphone (microphone) which is one of the voice input means of the present device, 3
Is a speaker which is one of the audio output means of this apparatus, and 4 is an audio interface section, which is instructed by a system control section 13 which will be described later.
Switching process for switching between the microphone 2 and the speaker 3, an on / off hook detection process for detecting whether the handset 1 is in an on-hook state or an off-hook state, and an echo is erased when the microphone 2 and the speaker 3 are used as voice input / output means. For example, an echo canceling process for generating a tone, a tone generating process such as a dial tone, a ringing tone, a busy tone, and a ringing tone are performed.

Reference numeral 5 is a voice encoding / decoding unit, which is instructed by the system control unit 13 and is a 64 kbps PCM A-1.
aw / μ-law, 64 kbps / 56 kbps / 48
kbps SB-ADPCM, 16 kbps LD-C
According to voice encoding and decoding algorithms such as ELP,
The transmission voice signal is encoded and the reception voice signal is decoded. Reference numeral 6 is a person camera for inputting a self-portrait and the like, which is one of the image input means of the apparatus, and 7 is a document camera for inputting a document original image and the like, which is another image input means of the apparatus. 8 is a display unit, which is a portrait camera 6
Alternatively, an input image from the document camera 7, an image received from the other party, an operation screen, a shared screen, etc. are displayed. A video interface unit 9 is a switching process for switching between the person camera 6 and the document camera 7, which are image input means, according to an instruction from the system control unit 13, and a display switching for switching display between an input image, a received image, an operation screen, and a shared screen. Processing is performed.

Reference numeral 10 denotes a video editing & processing section, which is a mirror image processing of an input image from the person camera 6, various synthesizing processing of divided input images from the document camera 7, detection processing of a specific image in the input image, input with a received image. It is for performing a combining process with an image, an overlay process of an image with an operation screen instructed by the system control unit 13, graphic data such as pointing information, and the like. Reference numeral 11 denotes a video encoding / decoding unit, which is ITU-T recommendation H.264. The transmission image is encoded and the reception image is decoded according to an encoding algorithm such as H.261. An operation unit 12 includes a keyboard used for inputting control information and various data for controlling the entire apparatus, a mouse for controlling pointing, a touch panel, a digitizer, a trackball, and the like. A system control unit 13 includes a CPU (central processing unit), a ROM (read only memory), a RAM (readable / writable memory), etc., monitors the state of each unit, controls the entire apparatus, and operates / operates according to the state. The display screen is created and the application program is executed.

Reference numeral 14 is a multiplexing / demultiplexing unit, which sends a control command from the system control unit 13 to BA when the ITU-T recommendation is complied with.
S code is converted to ITU-T Recommendation H.264. 221
The BAS code, the audio signal from the audio encoding / decoding unit 5, the image signal from the video encoding / decoding unit 11,
The control signal from the system control unit 13 is multiplexed for each transmission frame, the reception frame is separated into the above-mentioned constituent elements, and each of them is provided with a voice encoding / decoding unit 5 and a video encoding / decoding unit 11. , And to the system control unit 13, respectively. A line interface unit 15 controls a line according to the ISDN user / network interface / PSTN various modem interfaces by exchanging commands with the system control unit 13. Reference numeral 16 denotes a storage unit such as an HD (hard disk) for storing various control information of the entire apparatus, reception / transmission voice information / image information / pre-input document, and the like.
17 is ISDN / PSTN / to which this device is actually connected
A line such as a LAN.

FIG. 2 is a functional block diagram showing a video input / video editing portion from the document camera 7 in the video conference apparatus of FIG. In the figure, reference numeral 101 denotes a camera movement control unit, which controls execution of pan / tilt / zoom operations of the document camera 7 based on an instruction from the system control unit 13. Reference numeral 102 is a document size / direction detection unit that detects the size and direction of a document document placed on a document camera stand (document table), 103 is a video switch that switches the input between the portrait camera 6 and the document camera 7, and 104 is an NTSC. Analog NTS from the person camera 6 and the document camera 7 at the decoder
The C image signal is sampled and digitized so that it can be processed. 105 is an image composition processing unit, which is an NT
An image signal digitized by the SC decoder 104 is stored in a memory 107 described later via a memorial access control unit 108 described below, and then overlay synthesis of divided input images is performed, and a difference / motion detection unit 109 described below calculates a difference / Various image synthesizing processes such as extraction of an image of a portion in which motion is detected are performed.

Reference numeral 106 denotes an image area boundary detection unit which detects a boundary guide indicating an image area from the divided images input by division.
107 is a memory for storing the digitized image, 10
Reference numeral 8 denotes a memory access control unit for controlling access to the memory 107 such as writing / reading, 109 denotes a difference / motion detecting unit, which is an entire image of the document original initially stored in the memory 107, and a document original which is continuously input. The whole image is constantly compared, and whether or not the difference is greater than or equal to a reference value is monitored.When a difference greater than or equal to the reference value is detected, the difference generation image area is cut out, and thereafter, it is also always compared with the difference image. Then, the motion detection is performed, and the input moving image to the video encoding / decoding unit 11 is detected. 110 is the display unit 8
It is a display VRAM (video RAM) for displaying an image on the display.

Although the case where the person camera 6 and the document camera 7 are separately provided is shown for simplification of description, one camera may be used to switch between the person camera mode and the document camera mode. At this time, the video switch 103 operates as an input mode changeover switch. Further, the image composition processing unit 105, the image area boundary detection unit 106, the pointer detection unit 109, etc. may be commonly processed by a high-speed video processor or the like.

FIGS. 3 to 5 are schematic views showing the structure of the upper surface of the document table. In each drawing, 201 is a document camera stand as a document table, and 202 is the document for detecting the size and direction of the document document. A document guide for fixing the document, 203
Reference numerals -1, 203-2, 203-3, 203-4 are slides for moving the document guide 202, and 301 is a center point of the document camera stand 201. 301-P, 301-
L, 301-A4P, 301-A4L, 301-A3
P, 301-A3L is the center point of each document original when various document originals are set on the document camera stand 201.

FIG. 6 to FIG. 10 are conceptual diagrams of the operation / direction of the document camera 7 and the divided input image when the A4 size document original is actually divided into four images.

FIG. 11 is a diagram showing an image of a document original document stored in the memory 107 after division input and combination of an A4 size document original, and in FIG. 11, A1 is a high-resolution A4 landscape image combined after division imaging. Directional document original still image area, A2 is A4 Lateral entire document original still image area to be imaged and stored in the memory 107, a1, b1, c1, d1
Are the divided image areas actually divided and input, A2-
1 is then sequentially input and is compared with the image area A2.
4 document original whole image area, A2-2, in order to detect the sequential movement of the image area A2-1 which is the transmission source image after the difference between the image area A2 and the image area A2-1 exceeds a specified value. Is the entire image area of the document original input. When motion is detected in the image area A2-2 and becomes an input image to the video encoding / decoding unit 11, the image area A2-1 is sequentially replaced.

FIG. 12 shows an actual still image area A2 of an A4 size document original, and an entire image area A2- of an A4 document original.
FIG. 1 is a conceptual diagram in which a pointing moving image is sequentially extracted to a document original by using the entire image area of the document original A2-2.

13 to 17 are flowcharts showing the operation of the video conference apparatus of FIG.

Next, the operation of the video conference apparatus according to the present embodiment will be described with reference to the drawings.

First, in step S1301 of FIG. 13, a document original is set on the document camera stand 201, and the video switch 103 is operated to switch the image input to the document camera mode. Next, in step S1302, the document guide 202 is slid (203-1, 203-2, 203-3, 20).
3-4) Move along and align with the document original. Next, in step S1303, the document size & direction detection unit 102 detects the document size & direction of the document document based on the position of the document guide 202. Next, step S1304.
In step S1332 of FIG. 16, which will be described later, it is determined whether the document original is an A4 horizontal document.
If the document is an A4 horizontal document, the process proceeds to the next step S130.
Go to 5. In step S1305, the orientation of the document camera 7 is switched to a direction suitable for capturing an A4 landscape document by the control of the camera movement control unit 101.

Next, in step S1306, the camera focus & zoom image pickup area for A4 lateral document original image division input is set. Then, first in step S1307,
As shown in FIGS. 6A and 7A, the regions a1 and b
Based on the information stored in the storage unit 16, the system control unit 13 determines to sequentially shoot 1, c1, and d1. Then, first, in order to capture an image of the first read frame region a1, the document camera 7 is pan-tilted to adjust the camera focus to 401-1 in FIG. 7A, and the zoom is performed so that the entire image capturing region matches the region a1. To match. Next, in step S1308, the image of the area a1 is loaded into the memory 107, and the division boundary area guide 403-in FIG.
The image boundary detection unit 1 detects the images 1, 403-5, and 403-8.
It is detected by 06.

The detected image position is notified to the image composition processing unit 105, and based on the document size and direction information of the document document and the memory write address information of the first frame from the system control unit 13, the image composition processing unit 105. Rewrites in the memory 107 in step S1309 so that each boundary guide is set to a fixed memory address. For example, the center of the boundary guide 403-1 is set to the address (X1
1, Y11), the center of the boundary guide 403-5 is the address (X12, Y11), and the center of the boundary guide 403-8 is the address (X11, Y12). Rewriting is performed on the memory 107 via the memory access control unit 108.

Next, in step S1310, the document camera 7 is adjusted to focus the camera on 401-2 in FIG. 7A in order to capture an image of the region b1 of the second read frame.
Is pan-tilted and the zoom is adjusted so that the entire imaging region matches the region b1. Next, in step S1311, the image of the area b1 is loaded into the memory 107, and
Division boundary area guides 403-2 and 403-in (a)
The image boundary detection unit 106 detects images 5 and 403-6. The position of the detected image is set to the image synthesis processing unit 10
5, the image composition processing unit 105 sets each boundary guide to a fixed memory address in step S1312 based on the document size & direction information of the document document and the memory write address information of the second frame from the system control unit 13. So that it is rewritten on the memory 107. For example, the center of the boundary guide 403-2 is set to the address (X13,
Y11), the center of the boundary guide 403-5 at the address (X
12, Y11) and the center of the boundary guide 403-6 are rotated as needed so that the center of the boundary guide 403-6 becomes the address (X13, Y12), and then rewritten on the memory 107 via the memory access control unit 108. I do.

Further, at this time, as shown in FIG. 7B, rectangular regions (X12-2, X12) sandwiching the boundary guide 403-5 are sandwiched.
12-1), (X11-1 / Y11-2, Y12-2 /
Since Y12-1) is captured in the memory 107 in an overlapping manner with the image region captured in the region a1, when the region a1 is written in the memory 107 by the image composition processing unit 105, the image of the rectangular region is Overwrite and write.

Next, in step S1313 of FIG. 14, in order to image the area c1 of the third read frame,
The document camera 7 is pan-tilted to adjust the camera focus to 401-3 in FIG. 7A, and the entire imaging area is the area c1.
Adjust the zoom to match. Next, step S
At 1314, the image of the area c1 is loaded into the memory 107, and at the same time, the division boundary area guide 403-3 in FIG.
The image boundary detection unit 106 converts the images 403-6 and 403-7.
Is detected by The position of the detected image is notified to the image composition processing unit 105, and based on the document size & direction information of the document document and the memory write address information of the third frame from the system control unit 13, the image composition processing unit 105 performs step S1315. Then, rewriting is performed on the memory 107 so that each boundary guide is set to a fixed memory address. For example, the center of the boundary guide 403-3 is the address (X13, Y13), the center of the boundary guide 403-6 is the address (X13, Y12), and the center of the boundary guide 403-7 is the address (X12, Y13). The memory access control unit 10 is also subjected to rotation processing if necessary.
Rewriting is performed on the memory 107 via No. 8.

Further, at this time, as shown in FIG. 7B, a rectangular area (X12-2 / X) sandwiching the boundary guide 403-6 is provided.
12-3, X13-2 / X13-3), (Y12-3,
Y12-2) is the image area captured in the area b1, and rectangular areas (X12-3, X12-1) and (Y12-3, Y).
Since the image of the portion 12-1) is captured in the memory 107 in an overlapping manner with the image region captured in the region a1, the image synthesis processing unit 105 stores the region c1 in the memory 107.
When writing to, the rectangular area is subjected to image overlay processing and written.

Next, in step S1316, the region d1 of the fourth read frame, which is the last frame of the A4 horizontal document original read, is imaged. Therefore, the camera focus should be set to 401-4 in FIG. 7A. The document camera 7 is pan-tilted and the zoom is adjusted so that the entire imaging area matches the area d1. Next, in step S1317, the image of the area d1 is loaded into the memory 107, and
Division boundary area guides 403-4 and 403-in (a)
The image boundary detection unit 106 detects images 7 and 403-8. The position of the detected image is set to the image synthesis processing unit 10
5, the image composition processing unit 105 sets each boundary guide to a fixed memory address in step S1318 based on the document size and direction information of the document document and the memory write address information of the fourth frame from the system control unit 13. So that it is rewritten on the memory 107. For example, the center of the boundary guide 403-4 is set to the address (X11,
Y13), the center of the boundary guide 403-7 is the address (X
12, Y13) and the center of the boundary guide 403-8 is rotated as necessary so that the center of the boundary guide 403-8 becomes the address (X11, Y12), and then rewritten on the memory 107 via the memory access control unit 108. I do.

Further, at this time, as shown in FIG. 7B, a rectangular area (X11-4 / X) sandwiching the boundary guide 403-8 is provided.
11-1, X12-1 / X12-4), (Y12-4,
Y12-1) is an image area captured in the area a1 and a rectangular area (X12-3, X12) sandwiching the boundary guide 403-7.
12-4), (Y13-4 / Y13-3, Y12-3 /
The image of the portion (Y12-4) is the image area captured in the area c1, the rectangular areas (X12-2, X12-4), and (Y
12-2, Y12-4) portion of the image is captured in the memory 107 in an overlapping manner with the image region captured in the region b1, so the image synthesis processing unit 105 stores the region c1 in the memory 107. At the time of writing, the rectangular area is subjected to image overlay processing and then written.

Next, in step S1319, the above 4
The image is divided and imaged, and the image synthesis processing is performed.
The rectangular area (X11, X1 shown in FIG. 11 surrounded by the divided image boundary guides in FIG.
X13), (Y11, Y13), which are registered in advance in the storage unit 16 and from the system control unit 13 to the image synthesis processing unit 10.
Image areas (X1s, X1e) and (Y1
s, Y1e) is displayed as a still image of an A4 horizontal document original in which the entire portion matches the actual A4 horizontal document original VRAM
The data is transferred to 110 and displayed on the display unit 8, treated as an input still image to the video encoding unit 11, and transmitted to the communication partner.

Next, proceeding to step S1320 of FIG. 15, the system control unit 13 causes the camera movement control unit 10 to focus the document camera 7 on FIG. 5301-A4L.
1, and the entire A4 horizontal document original, that is, FIG.
The zoom is set so that the rectangular area portion (X1s → X1e, Y1s → Y1e) shown in FIG.
Next, proceeding to step S1321, the entire area image of the A4 document original is captured as a still image and stored in the memory 107 as the area A2. Next, proceeding to step S1322, it is determined whether or not the document camera mode has ended, and if so, this processing operation ends, and if not ending, step S132.
Proceed to 1323. In this step S1323, the input image from the document camera 7 is continuously fetched in the memory 107, and the difference is constantly compared with the image region A2 fetched as the image region A2-1.

In the camera mode set in step S1320, the entire area image of the A4 document original is written in the memory 107 as the captured image area A2.

Next, in step S1324, the difference between the two image areas A2 and A2-1 allows a predetermined reference value, that is, an image error for each image frame and some fluctuation of the document original. Judgment whether or not the specified value has been reached. When it is determined that the value is equal to or more than the specified value, this is the case when the explainer tries to point to a certain place in the imaged document manuscript by holding it with a pen or a hand, such as A2-1 in FIG. , Area e1 shown in FIGS. 12 (c) and 12 (d)
A part of the hand appears in the part, and a large difference value occurs. This time,
Proceeding to next step S1325, only the region e1 having a large difference value as described above is extracted. Next, step S
In step 1326, only the extracted image area e1 is video-coded and transmitted, and if necessary, an overlay display instruction command for the received video is issued to the communication partner.

As a means for transmitting the moving image only in the area e1 as described above, for example, when the document camera mode is started, a fixed image is provided in the pre-reference frame portion of the moving image encoding unit of the video encoding / decoding unit 11. A uniform image such as (luminance level white, color difference level 0) is input, and
An image in which the captured image is embedded only in the region e1 like the image in the region A2-2 in (d) may be transferred as an input to the moving image encoding unit of the video encoding / decoding unit 11. The overlay start command is not particularly necessary and may always be overlaid.

Next, in step S1327, the display unit 8 on the device side is subjected to enlargement processing so as to match only the extracted moving image portion with the resolution of the area A2 which is already displayed, and then overlayed. indicate. Next, step S
Proceeding to 1328, the received moving image is decoded on the receiving-side display unit 8 and enlarged to match the resolution of the area A2 already received and displayed, and then overlay-displayed. Next, proceeding to step S1329, a moving image is generated on the document original due to the occurrence of a difference equal to or greater than the specified value, and moving image transmission has started. Therefore, the extracted and transmitted image area is stored in the memory 107 as A2. It is stored as -1. next,
In step S1330, the entire image of the document original is continuously captured (A2-2 in FIG. 11), and A in the memory 107 is read.
The data is stored in the area 2-2 and compared with the areas A2 and A2-1.

Next, in step S1332 of FIG. 16, the difference between the image areas A2 and A2-1 is the reference value (specified value).
If it is determined that the difference is within the specified value, the process advances to step S1331, and the image area A2
-1 and the image area A2-1 are subjected to differential moving image coding communication,
Alternatively, in order to simply completely eliminate the moving image, the image initially input as the reference image to the moving image encoding unit of the video encoding / decoding unit 11 is continuously transferred, and then the above-mentioned FIG.
Return to step S1330. If the difference is greater than or equal to the reference value in step S1332 of FIG. 16, the process advances to step S1331 to send a moving image overlay end command to the communication partner device, and at this time, after clearing the image area A2-1. , Step S13 of FIG.
Return to 22.

The above processing is repeated until the document camera mode communication is completed in step S1322.

If the document original detected in step S1304 of FIG. 13 is not the A4 lateral document original, the process proceeds to step S1334 of FIG. 17 and the document original whose orientation of the document camera 7 is detected. Switching to the direction suitable for the size and direction, in the next step S1335, the focus preset position and zoom degree etc. corresponding to each document size and direction are detected and calculated, and accordingly, the captured image and the divided image are sequentially captured. Performs synthesis processing. After that, if a high-resolution whole still image of the document original is acquired, displayed, and transmitted, in the next step S1336, the whole document original image capturing position is focused and zoomed in accordance with the document size and direction to be imaged. Next, in step S1337, the captured image is stored in the memory 107 as a still image, and in the next step S1338, the A4 lateral document original is described as an example, and the steps S1322 to S1 in FIG.
330 and steps S1331 to S1 of FIG.
After the parameters of the portion 333 are replaced with the parameters for each document size and direction and the processing is repeated, the present processing operation is ended.

(Other Embodiments) In the above embodiment, as a camera for inputting image information, a document original for outputting a normal TV image signal such as NTSC / PAL which can be currently obtained at a low price. Although it was described as a high-resolution image acquisition means using a low-resolution camera for imaging, it is still expensive, but it can be applied to a higher-resolution camera such as a digital camera having a resolution of 1.6 million pixels. . For example, if the camera itself is applied to a camera having four times the resolution of the current one, the resolution of A4 document original reading is 200 dpi if it is replaced with a facsimile.
It is possible to a considerable extent, and it is also possible to easily realize an image communication device capable of reading document originals and performing real-time communication with a simple operation and a reading resolution closer to that of a scanner.

[0060]

According to the first and second aspects of the present invention, a still image of a document original can be transmitted / received at high resolution by divisional imaging, and the presenter can point to the document original actually placed on the original table. It is possible to extract the motion of pointing with a pen etc. as moving image information and send it, and to display the same image with overlay display without affecting the high-resolution still image at all, and with very high quality. There is an effect that image communication can be performed, operability is improved, and it can be provided at a low price.

According to the third aspect of the present invention, when the comparison difference between the image information stored by the storage means and the image information input after the storage of the image information is equal to or larger than the reference, the difference is detected. Since the extracted image area is extracted and transmitted, the variation can be transmitted when there is a change in the image, and the amount of transmitted information can be reduced, so that the communication cost can be reduced.

According to the fourth aspect of the present invention, since the image is divided into a plurality of areas and the input image is one frame, it is possible to capture a high resolution image.

According to the invention of claim 5, the image input means detects the size and orientation of the input image information and controls the position of the image input means according to the detection result.
Good image input is possible without the need for complicated operations for the user.

According to the invention of claim 6, when the received still image is received and then the received moving image is overlaid and displayed, the resolution of the still image and the moving image is matched. It becomes possible to display, and a good image can be displayed.

According to the seventh and tenth aspects of the invention, the image is divided into a plurality of regions and input, the plurality of regions are combined, and 1
By using a frame image as a transmission image, it is possible to communicate a high resolution image.

Furthermore, after transmitting one frame of image, only the area where motion is detected is transmitted, so that the amount of communication information can be reduced.

According to the eighth and ninth aspects of the invention, it is possible to transmit an image with a small amount of information.

According to the eleventh aspect of the invention, the device configuration can be simplified.

According to the twelfth aspect of the present invention, the transmitted image can be a higher resolution image than the motion detection image. Therefore, it is possible to communicate a good image with high resolution, and it is possible to prevent the precision of the motion detection from being excessively increased more than necessary by not performing the motion detection with the high resolution image.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a video conference apparatus as an image communication apparatus according to an embodiment of the present invention.

FIG. 2 is a functional block diagram of an image input and processing unit in the video conference device of FIG.

FIG. 3 is a diagram showing a configuration of a document table upper surface on which a document of a document camera is set.

FIG. 4 is a diagram showing a configuration of a document table upper surface on which a document of a document camera is set.

FIG. 5 is a diagram showing a configuration of a document table upper surface on which a document of a document camera is set.

FIG. 6 is a conceptual diagram of an operation / direction of a document camera and a split input image when split-capturing an A4 document original.

FIG. 7 is a conceptual diagram of a divided input image when an A4 document original is divided and imaged.

FIG. 8 is a conceptual diagram of a divided input image when an A4 document original is divided and imaged.

FIG. 9 is a conceptual diagram of divided input images when an A4 document original is divided and imaged.

FIG. 10 is a conceptual diagram of a divided input image when an A4 document original is divided and imaged.

FIG. 11 is a memory storage configuration diagram of a divided captured image, a composite document original image, a difference / motion detection image, and the like.

FIG. 12 is a conceptual diagram of pointing detection on a document document placed on a document table.

13 is a flowchart showing an operation of the video conference device of FIG.

FIG. 14 is a flowchart showing an operation of the video conference apparatus of FIG.

15 is a flowchart showing an operation of the video conference apparatus of FIG.

16 is a flowchart showing an operation of the video conference apparatus of FIG.

17 is a flowchart showing an operation of the video conference device of FIG.

[Explanation of symbols]

6 People Camera (Image Information Input Means) 7 Document Camera (Image Information Input Means) 8 Display Unit (Display Means) 11 Video Encoding / Decoding Units (Encoding Means, Decoding Means) 13 System Control Units (First and Second) Second transmission means, setting means, resolution display means, resolution conversion means 15 Line interface section (communication means) 16 Storage section (first storage means) 102 Original size / direction detection section (size / direction detection means) 105 Image composition Processing unit (image synthesis means, overlay display means) 107 Memory (second storage means) 109 Difference / motion detection section (comparison means)

Claims (12)

[Claims] 1. An image information input unit for inputting image information, an encoding unit for encoding the input image information input by the image information input unit, and a communication line for transmitting the image information encoded by the encoding unit. Communication means for communicating via
An image communication apparatus comprising: a decoding unit that decodes received image information received from the communication unit; and an output display unit that outputs and displays the input image information and the received image information,
A camera is used as the image information input means, and a size / direction detecting means for detecting the size and direction of the document original when the document original is picked up and input by the camera;
Movable means for sequentially moving the camera so as to automatically perform imaging of the document original in a plurality of times based on the size information and the direction information of the document original obtained by the direction detection means; First storage means for sequentially storing the divided and captured images, image synthesizing means for synthesizing the plurality of divided and captured images into one document original image, and the document original image Transmission means for encoding and transmitting as a still image to the receiving side image communication device as a communication partner via the communication line, and for transmitting the whole image of the document original and for making the camera the whole image area of the document original as an imaging area. Setting means for automatically setting the focus and zoom adjustment to the first and second storage means for capturing and storing the image of the entire area of the document original as a still image, and the second storage means. Imaging said second with following incorporation storing the input image of the original document entire region 憶 means as a still image capturing an input image of the original document entire area
Comparing means for constantly comparing the images stored in the storing means, and when the difference in comparison by the comparing means exceeds a reference value, only the image of the portion in which the difference is detected is extracted and coded as a moving image. An image communication device, comprising: a transmission unit that converts the data into a transmission. 2. An image communication device on the side of receiving the encoded moving image, a resolution display unit for decoding a still image received as the entire document original image and displaying a resolution of the received moving image. A resolution conversion unit for decoding the received moving image and converting the resolution of the decoded moving image into a resolution that matches the displayed still image of the entire document original, and on the still image of the entire document original. The image communication apparatus according to claim 1, further comprising overlay display means for overlay-displaying the decoded received moving image. 3. Image information input means for inputting image information, encoding means for encoding the image information input by the image information input means as a still image, and image information encoded by the encoding means. In an image communication apparatus having a communication means for communicating via a communication line, a storage means for storing the image information, the image information stored by the storage means, and the image information input means after the storage of the image information. Comparing means for comparing the image information input by means of: and a transmitting means for extracting the image area in which the difference is detected, encoding as a moving image, and transmitting when the comparison difference by the comparing means is equal to or larger than a reference value. An image communication device comprising: 4. The image information input means divides the image information into a plurality of areas, inputs the image information for each divided area, and combines the input image information into one frame image. The image communication device according to claim 3. 5. The image input means includes drive means for detecting a size and a direction of an image formed of the image information and controlling the position of the image input means according to a detection result. 3. The image communication device according to item 3. 6. A first receiving means for receiving still image information, a detecting means for detecting the resolution of the still image, a second receiving means for receiving moving image information, and a matching means for adjusting the resolution of the still image. In view of the above, there is provided a resolution converting means for converting the resolution of the moving image received by the second receiving means, and a display means for displaying the still image by overlaying the moving image after the resolution conversion. Image communication device. 7. A first input means for dividing an image into a plurality of areas and inputting each area, a second input means for inputting the whole image, and an input by the second input means. Detection means for detecting movement between consecutive frames of an image, first transmission means for synthesizing a plurality of regions input by the first input means, and transmitting the combined image as one frame image; An image communication apparatus comprising: a second transmission unit that transmits an image in an image region in which the movement is detected when the movement is detected by the detection unit after the transmission by the transmission unit. 8. The image communication apparatus according to claim 7, wherein the first transmitting unit has an encoding unit and transmits an encoded image. 9. The image communication apparatus according to claim 7, wherein the second transmitting unit has an encoding unit and transmits an encoded image. 10. The image communication apparatus according to claim 7, wherein the first input unit is a camera. 11. The image communication apparatus according to claim 7, wherein the second input unit is a common input unit with the first input unit. 12. The image communication apparatus according to claim 7, wherein the image of the one frame has a higher resolution than the image input by the second input means.