JP2001103466A - Method and system for image remote transmission reception, image-pickup device and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image remote transmission reception method and its system, that can comparatively easily control a photographing direction of a camera to a target object while a zoom lens is set to a telescopic position remotely and can realize wide-angle photographing at a comparatively low cost, while keeping the image resolution of an object placed in the middle, to some degree. SOLUTION: A camera section 200 independently processes image signals from CCD sensors 9, 16, A/D converters 19, 20 convert the processed signals into digital signals, image memories 23, 24 store the digital image signals, an MPU 27 discriminates a magnification of the stored picked-up image in the image memories 23, 24, and magnification discrimination information that is discriminated is fed to a reception display device with image data. The reception display device expands compressed image data received from the camera section 200, composites the received images on the basis of the magnification discrimination information received after the expansion and displays the composited image on a screen.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to, for example, a remote imaging device in which a camera directly connectable to a line such as a local area network (LAN) is used as a remote imaging device. The present invention relates to a remote imaging transmission / reception method and system for performing remote imaging transmission / reception by a system, an imaging apparatus, and a storage medium storing a control program for controlling the remote imaging transmission / reception system.

[0002]

2. Description of the Related Art FIG. 14 shows a configuration of a camera as a remote imaging device in a conventional remote imaging transmission / reception system of this kind.

In FIG. 1, reference numeral 100 denotes an exterior cover of a camera, 101 denotes a lens unit, and 102 denotes a front lens.
It is arranged on the front surface of the lens unit 101. 103
Is a focus lens, 104 is a zoom lens, 105 is an iris blade for controlling the amount of light, and 106 is a focus motor, which is a motor for moving the focus lens 103. Reference numeral 107 denotes a zoom motor which moves the zoom lens 104. Reference numeral 108 denotes an iris motor which moves the iris blade 105, and the movement of the iris blade 105 controls the amount of light to a CCD sensor 109, which is an imaging unit described later. A CCD sensor 109 includes a focus lens 103 and a zoom lens 104.
The optical signal that has passed through is converted into an electric signal.

Reference numeral 110 denotes a CSD (correlated double sampling circuit) / AGC (automatic gain control circuit) circuit. 111
Is an A / D converter, 112 is a process circuit for performing digital image processing, 113 is an image memory (luminance memory / color difference memory) for luminance component Y and color component C, 11
Reference numeral 4 denotes an image compression circuit which compresses the amount of digital data in the image memory 113. 115 is an operation timing generator (TG: Timing Generator)
er), the operation timing of the CCD sensor 109 is generated. 116 is SSG (Standard Signa)
l Generator) to generate a horizontal / vertical synchronization signal or the like from the timing signal of the TG 115.
117 is an MPU (Micro Processing)
(Unit: micro-computer), which controls the operation of the camera.

Reference numeral 118 denotes a memory controller (Memor
y Controller) controls writing / reading to / from the image memory 113 in accordance with the timing signal of the SSG 116. 119 is a data packet circuit, 120 is a network interface (Net)
work I / F).

In the lens unit 101, the optical signal of the subject causes the focus sensor 103 and the zoom lens 104 to form an image on the CCD sensor 109 with high accuracy according to the control data of the MPU 117. At this time, CC
In order to limit the light amount within the minimum and maximum (dynamic range) of the D sensor 109, the opening of the iris blade 105 is changed by the iris motor 108, and the appropriate light amount
Adjust so that it enters the sensor 109.

[0007] The optical signal of the subject is irradiated to the CCD sensor 109 for an appropriate time, and the CCD sensor 109 photoelectrically converts the light energy and stores it as an electrical signal.
The stored electric signals are sequentially read out in field units according to the clock of the TG 115, and are read out by the CSD / AGC.
The circuit 110 performs correlated double sampling and gain adjustment. The analog video signal accumulated for each pixel of the CCD sensor 109 is sequentially converted into digital data by the A / D converter 111.

A process circuit 112 digitally performs predetermined color processing, white balance adjustment processing, and the like on the digital image signal, and outputs a Y, U / V digital signal, which is a digital video signal adjusted to an appropriate level. Output. In the process circuit 112, the lens unit 1
01 to extract the sharpness signal etc. necessary to drive
Output to MPU 117.

[0009] Y, U /
The V digital signal is synchronized with a vertical (V) / horizontal (H) synchronization signal and a pixel timing signal from the SSG 116,
The image data is temporarily stored in the image memory 113 in accordance with the address / write clock created by the memory controller 118.

On the other hand, from the image memory 113, the image compression circuit 114, which is sequentially read in accordance with the read timing control signal of the memory controller 118, performs MJ
The image is subjected to image compression processing such as PEG, and sent to a receiving PC (not shown) by a data packet circuit 119 according to a LAN (local area network) protocol such as TCP / IP. The compressed image data is sequentially read from the packet data by the application software started on the PC, and the software image is decompressed and displayed on the monitor screen.

[0011]

However, in the conventional example described above, when the zoom lens 104 is on the high magnification side such as 12 times, it is necessary to remotely direct the image pickup direction of the camera to a target subject. If the imaging range is very narrow and the bandwidth of the line is small, or if the line delay is large, it is very difficult and takes much time to point the camera at the target subject. Alternatively, once the zoom lens 104 is moved from the tele side to the wide side, the zoom lens 104 is moved to the tele side while controlling the direction of the camera so that the subject is always located at the center. The subject was adjusted to the desired size on the shooting screen. In addition, when photographing an entire subject including a plurality of persons from a certain distance, to photograph a person near the center with a certain image quality, an expensive camera using three CCD sensors 109 or a camera such as a high-definition television is used. There was no way but to use it.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems of the prior art, and a first object of the present invention is to set a zoom lens at a telephoto position while maintaining a target position. Provided is a method and system for remotely transmitting and receiving an image in which a photographing direction of a camera can be relatively easily controlled remotely for a subject to be photographed, and wide-angle photographing can be realized at a relatively low cost while maintaining the image resolution of a central subject to some extent. It is in.

It is a second object of the present invention to provide an image pickup apparatus most suitable for the above-mentioned system.

A third object of the present invention is to provide a storage medium storing a control program for controlling the above-mentioned image remote transmission / reception system of the present invention.

[0015]

According to a first aspect of the present invention, there is provided a remote image transmitting / receiving method according to the first aspect of the present invention. An image remote transmission / reception method for remotely transmitting / receiving an image by an image remote transmission / reception system comprising a reception / display device for receiving / displaying an image, wherein the remote imaging device side receives image signals from two independent image sensors, respectively. A signal processing step of independently processing, an A / D conversion step of digitizing a signal processed by the signal processing step, and digital images converted by the A / D conversion step are separately stored in memory means. A memory step, an enlargement ratio determining step of determining an enlargement ratio of the captured image stored in the memory unit on the memory unit, and And transmitting the determined enlargement ratio discrimination information together with the image data to the reception display device, which is a receiving end, and expands the compressed image data received from the remote imaging device on the reception display device side. A decompression process, a synthesis process of synthesizing the received image based on the received enlargement ratio determination information after decompression by the decompression process, and a display process of displaying an image synthesized by the synthesis process on a screen. Features.

According to a second aspect of the present invention, there is provided an image remote transmitting / receiving method according to the first aspect, wherein the communication line is a local area network. And

According to a third aspect of the present invention, there is provided an image remote transmitting / receiving method according to the first aspect, wherein the remote imaging device is a camera. I do.

According to a fourth aspect of the present invention, there is provided an image remote transmitting and receiving method according to the first aspect, wherein the receiving and displaying device is a personal computer. And

According to a fifth aspect of the present invention, there is provided an image remote transmitting / receiving method according to the first aspect, wherein the image pickup device is a CCD sensor. I do.

According to a sixth aspect of the present invention, there is provided an image remote transmitting and receiving method according to the first aspect of the present invention, wherein the enlargement ratio determining step comprises the step of: (Autofocus) The enlargement ratio determination process is performed after the completion of the operation.

According to a seventh aspect of the present invention, there is provided an image remote transmission / reception system which can be directly connected to a communication line, and receives and displays a captured image transmitted from the remote imaging device. An image remote transmission / reception system comprising a reception display device, wherein the remote imaging device side includes signal processing means for independently processing image signals from two independent image sensors, and the signal processing means. A / D conversion means for digitizing the processed signal, memory means for separately storing digital images converted by the A / D conversion means, and the memory means for picked-up images stored in the memory means The enlargement ratio discriminating means for discriminating the above enlargement ratio, and the enlargement ratio discrimination information discriminated by the enlargement ratio discriminating device are displayed on the reception display device, which is a receiving end. Sending means for sending the data together with the data, and the receiving and displaying device includes, on the receiving display device side, expanding means for expanding the compressed image data received from the remote imaging device, and the received enlargement ratio discrimination information after expansion by the expanding means. And a display unit that displays an image synthesized by the synthesis unit on a screen based on the received image.

In order to achieve the first object, an image remote transmission / reception system according to claim 8 is provided.
It is a local area network.

According to a ninth aspect of the present invention, there is provided an image remote transmitting / receiving system according to the ninth aspect, wherein the remote imaging device is a camera. I do.

According to a tenth aspect of the present invention, there is provided an image remote transmitting and receiving system according to the seventh aspect, wherein the receiving and displaying device is a personal computer. And

In order to achieve the first object, an image remote transmission / reception system according to claim 11 is the image remote transmission / reception system according to claim 7, wherein the enlargement ratio discriminating step is performed by using the AF of the remote imaging device. (auto focus)
It is characterized in that the enlargement ratio discrimination processing is executed after waiting for the end of the operation.

According to a twelfth aspect of the present invention, there is provided a remote image transmitting / receiving method for directly connecting to a communication line, and receiving and displaying a captured image transmitted from the remote image capturing apparatus. A remote image transmitting and receiving method for remotely transmitting and receiving an image by an image remote transmitting and receiving system comprising a receiving and displaying device, wherein a splitting step of splitting light from a lens into first and second lights on the remote imaging device side. A first introducing step of introducing the first light branched by the branching step into a first image sensor after passing through a lens having a fixed magnification / focal length; and a second introducing step by the branching step.
A second introducing step of introducing the light of the second type into the second image sensor after passing through a variable magnification / focal length lens, and a process of processing the image signals of the first and second image sensors as a luminance signal and a color signal. A processing step, an A / D conversion step of A / D converting the image signal processed by the processing step, and a digital image converted by the A / D conversion step into first image memory means and A memory step of separately storing in the second image memory means, and detecting an enlargement ratio and position coordinates of the first image and the second image respectively stored in the first image memory means and the second image memory means. And detecting the images stored in the first image memory means and the second image memory means in the receiving display device at the receiving end at independent compression ratios by the detecting step. A transmitting step of transmitting the compressed image data received from the remote imaging device, and a receiving step of transmitting the received enlarging ratio after decompressing the compressed image data received from the remote imaging device. And a display step of displaying an image synthesized by the synthesis step on a screen.

According to a thirteenth aspect of the present invention, there is provided an image remote transmitting and receiving method according to the twelfth aspect, wherein the communication line is a local area network. And

According to a fourteenth aspect of the present invention, there is provided an image remote transmission / reception method according to the twelfth aspect, wherein the remote imaging device comprises:
It is a camera.

According to a fifteenth aspect of the present invention, there is provided a remote image transmitting and receiving method according to the twelfth aspect, wherein the receiving and displaying device comprises:
It is a personal computer.

In order to achieve the first object, a method for remotely transmitting and receiving an image according to claim 16 is the method for remotely transmitting and receiving an image according to claim 12, wherein:
It is a D sensor.

In order to achieve the first object, a remote image transmitting and receiving method according to a seventeenth aspect is characterized in that the branching means is a prism. .

According to another aspect of the present invention, there is provided an image remote transmitting / receiving method as set forth in claim 12, wherein the magnification ratio discriminating step is performed by using the AF of the remote imaging apparatus. (Autofocus) The enlargement ratio determination process is performed after the completion of the operation.

In order to achieve the first object, an image remote transmission / reception system according to a nineteenth aspect of the present invention provides a remote imaging device which can be directly connected to a communication line, and receives and displays an image transmitted from the remote imaging device. An image remote transmission / reception system, comprising: a reception unit that transmits light from a lens to first and second light; and a remote unit that transmits light from a lens to the remote imaging device. First introducing means for introducing the first light into the first image sensor after passing through a fixed magnification / focal length lens, and passing the second light branched by the branching means after passing through a variable magnification / focal length lens A second introduction unit for introducing into the second imaging device, a process processing unit for processing the imaging signals of the first and second imaging devices as a luminance signal and a color signal, and processing by the processing unit The image signal A / D conversion A /
D conversion means, first image memory means and second image memory means for separately storing respective digital images converted by the A / D conversion means, and the first image memory means and the second image Detecting means for detecting an enlargement ratio and a position coordinate of the first image and the second image respectively stored in the memory means; and detecting the images stored in the first image memory means and the second image memory means, respectively. Sending means for sending, together with the detection information detected by the detecting means, to the receiving display device, which is a receiving end, at an independent compression ratio, and the receiving display device has a compressed image received from the remote imaging device. Decompression means for decompressing data, synthesizing means for synthesizing the received image based on the enlargement ratio received after decompression by the decompression means, and displaying the image synthesized by the synthesizing means on the screen And having a display means for displaying.

In order to achieve the first object, an image remote transmission / reception system according to claim 20 is provided.
3. The image remote transmission / reception system according to claim 1, wherein the communication line is a local area network.

To achieve the first object, an image remote transmission / reception system according to claim 21 is provided.
In the image remote transmission / reception system described above, the remote imaging device is a camera.

Further, in order to achieve the first object, an image remote transmitting / receiving system according to claim 22 is provided.
In the image remote transmission / reception system described above, the reception display device is a personal computer.

In order to achieve the first object, an image remote transmission / reception system according to claim 23 is provided.
In the image remote transmission / reception system described above, the imaging device is a CCD sensor.

Further, in order to achieve the first object, an image remote transmitting / receiving system according to claim 24 is provided.
In the image remote transmission / reception system described above, the branching means is a prism.

In order to achieve the first object, an image remote transmitting / receiving system according to claim 25 is provided.
In the above described remote image transmission / reception system, the enlargement ratio discriminating step is characterized by executing an enlargement ratio discriminating process after waiting for an end of an AF (auto focus) operation of the remote imaging device.

According to another aspect of the present invention, there is provided an image apparatus according to claim 26, wherein the signal processing means independently processes image signals from two independent image pickup devices, and the signal processing means. A / D conversion means for digitizing a signal processed by the A / D converter, a memory means for separately storing each digital image converted by the A / D conversion means, and a memory for a picked-up image stored in the memory means And an enlargement ratio discriminating unit for judging the enlargement ratio on the means.

In order to achieve the second object, an image pickup apparatus according to claim 27 is the image pickup apparatus according to claim 26, wherein the enlargement ratio discrimination information determined by the enlargement ratio discrimination means is transmitted via a network. And sending means for sending to the reception display device.

In order to achieve the second object, an image pickup apparatus according to claim 28 is a device for splitting light from a lens into first and second light, and split by the splitting device. First introducing means for introducing the first light into the first image sensor after passing through a lens having a fixed magnification / focal length, and passing the second light branched by the branching means through a variable magnification / focal length lens. A second introduction unit for introducing the image signals of the first and second image pickup devices into a luminance signal and a color signal later, and an image processed by the process processing unit. A / D signal
A / D conversion means for converting, image memory means for storing first and second digital images imaged by the first and second imaging elements and digitally converted by the A / D conversion means, Detecting means for detecting the enlargement ratio of the first and second images stored by the image memory means and the position of the image area relatively corresponding to each other.

According to a twenty-ninth aspect of the present invention, there is provided an imaging apparatus according to the twenty-ninth aspect, wherein the first and second images detected by the detecting means are enlarged. It is characterized by having sending means for sending information on the ratio and the position of the image area corresponding to the ratio.

According to a third aspect of the present invention, there is provided a storage medium comprising: a remote imaging device which can be directly connected to a communication line; and a receiving device which receives and displays a captured image transmitted from the remote imaging device. A storage medium storing a control program for controlling an image remote transmission / reception system including a display device, wherein the control program is executed on the remote imaging device side, and is executed on the reception display device side. Control program,
A control program executed on the remote imaging device side includes a signal processing module that independently processes image signals from two independent image sensors, and an A / A that digitizes a signal processed by the signal processing module. A D conversion module, a memory module for separately storing each digital image converted by the A / D conversion module in a memory unit, and determining an enlargement ratio of a captured image stored in the memory unit on the memory unit And a sending module for sending the enlargement ratio determination information determined by the enlargement ratio determination module together with the image data to the reception display device, which is a receiving end, which is executed on the reception display device side. A control program for expanding the compressed image data received from the remote imaging device. Module, a combining module that combines the received image based on the received enlargement ratio discrimination information after decompression by the decompression module, and a display module that displays an image combined by the combination module on a screen. I do.

In order to achieve the third object, a storage medium according to claim 31 is the storage medium according to claim 30, wherein the communication line is a local area network.

In order to achieve the third object, a storage medium according to claim 32 is the storage medium according to claim 30, wherein the remote imaging device is a camera.

In order to achieve the third object, a storage medium according to claim 33 is the storage medium according to claim 30, wherein the reception display device is a personal computer.

In order to achieve the third object, a storage medium according to claim 34 is the storage medium according to claim 30, wherein the image pickup device is a CCD sensor.

In order to achieve the third object, a storage medium according to claim 35 is characterized in that, in the storage medium according to claim 30, the branching means is a prism.

In order to achieve the third object, the storage medium according to claim 36 is the storage medium according to claim 30, wherein the enlargement ratio determination module is an AF (autofocus) of the remote imaging device. It is characterized in that the enlargement ratio discrimination processing is executed after waiting for the end of the operation.

According to a third aspect of the present invention, there is provided a storage medium comprising: a remote imaging device which can be directly connected to a communication line; and a reception device which receives and displays a captured image transmitted from the remote imaging device. A storage medium storing a control program for controlling an image remote transmission / reception system including a display device, wherein the control program is executed on the remote imaging device side, and is executed on the reception display device side. Control program,
The control program executed on the remote imaging device side includes a branch module that branches light from a lens into first and second lights, and a first light that is branched by the branch module and that has a fixed magnification / focal length. A first introduction module that introduces the first light into the first image sensor after passing through the lens, and a second module that introduces the second light branched by the branch module into the second image sensor after passing through the variable magnification / focal length lens. An introduction module, a processing module that processes the imaging signals of the first and second imaging elements as a luminance signal and a color signal, and an A / D that performs A / D conversion of the image signal processed by the processing module. A conversion module; and a digital image converted by the A / D conversion module.
A memory module separately stored in the image memory means of
A detection module for detecting an enlargement ratio and a position coordinate of the first image and the second image stored in the first image memory and the second image memory, respectively; And a sending module for sending the images stored in the image memory means to the receiving display device, which is the receiving end, at an independent compression ratio together with the detection information detected by the detecting module. A control program executed by the decompression module for decompressing the compressed image data received from the remote imaging device; a synthesis module for synthesizing the received image based on the received enlargement ratio after decompression by the decompression module; A display module for displaying an image synthesized by the synthesis module on a screen.

In order to achieve the third object, a storage medium according to claim 38 is the storage medium according to claim 37, wherein the communication line is a local area network.

In order to achieve the third object, a storage medium according to claim 39 is the storage medium according to claim 37, wherein the remote imaging device is a camera.

In order to achieve the third object, a storage medium according to claim 40 is the storage medium according to claim 37, wherein the reception display device is a personal computer.

In order to achieve the third object, the storage medium according to claim 41 is characterized in that, in the storage medium according to claim 37, the imaging element is a CCD sensor.

In order to achieve the third object, a storage medium according to claim 42 is the storage medium according to claim 37, wherein the branching means is a prism.

In order to achieve the third object, a storage medium according to claim 43 is provided.
3. The storage medium according to claim 2, wherein the storage medium is a floppy disk.

In order to achieve the third object, a storage medium according to claim 44 is provided in accordance with claims 30 to 41 or 4.
3. The storage medium according to claim 2, wherein the storage medium is a hard disk.

Further, in order to achieve the third object, the storage medium according to claim 45 is a storage medium according to claims 30 to 41 or 4
3. The storage medium according to claim 2, wherein the storage medium is an optical disk.

In order to achieve the third object, a storage medium according to claim 46 is provided.
3. The storage medium according to claim 2, wherein the storage medium is a magneto-optical disk.

In order to achieve the third object, a storage medium according to claim 47 is provided in accordance with claims 30 to 41 or 4
3. The storage medium according to claim 2, wherein the storage medium is a CD-R.
OM (Compact Disk Read Only)
Memory).

In order to achieve the third object, a storage medium according to claim 48 is provided according to claims 30 to 41 or 4
3. The storage medium according to claim 2, wherein the storage medium is a CD-R.
(Compact Disk Recordable)
It is characterized by being.

In order to achieve the third object, a storage medium according to claim 49 is provided according to claims 30 to 41 or 4
3. The storage medium according to claim 2, wherein the storage medium is a magnetic tape.

In order to achieve the third object, the storage medium according to the fiftyth aspect is characterized in that:
3. The storage medium according to claim 2, wherein the storage medium is a nonvolatile memory card.

Further, in order to achieve the third object, the storage medium according to claim 51 is provided in accordance with claims 30 to 41 or 4
3. The storage medium according to claim 2, wherein the storage medium is a ROM.
(Read Only Memory) chip.

[0066]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) First, the first embodiment of the present invention will be described.
The embodiment will be described with reference to FIGS.

FIG. 1 is a block diagram showing a configuration of a camera unit as a remote image pickup device for inputting an image in the image remote transmission / reception system according to the present embodiment. In the figure, 200 is a camera unit, 1 is an exterior cover of the camera unit 200, 2 is a lens unit, 3 is a single focus CCD unit, 4 is a zoom / AF CCD unit, 5 is a front lens, and the front surface of the lens unit 2 Are located in Reference numeral 6 denotes a prism, which is a spectroscope, which separates light from a subject into the zoom lens 15 and the single focus lens unit 2a. Reference numeral 7 denotes a mirror for guiding the subject light from the prism 6 to the single focus lens unit 2a. Reference numeral 8 denotes a single focus lens in the single focus lens unit 2a, and 9 denotes a first CCD sensor in the single focus lens unit 2a.

A focus motor 10 moves the focus lens 14 in the lens unit 2. A zoom motor 11 moves the zoom lens 15 in the lens unit 2. Reference numeral 12 denotes an iris blade for controlling the amount of light, which is moved by an iris motor (not shown) to control the amount of light to the CCD sensor 109. 14 is a focus lens in the lens unit 2,
It operates according to a command from the MPU 27 described later. Reference numeral 15 denotes a zoom lens in the lens unit 2, which is an MPU described later.
It operates according to the command from 27. Reference numeral 16 denotes a second CCD sensor in the lens unit 2, which converts an optical signal passing through the focus lens 14 and the zoom lens 15 into an electric signal.

Reference numeral 17 denotes a first CSD (correlated double sampling circuit) / AGC (automatic gain control circuit) circuit, and reference numeral 18 denotes a second CSD (correlated double sampling circuit) / AGC (automatic gain control circuit) circuit. . Reference numeral 19 denotes a first A / D converter which converts an analog signal from each pixel of the first CCD sensor 9 into a digital signal at high speed, and 20 denotes a digital signal which converts an analog signal from each pixel of the second CCD sensor 16 into a digital signal. A second A / D converter 21 for high-speed conversion is a first process (Pro) for a single focus camera CCD for digital image processing.
process) circuit, a second process (Process) circuit for a zoom lens for digital image processing, a first image memory (luminance memory / color difference memory) 23 for a luminance component Y and a color component C, and a luminance component Y And a second image memory (luminance memory / color difference memory) 25 for the color component C, and a timing generator (TG: Timing Generator) for regulating the operation timing of accumulation / readout of the first CCD sensor 9 and the second CCD sensor 16.
r), 26 are SSG (Standard Signal)
A horizontal / vertical synchronization signal or the like is generated from the timing signal of the TG 25.

Reference numeral 27 denotes an MPU (Micro Processes).
A sing Unit (small processing unit) for controlling the operation of the camera unit 200. 28 is a memory controller,
This controls writing / reading to / from the first image memory 23 and the second image memory 24 in accordance with the timing signal of the SSG 26. Reference numeral 29 denotes an enlargement ratio calculating circuit, which stores the first image memory 23 from the wide-angle fixed focus camera unit 200.
The enlargement ratio of the image in the image memory and the image in the second image memory 24 from the zoom camera unit 200 is calculated.

Reference numeral 30 denotes a first image compression circuit which compresses the amount of digital data in the first image memory 23. Reference numeral 31 denotes a second image compression circuit which compresses the amount of digital data in the second image memory 23. A data multiplexing circuit 32 multiplexes the image data from the first image compression circuit 30 and the second image compression circuit 31, the enlargement ratio data from the enlargement ratio calculation circuit 29, and the combined address information. Reference numeral 33 denotes a LAN (local area network) 10Base-T or 10
Network interface (Network I) as a LAN line interface such as 0Base-T.
/ F).

In the present embodiment, a wired network has been described as an example, but the same effect can be expected even when a wireless line using radio waves or light is used. The same applies not only to a local network but also through a WAN or the Internet.

FIG. 2 is a view showing a configuration of a camera platform for mounting the camera unit 200 shown in FIG. 1. In FIG. 2, reference numeral 34 denotes a camera platform for mounting and fixing the camera unit 200. , 35 are pan (PAN) motors, 36 is tilt (Ti)
(lt) Motors, the platform 35 is operated by these motors 35 and 36.

FIG. 3 is a diagram showing a configuration of an image remote transmission / reception system according to the present embodiment. In FIG.
Reference numeral 0 denotes a camera unit serving as a remote imaging device serving as an image input unit, and is a LAN (Local Area Network).
It is connected to a line 205 via a LAN connector 209. Then, each camera 200 multiplexes the compressed image data, the enlargement ratio, the combined position coordinates, and the like by a method described later, and transfers the data to the LAN line 205 as needed. 201 is a server, 202 is browser application software, 203
Is a PC (personal computer) as a reception display device, and 204 is a network board (Network).
Board), 205 is a LAN (Local Area)
Network), 206 is a first subject, 207 is a second subject, and 208 is a third subject. PC203
The browser application software 202 stores a data string in which the destination IP address 231 is the IP address of the PC 203 itself as shown in FIG.
5, the image data is expanded in reading order.

FIG. 4 shows a camera section 20 according to this embodiment.
0 is a diagram showing multiplexed data created at the time of transmission. In the same figure, 220 is Preamble, 221 is Ver
area, ServiceType 223, FrameLength 223, identifier 224, flag 225, FragmentOffset 227
Is the lifetime, 228 is the protocol, 229 is the header checksum, 230 is the source IP address, 231 is the destination IP address, 232 is DataUnit, and 233 is P
ad, 234 are the FCS, 235 is the Data column identification code, 236 is the data length of the compressed image data of the first camera, 237 is the enlargement ratio, 238 is the address information ADR Inf for synthesis, and 239 is the first camera. N-th packet of the compressed data of the image No. 240 is the second Dat
a length, 241 is the M-th packet of the compressed data of the image of the second camera, 242 is a code indicating an initial packet, intermediate packet, or completion packet of image data, audio data, or graphic data, 243 is a Packet
tID.

Then, as a data string including the destination IP address 231 and the transmission source IP address 230, H320
And H323, etc., arranged in a data sequence promised to the receiving side,
The data is sent to a line such as an ISDN or a LAN via the network I / F 33. Receiving PC 203 (see FIG. 2)
Reads out the data string of the destination to the user from the line, decompresses the compressed image data, sequentially records the frame in the image memory in the video board inside the PC 203, outputs the frame to the monitor, and outputs the data to the monitor from a remote location. A live image from the camera unit 200 connected to 205 can be confirmed.

Next, the operation of the camera unit 200 having the above configuration will be described with reference to FIG.

Light from a subject (not shown) enters the lens unit 2 through the front lens 5 of the camera unit 200, and is separated by the prism 6 into a straight wave and a reflected wave.
The reflected wave is guided to a single focus lens 8 by a mirror 7 and forms an image on an imaging surface of a first CCD sensor 9. The first CCD sensor 9 is adjusted to an appropriate level by an exposure control circuit (not shown) such as an electronic shutter and a first CDS / AGC circuit 17, and is read out line by line in accordance with a read timing clock of the TG 25. It is sampled and held, and the first A / D converter 19 sets the SSG 26
Is digitized in pixel units in accordance with the timing signal. The digital pixel data guided to the first process circuit 21 is calculated in the order of the luminance signal and the color difference signal, and is stored in the first image memory 23 at the address and timing designated by the memory controller 28.

On the other hand, the straight wave passing through the prism 6 is focused by the focus lens 14 and the zoom lens 15 on the imaging surface of the second CCD sensor 16 so that the MPU 2
Reference numeral 7 drives the focus motor 10 and the zoom motor 11 according to the in-focus state. An iris motor (not shown) is controlled to adjust the opening and closing of the iris blades 12 so that the amount of light irradiation from the subject to the second CCD sensor 16 is limited and an appropriate exposure is obtained. Thereby, an appropriate amount of light is incident on the second CCD sensor 16.

The electric signal of the subject stored in the second CCD sensor 16 is read out line by line in the same manner as the first CCD sensor 9 in accordance with the read timing clock from the TG 25, and is sampled and held. A / D
The data is digitized by the converter 19 in pixel units in accordance with the timing signal of the SSG 26. Second process circuit 2
The digital pixel data guided to 2 is calculated in the order of the luminance signal and the color difference signal, and is stored in the second image memory 24 at the address and timing designated by the memory controller 28.

FIG. 5 shows the first image memory 23 shown in FIG.
FIGS. 3A and 3B are diagrams showing an example of an image stored in a second image memory 24. FIG. 2A shows an example of an image in a first image memory 23, and FIG. 2B shows a second image memory. An example of the image in 24 is shown.

Further, the case where the number of pixels of the first image memory 23 and the second image memory 24 is 640 × 480 pixels (VGA) with the same weight in the vertical and horizontal directions and a pixel ratio of 4: 3 will be described as an example. I do.

In FIG. 5A, reference numeral 40 denotes an image in the first image memory 23; 41, a dotted frame shown in the image 40 stored in the first image memory 23; FIG. 1 (see FIG. 1) shows an image pickup range, which corresponds to the image 43 in the second image memory 24 shown in FIG. Also, in FIG.
Is the second camera 200 in the image of the first camera 200
(Xc, Yc), (Xc
(1, Y1) and 44 are hut doors. FIG. 5 (b)
, 43 is an image in the second image memory 24.

Hereinafter, a method of deriving an imaging range (dotted frame 41) corresponding to the image 43 in the second image memory 24 in the image stored in the first image memory 23 will be described with reference to FIGS. Will be explained.

FIG. 6 is a diagram for explaining a method of creating template data from an image stored in the first image memory 23.

First, a horizontal line and a vertical line passing through the coordinates (M, N) are respectively selected from images stored in the first image memory 23. For example, in the present embodiment, a horizontal line passing through the luminance data (Xc, Yc) = (320, 240) at the center (see FIG. 5A) of the image stored in the first image memory 23 as a default. (M line in FIG. 6A) and a vertical line (FIG.
(N line of (a)) are selected.

Then, as described below, the first image memory 2
In the horizontal line coordinates selected from the images stored in No. 3 as the q-th template in the horizontal direction, the coordinates are from coordinates 1 + 4 (q-1) to coordinates 640-4 (q-1). Define.

First template (see FIG. 6B) Tm1 (x) = f (P (1,1), P (1,2),..., P (1,640) Second template (See FIG. 6 (c)) Tm2 (x) = f (P (1,5), P (1,6),..., P (1,636)... Q-th template Tmq (x) = f ( P (q, 4q-3), P (q, 4q-2), ..., P (q, 644-4q) ... 73rd template (see Fig. 6 (d)) Tm73 (x) = f (P (73, 293), P (73, 294),..., P (1, 348).

That is, the q-th template in the horizontal direction is a selected horizontal line (M line in FIG. 6A).
This is a set of pixels obtained by scaling 40 pieces of pixel information as 640-2 × (q-1) pieces of pixel information.

In the present embodiment, the zoom lens 16
The creation of the 73rd template has been completed based on the drive limit relationship (see FIG. 1).

Next, the horizontal pixel data of the image stored in the second image memory 24 is, for example, shown in FIG. 7 so as to correspond to each horizontal template created as described above. Is performed to allocate pixel data.

Here, the calculation of FIG. 7 will be described.

(The horizontal pixel density of the image stored in the second image memory) / (The horizontal pixel density of the image stored in the first image memory) = (the pixel density in the second image memory) Since the number of pixel data in the stored image in the horizontal direction) / (the number of assignments in the q-th horizontal template) = 640 / (640-8 (q-1)), the first When corresponding to the coordinates and number of pixel data in the horizontal direction of the image stored in the image memory 23, the i-th pixel Xq of the q-th template
The coordinates of (i) can be expressed as follows: Xq (i) = i × 640 / (640-8 (q−1)).

Here, when Xq (i) is an integer, the pixel data in the horizontal direction of the image stored in the second image memory 24 corresponding to the obtained coordinates (the first template Ym1 (x ) With the same density interval as Xq
(I).

However, if Xq (i) is not an integer, the second image memory 24 adjacent to the obtained coordinates
Xq (i) may be obtained by performing weighting evaluation on pixel data in the horizontal direction of the image stored in.

For example, as shown in the following equation (1), Xq
If the coordinates of (i + 1) exist between X (i + 2) and X (i + 3), Xq (i + 1) is obtained by weighting the pixel data of X (i + 2) and X (i + 3). Good Xq (i + 1) = X (i + 2) × b1 + X (i + 3) × a1) / (a1 + b1) (1) In the above formula (1), a1 and b1 are X
It is the distance from q (i + 1) to X (i + 2), X (i + 3).

Similarly, in Xq (i + 2),
If the coordinates exist between X (i + 4) and X (i + 5), Xq (i + 2) may be obtained using the following equation (2).

Xq (i + 2) = X (i + 4) × b2 + X (i + 5) × a2) / (a2 + b2) (2) In the above formula (2), a2 and b2 are X
It is the distance from q (i + 2) to X (i + 4), X (i + 5).

The q-th template data Tmq (x) thus rearranged is expressed as follows: Tmq (x) =
f (Xq (1), Xq (2), ..., Xq (i), ...).

Similarly, a selected vertical line (see FIG. 6A) of the image stored in the first image memory 23 is selected.
, The q-th template in the vertical direction from the coordinates 1 + 3 (q−1) to the coordinates 480-3 (q−
1), and the q-th template: Tnq (x) = f (P (q, 3q−2), P (q, 3q
−1),..., Pq (q, 483-3q)).

Then, in the same manner as in the horizontal direction, Tnq (x) = f (Yq (1), Yq (2),..., Yq
(I),...) Are assigned as shown in FIG.
(F), (g)).

The horizontal template data Tmq (x) and the vertical template data Tnq (x) (1 ≦ q ≦ 73) thus obtained are substituted into the following equations (3) and (4). .

[0104]

(Equation 1)

[0105]

(Equation 2)

However, as described above, (Xc, Yc) is
The luminance data at the center of the image stored in the first image memory 23 (that is, (Xc, Yc) = (320, 2)
40).

The above equation (3) is obtained by calculating the first image memory 2 corresponding to the template data Tmq (x) in the horizontal direction.
3 shows an average degree of difference Sm (q) per pixel of the luminance value of the image stored in No.3. The above equation (4) represents the first template data Tnq (x) corresponding to the vertical template data Tnq (x).
The average difference Sn (q) per pixel of the luminance value of the image stored in the image memory 23 of FIG.

Here, in the above equations (3) and (4),
G (x, y) is a luminance value of each pixel point in the first image memory.

Then, the above templates (q = 1
７３73), S (q) is calculated by the following equation (5), and the value of q that minimizes S (q) is obtained.

S (q) = Sm (q) + Sn (q) (5) FIG. 8A shows the coincidence S (q) in the first image memory 23.
Shows the template Tq (m, n) in which is the maximum, and FIG. 8B shows the relationship between the second image template line and the image position.

The shift angle Th between the imaging center of the second camera unit 200 and the imaging center of the first camera unit 200 is (Xc
-320, Yc-240).
0, the storage medium (EEPRO) in the MPU 27 (see FIG. 1) is used as calibration data at the assembly adjustment stage.
M etc.).

Next, the operation of calculating the enlargement ratio (zoom ratio) of the image in the first image memory 23 and the image in the second image memory 24 in the camera section 200 of the present embodiment will be described with reference to FIG. This will be described based on a flowchart.

First, each time the zoom position of the second camera unit 200 is changed (moved) in step S901, it is determined whether or not the zoom position has been changed (moved) so that the enlargement ratio is calculated. to decide. If it is determined that the zoom position has been changed, it is determined in step S902 whether or not the focus is correctly focused on the subject (the focus position is normal), and then the calculation of the enlargement ratio starts. Is done.

If it is determined in step S902 that the subject is properly focused (the focus position is normal), the next step S903 is performed.
Reads the template data (image data) Tm1 and Tn1 in the second image memory 24 and calculates all templates. Next, in step S904, the minimum value of the loop counter q and the difference S is set to Smin, and Smin =
255, q in which the degree of difference S is minimized is defined as Zoomq, and initialization is performed with Zoomq = 1.

Next, in step S905, it is determined whether the comparison with the template has been completed for 1 to 73 (q <or = qm
ax? Judge). Then, the judgment result is affirmative (Y
In the case of es), in the next step S906, a difference value S (q) for each q-th template is calculated (S (q)
= Sm (q) + Sn (q)). Next, step S907
, The dissimilarity value S calculated in step S906.
Whether (q) is smaller than Smin (S (q) <Smi
n? Judge). Then, the difference value S (q) is Smi.
If it is determined that it is smaller than n (S (q) <Smin), the value of q is written to Zoomq (Zoomq = q) in the next step S908, and the value of S (q) is written to Soomq.
Write to min (Smin = S (q)). Next, in step S909, the value of the loop counter is increased by setting q = q + 1, and the process returns to step S905.

If the judgment result in the step S901 and the step S902 is negative (No), the process returns to the step S901.

If the result of the determination in step S905 is negative (No), the flow advances to step S910 to determine whether Smin is smaller than the reference value Sref (Sm).
in <Sref? Judge). Then, if the determination result is affirmative (Yes), in step S911, the first
The second image position and the enlargement magnification (zoom magnification) in the image memory 23 are determined. That is, enlargement magnification = 640 / (6
40-8 × q) and the dotted frame 4 in the first image memory 23.
Position coordinate start point of 1 (4 × Zoomq + 1, 3 × Zoom
q + 1) and the position coordinate end point (640-4 × Zoomq,
480-3 × Zoomq).

Next, at step S 912,
The enlargement ratio information, the position coordinate start point and the position coordinate end point data obtained in 911 are guided (set) to the data multiplexing circuit 32 of FIG.
Is arranged as shown in FIG. 4 together with the compressed image data of
A PC (personal computer) or the like (computer 20 in FIG. 2) which is sent to the network I / F 33 in FIG.
The data is displayed on the monitor by the browser application software via the network board 204 such as 3).

When the result of the determination in step S910 is negative (No) and when the process of step S912 is completed, the process returns to step S901.

FIG. 10 is a diagram showing a display example of an image synthesized and displayed on a monitor connected to the PC 203 in FIG. 3. FIG. 10A shows a second image in a first image. FIG. 13B shows a case where the image is synthesized and the resolution of the central portion is increased.
Picture-In-Pict on top left of first image
ure, and an example in which an image having a wide angle of view is simultaneously displayed while viewing an enlarged image.

The camera section 200 shown in FIG. 1 is mounted and fixed on a camera platform base 34 of the camera platform section shown in FIG.
It is assumed that the user attempts to control the direction of the imaging center of 0 (the direction of the front sphere lens 5) while viewing the screen of the remote PC 203 (see FIG. 2). For example, if the pan motor 35 of the camera platform is driven to rotate so that the imaging center of the camera unit 200 is directed to the direction of the door 44 of the hut in FIG. 5A, the camera already has a camera angle of view in FIG. The hut door 44 has been removed from the angle of view of the unit 200, and the user has to move the pan motor 3
By repeating the operation of rotating the drive 5, a part 45 of the hut is displayed on the screen of the PC 203, and it can be confirmed for the first time that the rotational drive direction of the pan motor 35 is correct.

On the other hand, in the present embodiment, one CCD camera always captures a wide-angle image, and a wide-angle image is always displayed on the monitor screen on the receiving side. The orientation of the imaging center of the camera unit 200 mounted and fixed on the camera can be easily controlled by the target subject.

FIG. 11 shows the position (position information of the zoom motor 11) of the zoom motor (zoom pulse motor) 11 in the lens unit 2 of FIG. 1 and the lens focal length (m
FIG. 12 shows a relationship between the size C1 of the first CCD sensor 9, the focal length F1 of the first focus lens (single focus lens) 8, and the size C2 of the second CCD sensor 16. FIG. 8 is a diagram for explaining an enlargement magnification calculated from the focal length F2 of the second focus lens (focus lens) 14 and FIG.
FIG. 2B shows the second CCD sensor 1 on the CD sensor 9 side.
Each of the six sides is shown.

In FIG. 12A, F1 is the focal length of the first focus lens 8, C1 is the size of the first CCD sensor 9, and O1 is the actual imaging subject length of the first focus lens 8. , L1 is the first focus lens 8
From the object to the subject.

Further, in FIG. 12B, F2 is the second
, The focal length of the focus lens 14, C2 is the second CC
The size of the D sensor 16, O2 is the actual imaging subject length of the second focus lens 14, and L2 is the distance from the second focus lens 14 to the subject.

The imaging magnification (magnification magnification) Z of the first CCD sensor 9 and the second CCD sensor 16 is obtained by the following equation (6).

Z = O1 / O2 = (C1 × F2) / (C2 × F1) (6) Therefore, the method of obtaining the enlargement ratio described with reference to FIGS. 6, 8, and 9 differs for all template candidates. Although the value of the degree was calculated, by obtaining the minimum value of the difference S (q) of the template corresponding to the vicinity of the magnification obtained from the position information of the zoom motor 11, it is unnecessary to match the difference. No need to perform calculations.

Further, in the image remote transmission / reception system according to the present embodiment, the functions of the above-described embodiment are realized by a computer reading and executing a control program stored in a storage medium. However, the present invention is not limited to this, and performs a part or all of actual processing such as an OS (Operating System) running on a computer based on the instruction of the control program, and performs the processing described above. Needless to say, a case where the function of the present embodiment is realized is also included.

The storage medium for storing the control program includes, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM (Co-ROM).
mpact Disk Read Only Memo
ry), CD-R (Compact Disk Rec)
order, a magnetic tape, a nonvolatile memory card, a ROM chip, or the like.

In the present embodiment, the image difference S (q) based on only the luminance data in the luminance memory is used to perform the second
Image memory 2 in the image in image memory 24
Although the method of calculating the position and the enlargement ratio of the target image in 4 has been described, it is also possible to use data in the color difference memory or to combine them.

In the present embodiment, a template is prepared for each line as a template. However, it is also possible to prepare a template for a plurality of lines to further enhance reliability.

(Second Embodiment) Next, a second embodiment of the present invention will be described.
The embodiment will be described with reference to FIG.

The configuration of the camera platform according to this embodiment is as follows.
Since this is the same as FIG. 2 of the first embodiment described above, the description will be made with reference to FIG.

FIG. 13 is a block diagram showing the configuration of the camera unit according to the present embodiment. In FIG. 13, the same parts as those in FIG. 1 of the first embodiment are designated by the same reference numerals. is there.

FIG. 13 differs from FIG. 1 in that FIG.
Is that a variable focus lens unit 2b is provided instead of the single focus lens unit 2a. The varifocal lens unit 2b includes a first CCD sensor 9, an iris blade 66, a zoom lens motor 67, and a zoom lens 6.
8, a focus lens motor 69 and a focus lens 70 are provided.

Then, the focus lens 70 adjusts the focus of the optical image reflected by the mirror 7. Also,
The focus lens motor 69 moves the focus lens 70 based on a control signal output from a control circuit (not shown). With this configuration, while the second focus lens 14 is adjusted so as to focus on the center of the optical image, the focus lens 70 is adjusted so as to focus on the peripheral portion of the optical image. An image can be obtained in which both the center and the periphery of the image are focused.

A zoom lens motor 67 controls the movement of the zoom lens 68. Further, the zoom lens motor 67 is controlled so that the angle of view captured by the second CCD sensor 16 does not become narrower. With this configuration, the angle of view captured by the first CCD sensor 9 can be set arbitrarily.

The other configuration and operation of this embodiment are the same as those of the above-described first embodiment, and the description thereof will be omitted.

[0139]

As described above in detail, according to the image remote transmission / reception method and system of the present invention, it is possible to check the image on the wide side while keeping the zoom lens position on the tele side, and it is possible to check the target object. It is possible to relatively easily turn the shooting direction of the camera, and to improve the image resolution of the center subject at a relatively low cost even when shooting at a wide angle.

Further, according to the imaging apparatus of the present invention, there is an effect that it is optimal for the above-described remote image transmitting / receiving system of the present invention.

Further, according to the storage medium of the present invention, there is an effect that the above-described image remote transmitting / receiving system of the present invention can be smoothly controlled.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a camera unit as a remote image pickup device for image input in an image remote transmission / reception system according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a configuration of a camera platform for mounting a camera unit in the remote image transmission / reception system according to the first embodiment of the present invention.

FIG. 3 is a diagram showing a configuration of an image remote transmission / reception system according to the first embodiment of the present invention.

FIG. 4 is a diagram showing multiplexed data created by a camera unit at the time of transmission in the remote image transmission / reception system according to the first embodiment of the present invention.

FIG. 5 is a diagram showing an example of images stored in a first image memory and a second image memory of a camera unit in the image remote transmission / reception system according to the first embodiment of the present invention.

FIG. 6 is a diagram for explaining a method of creating template data from an image stored in a first image memory of a camera unit in the image remote transmission / reception system according to the first embodiment of the present invention.

FIG. 7 is a diagram for explaining how to obtain template data of a camera unit in the remote image transmission / reception system according to the first embodiment of the present invention.

FIG. 8 is a diagram showing a template Tq (m, m) having a minimum degree of difference S (q) in a first image memory of a camera unit in the image remote transmission / reception system according to the first embodiment of the present invention.
FIG. 11 is a diagram illustrating a relationship between template positions of n) and a second image and image positions.

FIG. 9 is an enlargement ratio (zoom ratio) of an image in the first image memory and an image in the second image memory of the camera unit in the image remote transmission / reception system according to the first embodiment of the present invention.
5 is a flowchart showing the flow of the calculation processing operation of FIG.

FIG. 10 is a personal computer (PC) in the remote image transmission / reception system according to the first embodiment of the present invention.
FIG. 7 is a diagram showing a display example of an image synthesized and displayed on a monitor connected to the monitor.

FIG. 11 illustrates a position (zoom motor position information) of a zoom motor (zoom pulse motor) in a lens unit of a camera unit in the image remote transmission / reception system according to the first embodiment of the present invention, and a lens focal length at that time. (mm).

FIG. 12 shows the size C1 of the first CCD sensor of the camera unit and the focal length F1 of the first focus lens (single focus lens) in the image remote transmission / reception system according to the first embodiment of the present invention. FIG. 9 is a diagram for explaining an enlargement magnification calculated from a size C2 of a second CCD sensor and a focal length F2 of a second focus lens (focus lens).

FIG. 13 is a block diagram illustrating a configuration of a camera unit in an image remote transmission / reception system according to a second embodiment of the present invention.

FIG. 14 is a block diagram showing a configuration of a camera unit in a conventional image remote transmission / reception system.

[Explanation of symbols]

Reference Signs List 1 outer cover 2 lens unit 2a single focus lens unit 2b variable focus lens unit 3 single focus CCD unit 4 zoom / AF CCD unit 5 front lens 6 spectroscope (prism) 7 mirror 8 single focus lens (first 9 first CCD sensor 10 focus motor 11 zoom motor 12 iris blade 14 focus lens (second focus lens) 15 zoom lens 16 second CCD sensor 17 first CSD (correlated double sampling circuit)
/ AGC (automatic gain control circuit) circuit 18 Second CSD (correlated double sampling circuit)
/ AGC (automatic gain control circuit) circuit 19 First A / D converter 20 Second A / D converter 21 First process (Process) circuit 22 Second process (Process) circuit 23 First image Memory (luminance memory / chrominance memory) 24 Second image memory (luminance memory / chrominance memory) 25 Timing generator (TG: Timin)
g Generator 26 SSG (Standard Signal)
(Generator) 27 MPU (Micro Processing)
Unit: Microcomputer 28 Memory Controller (Memory Con)
(controller) 29 Enlargement ratio calculation circuit 30 First image compression circuit 31 Second image compression circuit 32 Data multiplexing circuit 33 Network interface (Network)
rk I / F) 34 Pan head 35 Pan (PAN) motor 36 Tilt motor 66 Iris blade 67 Zoom lens motor 68 Zoom lens 69 Focus lens motor 70 Focus lens 200 Camera unit (image input unit, remote imaging device) 201 server 202 browser application software 203 PC (personal computer, reception display device) 204 network board (Network Bo)
ard) 205 LAN (Local Area Network)
rk) 206 first subject 207 second subject 208 third subject

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C022 AA00 AA01 AB62 AB65 AB66 AB68 AC00 AC01 AC27 AC42 AC51 AC54 AC69 5C054 CC03 CC05 CC06 CF06 CG05 CG08 DA01 DA08 DA09 EA03 EB05 EG04 EG06 FB03 FC01 FD07 FE12 GA01 GA04 GB01 KK00 MA00 PP04 RB01 RC00 SS06 SS20 UA34

Claims (51)

[Claims] An image remote transmission / reception method for remotely transmitting / receiving an image using an image remote transmission / reception system comprising a remote imaging device directly connectable to a communication line and a reception display device for receiving and displaying a captured image transmitted from the remote imaging device. A signal processing step of independently processing image signals from two independent image pickup devices, and an A / D for digitizing the signal processed by the signal processing step. A conversion step, a memory step of separately storing each digital image converted by the A / D conversion step in a memory unit, and determining an enlargement ratio of the captured image stored in the memory unit on the memory unit. The enlargement ratio discriminating step and the enlargement ratio discrimination information discriminated in the enlargement ratio discriminating step are sent together with the image data to the reception display device which is a receiving end. The receiving display device side, on the side of the expansion based on the received magnification ratio discrimination information after the expansion process of expanding the compressed image data received from the remote imaging device, after the expansion process. An image remote transmission / reception method, comprising: a combining step of combining received images; and a displaying step of displaying an image combined by the combining step on a screen. 2. The method according to claim 1, wherein the communication line is a local area network. 3. The method according to claim 1, wherein the remote imaging device is a camera. 4. The method according to claim 1, wherein said reception display device is a personal computer. 5. The method according to claim 1, wherein the image sensor is a CCD sensor. 6. The remote image transmission / reception method according to claim 1, wherein the enlargement ratio discriminating step waits for an end of an AF (Auto Focus) operation of the remote imaging device before executing the enlargement ratio discriminating process. . 7. An image remote transmission / reception system comprising: a remote imaging device directly connectable to a communication line; and a reception display device for receiving and displaying a captured image transmitted from the remote imaging device. Are independent 2
Signal processing means for independently processing the image signals from the two image sensors, A / D conversion means for digitizing the signal processed by the signal processing means, and each of the signals converted by the A / D conversion means. Memory means for separately storing digital images, enlargement rate determination means for determining an enlargement rate of the captured image stored in the memory means on the memory means, and enlargement rate determination information determined by the enlargement rate determination means Transmitting means for transmitting the compressed image data received from the remote imaging device to the receiving and displaying apparatus, the transmitting means for transmitting the compressed image data received from the remote imaging apparatus; Combining means for combining the received image based on the received enlargement ratio determination information after decompression, and display means for displaying an image combined by the combining means on a screen Image remote transceiver system characterized by having a. 8. The image remote transmitting / receiving system according to claim 7, wherein said communication line is a local area network. 9. The image remote transmission / reception system according to claim 7, wherein the remote imaging device is a camera. 10. The remote image transmission / reception system according to claim 7, wherein said reception display device is a personal computer. 11. The enlargement ratio discriminating step executes an enlargement ratio discrimination process after waiting for the end of an AF (auto focus) operation of the remote imaging device.
An image remote transmission / reception system according to claim 1. 12. An image remote transmission / reception method for remotely transmitting / receiving an image by an image remote transmission / reception system comprising a remote imaging device directly connectable to a communication line and a reception display device for receiving and displaying a captured image transmitted from the remote imaging device. A branching step of splitting light from the lens into first and second lights, and a lens having a fixed magnification / focal length, wherein the first light split by the splitting step is provided on the remote imaging device side. And a second introducing the second light branched by the branching step into the second image sensor after passing through a variable magnification / focal length lens. A process, a process for processing image signals of the first and second image sensors as a luminance signal and a color signal, and an A / D converter for A / D-converting the image signal processed by the process. A / D conversion step; a memory step of separately storing the digital images converted by the A / D conversion step in a first image memory means and a second image memory means; A detecting step of detecting an enlargement ratio and a position coordinate of the first image and the second image respectively stored in the second image memory means; And transmitting the images together with the detection information detected by the detection process to the reception display device, which is the reception end, at an independent compression ratio.The reception display device side receives the images from the remote imaging device. A decompressing step of decompressing the received compressed image data, a synthesizing step of synthesizing the received image based on the received enlargement ratio after decompression by the decompressing step, and synthesizing by the synthesizing step. Image remote transmission and reception method characterized in that it comprises a display step of displaying on a screen an image. 13. The method according to claim 12, wherein the communication line is a local area network. 14. The method according to claim 12, wherein the remote imaging device is a camera. 15. The method according to claim 12, wherein the reception display device is a personal computer. 16. The method according to claim 12, wherein the image sensor is a CCD sensor. 17. The remote image transmitting / receiving method according to claim 12, wherein the branching unit is a prism. 18. The enlargement ratio discriminating step waits for the end of an AF (autofocus) operation of the remote imaging apparatus, and then executes the enlargement ratio discrimination process.
2. The image remote transmission / reception method according to 2. 19. An image remote transmitting / receiving system comprising: a remote imaging device directly connectable to a communication line; and a reception display device for receiving and displaying a captured image transmitted from the remote imaging device. Means for splitting light from a lens into first and second lights, and introducing the first light split by the splitting means into a first image sensor after passing through a fixed magnification / focal length lens. A first introducing means for introducing the second light branched by the branching means into a second image pickup device after passing through a variable magnification / focal length lens, and the first and second light introducing means. Processing means for processing an image signal of an image sensor as a luminance signal and a color signal; A / D conversion means for A / D converting an image signal processed by the processing means;
A first image memory unit and a second image memory unit for separately storing digital images converted by the D conversion unit; and a first image memory unit and a second image memory unit respectively stored in the first image memory unit and the second image memory unit. Detecting means for detecting the enlargement ratio and position coordinates of the first image and the second image; and receiving the images stored in the first image memory means and the second image memory means at an independent compression ratio at the receiving end. A transmission unit for transmitting the reception display device together with the detection information detected by the detection unit, and the reception display device side includes a decompression unit that decompresses the compressed image data received from the remote imaging device; A synthesizing unit that synthesizes the received image based on the received enlargement ratio after expansion by the expansion unit, and a display unit that displays an image synthesized by the synthesizing unit on a screen. Image remote transceiver system, characterized by. 20. The remote image transmission / reception system according to claim 19, wherein said communication line is a local area network. 21. The remote image transmission / reception system according to claim 19, wherein said remote imaging device is a camera. 22. The image remote transmission / reception system according to claim 19, wherein said reception display device is a personal computer. 23. The image remote transmission / reception system according to claim 19, wherein said image sensor is a CCD sensor. 24. The image remote transmission / reception system according to claim 19, wherein said branching means is a prism. 25. The enlargement ratio determining step, wherein the enlargement ratio determination process is performed after waiting for the end of an AF (auto focus) operation of the remote imaging device.
10. The image remote transmission / reception system according to item 9. 26. A signal processing means for independently processing image signals from two independent image sensors,
A / D conversion means for digitizing a signal processed by the signal processing means, memory means for separately storing each digital image converted by the A / D conversion means, and imaging stored in the memory means An image-capturing apparatus comprising: an enlargement ratio determining unit that determines an enlargement ratio of an image on the memory unit. 27. A system according to claim 26, further comprising sending means for sending the enlargement ratio discrimination information determined by said enlargement ratio discriminating unit to a reception display device via a network.
An imaging device according to any one of the preceding claims. 28. A first imaging unit after splitting a light from a lens into first and second lights and passing the first light split by the splitting unit through a fixed magnification / focal length lens. First introducing means for introducing the light into the element, second introducing means for introducing the second light branched by the branching means to the second image pickup element after passing through a variable magnification / focal length lens, Processing means for processing the image signal of the second image sensor as a luminance signal and a color signal; and A / D converting the image signal processed by the processing means.
/ D conversion means, image memory means for storing first and second digital images imaged by the first and second imaging elements and digitally converted by the A / D conversion means, and the image memory means Detecting means for detecting an enlargement ratio of the first and second images accumulated by the first and second positions and a position of an image area corresponding to the enlargement ratio. 29. The image processing apparatus according to claim 28, further comprising a transmission unit configured to transmit information regarding an enlargement ratio of the first and second images detected by the detection unit and a position of a relatively corresponding image area. An imaging device according to any one of the preceding claims. 30. A control program for controlling an image remote transmission / reception system comprising a remote imaging device directly connectable to a communication line and a reception display device for receiving and displaying a captured image transmitted from the remote imaging device is stored. A storage medium, wherein the control program includes a control program executed on the remote imaging device side and a control program executed on the reception display device side, and the control program executed on the remote imaging device side A signal processing module for independently processing image signals from two independent image sensors, an A / D conversion module for digitizing a signal processed by the signal processing module, and an A / D conversion module Module for separately storing each digital image converted by the memory means in the memory means A magnification ratio determining module for determining a magnification ratio of the captured image stored in the memory device on the memory device; and a receiving end receiving the magnification ratio determination information determined by the magnification ratio determining module. A control module that has a sending module that sends the image data together with the image data to the display device, wherein the control program that is executed on the receiving and displaying device side includes an expansion module that expands the compressed image data received from the remote imaging device; A storage medium, comprising: a combining module that combines the received image based on the received enlargement factor determination information later; and a display module that displays an image combined by the combining module on a screen. 31. The storage medium according to claim 30, wherein said communication line is a local area network. 32. The storage medium according to claim 30, wherein said remote imaging device is a camera. 33. The storage medium according to claim 30, wherein said reception display device is a personal computer. 34. The storage medium according to claim 30, wherein said image pickup device is a CCD sensor. 35. The storage medium according to claim 30, wherein said branch means is a prism. 36. The storage medium according to claim 30, wherein said enlargement ratio determination module executes an enlargement ratio determination process after waiting for an end of an AF (autofocus) operation of said remote imaging device. 37. A control program for controlling an image remote transmission / reception system comprising a remote imaging device directly connectable to a communication line and a reception display device for receiving and displaying a captured image transmitted from the remote imaging device is stored. A storage medium, wherein the control program includes a control program executed on the remote imaging device side and a control program executed on the reception display device side, and the control program executed on the remote imaging device side Includes: a branch module that branches light from a lens into first and second lights; and a first light that is branched by the branch module is introduced into a first image sensor after passing through a lens with a fixed magnification / focal length. And a second imaging unit that passes the second light branched by the branching module through a variable magnification / focal length lens. A second introduction module for introducing the image signal into the image element, a processing module for processing the image signals of the first and second imaging elements as a luminance signal and a color signal, and an image signal processed by the processing module to A An A / D conversion module for performing A / D conversion; a memory module for separately storing digital images converted by the A / D conversion module in first image memory means and second image memory means; A detection module for detecting an enlargement ratio and a position coordinate of the first image and the second image stored in the image memory means and the second image memory means, respectively, and the first image memory means and the second image The image stored in the memory means is detected by the detection module in the reception display device at the receiving end at an independent compression ratio. And a sending module for sending with detection information, the control program executed by the receiving display device side, the extension module for decompressing the compressed image data received from said remote image sensing device,
A storage medium, comprising: a combining module that combines the received image based on the received enlargement ratio after being expanded by the expanding module; and a display module that displays an image synthesized by the combining module on a screen. 38. The storage medium according to claim 37, wherein said communication line is a local area network. 39. The storage medium according to claim 37, wherein said remote imaging device is a camera. 40. The storage medium according to claim 37, wherein said reception display device is a personal computer. 41. The storage medium according to claim 37, wherein said imaging element is a CCD sensor. 42. The storage medium according to claim 37, wherein said branching means is a prism. 43. The storage medium according to claim 30, wherein the storage medium is a floppy disk.
The storage medium according to the above. 44. The storage medium according to claim 30, wherein the storage medium is a hard disk. 45. The storage medium according to claim 30, wherein the storage medium is an optical disk. 46. The storage medium according to claim 30, wherein said storage medium is a magneto-optical disk. 47. The storage medium is a CD-ROM (Co-ROM)
mpact Disk Read Only Memo
43. The storage medium according to claim 30, wherein the storage medium is ry). 48. The storage medium has a CD-R (Comp
43. The storage medium according to claim 30, wherein the storage medium is an act disk recordable. 49. The storage medium according to claim 30, wherein the storage medium is a magnetic tape. 50. The storage medium according to claim 30, wherein the storage medium is a nonvolatile memory card.
2. The storage medium according to 2. 51. A storage medium, comprising: a ROM (Read)
43. The storage medium according to claim 30, wherein the storage medium is an only memory (chip) chip.