JPH09210646A - Device for inputting three-dimensional picture information - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a three-dimensional data in real time and improve the operability by measuring the three-dimensional shape of an object by using a slit light and an image pick-up means consisting of an optical detector and mapping a color picture of the three-dimensional shape. SOLUTION: A slit light 12 emitted from a laser slit light source 1 is scanned by a rotary mirror 2 in a rotational direction, and it is directed to an object 15. A picture picked up by a PSD camera is obtained as a three-dimensional shape of the object 15 by a picture analyzing part 10 through an A/D conversion memory part 9. Further, its color picture is picked up by a color video camera 3 and the color picture is subjected to mapping to the three-dimensional shape. A controller 7 controls turning on or turning off of the light source 1 by means of a laser control circuit 6, and turns the rotary mirror 2 by means of a rotary mirror control circuit 5. A rotating mechanism is controlled by a controller 7 so that the object can be picked up at a desired angle.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional image information input device used in a video conference system device or the like. In particular, the present invention relates to a three-dimensional image information input device necessary for performing parameter coding using a three-dimensional shape model.

[0002]

2. Description of the Related Art Conventionally, as this type of technology, there is a general video conference system as shown in FIG. In other words, the image is captured by a two-dimensional camera and the image information is transmitted to the partner station. For example, Japanese Patent Application Laid-Open No. 3-76385 specifically discloses a conference hall photographing device. The camera 21 used in the video conference system is configured to automatically zoom in the camera 21 in the speaker direction.

However, the conventional image information transmission method is called two-dimensional image waveform transmission, and various methods are used to compress the data amount, but it is used in the video conference system. Data transfer rate is usually 3
About 84 Kbps is used. If the data is compressed more than this, the deterioration of the image quality becomes a problem. Therefore, further advanced image information coding is desired.

Therefore, research on image analysis coding based on three-dimensional structure data has been advanced.

The transmitting side and the receiving side or the network share a three-dimensional shape model with each other, and only genuinely essential information such as motion information and facial expression information is exchanged on the transmission path, and the user is told to the user. Is a method that allows moving images to be obtained without discomfort (Harashima et al., "Concept of Next-Generation Image Coding" IEICE Technical Report, IE 87-
1,1 / 8 (1989)).

Such a method is called parameter coding, and transmission data can be compressed to about 1/100 of the conventional value, and is expected from the viewpoint of communication cost.

It has been pointed out that these technologies will be used in an immersive communication conference system as shown in FIG. 5 in the future (Kishino et al. Gathered in "O puls E NO.149 PP154,169 (199
2.4)).

[0008]

However, in the transmission method using the image analysis coding based on the three-dimensional structure data, that is, in the parameter transmission, the output side which is the synthesis side is considerably studied by the technology of CG (computer graphic). Is being promoted.

However, the input side, which is the analysis side, does not have an input device for real-time three-dimensional information data, and is currently input by an experimental measurement method.

Therefore, a real-time three-dimensional image information input device is required in order to use the parameter transmission in a video conference system or the like.

As a device for taking in a three-dimensional shape in real time, a light cutting method using a photodetector (PSD) array has been proposed as shown in FIG. 4 (Araki "High-speed measurement by slit light projection method" O puls E NO.147 PP76,82 (1992.2))
There is a drawback that operability is a problem for use in a video conference system because a color image cannot be obtained and a mechanism for freely selecting a subject is not provided.

An object of the present invention is to provide a three-dimensional image information input device having excellent operability.

[0013]

In order to solve the above-mentioned drawbacks, the present invention provides a scanning means for scanning a slit light on an object, a position measuring means for measuring the position of the slit light, and an optical object for the object. A three-dimensional image information input device is configured to include an image capturing unit that captures an image by using detection and a color image capturing unit that captures a color image.

Further, a means for measuring a three-dimensional shape of a subject using the slit light and the image pickup means by the photodetector, a means for mapping a color image on the three-dimensional shape, and an imaging distance. The image pickup means and the color image photographing means of the photodetector are provided with a zoom function so that they can be freely changed, and the slit light scanning means for selecting an image pickup object,
Rotation means for rotating the entire image pickup means and color image photographing means by the photodetector is provided.

Further, the slit light is a semiconductor laser, and an invisible laser light whose output is 0, 1 mW or less is used.

Further, the image pickup means by the photodetector and the color CCD line sensor are arranged side by side to obtain high-speed three-dimensional color shape data.

By configuring the three-dimensional image information input device of the present invention as described above, three-dimensional color shape data can be obtained in real time, and the three-dimensional shape data can be transmitted to the other party, for example, motion information, Parameters can be transmitted to send information such as facial expression information.

Further, since the zoom function and the rotation mechanism are provided, it is possible to easily select a subject, so that it is possible to transmit parameters as a video conference system, the communication cost is low, and a realistic moving image can be obtained. Become.

[0019]

Embodiments of the present invention will be described below.

FIG. 1 is a block diagram of the present invention.

1 is a laser slit light source, 2 is a rotating mirror, 3 is a color video camera, 4 is a photodetector (PSD).
A camera, 5 is a rotary mirror control circuit, 6 is a laser control circuit, 7 is a controller, 8 is an A / D conversion memory section, 9 is a video signal input circuit, 10 is an image analysis section, 11 is a transmission device, and 12 is a rotary mirror. 2 is a rotation mechanism, 13 is a position detector, 14 is slit light, and 15 is a subject.

Slit light 1 from laser slit light source 1
4 is scanned in the rotating direction by the rotating mirror 2 and is irradiated onto the subject 15. The image taken by the PSD camera 4 is
The three-dimensional shape of the subject 15 is obtained by the image analysis unit 10 via the A / D conversion memory unit 8. Further, the color video camera 3 captures a color image, and the color image is mapped to the three-dimensional shape. The angle of the rotating mirror 2 can be measured by the position detector 13.

The controller 7 controls ON / OFF of the power of the laser slit light source 1 via the laser control circuit 6, and rotates the rotary mirror 2 via the rotary mirror control circuit 5. The rotation mechanism 12 is controlled by the controller 7,
The subject can be imaged from any angle.

FIG. 2 shows a coordinate calculation method of the present invention (Electronic Communication Handbook, First Volume P1127, edited by the Institute of Electronics, Information and Communication Engineers). A three-dimensional shape can be obtained by this formula.

That is, one point P (x, y,
z), a spatial straight line connecting the image P'position on the image surface and the contact point LO of the lens is determined. Since the plane formed by the projection light is determined by knowing α, the three-dimensional coordinates of the point P can be determined as the intersection of these. To input the data of the entire scene, the angle or position of the projection light is moved little by little and the data of a plurality of lines is input.

In order to map a color image, the color video camera 3, the PSD camera 4 and the three-dimensional coordinates obtained by the light cutting method using slit light are aligned.

[0027]

As described above, according to the present invention,
Three-dimensional shape data can be obtained in real time, enabling color image mapping. As a result, the transmitting side and the receiving side or the network share a three-dimensional shape model with each other, and only true essential information, such as movement information and facial expression information, is exchanged on the transmission path, and Can provide a realistic moving image without a feeling of strangeness. That is, image analysis coding based on the structure data, that is, parameter transmission can be easily performed.

[Brief description of drawings]

FIG. 1 is a block diagram of the present invention.

FIG. 2 is an explanatory diagram showing a coordinate calculation method of the present invention.

FIG. 3 is an explanatory diagram of a conventional video conference system.

FIG. 4 is an explanatory diagram of a light cutting method.

FIG. 5 is an explanatory diagram of a realistic communication conference system.

[Explanation of symbols]

 1 Laser slit light source 2 Rotating mirror 3 Color video camera 4 Photodetector (PSD) camera 5 Rotating mirror control circuit 6 Laser control circuit 7 Controller 8 A / D conversion memory unit 9 Video signal input circuit 10 Image analysis unit 11 Transmission device 12 Rotation mechanism 13 Position detector 14 Slit light 15 Subject

Claims (4)

[Claims] 1. A scanning means for scanning an object with slit light, a position measuring means for measuring the position of the slit light, an imaging means for imaging the object using a photodetector, and a color image. A three-dimensional image information input device comprising: a color image capturing means. 2. A means for measuring a three-dimensional shape of a subject using the slit light and an imaging means by the photodetector, a means for mapping a color image on the three-dimensional shape, and an imaging distance. The image pickup means and the color image pickup means of the photodetector are provided with a zoom function so that they can be freely changed,
3. The three-dimensional image information input device according to claim 1, further comprising: rotating means for rotating the slit light scanning means, the image pickup means using a photodetector, and the color image pickup means in order to select an image pickup object. . 3. The three-dimensional image information input device according to claim 1, wherein the slit light is a semiconductor laser and invisible laser light whose output is 0 or 1 mW or less is used. 4. An image pickup means by the photodetector, and a color C
3. The three-dimensional color shape data is obtained at high speed by using CD line sensors side by side.
The described three-dimensional image information input device.