JPH11266465A - Image transmission/processing method and system, and medium for storing programs - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method and a system where a transmission capacity is reduced when 3-dimensional image information is expressed by a complex amplitude and the resulting information is sent. SOLUTION: In this image transmission method, an image of interference fringe expressed in a complex number is decomposed into an amplitude component image and a phase component image, where processing of reducing high frequency components of a spatial frequency is applied to the amplitude component and gradation conversion processing is applies to the phase component image. The image components after the respective processings are compression- coded and the two image data components after compression coding are transmitted separately from a transmitter side. A receiver side receives the two image data components sent separately and sequentially decodes the received image data into the amplitude component image and the phase component image, and synthesizes them into complex components again and displays them.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for efficiently compressing or encrypting image information and storing or transmitting the same by utilizing interference fringes as a hologram.

[0002]

2. Description of the Related Art Holography is a technique for reproducing a wavefront from an object by diffracting light. In general, holograms have been developed as stereoscopic photographs. on the other hand,
A hologram is a technique for recording interference fringes of light, and can be obtained by calculation if the shape of a display object, the wavelength of reference light, and the like are known. This has been studied for a long time in the field of computer generated holograms. The merit is that it is possible to generate interference fringes by calculation even for non-existent objects.
Until now, it has mainly been developed in fields other than stereoscopic display, such as being used for optical pickups in CD-ROM devices.

[0003]

A major feature of holograms other than stereoscopic display is information redundancy.
That is, even if a part of the hologram is missing, the influence on the reproduced image is small. Thus, by recording the three-dimensional information and the image information as interference fringes, it is possible to form a technique that simultaneously retains the conventional image compression and encryption functions. However, in order to display interference fringes as a hologram, it is necessary to display interference fringes having an enormous number of pixels on a high-resolution device. For this reason, in general, not only is the computer hologram difficult to manufacture a display device, but also a major problem is that the generation of interference fringes results in an enormous amount of data. Therefore, there has been little research on image compression / encryption technology using holograms.

Further, with the recent development of electronic display technology,
Even if a high-resolution device is realized, the problem remains that the data amount of an image (interference fringe) is enormous. For example, when a 5-inch screen is considered, about 8 G pixels or more are required to display a hologram. On the other hand, an HDTV has a size of about 2 M pixels, and the data amount of one image is about 4000 times. Even if a large-capacity transmission technology using an optical fiber or the like is established in the future, a data compression technology is a major issue in the future.

[0005] The present invention has been made in view of the above points, and has as its object to reduce the transmission capacity when three-dimensional image information is expressed by complex amplitude and transmitted. Another object of the present invention is to efficiently encrypt three-dimensional or two-dimensional image data using interference fringes. Another object of the present invention is to reduce the data amount of an image obtained by digitizing a plurality of interference fringes.

[0006]

In order to achieve the above object, according to the first aspect of the present invention, three-dimensional information of an object recorded as interference fringes by reference light and light from the object is sequentially recorded. Transmitting, on the receiving side, while sequentially displaying the received interference fringes, irradiating the reproduction light, and displaying the object three-dimensionally, the transmitting side, the image of the interference fringes represented by a complex number A process of decomposing the component image into an amplitude component image and a phase component image, performing a process of reducing a high frequency component of a spatial frequency on the decomposed amplitude component image, performing a gradation conversion process on the phase component image, A step of compressing and encoding each of the processed images, and a step of separately transmitting the image data of the two components that have been compressed and encoded. Image data of two components And decoding the received image data sequentially into an amplitude component image and a phase component image, and combining the decoded amplitude component image and the phase component image into a complex component again for display. This is an image transmission method using a phase / amplitude decomposition process.
According to a second aspect of the present invention, in the image transmission method according to the first aspect, in the transmitting step, the phase component and the amplitude component of each of the image data in accordance with a type of the interference fringe image. The transmission sequence or the transmission cycle is changed.

Next, the invention according to claim 3 is an image processing method for converting image data and storing or transmitting the converted image, wherein the image data is installed at a certain spatial position, and Irradiating a specific reference light and calculating a projection image generated by light transmitted or reflected by the image as an image having a complex amplitude value; and projecting the projection image having the calculated complex amplitude value. Two types of images obtained by decomposing each pixel of the image into a real part and an imaginary part, and
Accumulating or transmitting calculation parameters for generating the projection image. The invention described in claim 4 is the same as the invention described in claim 3.
In the image processing method described in (1), in the step of calculating the projection image, a lens is installed on the entire surface of the spatial position where the image data is arranged, and the projection image at the focal length of the lens is obtained. According to a fifth aspect of the present invention, in the image processing method of the third or fourth aspect, in the step of storing or transmitting, each pixel of the projected image is decomposed into a real part and an imaginary part. It is characterized in that the two types of images and the calculation parameters are separately stored or transmitted.
According to a sixth aspect of the present invention, in the image processing method according to the third aspect, in the storing or transmitting step, each pixel of the image of the projected image is decomposed into a real part and an imaginary part. It is characterized in that the image and the calculation parameters including the wavelength of the reference light and the position information where the image data is set are encrypted and stored or transmitted.

[0008] Next, the invention according to claim 7 is based on claim 3.
7. An image processing method for reproducing and displaying a projection image stored or transmitted by the image processing method according to claim 6, wherein the image of the real part is irradiated with light having the same wavelength as the reference light. Then, the image of the imaginary part is calculated with the wavefront of the transmitted light when the light having the same wavelength as the reference light shifted by π / 2 phase is calculated, and the combined value of the wavefronts of the two transmitted lights is calculated as an image. And reproducing the projection image, and displaying the reproduced projection image. According to an eighth aspect of the present invention, in the image processing method according to the seventh aspect, in the step of reproducing the projected image, while reading the two types of stored or transmitted image and the calculation parameter, It is characterized in that projected images are sequentially reproduced.
According to a ninth aspect of the present invention, in the image processing method according to the seventh or eighth aspect, in the step of displaying the projection image, a lens capable of enlarging or reducing an image according to the calculation parameter is provided. Through which the reproduced projected image is optically projected.

Next, an invention according to claim 10 is an image processing method for multiplexing a plurality of images to generate a multiplexed image, wherein the image is an image related to interference fringes caused by reference light and light from an object. Selecting one image from a plurality of digitized digital images to be digitized, holding only high-order bits up to a predetermined order in the selected image, and selecting the selected image. Allocating information of higher-order bits of an image other than the selected image to a position corresponding to a lower bit that is not held in each pixel of the selected image. According to an eleventh aspect of the present invention, in the image processing method according to the tenth aspect, in the step of selecting the image, the plurality of digital images are images generated from the same image having different resolutions. It is characterized by having. According to a twelfth aspect of the present invention, in the image processing method according to the tenth aspect, in the step of selecting the image, the plurality of digital images include an image generated from a background image and the background image. And a digital image relating to the background image is selected. According to a thirteenth aspect of the present invention, in the image processing method according to the fourteenth aspect, in the step of allocating the information, a rule for allocating bits is held as a correspondence table, and the correspondence table is added to the generated multiplexed image. It is characterized by being added. An invention according to claim 14 is an image processing method for expanding a multiplexed image generated by the method according to claim 13, wherein the step of extracting the correspondence table from the generated multiplexed image, Extracting a predetermined bit of the multiplexed image based on the extracted correspondence table, and then expanding the multiplexed image.

Next, according to a fifteenth aspect of the present invention, a three-dimensional object is irradiated with reference light, and information recorded as interference fringes due to light from the object is sequentially transmitted. In the image transmission apparatus for sequentially displaying and irradiating the interference fringes with reproduction light and displaying an object three-dimensionally, the transmitting side includes means for inputting an image of an interference fringe having a complex amplitude, and an image of the interference fringe. Into a phase component image and an amplitude component image; an image processing unit that performs processing to remove a high-frequency component of a spatial frequency from the decomposed amplitude component image; and a gradation process on the decomposed phase component image. Means for performing image processing for performing a conversion process, and means for performing compression encoding processing on each of the image-processed component images, wherein the receiving side converts each of the compression-encoded image data into a phase component image and an amplitude. Decode to component image Means for processing, the phase component image and an amplitude component image the decoded an image transmission apparatus according to the phase and amplitude degradation process, characterized in that it comprises means for combining the complex amplitude of the image.

Next, according to the present invention, there is provided an image conversion means for generating a projection image of an input image using a specific calculation parameter, a means for determining the calculation parameter, the projection image and the projection image. An image processing apparatus comprising: means for accumulating calculation parameters; and / or means for transmitting the projection image and the calculation parameters. According to a seventeenth aspect of the present invention, in the image processing apparatus according to the sixteenth aspect, the image processing apparatus includes means for receiving the stored or transmitted projection image and calculation parameters, and the received projection image. The apparatus further comprises means for reproducing a projection image by using calculation parameters, and means for displaying the reproduced projection image.

Next, an image processing apparatus for multiplexing a plurality of images to generate a multiplexed image is an image related to interference fringes caused by reference light and light from an object. Input means for inputting a plurality of digitized digital images to be multiplexed, a frame memory serving as a working memory when generating a multiplexed image, and a plurality of images input by the image input means Image bit allocation determining means for defining a bit replacement method so as to hold each upper bit of each pixel of the plurality of images, and each bit determined by the image bit allocation determining means. Image bit operating means for operating a bit sequence of each pixel of an image based on a method of replacing the image data to generate a multiplexed image on the frame memory. An image processing apparatus.

Next, according to a nineteenth aspect of the present invention, three-dimensional information of an object recorded as interference fringes by reference light and light from the object is sequentially transmitted, and the received interference fringes are sequentially displayed on the receiving side. Along with the reproduction light, a computer-readable recording medium recording an image transmission program for displaying an object three-dimensionally, the image transmission program for the transmission side, the interference fringe represented by a complex number A procedure of decomposing the image into an amplitude component image and a phase component image, performing a process of deleting a high-frequency component of a spatial frequency on the decomposed amplitude component image, performing a gradation conversion process on the phase component image, Causing the computer to execute a procedure of compression-encoding each image after each processing and a procedure of separately transmitting the image data of the two components that have been compression-encoded, and The program includes a step of receiving the image data of the two components transmitted separately, a step of sequentially decoding the received image data into an amplitude component image and a phase component image, and the steps of: A recording medium for recording an image transmission program for causing a computer to execute a procedure of combining a component image with a complex component again for display. According to a twentieth aspect of the present invention, in the recording medium storing the image transmission program according to the nineteenth aspect, in the transmitting step, the phase component and the amplitude component are changed according to the type of the image of the interference fringes. The transmission order or transmission cycle of each image data is changed.

Next, an invention according to claim 21 is a computer-readable recording medium storing an image processing program for converting image data and storing or transmitting the converted image, wherein the image processing program An image having a complex amplitude value is obtained by arranging image data at a certain spatial position, irradiating the image with a specific reference light, and calculating a projection image generated by light transmitted or reflected by the image. And storing or transmitting two types of images obtained by decomposing each pixel of the image of the projected image having the calculated complex amplitude value into a real part and an imaginary part, and calculation parameters for generating the projected image. And a recording medium that records an image processing program that causes a computer to execute the procedure. According to a twenty-second aspect of the present invention, in the recording medium in which the image processing program according to the twenty-first aspect is recorded, in the step of calculating the projection image by calculation, a lens is provided over the entire spatial position where the image data is arranged. And a projection image at a focal length of the lens is obtained. According to a twenty-third aspect of the present invention, in the recording medium storing the image processing program according to the twenty-first or the twenty-second aspect, in the storing or transmitting procedure, each pixel of the image of the projected image is a real part. And two types of images decomposed into an imaginary part and calculation parameters are separately stored or transmitted. According to a twenty-fourth aspect of the present invention, in the recording medium storing the image processing program according to the twenty-first aspect, in the storing or transmitting procedure, each pixel of the image of the projected image is converted into a real part and an imaginary part. It is characterized in that the two kinds of decomposed images and the calculation parameters including the wavelength of the reference light and the position information where the image data is installed are encrypted and stored or transmitted.

According to a twenty-fifth aspect of the present invention, an image processing program for reproducing and displaying a projection image stored or transmitted by the image processing method according to any one of the third to sixth aspects is recorded. A computer-readable recording medium, wherein the image processing program irradiates the image of the real part with light having the same wavelength as the reference light, and shifts the phase of the imaginary part image by π / 2. A procedure of calculating the wavefronts of the transmitted light when irradiating light having the same wavelength as the reference light, generating a combined value of the wavefronts of the two transmitted lights as an image, and reproducing the projected image; And a recording medium on which an image processing program for causing a computer to execute is displayed. According to a twenty-sixth aspect of the present invention, in the recording medium storing the image processing program according to the twenty-fifth aspect, in the step of reproducing the projected image, the stored or transmitted two types of images and the The method is characterized in that a projection image is sequentially reproduced while reading parameters. According to a twenty-seventh aspect of the present invention, in the recording medium storing the image processing program according to the twenty-fifth or twenty-sixth aspect, in the step of displaying the projection image, the image is enlarged according to the calculation parameter. The reproduced projection image is optically projected through a lens that can be reduced.

Next, an invention according to claim 28 is a computer-readable recording medium recording an image processing program for multiplexing a plurality of images to generate a multiplexed image, wherein the image processing program comprises: An image related to interference fringes due to light from the reference light and the object, and a procedure of selecting one image from a plurality of digitized digital images to be subjected to the multiplexing process, and in the selected image, A procedure for retaining only high-order bits up to a predetermined level, and a procedure for allocating information of high-order bits of an image other than the selected image to a position corresponding to a non-retained lower bit of each pixel of the selected image. And a recording medium storing an image processing program for causing a computer to execute the above. According to a twenty-ninth aspect of the present invention, in the recording medium storing the image processing program according to the twenty-eighth aspect, in the step of selecting the image, the plurality of digital images are different from the same image having different resolutions. It is characterized in that it is a generated image. According to a thirtieth aspect of the present invention, in the recording medium storing the image processing program according to the twenty-eighth aspect, in the step of selecting the image, the plurality of digital images are generated from a background image. An image generated from an image and a component image synthesized with the background image, wherein a digital image related to the background image is selected. Also,
According to a thirty-first aspect of the present invention, in the recording medium storing the image processing program according to the thirty-eighth aspect, in the step of allocating the information, a rule for allocating bits is held as a correspondence table, and the multiplexing method generates the correspondence table. It is characterized by being added to a structured image. An invention according to claim 32 is a computer-readable recording medium recording an image processing program for expanding a multiplexed image generated by the method according to claim 13, wherein the image processing program includes An image for causing a computer to execute a procedure for extracting the correspondence table from the multiplexed image thus obtained and a procedure for extracting a predetermined bit of the multiplexed image based on the extracted correspondence table to develop a multiplexed image. This is a recording medium on which a processing program is recorded.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS (First Embodiment) In this embodiment, a complex amplitude interference fringe for hologram display is described.
An image transmission method and apparatus for performing data compression processing suitable for an amplitude component and a phase component and transmitting the data will be described. Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIGS. 1A and 1B are flow charts showing an embodiment of the method of the present invention. FIG. 1A shows a procedure on the transmitting side, and FIG. The procedure on the receiving side is shown. In the following description, it is assumed that the hologram of the display target is sequentially generated and input as a complex amplitude interference fringe. Note that an image indicated by 121 in FIG. 2 is used as an example of the display target. Although this example is a two-dimensional image, even if the display target is a three-dimensional object, the processing for the generated interference fringes is the same for a two-dimensional and three-dimensional object. Will be described.

On the transmitting side, first, an interference fringe described by a complex amplitude is input (step 101). 122 in FIG.
123 is an interference fringe (complex amplitude) for the input image 121
A real component a (x, y) (122) of I (x, y) = a (x, y) + ib (x, y) and an imaginary component b (x, y)
(123).

Next, the interference fringe represented by the complex amplitude component can be expressed as I (x, y) = c (x, y) e ⁱ φ ^{(x, y)} , so that the phase component φ (x, y)
To the amplitude component c (x, y) (step 10
2). Reference numeral 124 in FIG. 2 represents the amplitude component c (x, y), and reference numeral 125 in FIG. 2 represents the phase component φ (x, y). These images are expressed as images having 256 gradations.

Next, compression encoding processing of each component is performed. First, FIG. 3 shows a procedure for compressing the amplitude component c (x, y). First, low-pass filter processing is performed as preprocessing (1311), the image after low-pass filter processing is divided into blocks (1312), and individual blocks are subjected to discrete cosine transform (1313), and quantization processing using a quantization table (1312) is performed. 1314) (step 103) to generate compressed data. The image after the filter processing is indicated by 126 in FIG.

Since the image of the amplitude component is a blurred image as a whole (an image containing many components having a low spatial frequency),
There is almost no deterioration in the image quality of the reproduced image due to the application of the low-pass filter. In addition, since the spatial frequency is low, the compression rate can be further increased by using a quantization table that cuts high frequency components considerably.

For the phase component, first, a gradation process (1321) is performed. Since this component image has 256 gradations, each pixel is represented by 8 bits. Therefore, for example, the image is converted into a 4-bit gradation image. The image of the phase component is a component including information such as the shape of the object (or the contour of the texture), and the interval between the stripes is more important than the density information. Therefore, as an extreme example, a binary image can be used. Then, the gradation-converted image is divided into blocks (132).
2) Perform discrete cosine transform (1323) and perform quantization (1324) using a quantization table (step 10).
4) Generate compressed data. The image after gradation processing is shown in FIG.
127.

The high spatial frequency of the phase component is important. Therefore, when the phase component subjected to the gradation reduction processing (1321) is frequency-converted and quantized, a quantization table is used in which the high-frequency component is not dropped much. In order to preserve the high spatial frequency of the phase component, instead of performing the frequency conversion of the phase component subjected to the gradation reduction process (1321) and quantizing the phase component (1322-1324), Huffman coding is performed. May be performed. In this case, reference numeral 133 described later.
In the processing indicated by reference numerals 1 and 1332, the phase components that have been subjected to the gradation reduction and the lossless compression are expanded.

Then, the compressed data of the images 126 and 127 of FIG. 2 are separately transmitted (step 105). As a transmission / reception procedure with the receiving apparatus, a procedure determined for each apparatus is used (steps 106 and 111).

The above processing is sequentially performed every time a new interference fringe is input.

When the receiving side receives the compressed data (step 112), it first performs a decoding process (step 1).
13). The images 126 and 127 are generated. That is, the transmitted compressed data is inversely quantized (1331), inverse DC
By performing the T operation (1332), an image of a phase component and an amplitude component is generated. Then, an image in which the two component images are converted into complex amplitude components again is generated (step 1).
14). Reference numeral 128 in FIG. 2 is an example of an image representing a real component of the complex amplitude, and reference numeral 129 in FIG. 2 is an example of an image representing an imaginary component of the complex amplitude.

By irradiating the converted image with reproduction light, an image as shown by 130 in FIG. 2 can be reproduced (steps 115 and 116).

Next, a configuration example and an operation example of the three-dimensional video transmission apparatus according to the present invention having the above-described characteristic portions will be described. FIG. 4 is a block diagram illustrating an embodiment of the apparatus of the present invention.

In the figure, reference numeral 1401 denotes an interference fringe input means;
Reference numeral 1402 denotes a phase / amplitude component decomposition unit, 1403 denotes a phase component compression encoding unit, 1404 denotes an amplitude component compression encoding unit, and 1405 denotes a transmission unit, and these units constitute a transmission side. 1411 is a receiving means, 1412
Denotes a phase component decoding unit, 1413 denotes an amplitude component decoding unit, 1414 denotes a complex amplitude synthesizing unit, and 1415 denotes a display unit. These units constitute a receiving side. An operation example of the apparatus having the above configuration will be described below.

On the transmitting side, the interference fringe input from the interference fringe input means 1401 is converted into a phase / amplitude component decomposition means 1402
, It is decomposed into a phase component and an amplitude component.

The phase component is calculated by a phase component encoding means 1403.
Performs an encoding compression process. The amplitude component is subjected to encoding compression processing by an amplitude component encoding unit 1404. The above two processes are processed in parallel,
At 05, the compressed data is transmitted, respectively.

On the receiving side, the compressed data of the phase component and the amplitude component received by the receiving means 1411 are identified by detecting the data header or the like by the receiving means 1411.
Each component is sent to the decoding processing means. The compressed data of the phase component is obtained by the phase component decoding unit 1412.
The compressed data is converted into the original phase component image. In addition, the compressed data of the amplitude component is also supplied to the amplitude component
13, the compressed data is converted into the original amplitude component image.

Then, in the complex amplitude synthesizing means 1414,
The two component images are converted into complex amplitude images, and the display means 1
At 415, it is displayed as a hologram.

By adopting the above-described control mode, encoding is performed in accordance with the characteristics of each component image, so that a higher compression ratio can be realized as compared with the conventional compression of complex amplitude.

In this embodiment, the gradation processing is used as a pre-processing of the encoding of the phase component. However, the method of the gradation processing is limited to a method of changing 8 bits to 4 bits. is not. Further, the pre-processing is not limited to the gradation processing, and may be any processing that can hold the pattern of the stripe interval, and the type of image processing is not limited.

As a pre-process for encoding the amplitude component,
In the present embodiment, a low-pass filter is used. However, the processing is not limited as long as the processing can hold a low-frequency component of the spatial frequency.

In the present embodiment, the discrete cosine transform and the quantization process are used as the encoding process. However, many other processes such as fractal transform can be considered, and the present invention is not limited to this embodiment.

In this embodiment, the moving area and the stationary area have been described without distinction. However, the compressed data is transmitted every time the input interference fringe is sequentially updated. On the receiving side, an image can be observed as a moving image. Therefore, there are many other methods for transmitting the compressed data. For example, in the case of an image having many moving regions, a method of transmitting the amplitude component only once in three frames, or a method of transmitting the phase component image only once in three frames in an image such as a change in illumination light only. Such,
It is conceivable to change the transmission order / period of the image of the phase and the amplitude component based on the number of frames and the content of the display image.

The wavefront of light is represented by a complex number, and interference fringes caused by overlapping of a plurality of wavefronts are also represented by complex amplitude. Therefore, the interference fringe component can be decomposed into an amplitude component and a phase component. It can be said that the amplitude component has information reflecting characteristics such as luminance and color of the object, and the phase component has information reflecting characteristics such as position and shape.

In the method of transmitting the image data of the interference fringes simply by compression coding, the high-frequency component has a low density value (contrast). Therefore, the high-frequency component is easily cut by the compression processing, and the image quality of the reproduced image is degraded. There is a disadvantage that it becomes large.

Therefore, as described above, the image transmission method according to the present embodiment decomposes an image of an interference fringe generated as a complex component image into an amplitude component and a phase component image, and the decomposed amplitude component image includes Performing image processing for removing high-frequency components of the spatial frequency, performing image processing for gradation number conversion such as reducing the number of gradations on the phase component image, and compressing each component image after the image processing. Then, the receiving side decodes the received image data of each component into an amplitude component image and a phase component image, synthesizes the complex component image again, and displays the image.

On the transmitting side, the transmission order or transmission cycle of each image data of the phase component and the amplitude component depends on the type of the image of the interference fringe (for example, an image having a large moving area, an image in which only the illumination light changes). To change.

Further, the image transmission device according to the present embodiment
Means for inputting an image of a complex amplitude interference fringe to the transmitting side;
A means for decomposing the interference fringe image into a phase component image and an amplitude component image; an image processing means for performing processing for removing a high-frequency component of a spatial frequency from the decomposed amplitude component image; and the decomposed phase component. Means for performing image conversion processing on the image, and means for compressing and encoding each of the image-processed component images. There are provided means for decoding the component image and the amplitude component image, and means for synthesizing the decoded phase component image and amplitude component image with a complex amplitude image.

Focusing on the fact that human vision is more sensitive to shape than color, etc., the lack of amplitude information has less effect on the sense that the image quality has deteriorated compared to the lack of phase information. The amplitude component of the image data of the interference fringes is processed by a low-pass filter or the like to cut the high-frequency components, thereby increasing the compression rate by the encoding process. On the other hand, the phase information is information where the fringe interval and pattern are important. Therefore, paying attention to the fact that the gray value of the stripe is not so important, the compression ratio of the encoding process is increased by performing processing such as reducing the number of gray levels of the phase component. This enables transmission with a smaller capacity than transmitting the complex amplitude information itself.

By changing the transmission order and transmission cycle, it is possible to emphasize the phase component in the transmission of an image having many moving regions, and to emphasize the amplitude component in the transmission of an image in which only the illumination light changes. Thus, it is possible to further reduce the transmission capacity.

As described above, according to the present invention of the present embodiment, by performing pre-processing in which the respective characteristics of the phase component image and the amplitude component image are stored, a redundant portion can be deleted. The compression ratio can be further increased without deteriorating the image quality of the reproduced image.

(Second Embodiment) In the present embodiment, two images are generated by decomposing an interference fringe having a complex amplitude obtained by calculation into a real part component and an imaginary part component for each pixel. An image processing method and apparatus that separately encrypts two images and uses parameters of various setting conditions when an interference fringe is generated as an encryption key will be described. Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 5 shows an embodiment of the basic system configuration of the present invention. As shown in FIG.
It comprises an image storage management unit 210, an image conversion unit 211, a calculation parameter determination unit 212, an image transmission / reception unit 213, and an image display unit 214. In the following, a side that converts and stores or transmits an image (hereinafter, referred to as a transmitting side) and a side that restores, reproduces, and displays the stored or transmitted image (hereinafter, referred to as a receiving side) are included. The configuration will be described.

The image storage management means 210 stores the generated or received projection image and calculation parameters, and the image conversion means 211 performs various image processing or image conversion processing such as encryption according to the display target image. In particular,
The transmission side calculates a projection image of the input image using specific calculation parameters, and the reception side reproduces the original image (projection image) using the received projection image and the calculation parameters. The calculation parameter determining means 212 determines calculation parameters for calculating a projection image on the transmission side.

If the image transmitting / receiving means 213 is a stand-alone system, the image transmitting / receiving means 213 has a mechanism for controlling image input / output between the image storage / management means 210 and the image display means 214. If they are connected via an external device, they have an image transmission / reception function. The image display means 214 displays an image according to the reproduced image data of the projected image.

These parts function by communicating with each other, and as an example of a specific function (processing), FIG.
This will be described with reference to the flowcharts (a) and (b).

As a first embodiment of the present invention, a specific example using Fresnel projection, which is one specific example of calculation of a projection image, will be described.

As shown in FIG. 7A, the display image (original image A (231)) is irradiated with the reference light 233, and the wavefront of the light transmitted through the original image A is shifted to the screen at a distance Z away. Assume a system in which an interference fringe (image B) generated in H.232 is used as an image after image conversion.

As shown in FIG. 7B, the image B on the screen 232 is again irradiated with the same light (234) as the reference light, whereby the image (projection image A ') is projected at the position 235. Is done. As the projection image A ′, the same thing as the original image A is reproduced. Hereinafter, the embodiment of the present invention will be described using the image ABA ′ conversion system.

First, an original image A (for example, N × N pixels) as shown at 231 in FIG. 7A is input (step 20).
1). Then, it is assumed that each pixel of the input original image A has a point light source. For the amplitude U ₀ of each point light source, for example,
The wavefront on the screen 232 installed at the position of the distance Z is determined using the gray value of each pixel. Here, the point light source is represented by u = (U ₀ / r) · exp [j (kr + φ)] (1) where amplitude U ₀ , phase kr + φ, φ are the initial phase, j
= (-1) ^1/2 , and the image B projected on the screen 232 is assumed to be composed of M × M pixels. Where k is
2π / λ and λ represent the wavelength of the reference light, and r represents the distance between each point light source and each pixel on the screen 232.

Next, the pixel pitch P of the input image_A, Projection
Image pixel pitch P_BAnd reference light wavelength λ and initial phase
φ₀And the distance Z at which the projection image is set as a calculation parameter
A decision is made (step 202). Next, for each point light source,
Wavelength λ and phase φ ₀Using each of the images B
At the pixel, add the wavefronts of the light from the individual point sources
Thus, the value of the wavefront at each pixel of image B is calculated (step
203). Thereby, the projection on the screen 232 is performed.
An image (image B) is obtained.

Specifically, light from a point light source (formula (1)) located at each pixel on the input image (original image A) as shown at 251 in FIG. Is calculated by the following equation. uB = ΣΣuA (2) Here, “uA” indicates that light from a point light source located at each pixel on the input image (original image A) has the light at the pixel (the position indicated by uB) on the screen 232. The amplitude value, uB, represents the complex amplitude of light at a certain position (pixel) on the screen 232 (sum of all point light sources uA).

Then, the complex number uB of each pixel is decomposed into a real part and an imaginary part to obtain projection images such as 253 and 254 in FIGS. 9C and 9D. uB = B _Re + jB _Im (3)

Then, two projected images B _Re (real part), B
_Im (imaginary part) is generated, and two projection images and calculation parameters are held (step 204).

Next, the projection image and the parameters used for the calculation are transmitted and received, respectively (steps 206 and 20).
7).

That is, the projected image B of the real part_ReThe imaginary part
Image B_ImAnd as parameters for calculating the image
The position Z of the projected image, the wavelength λ of the reference light, and the initial position of the reference light.
Phase φ ₀, The pixel pitch P of the projected image_B, Pixel pitch P of original image
_AAre transmitted and received simultaneously.

On the receiving side, while accumulating the received data (step 208), the parameters (Z, λ, φ ₀ , P _A , P _B ) used for the calculation are applied to the projection image of the real part. The projection image B _Re at the distance Z is calculated (step 20).
9). Next, the parameters (Z,
λ, φ ₀ + π / 2) is used to determine the projection image B _Im at the distance Z (step 210). Then, by adding the two projected images B _Re and B _Im for each pixel, a new projected image (added image) A ′ (the reproduced image 252 in FIG. 9B) is generated and displayed (step 211). ), That is, the original image A is displayed. At this time, when the reproduction light is simply applied to the two projection images of the real part and the imaginary part, a double image based on the conjugate image is reproduced, and it is not known what the original image is. Therefore, the imaginary fringe has a phase of the reproduction light of π
By irradiating an object shifted by / 2, the conjugate image can be canceled and the original image can be faithfully reproduced.

Next, as a second example of calculation of a projected image, an example using a Fourier transform type projection method which is a special form of the Fresnel projection type will be described. The Fourier transform type is a transform method when the value of the distance Z of the Fresnel projection type is set to infinity. Although it is not practical to arrange at infinity, this system can be easily realized physically by using a lens having a focal length f. In calculation, this projected image can be calculated at high speed by using a fast Fourier transform (FFT).

FIG. 8A shows the Fourier transform type projected image.
As shown in FIG. 7, a lens 242 having a focal length f is placed in front of an input image (original image C (241)), and transmitted light when a plane wave 243 is projected on the image C as reference light is transmitted through the lens 24
This is equivalent to obtaining an image D to be projected on the screen 244 arranged at a distance f from 2.

As shown in FIG. 8B, the projected image D on the screen 244 is again irradiated with the same plane wave as the reference light, and a lens 245 having a focal length f is set in front thereof. By obtaining a projection image generated at the position of the focal length f by the wavefront transmitted through H.245, the same re-projection image C ′ (246) as the original image is obtained.

The result of the Fourier transform is output as a complex number. The original image is reproduced by performing the same Fourier transform again on the projection image by the complex number.

Next, an example of specific processing will be described.

After inputting an input image C (x, y) as shown at 251 in FIG. 10A (step 201), calculation parameters (wavelength λ of reference light, initial phase φ ₀ , pixel of input image) The pitch, the pixel pitch of the projected image, and the focal length f) are determined (step 202). Next, the input image C (x, y)
Is Fourier-transformed. Each pixel F of the Fourier-transformed image
C (f _x, f _y) and over the parameter conversion, the following equation the value of each _{pixel, f x = x / (λ} · z), f y = y / (λ · z) ··· (4 ) To calculate the projection image D by calculation (step 203).

[0070] That _{is, x = f x · λ ·} z, y = each pixel in the f _y · λ · z image the Fourier transformed by FC (f _x, f _y)
, The value of each pixel of the projected image D can be obtained.

The projected image D is represented by a complex number.
Is decomposed into a real part DRe and an imaginary part DIm (step 20).
4) Two images are generated as shown at 263 and 264 in FIGS. 10D and 10E, and are stored together with the calculation parameters (step 205).

Then, the wavelengths λ and phase φ used for the reference light, the pixel pitch of the original image, the pixel pitch of the projected image, and the focal length f are transmitted and received as the calculation parameters of the images DRe and DIm (step 206). , 20
7).

On the receiving side, while accumulating the received data (step 208), a projection image by Fourier transform is obtained for the real part image DRe using the same parameters as the reference light (step 209). Image D of the imaginary part
For Im, a projected image when the phase is shifted by π / 2 with respect to the reference light is calculated using Fourier transform (step 210). Then, when an image is generated by adding the two projected images, the original image is reproduced (step 21).
1). Note that reference numeral 262 in FIG. 10C denotes an example of an optically reproduced image according to the present invention.

If only the real part is used, FIG.
As shown at 261 in (b), an image in which the original image upside down is overlaid is reproduced. If the original image is a complicated image, it is understood that the original image cannot be recognized with such a superimposed image.

In the above embodiment, the real part and the imaginary part are separately transmitted. However, at the stage of the complex amplitude, it is also possible to decompose into an amplitude component and an imaginary component, and store and transmit each separately. For example, in the case of the Fresnel projection type, the projected images of the amplitude and phase components are 255 and 255 in FIGS.
The image is 256, and in the case of the Fourier transform type example, images as shown in 265 and 266 in FIGS. 10F and 10G are generated from the projected images of the amplitude and phase components. Then, on the receiving side, a complex component image is generated again from the amplitude component and the phase component, and the real part is displayed. Or,
Further, it is also conceivable to decompose the image into a real part and an imaginary part, add the variable conversion processing as described above, and then generate a composite image of the projection image of the real part and the imaginary part.

Here, the reproduction image can be generated by calculation on a computer, but can also be displayed by a display device capable of controlling the amplitude and phase of light. If only a display device capable of displaying only the amplitude is used, it is possible to optically reproduce a high-speed image by using the above-described method of reproducing the images obtained by real and imaginary decomposition.

It is also conceivable that the dynamic range of the projected image is changed by a specific function conversion or the like, and the parameters of the function are transmitted and received at the same time. In other words, by manipulating the dynamic range, even if a projected image is generated as it is from the transmitted image, it is possible to prevent the image from being discriminated by being buried in noise. That is, it is also possible to use only image information in a specific range as a projection image. For example, as shown at 271 in FIG. 11A, the projection image normally obtained as the projection image is linearly converted and replaced with the gray value of the image.
As shown in FIG. 2, a method of making the relationship between the calculated value of the projected image and the image density value non-linear is conceivable.

In this embodiment, the size of the projected image is described as the projected image (M × M pixels) with respect to the input image (N × N pixels). Is arbitrary, and M = N or M = 2 * N is also possible. The aspect ratio is also arbitrary, and is not specified in the above embodiment.

The parameters for generating the projection image are as follows:
Although one type of example is described in one image, it is also possible to change each pixel, for example, by changing a parameter for each pixel by a predetermined function conversion, and transmitting the parameter of the function. It is also possible to

In the above embodiment, the images A, B,
Although the example in which the sizes of C and D are fixed has been described, the size of the display image can be arbitrarily set by transmitting these sizes as parameters.

In the case of the Fresnel projection type, an example is shown in which, upon transmitting an image, a projection image is calculated after all of the transmitted image data has been received. It is also possible to calculate.

That is, the calculation parameters are transmitted and received first, and the projection images are calculated from the pixels sequentially received by using the parameters.
With a small number of pixels, the blurred projected image gradually becomes clear, and blogless display becomes possible.

If the image is divided into specific blocks instead of pixels, and data is received for each block,
A method of calculating the projection image is also conceivable, and the processing procedure of the received data is not specified in the above embodiment.

Also, the order of the pixel data to be transmitted can be considered in a number of ways, such as a method of sequentially starting from the upper left pixel, a method of scanning the image outward from the center of the image, and the order of the transmitted data is not specified.

Further, in the Fresnel projection type example, an example is shown in which a projection image of one image is transmitted. However, a plurality of images or moving image sequences are arranged at different Z values, or the incident angle θ of the reference light is changed. It is also possible to calculate a different value for each frame and transmit a projection image projected on the same screen. In this case, parameters (Z, λ, φ, θ, etc.) are given for each image, and the original image is restored by calculating a projection image at each Z value or each θ value. Can do things. That is, a plurality of pieces of image information can be transmitted at the same time.

Next, the operation of the embodiment of the image processing apparatus of the present invention having the above-described characteristic portions will be described.

When an image to be displayed or an image to be transmitted is input, it is sent to the re-image conversion means 211. The image conversion unit 211 calculates a projection image of the input image using the calculated parameters determined by the determined calculation parameter determination unit 212, and stores the calculated projection image and the calculated parameters in the image storage management unit 210. Is retained. The image storage management means 210 transmits a desired projection image and its calculation parameters in response to a trigger of the image transmission / reception means 213. On the receiving side, the received data is transferred to the image storage management unit 2 via the image transmitting / receiving unit 213.
In accordance with a trigger of the image display means 214, the image conversion means 211 calculates an original projection image from the received and stored projection image and the calculation parameter, and outputs the calculated projection image to the image display means 214. Is displayed.

According to the above-described control mode, the display target image is converted into a projection image, so that it is impossible to determine what is displayed in the original image. It is impossible to obtain the original image, and the encrypted transmission and storage of the image information becomes possible.

Further, in this embodiment, a projected image similar to the image generation is obtained by calculation in reproducing the converted image, but it is also possible to optically reproduce the reproduced image in real time.

For example, if a reproduction system using only the real part is described as an example with reference to FIG. 12, a received projection image is displayed on a display 281. Display 28
The projection image displayed in 1 is reduced by the lens 282 and projected on the display 283. Here, the lens 282 is a lens whose reduction ratio can be changed in accordance with a calculation parameter (projected image pitch or distance Z) (for example, the lens is installed in a movable type before and after, or a Fresnel lens displayed electronically). Etc. are conceivable).

The display 283 is a high-resolution display device capable of fine display, and may be a reflection type liquid crystal or the like. The display 283 is irradiated with light corresponding to the calculation parameter (wavelength λ) from 285, and the reproduction light 285
Is irradiated on the display 283 through the half mirror 284. The light reflected by the display 283 is projected on a screen 287 through a half mirror 284. The image projected on the screen 287 is the magnifying lens 2
The image is enlarged by 88 and reproduced on the screen 289 at the size of the original image. Here, the magnification of the magnifying lens can be flexibly handled by using one that can be changed by a calculation parameter (pixel pitch or distance Z).

By using the above system, image generation is performed by calculation, and at the time of transmission, a projected image is transmitted to protect the security. For reproduction, the original image is reproduced instantaneously optically. Will be done.

In this embodiment, a combination with the method described in the first embodiment is also possible.

That is, in the encryption / encoding process, in step 204 of FIG. 6A, instead of decomposing the component into a real part / imaginary part, the component is decomposed into an amplitude / phase component. Encoding is performed as described in the embodiment. In step 205, instead of the projection image of the real part and the projection image of the imaginary part, the encoded amplitude component and phase component are stored.

In the decoding / display process, between steps 208 and 209 in FIG. 6B, the coded amplitude component and phase component of the received data are decoded and decoded. Real part from amplitude component and phase component,
Processing for obtaining an imaginary part is added.

As described above, in addition to the data compression effect described in the first embodiment, the receiving side can store and manage encrypted data and use an image display device capable of displaying normal grayscale values. Thus, optical reproduction becomes possible.

The present invention provides a hard disk or other storage device capable of storing and storing data such as a projection image and its calculation parameters and freely reading them out, and calculating and reproducing data for generating and reproducing the projection image. And a device necessary for holding data when performing image processing and the like, a device equivalent thereto, an output device such as a display for displaying a reproduced projected image, and an input device such as a keyboard and a mouse. The function of each part in the embodiment of the configuration of FIG. 5 or the function of FIG. 6 by a computer or a similar device that controls the hard disk, buffer, output device, input device, and the like based on a predetermined procedure.
It is possible to appropriately execute the processing procedure or algorithm in the embodiment of the method of the present invention shown in the flowcharts of (a) and (b), and to execute the procedure or algorithm on a computer or the like. Can be recorded on a computer-readable recording medium, for example, a floppy disk, a memory card, an MO, a CD-ROM, and the like, and distributed.

A computer-readable recording medium, such as a floppy disk or a memory, for transmitting or reproducing and displaying one or both of the projection image and the calculation parameter to be stored or transmitted by the method according to the present invention. Card, MO, CD-
It can be recorded on a ROM or the like and distributed.

As described above, in the method described in the present embodiment, when storing / transmitting, the image is irradiated with the reference light having the wavelength (λ) at the angle of the incident angle θ, and the image is irradiated at a certain distance from the image. (Z) calculating a projection image projected on a distant screen as a complex amplitude, decomposing the complex amplitude projection image into a real part and an imaginary part, and dividing the projection image into two parts and a calculation parameter (distance ( Z), wavelength (λ), etc.) are stored or transmitted, and when reproducing / displaying, the wavelength (λ) is used.
Is calculated by irradiating the projected image of the real part with the incident angle θ, and the projected image of the imaginary part has a further π / 2 phase with the light of the wavelength (λ). The projection image of the distance (Z) when the light with the shifted position is irradiated is calculated, and an image is generated by adding the two projection images.

As another method, when calculating a projected image as a complex amplitude, a lens is provided on the entire surface of the image, and an image of light transmitted through the lens is used as a projected image.

In the above method, two types of images obtained by decomposing each pixel of the image of the projected image into a real part and an imaginary part, and calculation parameters are separately stored or transmitted.

In the above method, when accumulating or transmitting projection images and calculation parameters (distance (Z), wavelength (λ), etc.) obtained by calculation, these projection image data and calculation parameters are encrypted. In addition to holding the encrypted data, an encryption key is also held at the same time.

In the above method, when the stored or transmitted projection image is reproduced and displayed on the original original image,
While sequentially reading stored or transmitted data,
The projection images are sequentially reproduced.

Further, in the above method, when reproducing and displaying the projected image, the projected image is optically reproduced and displayed through a lens capable of scaling the projected image.

Further, in the apparatus of the present embodiment, the image conversion means for generating the projection image of the input image using specific calculation parameters on the side storing or transmitting the projection image,
Means for determining the calculation parameters, means for storing the projection image and the calculation parameters, and / or means for transmitting the projection image and the calculation parameters, and a side for reproducing and displaying the projection images A means for receiving the stored or transmitted projection image and calculation parameter; a means for reproducing the projection image based on the received projection image and calculation parameter; and a means for displaying the reproduced projection image. ing.

As a recording medium of the method according to the present embodiment, the above method is recorded on a computer-readable recording medium as a program to be executed by a computer.

Further, as the image recording medium in this embodiment, one or both of the projection image and the calculation parameters obtained by the above method are recorded on a computer-readable recording medium.

Recording the interference between the reference light and the light transmitted through the image is equivalent to recording a hologram. Then, it is impossible to recognize what is recorded on the hologram unless the hologram is irradiated with reference light (reproduction light) and the generated image is observed. That is, the image can be encrypted and stored.

Also, unless the hologram is irradiated with the same light as the reference light, the reproduced image cannot be observed, and the original image cannot be reproduced unless the calculation parameters for calculating the projected image are known. By managing calculation parameters and projection images separately by using
Further, the image data can be held more safely.

A second method using a projection image of light transmitted through an image at an infinite point as a method of obtaining a projection image can be realized by physically viewing transmitted light through a lens. Since this system is equivalent to performing an optical Fourier transform, a projected image can be calculated at high speed by applying the Fourier transform. At this time, the result of the output of the Fourier transform becomes a complex number, and the projection image of the real part is used as the projection image. Then, the original image can be reproduced by subjecting the projected image to the optical Fourier transform again. Projection and reprojection of an image using such a Fourier transform are often used in simulation of a computer generated hologram.

Normally, in a computer generated hologram, only the above-mentioned real part is used as a projected image. However, when an image is reproduced only with a real number part, a true image and a conjugate image are generated at the same time, and an original image and an image obtained by inverting the original image are superimposed and reproduced, so that the original image cannot be recognized (2). Double image problem). In other words, it can be said that this is a kind of encryption that can keep the confidentiality of the image if only the real part is used.
By the way, in order to reproduce the original image, as a re-display method that does not cause the problem of the double image, when the complex amplitude itself is used for transmission, if the wavelength of the reproduction light is known, the image data can be easily reproduced. May be lost. However, by transmitting the two interference fringes (that is, the real number interference fringe and the imaginary number interference fringe) separately as in the present invention, the reproduction by one of the interference fringes is 2. Although it is difficult to recognize what is recorded as an image in the subject of the multiple images, the problem of the double image can be avoided by combining the two interference fringes, and the security is simple. From complex amplitude transmission, 2
Double security can be secured.

Further, when the image data of the projected image and the calculation parameters are stored, each data is encrypted and stored, so that, for example, security when transmitting and receiving this image data via a network is obtained. The above safety can be secured.

Further, as a feature of the hologram, there is a feature that the entire image of the reproduced image can be observed even with only partial data. And, if the hologram is small, the image quality of the reconstructed image is poor, but by using a larger (large screen) hologram, the reconstructed image becomes clearer.
"0 optical Holography" Colo
er, by Burckhardt and Lin, p.
p. 526-541, (1971)). That is, the original image can be reproduced even if the projection image used in the present invention is partial data of the projection image. Therefore, according to the fifth method, instead of reading the entire data of the projection image into a memory or the like and then calculating the reproduced image, the reproduced image is sequentially read (re-projected) from the read data while being read sequentially. Gradually becomes clearer,
Progressive image reproduction becomes possible.

It is not necessary to use the wavelength of the actual laser light as the wavelength used for the reproduction light, and it is sufficient that the wavelength can be calculated as a calculation simulation. Therefore, there are infinite types of wavelengths to be used. However, the reproduction light wavelength cannot be decoded.

When a wavelength of an existing visible wavelength laser or the like is used for generating a projection image, reprojection processing can be performed optically in real time. That is, data transmitted via a network or the like can be reproduced in real time and an original image can be displayed.

As described above, according to the present invention, image information can be transmitted and received and stored with high security encryption, and progressive reproduction can be performed.

(Third Embodiment) When the interference fringes of the computer generated hologram described in the first and second embodiments are viewed as a digital image, it is said that the main bits contain the main information of the reproduced image. Has characteristics. For this reason, even if the lower bits of each pixel are deleted, the influence on the image quality deterioration of the reproduced image is small. Therefore, the lower bit portion can be used as a storage location for other image information. Therefore, in the present embodiment, an image processing method and apparatus that multiplexes a plurality of digital images related to interference fringes to generate a multiplexed image using the above characteristics will be described. Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

First, the definition of a digital image related to interference fringes in the present embodiment will be described with reference to FIG.
In the following, a digital image obtained by digitizing interference fringes of a computer generated hologram is simply referred to as a “digital image”. In the digital image according to the present embodiment, each pixel is composed of 8 bits. Then, the bit Dear of each pixel constituting the digital image, ⁰ 2 from the lower bit in order as shown in FIG. 14, 2 ^{1, 2} 2, 2 ^3, 2 ^4, 2 ^5, 2 ^6, 2 ⁷
Let's call it the place. Note that in FIG.
Numerals 01, 302, 305, 311 and the like are symbols indicating pixels constituting the digital image. In FIG. 14, as an example, the pixel 311 is extracted and each bit is shown. The number of bits of the digital image, 8 bits, is an example, and can be freely set. Note that generation of an image related to interference fringes and hologram display (image display) using interference fringes are the same as those described in the first and second embodiments, and a description thereof will be omitted below.

Next, a G image processing method for generating a multiplexed image from a plurality of digital images will be described with reference to FIGS. 13 (a) and 13 (b). First, a plurality of digital images to be multiplexed are input (step 401). In the present embodiment, a description will be given on the assumption that three digital images having different sizes as shown in FIG. 15 have been input. For example, as the size of the digital image, the size of the digital image A of the reference numeral 21 is 256 × 256 pixels, the size of the digital image B of the reference numeral 22 is 128 × 128 pixels, and the size of the digital image C of the reference numeral 23 is 64 × 64 pixels. It is assumed that In FIG. 15, the reference numerals assigned to the three digital images are for specifying the pixels of each digital image. FIG. 16 is a diagram showing a bit sequence of a specific pixel of each digital image shown in FIG. Reference numeral 31 in FIG. 16 indicates a bit sequence of the pixels 301 to 316 of the digital image A in FIG. 15, reference numeral 32 indicates a bit sequence of the pixels 321 to 324 in the digital image B of FIG. 3 shows a bit sequence of a pixel 331 of the digital image C of FIG. In the following, in the reference numeral 32 in FIG.
A, b, c, d, e, f
Shall be called. Similarly, at reference numeral 33, the pixel 33
The upper 6 bits of 1 are g, h, i,
j, k, l.

Next, a method of exchanging bits for image multiplexing is determined (step 402). Here, a method of exchanging bits is defined so as to hold each upper bit of each pixel of each digital image. Here, the reason why the image quality is less deteriorated even when the image is reproduced using only the upper bits of each pixel of the digital image of the interference fringe will be described below. Consider the case where the object is a single point light source. When the interference fringes of the wavefront from this point light source are recorded as a hologram,
The information of one point is scattered over the entire hologram surface. The hologram is a fairly redundant recording method of information, so that when reproducing, the original image can be reproduced even if some information of the hologram is missing. It can be said that this hologram has not only planar redundancy but also similar redundancy for the bit position of a digital image. In an extreme example, even if the image is binarized, the density information of the original image is scattered and held in the hologram.
This is because the information necessary for the hologram is the interval (phase component) between the fringes of the interference fringes recorded as described in the first embodiment, and the shading of the fringes is more important than the phase information. Because there are few. In fact, even a binary hologram represented by a binary value can represent a gray value. In other words, the light transmitted through the hologram is not binarized,
This is because the analog waveform makes it possible to easily change the gray level by adjusting the amount of light at the interval between the stripes. Therefore, when the interference fringes are viewed as a digital image,
Utilizing the characteristic that the main information of the reproduced image is included in the high-order bits, the method of exchanging bits is specified so that each high-order bit of each pixel of each digital image is retained, and image multiplexing is performed. Do. For example, as a method of exchanging bits, upper 6 bits of the digital image A are left as information of the digital image A, and information of upper 6 bits of the other digital images B and C is assigned to the remaining lower 2 bits.

An example of this bit replacement method is shown in FIG.
This will be described with reference to FIG. FIG. 17 is a bit string of each pixel of the multiplexed image generated based on the digital image A.
Reference numerals 301 to 316 represent the pixels in FIG. In an example of the bit replacement method, the upper 6 bits of the pixels 301 to 316 are set as the upper 6 bits of the digital image A. Then, the pixel 32 of the digital image B
The upper 6 bits of 1 are the pixels 301, as shown in FIG.
It is allocated to lower bits of 302, 303 and 304.
In the example of FIG. 17, the bits of the lower 2 ^1, 2 ⁰ pixel 301, a pixel 321 of the digital image B, b is allocated, c of the pixel 321, d is allocated to the lower bits of the pixel 302, the pixel the lower bits 2 ¹ 303 given e of the pixel 321, the pixel 32 to the lower bits 2 ¹ pixel 304
It defines a bit swapping method for allocating the value of f of 1. Similarly, in the bit replacement method, the values of the upper 6 bits of the pixels 322, 323, and 324 of the digital image B are allocated to the lower bits of the pixels 305 to 316 as shown in FIG. Next, in the bit swapping method, the pixels 331, 304, 307, 308, and 31 of the pixel 331 of the digital image C as shown in FIG.
The values of the upper bits g, h, i, j, k, and l of the pixel 331 are sequentially assigned to the least significant bit 20 of ¹ , 312. FIG. 18 shows the pixels 301 to 316 in FIG.
The a view showing each bit position, the bit position 2 ⁰ of the lowest of the reference numeral 34 is 16 pixels, the reference numeral 35 is a bit position 2 ^1,
Reference numeral 36 denotes a bit position ² 2-2 ^7. by the way,
As can be seen from FIGS. 17 and 18, in this bit replacement method, information is not allocated to each bit indicated by reference numeral 341.

Then, based on the bit exchange method defined in step 402, the upper bits of each pixel of the digital images B and C are decomposed, and the bits of the digital images B and C decomposed into the lower bits of the digital image A are allocated. (Steps 403 and 404). This means that images of different sizes have been recorded with the number of pixels and the amount of information of one digital image A. Then, the generated multiplexed image is stored, displayed, or transmitted / received (step 405). As described above, a multiplexed image of a plurality of digital images is generated.

Here, the digital images A, B, and C are described as different images, but they are the same image,
By using the images as images having different resolutions, multi-resolution image information can be held with a data amount of one image information. This allows for progressive display of images,
It is also possible to display an image having a resolution suitable for the resolution of the display device.

It is also possible that the digital image A is an image relating to a background image and the digital images B and C are images relating to a component image to be synthesized with the background image. In this case, the offset value of each of the images B and C is attached to the multiplexed image by a header or the like as the arrangement information of the digital images B and C on the digital image A. Here, it is assumed that the image size of the partial image with respect to the background image is small enough to be multiplexed by the above method.

As shown by reference numeral 341 in FIGS. 17 and 18, the least significant bit 2 ⁰ of the pixels 315 and 316 is used.
Is blank. Digital image A
In this example, 2 × 4 × 4 pixels
There is a vacant bit, and a total of 8192 ｛= (256 /
4) × (256/4) × 2｝ bits are left. Using this portion, additional information of the image, for example, the offset value of the component image described above can be held. Note that the image allocation and the bit allocation described in the embodiments described above are examples, and can be changed according to image information, and are not specified in the example of the present embodiment.

Next, an example of transmitting and receiving the multiplexed image and displaying the multiplexed image will be described with reference to FIG. In addition,
Hereinafter, the side that performs this processing will be referred to as the “receiving side”. In the image processing method related to multiplexing described above, a correspondence table related to image distribution and bit allocation defined by a method of exchanging bits is prepared, and attached and transmitted to the multiplexed image (step 411). The receiving side first reads the attached table (step 41).
2) The data corresponding to the table is divided into bits (step 413), each image is returned to the original size, and generated / displayed (step 414). When the stored multiplexed image is to be expanded and displayed, the above step 4
12 to 414 will be performed.

A display method according to the display capability of the display device will be described. First, by the method described above, a multiplexed image in which images of a plurality of resolutions are multiplexed and a correspondence table are generated, and stored or transmitted / received on some recording medium (steps 401 to 405 and step 41).
1). On the display device side, assuming that the effective image display size is, for example, 128 × 128 pixels in accordance with the display screen size specified in advance, the stored correspondence table is referred to (step 412), and the 128 × 128 pixels are converted from the multiplex image.
Only bit information corresponding to 128 pixels is extracted (step 413). Thus, the image information to be displayed itself matches the performance of the corresponding display device, so that the image can be operated efficiently. When the image is to be printed (step 415), a higher resolution image is required. Therefore, the correspondence table is referred to again (step 412), and the bits corresponding to the image having a size suitable for printing are read out. (Step 413) The image is printed. One of the advantages of using interference fringes as a multi-resolution image is that the display accuracy of a display object can be changed. That is, in the case of interference fringes having a high resolution, even a component having a high spatial frequency can be expressed. This means that a detailed shape of the object such as unevenness and a fine pattern on the surface can be expressed. When the resolution is low, only the low-frequency component of the spatial frequency can be described, so that only the rough shape of the object can be expressed. In other words, not only the resolution of the display device but also the interference fringes are selected as needed, so that the object can be expressed with the necessary resolution (definition).

An example in which a background image and a component image are prepared as images to be multiplexed will be described. For background images,
When multiplexing a plurality of component images having the same resolution in combination, the method described above is used. On the other hand, even if the size of the component image with respect to the background image is the same, the image size to be multiplexed is also multiplexed for a larger size. That is, the background image is a single image of a predetermined size, the component images are a plurality of images having different resolutions, and a plurality of component images having different resolutions are multiplexed on one background image. When developing and displaying a background image and a component image from a multiplexed image obtained by multiplexing these, first,
By the method described above, the background image and the component image are decomposed, and the background image is combined with the component image having the same resolution as the background image. When increasing the resolution of the entire composite image of the background image and the component image, the background image is increased in resolution of the background image extracted by predetermined image processing, and the component image is a multiplexed image having a resolution corresponding to the increased resolution. , And combine it with a background image with a higher resolution. Since the original high-resolution information is used for the part image part, a clearer image can be obtained for the part image.

Next, an image processing apparatus that performs the above-described method will be described. FIG. 19 is a block diagram illustrating an example of a device configuration according to the present embodiment. 19, the image processing apparatus includes an image input unit 51, a frame memory 52, an image bit operating unit 53, an image bit distribution determining unit 54, and an image holding unit 55. When displaying a multiplexed image, an image display means 56 is provided. Further, when transmitting / receiving multiplexed images, an image transmitting / receiving means 57 is provided. Here, the image input means 51
Is an image related to interference fringes caused by reference light and light from an object, and is provided for inputting a plurality of digitized digital images to be multiplexed. The frame memory 52 serves as a working memory when generating a multiplexed image. The image holding unit 55 is provided to hold a plurality of images input by the image input unit 51 and a generated multiplexed image. I have. Then, the image bit distribution determining means 54 has a function of defining a bit replacement method so as to hold each upper bit of each pixel of a plurality of images.
The image bit operating means 53 generates a multiplexed image on the frame memory 52 by operating the bit sequence of each pixel of the input digital image based on the method of replacing each bit determined by the image bit distribution determining means 54. Has functions.

The operation of this device will be described below. First,
The digital image input to the image input unit 51 is held in the image holding unit 55, and one digital image is read into the frame memory 52, and the number of bits of the image,
Based on information such as the size, the bit allocation determining means 54 determines a bit replacement method such as a lower bit allocation method and another image arrangement method. Next, another image is read into the frame memory 52, and the newly read image is divided into bits by the bit operating means 53 based on the previously determined bit replacement method. Assign to lower bits. After multiplexing all the images read first, the new image is held in the image holding unit 55. When transmitting the stored image, the image is transmitted through the image transmitting / receiving unit 57.
It is sent to another display device, storage medium, or the like. Then, the display device 56 performs display while sequentially reading out only the image of the portion that meets the specifications of the display device from the stored images. Here, the correspondence between the units in FIG. 19 and the processing steps in FIG. 13A will be described. The image input unit 51 performs step 401, the image bit allocation determining unit 54 performs step 402, The bit operating unit 53 performs steps 403 and 404, and the image holding unit 55 performs step 405. In the case of displaying an image multiplexed by the apparatus shown in FIG. 19, the transmitting / receiving means 57 performs step 411 in FIG. 13B, and the image bit operating means 53 performs steps 412, 413.
Is carried out, and the image display means 56 executes steps 414 and 415
Will be implemented.

In the present embodiment, a digital image is used as an input image. However, an input image may be analog information. The present invention can be applied by converting into a digital image according to the amount.

As described above, when a digital image is an image of n bits for each pixel, important information as image information is mainly included in higher-order bits. Therefore, even if the lower bits are rewritten with different information, the effect on the image quality of the image is small. That is, it is possible to determine the lower bits that do not affect the image quality according to the image. Therefore, a plurality of images are extracted up to a predetermined high-order bit (for example, n / 2 bits) and are combined. That is, a certain image (for example, an image having the largest amount of information) is selected, and information of higher-order bits of another image is incorporated in lower bits. At this time, it is decided by the system to determine which bit position is information of a different image, or the information is attached to the image as additional information. As a result, the information of two images is incorporated with the data amount of one image.

As a method of multiplexing the image information obtained by reducing the size of the image by １ ／, the lower bits of the four pixels of the initially selected image are added to the lower bits of one pixel of the サ イ ズ size image. Make sure to assign the high-order bit. When this process is repeated, normal size image information is placed in the upper bits of the pixel, half size image information is placed in the upper half of the lower bits, and １ ／ is placed in the upper half bits of the lower bits. The image information of the size is incorporated. When reading this image, it is possible to easily display an image having an optimal size on the screen of the display device by determining how many bits of information are extracted according to the screen size of the display device. Also, a component image and a background image can be prepared. At this time, the resolution of the background image and the resolution of the component image do not need to be the same, and by increasing the resolution of the component image relative to the background image, it is also possible to make the part image portion high definition. It becomes possible. The multiplexing of digital images described in the present embodiment can be combined with the encryption-related processing described in the second embodiment.

As described above, according to the present invention, it is possible to hold a plurality of images in the data amount of one image, or to transmit and receive a plurality of images, and to display images according to the specifications of the display device. This has the effect of wasting unnecessary memory capacity and eliminating the need for image processing.

Note that each unit of the apparatus shown in the first to third embodiments functions as a processing unit. That is, each means (each processing unit) is realized by dedicated hardware, or is provided as a program and executed by a memory (not shown) and a CPU (Central Processing Unit) to realize its function. In addition, a program for realizing the method described in each embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed to execute image transmission / image processing. Processing may be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” is a floppy disk, a magneto-optical disk, an RO
M means a storage medium such as a general medium such as a CD-ROM or a hard disk built in a computer system. Further, a "computer-readable recording medium" refers to a communication line for transmitting a program via a network such as the Internet or a communication line such as a telephone line, and dynamically holds the program for a short time. thing,
In this case, a program that holds a program for a certain period of time, such as a volatile memory in a computer system serving as a server or a client, is also included. Further, the above-mentioned program may be for realizing a part of the above-mentioned functions, or may be for realizing the above-mentioned functions in combination with a program already recorded in a computer system.

Next, the fields of application of the image transmission / processing method and apparatus described in the first to third embodiments will be described. The present invention relates to an image transmission / processing technique using computer holography, and more particularly to a technique for transmitting / accumulating not only stereoscopic images but also ordinary two-dimensional images. And this technology, in the stereoscopic video transmission over the network,
It can be used for virtual reality data transmission. Specific applications include 3D television, CAD systems, network-based virtual reality computer games, and the like.

[0137]

As described above, the following effects can be obtained by the image transmission / processing method and apparatus according to the present invention and the recording medium on which the program is recorded. By performing preprocessing that preserves the characteristics of the phase component image and the amplitude component image, redundant portions can be deleted, and the compression ratio at the time of transfer can be further increased without deteriorating the image quality of the reproduced image. Will be able to Also, by irradiating a specific reference light to the image to be processed and using a complex amplitude value obtained by calculating a projected image generated by light transmitted or reflected by the image, the image information can be used as a security level. It is possible to achieve transmission and reception and accumulation with high encryption, and it is possible to obtain the effect that progressive reproduction can be performed. Also, the data amount can be reduced by multiplexing images in which a plurality of interference fringes are digitized.

[Brief description of the drawings]

FIG. 1 is a flowchart showing a procedure on a transmitting side and a procedure on a receiving side in the first embodiment, respectively.

FIG. 2 is a diagram showing a specific example of an input image and interference fringes.

FIG. 3 is a diagram showing a specific example of encoding / decoding processing in the embodiment.

FIG. 4 is a block diagram showing one configuration example of the device according to the present invention.

FIG. 5 is a block diagram showing a basic configuration of an apparatus according to a second embodiment.

FIG. 6 is a flowchart showing a basic processing procedure in the second embodiment.

FIG. 7 is a diagram illustrating a system for calculating a Fresnel projection image according to the method of the present invention.

FIG. 8 is a diagram illustrating a system for calculating a Fourier transform projection image according to the method of the present invention.

FIG. 9 is a diagram showing a specific example of an image when a Fresnel projection image is used.

FIG. 10 is a diagram showing a specific example of an image when a Fourier transform projection image is used.

FIG. 11 is a diagram illustrating a method of converting between a projected image and an image gray value.

FIG. 12 is a diagram showing an embodiment of a system configuration block for optically displaying a projected image.

FIG. 13 is a flowchart showing a processing procedure of a method according to the third embodiment.

FIG. 14 is a diagram showing a relationship between an image and a bit position.

FIG. 15 is a diagram illustrating an example of an array of pixels of an image.

16 is a diagram showing a bit string of each pixel of each image shown in FIG.

FIG. 17 is a diagram showing a bit string of each pixel of the generated multiplexed image.

FIG. 18 is a diagram showing bit allocation in each bit position of a generated multiplexed image.

FIG. 19 is a block diagram showing a configuration example of a device according to a third embodiment.

[Explanation of symbols]

 1401 interference fringe input means 1402 phase / amplitude component decomposition means 1403 phase component compression coding means 1404 amplitude component compression coding means 1405 transmission means 1411 reception means 1412 phase component decoding means 1413 amplitude component decoding means 1414 complex amplitude synthesis means 1415 Display means 210 Image storage management means 211 Image conversion means 212 Calculation parameter determination means 213 Image transmission / reception means 214 Image display means 51 Image input means 52 Frame memory 53 Image bit operation means 54 Image bit allocation determination means 55 Image storage means 56 Image display means 57 Transmission / reception means

 ──────────────────────────────────────────────────の Continuing on the front page (72) Inventor Satoshi Suzuki Nippon Telegraph and Telephone Corporation, 3-19-2 Nishishinjuku, Shinjuku-ku, Tokyo

Claims (32)

[Claims] 1. A three-dimensional information of an object recorded as interference fringes by reference light and light from an object is sequentially transmitted, and a receiving side sequentially displays the received interference fringes and irradiates a reproduction light to irradiate the object with reproduction light. In the image transmission method for displaying three-dimensionally, on the transmitting side, a process of decomposing an image of an interference fringe represented by a complex number into an amplitude component image and a phase component image; Performing a process of reducing the high-frequency components of the phase component image, performing a gradation conversion process on the phase component image, and performing a compression encoding process on each of the images after each of the processes, and an image of the compression-encoded two components. Transmitting the data separately, wherein the receiving side receives the image data of the two components transmitted separately, and converts the received image data into an amplitude component image and a phase component image. Successive restoration Process and an image transmission method according to the phase and amplitude degradation process, characterized in that it has a, a process of displaying synthesized and the decoded amplitude component image and a phase component image again complex components of the. 2. The transmission step according to claim 1, wherein a transmission order or a transmission cycle of each of the image data of the phase component and the amplitude component is changed according to a type of the image of the interference fringes. An image transmission method based on the described phase and amplitude decomposition processing. 3. An image processing method for converting image data and storing or transmitting the converted image, wherein the image data is set at a certain spatial position, and the image is irradiated with a specific reference light, The process of calculating a projection image generated by light transmitted or reflected by calculation as an image having a value of complex amplitude, and each pixel of the image of the projection image having the calculated value of complex amplitude as a real part. An image processing method comprising: storing or transmitting two types of images decomposed into imaginary parts and calculation parameters for generating the projection image. 4. The method according to claim 3, wherein in the step of calculating the projection image, a lens is installed on the entire surface of the spatial position where the image data is arranged, and the projection image at the focal length of the lens is obtained. The image processing method described in the above. 5. In the storing or transmitting step, two types of images obtained by decomposing each pixel of the image of the projected image into a real part and an imaginary part and calculation parameters are separately stored or transmitted. The image processing method according to claim 3 or 4, wherein 6. The storing or transmitting process includes two types of images obtained by decomposing each pixel of the image of the projected image into a real part and an imaginary part, a wavelength of reference light, and positional information where image data is set. 4. The image processing method according to claim 3, wherein the calculation parameters are encrypted and stored or transmitted. 7. An image processing method for reproducing and displaying a projection image stored or transmitted by the image processing method according to claim 3, wherein the image of the real part includes the reference. Irradiating light of the same wavelength as the light, and calculating the wavefront of the transmitted light when irradiating the image of the imaginary part with the light of the same wavelength as the reference light shifted by π / 2 phase. An image processing method comprising: generating a composite value of a wavefront of light as an image and reproducing a projected image; and displaying the reproduced projected image. 8. The method according to claim 7, wherein in the step of reproducing the projection image, the projection image is sequentially reproduced while reading out the two kinds of stored or transmitted images and calculation parameters. Image processing method. 9. The reproduced projection image is optically projected through a lens capable of enlarging or reducing the image according to the calculation parameter in the step of displaying the projection image. An image processing method according to claim 8. 10. An image processing method for multiplexing a plurality of images to generate a multiplexed image, comprising: an image related to an interference fringe caused by reference light and light from an object; Selecting one image from the digitized digital images, holding only the high-order bits up to a predetermined order in the selected image, and storing the lower bits of each pixel of the selected image that are not held. Allocating information of higher-order bits of an image other than the selected image to a position corresponding to the bit. 11. The method according to claim 1, wherein in the step of selecting the image, the plurality of digital images are images generated from the same image having different resolutions.
0. The image processing method according to 0. 12. In the process of selecting the image, the plurality of digital images are an image generated from a background image and an image generated from a component image combined with the background image, and The image processing method according to claim 10, wherein a digital image is selected. 13. In the step of allocating the information, a rule for allocating bits is held as a correspondence table,
11. The image processing method according to claim 10, wherein the correspondence table is added to the generated multiplexed image. 14. An image processing method for expanding a multiplexed image generated by the method according to claim 13, wherein the step of extracting the correspondence table from the generated multiplexed image is performed based on the extracted correspondence table. Extracting a predetermined bit of the multiplexed image and then expanding the multiplexed image. 15. A method of irradiating a three-dimensional object with reference light, sequentially transmitting information recorded as interference fringes by light from the object,
On the receiving side, the received interference fringes are sequentially displayed, and the interference fringes are irradiated with reproduction light to display an object in a three-dimensional manner. Means for decomposing the interference fringe image into a phase component image and an amplitude component image; means for performing processing for removing a high-frequency component of a spatial frequency from the decomposed amplitude component image; Means for performing a gradation conversion process on the phase component image thus obtained, and means for performing a compression encoding process on each of the image-processed component images, wherein the receiving side comprises: Means for decoding image data into a phase component image and an amplitude component image; and means for combining the decoded phase component image and amplitude component image into a complex amplitude image. Decomposing the image transmission apparatus according to. 16. An image conversion unit for generating a projection image of an input image using a specific calculation parameter; a unit for determining the calculation parameter; a unit for accumulating the projection image and the calculation parameter;
An image processing apparatus comprising: one or both of means for transmitting the projection image and the calculation parameter. 17. The image processing apparatus, comprising: means for receiving the stored or transmitted projection image and calculation parameter; means for reproducing a projection image based on the received projection image and calculation parameter; 17. The image processing apparatus according to claim 16, further comprising: means for displaying an image. 18. An image processing apparatus for multiplexing a plurality of images to generate a multiplexed image, comprising: an image relating to interference fringes caused by reference light and light from an object; Image input means for inputting a multiplexed digital image; a frame memory serving as a working memory when generating a multiplexed image; an image holding means for holding a plurality of images input by the image input means; Image bit allocation determining means for defining a bit replacement method so as to retain each upper bit of each pixel of the image of the image, and for each pixel of the image based on the bit replacement method determined by the image bit allocation determination means. An image processing apparatus comprising: image bit operation means for operating a bit string to generate a multiplexed image on the frame memory. 19. The three-dimensional information of an object recorded as interference fringes by reference light and light from the object is sequentially transmitted, and the receiving side sequentially displays the received interference fringes and irradiates the object with reproduction light to illuminate the object. A computer-readable recording medium recording an image transmission program to be displayed three-dimensionally, wherein the transmission-side image transmission program converts an image of interference fringes represented by a complex number into an amplitude component image and a phase component image. And a process of decomposing, performing a process of removing a high-frequency component of a spatial frequency on the decomposed amplitude component image, performing a gradation conversion process on the phase component image, and compression-encoding each of the processed images. A computer-executing step of processing and a step of separately transmitting the image data of the two components that have been compression-encoded, wherein the image transmission program for the receiving side includes: Receiving the image data of the two components transmitted to the device, sequentially decoding the received image data into an amplitude component image and a phase component image, and complexing the decoded amplitude component image and phase component image again. A recording medium for recording an image transmission program for causing a computer to execute a procedure of combining and displaying the components. 20. The transmission step according to claim 19, wherein the transmission order or the transmission cycle of each of the image data of the phase component and the amplitude component is changed according to the type of the image of the interference fringes. A recording medium on which the described image transmission program is recorded. 21. A computer-readable recording medium storing an image processing program for converting image data and storing or transmitting the converted image, wherein the image processing program stores the image data at a certain spatial position. Irradiating the image with a specific reference light, calculating the projected image generated by the transmitted or reflected light of the image as an image having a complex amplitude value, and calculating the complex amplitude. Image processing for causing a computer to execute two types of images obtained by decomposing each pixel of an image of a projection image having a value into a real part and an imaginary part, and a procedure for storing or transmitting calculation parameters for generating the projection image A recording medium on which a program is recorded. 22. The method according to claim 21, wherein, in the step of calculating the projection image, a lens is installed on the entire surface of the spatial position where the image data is arranged, and the projection image at the focal length of the lens is calculated. A recording medium on which the image processing program described above is recorded. 23. In the storing or transmitting procedure, two types of images obtained by decomposing each pixel of the image of the projected image into a real part and an imaginary part and calculation parameters are separately stored or transmitted, respectively. A recording medium on which the image processing program according to claim 21 or 22 is recorded. 24. The storing or transmitting procedure includes two types of images obtained by decomposing each pixel of the image of the projected image into a real part and an imaginary part, a wavelength of reference light, and positional information where image data is set. The recording medium according to claim 21, wherein the calculation parameter is encrypted and stored or transmitted. 25. A computer-readable recording medium recording an image processing program for reproducing and displaying a projection image stored or transmitted by the image processing method according to claim 3. The image processing program irradiates the image of the real part with light of the same wavelength as the reference light, and irradiates the image of the imaginary part with light of the same wavelength as the reference light shifted by π / 2 phase. Calculating the wavefronts of the transmitted lights at the time, generating a combined value of the wavefronts of the two transmitted lights as an image, and reproducing the projected image; and displaying the reproduced projected image on a computer. A recording medium on which an image processing program to be recorded is recorded. 26. The method according to claim 25, wherein, in the step of reproducing the projection image, the projection image is sequentially reproduced while reading out the two kinds of stored or transmitted images and calculation parameters. A recording medium on which an image processing program is recorded. 27. The method according to claim 25, wherein in the step of displaying the projected image, the reproduced projected image is optically projected through a lens capable of scaling the image in accordance with the calculation parameter. A recording medium on which the image processing program according to claim 26 is recorded. 28. A computer-readable recording medium recording an image processing program for multiplexing a plurality of images to generate a multiplexed image, the image processing program comprising: an interference fringe caused by reference light and light from an object. A procedure for selecting one image from a plurality of digitized digital images to be subjected to multiplexing processing, and in the selected image, only high-order bits up to a predetermined order. An image processing program for causing a computer to execute a procedure of holding, and a procedure of assigning information of a high-order bit of an image other than the selected image to a position corresponding to a lower bit not held of each pixel of the selected image. The recording medium on which it was recorded. 29. In the step of selecting an image, the plurality of digital images are images generated from the same image having different resolutions.
A recording medium on which the image processing program according to claim 8 is recorded. 30. In the step of selecting an image, the plurality of digital images include an image generated from a background image and an image generated from a component image combined with the background image, and 29. A recording medium recording the image processing program according to claim 28, wherein a digital image related to the image processing is selected. 31. In the information allocating procedure, a rule for allocating bits is held as a correspondence table,
29. The recording medium according to claim 28, wherein said correspondence table is added to the generated multiplexed image. 32. A computer-readable recording medium recording an image processing program for developing a multiplexed image generated by the method according to claim 13, wherein the image processing program comprises: Recording the image processing program for causing a computer to execute a procedure of extracting the correspondence table and a procedure of extracting a predetermined bit of the multiplexed image based on the extracted correspondence table to develop a multiplexed image. Medium.