JP3512096B2 - Stereoscopic image synthesis processing device - Google Patents

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a binocular parallax (binocu).
The present invention relates to a stereoscopic image synthesis processing device that realizes a stereoscopic effect by utilizing lar parallax) and convergence.

[0002]

2. Description of the Related Art Various methods have been proposed as methods for realizing a three-dimensional effect by utilizing binocular parallax and vergence. Among them, for example, (1) three-dimensional image engineering, Asakura Shoten, Takataka Ogoshi, 199.
1, p7-21, history of three-dimensional image technology (2) JP-A-5-232890.

In the above (1), a parallax panoramagram or a paralux stereogram is shown as a method of reproducing a three-dimensional effect with the naked eye without using a device such as eyeglasses. The mainstream method for creating stereoscopic images is to use a photographic technique. Specifically, a dedicated camera is rotated or linearly moved with respect to the subject, and images viewed from different directions are displayed on the panorama dry plate. It is a common method to directly shoot the image on the top, or to burn each image taken by a camera from a plurality of directions on a panorama dry plate with a dedicated synthesizer.

Further, in the above (2), a method of creating a stereoscopic image using a single two-dimensional image or a two-dimensional image obtained by combining a plurality of two-dimensional images by cutting or superimposing as an original image is proposed. . Specifically, when desired regions of the original image to be set to the intermediate position, the front position, and the rear position are simultaneously designated, a pair of parallax images obtained by shifting only the respective regions in the left-right direction by a predetermined amount as they are. Forming a pair of parallax images when viewed from different directions,
After that, these parallax images are combined.

[0005]

However, the above-mentioned Paralux panoramagram and Paralux stereogram require a dedicated camera and a synthesizer, which makes it difficult for ordinary people to easily create them. is there.

In the above (2), since a large-capacity image storage means is required to intermediately form a pair of parallax images, it is difficult to inexpensively construct the apparatus. . Further, since the operator simultaneously designates a desired area of the original image and designates positions such as the middle, front, and rear (chaotically), there is a problem that the operation is troublesome.
In addition, since the desired area of the original image is simply shifted in the left-right direction by a predetermined amount, there is a problem that it looks unnatural after the shift.

Further, even when a desired area of the original image is moved backward, the area is simply shifted in the left-right direction by a predetermined amount, so that an image that should otherwise be hidden and invisible should be synthesized, which is unnatural. There is a problem that it looks like. Also,
Since the desired areas of the original image are only shifted in the left-right direction by a predetermined amount, there is a problem that the area cannot be moved in the vertical direction with respect to the image surface except in a specific case. Further, since the area is simply shifted in the horizontal direction without depending on the designated position in the vertical direction of the desired area of the original image, there is a problem that the apparent size of the image does not change and looks unnatural. is there.

In view of the above conventional problems, the present invention provides a stereoscopic image synthesizing apparatus capable of synthesizing a stereoscopic image using a single or a plurality of two-dimensional images as original images with an inexpensive structure. The purpose is to

It is another object of the present invention to provide a stereoscopic image synthesizing processing device capable of synthesizing a stereoscopic image using a single or a plurality of two-dimensional images as original images by a simple operation.

It is another object of the present invention to provide a stereoscopic image synthesizing device capable of synthesizing a natural stereoscopic image using a single or a plurality of two-dimensional images as original images.

The present invention also provides a stereoscopic image synthesizing apparatus capable of moving a desired region of an original image in a direction vertical to an image plane, using a single or a plurality of two-dimensional images as an original image. The purpose is to do.

[0012]

In order to achieve the above object, the present invention has an up-and-down specifying means for specifying up-and-down conditions of an image, an image storing means for storing an image signal of at least one image, and the up-and-down specifying. On the basis of the ups and downs conditions designated by the means, the line-sequential scanning type image signal is converted so that each image corresponding to a plurality of viewpoints is shifted in the left-right direction and circulated side by side at a predetermined interval. And image conversion means for storing the image in the storage medium.

In addition, the image conversion means is capable of processing sinking.
If selected, the area set by the sinking process will be
Do not write the projected image signal to the image storage means.
And wherein the Unisuruko.

Further, the image conversion means is arranged to move from the original area.
Left eye image that has been processed for sinking in the range of the left eye image that deviates
Is presented to the left eye and up and down are not processed for the right eye
When an image is presented, the above left-eye image or right-eye image
Characterized that you erase either one of the image.

Further, the image conversion means is characterized in that when the respective images corresponding to a plurality of viewpoints are shifted in the left-right direction, the image of the part which cannot be hidden is erased.

Further, the image conversion means is characterized in that when the respective images corresponding to a plurality of viewpoints are laterally shifted, they are shifted so as to be perpendicular to the line of sight.

Further, the image conversion means is characterized in that when the images corresponding to a plurality of viewpoints are shifted in the left-right direction, the images are scaled according to the position in the left-right direction.

[0018]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. 1 is an explanatory diagram showing a parallax stereogram using stereoscopic images synthesized by a stereoscopic image synthesis processing device according to the present invention, and FIG.
3 is an explanatory view showing the ups and downs of the stereoscopic image, FIG. 3 is a block diagram showing the mechanism of the copying machine to which the stereoscopic image synthesizing device is applied, and FIG. 4 is a block diagram showing the electrical system of the copying machine of FIG. FIG. 5 is a block diagram showing the stereoscopic circuit of FIG. 4 in detail,
FIG. 6 is a timing chart showing main signals of the stereoscopic circuit of FIG.

In FIG. 1, the parallax barrier 101
Are light-transmitting portions 102 alternately arranged at equal pitches P.
The stereoscopic image 104 is arranged at the position of the interval T from the parallax barrier 101. In this stereoscopic image 104, a left-eye image 105 and a right-eye image 106 have width w respectively corresponding to the light transmitting portion 102, the light shielding portion 103, the left eye 107 and the right eye 108.
1 and wr (wl = wr = W) are alternately arranged, and the left-eye image 105 and the right-eye image 106 are observed by the left eye 107 and the right eye 108 over the parallax barrier 101, respectively.

In this case, the left eye 107 can see the left-eye image 105 through the light transmitting section 102, but cannot see the right-eye image 106 hidden by the light shielding section 103. Similarly, the right eye 108 can see the right-eye image 106 through the light transmitting unit 102, but cannot see the left-eye image 105 hidden in the light shielding unit 103. That is, if the distance between the left eye 107 and the right eye 108 is L and the distance (observation distance) between the left eye 107 and the right eye 108 and the stereoscopic image 104 is D, the following relationship is established. P / W = (D−T) / D (1) P / D = T / D (2)

Next, the principle that the parallax stereogram provides an image with parallax and vergence to the left eye 107 and the right eye 108 to obtain a stereoscopic effect will be described with reference to FIG. The image 201 for the left eye and the image 202 for the right eye are simultaneously observed by the left eye 107 and the right eye 108, respectively. In this case, the observer merges the image of the left eye 107 and the image of the right eye 108. At the position of 203, it is possible to obtain a feeling that an entity is raised and exists. Here, if the amount of displacement between the left-eye image 201 and the right-eye image 202 is Mu, and the floating sense distance is Hu, the following relationship holds. Hu / Mu = (D-Hu) / L ∴Mu = Hu × L / (D-Hu) (3)

Further, the left-eye image 204 and the right-eye image 205 having the correspondence relationship as shown in the figure makes it possible to obtain the sensation that an entity is actually depressed and present at the position 206. In this case, the left-eye image 204 and the right-eye image 205
The following relationship is established, where Md is the amount of positional deviation and Hd is the sense distance of sinking. Hd / Md = (D + Hd) / L ∴Md = Hd × L / (D + Hd) (4)

Therefore, in the parallax stereogram, the left-eye image 204 and the right-eye image 2 which are in a corresponding relationship.
By recording 05 at different positions, it is possible to give a feeling of sinking to the actual image surface 104. Also,
This effect is the same based on a normal two-dimensional image,
By changing the recording positions of the left-eye image 204 and the right-eye image 205 and controlling the shifting direction and amount, it is possible to reproduce an arbitrary feeling of sinking.
(4) has substantially the same meaning in consideration of the shift direction and the up / down direction of the left-eye image 204 and the right-eye image 205.

The mechanical section of the copying machine shown in FIG. 3 is roughly composed of a scanner unit 301 for reading a document and a printer unit 302 for recording an image on a recording sheet. The scanner unit 301 will be described in detail. The original 303 is placed at a predetermined reading position on the platen 304, and the halogen lamps 305-1 and 305-2 are provided.
Illuminated by. The reflected light of the original 303 is sequentially reflected by the first mirror 306, the second mirror 307, and the third mirror 308, and is imaged by the lens 309 on the light receiving surface of the CCD 310 which is a color line image sensor.
Photoelectric conversion is performed by 310.

The halogen lamps 305-1 and 305-2 and the first mirror 306 are mounted on a first carriage (not shown), and the second mirror 307 and the third mirror 308 are mounted on a second carriage (not shown). . The first and second carriages are driven by a carriage drive motor 410 (see FIG. 4) at a speed ratio of 2: 1 in the sub-scanning direction (from left to right in the figure).
Then, the original 303 on the platen 304 is scanned in the main and sub scanning directions.

The image signal photoelectrically converted by the CCD 310 is subjected to various kinds of processing by the image processing section 311 shown in detail in FIG. 4 and then applied to the laser diode (LD) 420 (FIG. 4) of the printer unit 302. LD42
It is converted into laser light by 0. Here, the LD 420 is strongly lit when the original density is light, and is weakly lit when the original density is high. Next, the printer unit 3
02 will be described in detail. The laser light emitted from the LD is reflected by the polygon mirror 312 and the polygon motor 31.
6 is deflected at a constant angular velocity by the lens 6, is corrected to be deflected at a constant velocity by the fθ lens 313, is reflected by the fourth mirror 314, and is irradiated onto the photosensitive drum 315.

The surface of the photosensitive drum 315 is uniformly charged in advance with a negative potential by a charging charger 317, and when laser light is irradiated in this state, the surface charge flows to the ground due to a photoconductive phenomenon and disappears. Due to the intensity of light, an electrostatic latent image is formed according to the lightness and darkness of the document. Developing unit 31
8 is black (K), cyan (C), magenta (M),
Each of the yellow (Y) toners has a negatively charged developing unit, one of which is selected to develop the electrostatic latent image on the photoconductor drum 315 with the toner of that color.

The transfer belt 319 is charged in advance to a positive potential, and when it approaches the photosensitive drum 315, the toner image on the photosensitive drum 315 is transferred to the transfer belt 319 by a bias. In this case, in the single color mode, the two color mode, and the full color mode, the photoconductor drum 3 is used.
The toner images of respective colors are formed by rotating 15 once, twice, and four times, and are transferred so as to be superimposed on the transfer belt 319. In addition, the photosensitive drum 3 after the transfer is completed
The residual toner on 15 is removed by the cleaning unit 326.

Recording papers 321-1 and 321-2 previously stored in the paper feed cassettes 320-1 and 320-2, respectively.
Are selectively fed from the paper feed rollers 322-1 and 322-2, respectively. Then, the registration roller pair 323-
1, 323-2 are initially stopped, and the recording paper 321-
When 1 and 321-2 arrive, rotation is started and sent out so as to match the toner image on the transfer belt 319. The toner images on the transfer belt 319 are re-transferred to the recording papers 321-1 and 321-2 by the transfer charger 324 having a positive voltage and by releasing the bias of the transfer belt 319. Next, the recording papers 321-1 and 321-2 are ejected after the toner images are fixed by the fixing roller pairs 325-1 and 325-2. In addition, the residual toner on the transfer belt 319 after the retransfer is completed is cleaned by the cleaning unit 3.
Removed by 27.

The electrical component section shown in FIG. 4 schematically includes a scanner unit 301, an image processing unit 311, a printer unit 302, an operation display unit 401 for detecting and displaying an input such as selection of a processing mode, and the like. Control circuit 40 of each unit 301, 311, 302, 401 of
9, 418, 421, 428, and a system control unit 403 for controlling the entire copying machine 402.
It is composed by. The copying machine 402 is a LAN
It is connected to a LAN 405 via a (local area network) connection device 404, and inputs and outputs image signals to and from a workstation (WS) 406, a personal computer (PC) 407, etc. via the LAN 405.

Explaining the scanner unit 301 in detail, the CCD 310 color-separates the incident light into RGB and then photoelectrically converts the incident light into RGB analog image signals. An A / D conversion / shading correction circuit 408 performs A / D conversion of the RGB analog image signals, and then performs shading correction for uneven illumination of the halogen lamp 305, uneven sensitivity of each light receiving element of the CCD 310, and dark current. The scanner control circuit 409 communicates with the system control unit 403 as well as the scanner unit 3
01, the operation of the A / D conversion / shading correction circuit 408, the lighting control of the halogen lamp 305, and the rotation control of the carriage drive motor 410 are performed. The document size sensor 411 detects the size of the document 303 on the platen 304 and outputs the detection result to the scanner control circuit 409.

A / D conversion / shading correction circuit 40
The eight RGB output signals are applied to the γ conversion circuit 412 in the image processing unit 311. The γ conversion circuit 412 is also connected to the LAN connection device 404, and the A / D conversion circuit 4
08 or image data input from the LAN connection device 404 is converted (scanner γ conversion) in the gradation of the image data, and the image area separation circuit 41
3 and the color correction circuit 414. The γ conversion circuit 412 can also convert the gradation of the image data input from the A / D conversion circuit 408 and output it to the LAN connection device 404.

The image area separation circuit 413 determines whether the image portion of the input image signal is a line drawing such as characters, whether it is a monochrome image or a color image, and outputs the determination signal to the color correction circuit 414. The area control circuit 415 outputs a switching signal for performing different image processing for each partial area of the image to the color correction circuit 41.
Output to 4. The color correction circuit 414 performs color correction for converting the image data from the γ conversion circuit 412 into a toner recording amount according to the developing device, and also performs two-dimensional filter processing such as edge enhancement and smoothing processing.

In this case, edge enhancement is performed based on the determination signal of a line drawing such as characters, and smoothing processing is performed based on the determination signal of no. Further, the processing may be performed by the switching signal from the area control circuit 415 without depending on the determination signal. Also in the case of color correction, a toner recording amount suitable for the full color mode or the black mode is converted by a switching signal from the area control circuit 415, or the UCR rate is 100 in the case of a line drawing and a monochrome image in the full color mode.
%, The UCR rate is 70% for non-line drawings and color images.
Sometimes converted to.

The image signal converted into the toner amount from the color correction circuit 414, the determination signal from the image area separation circuit 413, and the switching signal from the area control circuit 415 are sent to the variable magnification circuit 41.
6 is output. A scaling circuit 414 performs scaling processing for enlarging and reducing the image signal in the main scanning direction, and printer gamma correction for correcting recording characteristics (image signal vs. toner recording amount characteristic) that fluctuate depending on the temperature and humidity of the printer unit 302. Processing or gradation processing is performed in which one or several pixels in the main scanning direction and one or several pixels in the sub-scanning direction are defined as one unit and gradation expression is performed with emphasis on resolution or gradation.

The gamma correction processing and the gradation processing are performed based on the determination signal and the switching signal. For example, in the case of a line drawing, the gradation processing in which the resolution is emphasized is emphasized, and in the case of the non-line drawing, the gradation is emphasized. Perform gradation processing. Further, since the recording characteristics change depending on the type of gradation processing, different γ correction processing is performed in conjunction with the gradation processing, and further predetermined gradation processing and γ correction processing are performed by the switching signal without depending on the determination signal. . The scaling in the sub-scanning direction is performed by changing the rotation of the carriage drive motor 410. In addition, the scaling circuit 416 is LA
Connected to the N connection device 404, and outputs the processed image signal or the image signal from the LAN connection device 404 together with the switching signal to the stereoscopic circuit 417 shown in detail in FIG. 5, or connects the processed image signal to the LAN connection. Output to the device 404.

Next, the three-dimensionalization circuit 417 will be described in detail with reference to FIGS. In FIG. 5, the image signal 501 input from the scaling circuit 416 and the switching signal 5
02 are combined into one, and the 3-state buffer 503,
It is applied via 504 to the data input terminals of SRAMs (Static Random Access Memories) 505 and 506, respectively. Here, the frame synchronization signal 523, the line synchronization signal 507, and the pixel synchronization signal 5 shown in FIG.
Reference numeral 08 is a signal indicating a division of one page, one line, and one pixel, respectively.

The SRAMs 505 and 506 have a capacity for storing the image signal 501 for one line and the switching signal 502, and the both signals 501 and 502 are alternately SRA for each line.
It is written in M505 and 506. In this case, SRAM
3-state buffer 503 when written to 505
Is active, and the 3-state buffer 504 is in a high impedance state. Similarly, the SRAM 506
When written to, the 3-state buffer 503 becomes a high impedance state and the 3-state buffer 504 becomes active.

SRAMs 505, 50 to which writing is performed
The address terminal 6 has a counter 50 that counts the pixel synchronization signal 508 after being cleared by the line synchronization signal 507.
The output signal 9 (see FIG. 6) is applied via the selectors 510 and 511, whereby the image signal 501 and the switching signal 502 are written in the SRAMs 505 and 506 in the order of input.

On the other hand, offset registers 512 and 513
The offset address AL for the left eye and the offset address AR for the right eye are set in advance respectively, and the output signal thereof is applied to the data terminal of the selector 514. The output signal of the frequency divider 515 (see FIG. 6) that is cleared by the line synchronization signal 507 and divides the pixel synchronization signal 508 by 2 × N (N ≧ 1) is applied to the control terminal of the selector 514. The selector 514 has an offset address A for the left eye.
L and the offset address AR for the right eye are used as the line synchronization signal 5
It is output alternately every N pixels with reference to 07.

The offset addresses AL and AR output from the selector 514 are applied to one input terminal of the adder 516. The output signal of the counter 509 is applied to the other input terminal of the adder 516, the both input signals are added, and the addition result is the valid address of the SRAMs 505 and 506 (the address where the valid switching signal 502 is written). It is determined whether or not only the effective address is selected by the selector 51.
Output to 0 and 511. In this case, the adder 516 outputs the nearest valid address instead when the addition result is not a valid address. Note that FIG. 6 shows the case where all the addition results are valid addresses, and the case where N = 2.

The output signal of the adder 516 is applied to the address terminal of one of the SRAMs 505 and 506 which is not written, via the selectors 510 and 511, and the image signal 501 stored in the SRAM is switched. The signal 502 is read. SRAM 505 or 506
In principle, the signals 501 and 502 read from are alternating signals starting from the left-eye offset address AL or the right-eye offset address AR every N pixels.

Therefore, by setting the offset addresses AL and AR corresponding to the shift amounts of the left-eye image and the right-eye image, respectively, in the offset registers 512 and 513, the left-eye image and the right-eye image have N pixels. It is possible to obtain stereoscopic images that are alternately arranged for each. In addition, when the conversion to the stereoscopic image is not performed, that is, when the normal image having the up / down amount of “0” is obtained, the offset registers 512 and 5 are used.
The same offset address is set in 13.

The selector 517 is an SR for reading.
The signals 501 and 502 from the AM 505 or 506 are selected and output to the eraser 518. Where signal 50
Since the writing of 1, 502 to the SRAM 505 or 506 is alternately performed for each line, the signals 501, 502 are used.
Of the SRAM 505 or 506 is also alternately performed for each line, and the read signal is the selector 517.
Selected by.

The eraser 518 replaces the input image signal 501 with a fixed signal value (for example, a value for not adhering toner or a value for adhering the most toner) according to the input switching signal 502 and setting, and the input image signal 501
Alternatively, the replaced signal value is output to the data terminal or the like of the image memory 520 via the 3-state buffer 519, and
The switching signal 502 is output to the control gate 521. The image memory 520 has a capacity for storing signals corresponding to B, C, M, and Y toners for each page, and is used at the time of image composition.

The counter 524 is a counter that is cleared by the frame sync signal 523 indicating the separation of images for one page and counts the line sync signal 507, and a counter that is cleared by the line sync signal 507 and counts the pixel sync signal 508. And the like, and the two-dimensional coordinates of the image signal obtained from these count values are converted into the address signal of the image memory 520 and applied to the address terminal. The counter 524 also outputs the original signal of the write control clock for the image memory 520 to the control gate 521. The delay device 525 delays the switching signal 502 by one line + the number of set pixels and outputs it to the control gate 521.

The control gate 521 masks the original signal of the write control clock from the counter 524 and outputs it to the image memory 520 according to the two switching signals 502 from the eraser 518 and the delay device 525 and the setting. That is, when performing image composition or the like, the 3-state buffer 5
The writing of the image signal 501 from 19 into the image memory 520 is selectively performed according to the two switching signals 502 from the eraser 518 and the delay device 525 and the setting.
When the image signal 501 stored in the image memory 520 is printed by the printer unit 302,
The 3-state buffer 519 enters a high impedance state, the image signal 501 is read from the image memory 520, and becomes the output image signal 522 of the stereoscopic circuit 417.

When writing to or reading from the image memory 520, the page of the image memory 520 corresponding to the toner is appropriately selected. When printing is performed without using the image memory 520, the 3-state buffer 519
The output signal of is directly used as the output image signal 522 of the stereoscopic circuit 417.

Returning to FIG. 4, the image processing control circuit 418 communicates with the system control unit 403 and
According to a request from the system control unit 403, the γ conversion circuit 412, the image area separation circuit 413, the color correction circuit 414, the area control circuit 415, the scaling circuit 416, and the three-dimensionalization circuit 41.
The image processing unit 311 is controlled as a whole by performing various settings for the image processing unit 311. The image signal 522 output from the three-dimensionalization circuit 417 is applied to the LD drive circuit 419 of the printer unit 302, and the LD drive circuit 419 performs pulse width modulation, power modulation, or the like according to the image signal 522, and the lighting intensity of the LD 420. Drive by adjusting.

The printer control circuit 421 communicates with the system control unit 403 and controls the entire printer unit 302. For example, LD drive circuit 4
19, a polygon motor 316, a photosensitive drum 31
5, the rotation control of the motor 422 that rotationally drives the motor 5, the motor 423 that rotationally drives the transfer belt 319, the selection control of the developing units B, C, M, and Y of the developing unit 318, the loads of the high-voltage power source 424 (for example, charging). Output control for each of the charger 317, each developing device, the transfer belt 319, the transfer charger 324, and the like, temperature control of the thermal fixing unit 325, and the like are performed. Although not shown, the printer unit 302 has a paper size sensor for detecting the size of the recording paper 321-1, 321-2 for each of the paper feed cassettes 320-1, 320-2. It is applied to the printer control circuit 421.

The operation display unit 401 is a digitizer 425 for inputting a predetermined range, position, etc. on a document, a display section for displaying options and setting states of various modes, and detection for detecting a pressed position of this display section. T is a unit
A PD (touch panel display) 426 and a keyboard 42 for inputting the number of copies and the start of copying.
7 and the operation display control circuit 428 and the like.
The operation display control circuit 428 displays options for each mode on the TPD 426 to prompt the operator for key input or the like, or detects inputs from the digitizer 425, TPD 426, and keyboard 427 to display the setting state on the TPD 426. At the same time, it communicates with the system control unit 403 to transmit the input result.

Next, a display screen example of the TPD 426 will be described. First, when the power of the copying machine is turned on, the operation display control circuit 428 is in the initial state, and the standard screen as shown in FIG. 7 is displayed. The "Photo", "Text" and "Standard" display areas on the right side of this standard screen are soft key areas for image quality mode selection. When the operator presses this soft key, the photo mode suitable for the photo image, A character mode suitable for a character image and a standard mode suitable for a photograph / character mixed image are selected.

In this case, for example, when the "character" soft key is pressed, the operation display control circuit 428 recognizes the selection of the character mode by displaying a frame on the "character" soft key as shown in FIG. Tell the operator that
The system control unit 403 is requested to set the character mode. In response to this request, the system control unit 403 requests the image processing control circuit 418 to make settings for the character mode, and the image processing control circuit 418 receives this request and the area control circuit 415, the color correction circuit 414, and the magnification changer. The circuit 416 is set for the character mode, and these circuits 414 to 416 do not depend on the determination signal of the image area separation circuit 413 but perform edge emphasis filter processing, resolution-sensitive gradation processing, and γ correction suitable for this. Set to do.

The "color selection" display area is a soft key area for calling the color mode selection screen. When the operator presses this soft key, the operation display control circuit 428 is displayed.
Displays a color mode selection screen as shown in FIG.
This allows the operator to select various color modes including the full color mode. For example, when the "black" display area is pressed in this display state, the operation display control circuit 4
28 displays the black mode selection screen as shown in FIG. 10 to inform the operator that the selection of the black mode has been recognized.

Further, the operation display control circuit 428 requests the system control unit 403 to set the black mode, and the system control unit 403 receives the request and sets the black mode setting to the image processing control circuit 418. To request. In response to this request, the image processing control circuit 418 sets the area control circuit 415 and the color correction circuit 414 for the black mode, and the color correction circuit 414 performs color correction processing for converting the toner recording amount suitable for the black mode, for example. .

The system control unit 403 also requests the printer control circuit 421 and the like to control the operation for the black mode, and the printer control circuit 421 receives this request and selects the K developing section at the time of actual printing. Alternatively, control such as reading an original, forming an electrostatic latent image, forming a toner image, and transferring a toner image once to retransfer the toner image on the transfer belt 319 to a recording sheet is performed.

Next, the flow of control when the three-dimensional mode for outputting a stereoscopic image is selected will be described. Figure 1
When the "create" display area is pressed in the display state of the display screen shown in 0, the "create" screen as shown in FIG. 11 is displayed, which allows the operator to select various create modes including the three-dimensional mode. Become. When the "3D" display area is pressed down in this display state, a "3D" screen as shown in FIG. 12 is displayed, whereby the operator
It is possible to set the "image interval" and "up / down amount" in the dimension mode. In this display state, for example, when the "+" soft key for "image interval" is pressed once, the "image interval" becomes 1
Increment by the dot amount, and also "up and down amount"
Each time the "-" soft key of is pressed, the value is decremented by 1 mm. When the "up / down amount" is set to "+9 mm", the erasing width of the document is changed to "1.9 mm".

Here, the "document erasing width" will be described. In the copying machine described above, the size of the original 303 placed on the platen 304 is detected by the original size sensor 411. For example, if "A4 vertical" is detected,
When each of the "A4 length", "A3", and "automatic" paper feed mode selection areas on the right side of the screen shown in FIG. 12 is selected, a mode for selecting a paper feed cassette containing A4 length recording sheets , A mode for selecting a paper feed cassette accommodating A3 recording paper, and an automatic paper selection mode for automatically selecting a paper feed cassette according to the size and magnification of a document. In the display example shown in FIG. 12, the automatic paper selection mode is selected, and the scaling factor is 1 from the screen shown in FIG.
Since it is 00%, the A4 length paper feed cassette is selected.

On the other hand, when a stereoscopic image is created from a two-dimensional image, the recording positions of the image for the left eye and the image for the right eye may be shifted based on the equations (3) and (4), but the original and the image are recorded. In some cases, a part of the original document may stick out of the recording paper and cannot be recorded due to the relationship between the size of each paper, the scaling ratio, and the shift amount. The width of the non-recordable area is referred to as "original erasing width" in the present specification. The widths of the original and recording paper in the shift direction are Wo and Wp, the shift amount is M, the scaling ratio in the shift direction is R, and the original When the erase width is E, the following relationship holds. E = Wo + M / R−Wp / R However, when E ≦ 0, E = 0 (5)

In the above setting example, the size of the original and the recording paper are both A4 vertical and the scaling factor is 100%, so that the width E of the unrecordable area matches the shift amount M. Here, it is said that the average distance L between both eyes of a Japanese person is about 62.5 mm, and in this embodiment, assuming that the observation distance D is 300 mm, the erase width E of the document is E = when the amount of ups and downs is +10 mm. 10 × 62.5 / (300−10) ≈2.2 mm When the up / down amount is +9 mm, E = 9 × 62.5 / (300−10) ≈1.9 mm is displayed.

The calculation of the erase width E of the original is performed by the operation display control circuit 428 in this embodiment. As described above, in the present embodiment, when a part of the document cannot be recorded by protruding from the recording sheet due to the input condition (for example, the size and the amount of ups and downs of the document and the recording sheet), the operation display control circuit 428 indicates that fact. Since it is displayed, the operator can change the setting conditions with reference to this. For example, in the above setting example, the automatic paper feed mode is canceled and the A3 paper feed cassette is selected, the automatic scaling mode is canceled and the scaling ratio is manually adjusted, or the A4 paper feed cassette is selected and changed. It is possible to set the magnification in the automatic scaling mode, thereby preventing a failure such as a necessary document image not being recorded.

Further, when the "image interval" is set large, the interval P of the parallax barrier 101 needs to be correspondingly large. However, when such a parallax stereogram is actually observed, the parallax barrier 101 of the parallax barrier 101 is observed. Vertical stripes are easily noticeable and may give an observer discomfort. Therefore, in this embodiment, the range (1 to 4 dots) of the "image interval" that can be set is shown as shown in FIG. 12, and the operation display control circuit 428 does not accept the setting exceeding this range. The discomfort described above can be prevented in advance. Furthermore, if a large number of types of "image intervals" can be set, the number of necessary parallax barriers 101 also increases and storage becomes complicated. Therefore, by limiting the settable image intervals, such a problem may occur. Can be prevented.

Further, when observing a parallax stereogram, the focus adjustment function of the eye is adjusted to the parallax stereogram, but if the setting of the ups and downs is extreme, what is the sense obtained from the focus adjustment function of the eye? The difference is so large that it gives the observer a feeling of strangeness. Therefore, in this embodiment, the up / down amount setting range (-199 to 99 m) shown in FIG.
Since the operation display control circuit 428 does not accept the setting exceeding m), it is possible to prevent the discomfort.

The setting of the three-dimensional mode is completed by pressing the "end" key on the screen shown in FIG. When the operation display control circuit 428 detects the pressing of the "end" key, the operation display control circuit 428 displays the screen shown in FIG. A dimension mode setting request and the set image interval and up / down amount (for example, image interval = 3 dots, up / down amount = 9 mm) are transmitted. In response to this, the system control unit 403 transmits to the image processing control circuit 418 a request for setting the three-dimensional mode, the set image interval and the amount of ups and downs, and the image processing control circuit 4
18 receives this, and the area control circuit 415 and the scaling circuit 4
16 and the three-dimensionalization circuit 417 are set.

FIG. 14 shows the relationship between the original image 303 and the recording paper 321 and the input image signal 501 and the switching signal 502 in one line when the stereoscopic circuit 417 of FIG. 5 converts the input image signal 501 into the stereoscopic image signal 522. The setting operation of the image processing control circuit 418 will be described below.

In FIG. 14, the original 303 is placed so that its front end is aligned with the original reference position 801 provided on the platen 304, and the image signal 501 obtained by reading the illustrated reading line is converted into a three-dimensional circuit 417. Entered in. In this case, the image signal 501 is composed of a valid image signal 802 corresponding to the original area and invalid image signals 803-1 and 803-2 corresponding to the outer areas of the original at both ends thereof, and the line synchronization signal 507 is the invalid image signal. Signal 803
Occurs in the section.

When the image processing control circuit 418 receives the request for setting the three-dimensional mode, the set image interval and the amount of ups and downs, like the operation display control circuit 428, the erasure width E of the document is set.
Is calculated and the area control circuit 415 is set. here,
The image processing control circuit 418 recognizes the pixel position of the effective image signal 802 based on the line synchronization signal 507 based on the detection result of the document size sensor 411, the set scaling factor, etc., and the area control circuit 415. The area control circuit 415 is set so that the switching signal 502 from the input signal is input to the three-dimensionalization circuit 417 in synchronization with the effective image signal 802.

Specifically, the falling timing of the switching signal 502 (active when low) indicating the area to be subjected to the three-dimensional processing coincides with the beginning of the effective image signal 802, and the rising timing of it is from the end of the effective image signal 802. Original erasure width E × magnification (in this example, about 1.9 m
The area control circuit 415 is set so as to be advanced by the number of pixels E ′ corresponding to m).

Further, the image processing control circuit 418 controls the left-eye offset address AL and the right-eye offset address AR.
To calculate the offset registers 512 and 513, respectively.
Set to. Offset address A calculated here
L and AR are added with a difference corresponding to the number of pixels M ′ corresponding to the shift amount M (about 1.9 mm in this example) calculated based on the equation (3) or (4). In addition, the effective image signal 802
The minimum values of the offset addresses AL and AR (AR in this case) are determined so that the recording position at the beginning of the recording sheet coincides with the edge of the recording paper 321. AL-AR = M '(6)

Note that such movement processing in the main scanning direction is also performed when performing image synthesis or the like, but in this case as well, values corresponding to the movement distances are used as offset registers 512 and 513.
The image memory 52 of the image signal 501
The write position on 0 is controlled. Further, when performing image synthesis or the like, movement processing in the sub-scanning direction is also performed, and in this case, the timing of starting rotation of the carriage drive motor 410 and the timing of generation of the frame synchronization signal 523 are controlled.

The image processing control circuit 418 further sets the frequency division number ("6" in this case) of the frequency divider 515 in accordance with the received image interval, and also sets the variable magnification circuit 416. That is, the unit of the gradation processing performed by the scaling circuit 416 in the main scanning direction is set to a divisor of one half of the frequency division number (in this case, “1” or “3”). This setting is the scaling circuit 4
This is performed in order to prevent interference between the period in the main scanning direction of the gradation processing performed by 16 and the left-eye image and the right-eye image of the stereoscopic processing performed by the stereoscopic circuit 417. The image processing control circuit 418 also sets the γ correction processing in conjunction with the gradation processing performed by the scaling circuit 416.

The image processing control circuit 418 also sets the eraser 518 so that the input image signal 805 is replaced with a value that does not cause the toner to adhere most if the switching signal 806 does not indicate a region indicating the three-dimensional processing. To control. Here, in general, an observer feels a sense of discomfort when gazing at an object that cannot be observed with both eyes and is prone to fatigue, but in the present embodiment, an image region predicted to be observed with only one eye, that is, the switching signal 806 is stereoscopic. Since the area shown as not subjected to the chemical conversion treatment is erased by the above replacement, it is possible to prevent discomfort and fatigue.

When the copy start key (not shown) of the keyboard 427 is pressed on the setting end screen of the three-dimensional mode shown in FIG. 13, the operation display control circuit 428 detects this and copies it to the system control unit 403. Request operation start. Upon receiving this request, the system control unit 403 requests the control circuits 409, 418, 421 of the other units 301, 311, 302 to start the copy operation, and the control circuits 409, 418, 421 in the units concerned. Control each circuit for the copy operation.

The recording paper on which the stereoscopic image is recorded in this manner is used as a parallax stereogram together with the parallax barrier 101. The cancellation of the three-dimensional mode is performed by pressing the "cancel" key on the three-dimensional mode setting screen shown in FIG.

Next, the flow of control when different three-dimensional processing is performed for each designated area of the original will be described. In the initial screen shown in FIG. 7, the display areas of "entire surface", "area", and "composite" on the right side of the screen are soft keys for selecting the editing mode, and when these keys are pressed, they are the same on the entire surface of the document. "Full mode" for performing the processing of "1", "Area mode" for performing different processing for each designated area of the original, "Compositing mode" for performing different processing for each designated area of a plurality of originals and combining them on one recording sheet Is selected. The "full-face mode" is automatically selected at the time of initial setting after the power of the copying machine is turned on.

When the "area" key is pressed, the operation display control circuit 429 detects this and specifies the area having the message "Please set the original on the digitizer and specify the area" as shown in FIG. While displaying the screen,
By displaying a frame in the display area of the "area", the operator is informed that the "area mode" has been recognized. This allows the operator to specify the desired first area (area 1) using the digitizer 425. When the operator operates the digitizer 425 and finishes the designation of the area 1, FIG.
A screen similar to that shown in is displayed, which enables the same setting as that of the above-mentioned "whole surface mode" for the first designated area.

Here, when the "Create" key is pressed on the screen shown in FIG. 16, the screen is switched to the create mode setting screen as shown in FIG. 17, and various kinds of "Mirror", "Italic" and "3D" create are created. The mode can be set. Further, when the "3D" key is pressed on the screen shown in FIG. 17, the 3D mode setting screen for the designated area 1 is displayed as shown in FIG. This allows the operator to set the image interval and the amount of ups and downs in the three-dimensional mode for the designated area 1.

Here, if the image interval in the three-dimensional mode can be set for each area, the parallax barrier 101 having a different interval P for each area is required. Therefore, in this embodiment, the image interval in the three-dimensional mode is set. It is common to all areas. The setting of the three-dimensional mode is completed by pressing the "end" key on the screen shown in FIG. 18. When the operation display control circuit 429 detects this, the screen as shown in FIG. "And" three-dimensional mode "
Notify the operator that the setting of is completed.

In the screen shown in FIG. 19, the "magnification" display area is a key for calling the magnification mode selection screen, and when the "magnification" key is pressed, the magnification mode selection as shown in FIG. Display the screen. The display areas of “standard-size scaling”, “zoom”, and “perspective scaling” on the left side of the screen shown in FIG. 20 are keys for selecting a scaling mode. The "standard variable magnification mode" in which the magnification can be directly selected, the "zoom mode" in which an arbitrary magnification ratio can be set, and the "perspective variable magnification mode" which can be selected only when the three-dimensional mode is set are selected.

On the screen shown in FIG. 20, the "standard-size variable magnification mode" is selected, and the fixed variable magnification that can be selected is also displayed. When the display area of "71%" is pressed in this state, the screen is switched to the one shown in FIG.
Notify the operator that the scaling setting of "%" has been recognized. Further, when the "perspective zoom ratio" display area is pressed on the screen shown in FIG. 20, the screen is switched to the screen shown in FIG. 22 to notify the operator that the "perspective zoom ratio mode" setting has been recognized.

Next, the "perspective variable magnification mode" will be described with reference to FIG. When the up-and-down process is applied to an image as in the three-dimensional mode, usually, desired regions of the original image are simply shifted in the left and right directions by a predetermined amount, and the size of the region on the recording paper is changed. Do not change. In this case, as shown in FIG. 2, the size of the entity perceived including perspective is relatively smaller than that on the recording surface 104 in the floating process as shown in FIG. In the sinking process, it becomes relatively large as shown by 206 in the figure.

However, there are cases where the operator does not desire such a change in the size of the substance. That is, FIG.
As shown in FIG. 3A, the real image 901 and the floating image 902,
It may be desired to maintain the perceived size of the entity even when the ups and downs are processed like the real image 903 and the sunken image 904. The “perspective variable magnification mode” is a mode selected in such a case, and is a mode for automatically determining a variable magnification for maintaining the size of the substance perceived according to the setting of ups and downs.

Specifically, when the "perspective zoom mode" is selected, the operation display control circuit 429 sets the assumed observation distance to D, and the set value of ups and downs to H (however, in the case of up, plus, In the case of sinking, minus) is used to determine the scaling factor for that area as follows. (Magnification ratio) = D / (D−H) × (Magnification ratio outside the area) (7)

As a result, as shown in FIG. 23A, the left-eye image 905 and the right-eye image 90 with respect to the real image 901.
6. It becomes possible to record the left-eye image 907 and the right-eye image 908 with respect to the real image 903, so that the size of the perceived entity including perspective is the same as in the floating image 902 and the sinking image 904. Can be maintained. It should be noted that the (magnification outside the area) in Expression (7) is added to record the area in which the three-dimensional mode is designated with a relative size with respect to the entire original image.

The display area of "move" in the screen shown in FIG. 22 is a key for calling the move mode selection screen,
When the "move" key is pressed, a movement mode selection screen as shown in FIG. 24 is displayed. In the movement mode selection screen shown in FIG. 24, “upper left”, “middle upper”, “upper right”, “left middle”, “centering”, “middle right”, “lower left”, “middle lower”, “lower right” The nine display areas are movement keys for designating a reference position when moving a desired area of the original image on the recording paper, and when each key is pressed, the movement mode of the area is selected.

FIGS. 25A to 25I show the case where the nine keys shown in FIG. 24 are pressed when the three-dimensional mode (sinking process) and the reduction / magnification are designated, respectively, and the designated area Left-eye images 1002-a to 1002-i and right-eye images 1003 with respect to original positions 1001-a to 1001-i of
-A to 1003-i are "upper left", "middle upper", "upper right",
"Middle left", "Centering", "Middle right", "Lower left",
It is recorded at the positions of "middle lower" and "lower right".

Here, in FIG. 26, in the normal up-and-down process, for example, a desired area 1101 of the original image is equally shifted in the left-right direction from the original area like the left-eye image 1102 and the right-eye image 1103 and recorded. To do. In this case, the perceived position of the entity 1104 moves along the direction of the midpoint 1105 of the left eye 107 and the right eye 108. However, there are cases where the operator does not want to move such an entity in the horizontal direction, and positions 1106 and 1107 in FIG.
In some cases, it is desired that the substance is perpendicular to the recording surface 104.

The "vertical" display area in FIG. 24 is a key selected in such a case, and is displayed only when the three-dimensional mode is selected. When the "vertical" key is pressed and the "vertical movement mode" is selected, the operation display control circuit 429 switches to the screen shown in FIG. 27 and notifies the operator that the "vertical movement mode" has been selected. ,
The assumed observation distance is D, and the set value of ups and downs is H (however, plus when floating, minus when sinking)
As described below, the left-eye image 1108 and the right-eye image 1
The movement amount Nc of the distribution center 1110 of 109 is calculated. Nc = H / (D−H) × No (8)

Here, the center point 1 of both eyes 107 and 108
An intersection 1111 with a perpendicular line that passes through 105 and intersects the image plane 104 at a right angle is set, a distance between a center point 1112 and an intersection point 1111 of a desired region 1106 of the original image is set to No, and a distance between a distribution center 1110 and the center point 1112 is Nc. As a result, the left-eye image and the right-eye image for the desired region 1106 of the original image are located at positions 1108 and 1109, respectively.
Recorded in the vertical position 1107.
Can be moved to.

The display area of "area addition" on the screen shown in FIG. 27 is a key for additionally specifying the second and third areas 2 and 3 which are different from the designated area 1, and the "area When the "Add" key is pressed, the area designation screen as shown in FIG. 28 is displayed, and "Area 2" with a frame is additionally displayed to confirm that the selection of "Area addition" has been recognized. Tell. As a result, the "area 2" can be specified and various settings of the area can be made as in the case of the first specified area "area 1".

The display area "outside the area" on the screen shown in FIG. 27 is a key used when processing and setting the remaining areas excluding the areas designated by "area 1" and "area 2". When the "outside area" key is pressed, a screen as shown in FIG. 29 is displayed, and a frame is displayed in "outside area" to inform the operator that the selection of "outside area" has been recognized. This also enables various settings regarding "outside the area". As described above, the operator designates “areas 1, 2”, sets processing for “designated areas 1, 2”, and “outside area”
When the setting of the process of is finished and the copy start key is pressed,
A screen as shown in FIG. 30 is displayed and the operator is requested to set the original 303 on the platen 304.

Next, as an example, as shown in FIG. 31 (a), "areas 1 to 3" and "outside area" are designated on the document, the operation is performed with the following settings. explain. -Original size: A4 vertical-Paper feed mode: Automatic paper selection- "Area 1" processing setting Create: 3D mode (image spacing 2 dots, up / down -100 mm) Move: Centering color selection: Black scaling: Perspective scaling "Area 2" processing setting Create: 3D mode (image interval 2 dots, up / down + 50mm) Move: Vertical color selection: Full color scaling: 100%-"Area 3" processing setting Create: No setting Move: Right middle color selection: Red scaling: 121% ・ "Outside area" processing setting Create: No setting Move: Centering color selection: Full color scaling: 100%

When the "confirm" key is pressed on the document setting instruction screen shown in FIG. 30, the operation display control circuit 428 is displayed.
Requests the detection results of the document size sensor 411 and the paper size sensor to the system control unit 403, and determines the paper size based on each size received in response to this (A4 length in this case). Next, the operation display control circuit 428 calculates the area to be erased by the processing in the three-dimensional mode, displays the calculation result on the screen as shown in FIG. 32, and asks the operator for confirmation.

The erase area will be described with reference to FIG. FIG. 23B shows the original area 90 of FIG.
3 shows a document surface 909, a left-eye image surface 910, and a right-eye image surface 911 in which the vicinity of 3 is enlarged. Here, the left eye image 9
07 and the right-eye image 908 are to be recorded as they are by shifting as shown in the figure, the area 91 of the right-eye image surface 911 corresponding to the range of the left-eye image 907 outside the original area 903.
2, the corresponding area 913 of the document surface 909 is recorded,
Further, in the area 914 of the left-eye image surface 910 corresponding to the range of the right-eye image 908 that deviates from the original area 903, the original surface 9
The corresponding area 915 of 09 is recorded.

In this case, in the range of the left-eye image 907 which is out of the original area 903, the left-eye image 90 on which the sinking process has been performed.
7 is presented to the left eye 107, and the original image that is not subjected to up / down processing is presented to the right eye 108, which is unnatural. That is, since the image originally present to the right eye 108 is present on the front side, it is natural that the image subjected to the sinking process existing behind it is hidden and invisible. Therefore, in this range, it is better to delete one of the left-eye image subjected to the sinking process and the originally existing right-eye image, instead of simultaneously recording them. In the present embodiment, the former is erased as an example, and for this reason, the ratio of the area erased by the processing in the three-dimensional mode is displayed (4% in FIG. 32) and the operator is requested to confirm.

In this example, "100" is added to "area 1".
mm subduction processing "and" perspective scaling "are set.
Since the length of the “region 1” in the main scanning direction is 50 mm as shown in FIG. 31A, the (shift amount) of the left eye image and the right eye image, (magnification), (“magnification after magnification” The length of the area 1 "in the main scanning direction) and the length (extending from the original range of the area 1) are as follows. (Displacement amount) = 100 × 62.5 / (300 + 100) ≈15.6 mm (Magnification ratio) = 300 / {300 − (− 100)} × 100≈75% (Length after magnification change) = 50 mm × 0 0.75 = 37.5 mm (protruding length) = (37.5 + 15.6) −50 = 3.1 mm

In addition, since the "centering" movement mode is set for "area 1", the protruding portion is shown in FIG.
As shown in (e), it is evenly distributed to the left-eye image and the right-eye image. Therefore, the ratio of erasing the left-eye image and the right-eye image is as follows, and is displayed as shown in FIG. (Erase ratio) = (3.1 / 2) /37.5×100 ≈4%

The unnaturalness described above is a peculiar problem associated with the "sinking" process, and does not occur when the "floating" process is performed as in the "region 2".

When the "confirm" key is pressed on the screen shown in FIG. 32, the operation display control circuit 428 transmits various setting requests and operation requests to the system control unit 403 in ascending / descending order from the bottom. . In this case 10
Since the "region 1" where the 0 mm sinking process is performed is the lowest, the operation display control circuit 428 requests the setting regarding the "region 1", and the "region 1" → "outside the region" → "region 3" → " Requests are made in the order of "area 2".

The "region 1" operation display control circuit 428 sets the "region 1", for example, "setting the three-dimensional mode with image spacing of 2 dots and ups and downs -100 mm", "centering movement mode setting", and "black mode". settings of"
And "75% scaling" etc.
Request to 03. The operation display control circuit 428 also transmits the position information of “area 1” to the system control unit 403 as shown in FIG. 31B, and erases the area outside the transmitted area and the image memory 5 of the image signal 501.
Request full write to 20.

Upon receiving these, the system control unit 403 transmits various setting requests to the image processing control circuit 418,
The image processing control circuit 418 receives these, and the color correction circuit 4 receives them.
14, the area control circuit 415, the scaling circuit 416, the three-dimensionalization circuit 417, and the like are set. As a result, for example, the eraser 518 in the three-dimensionalization circuit 417 replaces the input image signal with a value that causes the least toner adhesion when the "outside area" switching signal is input. Further, the control gate 521 does not mask the original signal for write control. The system control unit 403 also sends “7” to the scanner control circuit 409.
5% scaling "setting, movement control in the sub-scanning direction, etc. are required.

Then, the operation display control circuit 428 requests the system control unit 403 to start the original reading operation, and the system control unit 403 receives the request and requests the scanner control circuit 409 and the like to start the original reading operation. To do. In response to this, the scanner control circuit 409 controls the scanner unit 301 to read the document four times. In this case, since the "black mode" is set for the "area 1", it is normally necessary to perform the reading once and write the page for K in the image memory 520, but here, the pages for C, M and Y are written. The reading is performed four times in order to erase the previous image signal remaining in.

"Outside the area" Next, the operation display control circuit 428
Requests the system control unit 403 to perform settings related to "outside the area", such as "cancellation of three-dimensional mode setting", "setting for full color mode", and "magnification setting". The operation display control circuit 428 also transmits to the system control unit 403 the positional information of all the “regions 1 to 3” set as shown in FIG. Is written to the image memory 520.

Receiving these, the system control unit 403 requests various setting requests to the image processing control circuit 418,
In response to this, the image processing control circuit 418 receives the color correction circuit 41.
4, the area control circuit 415, the scaling circuit 416, the three-dimensionalization circuit 417, and the like are set. Thus, for example, the control gate 521 masks the write signal when the switching signal 502 from the eraser 518 is within the area. The system control unit 403 also requests the scanner control circuit 409 to set “actual size” and control movement in the sub-scanning direction.

Then, the operation display control circuit 428 requests the system control unit 403 to start the original reading operation, and the system control unit 403 receives the request and requests the scanner control circuit 409 and the like to start the original reading operation. To do. In response to this, the scanner control circuit 409 controls the scanner unit 301 to read the document four times. That is, "out of area" is "full color mode"
Is set, the reading is performed four times in order to write to all pages of KCMY of the image memory 520.

In the present embodiment, the operation display control circuit 428 transmits the position information of the stored area (area 1) whose ups and downs are in the lower order at the time of the processing of "outside the area", and It requests that the image signal 501 be written to the image memory 520. As a result, the image outside the area is overwritten in the area that has overflowed in the stored area, and it is possible to prevent the unnaturalness due to the sinking process as described above.

[Region 3] Next, the operation display control circuit 428.
Requests the system control unit 403 to perform settings relating to "region 3", such as "middle right movement mode" setting, "red mode" setting, and "121% scaling".
The operation display control circuit 428 also includes the system control unit 4
03, the position information of “area 3” is transmitted as shown in FIG. 31C, and a request is made to write the image signal 501 inside the transmitted area to the image memory 520.

Receiving these, the system control unit 403 requests various setting requests to the image processing control circuit 418,
In response to this, the image processing control circuit 418 receives the color correction circuit 41.
4, the area control circuit 415, the scaling circuit 416, the three-dimensionalization circuit 417, and the like are set. Thus, for example, the control gate 521 masks the original signal for write control when the switching signal 502 from the eraser 518 is within the area. The system control unit 403 also includes a scanner control circuit 409.
For this, the setting of "121% scaling" and movement control in the sub-scanning direction are required.

Then, the operation display control circuit 428 requests the system control unit 403 to start the original reading operation, and the system control unit 403 receives the request and requests the scanner control circuit 409 and the like to start the original reading operation. To do. Further, the scanner control circuit 409 receives this and controls the scanner unit 301 to read the original twice. That is, since the “red mode” is set for the “area 3”, the reading may be performed twice in order to write the M and Y pages of the image memory 520.

Since neither “area 3” nor “outside area” is subjected to ups and downs, the ups and downs are in the same order, but in the above setting example, if they are read at once, they may correspond to different scaling factors. Since it cannot be done, it is processed in two steps. Therefore, if the scaling ratios are the same, it may be possible to process "region 3" and "outside region" at once by switching the process with the switching signal 502 or the like.

Further, since "enlargement / magnification" is set for "area 3" (121%), the size on the image memory 520 (after magnification) is larger than the original image, and therefore,
If "outside the area" is processed after "area 3", the area around the area is overwritten and erased in the area protruding from the original area, so in the above setting example, the image is prioritized from the original area. "Region 3" is processed after "outside region".

[Region 2] Finally, the operation display control circuit 42
8 indicates “area 2” for the system control unit 403.
Settings related to, for example, "two-dot image spacing, up / down amount + 50 mm three-dimensional mode", "vertical movement mode", "full color mode" and "actual size"
Request settings, etc. The operation display control circuit 428 also transmits the position information of “region 2” to the system control unit 403 as shown in FIG. 31 (d), and writes the image signal 501 inside the transmitted region in the image memory 520. To request.

Receiving these, the system control unit 403 requests various setting requests to the image processing control circuit 418,
In response to this, the image processing control circuit 418 receives the color correction circuit 41.
4, the area control circuit 415, the scaling circuit 416, the three-dimensionalization circuit 417, and the like are set. Thus, for example, the control gate 521 masks the original signal for write control when the switching signal 502 from the eraser 518 is out of the area. Further, as shown in FIG. 31A, the center position of the "area 2" in the main scanning direction is 40 mm from the center position of the document in the main scanning direction.
Since the size of the original and the size of the recording paper are set to the same, the left side should be set so that the midpoint of both eyes when observing the parallax stereogram is the center position of the recording paper in the main scanning direction. The distribution center of the image and the right image is set as follows. (Movement amount) = 50 / (300-50) × 40 = 8 mm

The image processing control circuit 418 calculates the left-eye offset address AL and the right-eye offset address AR based on the above calculation results, and sets them in the registers 512 and 513. Further, the system control unit 403 requests the scanner control circuit 409 to set “actual size” and control movement in the sub-scanning direction.

Then, the operation display control circuit 428 requests the system control unit 403 to start the original reading operation, and the system control unit 403 receives the request and requests the scanner control circuit 409 and the like to start the original reading operation. To do. In response to this, the scanner control circuit 409 controls the scanner unit 301 to read the document four times.

Here, in this embodiment, erasure outside the area transmitted by the operation display control circuit 428 at the time of processing the first area (area 1) and the image memory 50 of the image signal 501.
Requesting full writing to 2. The operation display control circuit 428 also transmits the position information of the unstored area (area 2) whose ups and downs are in the up-and-down order during the “outside area” processing, and also transmits the image signal 501 inside the area to the image memory 50.
Request not to write to 2.

As a result, nothing is recorded in the area outside the range of the left-eye image 905 in the original area 901 shown in FIG. Therefore, the image 901 originally present as a result of the floating process is completely erased, and it is possible to prevent the entity 902 after the floating process and the originally existing image image 901 from being presented twice. Also,
The image signal 501 according to the setting is stored in the image memory 502 in response to the above setting request and operation request by the operation display control circuit 428.

Next, the operation display control circuit 428 requests the system control unit 403 to start the operation of reading the image signal (stereoscopic signal) 522 from the image memory 502 and printing it out on the recording paper. In response to this, the system control unit 403 transmits a read request or the like from the image memory 502 to the image processing control circuit 418,
In response to this, the image processing control circuit 418 sets the 3-state buffer 519 to a high impedance state and the like.

Further, the system control unit 403 requests the printer control circuit 421 to start the print operation, and the printer control circuit 421 receives the request and controls the printer unit 302 to perform the print operation in the full color mode. Thus, the recording paper on which the stereoscopic image is recorded is used as a parallax stereogram together with the parallax barrier 101.

Compositing Next, the flow of control when different three-dimensional processing is performed for each designated area of a plurality of originals and they are combined into one sheet will be described. When the "composite" key is pressed on the standard screen shown in FIG. 7, a background document setting screen as shown in FIG. 33 is displayed, and a frame is displayed in the "composite" display area to display the "composite mode".
Notify the operator that the selection of was recognized. As a result, the operator can make settings relating to the background original in almost the same manner as the above-mentioned full-face mode and area mode.

The display areas of "entire surface" and "area" displayed near the center of the screen shown in FIG. 33 are keys for selecting the editing mode of the background document, and the operator depresses these keys. Then, respectively, the "full mode" in which the same processing is performed on the entire surface of the background document and the "region mode" in which different processing is performed for each designated area of the background document are selected. In addition,
In the initial state, the "whole surface mode" is selected, and a frame is displayed in the "whole surface" display area. Further, in the present embodiment, the background document is configured so as not to accept the setting of different scaling factors for each of the three-dimensional mode and the area.

When the operator similarly completes the setting relating to the background original and presses the copy start key, the operation display control circuit 428 displays the original setting instruction screen similar to that of FIG. 30, and displays the original 302 to the operator. Request to set on platen 303. Next, when the "confirm" key is pressed on the original setting instruction screen similar to FIG. 30, the operation display control circuit 428 requests the system control unit 403 for the detection results of the original size sensor 411 and the paper size sensor. A paper size is determined based on each size received in response.

Next, the operation display control circuit 428 requests the setting regarding the background original including the area position information and the full writing of the image signal 501 to the image memory 520, and the system control unit 403 receives them and receives the image processing control circuit 418. To the scanner control circuit 409, and to the scanner control circuit 409 a magnification setting request and a request for movement control in the sub-scanning direction. In response to this, the image processing control circuit 418 sets the color correction circuit 414, the area control circuit 415, the scaling circuit 416, the three-dimensionalization circuit 417, and the like.

Then, the operation display control circuit 428 requests the system control unit 403 to start the original reading operation, and the system control unit 403 receives the request and requests the scanner control circuit 409 and the like to start the original reading operation. To do. In response to this, the scanner control circuit 409 controls the scanner unit 301 to read the original 302 four times including the reason for erasing the previous image signal remaining in the image memory 520.

Next, the operation display control circuit 428 displays a composite manuscript area designation screen as shown in FIG. 34, which allows the operator to specify a desired area of the composite manuscript using the digitizer 425. The operator is the digitizer 42
When the designation of the desired area of the composite original is completed using 5,
The operation display control circuit 428 displays a screen as shown in FIG. 35, which enables the operator to set the designated area of the composite original in substantially the same manner as the individual area in the area mode described above. When the operator finishes the setting of the designated area of the composite original and presses the copy start key, the operation display control circuit 428 displays the original setting instruction screen similar to that in FIG. 30 again and displays the original 302 on the platen for the operator. Request to set on 303.

Then, when the "confirm" key is pressed on the original setting instruction screen similar to that shown in FIG. 30, the operation display control circuit 428 makes a setting to the system control unit 403 regarding the composite original including the area position information, and its setting. The writing of the image signal in the area to the image memory 520 is requested. Upon receiving the request, the system control unit 403 transmits various setting requests to the image processing control circuit 418, and the image processing control circuit 418 receives the request and sets the color correction circuit 41.
4, the area control circuit 415, the scaling circuit 416, the three-dimensionalization circuit 417, and the like are set. Further, the system control unit 403 sends a request for magnification setting and a request for movement control in the sub-scanning direction to the scanner control circuit 409.

Then, the operation display control circuit 428 requests the system control unit 403 to start the original reading operation, and the system control unit 403 receives the request and requests the scanner control circuit 409 and the like to start the original reading operation. To do. In response to this, the scanner control circuit 409 controls the scanner unit 301 to read the document as many times as necessary.

Here, the required number of readings depends on the color mode of the image stored in the image memory 520 and the color mode of the area to be combined. For example, even if the area to be combined is in the black mode, the image memory If the image in the full-color mode is already stored in the corresponding area of 520, the reading is performed four times to read C and M in the image memory 520.
And erase the stored signals for each page of Y.

Next, the operation display control circuit 428 displays a composite original area designation screen similar to that shown in FIG. 34, whereby the operator can use the digitizer 425 to designate a desired area of a new original to be composited. it can. The operation and operation are the same as those described above. The operator confirms various settings and document sets related to a new composite document, various setting requests and operation requests are made by the operation display control circuit 428, and the operation display control is performed again. The circuit 428 displays an area designation screen for a composite document similar to that shown in FIG. Then, these operations are repeated for the number of composite originals to obtain the image memory 520.
An image signal required for image recording is stored in the.

When the copy start key is pressed in the display state of the composite original area designation screen similar to FIG. 34, the operation display control circuit 428 causes the system control unit 4 to operate.
03 is requested to start the operation of reading the image signal (stereoscopic signal) 522 from the image memory 502 and printing it out on the recording paper. In response to this, the system control unit 403 transmits a read request or the like from the image memory 502 to the image processing control circuit 418, and the image processing control circuit 418 receives this and sets the 3-state buffer 519 to a high impedance state, etc. To do.

The system control unit 403 requests the printer control circuit 421 to start the print operation, and the printer control circuit 421 receives the request and controls the printer unit 302 to perform the print operation in the full color mode. Thus, the recording paper on which the stereoscopic image is recorded is used as a parallax stereogram together with the parallax barrier 101.

Next, the operation when the sinking process is selected in the composite mode will be described. When the sinking process is performed as described above, unnaturalness may occur due to the up-down relation of ups and downs with the image around the designated area. This is especially true when an image with no ups and downs is stored first and then the image with ups and downs is overwritten later as in the present embodiment.

By the way, in this embodiment, the control gate 521 is used.
On the other hand, a signal obtained by delaying the switching signal 502 by one line + the number of set pixels by the delay device 525 is applied. Therefore, the control gate 521 is set to the eraser 5
18 and the delay signal input from the delay device 525 are both not within the area, the original signal of the write control clock is masked and output to the image memory 520. If the sinking process is selected in the synthesis mode, the sinking process is performed. The image signal that overflows the area set by
Unnaturalness can be prevented by not writing 0.

The operation when a plurality of sinking processes are selected in the composite mode will be described next. In this embodiment,
When the ups and downs are processed as in the area mode, the ups and downs are basically processed in order from the lower area. For example, in composite mode,
If the three-dimensional mode with the up / down amount of -20 mm has already been set (stored in the image memory 520), when the three-dimensional mode is set again in the setting of another composite original, the operation display control circuit 428 shows in FIG. By displaying such a three-dimensional mode setting screen, the setting in the direction of sinking from the image already stored in the image memory 520 is not accepted except for the background document. As a result, it is possible to prevent unnaturalness that occurs due to the vertical relationship between the up and down areas.

In the above embodiment, the case where the stereoscopic image for parallax stereogram is generated has been described as an example, but the present invention can be applied to the stereoscopic image for parallax panoramagram. In this case, for example, the offset registers 512 and 5 shown in FIG.
By increasing the number of 13 and the number of data input terminals of the selector 514 and changing the frequency division number of the frequency divider 515, an image signal corresponding to three or more viewpoints is circulated for each predetermined number of pixels. A stereoscopic image for a panoramagram can be generated.

In the above embodiment, the case where the original is read by the scanner unit 301 to generate a stereoscopic image has been described, but the original image may be electronic. For example, a frame memory may be provided in the LAN connection device 404 to electronically store the original image from the LAN 405 and read it to the image processing unit 311 side as many times as necessary. In this case, the size of the original image stored in the frame memory of the LAN connection device 404 can be used in place of the detection result of the development size sensor 411 by transmitting the size of the original image from the LAN connection device 404 to the system control device 403. it can.

[0137]

As described above, according to the present invention, the image storing means for storing the image signal of at least one image is provided, and the image signal of the line-sequential scanning type is supplied to the image signal of the line-sequential scanning based on the designated up / down condition. Since each image corresponding to a plurality of viewpoints is shifted in the left-right direction so as to be circulated at predetermined intervals and arranged so as to be stored in the image storage means, it is possible to use an inexpensive configuration without using a large-capacity image memory. Single or multiple 2
A stereoscopic image can be combined using a three-dimensional image as an original image.

Further, since the designated up / down condition is limited to the floating direction from the stored image area, the operator can set the up / down direction without considering the three-dimensional positional relationship. Stereoscopic images can be combined with a simple operation.

When the images corresponding to a plurality of viewpoints are shifted in the left-right direction, the shifted images are deleted,
It is possible to synthesize a natural stereoscopic image.

When the images corresponding to a plurality of viewpoints are shifted in the left-right direction, they are shifted so as to be perpendicular to the line of sight, so that a natural stereoscopic image can be synthesized.

Further, when the images corresponding to a plurality of viewpoints are shifted in the left-right direction, the respective images are scaled according to the positions in the left-right direction, so that the apparent size in the vertical direction can be changed. Therefore, it is possible to synthesize a natural stereoscopic image.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing a parallax stereogram using stereoscopic images synthesized by a stereoscopic image synthesis processing device according to the present invention.

FIG. 2 is an explanatory diagram showing ups and downs of the stereoscopic image of FIG.

FIG. 3 is a configuration diagram showing a mechanism of a copying machine to which a stereoscopic image synthesis processing device according to the present invention is applied.

FIG. 4 is a block diagram showing an electrical system of the copying machine of FIG.

5 is a block diagram showing the stereoscopic circuit of FIG. 4 in detail.

6 is a timing chart showing main signals of the stereoscopic circuit of FIG.

FIG. 7 is an explanatory diagram showing a standard screen of the TPD of FIG.

8 is an explanatory diagram showing a character mode selection screen of the TPD of FIG.

9 is an explanatory diagram showing a color mode selection screen of the TPD of FIG.

10 is an explanatory diagram showing a black mode selection screen of the TPD of FIG.

11 is an explanatory diagram showing a create mode selection screen of the TPD of FIG.

12 is an explanatory diagram showing a three-dimensional mode selection screen of the TPD of FIG.

13 is an explanatory diagram showing a three-dimensional mode setting end screen of the TPD of FIG.

14 is a timing chart showing the relationship between a document and recording paper, an input image signal, and a switching signal in one line in the three-dimensionalization circuit of FIG.

15 is an explanatory diagram showing an area designation screen of the TPD of FIG.

16 is an explanatory diagram showing an area designation end screen of the TPD of FIG.

FIG. 17 is an explanatory diagram showing a create mode setting screen of the TPD of FIG.

18 is an explanatory diagram showing a three-dimensional mode selection screen of the TPD of FIG.

19 is an explanatory diagram showing a three-dimensional mode setting end screen of the TPD of FIG.

20 is an explanatory diagram showing a scaling mode selection screen of the TPD of FIG.

21 is an explanatory diagram showing a scaling mode setting end screen of the TPD of FIG. 4. FIG.

22 is an explanatory diagram showing a perspective variable magnification mode setting screen of the TPD of FIG. 4. FIG.

FIG. 23 is an explanatory diagram showing sizes of a floating image and a sinking image in the perspective variable magnification mode.

24 is an explanatory diagram showing a movement mode selection screen of the TPD of FIG.

FIG. 25 is an explanatory diagram showing movement of an image designated by the movement mode selection screen of FIG. 24.

FIG. 26 is an explanatory diagram showing movement of an image in a vertical movement mode.

27 is an explanatory diagram showing a vertical movement mode selection screen of the TPD of FIG.

28 is an explanatory diagram showing a region designation screen of the TPD of FIG.

29 is an explanatory diagram showing an outside-region selection screen of the TPD of FIG.

30 is an explanatory diagram showing a document setting instruction screen of the TPD of FIG.

FIG. 31 is an explanatory diagram showing an example in which images of a plurality of areas are three-dimensionalized.

32 is an explanatory diagram showing a non-recordable area instruction screen of the TPD of FIG. 4. FIG.

33 is an explanatory diagram showing a background document setting screen of the TPD of FIG.

34 is an explanatory diagram showing an area designation screen of a composite original of the TPD of FIG.

FIG. 35 is an explanatory diagram showing an area designation end screen of the composite original of the TPD of FIG. 4.

FIG. 36 is an explanatory diagram showing a three-dimensional mode setting screen of the composite original of the TPD of FIG.

[Explanation of symbols]

301 Scanner unit 403 System control unit 409, 418, 421, 428 control circuit 417 Three-dimensional circuit 425 digitizer 427 TPD (touch panel display) 520 image memory

─────────────────────────────────────────────────── ─── Continuation of the front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) H04N 1/387 H04N 1/40 H04N 13/02 G03B 35/00 G06T 15/00

Claims (6)

(57) [Claims] 1. A line-sequential scanning type based on up-and-down designating means for designating up-and-down conditions of an image, image storage means for storing an image signal of at least one image, and up-and-down condition specified by the up-and-down designating means. Image signals of a plurality of viewpoints are converted so that the images corresponding to a plurality of viewpoints are shifted in the left-right direction so as to be circulated side by side at predetermined intervals, and are stored in the image storage means. Processing equipment. 2. The sinking process is selected in the image conversion means.
The area set by the sinking process,
The stored image signal to the image storage means.
Synthesis processing apparatus of the stereoscopic image according to claim 1, wherein Rukoto. 3. The image conversion means is out of the original area.
In the range of the left eye image, the left eye image that has undergone sinking is the left eye
Image presented to the right eye without ups and downs processing.
If presented, the above left-eye image or right-eye image
2. One of the two is erased.
Alternatively, the stereoscopic image synthesizing processing device according to the second aspect. 4. The image converting means erases an image of a hidden and invisible portion when the images corresponding to a plurality of viewpoints are shifted in the left-right direction. The stereoscopic image synthesis processing apparatus according to item 1. 5. The image conversion means, when shifting each image corresponding to a plurality of viewpoints in the left-right direction, shifts so as to be perpendicular to the line of sight. The stereoscopic image synthesis processing device according to item 3. 6. The image conversion means scales each image according to the position in the left-right direction when the images corresponding to a plurality of viewpoints are shifted in the left-right direction.
3. The stereoscopic image synthesizing device according to any one of 1.