JPH09172654A - Stereoscopic picture editing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a simple stereoscopic picture editing device by calculating deviation quantity creating a parallax required for obtaining a sense of depth from a left eye character signal and a right eye character signal. SOLUTION: This stereoscopic picture editing device 11 performs a parallel processing by a left eye picture signal processor 12L and a right eye picture signal processor 12R. A character signal is fetched by a character input device 14. An editing operator indicates the input position (X, Y) of a character by the knob 13A of a position input device 13 and indicates a Z-axis direction by the knob 13B while viewing a picture in a monitor 23. The instructions are converted into an address and synthesized with the picture.

Description

Detailed Description of the Invention

[0001]

[Table of Contents] The present invention will be described in the following order. TECHNICAL FIELD The present invention relates to a problem to be solved by the invention. Means for solving the problem Embodiments of the invention (1) Deviation amount determination function (1-1) Deviation amount calculation process according to depth direction (1) -1-1) Initial setting (1-1-2) Setting of variable parameter and calculation of shift amount (1-2) Enlargement / reduction processing of character itself according to position in depth direction (2) First embodiment (3) Second embodiment (4) Other embodiments Effect of the invention

[0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic image editing apparatus.

[0003]

2. Description of the Related Art Conventionally, as a device for displaying a two-dimensional image so that it can be perceived as a stereoscopic image, a stereoscopic image display device shown in FIG. 6 has been known. This stereoscopic video display device separately projects a two-dimensional image for the left eye and a two-dimensional image for the right eye projected onto the screen 2 from the two projector devices 1R and 1L, and the projected two-dimensional image is projected. A two-dimensional image for the left eye of the three-dimensional image can be perceived only by the left eye, and a two-dimensional image for the right eye can be perceived only by the right eye, so that an observer can observe as a stereoscopic image. It is done like this.

Therefore, the projector device 1 on the projection side
An image is projected from R and 1L through two polarization filters 3R and 3L having different polarization directions, and the observation side observes this image through the spectacles 4 to which the polarization filters 4R and 4L are attached. There is. Glasses 4 like this
If you wear it and observe the two-dimensional image projected on the screen 2, the two-dimensional image for the left eye can be incident only on the left eye, and the two-dimensional image for the right eye can be incident only on the right eye. Can be made. As a result, the observer can perceive a two-dimensional image located at the front or the back of the screen 2.

At the production site of a program, when a character string such as a creator's name is inserted into a stereoscopic image of this kind, editing work may be performed. However, the character string is inserted at an arbitrary position in the depth direction. In order to do so, it is necessary to insert a character string into each of the left-eye image and the right-eye image so that parallax according to the depth occurs. For example, when it is desired to insert the character string on the same surface as the screen 2, as shown in FIG. 7A, the target character string VL for the left eye and the character string VR for the right eye are inserted. Need to be inserted in place.

On the other hand, when it is desired to insert the character string on the far side of the screen 2, the character string VL for the left eye is about to be inserted 2 as shown in FIG. 7B. Insert it by shifting to the left with respect to the position on the 3D screen
The character string VR for the right eye must be shifted to the right and inserted. On the other hand, when it is desired to insert the character string on the front side of the screen 2, the position on the two-dimensional screen where the character string VL for the left eye is about to be inserted, as shown in FIG. 7C. Must be inserted to the right with respect to the right eye, and the character string VR for the right eye must be inserted to the left.
As described above, the worker involved in the editing work can perform a relative insertion of the character string VL for the left eye and the character string VR for the right eye according to the position on the two-dimensional screen where the character string is to be inserted and the position in the depth direction. The positional relationship must be set.

[0007]

However, in the case of the editing apparatus which has been used conventionally, the work of inserting these character strings VL and VR is independent for each of the left-eye image and the right-eye image. The work tends to take a lot of time and effort. Also, to check the edited result, there is no other way but to play back the image for the left eye and the image for the right eye that have been edited at the same time and preview, so in order to insert the character string at the intended depth direction position. Had more trouble and time consuming problems.

The present invention has been made in consideration of the above points, and is intended to propose a stereoscopic image editing apparatus that can insert a character string into a stereoscopic image more easily than ever before. is there.

[0009]

In order to solve such a problem, in the present invention, a character string is temporarily stored in a storage means, and the character signal from the storage means is stored in the first character signal for the left eye and the right eye. When each is read out as the second character signal for use in calculating the relative displacement amount for obtaining the parallax necessary to obtain a sense of depth, based on the position information in the depth direction input from the input means, A first read address for giving the first character signal and a second read address for giving the second character signal are generated based on the shift amount. In this way, one character string to be read is separately read at two different read addresses and mixed into each of the left-eye image signal and the right-eye image signal, whereby the left-eye image signal and the right-eye image signal are mixed. It is possible to insert a character string at a desired position in the depth direction in a stereoscopic image obtained by synthesizing.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below in detail with reference to the drawings.

(1) Displacement amount determining function In this section, the function of calculating the displacement amount G on the screen corresponding to this by simply inputting the depth direction position where the character string is to be inserted as the depth amount T, and the depth amount A function of enlarging or reducing the characters themselves to be inserted in the image for the left eye and the image for the right eye according to the amount T will be described.

(1-1) Deviation amount calculation processing according to depth direction (1-1-1) Initial setting The use environment of the display device for displaying a stereoscopic image differs depending on the installation situation. Therefore, in order to be able to automatically calculate and determine an appropriate shift amount G in any usage environment, three values are input as initial setting values. However, the width I of both eyes should be fixed at 6.5 cm.

First, the first value is the size S of the screen 2 for projecting a two-dimensional image for a stereoscopic image. This size S is given by the diagonal distance of the screen 2 as shown in FIG. 1, and is 1 [inc] in the range of 1 [inch] to 1000 [inch].
h] can be entered in units. The second value is the distance D from the viewer to the screen 2. This distance D is shown in FIG. Incidentally, the distance D can be entered in units of 1 cm in the range of 0 cm to 10000 cm. The third value is the limit value of the parallax angle θ of the viewer. This value is -1 [°] to +6
The value can be entered in the unit of 0.1 ° within the range of °. By this work, it becomes possible to calculate the appropriate shift amount G regardless of the difference in the usage environment.

(1-1-2) Setting of Variable Parameter and Calculation of Displacement Now, when the setting of the initial value is completed as described in the previous section, the displacement according to the depth amount T of an arbitrary value given by the editor is next. Quantity G
Is calculated. As will be described below, the value input by the editor is only the depth amount T. The depth amount T is
It is a value where the position on the screen 2 is 0, the direction closer to the viewer is +, and the direction further from the viewer is −, and the distance from the screen 2 to the viewer is 100 [%].
And given in the ratio. For example, when there is an imaginary plane for inputting a character string at an intermediate position between the screen 2 and the viewer, the value of the depth amount T is 50 [%].

Now, given the depth amount T in this way,
The deviation amount G is

[Equation 2] Can be obtained as However, I is 6.5 [cm]. The expression (2) is satisfied in the cases shown in FIGS. 2A and 2B (that is, when -I <G is satisfied).

Incidentally, when the shift amount G is -I> G as shown in FIG. 2D, T [%] =-infinity holds.
Although the notation of + and − appears as the deviation amount G,
+ Indicates that the positional relationship between the left and right character strings VL and VR is reversed from the state where the positions of the character string VL for the left eye and the character string VR for the right eye match (that is, the character for the left eye is reversed). Row VL
Means that the character string is shifted to the right of the character string VR for the right eye), and-is a state where the positions of the character string VL for the left eye and the character string VR for the right eye match. It means that the character string VL for the left eye shifts to the left and the character string VR for the right eye shifts to the right.

The unit of the value calculated by the equation (2) is [cm] and cannot be directly used for the image signal treated in the pixel unit. Therefore, the value obtained by the equation (2) is

(Equation 3) Is used for various processing.

(1-2) Enlargement / Reduction Processing of Characters According to Position in Depth Direction Deviation amount G commensurate with feeling of depth T by the calculation described in the preceding paragraph.
However, if the character string is shifted by the number k of pixels obtained by using the equation (3) and inserted into the left-eye image and the right-eye image, the character string having a certain size on the screen 2 is obtained. Is moved to the front side or the back side with the same size, and there is a possibility that a sense of perspective may be uncomfortable. Therefore, the following will show a method in which a character string of the same size can be displayed large when it comes close to the front, and can be displayed small when it approaches the front so as to give a sense of perspective close to reality.

Enlargement / reduction processing of the character itself will be described with reference to FIG. FIG. 3 shows an example in which a character having a size represented by a length y is brought closer to the viewer side when the character is inserted on the screen. At this time, if the length that would be taken when a character of the size represented by the length y is shifted to the front by the depth amount G is y ′, a triangle is formed between the length y and the length y ′. From the relationship of the ratio,

(Equation 4) Can be obtained as If the size of the character itself is enlarged or reduced by substituting it into this relational expression, the perspective can be more accurately transmitted to the viewer.

(2) First Embodiment A screen 2 required for image processing using the above relational expression.
FIG. 4 shows an example of a stereoscopic image editing apparatus having a function of obtaining the amount of deviation G and the size of the character itself. Incidentally, the stereoscopic image editing apparatus 11 shown in FIG. 4 processes the left-eye image signal V _INL and the right-eye image signal V _INR in parallel. First, the configuration will be described. The stereoscopic image editing device 11 includes an image signal processing device 12L dedicated to processing the left-eye image signal V _INL and an image signal processing device 12 dedicated to processing the right-eye image signal V _INR.
R and a position input device 1 for instructing a position to insert the character signal V _INT into each of the image signal processing devices 12L and 12R.
3 and 3.

Incidentally, the character signal V _INT is taken in through a character input device 14 such as a camera or a scanner, and is given to each of the image signal processing devices 12L and 12R. As described above, the character input device 14 receives the received character signal V _INT via the two cables from each image signal processing device 1.
Since the configuration is given to 2L and 12R, only one text original is required. Further, since only one character original is required in this manner, the left-eye and right-eye character originals are unnecessary, and the editing work can be shortened.

Now, return to the description of the image signal processing devices 12L and 12R. Since these two image signal processing devices 12L and 12R have the same structure, the internal configuration of the image signal processing device 12L will be described here as an example. The image memory 15 is a memory having a storage capacity for one frame, and is a character signal V _INT input from the character input device 14.
Is written and held at the address given from the write address generator 16. The read address generator 17 is a circuit that generates a read address required when reading a character signal stored in the image memory 15,
The control device (CPU) 17A is mainly configured.

Here, the read address generator 17 is used not only for the control unit (CPU) 17A but also for a read only memory (ROM) 17B for storing control programs and conversion tables, for executing various arithmetic processes and storing software programs. It is composed of a read / write memory (RAM) 17C and an interface 17D. Here, the interface 17D inputs the position information input from the position input position 13 to the CPU 17A, and the above equations (1) to (3) are input.
Used to generate the optimum read address given by the formula.

Of these, the position information (X, Y) indicating the insertion position on the two-dimensional plane (X-Y plane) is the input knob 13A of the position input device 13 such as a track ball.
The position information T indicating the insertion position in the depth direction (Z-axis direction) is input in 1/100 increments using the input knob 13B such as a potentiometer.

The read address generator 17 generates a read address on the basis of the position information given from these two input knobs 13A and 13B, and gives it to the image memory 15. For this reason, initial values (screen size S, binocular distance I, distance D from the viewer to the screen 2, limit values of the viewer's parallax angle θ, etc.) necessary for generating the read address are also included in the position input device 13. Is input to the read address generator 17.

The multipliers 19 and 20, the key signal generator 21 and the adder 22 constitute a switch circuit. Of these, the key signal generator 21 is used to determine whether or not the character signal V _TL has been read from the image memory 15, and if it has been read, the multiplier K is set to “1” and there is no reading. In this case, the multiplier K is set to "0" so that either the left-eye image signal V _INL or the character signal V _TL can be output from the adder 22. The monitor 23 is used to confirm the image signal output from the adder 22 in an editing room or the like, and is used for positioning work such as where to insert the character string on the screen.

With the above configuration, the stereoscopic image editing apparatus 1
An example of the editing work using 1 will be described. First, the editing operator operates the position input device 13 to input initial values such as the screen size S and the distance I between both eyes. When the input of the initial value is completed, the character original is imaged by the imaging camera or the like which is the character input device 14, and is written in the image memory 15 as the character signal V _INT .

While confirming the content of the captured image on the screen of the monitor 23, the editing operator designates the position on the screen where the character string is to be arranged by operating the input knob 13A. At this time, position information is output from the position input device 13 to the image signal processing devices 12L and 12R, and the read address generator 17 uses this position information to generate a reference read address. When the position on the two-dimensional plane is fixed in this way, the operation for inputting the position in the depth direction is started.

The editing operator operates the input knob 13B to specify a relative depth position based on the distance between the screen surface and the viewer. At this time, the read address generator 17
Is added to or subtracted from the reference read address by half the amount of shift in the left-right direction on the screen 2 obtained by the equations (2) and (3) to set the read addresses of the left-eye and right-eye character signals. . At this time, the read address generator 17 sets the character size according to the depth position by using the equation (4), and controls the reading from the image memory 15 so as to give a sense of perspective.

At this time, the character signal V is displayed on the screen 2.
_Since the left stereoscopic image in which _TL and V _TR are respectively inserted is displayed, the editing operator can immediately confirm whether or not the position designation is appropriate, and if necessary, operate the input knobs 13A and 13B. The position can be adjusted. As described above, the stereoscopic image editing apparatus 11 inserts a character signal whose read address is adjusted according to position information in the depth direction into the left-eye image signal V _INL and the right-eye image signal V _INR in real time. When both signals are reproduced at the same time after the left and right separate editing operations as described above, it is very efficient without requiring time and effort.

According to the above construction, the editing operator can insert the character string into a desired position in the depth direction only by operating one input knob 13B, and the editing operation can be shortened. . In addition, it is not necessary to repeat the intuition-based input of the shift amount G necessary for obtaining a desired depth feeling by performing the arithmetic processing using the expressions (2) to (4) and the verification by the reproduction, and the editing work can be performed. Can be made more efficient. Further, it is only necessary to prepare one manuscript of the character string to be inserted, and it is not necessary to prepare the manuscript for the left eye and the manuscript for the right eye separately.

(3) Second Embodiment In FIG. 5 in which parts corresponding to those in FIG. 4 are assigned the same reference numerals, one image signal processing device is used as a left eye image signal V _INL and a right eye image signal. 3 shows a stereoscopic image editing device 31 shared with V _INR . The stereoscopic image editing apparatus 31 has switching switches 32 and 33 for switching and using the image signal input / output every one field period for the left eye or the right eye.

The switching switch 32 is for alternately _{supplying the} left-eye image signal V _INL and the right-eye image signal V _INR externally input to the multiplier 19, and the switching switch 33 is for the projectors 1L and 1R. It is for switching the signal output to. The switching control circuit 34 is a circuit for controlling switching of these two switching switches 32 and 33, and is adapted to give a switching timing by giving a switching signal SW to each of the switches 32 and 33.

In the case of this embodiment, the method of generating the character signals V _TL and V _TR corresponding to the character string to be inserted into the stereoscopic image becomes a problem, but in the case of the stereoscopic image editing device 31, the switching control circuit is provided. The switching signal SW output from the interface 34 is fetched from the interface 17E into the read address generator 17 and the read addresses are generated in a time division manner to generate the necessary character signals V _TL and V _TR . Incidentally, the RAM 17C stores the read address for the left eye and the read address for the right eye, which are calculated based on the position information input from the position input device 13, respectively, and are read alternately according to the switching signal SW. It is designed to be done.

Since the basic structure is the same in this embodiment as well, the contents and effects of the editing work are the same as those in the first embodiment, but in the case of this embodiment, the image signal V for the left eye is used.
_{Since INL} and the image signal V _INR for the right eye are switched for each field, a frame-sequential stereoscopic image can be obtained.

(4) Other Embodiments In the above embodiment, two projectors 1L are used.
Although the case where 1 and 1R are used as an image output device has been described, the present invention is not limited to this, and a liquid crystal display device or the like may be used as an output device. Further, in the above embodiment, the case where the position information in the two-dimensional screen and the position information in the depth direction are input using the knobs 13A and 13B has been described, but the present invention is not limited to this, and a button type such as a numeric keypad is used. Numerical values may be input using the input device.

Further, in the above-described embodiment, the case where the aspect ratio of the screen 2 is set to 16: 9 has been described, but the present invention is not limited to this and is also applicable to other ratios such as 4: 3. obtain. Further, in the above-described embodiment, the shift amount of the left-eye character signal and the shift amount of the right-eye character signal are calculated based on the position information in the depth direction input from the editing operator, and the shift amount is adjusted according to the perspective. Although the case of executing the enlargement / reduction processing of the character size was described,
The present invention is not limited to this, and can be applied to a case where only the calculation of the shift amount according to the position in the depth direction is executed.

Further, in the above-described embodiment, the case where a desired character is inserted into a stereoscopic image with a desired depth has been described, but the present invention is not limited to this, and is widely applied when an image other than characters is inserted. Applicable. Further, in the above embodiment, the coefficient K given to the multipliers 19 and 20 is set to "1".
Alternatively, the case where only one of the signals is output to the subsequent stage as “0” has been described, but the present invention is not limited to this.
The coefficient K may take a value of 0 <K <1.

[0039]

As described above, according to the present invention, after the character string to be inserted is stored in the storage means, the character signal from the storage means is used as the first character signal for the left eye and for the right eye. When reading the second character signal, the relative shift amount that obtains the parallax necessary to obtain the sense of depth is calculated based on the position information in the depth direction input from the input unit, and the shift amount is calculated. The first read address for giving the first character signal and the second read address for giving the second character signal are generated based on the above. In this way, the editing operator can insert a character string at a position where a desired sense of depth can be obtained simply by designating position information in the depth direction using the input means, and stereoscopic image editing with higher work efficiency than before. The device can be obtained.

[Brief description of the drawings]

FIG. 1 is a schematic diagram for explaining a screen size.

FIG. 2 is a schematic diagram for explaining each parameter.

FIG. 3 is a schematic diagram for explaining a size change of a character size according to perspective.

FIG. 4 is a block diagram showing an embodiment of a stereoscopic image editing apparatus according to the present invention.

FIG. 5 is a block diagram showing an embodiment of a stereoscopic image editing apparatus according to the present invention.

FIG. 6 is a schematic diagram showing a general configuration of a stereoscopic image display device.

FIG. 7 is a schematic diagram for explaining a relationship between image shift and perceived perspective.

[Explanation of symbols]

1R, 1L ... Projector device, 2 ... Screen,
3R, 3L, 4R, 4L ... Polarizing filter, 4 ... Glasses, 11, 31 ... Stereoscopic image editing device, 12L, 12R
... Image signal processing device, 13 ... Position input device, 13
A, 13B ... Input knob, 14 ... Character input device, 1
5 ... Image memory, 16 ... Write address generator, 17
... Read address generator, 19, 20 ... Multiplier, 21
...... Key signal generator, 22 ...... Adder, 23 ...... Monitor, 32, 33 ...... Switching switch, 34 ...... Switching control circuit.

Claims (5)

[Claims] 1. A storage unit for capturing and storing a character string to be inserted in a stereoscopic image as an image signal, and a first character signal read out from the storage unit for the left eye for the left eye constituting the stereoscopic image. A left-eye image output unit that mixes and outputs the image signal, and a right that mixes and outputs the second character signal read from the storage unit for the right eye to the right-eye image signal that forms the stereoscopic image. Eye image output means, input means used for designating and inputting a position on the two-dimensional plane into which the character string is inserted and a position in the depth direction, and position information in the depth direction input from the input means. A relative shift amount of parallax required to obtain a sense of depth is calculated based on the first read address that gives the first character signal based on the relative shift amount, and the second character signal. Second read address giving And a read address generating means for giving the storage means to the stereoscopic image editing apparatus. 2. The read address generating means is a ratio of a distance I between both eyes of a viewer and a ratio of a virtual insertion position of the character string to a distance from a physically existing display screen to the viewer. Using T, the following equation 2. The stereoscopic image editing apparatus according to claim 1, wherein G is calculated as a relative shift amount of the parallax required to obtain a sense of depth. 3. The read address generating means enlarges or reduces the size of the character string so that a perspective feeling corresponding to a sense of depth is generated based on the position information in the depth direction input from the input means. The stereoscopic image editing apparatus according to claim 1, wherein 4. The storage unit and the read address generating unit are separately prepared for the left-eye image signal and the right-eye image signal, respectively. 3D image editing device. 5. The left-eye image output means and the right-eye image output means are one output means, and the output means are alternately used in a time division manner. The stereoscopic image editing device according to 1.