CN101385047B - Image signal processing apparatus and virtual reality creating system - Google Patents

Abstract

A virtual reality creating system including: a screen 1 including a projection plane of arbitrary shape; a distortion correction unit 3 which performs distortion correction for projecting image light onto the projection plane of arbitrary shape for a two-dimensional image signal to project image light onto a two-dimensional projection plane and then outputs the same; a parameter adjusting PC 5 which creates a distortion correction table as a correspondence map between the two-dimensional projection plane and a mesh model of the projection plane of arbitrary shape; and projectors 2a and 2b unit which project an image based on the image signal outputted from the image signal processing apparatus onto the screen. The distortion correction unit 3 receives the distortion correction table from the parameter adjusting PC 5 and performs distortion correction processing for each pixel of the two-dimensional image signal received by the image signal input unit with reference to the distortion correction table to generate the image signal to project the image light onto the projection plane of arbitrary shape. It is therefore possible to display images with reduced distortion of image light viewed by a viewer with a simple structure in real time.

Description

Image signal processing apparatus and virtual reality creating system

Technical field

The present invention relates to a kind of image signal processing apparatus, be used in advance received image signal being carried out distortion correction, make even also can show the two dimensional image signal on being projected to the screen of arbitrary shape the time and do not have distortion, the present invention also relates to a kind of virtual reality creating system.

Background technology

In the virtual reality creating device, realize projected image on the arbitrary shape screen and do not had the technology of distortion.The example of this prior art comprises following document etc.In these virtual reality creating devices, received image signal is computer graphical signal or the DV signal that is produced for the virtual reality creating device.In addition, in system, create the relationship expression (relational expression) (to before the distortion correction and the afterwards description and the distortion correction table of the relation between the image) be used for projected image and do not have the distortion correction of distortion.

Japan Patent No.3387487

Summary of the invention

Technical problem

Yet, in above-mentioned technology, owing to be in same system, to create the relationship expression that distortion correction is used, limited allowing the picture signal that is transfused to, maybe need to carry out three-dimensional computations and handle, this makes complex system, and needs the equipment of high standard.

Therefore, consider above-mentioned situation and finished the present invention, the purpose of this invention is to provide a kind of image signal processing apparatus, by utilizing the result of the external treatment of carrying out at distortion correction, it can easily carry out distortion correction treatment, does not need to carry out complicated three-dimensional process.

Technical scheme

The present invention is a kind of image signal processing apparatus, it exports to projecting cell with output image signal so that throw image light on the projection plane of arbitrary shape, and the problems referred to above have been solved, this device comprises: the picture signal input unit receives the two dimensional image signal so that throw image light on the two-dimensional projection plane; Outside input unit, externally receiving distortion correction table shines upon as the corresponding relation between the mesh mode of two-dimensional projection plane and arbitrary shape projection plane, for the two dimensional image signal that receives by the picture signal input unit, use distortion correction table to carry out distortion correction treatment; The distortion correction unit, with reference to the distortion correction table that receives by outside input unit, to each pixel of the two dimensional image signal that receives by the picture signal input unit, carry out distortion correction treatment, produce output image signal and on projection plane, throw image light; Output unit is for projecting cell output produces picture signal by the distortion correction unit.

Virtual reality system according to the present invention comprises: screen, comprise the projection plane that has towards the arbitrary shape of beholder's concave surface, and screen can show the wide image of effective angle in an amplitude ratio beholder visual field; Image signal processing apparatus throws image light at the two dimensional image signal on two dimensional image light, use execution distortion school to throw image light on the projection plane of arbitrary shape, exports output image signal afterwards; The external treatment device is created distortion correction table and is answered relationship map as the degree between the network model of two-dimensional projection plane and arbitrary shape projection plane; Projector unit is based on the output image signal projection on screen from image signal processing apparatus output.In order to address the above problem, the feature of image signal processing apparatus comprises: the picture signal input unit receives the two dimensional image signal; Outside input unit, receive distortion correction table as the mapping of the corresponding relation between the network model of two-dimensional projection plane and arbitrary shape projection plane, the use distortion correction table is carried out the distortion correction treatment at the two dimensional image signal that is received by the picture signal input unit; The distortion correction unit, with reference to the distortion correction table that receives by outside input unit, each pixel to the two dimensional image signal that received by the image signal data unit is carried out distortion correction treatment, produces output image signal, and throw image light on the projection plane of arbitrary shape; Output unit, the output image signal that output is produced by the distortion correction unit to projecting cell.

Beneficial effect

According to the present invention, to image signal processing apparatus, store distortion correction table in advance from the outside, and when the process that image light is projected from projecting cell on the screen, carrying out distortion correction treatment at the two dimensional image signal, only produce output image signal, and need not carry out three-dimensional process by carrying out the two-dimensional coordinate conversion.Therefore, according to the present invention, can realize reducing the processing of the image fault that the beholder sees with simple structure.

Description of drawings

Fig. 1 shows the block diagram of the formation of the virtual reality creating system that the present invention is applied to.

Fig. 2 shows the block diagram that the hardware of the distortion correction unit that the present invention is applied to constitutes.

Fig. 3 shows the block diagram that the software of the distortion correction unit that the present invention is applied to constitutes.

Fig. 4 is a view of explaining the distortion correction treatment of using distortion correction table, (a) is that treatment for correcting is a two dimensional image before; (b) be that treatment for correcting is an output image afterwards.

Fig. 5 is a view of explaining the gamma correction processing of using the gamma correction table, (a) is the two dimensional image before the treatment for correcting; (b) be output image after gamma correction is handled; (c) be gamma correction and distortion correction output image afterwards.

Fig. 6 is a view of explaining the gamma correction processing of using the gamma correction table, (a) is treatment for correcting two dimensional image before; (b) be output image after gamma correction is handled; (c) be gamma correction and distortion correction output image afterwards.

Fig. 7 is the block diagram that the screen mould of parameter adjustment personal computer is created piece.

Fig. 8 show spherical model and with the view of the corresponding input parameter of spherical model.

Fig. 9 show cutting a part of ball surface model and with the view of the corresponding input parameter of spherical model.

Figure 10 shows the view of the front shape when a part of spherical screen of cutting.

Figure 11 show the column model and with the view of column model corresponding parameter.

Figure 12 shows the view of the input parameter on a plurality of planes.

Figure 13 shows distortion correction treatment is carried out in explanation to the spherical form of screen view.

Figure 14 shows the view of the content of distortion correction treatment.

Figure 15 is the two-dimensional cross-section view at Fig. 4 of hemisphere screen center cutting.

Figure 16 is the image views of the distortion correction of grid image.

Figure 17 is the image views when corresponding two pixels of adjoining from the x direction of input picture are created each color of pixel information of output image.

Figure 18 is an explanatory of calculating the colouring information of output image on the x direction by two color of pixel information that the mixing input picture adjoins.

Figure 19 is the image views when creating each color of pixel information of output image from corresponding two pixels of input picture y direction.

Figure 20 is an explanatory of calculating the output image colouring information by two color of pixel information of adjoining on the y direction of mixing input picture.

Figure 21 is the image views when corresponding 4 pixels of adjoining from input picture x and y direction are created each pixel color information of output image.

Figure 22 is the explanatory by the colouring information that mixes 4 color of pixel information calculations output images that input picture adjoins in x and y direction.

When Figure 23 creates each pixel color information of output image when corresponding two pixels of adjoining in the x direction from input picture, converting input picture the explanatory of the processing of output image to according to input order, (a) is the explanatory of the processing after preceding several pixel P1 of input picture and P2 are transfused to; (b) be explanatory after the pixel P3 behind the pixel P2 is transfused to.

Figure 24 is when corresponding two pixels of adjoining in the y direction from input picture are created each color of pixel information of output image, converting input picture the explanatory of the processing of output image to according to input order, (a) is the explanatory of the processing after the pixel P1 of input picture and P2 are transfused to; (b) be explanatory after the pixel P4 behind the pixel P2 is transfused to.

Figure 25 is when corresponding 4 pixels of adjoining in x and y direction from input picture are created each pixel color information of output image, convert input picture the explanatory of the processing of output image to according to input order, (a) be the explanatory of the processing after preceding several pixel P1 of input picture are transfused to P4; (b) be explanatory after the pixel P6 behind the pixel P4 is transfused to.

Figure 26 is when corresponding two pixels of the input picture that adjoins from first pixel P1 ' with output image are created each pixel color information of output image, input picture is converted to output image processing explanatory and (b) be the explanatory that produces the pixel P2 ' behind the first pixel P1 '.

Figure 27 is when corresponding two pixels of adjoining in the y direction from input picture are created each pixel color information of output image, converting input picture the explanatory of the processing of output image to, (a) is the explanatory that produces first pixel P1 ' of output image; (b) be the explanatory of the pixel P2 ' behind the generation first pixel P1 '.

Figure 28 is when corresponding 4 pixels of adjoining in x and y direction from input picture are created each pixel color information of output image, converting input picture the explanatory of the processing of output image to according to the output order, a) is the explanatory that produces first pixel P1 ' of output image; (b) be the explanatory of the pixel P2 ' behind the generation first pixel P1 '.

Description of reference numerals

1 screen

2 image projection unit

3 distortion correction unit

The outside lead-out terminal of 3h

3a-3f image input terminal

3g, 3h external input terminals

5 parameter regulation PC

6 operation input blocks

11 signaling mode change-over circuits

13 external equipment control circuits

12 imaging signal processing circuits

15 computing stores

16 table memories

17 signaling mode change-over circuits

18 control signal memories

21 input picture processing blocks

22 image switchings/block

23 images synthesize piece

24 distortion correction pieces

25 output image processing blocks

26 Synchronous Processing pieces

27 conversion tables read/memory block

28 external equipment controll blocks

29 control signals read/memory block

31 spheries

32 cylindricalitys

33 is synthetic

34 mix with spherical

35 mix with cylindricality

36 and planar hybrid

100 input pictures

100 ' output image

Embodiment

Hereinafter, provide description with reference to the accompanying drawings to the embodiment of the invention.

The virtual reality creating system that the present invention is applied to relies on image projection unit 2 projections by output image right and that left-eye image light is synthetic, this image projection unit comprises as two projecting apparatus 2a of projecting cell and 2b, so that projection 3-D view light on screen 1, this screen comprises having the projection plane towards the arbitrary shape on beholder's recessed surface shown in Fig. 1, and can show the image wideer than effective visual angle of beholder, provide virtual reality to the beholder like this.

This virtual reality system comprises the distortion correction unit 3 as image signal processing apparatus, and it is connected to projecting apparatus 2a and 2b, image generator 4 and parameter regulation personal computer 5.Distortion correction unit 3 carries out image signal processing so that proofread and correct caused image fault when throwing image light on the screen of the projection plane with arbitrary shape, and produce output image signal.Parameter regulation personal computer 5 does not need to be connected with distortion correction unit 3 always, only need be connected with distortion correction unit 3 during to distortion correction unit 3 output distortion checking lists, gamma correction table, control signal etc. in following description.

The 1 pair of right side and left-eye image light from projecting apparatus 2a and 2b of screen carries out direct reflection (miror-reflect).The shape of the projection plane of screen 1 is to use hemisphere, cylindricality of spherical calotte etc., and can be the shape that comprises interconnective a plurality of planes.

In order to throw right and left-eye image light, projecting apparatus 2a and 2b 3 receive and export the picture signal that comprises left-eye image signal and eye image signal from the distortion correction unit.These projecting apparatus 2a is connected with two channel image lead-out terminal 3e, 3f of distortion correction unit 3 respectively with 2b.

For example, in order to provide three-dimensional view, be equipped with right and left eye Polarization filter respectively for projecting apparatus 2a and 2b to the beholder; Screen 1 is so-called screen; The beholder puts on and the corresponding polarising glass of Polarization filter.Projector unit does not need to comprise two projecting apparatus.Projector arrangement can be become alternately to throw right and left-eye image light at time division way from an independent projecting apparatus.

Image generator 4 comprises the storage medium of the picture signal that storage projection two dimensional image light is used.Image generator 4 is personal computer, the image playback apparatus such as video cassette recorder and DVD logging machine, video cameras, stereoscopic camera etc.Image generator 4 comprises the lead-out terminal that is used for four passages, they be connected to be used for distortion correction unit 31 to 4 channel image input terminal 3a to 3d.In the example shown in Fig. 1 to 3, show the structure of 4 input channels and 2 output channels.Yet the number of each of input and output passage can be 1.

Parameter regulation personal computer 5 is created and is used for according to the curve form of screen 1 the two dimensional image signal in the distortion correction unit 3 being carried out the distortion correction table of distortion correction, with being used for the two dimensional image signal is carried out the gamma correction table that luminance picture is proofreaied and correct, and table is offered distortion correction unit 3.

Distortion correction table is the corresponding relation mapping between the network model of two-dimensional projection plane and arbitrary shape projection plane.This distortion correction table can be the table of the corresponding distortion correction of the output image pixel input image pixels before after description and the distortion correction, and the amount of movement of each pixel is described, the feasible a plurality of color of pixel information that allow with suitable mixed input picture, and the color of pixel information of establishment output image.In addition, the gamma correction table is a such table, and it has been described in each pixel of the two dimensional image signal before the distortion correction treatment or the output image signal how many times after distortion correction treatment and has been configured to higher brightness.

The distortion correction table of only describing the corresponding relation mapping (correspondence map) between the network model of projection plane of two-dimensional projection plane and arbitrary shape is for example with the pixel coordinate (5 of input picture, 7) pixel coordinate (6,8) with output image interrelates.When 0.3 amount of movement being arranged on the y direction when 0.55 amount of movement being arranged in the x direction, can be from the distortion correction table of the color of pixel information of a plurality of color of pixel information creating output images of input picture for example with the pixel coordinate (5.55 of input picture, 7.3) interrelate with the pixel coordinate (6,8) of output image.

Distortion correction unit 3 comprises the sub-3g of external input terminals, and it is connected to parameter regulation personal computer 5 and receives distortion correction table and the gamma correction table.The processing of creating distortion correction table by parameter regulation personal computer 5 is described in the back.

Parameter regulation personal computer 5 is controlled the operation of projecting apparatus 2a and 2b to distortion correction unit 3 output control signals.This control signal comprises all types of control commands at projecting apparatus 2a and 2b, such as beginning with stop the order of output of image light of projecting apparatus 2a and 2b and the color adaptation of image projection position, picture size, zoom factor, projecting apparatus 2a and 2b.Receive this control signal by distortion correction unit 3, and provide it to projecting apparatus 2a and 2b by the outside lead-out terminal 3h of distortion correction unit 3.

The distortion correction unit 3 that figure 2 illustrates its hardware configuration is included in the signaling mode change-over circuit 11 of image input side, imaging signal processing circuit 12, external equipment control circuit 13, digital signal processor (DSP) 14, computing store 15, table memory 16, at the signaling mode change-over circuit 17 and the control signal memory 18 of image outlet side.Fig. 3 show comprise so functional software structure of the distortion correction unit 3 of hardware configuration, distortion correction unit 3 comprise the synthetic piece 23 of input picture processing block 21, image switching/block 22, image, distortion correction piece 24, output image processing block 25, Synchronous Processing piece 26, conversion table read/memory block 27, external equipment controll block 28, control signal read/memory block 29.

The function of signaling mode change-over circuit 11 is the same with output image processing block 21, its by image input terminal 3a to 3d from image generator 4 the reception images.Signaling mode change-over circuit 11 receives composite signal, separation signal, component signal, digital video signal etc., as the two dimensional image signal from image generator 4.Under the situation of the such structure of the two dimensional image signal that can receive several types, image input terminal 3a is DVI-I terminal, RGB terminal, S terminal, synthetic terminal, D terminal etc. to 3d, and each terminal has the terminal shape of supporting a kind of signaling mode.By allowing to import all types of two dimensional image signals by this way, the type of the two dimensional image signal of input is increased.Receiving under the situation of two dimensional image signal by image input terminal 3a, 3b, 3c or 3d, signaling mode change-over circuit 11 becomes the standard that can be handled by imaging signal processing circuit 12 grades with the system conversion of two dimensional image signal, and outputs it to imaging signal processing circuit 12.

Imaging signal processing circuit 12 comprise with Fig. 3 in image switching/block 22 the same functions image switching/partitioning circuitry, with the visual combiner circuit of image block 23 the same functions, and the image calibrating circuit of distortion correction piece 24 the same functions and with the synchronous processing circuit of Synchronous Processing piece 26 the same functions.This imaging signal processing circuit 12 switches/cuts apart the two dimensional image signal by image switching/block 22 from input picture processing block 21, and the image in the synthetic piece 23 of carries out image is synthetic under the situation of synthetic a plurality of two dimensional image signals, and provide it to distortion correction piece 24.

Read/distortion correction table in the memory block 27 with reference to being stored in conversion table in advance, distortion correction piece 24 individual elements are carried out coordinate transform the two dimensional image conversion of signals are become output image signal, are used for distortion correction treatment.In addition, read/gamma correction table in the memory block 27 with reference to being stored in conversion table in advance, the brightness value that distortion correction piece 24 changes each pixel becomes output image signal with the two dimensional image conversion of signals, is used for gamma correction and handles.In addition, distortion correction piece 24 can be by reference described amount of movement of distortion correction table in the coordinate transform of distortion correction treatment, based on a plurality of color of pixel information of the input picture relevant, create each color of pixel information of output image with the pixel of output image.In distortion correction treatment and gamma correction processing, imaging signal processing circuit 12 (distortion correction piece 24) uses computing store 15 as the service area.

The distortion correction treatment of being undertaken by distortion correction piece 24 is used for distortion correction with pixel a ', b ' and c ' that pixel a, b and the c of the two dimensional image signal shown in Fig. 4 (a) converts the output image shown in Fig. 4 (b) to.This output image signal 100 ' be is according to the result of the coordinate transform that network model carried out of the screen 1 of the projection plane with arbitrary shape.

The gamma correction table of the output image signal after supporting distortion correction treatment be stored in conversion table read/memory block 27 in the time, the gamma correction processing of being undertaken by distortion correction piece 24 is processing shown in Figure 5.Particularly, the two dimensional image signal 100 that at first Fig. 5 (a) is illustrated carry out gamma corrections handle produce two dimensional image signal 100 ', then, to two dimensional image signal 100 ' execution distortion correction treatment.

The gamma correction table of the two dimensional image signal before supporting distortion correction treatment be stored in conversion table read/storage area 27 in the time, it is processing shown in Figure 6 that gamma correction is handled.Particularly, the two dimensional image signal 100 that the conduct that Fig. 6 (b) illustrates illustrates Fig. 6 (a) carry out the result's of distortion correction treatment output image signal 100 ' in, the brightness of pixel a ', b ' and c ' is changed respectively after the distortion correction, to obtain new pixel a after gamma correction shown in Fig. 6 (c) ", b " and c ".With reference to the amount of movement of describing in the distortion correction table, based on a plurality of color of pixel information of the input picture relevant with the pixel of output image, the distortion correction treatment of distortion correction piece 24 is created the color of pixel information of output image in the Coordinate Conversion of coordinate distortion correction treatment.Will be described later the details of distortion correction treatment, this distortion correction treatment comprises and is used for carrying out interpolation and creates the information processing of output image color of pixel.

The output image signal that has been carried out distortion and gamma correction processing by distortion correction piece 24 is sent to output image processing block 25 (signaling mode change-over circuit 17), and offers projecting apparatus 2a and 2b from output image processing block 25.At this moment, output image processing block 25 (signaling mode change-over circuit 17) converts output image signal to allow projecting apparatus 2a and 2b projected image signaling mode, and with its output.Sub-3e of output end of image and 3d are DVI-I terminal, RGB terminal etc., and they have the terminal shape of the standard of supporting output image signal.

In distortion correction unit 3, in order to allow each piece to carry out real-time operation, the transmission of the picture signal of the processing timing of Synchronous Processing piece 26 control chart image signals and input picture processing block 21, image switching/block 22, image synthetic piece 23, distortion correction piece 24 and output image processing block 25 regularly.In distortion correction unit 3, by the software processes of digital signal processor 14 control imaging signal processing circuits 12.

In addition, in distortion correction unit 3, control signal reads/memory block 29 receives and storage provides from parameter regulation personal computer 5 control signal, and external equipment control circuit 13 (external equipment controll block 28) rightly from control signal read/memory block 29 selects control signals and sends the control signal of selecting to projecting apparatus 2a and 2b by outside lead-out terminal 3h.Can send to the control signal of projecting apparatus 2a and 2b from external equipment controll block 28 output distortion correcting units 3 as shown in Figure 3, respond such as the button of operating by the user or the operator input signal of the operation input unit 6 the remote controller.This allows user to control projecting apparatus 2a and 2b, switches simultaneously to be stored in control signal and to read/control signal in the memory block 29.

As mentioned above, utilize distortion correction unit 3, by read at conversion table in advance/memory block 27 in storage distortion and gamma correction table, and when when projecting apparatus 2a and 2b project screen 1 with image light at the two dimensional image signal performed distortion and gamma correction carry out two-dimensional coordinate conversion and brightness transition handling, create output image signal, and do not need three-dimensional process.Particularly, the parameter regulation personal computer 5 that provides by the outside produces the relationship expression that distortion correction is used, and the result of the parameter regulation personal computer that will therefore obtain imports as distortion correction table.Therefore, in distortion correction unit 3, only can carry out distortion correction, and not need three-dimensional computations by two-dimentional calculating.Therefore, according to distortion correction unit 3, utilize simple structure just can realize reducing the processing of the distortion of the image that the beholder sees in real time.

In addition,, can both carry out above-mentioned processing, thereby reduce restriction the input picture kind for dissimilar picture signals according to this distortion correction unit 3.

In addition, distortion correction unit 3 is configured to side by side receive a plurality of two dimensional image signals and side by side exports a plurality of picture signals.When side by side receiving a plurality of two dimensional image signal, imaging signal processing circuit 12 can be selected some in a plurality of two dimensional image signals and carry out distortion correction at these signals, so that output image information is outputed to signaling mode change-over circuit 17.Can produce and export a plurality of two dimensional image signals from signaling mode change-over circuit 17.The condition of the output image signal of selecting to export to signaling mode change-over circuit 17 is set from a plurality of two dimensional image signals by parameter regulation personal computer 5.In addition, expectation carries out image size redefines operation, so that with the assimilations such as picture size of a plurality of two dimensional image signals.

In addition, when side by side importing a plurality of two dimensional image signal, by the Synchronous Processing piece 26 that constitutes by DSP14 can with a plurality of two dimensional image signals with handle regularly synchronously.This can use two projecting apparatus 2a and 2b that three-dimensional view is provided.

In addition, use a plurality of two dimensional image signals, by a plurality of two dimensional image signals are combined with difference (disparity) between them, the above-mentioned imaging signal processing circuit of mentioning 12 can produce difference two dimensional image signal.Under the situation of three passages input, utilize the difference between the two dimensional image signal of the two dimensional image signal of passage 3 and passage 1 and 2, can be with the two dimensional image signal of passage 3 and the two dimensional image signal combination of passage 1 and 2.Under the situation of 4 passage inputs, difference between the two dimensional image signal by utilizing passage 3 and the two dimensional image signal of passage 1 combines the two dimensional image signal of passage 3 with the two dimensional image signal of passage 1, and utilizes difference between the two dimensional image signal of the two dimensional image signal of passage 4 and passage 1 that the two dimensional image signal of passage 4 is combined with the two dimensional image signal of passage 1 to produce difference two dimensional image signal.Can the condition that produce in the difference two dimensional image signal processing be set by parameter regulation personal computer 5, and such being provided with can show undistorted stereo-picture on screen 1.

The ensuing processing that is described in parameter regulation personal computer 5 establishment distortion correction table in the virtual reality creating system that disposes as mentioned above.

Parameter regulation personal computer 5 comprises that mainly screen mould establishment piece, projector arrangement/installation (setup) piece, customer location are provided with piece, have the function as the table establishment/IOB relevant with distortion correction table.Screen mould has been shown among Fig. 7 has created the network model that piece is created screen 1.This screen mould is created three basic models of piece initial storage, and they are spherical model 31, cylindricality model 32 and mixed model 33.Mixed model 33 comprises, mainly the spherical mixed model 34 that is made of the sphere of mixing with other plane or curved surface, the main cylindricality mixed model 35 that is made of the cylindricality of mixing with other plane or curved surface reach the planar hybrid model 36 that mainly is made of the plane of mixing with other plane or curved surface.For in model 31,32 and 34 to 36 each, select any one in these models, and with input parameter 31a, 32a and 34a to the 36a input, so that create the network model 31b, the 32b that are fit to actual screen 1 and 34b respectively to 36b.The basic model that is stored in the screen mould establishment piece is not limited to the model 31 to 33 shown in Fig. 7, except model 31 to 33, also model of ellipse may be set, rectangular model etc., and carry out the input of input parameter and the establishment of network model.Therefore, can create such distortion correction table: it can not cause the image fault that projects on the screen 1, even screen 1 is the combination of ellipse, rectangle or ellipse and rectangle.

Be basic model and input parameter below.

As shown in Figure 8, when screen 1 was spherical surface (a spherical part), input parameter was the radius R of spherical model and the distance A in spherical model central point and cross section.

Here, by the The Representation Equation spherical model.

x ²+ y ²+ z ²=R ²(equation 1)

Here, A＜=x＜=R ,-y1＜=y＜=y1, and-z1＜=z＜=z1.By x=A and z=0 substitution equation 1, obtain y1; And, obtain z1, as a result y1=z1 by x=A and y=0 substitution equation.Therefore, when screen 1 is aforesaid spherical surface,, only need to import the distance A of the central point of the radius R of spherical model and spherical model to the cross section as the input parameter of parameter regulation personal computer 5.

Illustrate as Figure 10, when the shape of the screen of seeing from front view 1 be from left and right, when the spherical screen of a part of spherical screen has been cut to inside in any end of top and bottom, the following screen 1 corresponding spherical model that is shown in.For example, shown in Figure 10 (a), when screen 1 is during from spherical screen that the end of bottom is cut, to be shown in screen 1 corresponding spherical model with equation 1 in front view, as shown in Figure 9, and A＜=x＜=R ,-B＜=y＜=y1, and-z1＜=z＜=z1.By x=A and z=0 substitution equation 1, obtain y1; By x=A and y=0 substitution equation 1, obtain z1; By y=-B and z=0 substitution equation 1, obtain x1.Therefore, as the situation of the screen 1 of above-mentioned description in, as the input parameter of parameter regulation personal computer 5, only need to import the radius R of spherical model, the central point of spherical model and the distance A in cross section, and between the cutting position of spherical model central point and spherical screen apart from B.

In a similar fashion, when screen 1 be shown in Figure 10 (b), Figure 10 (c), Figure 10 (d) like that from when screen 1 be the end of top, a left side and right-hand member from front view be cut spherical screen the time, each spherical model of following expression.Shown in Figure 10 (b), from the situation of the end cut spherical screen on top, spherical model is represented with equation 1, A＜=x＜=R, and-y＜=y＜=B, and-z1＜=z＜=z1.Shown in Figure 10 (c), from the situation of the end cut spherical screen of right-hand member, spherical model is represented with equation 1, A＜=x＜=R, and-y＜=y＜=y1, and-z1＜=z＜=B.Shown in Figure 10 (d), under the situation of the end cut spherical screen of left end, spherical model is represented with equation 1, A＜=x＜=R, and-y＜=y＜=y1, and-B＜=z＜=z1.Therefore,, only need to import the radius R of spherical model, the central point of spherical model and the distance A in cross section as the input parameter of parameter regulation personal computer 5, and between the cutting position of spherical model central point and spherical screen apart from B.In addition, if increase the quantity of the input parameter of parameter regulation personal computer 5, parameter regulation personal computer 5 can be created the screen mould of the screen of the combination that comprises two or more cutting positions.

On the other hand, when screen 1 is when having cut cylindrical arc screen, screen mould is represented with cylindrical model as shown in figure 11.Circumference by the cylindrical model on the cross section on x-y plane shown in equation 2 expression Figure 11.

x ²+ z ²=R ²(equation 2)

Here, by using such restriction A＜=x＜=R, 0＜=y＜=H and-z＜=z＜=z1 obtains the equation of cylindricality mold surface.Therefore, the input parameter of parameter regulation personal computer 5 is radius of a circle R (radius R of arc screen), the central point of circle and the distance A and the height H (height of arc screen) in cross section.

In addition, Figure 12 (a) shows the situation of the screen 1 with projection plane of being made up of a plurality of planes (comprising a plurality of rectangle planes).In this case, the input parameter of parameter regulation personal computer 5 is surface location and the surperficial height in the top view shown in Figure 12 (b).In the situation of Figure 12 (b),

Z=-x+1 (0＜=x＜1) (equation 3-1)

Z=0 (1＜=x＜3) (equation 3-2)

Z=x-3 (3＜=x＜4) (equation 3-3)

0＜y＜=H (equation 3-4)

In addition, at screen 1 is by a plurality of spherical surfaces, in the situation that the spherical surface that for example a plurality of levels are arranged constitutes, similar with the example shown in Fig. 8 to 9, the output parameter that only needs parameter regulation personal computer 5 is radius R, to the distance A in cross section, to the quantity of the spherical surface of arranging apart from B and level of cutting position.Particularly, for example, can realize comprising the screen 1 of the spherical screen of two vertical arrangement in conjunction with Figure 10 (a) and 10 (b), same, can realize comprising the screen 1 of the spherical screen of two vertical arrangement in conjunction with Figure 10 (a) and 10 (b).Therefore, should be appreciated that, as mentioned above,, only need to import radius R, to the distance A in cross section, to the quantity of the spherical surface of arranging apart from B and level of cutting position as the input parameter of parameter regulation personal computer 5.

In the situation that screen 1 is made of a plurality of peripheries,, only need to import the height H on surface, the radius R of screen 1 each part and the quantity on distance A and surface except the top view of arranging.Determine the function expression of the projection plane of screen 1 in this mode, by give the suitable value of x, y, z substitution and write down some on the screen 1 or more point as sampled point, can specify the shape of the projection plane of screen 1.In screen mould is created piece, stored the function expression of projection plane of the screen 1 of each type in each in the model 31,32 and 34 to 36 in advance, and these function expressions can be called so that distortion correction table is set.Only by the input above-mentioned parameter, as input parameter 31a, 32a, 34a is to 36a, and network model 31b, 32b that can be fit to by screen 1 establishment that parameter regulation personal computer 5 is respectively actual and 34b are to 36b.

Can be around x, y, the sampled point of the projection plane of z axle Rotation screen 1 (screen 1 can be defined as inclination).

Particularly, rotate the alpha angle by equation 4 expressions around the x axle.

$\left(\begin{array}{c}X\\ Y\\ Z\end{array}\right)=\left(\begin{array}{ccc}1& 0& 0\\ 0& \cos \mathrm{\α}& -\sin \mathrm{\α}\\ 0& \sin \mathrm{\α}& \cos \mathrm{\α}\end{array}\right)\left(\begin{array}{c}X\\ Y\\ Z\end{array}\right)$ (equation 4)

In addition, rotate the beta angle by equation 5 expressions around the y axle.

$\left(\begin{array}{c}X\\ Y\\ Z\end{array}\right)=\left(\begin{array}{ccc}\cos \mathrm{\β}& 0& \sin \mathrm{\β}\\ 0& 1& 0\\ -\sin \mathrm{\β}& 0& \cos \mathrm{\β}\end{array}\right)\left(\begin{array}{c}X\\ Y\\ Z\end{array}\right)$ (equation 5)

In addition, rotate the gamma angle by equation 6 expressions around the z axle.

$\left(\begin{array}{c}X\\ Y\\ Z\end{array}\right)=\left(\begin{array}{ccc}\cos \mathrm{\γ}& -\sin \mathrm{\γ}& 0\\ \sin \mathrm{\γ}& \cos \mathrm{\γ}& 0\\ 0& 0& 1\end{array}\right)\left(\begin{array}{c}X\\ Y\\ Z\end{array}\right)$ (equation 6)

Parameter regulation personal computer 5 is created the corresponding relation mapping, the sampled point that is obtained on the projection plane of this corresponding relation mapping with screen 1 is mapped to each sampled point to the two dimensional image signal of distortion correction unit 3 inputs, allows distortion correction unit 3 to carry out distortion correction treatment like this.The pixel of distributing this two dimensional image signal for each respective pixel in the distortion correction table produces the output image signal through distortion correction treatment thus.

In case the shape of the projection plane of the screen 1 that determine to use, and imported the parameter of parameter regulation personal computer 5 so that create distortion correction table when not having parameter etc. to change, does not need to revise distortion correction table.Therefore, distortion correction table is offered distortion correction unit 3, and it is stored in the distortion correction unit 3.

Using description that accompanying drawing 8 to 12 carried out above is about impelling distortion correction unit 3 to carry out distortion correction treatment at the shape of the projection plane of as shown in figure 13 screen.Particularly, project spherical screen 1, and do not change, then show the distorted image shown in Figure 13 (a) if will be used for the two dimensional image signal on two-dimensional projection plane.Therefore, produce shown in Figure 13 (b) in advance by the output image signal of distortion, so that the image that is incident upon on the spherical screen 1 does not comprise distortion.Yet because the variation of the position of the relative screen 1 with 2b of projecting apparatus 2a, the cause of the variation of the relative screen 1 in beholder position etc. needs further distortion correction.Therefore, can carry out such correction to the distortion correction table that is as above obtained.

Describe below at projecting apparatus 2a and 2b and beholder and relative position with the screen on globular projection plane and change the processing of creating distortion correction table.In response to input, carry out these processing by parameter regulation personal computer 5 from projector arrangement/mounting blocks and customer location setting piece.

Figure 14 is a view of explaining aberration emendation method, and except above-mentioned spherical the correction, this aberration emendation method also comprises the correction to projecting apparatus 2a and 2b and beholder position.At first for correction, as shown in figure 14, respectively based on beholder's viewing location and the projected position of projecting apparatus 2a and 2b, frustum (frustum) and image projection frustum are watched in definition.Represent to watch frustum by quadrangular pyramid, wherein the summit at P0 as viewing location, and by P0,0, Pm, n, Pm, 0 defines its bottom surface.The projection frustum is expressed as: the summit is at 0 place, as projecting apparatus back focus position, and by Q0,0, Qm, 0, Qm, n and Q0, n defines the bottom surface.Here, when picture signal is during such as SXGA, m and n represent to be respectively 1279 and 1023 image resolution ratio respectively.The bottom surface is called as the virtual screen face.

Here, for easy statement, Figure 15 shows the image of being seen from the y-z two-dimensional section at the m=i place.At first, postulated point Pi, j in virtual screen face 1a, compute vector P0Pi, the common factor Ri of the screen 1 of j and dome ( network model 31b, 32b, 34b are to 36b), j.Because i and j change in 0＜=i＜=m and 0＜=j＜=n, can create Pi, j-＞Qi, the mapping of j corresponding relation.This corresponding relation mapping is used for the anti-correction to image fault.

Particularly, by realizing distortion correction based on watching frustum execution normal picture to produce; Then, obtain the data of this image and use Pi, j-＞Qi, the j corresponding relation shines upon the data that the texture mapping coordinate are applied to this image, is used for producing once more image.Figure 16 shows by Pi, j-＞Qi, the image that grid constituted (it is the counter-rotating of Figure 13 (b)) that the mapping of j corresponding relation is applied to.Distortion correction treatment to the shape of the projection plane of screen 1 without limits.Therefore, among the spherical network model 31b that describes before distortion correction treatment not only can be applied to, and can be applied to other network model 32b, 34b in 36b etc.

As mentioned above, by using distortion correction table at the distortion correction treatment of being undertaken by parameter regulation personal computer 5, can carry out distortion correction treatment continuously at the two dimensional image signal that is used for two-dimensional display surface simultaneously with image from projecting apparatus 2a and 3b projects images light.

Describe below with reference to the amount of movement of describing in the distortion correction table, in the coordinate transform of distortion correction treatment, create output image color of pixel information processing (colouring information interpolation distortion correction treatment) based on the colouring information of the input image pixels relevant with the pixel of output image.This colouring information interpolation distortion correction treatment must not carried out.Yet colouring information interpolation distortion correction treatment can provide the output image of the sawtooth that lacks than acquisition output image when only carrying out distortion correction treatment.

When the two dimensional image conversion of signals being output image signal according to distortion correction table execution distortion correction treatment, distortion correction piece 24 mixes a plurality of color of pixel information before the conversion in proportion, and this ratio is corresponding to the amount of movement of representative picture element after from the representative pixel points before the conversion of carrying out according to distortion correction table to conversion.Then, distortion correction table produces output image signal, and this signal has the blend color information as the color of pixel information after each pixel transitions.Particularly, distortion correction piece 24 or produce output image signal by first process or by second process.First process is at least two locations of pixels of adjoining with respect to X-direction according to the representative pixel points after the conversion, mixes these at least two color of pixel information that the preceding X-direction of conversion is adjoined.Second process is at least two locations of pixels of adjoining with respect to Y direction according to the representative pixel points after the conversion, mixes these at least two color of pixel information that the preceding Y direction of conversion is adjoined.

Here, the corresponding relation mapping that the sampled point on the projection plane of screen 1 is mapped to two dimensional image signals sampling point be stored in advance conversion table read/memory block 27 in, as distortion correction table.In distortion correction table, the pixel of two dimensional image signal is distributed in the process of corresponding pixel, output image when the pixel of two dimensional image signal is associated with the pixel of output image signal after the conversion shows stepped inhomogeneous color sometimes, or so-called sawtooth.This be since each pixel according to image resolution ratio and definite clear and definite (definite) size, this has caused (rounding) the corresponding error that rounds off to coordinate position.Since the representative pixel points before the conversion, the center of pixel for example, and rounding error has appearred in the position corresponding to the pixel after conversion departs from.Therefore, the colouring information that uses adjacent pixels in the two dimensional image signal is according to the corresponding ratio of amount of movement the colouring information of output image signal being carried out interpolation.Therefore can reduce the sawtooth that occurs in the output image signal.

For example, with two dimensional image signal (hereinafter claiming input picture 100) pixel P1 that the x direction is adjoined and P2 convert to output image signal (hereinafter claim output image 100 ') pixel P1 ' and with input picture 100 pixel P3 that the x direction is adjoined and P4 convert to output image 100 ' the process of pixel P2 ' in, as shown in figure 17, having on the x direction under the mobile situation, pixel P1 that use is adjoined in the x direction and the colouring information of P2 create output image 100 ' the colouring information of pixel P1 ', use the colouring information of the pixel P3 that adjoins in the x direction and P4 create output image 100 ' the colouring information of pixel P2 '.

By more than or equal to 0 less than the amount of movement DELTAx on 1 the value representation x direction, 0 or 1 amount of movement represents that any one representative locations of the representative pixels position of input signal and adjacent pixels is complementary.Particularly, two pixel transitions that input picture 100 is adjoined on the x direction become output image 100 ' the process of single pixel in, when input picture 100 and output image 100 ' between when amount of movement DELTAx is arranged, as shown in figure 18, pixel P (x, colouring information y) and adjacent pixels P2 (x+1, colouring information y) in the average input picture 100 of the ratio of 1-DELTAx/DELTAx, obtain virtual pixel P (x+DELTAx, colouring information C y) _{X+DELTAx, y}=C _{X, y}(1-DELTAx)+C _{X+1, y}DELTAx.Shown in Figure 18 (b), can obtain following and virtual input pixel (x+DELTAx, y) output image 100 after the corresponding conversion ' pixel P ' (u, colouring information v):

C _x+DELTAx，y＝C _x，y(1-DELTAx)+C _x+1，yDELTAx

By this way, for input picture 100 on the x direction and output image 100 ' between have two pixels using when mobile on the x direction carry out colouring information interpolation distortion correction treatment produce output image 100 ', distortion correction unit 3 reads at conversion table in advance/memory block 27 in storage comprise distortion correction table to the description of amount of movement.Illustrate as Figure 17, distortion correction piece 24 from two pixels of input picture 100 on the x direction produce output images 100 ' each pixel P1 ' and P2 '.Therefore, according to two color of pixel information of input picture 100 with which kind of ratio influence output image 100 ' pixel color information, calculate output image 100 ' pixel.

Here, suppose with output image 100 ' pixel (u, (x y) has moved DELTAx to the pixel of v) corresponding input picture 100 from pixel.Be pre-created distortion correction table so that comprise description to amount of movement, this describe indication output image 100 ' pixel (u, v) corresponding to the virtual pixel of input picture 100 (x+DELTAx, y).Therefore, distortion correction piece 24 can by the mixed pixel of (1-DELTAx)/DELTAx (x, y) and (x+1, colouring information y) so that by following equation calculate output image 100 ' pixel (u, colouring information C v) _{U, v}:

C _u，v＝C _x，y(1-DELTAx)+C _x+1，yDELTAx

As shown in figure 19, with input picture 100 pixel P1 ' that pixel P1 that the y direction is adjoined and P2 convert output image 100 to and with input picture 100 pixel P3 that the y direction is adjoined and P4 convert to output image 100 ' the process of pixel P2 ' in, when having in the y direction when mobile, pixel P1 that use is adjoined in the y direction and the colouring information of P2 create output image 100 ' the colouring information of pixel P1 ', use the colouring information of the pixel P3 that adjoins in the y direction and P4 create output image 100 ' the colouring information of pixel P2 '.

By more than or equal to 0 less than the amount of movement DELTAy on 1 the value representation y direction, 0 or 1 amount of movement represents that the representative locations of pixel of input signal and the representative locations of any one adjacent pixels are complementary.Particularly, two pixel transitions of the input picture 100 that on the y direction, adjoins become output image 100 ' the process of single pixel in, when input picture 100 and output image 100 ' between when amount of movement DELTAy is arranged, shown in Figure 20 (a), pixel P (x, colouring information y) and adjacent pixels P2 (x, colouring information y+1) in the average input picture 100 of the ratio of 1-DELTAy/DELTAy, obtain virtual pixel P (x, colouring information C y+DELTAy) _{X, y+DELTAy}=C _{X, y}(1-DELTAy)+C _{X, y+1}DELTAy.Shown in Figure 20 (b), can obtain with virtual input pixel (x, y+DELTAy) output image 100 after the corresponding conversion ' pixel P ' (u, colouring information v):

C _x，y+DELTAy＝C _x，y(1-DELTAx)+C _x，y+1DELTAy

By this way, for input picture 100 and output image 100 ' between on the y direction, have when mobile by use two pixels on the y direction carry out colouring information interpolation distortion correction treatment produce output image 100 ', distortion correction unit 3 reads at conversion table in advance/memory block 27 in storage comprise the distortion correction table that amount of movement is described.As shown in figure 19, two pixels of distortion correction piece 24 on the y direction of input picture 100 produce output images 100 ' each pixel P1 ' and P2 '.Therefore, about two pixels of input picture 100 and output image 100 ' pixel, according to two color of pixel information of input picture 100 with which kind of scale effect output image 100 ' pixel color information, calculate output image 100 ' color of pixel information.

Here, suppose with output image 100 ' pixel (u, (x y) has moved DELTAy to the pixel of v) corresponding input picture 100 from pixel.Be pre-created distortion correction table so that comprise description to amount of movement, this describe indication output image 100 ' pixel (u, v) corresponding to the virtual pixel of input picture 100 (x, y+DELTAy).Therefore, distortion correction piece 24 can by the mixed pixel of (1-DELTAy)/DELTAy (x, y) and (x+1, colouring information y) so that by following equation calculate output image 100 ' pixel (u, colouring information C v) _{U, v}:

C _u，v＝C _x，y(1-DELTAy)+C _x+1，yDELTAy

In addition, as shown in figure 21, the pixel P1 that the x and the y direction of input picture 100 are adjoined convert to P4 output image 100 ' pixel P1 ' and the pixel P5 that the x and the y direction of input picture 100 are adjoined converted to P8 output image 100 ' the process of pixel P2 ' in, all have under the mobile situation in the x and y direction, the pixel P1 that use is adjoined in the y direction to the colouring information of P4 create output image 100 ' the colouring information of pixel P1 ', use pixel P5 that x and y direction adjoin to the colouring information establishment output image 100 of P8 ' the colouring information of pixel P2 '.

Shown in Figure 22 (a), 4 pixel transitions of will adjoin on the x of input picture 100 and the y direction become output image 100 ' the process of single pixel in, when respectively mobile DELTAx and DELTAy being arranged in the x and y direction, according to (1-DELTAx) (1-DELTAy)/ratio of DELTAx (1-DELTAy)/(1-DELTAx) DELTAy/DELTAxDELTAy, pixel P1 (the x of average input picture, y) colouring information, pixel P2 (x+1, y) colouring information, pixel P3 (x, y+1) colouring information and pixel P4 (x+1, y+1) colouring information.Can obtain colouring information C _{X+DELTAx, y+DELTAy}=C _{X, y}(1-DELTAx) (1-DELTAy)+C _{X+1, y}DELTAx (1-DELTAy)+C _{X, y+1}(1-DELTAx) DELTAy+C _{X+1, y+1}DELTAxDELTAy, it is the mixing of 4 pixels, shown in Figure 22 (b), and can following acquisition and virtual input pixel (x+DELTAx, y+DELTAy) corresponding output image 100 ' pixel P ' (u, v) colouring information: C _{X+DELTAx, y+ DELTAy}=C _{X, y}(1-DELTAx) (1-DELTAy)+C _{X+1, y}DELTAx (1-DELTAy)+C _{X, y+1}(1-DELTAx) DELTAy+C _{X+1, y+1}DELTAxDELTAy.

By this way, for input picture 100 and output image 100 ' between have in the x and y direction when mobile by use two pixels on x and each direction of y carry out the new interpolation distortion correction treatment of color produce output image 100 ', virtual reality creating system reads at conversion table in advance/memory block 27 in storage comprise distortion correction table to the description of amount of movement.As shown in figure 21, distortion correction piece 24 from input picture 100 4 pixels in the x and y direction produce output images 100 ' each pixel P1 ' and P2 '.Therefore, use the pixel color information of input picture 100 and output image 100 ' pixel, according to 4 pixel color information of input picture 100 with which kind of scale effect output image 100 ' pixel color information, calculate output image 100 ' colouring information.

Here, suppose with output image 100 ' pixel (u, (x y) has moved DELTAx and DELTAy to the pixel of v) corresponding input picture 100 from pixel.Be pre-created distortion correction table so that comprise description to amount of movement, this describe indication output image 100 ' pixel (u, v) corresponding to the virtual pixel of input picture 100 (x+DELTAx, y+DELTAy).Therefore, distortion correction piece 24 can by (1-DELTAx) (1-DELTAy)/the mixed pixel (x of DELTAx (1-DELTAy)/(1-DELTAx) DELTAy/DELTAxDELTAy, y), (x+1, y), (x, y+1) and (x+1, y+1) colouring information, so as by following equation calculate output image 100 ' pixel (u, colouring information C v) _{U, v}:

C _{x+DELTAx，y+DELTAy}＝C _x，y(1-DELTAx)(1-DELTAy)+C _x+1，yDELTAx(1-DELTAy)+C _x，y+1(1-DELTAx)DELTAy+C _x+1，y+1DELTAxDELTAy

Be formed for the distortion correction table of colouring information interpolation distortion correction treatment as the amount of movement of each pixel of the pixel (being no less than 2) of the input picture of interpolation target and output image by storage.These amount of movements are according to distortion correction table, by the location of pixels x of coordinate transform acquisition and the fractional part (fraction) of y coordinate.Output image 100 ' certain pixel P (u is the pixel of the input picture 100 of integer corresponding to x and y coordinate usually v), such as (10,5).Yet, consider output image 100 ' certain pixel P (u, v) overlapping with 2 to 4 pixels of input picture 100, output image 100 ' certain pixel corresponding to the pixel (10.3 of input picture 100,5.55) situation under, used moving of virtual reality creating system of the present invention hypothesis fractional part, such as in x direction 0.3 pixel with in y direction 0.55 pixel.For only use two pixels of adjoining in x or y direction create output images 100 ' colouring information, only need in distortion correction table, be stored in any one of amount of movement on x or the y direction.

Amount of movement in the distortion correction table can by as above-mentioned (10.3,5.55) represent, or only by as the fractional part of (0.3,0.55) represent.In addition, 0 to 100 the integer that utilizes 10 times of decimal integers 0 to 9 that move positions or decimal 100 times to move 2 positions is described the amount of movement in the distortion correction table.In this case, amount of movement is used in the colouring information interpolation distortion correction treatment divided by 10 or 100.This has eliminated the information of being represented by fractional value in the distortion correction table, allows distortion correction table only to comprise the information of integer representation like this.In addition, under the situation about representing with radix n, carry out the processing of the distortion correction unit of realizing colouring information interpolation distortion correction treatment,, can arrive n with 0 for colouring information interpolation distortion correction treatment ^r-1 value is described amount of movement and amount of movement divided by n ^rIn such situation, for colouring information interpolation distortion correction treatment, with 0 to n ^rThe amount of movement that-1 value is described (radix n) only needs the r position that moves right.For example, using binary value to carry out in the situation of processing of distortion correction unit 3, with 1 to 15 (2 ⁴-1) describes amount of movement and its divided by 16, be used in colouring information interpolation distortion correction treatment.Processing divided by 16 is exactly only to move right 4.R can be 8 (2 ⁴), 32 (2 ⁵), etc.

When by integer 1 to 9 or 0 to 100 expression amount of movement, or for the binary system of distortion correction unit 3 handles during by 0 to 16 expression amount of movement, its accuracy is respectively 0.1,0.01 and 1/16.Yet, be used for the figure place of amount of movement in round figures much smaller than the figure place that is used for the fractional representation amount of movement, reduced the data volume in the distortion correction table like this.In addition, by showing amount of movement according to the radix n numerical table of handling by distortion correction unit 3, may only comprise information, and not comprise information by the medium and small numeric representation of distortion correction table by integer representation, and make equally treating capacity less than require with the amount of movement of integer by 10 or 100 treating capacities of removing.

As above-mentioned description, according to having used virtual reality creating system of the present invention, carry out distortion correction treatment according to distortion correction table, use with output image 100 ' the corresponding input picture 100 of each pixel at least two pixels in the x and y direction, calculate output image 100 after the conversion ' the Pixel Information (colouring information) of each pixel.Therefore, the smoothly change of the colouring information between the adjacent pixels of output image 100 ' interior and reduce sawtooth.

Basic is contemplated to be, and 4 pixels using input picture 100 to adjoin are in the x and y direction carried out colouring information interpolation distortion correction treatment.Yet, according to the picture pattern that is presented on the screen, even use two pixels on x and any one direction of y direction, adjoining calculate output images 100 ' colouring information, also can suppress the generation of sawtooth.For example, on screen 1 projection be included in vertical extent in the image and the situation of the image on the hurdle erect side by side under, do not need to use two pixels of on the y direction, adjoining create output images 100 ' colouring information.On the other hand, projection is included in the image under horizontally extending the situation of image on screen 1, do not need to use two pixels of on the x direction, adjoining create output images 100 ' colouring information.In addition, when projection on screen 1 comprises the image of lattice, or even use the pixel color of on any one direction of x and y direction, adjoining create output image 100 ' colouring information, sawtooth that also can generating period.

In use comprises colouring information interpolation distortion correction treatment to the above-mentioned distortion correction table of the description of amount of movement, can use the primary colour signal such as RGB (red, green and blue) and CMY (blue or green, fuchsin and Huang), as input and output image 100 and 100 ' colouring information.In this case, independently use same processing method to mix the colouring information of the adjacent pixels of input picture 100 by each primary colours to R (red component), G (green component) and B (blue component) signal or C (blue or green component), M (fuchsin component) and Y (yellow component) signal, distortion correction piece 24 create output images 100 ' colouring information.The colouring information of being represented by three primary colours (especially RGB) has the color showing system that meets computer graphic image and gives projecting apparatus 2a and 2b output output image 100 ' advantage, provide so the output image 100 that almost do not have sawtooth '.In addition, for each primary colours can create concurrently output image 100 ' colouring information.This has quickened colouring information interpolation distortion correction treatment.In addition, except the three primary colors of RGB are carried out the parallel processing of similar fashion, carry out the distortion of colouring information interpolation by the alpha value of using transparency and handle, can create output image 100 ' colouring information.

In addition, in use comprises colouring information interpolation distortion correction treatment to the above-mentioned distortion correction table of the description of amount of movement, input and output image 100 and 100 ' colouring information can be to comprise monochrome information (Y) and colour difference information U (between luminance signal and the blue component poor) and V (between luminance signal and the red component poor), such as YUV (YCbCr).In this case, distortion correction piece 24 is by using identical processing method to monochrome information with colour difference information respectively, the colouring information that mixes the adjacent pixels of input picture 100 create output image 100 ' colouring information.Therefore, can according to meet output image 100 ' color showing method carry out colouring information interpolation distortion correction treatment.In addition, use is to the monochrome information sensitivity but to the insensitive human vision feature of colour difference information, only use the monochrome information of input picture 100 carry out colouring information interpolation distortion correction treatment calculate output image 100 ' monochrome information, use the colour difference information of some pixels of each group pixel to carry out colouring information interpolation distortion correction treatment simultaneously, quickened the distortion correction of capable colouring information interpolation like this.For example, as for monochrome information, 4 pixels on x and the y direction create output images 100 ' monochrome information, only use two diagonal angle pixels between 4 pixels create output images 100 ' colour difference information.

The operation of virtual reality creating system when describing the distortion correction table that comprises the description of the amount of movement that is used for above-mentioned colouring information interpolation distortion correction treatment according to the input order of input picture 100 is described below.

Through the synthetic piece 23 of input picture processing block 21, image switching/block 22 and image, input picture 100 is input to image input terminal 3a to 3d and offer distortion correction piece 24 as the processing target of colouring information interpolation distortion correction treatment.Usually, follow the scan line of input picture 100 to continue to provide these data to distortion correction piece 24.

When carrying out colouring information interpolation distortion correction treatment according to the input order of the pixel of input picture 100, distortion correction unit 3 reads at conversion table/stored distortion correction table in advance in the memory block 27, and this distortion correction table has been described the coordinate of output image 100 ' middle pixel after the conversion relevant with the coordinate of each pixel of input picture according to input order.Create distortion correction table by parameter regulation personal computer 5.Distortion correction table has been described the amount of movement that is used for colouring information interpolation distortion correction treatment equally.

As shown in the input picture of Figure 23 (a) and 23 (b), creating under the situation of pixel color information of output image 100 with the pixel of the order of P1, P2, P3... input input picture 100 and by mixing two color of pixel information that input picture 100 adjoining on the x direction, when reading preceding two pixel P1 and P2, distortion correction piece 24 at first calculate the output image 100 that uses two pixel P1 and P2 just can calculate ' all colours information.In this example, the colouring information that distortion correction piece 24 mixes two pixel P1 and P2 create the output image 100 shown in Figure 23 (a) ' pixel P1 ', P2 ' and the colouring information of P3 '.In this situation, in distortion correction table, the pixel P1 of input picture 100 and P2 corresponding to output image 100 ' pixel P1 ' to P3 ', and each pixel P1 ' is handled to the colouring information of P3 ', so that become the colouring information of the colouring information that comprises the pixel P2 that mixes in proportion according to its amount of movement and P3.Is inequality in order to produce pixel P1 ' independently each other to the ratio of the colouring information of pixel P1 that P3 ' mixed and P2.

Then, when the pixel P3 after pixel P1 and the P2 was inputed to distortion correction piece 24, distortion correction piece 24 calculated two pixel P2 of use of output images 100 ' all and the colouring information that P3 can calculate.In this example, distortion correction piece 24 is carried out with reference to distortion correction table and is handled, so that the pixel P2 of input picture 100 and P3 corresponding to output image 100 ' pixel P4 ' to P5 ', and the colouring information of pixel P4 ' each in the P5 ' becomes the colouring information of the colouring information that comprises the pixel P2 that mixes in proportion according to its amount of movement and P3.

When moving preceding two pixels of input picture 100 on the x direction to last two two pixels in the sequentially mobile such mode of individual element, by calculate the output image 100 that just can calculate from per two pixels of input picture 100 ' all color of pixel information, can calculate output image 100 ' all color of pixel information.Therefore, distortion correction piece 24 only needs to store at least two pixels of input picture 100 on the x direction always, and follows the time delay of read pixel and carry out colouring information interpolation distortion correction treatment.Therefore, time that can minimal distortion correcting block 24 pending datas such as grade has also reduced processing delay in the distortion correction piece 24.

Shown in 24 (a) and 24 (b), in the pixel that receives input picture 100 since first pixel of first row (scan line) according to the order reception of P1, P3... then since first pixel of second row according to the order of P2, P4..., and mix input picture 100 two color of pixel information of adjoining on the y direction create output image 100 ' the situation of each color of pixel information under, distortion correction piece 24 at first calculates two pixel P1 of use and P2 can to its output image that calculates 100 ' all colours information.The pixel of distortion correction piece 24 storages first row is up to receiving pixel P2.In this example, the colouring information that distortion correction piece 24 mixes two pixel P1 and P2 create the output image 100 shown in Figure 24 (a) ' pixel P1 ' and the colouring information of P2 '.In this case, distortion correction table described the pixel P1 of input picture 100 and P2 corresponding to output image 100 ' pixel P1 ' and P2 ', and each color of pixel information has become pixel P1 and P2 colouring information according to the pro rata mixing of its amount of movement.The ratio that is used to produce pixel P1 ' and the colouring information of P2 ' pixel P1 and P2 is different each other.

Then, shown in Figure 24 (b), when the pixel P4 behind the pixel P2 is transfused to into distortion correction piece 24, distortion correction piece 24 calculate use pixel P3 and P4 just can to its output image that calculates 100 ' all colours information.In this example, distortion correction piece 24 is carried out with reference to distortion correction piece table and is handled, so that the pixel P3 of input picture 100 and P4 corresponding to output image 100 ' pixel P3 ', the colouring information of pixel P3 ' has become the pro rata mixing of colouring information of pixel P3 and P4 according to its amount of movement.

Distortion correction piece 24 such modes receive two pixels of adjoining in the input picture 100 on the y direction after, by at first carry out colouring information interpolation distortion correction treatment obtain output image 100 ' all color of pixel information.Distortion correction piece 24 only needs to be stored in one-row pixels at least and the input image pixels in computing store 15 on the x direction always.Be accompanied by the time delay for the one-row pixels on the x direction, distortion correction piece 24 is carried out colouring information interpolation distortion correction treatment, and the time of pending data such as can shorten, and has reduced the processing delay in the distortion correction piece 24 like this.

Shown in the input picture of Figure 25 (a) and 25 (b), since first the row first pixel according to P1, P2... order receives then since second first pixel P3 that goes, P4... order receive the pixel of input picture 100 and be blended in x and the y direction on 4 color of pixel information of the input picture 100 that adjoins create output image 100 ' the situation of each color of pixel information under, at the preceding several pixel P1 that read first row, preceding several pixel P3 of the P2 and second row, under the situation of P4, distortion correction piece 24 calculate use two pixel P1 and P4 can to its output image that calculates 100 ' all colours information.In this example, distortion correction piece 24 mix two pixel P1 to the colouring information of P4 create the output image 100 shown in Figure 25 (a) ' pixel P1 ' colouring information.In this case, the pixel P1 that distortion correction table has been described input picture 100 to P4 corresponding to output image 100 ' pixel P1 ', and colouring information has become pixel P1 to the pro rata mixing of P4 colouring information according to its amount of movement.

Then, shown in Figure 25 (b), when the pixel P6 behind the pixel P4 is transfused to into distortion correction piece 24, distortion correction piece 24 use the pixel P2 of storage when first row is transfused to and P5 and pixel P4 and P6 calculating output image 100 ' all colours information.In this example, distortion correction piece 24 is carried out with reference to distortion correction piece table and is handled, so that the pixel P2 of input picture 100, P5, P4 and P6 corresponding to output image 100 ' pixel P2 ' to P4 ', and the colouring information of pixel P2 ' each in the P4 ' becomes the pro rata mixing of colouring information of pixel P2, P5, P4 and P6 according to its amount of movement.

After distortion correction piece 24 receives 4 pixels of adjoining on the x and y direction in the input picture 100 by this way, by at first carrying out all color of pixel information that colouring information interpolation distortion correction treatment obtains output image 100.Distortion correction piece 24 only needs to be stored in one-row pixels at least on the x direction and two pixels of the input picture in computing store 15 100 always.Even when all having in the x and y direction when mobile, distortion correction piece 24 is accompanied by for the time delay of the one-row pixels on the x direction and carries out colouring information interpolation distortion correction treatment, and time of pending data such as can shorten, reduced the processing delay in the distortion correction piece 24 like this.

Next describe when with output image 100 ' the operation of output order description virtual reality creating system when being used for the distortion correction table of above-mentioned colouring information interpolation distortion correction treatment.

Output image 100 after colouring information interpolation distortion correction treatment ' output to output image processing block 25 from distortion correction piece 24.Normally, be the scan line of basis with the pixel along input picture 100, give output image processing block 25 dateouts continuously from distortion correction piece 24.Do not losing under the situation of pixel, consideration be the basis with the pixel along the common output image 100 of scan line output ', if the pixel order with outlet side is represented distortion correction, then the pixel coordinate of the output image in distortion correction treatment is conspicuous, can make such corresponding relation mapping like this, it is only described from the image coordinate of the input side of distortion correction table upper end beginning.This size that can reduce distortion correction table saves conversion table and reads/memory block of memory block 27.In addition, this distortion correction table has also been described the amount of movement that is used for colouring information interpolation distortion correction treatment.Distortion correction table comprises the description to the amount of movement of being created by parameter regulation personal computer 5.

Read at conversion table/memory block 27 in the such distortion correction table of storage and as Figure 26 (a) shown in the colouring information in two pixels that the x direction is adjoined by mixing input picture 100 create output image 100 ' the situation of each pixel color information under; When two pixel P1 that read on the top from input picture 100 at first that the input picture the top of distortion correction table described adjoins in the x direction and P2, distortion correction piece 24 use two pixel P1 adjoining in the x direction and P2 create output image 100 ' the colouring information of the first pixel P1 ' and the data of giving output image processing block 25 output pixel P1 '. Then, shown in 26 (b), for be created in afterwards output image 100 of pixel P1 ' ' pixel P2 ', read in the reference distortion correction table under the situation of two pixel P3 that adjoining on the x direction of input picture 100 and P4, distortion correction piece 24 use two pixel P3 that on the x direction, adjoin of input pictures 100 and P4 create output image 100 ' the colouring information of pixel P2 ' and the data of giving output image processing block 25 output pixel P2 '.

Shown in Figure 27 (a), by two color of pixel information adjoining on the y direction of mixing input picture 100 create output image 100 ' the situation of each pixel color information under, at first when two pixel P1 that adjoin in the y direction and that describe on the top of distortion correction table that read input picture 100 from the top of input picture 100 and P2, distortion correction piece 24 use two pixel P1 on the y direction, adjoining and P2 create output image 100 ' the colouring information of the first pixel P1 ' and the data of giving output image processing block 25 output pixel P1 '.Then, shown in Figure 27 (b), for produce output image 100 behind the pixel P1 ' ' pixel P2 ', when the reference distortion correction table reads two pixel P3 that adjoin of input picture 100 and P4 on the y direction, distortion correction piece 24 use two pixel P3 that on the y direction, adjoin of input pictures 100 and P4 create output image 100 ' the colouring information of pixel P2 ' and the data of giving output image processing block 25 output pixel P2 '.

In addition, shown in Figure 28 (a), create by 4 color of pixel information of adjoining in the x and y direction of mixing input picture 100 output image 100 ' the situation of each color of pixel information under, at first at 4 the pixel P1 that adjoin in the x and y direction and describe that read input picture 100 from the top of input picture 100 during to P4 on the top of distortion correction table, distortion correction piece 24 use 4 pixel P1 adjoining in the x and y direction to P4 create output image 100 ' the first pixel P1 ' colouring information and to the data of output image processing block 25 output pixel P1 '.Then, shown in 28 (b), for produce output image 100 behind the pixel P1 ' ' pixel P2 ', 4 the pixel P5 that adjoin in the x and y direction that read input picture 100 in the reference distortion correction table are during to P8,4 pixel P5 that adjoin in the x and y direction that distortion correction piece 24 uses input pictures 100 to P8 create output image 100 ' pixel P2 ' colouring information and to the data of output image processing block 25 output pixel P2 '.

The foregoing description only is an example of the present invention.Therefore, the present invention is not limited to the foregoing description.Clearly, according to other embodiments of the invention, under situation about not deviating from, can make various modifications according to design etc. according to technological thought of the present invention.

For example, in the above-described embodiments, in two orthogonal coordinate systems, use square pixels, carry out and use two color of pixel interpolation of on x or y direction, adjoining and carry out 4 color of pixel interpolation that use is adjoined in the x and y direction.Yet, under the situation of the picture signal in comprising the triaxial coordinate system of triangular pixel, use to comprise that the hexagon pixel groups of 6 triangular pixels that adjoin carries out color interpolation.

Industrial applicibility

The present invention is applicable to such purposes: the authenticity of projection creation of image image on screen, so that provide actual image space to the beholder.

Claims (12)

1. an image signal processing apparatus is exported to projecting cell with output image signal, so that throw image light on the projection plane of arbitrary shape, described device comprises:

The picture signal input unit receives the two dimensional image signal so that throw image light on the two-dimensional projection plane;

Outside input unit, externally receive distortion correction table as the mapping of the corresponding relation between the network model of the projection plane of two-dimensional projection plane and arbitrary shape, described distortion correction table is used for the two dimensional image signal that is received by the picture signal input unit is carried out distortion correction treatment;

Distortion correction treatment with reference to the distortion correction table that is received by outside input unit, is carried out to each pixel of the two dimensional image signal that received by the picture signal input unit in the distortion correction unit, produces output image signal so that throw image light on projection plane; And

Output unit is to the output image signal of projecting cell output by the generation of distortion correction unit;

Wherein, the distortion correction unit in the corresponding ratio of amount of movement of the representative points of the representative points of pixel before the change pixel after the conversion, mix a plurality of color of pixel information before the conversion, this conversion is to carry out according to distortion correction table, and

The distortion correction unit produces the output image signal that has as the pixel color information blend color information of each pixel of conversion back.

2. image signal processing apparatus according to claim 1, wherein, outside input unit input control signal is externally controlled the operation of projecting cell; And

Output unit will be exported to projecting cell with output image signal by the control signal that outside input unit receives.

3. according to each described image signal processing apparatus of claim 1 and 2, wherein,

Outside input unit externally receives the two dimensional image signal that is used for being received by the picture signal input unit and carries out the gamma correction table that gamma correction is handled,

Described device also comprises:

The gamma correction unit, with reference to the gamma correction table that receives by the picture signal input unit, each pixel of the 2D signal that received by the picture signal input unit is carried out gamma correction handle, produce output image signal so that on the projection plane of arbitrary shape, throw image light.

4. image signal processing apparatus according to claim 1, wherein

The picture signal input unit is configured to receive simultaneously a plurality of two dimensional image signals, and

Output unit is configured to export simultaneously a plurality of output image signals,

Described image signal processing apparatus also comprises:

Signal processing unit, when receiving a plurality of two dimensional image signal that receives simultaneously by the picture signal input unit, carry out the processing of a plurality of two dimensional image signals being selected the output image signal that obtains by synthetic a plurality of two dimensional image signals with the processing by output unit output output image signal or from output unit output.

5. image signal processing apparatus according to claim 1 also comprises:

Synchronous processing unit is carried out a plurality of processing of being undertaken by signal processing unit at a plurality of two dimensional image signals synchronously.

6. image signal processing apparatus according to claim 1 also comprises:

Stereo-picture difference two dimensional image signal generation unit uses a plurality of two dimensional image signals that received by the picture signal input unit to produce the differential image signal, wherein

The distortion correction unit is carried out distortion correction treatment at the difference two dimensional image that is produced by stereo-picture difference two dimensional image signal generation unit and is produced output image signal.

7. image signal processing apparatus according to claim 1, wherein, the distortion correction unit is handled by first and second processing produces output image signal,

First handles and to be, at least two color of pixel information that conversion forward position X-direction is adjoined are mixed in the position of the representative points of at least two pixels of adjoining with respect to conversion forward position X-direction according to the representative points of the pixel after the conversion, and

Second handles and to be, at least two color of pixel information that conversion forward position Y direction is adjoined are mixed in the position of the representative points of at least two pixels of adjoining with respect to conversion forward position Y direction according to the representative points of the pixel after the conversion.

8. according to each described image signal processing apparatus of claim 1 and 7, wherein

The distortion correction unit uses a plurality of primary colours as colouring information, and each primary colours of mixing adjacent pixels produce output image signal.

9. according to each described image signal processing apparatus of claim 1 and 7, wherein

The distortion correction unit uses each signal that all comprises monochrome information and color difference signal as colouring information, and the signal of mixing adjacent pixels produces output image signal.

10. image signal processing apparatus according to claim 1, wherein

Distortion correction table is according to the order of the input pixel of two dimensional image signal, describes the corresponding relation between the network model of projection plane of two-dimensional projection plane and arbitrary shape, and

When receiving each input pixel of describing in distortion correction table, the distortion correction unit uses the pixel that receives to carry out distortion correction treatment.

11. image signal processing apparatus according to claim 1, wherein

Distortion correction table is according to the order of the output pixel of output image signal, describes the corresponding relation between the network model of projection plane of two-dimensional projection plane and arbitrary shape, and

When receiving each input pixel of describing in distortion correction table, the distortion correction unit uses the pixel that receives to carry out distortion correction treatment, and produces output image signal according to the order of the output pixel of describing in the distortion correction table.

12. a virtual reality creating system comprises:

Screen comprises the projection plane that has towards the arbitrary shape on beholder's recessed surface, and described screen can show the image wideer than effective visual angle of beholder;

Image signal processing apparatus is carried out the distortion correction that is used for throwing on the two-dimensional projection plane at the two dimensional image signal image light, to throw image light on the projection plane of arbitrary shape, exports output image signal then;

The external treatment device is created distortion correction table and is shone upon as the corresponding relation between two-dimensional projection plane and the arbitrary shape projection plane network model; And

Projecting cell, based on the output image signal projects images on screen from image signal processing apparatus output, wherein image signal processing apparatus comprises:

The picture signal input unit receives the two dimensional image signal;

Outside input unit, receive distortion correction table as the mapping of the corresponding relation between the network model of the projection plane of two-dimensional projection plane and arbitrary shape, distortion correction table is used to carry out the distortion correction treatment at the two dimensional image signal that is received by the picture signal input unit;

The distortion correction unit, with reference to the distortion correction table that receives by outside input unit, each pixel at the two dimensional image signal that is received by the picture signal input unit is carried out distortion correction treatment, produces output image signal so that throw image light on the projection plane of arbitrary shape; And

Output unit is to the output image signal of projecting cell output by the generation of distortion correction unit;

Wherein, the distortion correction unit in the corresponding ratio of amount of movement of the representative points of the representative points of pixel before the change pixel after the conversion, mix a plurality of color of pixel information before the conversion, this conversion is to carry out according to distortion correction table, and

The distortion correction unit produces the output image signal that has as the pixel color information blend color information of each pixel of conversion back.

Images