JP4605189B2 - Video display apparatus and method - Google Patents

Description

  The present invention relates to an image display apparatus and method for displaying light projected from an image projection apparatus such as a liquid crystal projector or a laser light projector.

  Video projection devices such as liquid crystal projectors, laser light projectors, and film projectors have features such as being able to easily increase the screen size of the image, making it easier to get a sense of realism, and allowing a larger number of people to view the image simultaneously. .

  However, in general, in an image projection apparatus, it is necessary to increase the output intensity of a light source as the screen size increases. However, this is not always easy and is one of the factors that restrict the screen size. In addition, when used outdoors such as outdoor theater, the surroundings are not always used in a sufficiently dark state, and a self-luminous image is easier to see than a projector and is appropriate.

  Conventionally, an amplification light emitting screen in which a projection screen has a luminance amplification function so that an image projected by a video machine or a projector can be observed brightly is disclosed in Japanese Patent Laid-Open No. 10-123622. (Hereinafter referred to as a conventional example).

  FIGS. 14A and 14B are diagrams showing an amplification light emitting screen described in a conventional example, and are a side view showing an enlarged pixel and a front view showing the screen. As shown in FIG. 14A, a unit pixel 213 of a conventional amplified light emitting screen receives a signal light 201 that is a projected image, converts it into a current, and amplifies it by means of a light receiving element 203. A conductive wire 204 connected to one end of the light source, a light emitting device 205 connected to the other end of the conductive wire 204 to which an amplification current is supplied from the light receiving device 203, and a light distribution angle of light emitted from the light emitting device 205. A lens 206 serving as output light 207, a negative lead 209 and a positive lead 208 connected to the light receiving element 203 and the light emitting element 205 through wires, and a package 210 for storing them, respectively. As shown in FIG. 14B, the amplified light emitting screen 211 has pixels 213 arranged in a matrix.

  In the amplified light emitting screen described in the conventional example configured as described above, an image obtained by a projection type imaging device such as a normal projector and a projector that is not a high output type can be displayed brightly on a large screen.

  As a conventional technique, Patent Document 1 discloses an active screen including a light receiving element that receives a focused image for each pixel and a light emitting element that is controlled to be turned on according to a photoelectric output from the light receiving element. 2 discloses that a time constant circuit or the like is provided between a light receiving element and a light emitting element with a control element interposed.

Japanese Patent Laid-Open No. 01-105989 JP-A-10-123622

  However, in the liquid crystal projector, the laser light projector, and the conventional example, an image is configured by a set of discretized information such as pixels or scanning lines, so that the larger the screen to be projected, that is, the larger the screen. As a result, there is a problem that roughness such as a gap between pixels or scanning lines is likely to be noticed or the definition is lowered.

  In addition, in the conventional spontaneous type video display device, a video signal processing device that supplies a video signal to each pixel is connected. However, as the number of pixels increases as the screen size increases or the resolution increases, the video signal processing device increases. As a result, the number of signal lines from each pixel to each pixel increases, which causes problems such as difficult installation and maintenance of the apparatus and lack of expandability.

  The present invention has been proposed in view of such a conventional situation, and provides a video display device and method capable of displaying a high-resolution and high-definition and sufficiently bright video even when the screen is enlarged. The purpose is to provide.

  In order to achieve the above-described object, the video display device according to the present invention projects light based on the first video signal onto the display surface, processes the signal obtained from the projection light, and performs self-emission to display the display. An image display device for displaying an image on a surface, a plurality of light receiving means provided in the display surface for receiving projection light projected on the display surface and outputting a signal based on the projection light, and the light receiving means And a plurality of signal processing means for generating a second video signal by correcting the output signal from the light source, and a light emitting means for emitting light based on the second video signal. An output signal from the light receiving means corresponding to the other signal processing means among the signal processing means is also received.

  The video display method according to the present invention is a video in which light based on a first video signal is projected on a display surface, a signal obtained from the projection light is processed and a video is displayed on the display surface by self-emission. A display method, in which a plurality of light receiving means provided in the display surface receives projection light projected on the display surface and outputs a signal based on the projection light, and is output in the light reception step. A signal processing step of correcting the output signal to generate a second video signal by a plurality of signal processing means, and a light emission step of emitting light based on the second video signal, each signal processing means, An output signal from the light receiving means corresponding to the other signal processing means among the plurality of signal processing means is also received.

  In the present invention, since the light emitting means emits light and displays an image based on the second video signal obtained by correcting the signal obtained based on the projection light projected on the display surface, high resolution is achieved even when the screen is enlarged. In addition, a high-definition and sufficiently bright image can be presented.

  According to the present invention, there is provided a video display device in which light based on a first video signal is projected on a display surface, and a signal obtained from the projection light is processed to display a video on the display surface by self-emission. A plurality of light receiving means provided in the display surface for receiving the projection light projected on the display surface and outputting a signal based on the projection light; and correcting the output signal from the light receiving means to perform a second process A signal processing unit configured to generate a video signal; and a light emitting unit configured to emit light based on the second video signal. Each signal processing unit corresponds to another signal processing unit among the plurality of signal processing units. Since the output signal from the light receiving means is also received, an image is displayed by self-emission by the light emitting means, so that even with a large screen, a high resolution, high definition and sufficiently bright image can be presented.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings.

  1A and 1B are diagrams showing a video display device according to the first embodiment of the present invention, each showing a front view showing a part of a screen and AA in FIG. 1A. It is a side view in a line.

  As shown in FIG. 1A, the video display device according to the present embodiment is obtained from the projection light by projecting light based on the first video signal onto the screen from the surface side of the screen. A video display device that corrects a signal to generate a second video signal having a higher resolution than the first video signal, and redisplays the video based on the second video signal. A plurality of light transmitting means provided, and the projection light 3 projected from the front surface side 10a of the screen 1 provided at a position facing the light transmitting portion 2 on the back surface side 10b of the screen 1 are received. The light receiving unit 4 that is a light receiving unit, the signal processing unit 5 that is a signal processing unit that performs a correction process based on the projection light 3 received by the light receiving unit 4 and generates a video signal, and the signal processing unit 5 output the signal. Screen the video signal And a projection portion 6 which is a light projecting means for projecting a light from the back side 10b of the down 1.

  As the light transmission part 2, for example, a minute hole penetrating the screen 1, or a material in which transparent glass or resin is fitted into the hole penetrating the screen 1 can be used. Alternatively, when a sufficient amount of light for detection by the light receiving unit 4 can be obtained, only that portion of the screen 1 may be thinned, or the screen structure itself is light even if it remains the same as other portions. It can also be regarded as a transmission means.

  The light 3 projected on the front side 10 a of the screen 1 is detected by the light receiving unit 4 provided on the back side 10 b of the screen 1 through the light transmitting unit 2 provided on the screen 1. Here, the first video signal is projected as the projection light 3 on the surface side 10a of the screen 1. However, the projection light 3 is not limited to visible light, but is invisible light such as infrared rays and ultraviolet rays. Can also be used. Moreover, it is also possible to provide a receiving unit instead of the light receiving unit 4 and transmit data wirelessly.

  The light receiving unit 4 differs depending on the projection light 3 on the surface side 10a of the screen 1 or specific processing in the signal processing unit 5 described later, for example, receiving light of three primary colors (RGB), or For example, the received light corresponding to each color of RGB can be separately arranged.

Although the light projection unit 6 is provided at the subsequent stage of the light receiving unit 4, the output signal of the light receiving unit is output through the gap 6 a of the light projection unit 6 or the path provided in the light projection unit 6 or the relay unit 6 b. The signal line 4a is further input to signal processing units 5 ₂ , 5 ₅ , 5 ₈ (hereinafter referred to as the signal processing unit 5 when referring to an arbitrary signal processing unit) provided in the subsequent stage.

Screen 1 is divided into a predetermined region P _n, the signal processing unit 5 is provided in a plurality corresponding to the respective predetermined regions P _n, for a single signal processing unit 5, a predetermined region P _n The output signal obtained from the transmitted light 3 received by each of the 16 light receiving units 4 via, for example, 16 included light transmitting units 2 may be input. Furthermore, not only the corresponding predetermined area but also the output signal from the projection light 3 received by the light receiving parts 4 in other adjacent areas are input to each signal processing section 5 together. For example, the signal processing circuit 5 corresponding to the region _{P 2,} P 5, _{P 8,} when the respective signal processing unit _{5 2,} 5 5, _{5 8,} the signal processing circuit _{5 5} is provided in the region _{P 5} Not only the projection light 3 received by the light receiving unit 4 but also the output signals from the light receiving units 4 provided in the regions P _1-4 and P _6-9 adjacent to the periphery of the region P ₅ are input together.

  The signal processing unit 5 uses the input output signals from the plurality of light receiving units 4 to synthesize a partial image signal indicating a partial region in the entire image, and based on the combined partial image signal, a local image signal is generated. Signal processing is performed for each region, and a high-quality video signal is generated. An image data conversion apparatus that improves the resolution and generates a high-quality video signal will be described later. Further, the correction may be made so that an appropriate video is generated by the projection light from both sides of the screen 1. Note that the number and position of the outputs of the light receiving unit 4 input to one signal processing unit 5 and the size and shape of the outer frame of the signal processing unit 5 and the light projection unit 6 are limited to those shown in FIG. Never.

  The second video signal that is an output signal of the signal processing unit 5 is input to the light projection unit 6 provided between the light receiving unit 4 and the signal processing unit 5 via the signal processing unit output signal line 5a. This is a very small scale projecting the image for each local area from the back side 10b of the screen. As the configuration, for example, an LCD projector, various laser light projectors, and the like can be applied, and the light 7 projected from the light projection unit 6 on the back side 10b of the screen 1 reaches the front side 10a of the screen 1. Anything is acceptable. On the other hand, the screen 1 needs to be transmitted through the front surface side 10a of the screen 1 without completely blocking the projection light 7 from the back surface side 1b.

  Next, a modification of the first embodiment shown in FIG. 1 will be described. FIG. 2 is a diagram showing a modification of the first embodiment of the present invention. In this modification shown in FIG. 2, the same components as those in the first embodiment shown in FIG. 1 are denoted by the same reference numerals, and detailed description thereof is omitted. In this modification, one large-scale video display device is obtained by joining a plurality of small-scale video display devices (hereinafter referred to as small-scale screens) in the first embodiment on the same plane. (Hereinafter referred to as a large-scale screen).

  As shown in FIG. 2A, the large-scale screen 10 is composed of nine small-scale screens 1a to 1i configured in the same manner as the screen 1 shown in FIG. Has a plurality of light transmission parts 2, and each of the small-scale screens 1a to 1i is provided with m signal processing parts 5, for example.

  FIG. 2B is an enlarged view of the region S1 of FIG. As shown in FIG. 2B, a light receiving portion 4 is provided at a position facing the light transmitting portion 2 on the back surface side 10b of the large-scale screen 10, and the light receiving portion 4 is connected via a light receiving portion output signal line 4a. It is connected to the signal processing unit 5. As described above, the signal processing unit 5 receives a plurality of output signals from the light receiving unit 4 in adjacent regions.

  In the first embodiment, an output signal from one light receiving unit is not only input to a signal processing unit provided with the light receiving unit and corresponding to a predetermined area of the screen, but also adjacent to the signal processing unit 5 or Similarly to the case where the signals are input to the plurality of adjacent signal processing units 5, in the video display device according to the present modification, the output signals from the light receiving unit 4 that are required are transmitted around the boundary 11 of the small-scale screens 1 a to 1 i. To the signal processing unit 5 arranged in For this reason, it is necessary to mutually connect the signal processing units 5 arranged around the boundary 11 of the small-scale screens 1a to 1i. Therefore, an interface unit 12 for the interconnection is provided at the boundary between the small-scale screens 1a to 1i. No interconnection is required at the end of the large-scale screen 10, but in that case, appropriate termination processing is performed on both the input end and the output end. Thus, the large-scale screen 10 can be easily formed by simply connecting the small-scale screens 1a to 1i to each other by the interface lower portion 12, and it is very convenient for maintenance and the like.

  In FIG. 2, one similar large-scale screen 10 is constituted by nine small-scale screens 1a to 1i. However, the number of small-scale screens 1a to 1i to be used is large. The shape and size of the scale screen 10 and the individual small-scale screens 1a to 1i do not have to follow the same figure, and an interface unit is provided in the small-scale screens 1a to 1i so that the space between the adjacent small-scale screens 1a to 1i Basically, it can be freely configured as long as the signal lines are interconnected.

  Next, the signal processing unit in the first embodiment of the present invention and its modification will be described in more detail. In one signal processing unit, a partial second video signal corresponding to a predetermined area of the screen is generated, and projections arranged in this predetermined area among a plurality of projection units 6 serving as display pixels on the screen. The video signal of the partial area is supplied to the unit 6. As the signal processing unit 5 that receives light based on the first video signal at the light receiving unit and generates a high-definition second video signal having a higher resolution than the first video signal from the output signal from the light receiving unit, The image data conversion device described in, for example, Japanese Patent Application Laid-Open No. 2000-125268 previously filed by the inventors of the present application can be used, and correction processing is performed based on the output signal from the light receiving unit 4, for example, A signal of 4 × 4 pixels is generated for one light receiving unit 4 to increase the resolution of 1: (4 × 4).

  Here, in the above Japanese Patent Laid-Open No. 2000-125268 and the like, class taps and prediction taps are extracted from a plurality of pixels of the original image located around the target pixel (generated pixel). One signal processing unit in the form is included in a predetermined region (Pn) of the screen 1 where the light projection unit 6 to which a partial second video signal generated by one signal processing unit 5 is supplied is arranged. An output signal from the light receiving unit 4 provided outside the light receiving unit 4 located on the outermost periphery of the light receiving unit 4 is also input and used for signal processing. That is, one signal processing unit 5 outputs an output signal from the light receiving unit 4 provided in a predetermined area of the screen 1 on which the light projection unit 6 to which the second video signal from the signal processing unit 5 is supplied is arranged. In addition, for example, from the light receiving unit 4 provided in another area of the screen 1 where the light projection unit 6 to which the second video signal from the other signal processing unit 5 adjacent to the signal processing unit 5 is supplied is arranged. The output signal is input and signal processing is performed.

  FIG. 3 is a block diagram of a signal processing unit in the present embodiment that supplies and inputs a partial image signal to the light projection unit 6 in a predetermined area of the screen 1. As shown in FIG. 3, the signal processing unit 5 receives an output signal S21 from each light receiving unit corresponding to a pixel, reconstructs the output signal S21, and outputs partial image data S22. The partial image data S22 is input, and the first and second region cutout portions 22a and 22b that cut out an image of a predetermined region, and the data cut out by the first region cutout portion 22a (predetermined light receiving portion) A class code generator 23 that generates a class code S24 from S23, a prediction coefficient ROM (Read Only Memory) 24 that reads prediction coefficient data S25 of the class code S24 supplied from the class code generator 23, Data (output signal from a predetermined light receiving unit) S26 cut out by the second region cutout part 22b and the prediction coefficient S read out by the prediction coefficient ROM 24 25, the prediction calculation unit 25 that performs the prediction calculation and generates the image data S27, and the image data S27 from the prediction calculation unit 25 are input, and the data is distributed to the data for each pixel (light projection unit 6). The generated pixel signal output unit 26 outputs the generated pixel signal S28.

  The data construction unit 21 is an input buffer that receives the output signal S21 from each light receiving unit, and reconstructs the partial image data S22 here. The data construction unit 21 includes an analog / digital (A / D) converter as required (when an analog signal is input).

  The first region cutout unit 22a receives the partial image data S22 from the data construction unit 21, and includes, for example, a target light receiving unit corresponding to the target pixel in the partial image data S22 and a plurality around the target pixel. For example, a total of seven light-receiving units composed of peripheral light-receiving units centered on the target light-receiving unit corresponding to the peripheral pixels are set as light-receiving units corresponding to pixels for class classification (hereinafter referred to as class taps), The output signal S23 from these 7 taps is supplied to the class code generator 23. Hereinafter, the light receiving unit is also referred to as a pixel, and the output signal from the light receiving unit is also referred to as a pixel value.

The class code generation unit 23 generates a class code based on the signal level distribution of the supplied class tap. As a method for generating the class code, when the partial image data S22 is, for example, pulse code modulation PCM (Pulse Code Modulation) data, a method of using this PCM data as a class code as it is, or so-called ADRC (Adaptive Dynamic Range Coding) There is a method of reducing the number of classes using a data compression method such as. In the method of the intact class code of these PCM data, when using 8-bit 7-tap the PCM data as a class tap, will be the number of classes are classified into several number of classes huge as 2 ^56, practically There's a problem.

  Therefore, in practice, the class code generation unit 23 reduces the number of classes by performing data compression processing (that is, requantization processing) such as ADRC. This class code generation method by ADRC uses a method of obtaining an ADRC code from the following taps in a neighboring area centered on the pixel of interest by the following formula (1) and generating a class code based on the ADRC code.

Here, c _i is an ADRC code, x _i is an input pixel value of each class tap, MIN is a minimum pixel value among input pixel values of each class tap in the region, and DR is a dynamic range (maximum pixel in the region). Difference between the value and the minimum pixel value), k is the number of requantization bits.

  That is, in the classification method based on ADRC, a quantization step width corresponding to the number of requantization bits is calculated from the dynamic range in the region, and a pixel value obtained by subtracting the minimum pixel value from the input pixel value is determined according to the quantization step width. Requantize. For example, in the case of performing 1-bit ADRC in which each class tap is re-quantized to 1 bit in 7 taps in the region, each input pixel value of 7 taps is adaptively 1-bit quantized based on the dynamic range in the region. As a result, since the input pixel value of 7 taps can be reduced to 7-bit data, the number of classes as a whole can be reduced to 128 classes.

  Returning to FIG. 3, the prediction coefficient ROM 24 stores prediction coefficient data corresponding to each class generated in advance by the learning circuit 30 described later, and corresponds to the class code S24 supplied from the class code generation unit 23. The prediction coefficient data S25 is read out and sent to the prediction calculation unit 25.

  The second region cutout unit 22b includes the target light receiving unit corresponding to the target pixel and the target target corresponding to the plurality of peripheral pixels centered on the target pixel in the partial image data S22 input from the data construction unit 21. For example, a total of 13 taps composed of peripheral light receiving parts centered on the light receiving part are selected as light receiving parts corresponding to prediction calculation pixels (hereinafter referred to as prediction taps), and an output signal (pixel value) from the light receiving part is selected. ) S26 is supplied to the prediction calculation unit 25.

  The prediction calculation unit 25 uses the linear taps for each pixel value S26 of the prediction tap supplied from the second region cutout unit 22b and the prediction coefficient data S25 supplied from the prediction coefficient ROM 24. By performing the product-sum operation represented by (2), high-resolution image data with higher resolution, such as HD image data that is a collection of high-resolution HD (High Definition) pixels, that does not exist in the prediction tap, for example. The generated pixel signal is output to the generated pixel signal output unit 26.

Here, x ′ is each pixel value of the high-resolution image, x _i is the pixel value of each prediction tap, w _i is the prediction coefficient, and n is the number of prediction taps. In this case, n is 13.

  The generation pixel output unit 26 is an output buffer for generating a pixel signal corresponding to each pixel from the high-resolution image data, and outputting the generated pixel signal to the corresponding light projection unit, and distributing the pixel signal to each pixel position. Do. The generated pixel output unit 26 may output serially and includes a digital / analog (D / A) converter as necessary.

  Next, a learning circuit that generates prediction coefficient data stored in the prediction coefficient ROM 24 will be described. Basically, learning is performed between a high-resolution teacher image and a student image whose resolution is reduced to a level corresponding to a projection image through a low-pass filter (LPF). However, since the projection light 3 is superimposed on the display light projected from the light projection unit 6 depending on the position of the display pixel and the spot diameter of the projection light, the display light is corrected and displayed. It is necessary to generate a pixel signal. In this embodiment, a prediction coefficient is generated in consideration of this correction.

  FIG. 4 is a block diagram showing the learning circuit of the present embodiment. The learning circuit 30 generates prediction coefficient data in advance and stores it in the prediction coefficient ROM 24. The learning circuit 30 includes a vertical decimation filter LPF 31 to which the teacher image data S 31 is input, a projection light superimposition correction unit 32 that corrects the projection light superimposition from the teacher image data S 31 and the data S 32 that has passed through the LPF 31, and the LPF 31. A noise superimposing unit 33 that superimposes noise on the post-data S32, and first and second region extractions that select a class tap and a prediction tap from the image data (student image data) S33 on which the noise is superimposed by the noise superimposing unit 33 Units 34a and 34b, a class code generation unit 35 that generates a class code S35 based on the pixel value S34 of the class tap supplied from the first region extraction unit 34a, and a second region extraction unit 34b. Prediction tap pixel value S36, class code S35 supplied from the class code generator 35, and projection light superimposition A normal equation calculation unit 36 for calculating a prediction coefficient from the image data (second teacher image data) S36 supplied from the correction unit 32 using a normal equation, a prediction coefficient determination unit 37 for determining a prediction coefficient, and the determined prediction And a memory 38 for storing the coefficient data together with the class code.

  The projection light superimposition correction unit 32 basically subtracts the projection light superimposition from the original teacher image data S31 according to the generation pixel position, and newly generates teacher image data (second teacher image data) S37. Then, correction for performing learning again from the teacher image data S37 is performed.

  In order to reduce the influence of projection light superimposition, it is desirable that the projection light be weaker than the display light. However, in this case, the influence of noise can be large. Therefore, the noise superimposing unit 33 generates student image data S33 in which noise is superimposed after passing through the LPF 31, and performs learning using the student image data S33, thereby obtaining a prediction coefficient that also has a noise suppression effect. .

  Further, the generated pixel signal output unit 26 shown in FIG. 3 described above may be configured to include a projection light superimposition correction function for performing correction by subtracting the superimposition according to the pixel position (position of the projection unit 6). In this case, the projection light superimposed correction unit 32 in FIG. 4 can be deleted.

  Furthermore, when invisible light such as infrared rays and ultraviolet rays is used, and when data is transmitted wirelessly, superimposition of projection light does not have to be considered, and at least the projection light superimposition correction unit may be deleted. it can.

  The first region cutout unit 34a, the second region cutout unit 34b, and the class code generation unit 35 are the first region cutout unit 22a and the second region cutout unit 22b in the signal processing unit shown in FIG. And the class code generation unit 23, the class tap is selected from the student image data S33 input to the first region extraction unit 34a, and the class code generation unit 35 receives the signal level of the class tap. After generating the class code S34 based on the distribution, it is sent to the normalization equation calculator 36. The second region cutout unit 34 b selects a prediction tap from the student image data S <b> 33 and supplies it to the normalization equation calculation unit 36.

  The normalization equation calculation unit 36 calculates, for each class, a prediction coefficient corresponding to the class indicated by the class code S35 based on the second teacher image data S37 and the pixel value S36 of the prediction tap, and the prediction obtained as a result The coefficient data S39 is stored in the memory 38.

  In this case, the normalized equation calculation unit 36 is configured to obtain the prediction coefficient w in the above equation (2) by the method of least squares. Specifically, the normal equation 36 includes pixel values of a relatively low resolution image (student image), W is a prediction coefficient, and Y is a high resolution image (second teacher image) before X is converted to high resolution. ) Are collected so as to generate the following expression (3) called a so-called observation equation.

  Here, m is the number of learning data indicating the number of pixels of the high-resolution image to be predicted, and n is the number of prediction taps.

  Next, the normal equation calculation unit 36 establishes a residual equation shown in the following equation (4) based on the above equation (3).

Therefore, it can be seen from the above formula (4) that each prediction coefficient w _i is an optimum value when the following formula (5) is minimum. That is, the prediction coefficient w _i is calculated so as to satisfy the following formula (6).

Therefore, the normal equation calculation unit 36 has only to calculate w ₁ , w ₂ ,..., W _n that satisfy the above-described equation (6), and from the equation (4), The following formula (7) is obtained, and the following formula (8) is obtained from these formulas (6) and (7).

  Then, the normal equation calculation unit 36 generates a normal equation represented by the following equation (9) from the equations (4) and (8).

In this way, the normal equation calculation unit 36 generates a normal equation that is a simultaneous equation of the same order as the predicted tap number n, and solves this normal equation using the sweep-out method (Gauss Jordan elimination method). A prediction coefficient w _i is calculated. The prediction coefficient determination unit 37 determines the prediction coefficient w _i corresponding to each class code and sends it to the memory.

  According to the present embodiment, the learning circuit 30 corrects the projection light superimposition in advance, and further learns the prediction coefficient from the teacher image and student image in consideration of noise and the like, and the signal processing unit 5 learns the prediction coefficient. By estimating the image data from the prediction coefficient and generating a pixel signal, if the signal obtained from the projection light is corrected by the signal processing unit 5, a highly precise and high-definition image is displayed on the screen 1. be able to. Furthermore, by preparing a plurality of small screens and providing the interface unit 12 in the signal processing unit 5 at this boundary, the screen can be easily enlarged and convenient for maintenance such as component replacement. That is, the video display device can be provided to the user in units of the small video display device according to the present embodiment, and any number of small video images can be provided on the user side in consideration of the user's own purpose and cost. By connecting the interface units 12 of the display devices, it is possible to assemble and use a video display device of an arbitrary size.

  In the first embodiment of the present invention as described above, the video signal is projected on the screen by the video projection device, and on the screen side, the projection light is received, and the video is based on the received projection light. By re-creating the signal and projecting it from the back side of the screen to the screen surface by the light projection means, high-quality and high-luminance video display is realized even on a large screen.

  Next, a second embodiment of the present invention will be described. In the first embodiment and the modification described above, an image is projected onto the screen 1 and the screen 10 by the image projection device, and a signal obtained from the projection light is processed to re-display a high-definition image. However, in the present embodiment, in the video projection device, by adding additional data to the projected video, a signal for high definition in the above-described signal processing unit provided on the display side. Along with the processing, the video projection apparatus side is also responsible for signal processing for higher definition.

  FIG. 5 is a block diagram showing a video projection apparatus according to the second embodiment of the present invention. The video projection apparatus generates a high image quality additional signal S42 from an original video signal S41 input via an input terminal, and a synthesized video signal S43 from the original video signal S41 and the high image quality additional signal S42. A video signal processing unit 43 including a generated composite video signal generation unit and a video signal projection unit 44 that projects the composite video signal S43 on the surface of a screen (not shown).

  That is, in the first embodiment described above, the original video signal S41 is projected as it is, but in this embodiment, a video signal processing unit is provided on the video projection device side to improve image quality. Generates various desired additional signals and generates a composite video signal by adding or embedding it to the original video signal. The screen signal side modulates the light modulated based on the composite video signal in the video signal projection unit. Project to.

  The video display device that receives and redisplays the projection light on the screen side is configured in substantially the same manner as the first embodiment described above, and receives the projection light projected based on the composite video signal. The signal processing unit generates a composite video signal based on the output signal from the light receiving unit. The signal processing unit, which will be described later, separates the additional data from the composite video signal, and performs a process for improving the quality of the composite video signal more efficiently and effectively based on the separated additional data.

  The method of adding the additional data will be described later. For example, a method of embedding the additional data using a digital watermark technique in a partial image in a processing area provided by a signal processing unit provided on the back side of the screen, Without generating a composite video signal, projection is performed based on the original video signal S41, and at a timing different from the projection of the original video signal 41 (preferably in advance) and by weak light that is difficult to perceive by the eyes You may use the method of projecting. Further, similarly to the first embodiment, a receiving unit may be provided on the back side of the screen instead of the light receiving unit that receives the projection light, and the additional signal and the video signal may be transmitted by radio signals.

  In addition, since the signal processing in the signal processing unit on the back side of the screen takes time, in a moving image with a large movement as it is, the time lag between the projected video from the screen front side and the projected video from the back side. If this occurs, it can be dealt with, for example, by reducing the intensity of the projection light or using invisible light as described above, or by increasing the processing speed in the signal processing unit 5 described above.

  Moreover, when projecting the composite signal to the screen surface side by the video projection device 40, not only visible light but also invisible light such as infrared rays or ultraviolet rays may be used. This eliminates the problem of temporal deviation between the projected image on the screen surface side and the projected image from the screen back side. Further, since the image is displayed only by the projection light from the back side of the screen, the signal processing in the synthesis of the images from both sides of the screen, that is, the second video signal generated by the signal processing unit on the back side of the screen is Although it is necessary to consider the image projected on the screen surface side based on the first image signal, the complexity of such signal processing is reduced. Further, the configuration of the video projection device 40 can be simplified.

  Hereinafter, in the present embodiment, a case where a motion vector is added to a video signal as additional data will be described. First, a method for adding a motion vector, which is additional data for improving image quality, in the video signal processing unit 43 according to the present embodiment will be described. The simplest method for adding additional data is to simply add additional data. For example, if the display unit size and the block size in the block matching are the same 8 × 8 pixels, and the search range is 64 × 64 pixels, 2 (X and Y directions) × 6 bits = 12 bits of data is 8 Each pixel data received by × 8 pixels, that is, 8 × 8 light receiving portions, is distributed and held. In this case, the size of the additional data added per pixel is smaller than the original (8 × 8) × 8 = 512 bits. Specifically, as shown in FIG. 6, for example, in the pixel block 45 of 8 × 8 pixels, it is assumed that additional data is added by 1 bit in 12 predetermined pixels 46. Further, not only progressive but also additional data can be added in the case of interlace ([8 × 4 pixel block] × 2). Here, in the case of interlace, in addition to the pixel 46 having 1-bit additional data, a pixel 47 having 12 additional data is added. The other pixels 48 are pixels with no additional data.

  FIGS. 7A, 7B, 7D, and 7E show RGB 3 × 8 = 24 bit data and YUV (Y: luminance signal, UV: color difference signal) (4: 2: 2), respectively. 2) is a schematic diagram showing pixel data (hereinafter referred to as original data) of the original video signal S41 of 2 × 8 = 16 bits and additional data of pixels obtained by adding additional data to the original data. FIG. 7A shows original data in RGB for one pixel shown in FIG. 6, that is, data in the pixel 48. As shown in FIG. 7B, 1-bit additional data (additional bit) 49a is simply added to such original data to obtain 25 bits.

  FIG. 7D shows the original data for two pixels adjacent in the horizontal direction in YUV, and the pixel shown in the right figure shows the original data for one pixel shown in FIG. As shown in the right diagram of FIG. 7E, 1-bit additional data (additional bit) 49c is simply added to such original data to make 17 bits. The pixel data shown in FIG. 7B or FIG. 7E is a pixel with additional data of the pixel 46 or 47 in FIG.

  Further, the processing can be made easier by making the bit lengths uniform in all pixels, but if 1 bit is added in all pixels at this time, additional data of 52 bits or 40 bits can be added.

  Further, when the bit length is not changed with respect to the original data, for example, some data compression is performed on pixel data of one pixel of 24 bits for RGB and one pixel of 16 bits for YUV. There are various data compression methods. For example, there is a method of simply replacing a bit group having low visual importance with each bit of the additional data. FIGS. 7C and 7F are diagrams showing pixel data when additional data is replaced and added, and are schematic diagrams showing RGB 24-bit pixel data and YUV 16-bit pixel data, respectively. As shown in FIG. 7C, for RGB, for example, the most significant bit LSB (Least Significant Bit) of B (Blue) is used, and as shown in FIG. 7F, YUV 4: 2: 2 is used. If so, for example, the most significant bit LSB of the color difference signal V is replaced with one of 12-bit data (additional bit 49b and additional bit 49d, respectively) representing the motion vector in the pixel block. Then, a total of 12-bit data indicating the motion vector can be distributed and transmitted to 8 × 8 pixels (each pixel data received by 8 × 8 light receiving units). MSB indicates the most significant bit.

  In the signal processing section provided on the back side of the screen, each bit indicating a motion vector is separated to obtain motion vector data, and 0 or 1 is mechanically assigned to the least significant bit of B or Y data which is separated and vacated. Can be handled as 8-bit data.

  Next, the video signal processing unit 43 in the present embodiment will be described in more detail. The video signal processing unit 43 performs motion vector detection and adds the result to the original image signal to generate a composite signal. This motion vector is, for example, disclosed in Japanese Patent Application Laid-Open No. 2001-2001 filed earlier by the present inventors. It can be detected by a motion vector detection device described in Japanese Patent No. 53981.

  In other words, the motion vector detection device has a plurality of target pixels including a target pixel in an image signal and a plurality of pixels positioned around the target pixel, and each of the target pixels includes a plurality of pixels positioned on a straight line extending in the time direction. Extraction means for extracting pixels, and for each target pixel for each pixel of interest, similarity is detected for each straight line direction based on pixel values of a plurality of pixels extracted for each straight line direction by the extraction means. And a motion vector calculating means for calculating a motion vector for the target pixel based on the similarity detected for each direction of the straight line for each target pixel. The motion vector is calculated based on the result of the arithmetic processing performed based on the pixel values of the pixels in the plurality of frames located on the plurality of straight lines passing through the plurality of pixels in the target frame.

  FIG. 8 is a block diagram showing a video signal processing unit that detects a motion vector and adds the motion vector to the original video signal to generate a synthesized signal. As shown in FIG. 8, the video signal processing unit 43 receives the original video signal S41 and detects the motion vectors S51 and S52. The image quality processing additional signal generation unit 41 detects the motion vectors S51 and S52, and the motion vectors S51 and S52 and the original video signal. S41 is input, and it is comprised from the synthetic | combination signal generation part 42 which produces | generates synthetic | combination signal S44.

  The additional signal generating unit 41 for improving image quality receives the frame data from the frame memories 51 to 53 and the frame memories 51, 52 and 52, 53, and detects the motion vectors S51 and S52, respectively. And 55.

  First, the original video signal S41 from which noise is to be removed is supplied to the frame memory 51. Frame memories 52 and 53 are sequentially connected to the frame memory 51 in a shift register shape. As a result, the frame memories 51, 52, and 53 store the image data of three temporally continuous frames.

  The frame memories 51 and 52 supply the stored frames to the motion vector detection unit 54. The motion vector detection unit 54 performs block matching based on the two supplied frames to detect the motion vector S51, and supplies the detected motion vector S51 to the synthesized signal generation unit 42. Similarly, the frame memories 52 and 53 supply the stored frames to the motion vector detection unit 55, and the motion vector detection unit 55 detects the motion vector S 52 from this frame and supplies it to the synthesized signal generation unit 42.

  The composite signal generation unit 42 generates the composite video signal S44 to which the motion vector is added by simply adding or replacing the motion vectors S51 and S52 to the original video signal as described above. The composite video signal S44 is supplied to the video signal projection unit, and an image is projected on the screen based on the composite video signal S44.

  As an example of the video signal projection unit 44 of the video projection device 40, a projection device using the optical switch shown in FIG. 9 can be used. As shown in FIG. 9, the image projection unit 44 includes a laser light source 102 that is a light emitting unit that emits light such as coherent light, an optical fiber 103 having one end connected to the laser light source 102, and other optical fibers 103. A 1-input L-output optical switch 104 (a natural number of L ≧ 2) connected to the end, and an optical fiber 105 individually connected to each of the L output ends of the optical switch 104; 1-input M-output optical switch 106 individually connected to each of the optical fibers 105, and light emission connected to the output end 107 of each of these L 1-input M-output optical switches 106 (M ≧ 2 natural number) 5 and the above-described video signal processing unit 43 shown in FIG. 5 are input. Based on the composite video signal S43, the laser light source 52 and the 1-input L-output optical switches 54 and 1 And a signal processing circuit 59 for outputting a control signal for controlling the force M output optical switch 56. Here, the control signals are an optical modulation signal (luminance modulation signal) S43a for modulating the luminance of the laser light and optical switch control signals (optical path selection signals) S43b and S43c for switching and selecting the optical path of the laser light.

  The 1-input L-output optical switch 104 and the 1-input M-output optical switch 106 have L and M output ends, respectively, and are arranged in a line in the X-axis direction and the Y-axis direction, respectively. . Hereinafter, such an array is also referred to as a one-dimensional array. As the 1-input L-output optical switch 104 and the 1-input M-output optical switch 106, an electro-optical switch using an electro-optic effect in an optical waveguide can be used. Such an optical switch includes, for example, a directional coupler type, an interferometer type, a Y branch type, an asymmetric X branch type formed by crossing two asymmetric waveguides, or three or more optical waveguides. There are multimode type elements using three or more existing modes, such as a multi-waveguide directional coupler, a waveguide array element, and a multi-mode interferometer (MMI). No.7 pp.760-767 July 1999).

  A 1-input 2-output optical switch is connected in multiple stages, and a 1-input 2-output optical switch is connected in multiple stages to each output end of the 1-input L-output optical switch 104 in which a one-dimensional array is configured. By connecting a one-input M-output optical switch 106 that forms a one-dimensional array of input M outputs, a two-dimensional array light emitting unit 108 corresponding to L × M pixels can be configured.

  The light emitting portion 108 is a portion that emits laser light that has undergone light intensity modulation and optical path switching, and is simply an end portion of an optical waveguide or an optical fiber of an optical switch. These are arranged in a one-dimensional or two-dimensional array, and light emitted therefrom is projected on a screen to form an image. Here, the end portion (light emitting portion 108) may be provided with a lens that corrects the shape and spread of the beam, or may have an appropriate emission angle according to the position of the pixel.

  The signal processing unit 109 receives the composite video signal S43 from the video signal input terminal 100 and supplies the optical modulation signal S102 to the laser light source 102, the 1-input L-output optical switch 104, and the 1-input M-output optical switch 106, respectively, and the light for the X axis. A switch control signal S103 and an optical switch control signal S104 for the Y axis are input. In the present embodiment, the light modulation signal S102 is input to the laser light source 102, and the laser light is directly modulated based on the video signal, that is, the luminance modulation is performed by the light emitting means. In addition, what added the light modulator to each light emission part 58, or the optical switch added to each light emission part 108 can also be used as a light modulator, In that case, the laser irradiated from a laser light source The light intensity can be made constant, and an optical response signal is supplied to the modulator. In this embodiment, since the laser light source 102 performs luminance modulation, the 1-input L-output optical switch 104 and the 1-input M-output optical switch 106, which are optical branching means, simply switch and select the optical path of light. Function as. When the optical switch control signals S43b and S43c are composed of a multi-stage connection of 1-input 2-output optical switches such as the 1-input L-output optical switch 104 and 1-input M-output optical switch 106, the optical path of each optical switch is switched. The signal to select.

  The signal processing unit 109 includes a control unit (not shown), and the control unit receives a synthesized video signal S43 synthesized by adding additional data to the original video signal S41, and the synthesized video signal S43. Based on the above, an optical modulation signal and an optical switch control signal for optical path switching and optical intensity modulation are generated. The signal processing unit 109 may perform various image signal processing such as noise suppression, IP (Interlace-Progressive) conversion, pixel number conversion, pixel position conversion, frame rate conversion, and decoding. .

  With such a projection unit 44, a light emission unit is configured in a two-dimensional array by combining light switches arranged in a one-dimensional array with light from a laser light source, and a light modulation signal input to the light source and the optical switch, and By controlling the luminance modulation and optical path selection by the optical switch control signal, respectively, high resolution and high frame rate display are possible, and image quality is hardly deteriorated due to variations in characteristics between elements, and the reliability of the projected image is high. It will be a thing.

  Also in the present embodiment, similarly to the first embodiment, the projection projected on the screen based on the synthesized video signal S44 obtained by adding or synthesizing the motion vector data related to each partial image data. With respect to the light, this projection light is received and processed by a video display device provided on the back surface of the screen, and redisplayed.

  Next, the signal processing unit of this video display device will be described. The configuration of the video display device other than the signal processing unit can be the same as that of the first embodiment shown in FIG. 1 or 2, and here, the signal processing unit will be described. FIG. 10 is a block diagram showing the signal processing unit of the present embodiment. The signal processing unit of the present embodiment separates the additional data from the synthesized video signal to which additional data such as a motion vector is added, and uses it for segmentation.

  The projection light projected on the screen based on the composite video signal is received by a light receiving unit provided at a position facing the light transmitting unit on the back side of the screen through a plurality of light transmitting units provided on the screen. Then, as shown in FIG. 10, an output signal S61 from the light receiving unit is input to the signal processing unit 60.

  As the signal processing unit 60, class classification adaptive processing based on motion vectors (for example, Japanese Patent Application Laid-Open No. 2000-341609 previously filed by the inventors of the present application) can be used. The generated video signal can be generated.

  That is, the signal processing unit 60 receives the output signal S61 from each light receiving unit, reconstructs data, a partial image memory 62 that stores data S62 constructed by the data construction unit 61, and Partial image memories 63 and 64 sequentially connected in a shift register form to the partial image memory 62, and motion vector separation units 65 and 66 for separating motion vectors S66 and S67 from data S64 supplied from the partial image memory 63, respectively. , Motion vectors S66 and S67, and partial images S63 to S65 from the partial image memories 62 to 63 are input, a region is extracted based on the motion vectors S66 and S67, and a class tap region prediction and a prediction tap are selected respectively. A class code S70 is generated from the extraction unit 67, the prediction tap region extraction unit 68, and the class tap. Based on the class code generator 69 and the class code S70, the prediction coefficient ROM 70 for reading the prediction coefficient data S71 previously learned by the learning circuit described later, the prediction coefficient data S71, and the prediction tap are input, and the high-quality video is input. A prediction calculation unit 71 that predicts and calculates the signal S72 and a pixel signal output unit 72 that generates a pixel signal S74 for each pixel from the high-quality video signal S72. The pixel signal S73 is input to a plurality of light projection units provided on the back side of the screen, and an image based on the pixel signal S73 is projected from the back side to the front side of the screen to display a high-quality video on the screen. Is done.

  Here, the partial images stored in the partial image memories 62 to 64 need to be an area wider than the partial image data in the first embodiment shown in FIG. An output signal from each light receiving unit corresponding to the vector search range is input. Then, the partial image data 62 to 64 to which the partial image data reconstructed by the data construction unit 61 is input stores partial image data of three temporally continuous frames. A motion vector is added to the partial image data.

  The motion vector separation units 65 and 66 are supplied with the partial image S64 of the partial image memory 63, and, as described above, the motion added to the predetermined pixel data or replaced with the predetermined bit of the predetermined pixel data. The additional bits indicating the vector are separated, and motion vectors S66 and S67 are generated from the separated additional bits.

  The partial image data of the frames stored in the frame memories 62, 63 and 64 is supplied to the area cutout unit 67. The region cutout unit 67 refers to the motion vector S66 supplied from the motion vector separation unit 65 and the motion vector S67 supplied from the motion vector separation unit 66, and determines an image at a predetermined position from the supplied partial image data. Cut out the area. The cut-out image area data S68 is supplied to the class code generation unit 69.

  The class code generation unit 69 extracts a pattern in space-time from the supplied data by, for example, ADRC processing, and generates a class code S70 indicating a class classified according to the extracted pattern. As described above, the image area cut out by the area cutout unit 67 is used for processing related to the class classification, and thus the image area is referred to as a class tap. The class code S70 is supplied to the prediction coefficient ROM 70.

  The prediction coefficient ROM 70 stores a prediction coefficient predetermined for each class, and reads a prediction coefficient corresponding to the class code from the stored prediction coefficient. The output (prediction coefficient data S71) of the prediction coefficient ROM 70 is supplied to the prediction calculation unit 71.

  On the other hand, the partial image of the frame stored in the partial image memories 62, 63, 64 is supplied to the area cutout unit 68. The region cutout unit 68 refers to the motion vectors S66 and S67 supplied from the motion vector separation units 65 and 66, cuts out an image region at a predetermined position from the partial image data of the supplied frame, and cuts out the image region Is supplied to the prediction calculation unit 71. The prediction calculation unit 71 performs a predetermined calculation based on the data S69 supplied from the region cutout unit 68 and the prediction coefficient data S71 supplied from the prediction coefficient ROM 70, and generates an output image as a result. This output image has noise removed or reduced. As described above, the image region cut out by the region cutout unit 68 is used for the calculation for predicting and generating the output image, and thus the image region is referred to as a prediction tap.

  The class tap and the prediction tap cut out by the region cutout units 67 and 68 are respectively the partial image of the target frame stored in the partial image memory 63 including the target pixel to be predicted and the temporal frame before and after the target frame. From the located frame, that is, the partial image of the frame stored in the partial image memories 62 and 63, the pixel of the same spatial position as the pixel of interest and the surrounding pixels located around the pixel of interest is used as a class tap and a prediction tap. Extracted. Here, the cut-out positions are shifted in time according to the motion vectors output from the motion vector separation units 65 and 68, and the cut-out positions of the class tap and the prediction tap in the entire frame are translated according to the motion vectors.

  The generated pixel signal generation unit 72 generates a pixel signal to be supplied to each pixel (light projection unit) from the output image from which noise is removed, and distributes the pixel signal S73 to each pixel.

  Next, a learning circuit for learning a prediction coefficient used in the signal processing unit shown in FIG. 10 will be described. FIG. 11 is a block diagram showing a learning circuit in the present embodiment.

  As shown in FIG. 11, the learning circuit 80 in the present embodiment is different from the first embodiment in that the teacher image data S81 does not correct the superimposition of the projection light. That is, the second teacher image data subjected to the correction for the projection light superimposition is not generated, and the original teacher image data S81 is used. This is because a time delay corresponding to one frame occurs between the projection video signal that is the first video signal (a transmission signal when wirelessly transmitted) and the display video signal that is the second video signal. In consideration of the fact that correction is not always easy, it is more desirable to perform signal transmission by invisible light or wirelessly. The LPF 81, the normal equation calculation unit 91, and the prediction coefficient determination unit 92 have the same configuration as the LPF 31, the normal equation calculation unit 36, and the prediction coefficient determination unit 37 described in the first embodiment, and perform the same processing. Assumed to be performed.

  Of the three partial images of three temporally continuous frames supplied to the partial image memories 83 to 85 via the LPF 82 and the noise superimposing unit 82, the partial images of two temporally continuous frames are motion vector detection units. 86 and 87, the motion vectors are respectively detected, and these two motion vectors and three partial image data are supplied to the region extraction units 88 and 89, respectively. The area cutout unit 89 cuts out the class tap and supplies the class tap to the class code generation unit. The class code generation unit generates a class code and supplies it to the normalized equation calculation unit 91. Further, the region cutout unit 89 cuts out the prediction tap and supplies it to the normalization equation calculation unit 91. The normalization equation calculation unit estimates the prediction coefficient from the teacher data S81 and the prediction tap by the same method as in the first embodiment. The prediction coefficient determined by the prediction coefficient determination unit 92 is sent to the memory 93. The prediction coefficient stored in this memory becomes a prediction coefficient read by the prediction coefficient ROM 70 of the signal processing unit described above.

  In the present embodiment, the motion vector detection is performed on the video projection device side, the result is added to the original image data, the motion vector is detected on the video display side, and between the frames based on the motion vector. A more effective noise suppression effect can be obtained by performing class classification adaptive processing using corresponding pixels.

  In addition, the video signal processing unit 43 in the present embodiment has been described as generating a synthesized video signal by adding a motion vector as additional data, but other examples of the video signal processing unit 43 include, for example, the present application An image data conversion apparatus which is a decoding processing means for suppressing distortion and noise generated with compression encoding such as MPEG distortion as described in Japanese Patent Application Laid-Open No. 10-31458 previously filed by the inventors. Applicable.

  That is, an image data conversion apparatus for correcting block distortion generated in MPEG-decoded image data, a feature amount extraction circuit for extracting feature amounts of image data, and the MPEG decoding based on the extracted feature amounts Cut out the image data, select the class tap and prediction tap, respectively, and generate the compressed data pattern by compressing the image data cut out by the class tap area extraction circuit and the prediction tap extraction circuit respectively, and the class tap extraction circuit An ADRC (Adaptive Dynamic Range Coding) circuit, a class code generation circuit for generating a class code to which the image data extracted by the class tap extraction circuit belongs, and a ROM table in which a prediction coefficient of the estimation formula is stored for each class Based on the prediction coefficient and the image data cut out by the prediction tap cut-out circuit. And a estimation calculation circuit for estimating.

  In addition, a learning circuit for learning a prediction coefficient is included, and learning is performed based on image data before and after the occurrence of block distortion by performing MPEG encoding / MPEG decoding processing in advance in consideration of removal of MPEG distortion by an image data converter. As a result, a prediction coefficient for reproducing the image data from which the MPEG distortion has been removed is generated.

  In this image data conversion apparatus, a prediction coefficient for estimating image data having no block distortion is stored in a ROM table, and estimated based on input image data and a prediction coefficient read from the ROM table. By performing the calculation, it is possible to output image data from which distortion and the like are removed. That is, the image data conversion apparatus performs an estimation calculation based on a prediction coefficient obtained by learning in advance from actual image data. Therefore, an image that reproduces a waveform closer to the actual, has a good image quality, and has no MPEG block distortion. Data can be output.

  In particular, the image data conversion apparatus detects the position of the DCT block of the image data from which block distortion is to be removed by the feature amount extraction circuit, and changes the cutout region and the number of samples of the image data according to the detection result. By following the degree of block distortion, image data with better image quality can be obtained.

  Such an image data conversion apparatus is effective when the image data to be distributed is compressed by MPEG or the like. Then, the projection light projected based on such image data is increased in resolution by a signal processing unit provided on the back side of the screen, re-displayed, compressed by MPEG or the like, and distributed to the projection apparatus side. Even in video, by projecting after removing block distortion etc. on the projection device side, signal processing is performed on the display device side from the projected light, so that an extremely high quality image can be re-displayed on the screen it can.

  Next, a third embodiment of the present invention will be described. 12A and 12B are a front view and a side view taken along line BB, respectively, showing the video display device according to the present embodiment. In the present embodiment, a self-luminous large-sized image display device that can present a high-resolution, high-definition and sufficiently bright image even when the screen is enlarged, and that is easier to install, maintain, and expand the device. It is. In the present invention, the light modulated based on the video signal having additional data for improving the image quality by the signal processing unit is applied to the plurality of light receiving units provided on the video display surface side by the light projection unit. The signal processing unit provided separately based on each output of the light receiving unit in a certain neighboring region generates a high-quality video signal related to the neighboring region and displays it by the light emitting unit. Present the screen, high-quality and high-brightness video. This will be described below.

  Unlike the first and second embodiments, it does not display an image on the screen. As shown in FIG. 12, the image display device 110 according to the third embodiment includes a plurality of light emitting units. A display screen is formed by arranging in a matrix. A light receiving unit 112 is provided at a predetermined position on the display screen including the light emitting unit 111. The light receiving unit 112 detects the received projection light and inputs the obtained signal to the signal processing unit 113 provided in the subsequent stage via the light receiving unit output signal line 112a. The signal processing circuit 113 performs high resolution processing based on the output signal from the light receiving unit 112 to generate a video signal 113 a, and supplies the video signal 113 a to each light emitting unit 111. The light emitting unit 111 emits light based on the supplied video signal 113a and displays an image.

  The light receiving unit 112 uses, for example, various light receiving elements such as a photo diode and a photo transistor with a color filter, and combines the three primary colors of light into one pixel (one light receiving unit). Has been placed. The light receiving unit 112 may be provided with a light receiving unit appropriately divided for each color.

  Each light receiving unit 112 inputs the output signal not only to one signal processing unit 113 but also to the adjacent signal processing unit 113. In the signal processing unit 113, image processing is performed on a partial region of the entire image. At this time, since the output signal of the light receiving unit provided in the vicinity of the region is also used for processing, the light receiving unit output signal included in these regions is input to the first signal processing unit.

  As each signal processing unit 113, for example, an image data conversion device or the like is used to improve the resolution, that is, increase the pixel density, and FIG. This is an example in the case of 16-fold densification that the light emitting unit supports. In the present embodiment, the configuration is the same as that of the signal processing unit in the first embodiment shown in FIG.

  However, this is merely an example, and the density, the number of the light emitting units 111 that the signal processing unit 113 bears, the positional relationship between the light receiving unit 112 and the light emitting unit 111, the pixel arrangement, and the like are not limited thereto. As the light emitting unit 111, a combination of a white lamp and a color filter, an electron tube type such as a CRT, or various elements such as a light emitting diode can be used. Although the light emitting unit 111 and the light receiving unit 112 are arranged on substantially the same plane, a shielding plate (not shown) may be provided so that light from the light emitting unit 111 does not enter the light receiving unit 112.

  In addition, this apparatus can be considered to be configured by developing and arranging on the same plane a unitized unit of the signal processing unit 113. Various signal lines in this unit have a very short wiring length and a very small number of wirings as compared with the case where only one signal processing unit 113 is prepared and handles the entire screen. By handling each unit in this way, it is possible to improve the maintainability and expandability of the apparatus.

  In the case of complete unitization, as shown in FIGS. 13A and 13B, for example, a connector group for easily connecting, disconnecting and terminating the output signal wiring of the light receiving unit between the units. An interface unit 114 can be provided.

  FIGS. 13A and 13B are diagrams showing a video display device according to a modification of the third embodiment of the present invention, each of which is a front view and a side view showing an enlarged side view of the region S2. is there. In this modification, as shown in FIG. 13 (a), a plurality of relatively small-sized video display devices 110a to 110i based on the above-described embodiment are joined together on the same surface, so that one large size is displayed. A large-scale video display device 120 is configured. That is, as shown in FIG. 13A, an example in which a large-scale video display device 120 similar to the small-scale video display device is configured by nine small-scale video display devices 110a to 110i is shown. In order to easily configure the large-scale video display device 120, as shown in FIG. 13B, the output signal lines 112a of the light receiving units 112 in the vicinity of the ends of the adjacent small-scale video display devices 110a to 110i are mutually connected. An interface unit 114 including, for example, a connector group for connecting, disconnecting, and terminating is provided. As a result, the small-scale video display devices 110a to 110i can be extremely easily interconnected and disconnected / terminated.

  Also in the present embodiment, as in the first embodiment, the video display device can be provided to the user in units of small-scale video display devices, and the user's own usage purpose and cost are taken into consideration on the user side. It is possible to connect the interface units of an arbitrary number of small-sized video display devices and assemble and use an arbitrary size video display device.

  The number of small-scale video display devices, the shape of the large-scale video display device constituted by the small-scale video display devices, and the shape and size of each small-scale video display device are limited to those shown in FIG. There is no need.

  In addition, the video signal to be optically projected to the video display device may be projected separately for each region using a plurality of optical projection devices, regardless of the presence or absence of the above-mentioned joining in the video display device, or You may superimpose a part or all. In this case, the region of the light receiving unit to be carried by one light projection device can be arbitrarily set regardless of the scale of the video display device or the position of the unit boundary.

  Next, a fourth embodiment of the video display device according to the present invention will be described. Similar to the second embodiment described above, in the video signal processing unit of the projection device that projects the video on the video display device, for example, a composite video signal having additional data for high image quality such as a motion vector is provided. The composite video signal is generated and projected to the video display device side using a light projection unit using invisible light. In the video display device, as in the third embodiment, a plurality of light receiving units provided on the display screen are used. The projection light to which the additional data is added is received. Then, the output signal from the light receiving unit is supplied to the signal processing circuit having the same configuration as the signal processing circuit shown in FIG. 10, and the signal processing unit improves the quality of the video more efficiently and effectively based on the additional data. Process. The additional data is embedded in a partial image carried by the signal processing unit using an electronic watermarking technique, or projected at a timing (preferably in advance) different from the projection of the original video signal. The method can be used. In addition, when the composite video signal or the additional data is transmitted wirelessly, a receiving unit is provided instead of the light receiving unit.

  Also in the optical projection apparatus of the present embodiment, a video signal processing unit similar to that of the second embodiment described above is provided, and various additional data for the purpose of improving the image quality are generated. A composite video signal added to or embedded in the original video signal is generated. Then, the video signal projection unit modulates the projection light based on the synthesized video signal, and projects this onto the video display surface side.

  In this way, the first signal processing unit on the video display surface side performs more efficient and effective video quality improvement processing based on the additional data. The additional data is embedded in the partial image of the first signal processing unit using electronic watermarking technology, or projected and transmitted at a timing (preferably in advance) different from the projection of the original video signal. For example, a method such as a method is used. Further, as the video signal projection unit in the third and fourth embodiments described above, a projection device using the optical switch shown in FIG. 9 can be used.

  According to the embodiment of the present invention as described above, video display is performed in which light based on the first video signal is projected on the screen, and the signal obtained from the projection light is processed to display the video on the screen. A plurality of light transmitting means provided on the screen for transmitting the projection light, and projected from the surface side of the screen provided at a position facing the light transmitting means on the back side of the screen. A light receiving means for receiving the projection light and outputting a signal based on the projection light; a signal processing means for correcting the output signal from the reception means to generate a second video signal; and the second video Since it has light projection means for projecting light based on the signal from the back side of the screen to the front side of the screen, it is possible to provide a projected image by the projection light with high image quality and high brightness even on a large screen. It can, for example, is suitable as an image display device in a digital cinema.

  In addition, the image display apparatus projects light on the display surface by light based on the first image signal, processes the signal obtained from the projection light, and displays the image on the display surface by self-light emission, A plurality of light receiving means for receiving projection light projected on the display surface and outputting a signal based on the projection light; and correcting the output signal from the light receiving means to generate a second video signal Signal processing means and a light emitting means for emitting light based on the second video signal, so that an image is displayed by self-light emission by the light emitting means, so that even with a large screen, high resolution and high definition and sufficient brightness Can be presented.

  It should be noted that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

(A) And (b) is a figure which shows the video display apparatus in the 1st Embodiment of this invention, Comprising: The front view which each shows a part of screen, and the AA line of FIG. 1 (a) It is a side view. It is a figure which shows the video display apparatus in the modification of the 1st Embodiment of this invention. The block diagram of the signal processing part of the video display apparatus in the 1st Embodiment of this invention is shown. It is a block diagram which shows the learning circuit which learns the prediction coefficient of the signal processing part of the video display apparatus in the 1st Embodiment of this invention. It is a block diagram which shows the video projection apparatus in the 2nd Embodiment of this invention. It is a schematic diagram which shows the data for 1 block projected by the video projection apparatus in the 2nd Embodiment of this invention. (A), (b), and (c) are diagrams showing pixel data of 3 × 8 = 24 bits of RGB, and (d), (e), and (f) are YUV (Y: luminance signal, UV : Color difference signal) (4: 2: 2) 2 × 8 = 16-bit pixel data, each of which is pixel data (hereinafter referred to as original data) of the original video signal S41, and additional data is added to the original data. It is a schematic diagram which shows the pixel data at the time of replacing and adding the pixel data at the time of adding simply and additional data. It is a block diagram which shows the video signal processing part of the video projection apparatus in the 2nd Embodiment of this invention. It is a schematic diagram which shows the video projection part of the video projection apparatus in the 2nd Embodiment of this invention. It is a block diagram which shows the signal processing part of the video display apparatus in the 2nd Embodiment of this invention. It is a block diagram which shows the learning circuit which learns the prediction coefficient of the signal processing part of the video display apparatus in the 2nd Embodiment of this invention. (A) And (b) is each a front view which shows the video display apparatus in the 3rd Embodiment of this invention, and a side view in the BB line shown to Fig.12 (a). (A) And (b) is a figure which shows the video display apparatus in the modification of the 3rd Embodiment of this invention, Comprising: It is a side view which expands a front view and area | region S2, respectively, and shows the side surface. (A) And (b) is a figure which shows the amplification light emission screen as described in a prior art example, Comprising: It is the side view which expands and shows 1 pixel, respectively, and the front view which shows a screen.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 screen, 1a-1i small-scale screen, 2 light transmission part, 4,112 light-receiving part, 4a light-receiving part output signal line, 5, 60,113 signal processing part, 6 light projection part, 6b relay part, 7 projection light, 10 large-scale screen, 12 interface unit, 21 data construction unit, 22a, 22b, 67, 68, 88, 89 area extraction unit, 23, 69, 90 class code generation unit, 24, 70 prediction coefficient ROM, 25, 71 Prediction calculation unit, 26, 72 generation pixel signal output unit, 30 learning circuit, 31, 81 vertical decimation filter LPF, 32 projection light superimposition correction unit, 33, 82 noise superimposition unit, 34a, 34b region cutout unit, 35 class code Generation unit, 36, 91 Normal equation calculation unit, 37, 92 Prediction coefficient determination unit, 38, 93 Memo 41 additional signal generation unit for high image quality, 42 composite signal generation unit, 43 video signal processing unit, 44 video signal projection unit, 51, 52, 53 frame memory, 54, 55, 86, 87 motion vector detection unit, 62 , 63, 64, 83, 84, 85 Partial image memory, 65, 66 Motion vector separation unit, 110 Video display device, 111 Light emitting unit

Claims (9)

A video display device in which light based on a first video signal is projected on a display surface, and a signal obtained from the projection light is processed to display a video on the display surface by self-emission,
A plurality of light receiving means provided in the display surface for receiving projection light projected on the display surface and outputting a signal based on the projection light;
A plurality of signal processing means for correcting the output signal from the light receiving means to generate a second video signal;
Light emitting means for emitting light based on the second video signal,
Each signal processing means also receives the output signal from the said light-receiving means corresponding to the other signal processing means among the said several signal processing means. The video display apparatus characterized by the above-mentioned.   Each of the signal processing means supplies the second video signal of the predetermined area to one or more of the light emitting means provided in the predetermined area of the display surface. From the light receiving means provided in the predetermined area Interface means for transmitting the output signal to other signal processing means provided in another area adjacent to the predetermined area and receiving the output signal from the light receiving means provided in the other area from the other signal processing means The video display device according to claim 1, further comprising:   The video display apparatus according to claim 1, wherein the correction process is an image quality improvement process.   The video display apparatus according to claim 1, wherein the correction process uses a class classification adaptive process.   The image quality improvement processing is high resolution processing for increasing the resolution of the second video signal than the first video signal and / or noise removal processing for removing noise from the first video signal. The video display device according to claim 3.   2. The video display device according to claim 1, further comprising video signal projection means for projecting light based on the first video signal onto the display surface. Video signal processing means for adding additional data to the first video signal and generating a composite video signal;
The video display device according to claim 6, wherein the video signal projecting unit projects light based on the composite video signal onto the display surface.   The video display device according to claim 6, wherein the video signal projection means projects invisible light. A video display method in which light based on a first video signal is projected on a display surface, a signal obtained from the projection light is processed and a video is displayed on the display surface by self-emission,
A light receiving step of receiving projection light projected on the display surface in a plurality of light receiving means provided in the display surface and outputting a signal based on the projection light;
A signal processing step of correcting the output signal output in the light receiving step and generating a second video signal by a plurality of signal processing means;
A light emitting step of emitting light based on the second video signal,
Each signal processing means also receives the output signal from the said light-receiving means corresponding to the other signal processing means among the said several signal processing means. The video display method characterized by the above-mentioned.

Images