JP2005210700A - Signal processor and image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To facilitate synchronization between a signal for displaying an image and a signal whose kind is different from that of the signal for displaying image, or synchronization among a plurality of kinds of signals for displaying images. <P>SOLUTION: To an image display device 150 which displays images, the image signal for displaying the image is supplied. For reproducing devices 222, 224, 226 which reproduce physical effects other than images, a CPU 310 and a RAM 314 are arranged in a signal processor 300, which supplies a control signal for controlling the reproducing devices 222, 224, 226. The CPU 310 stores the image and the control signal which are to be processed in the image display device 150 and the reproducing devices 222, 224, 226 in a state where they are mutually synchronized into a plurality of memory storage areas of the RAM 314, which are mutually associated in position, respectively, prior to supplying to the image display device 150 and to the reproducing devices 222, 224, 226. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a technique for processing a signal for displaying an image, and in particular, a synchronization between a signal for displaying an image and a signal of a different type or a plurality of types of signals for displaying an image. The present invention relates to a technique for facilitating the synchronization of images.

  A conventional example of an image display device that displays an image is disclosed in Patent Document 1. In general, when an image signal corresponding to each pixel constituting an image, that is, a color signal and a luminance signal are input, this type of image display apparatus has a color and luminance corresponding to the color signal and the luminance signal. Each pixel is displayed on the display, thereby displaying the entire image.

  By the way, in order to enhance the sense of presence that an observer can feel while observing an image displayed by an image display device, there is a technique for allowing an observer to experience a physical phenomenon other than an image together with the image. . If this technique is implemented, the observer can observe the image with a higher sense of reality by appealing not only to the visual sense of the observer but also to a sense other than the visual sense.

  For this purpose, a reproduction device that reproduces a physical phenomenon other than an image is installed as a peripheral device together with the image display device, and a control signal for operating the reproduction device is supplied to the reproduction device. The supply of the control signal is performed in synchronization with the supply of the image signal to the image display device.

An example of such a reproduction device is an acoustic device that generates sound, and if this acoustic device is used in combination with an image display device, an observer who observes the image, coupled with the acoustic effect by the acoustic device, A high sense of realism can be felt.
JP 2001-359121 A

  However, in one conventional example of this type of technology, a signal processing device that supplies signals to the image display device and the peripheral device is used, and the signal processing device conventionally controls the image display device. The image signal for controlling the peripheral device and the control signal for controlling the peripheral device are individually stored in a dedicated storage medium.

  Therefore, since the conventional signal processing device operates the peripheral device in synchronization with the display of the image by the image display device, the processing of the image signal in the image display device and the processing of the control signal in the peripheral device are synchronized with each other. Needed special equipment to do. As a result, this conventional signal processing device tends to be complicated in configuration.

  In order to eliminate such inconveniences, the present invention has an object of facilitating synchronization between a signal for displaying an image and a signal of a different type or synchronization of a plurality of types of signals for displaying an image. It was made as.

  The following aspects are obtained by the present invention. Each aspect is divided into sections, each section is given a number, and is described in a form that cites other section numbers as necessary. This is to facilitate understanding of some of the technical features that the present invention can employ and combinations thereof, and the technical features that can be employed by the present invention and combinations thereof are limited to the following embodiments. Should not be interpreted. That is, it should be construed that it is not impeded to appropriately extract and employ the technical features described in the present specification as technical features of the present invention although they are not described in the following embodiments.

  Further, describing each section in the form of quoting the numbers of the other sections does not necessarily prevent the technical features described in each section from being separated from the technical features described in the other sections. It should not be construed as meaning, but it should be construed that the technical features described in each section can be appropriately made independent depending on the nature.

(1) An image display device for displaying an image is supplied with an image signal for displaying the image, while a reproduction device for reproducing a physical phenomenon other than an image is supplied with a control signal for controlling the reproduction device. A signal processing device for supplying
A storage medium;
Prior to supply to the image display device and the reproduction device, the image signal and the control signal to be processed in a state of being synchronized with each other in the image display device and the reproduction device, A signal processing device including: a signal storage unit that stores each of the storage media in a plurality of storage areas that are positionally associated with each other.

  According to the signal processing device according to this section, the physical association between the image signal and the control signal is strengthened as compared with the case where the image signal and the control signal must be stored in separate storage media. The As a result, according to this signal processing device, it is possible to easily and accurately synchronize the image signal and the control signal.

  The “image signal” in this section is defined to include at least a luminance signal representing the luminance of each pixel of the image, or to be defined to include the luminance signal and a color signal representing the color of each pixel, The luminance signal and the color signal can be defined to include a depth signal representing the depth of the image.

  “Physical phenomena other than images” in this section are defined to include other phenomena that can be recognized by human vision (for example, ambient light), or auditory phenomena that can be recognized by human hearing. (E.g., sounds), defined to include haptic phenomena (e.g., temperature, humidity, vibration, tilt, etc.) that can be recognized by human haptics, or recognized by human olfaction It can be defined to include olfactory phenomena (eg, odor).

(2) Furthermore,
A common interface for the image signal and the control signal;
A transmission circuit common to the image signal and the control signal, which transmits the image signal and the control signal read from the storage medium to the image display device and the reproduction device via the interface, respectively. The signal processing apparatus according to item (1).

  According to this signal processing device, since the image signal and the control signal are transmitted to the image display device and the reproduction device via the common interface to each other, they must be transmitted via separate interfaces. In comparison, it may be easy to perform the transmission easily and accurately.

  “Transmission” in this section can be performed by wire or wirelessly.

(3) The image to be displayed by the image display device is composed of a collection of a plurality of frames,
In the storage medium, a frame-by-frame storage area for storing the image signal and the control signal for each frame of the image is allocated in the same number as the number of frames constituting the image,
The signal processing device according to (1) or (2), wherein the signal storage unit stores the image signal and the control signal in the storage area for each frame for each frame of the image.

  According to this signal processing device, the image signal and the control signal are stored in the same storage medium for each frame of the image, so that the image signal and the control signal used in association with the same frame are They are stored in a storage medium in a state of being associated with each other.

  Therefore, according to this signal processing device, the image signal and the control signal used in association with the same frame are read from the storage medium rather than being stored in the storage medium without being associated with each other in position. It is easy to synchronize the output image signal and the control signal for each frame.

(4) The signal storage unit stores the control signal on the upstream side in the direction in which the image signal and the control signal are read from the storage area for each frame and transmitted. The signal processing apparatus according to (3).

  According to this signal processing device, it becomes easy to supply the control signal to the reproduction device prior to the image signal for each frame.

(5) The signal storage unit stores the control signal on the downstream side in the direction in which the image signal and the control signal are read from the storage area for each frame and transmitted. The signal processing apparatus according to (3).

  According to this signal processing device, it becomes easy to supply the image signal to the image display device prior to the control signal for each frame.

(6) One frame of an image to be displayed by the image display device is composed of a collection of a plurality of lines,
In each storage area for each frame, the number of storage areas for each line for storing the image signal and the control signal for each line of each frame of the image is allocated in the same number as the number of lines constituting each frame of the image. And
The signal processing according to any one of (3) to (5), wherein the signal storage unit stores the image signal and the control signal in the storage area for each line for each line of each frame of the image. apparatus.

  According to this signal processing device, the image signal and the control signal are stored in the same storage medium for each line of the image, so that the image signal and the control signal used in association with the same line are They are stored in a storage medium in a state of being associated with each other.

  Therefore, according to this signal processing device, the image signal and the control signal used in association with the same line are read from the storage medium rather than being stored in the storage medium without being associated with each other in position. It is easy to synchronize the output image signal and the control signal for each line.

(7) The signal storage unit stores the control signal on the upstream side in the direction in which the image signal and the control signal are read from the storage area for each line and transmitted. The signal processing device according to (6).

  According to this signal processing device, it becomes easy to supply the control signal to the reproduction device prior to the image signal for each line.

(8) The signal storage unit stores the control signal on the downstream side in the direction in which the image signal and the control signal are read from the storage area for each line and transmitted. The signal processing device according to (6).

  According to this signal processing device, it becomes easy to supply the image signal to the image display device prior to the control signal for each line.

(9) A signal processing device that supplies an image display device for displaying an image, which includes an image signal for displaying the image and including an image signal for the right eye and an image signal for the left eye,
A storage medium;
The right-eye image signal and the right-eye control signal indicating that the image signal is the right-eye image signal, which should be used in a state of being synchronized with each other in the image display device, Prior to supply to the image display device, a first storage unit that stores each of the storage media in a plurality of storage areas that are positionally associated with each other;
The left-eye image signal and the left-eye control signal indicating that the image signal is the left-eye image signal, which should be used in a state of being synchronized with each other in the image display device, Prior to supply to the image display device, a signal processing device including a second storage unit that stores each of the storage media in a plurality of storage areas that are positionally associated with each other.

  According to this signal processing device, when an image signal supplied to the image display device for displaying an image includes a right-eye image signal and a left-eye image signal, the right-eye image signal and the left-eye image signal are displayed. The right-eye image signal and the left-eye image signal can be easily distinguished from each other by the right-eye control signal and the left-eye control signal that are stored in the storage medium in association with the image signal for the eye, respectively. It becomes.

  Further, according to this signal processing device, for each eye of the observer, the image signal and the control signal are stored in the same storage medium in a positional relationship with each other. And the control signal can be easily synchronized with each other.

(10) A signal processing device that supplies an image signal including a luminance signal indicating the luminance of each pixel of the image and a depth signal indicating the depth of the image to an image display device that displays the image,
A storage medium;
The luminance signal and the depth signal, which should be used in a state of being synchronized with each other in the image display device, are positionally associated with each other in the storage medium prior to supply to the image display device. And a signal storage unit for storing in each of the plurality of storage areas.

  According to this signal processing device, the image display device can display an image three-dimensionally. Further, according to this signal processing device, the luminance signal and the depth signal are stored in the same storage medium in a positional relationship with each other, and therefore the luminance signal and the depth signal are synchronized with each other in the image display device. It becomes easy.

(11) An image for receiving an image signal for displaying an image and a control signal to be processed in synchronization with the image signal, and displaying the image based on the received image signal and the control signal A display device,
A common interface for the image signal and the control signal;
Receiving the image signal and the control signal via the interface; a receiving circuit common to the image signal and the control signal;
A separation circuit for separating the image signal and the control signal received by the reception circuit;
An image display device comprising: a display unit configured to display the image based on the image signal and the control signal separated from each other by the separation circuit.

  According to this image display device, since the image signal and the control signal are received via the interface common to them, the reception is simpler and more accurate than when the signals must be received via separate interfaces. Can be easy to do.

(12) The image signal includes at least one of a color signal representing the color of each pixel of the image and a luminance signal representing the luminance of each pixel,
The display unit
A light output unit configured to modulate and output light based on the image signal;
The image display device according to item (11), including: a modulation unit that modulates the modulated light output by the light output unit based on the control signal.

  According to this image display device, if synchronization between the image signal and the control signal is ensured, the light is modulated by the light output unit (for example, a light source having an intensity modulation function or a combination of a light source and an intensity modulator). (For example, intensity modulation) and light modulation (modulation of a feature amount of light other than intensity) by the modulation unit can be performed in synchronization with each other.

(13) The control signal includes a depth signal representing the depth of the image,
The image display device according to (12), wherein the modulation unit includes a wavefront curvature modulation unit that modulates the wavefront curvature of the modulated light output by the light output unit based on the depth signal.

  According to this image display device, since the wavefront curvature of the modulated light output by the light output unit is modulated based on the depth signal, the image is displayed so as to have the depth represented by the depth signal. Perspective is given to the image.

  Furthermore, according to this image display device, if synchronization between the image signal and the depth signal is ensured, light modulation (for example, intensity modulation) by the light output unit and light wavefront curvature modulation by the wavefront curvature modulation unit Can be performed in synchronization with each other.

  Hereinafter, some of more specific embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 conceptually shows a signal processing device 300 according to the first embodiment of the present invention in a block diagram. This signal processing device 300 is configured mainly by a computer 302. As is well known, the computer 302 is configured by connecting a CPU 310, a ROM 312 and a RAM 314 to each other via a bus (not shown).

  As shown in FIG. 1, the signal processing device 300 further includes a transmission circuit 320 and an interface 322. When receiving a transmission command signal from the CPU 310, the transmission circuit 320 reads out necessary data, that is, an image signal and a control signal from the RAM 314 and transmits them to a peripheral device described later via the interface 322.

  As shown in FIG. 1, the signal processing device 300 is connected to an image display device 150, an odor generating device 222, an acoustic device 224, and an illumination device 226 that function as peripheral devices at an interface 322. . The odor generating device 222, the acoustic device 224, and the lighting device 226 are all provided to enhance the sense of presence that the observer of the image displayed by the image display device 150 feels from the image during the observation. It has been.

  The odor generating device 222 is provided in order to appeal to the sense of smell of the five senses of the observer of the image displayed by the image display device 150 and to enhance the sense of presence of the image. The odor generating device 222 is, for example, not illustrated, (a) a plurality of types of storage units (for example, tanks) that store a plurality of types of liquids (for example, fragrance) or gas that generate unique odors, and (B) Among the accommodating portions, those that contain the selected type of liquid or gas are opened, and the valve provided at the outlet is opened, and the selected type of liquid or gas is removed from the opened valve. The room where the observer is present is configured to include a discharge portion (for example, a pressure vaporization type, a filter vaporization type, an ultrasonic vaporization type, etc.) that atomizes and discharges as necessary.

  For example, when the image reproduces a seaside scene, the odor generating device 222 generates a tide scent itself or a scent equivalent thereto, and when the image reproduces a forest scene, the scent of wood itself Alternatively, when an image for relaxation of the observer is displayed by generating an odor corresponding thereto, the fragrance of the herb itself or an odor corresponding thereto can be generated. The odor generating device 222 generates an odor effective for enhancing the sense of presence of an image in an olfactory manner in the same space as the observer in synchronization with the start or development of the image.

  The sound device 224 is provided in order to appeal to the auditory sense among the five senses of the observer of the image displayed by the image display device 150 and to enhance the sense of presence of the image. For example, although not shown in the drawings, this acoustic device 224 takes out (a) a recording unit (for example, a CD) for recording a plurality of types of sound data, and (b) extracts and reproduces the corresponding types of sound data from the recording unit. And a playback unit (for example, a CD player).

  The sound device 224 generates, for example, a sound of a wave as a natural sound or an artificial sound when an image reproduces a seaside scene, and a sound of a bird or a breeze when an image reproduces a forest scene. When the image is generated as a natural sound or an artificial sound and an image for relaxation of the observer is displayed, an environmental sound effective for relaxing the brain can be generated. The sound device 224 generates a sound effective for aurally enhancing the presence of the image in the same space as the observer so as to be synchronized with the start or development of the image.

  The illumination device 226 is provided in order to appeal to the sight of the five senses of the observer of the image displayed by the image display device 150 and to enhance the presence of the image. The lighting device 226 is, for example, (a) an illumination lamp (main illumination lamp or auxiliary illumination lamp) installed in a room where an observer is present, and is one or more types of light. And (b) a control unit that controls the illuminating lamp so that the corresponding type of light is generated from the illuminating lamp.

  For example, when the image reproduces a seaside scene, the lighting device 226 generates light corresponding to the strong sunlight of the sun. When the image reproduces a forest scene, the lighting device 226 reaches the forest from the sun. It can be configured to generate light corresponding to the emitted light. The lighting device 226 generates a sound effective for visually enhancing the sense of presence of the image in the same space as the observer so as to be synchronized with the start or development of the image.

  In short, all of the odor generating device 222, the acoustic device 224, and the lighting device 226 perform physical phenomena other than images so as to synchronize with the start or development of the image in order to enhance the sense of presence of the observed image. It is an example of a reproduction device to reproduce.

  The signal processing device 300 supplies an image signal to the image display device 150 so that the image display device 150 can display the image. The signal processing device 300 further supplies a plurality of types of control signals for controlling the odor generating device 222, the acoustic device 224, and the lighting device 226 to the odor generating device 222, the acoustic device 224, and the lighting device 226, respectively.

  The RAM 314 stores image signals and control signals. The image signal is a signal for specifying the content of the image to be displayed, for example, a color signal for specifying the color of each pixel of the image to be displayed, and a luminance signal for specifying the luminance of each pixel. Etc. On the other hand, the control signal is a signal to be synchronized with the image signal, and is a signal other than the color signal and the luminance signal.

  The control signal is defined to include, for example, a signal that needs to be supplied to the odor generating device 222 in order to cause the odor generating device 222 to generate an odor in synchronization with an image displayed by the image display device 150. It is possible.

  The control signal may be defined to include a signal that needs to be supplied to the acoustic device 224 in order to control the sound by the acoustic device 224 in synchronization with the image displayed by the image display device 150. Is possible.

  The control signal includes a signal that needs to be supplied to the lighting device 226 in order to control the ambient light by the lighting device 226 in synchronization with the image displayed by the image display device 150.

  By the way, when it is necessary for the image display device 150 to display an image three-dimensionally, a depth signal for specifying the depth of the image to be displayed is supplied to the image display device 150 together with at least the luminance signal. is required. For example, the depth signal needs to be supplied to the image display device 150 in association with each pixel, or to be supplied in association with one or a plurality of scanning lines continuous to each other, or It may be necessary to provide one or more frames associated with each other.

  In this embodiment, when an image signal is generated by combining a luminance signal and a depth signal in units of pixels, the depth signal can be handled as a kind of image signal. Furthermore, in the present embodiment, as will be described later, the RAM 314 includes an area in which the control signal can be associated with each pixel and stored in the RAM 314. Therefore, the depth signal is handled as a kind of control signal. Is also possible.

  Next, a logical structure for storing data in the RAM 314 will be described with reference to FIGS.

  As shown in FIG. 2, the RAM 314 is assigned a storage area corresponding to one frame F of an image to be displayed by the image display device 150, that is, a frame-specific storage area 330. As shown in FIG. 2, when it is necessary to display a series of images composed of a plurality of frames F by the image display device 150, the frame-by-frame storage area 330 has the same number as the number of frames F to be displayed. A plurality of image signals corresponding to a series of images provided and displayed by the image display device 150 can be stored.

  Each frame storage area 330 is partitioned into a first storage area 340 and a second storage area 342. The first storage area 340 and the second storage area 342 are partitioned by a horizontal solid line in FIG. Both the first storage area 340 and the second storage area 342 are partitioned into a plurality of line-by-line storage areas 344.

  FIG. 3 shows in detail the configuration of a plurality of storage positions (a bit area, that is, a minimum storage unit described later) in the storage area 330 for each frame. In the case where an image is displayed by the image display device 150, in FIG. 3, the frame-specific storage area 330 is changed from the upper left end of the first storage area 340 in the direction indicated by the one-dot chain line with an arrow in FIG. The second storage area 342 is scanned to the lower right end, so that the stored information (data or signal) is read out serially.

  As shown in FIG. 3, each line storage area 344 has line numbers S (0), S (1), S (2),..., S (M),. Are attached so as to be arranged in a direction from top to bottom in FIG. Each storage area 344 to be noted is specified by line numbers S (0), S (1), S (2), S (3),..., S (M),. . The first storage area 340 located on the upper side in the frame-by-frame storage area 330 is composed of a plurality of line-by-line storage areas 344 having line numbers S (0) to S (M). On the other hand, the second storage area 342 located on the lower side is composed of a plurality of storage areas 344 by line whose line numbers are S (M + 1) to S (N).

  The number of line-by-line storage areas 344 belonging to the first storage area 340 is the same as the number of scanning lines K constituting the frame F to be displayed, as shown on the right side of FIG. Each line-by-line storage area 344 in the first storage area 340 is divided into an image signal storage area 350 and a control signal storage area 352.

  The image signal storage area 350 stores image signals, while the control signal storage area 352 stores control signals. The image signal storage area 350 is arranged on the upstream side of each line-by-line storage area 344, and the control signal storage area 352 is arranged on the downstream side of each line-by-line storage area 344. Each image signal and each control signal are stored in each line storage area 344 in association with each pixel to be displayed.

  As shown in FIG. 3, each line storage area 344 is partitioned into a plurality of bit areas each storing 1-bit data (signal). For example, image signals such as color signals and luminance signals use a plurality of bits of data to represent the color, luminance, etc. of one pixel. These multi-bit data are stored across a plurality of bit areas that are continuous with each other in the line-by-line storage area 344.

  In each bit area, bit numbers P (0), P (1), P (2), ..., P (a), ..., P (b) are arranged from left to right in FIG. It is attached. The image signal storage area 350 and the control signal storage area 352 are distinguished from each other by the size of the bit number. The image signal storage area 350 includes a plurality of bit areas having bit numbers from P (0) to P (a). On the other hand, the control signal storage area 352 includes a plurality of bit areas having bit numbers from P (a + 1) to P (b).

  Therefore, in this embodiment, as shown in FIG. 3, for example, in the first storage area 340, the line number is S (x), and the bit number of the image signal storage area 350 is P (c). The color and brightness of the pixel A shown in FIG. 2 are specified by the image signals stored in the plurality of bit areas that are P (d). In the first storage area 340, the line number is S (x) and the bit number of the control signal storage area 352 is P (e) to P (f). The above-described various controls (odor generation, sound effect control, and ambient light control) are executed in synchronization with the display of the pixel A by the control signal.

  In the present embodiment, the image signal is read out from the RAM 314 serially in the above-mentioned scanning order and line by line and transmitted to the image display device 150, whereby the image display device 150 displays an image.

  Further, in the present embodiment, following the readout of the image signal, a control signal (a control signal stored for each pixel) is serially arranged in the above-described scanning order in the same manner as the image signal, and The data is read from the RAM 314 for each line. When the control signal includes a depth signal, the depth signal is transmitted to the image display device 150, and thereby used for stereoscopic display of an image.

  When the control signal includes a signal for controlling the odor, the signal is transmitted to the odor generator 222. When the control signal includes a signal for controlling sound, the signal is transmitted to the acoustic device 224. When the control signal includes a signal for controlling ambient light, the signal is transmitted to the lighting device 226.

  As described above, the boundary between the first storage area 340 and the second storage area 342 is specified by the line number S (M). The boundary between the image signal storage area 350 and the control signal storage area 352 is specified by the bit number P (a). As shown in FIG. 1, the computer 302 includes a line counter 360 that counts line numbers and a bit counter 362 that counts bit numbers.

  As shown in FIG. 3, the second storage area 342 stores control signals. The control signal stored in the second storage area 342 is supplied to the odor generating device 222, the acoustic device 224, and the lighting device 226 every time an image signal for one frame is transmitted to the image display device 150. This applies to the control signals that are necessary.

  This second storage area 342 is common to the above-described control signal storage area 352 in that it is allocated to the RAM 314 for storing control signals, but it can store control signals only in units of frames. Alternatively, it is different from the control signal storage area 352 in which the control signal can be stored in units of scanning lines.

  Therefore, as a control signal stored in the control signal storage area 352 of the first storage area 340, a depth signal for controlling the depth position of an image to be displayed in synchronization with a pixel to be displayed by the image display device 150, a display This corresponds to a control signal for controlling the acoustic device 224 in synchronization with the scanning line K of the frame F to be processed. On the other hand, the control signal stored in the second storage area 342 corresponds to a signal for controlling the odor generating device 222, the acoustic device 224, or the lighting device 226 in synchronization with the frame F to be displayed.

  Next, a procedure for storing image signals and control signals in the RAM 314 will be described.

  In order to store the image signal and the control signal in the RAM 314, the CPU 310 executes a signal storage program (not shown) or includes an electronic circuit (not shown) (for example, including a line counter 360, a bit counter 362, etc.) that stores the signal. By the operation, the image signal corresponding to each pixel of the image to be displayed is stored in each image signal storage area 350 of the first storage area 340 in the scanning order from the head thereof, and further, the control corresponding to each pixel is performed. The signals are stored in the control signal storage area 352 in the scanning order from the beginning. Further, the CPU 310 stores the control signal in the second storage area 342 in the same manner.

  In this way, the CPU 310 stores the image signal in the image signal storage area 350 and the control signal in the control signal storage area 352 of the first storage area 340 and / or all pixels constituting the image to be displayed. At least one of storing in the second storage area 342 is performed.

  Next, a procedure for reading image signals and control signals from the RAM 314 will be described.

  As shown in FIG. 3, in order to read out the image signal and the control signal from the RAM 314, the transmission circuit 320 first starts from the image signal storage area 350 of the line-by-line storage area 344 whose line number is S (0). Image signals are read serially from the beginning. When the reading is completed, the transmission circuit 320 subsequently reads the control signal from the control signal storage area 352 serially. The read image signal and control signal are transmitted to the image display device 150 by the transmission circuit 320 via the interface 322 common to the image signal and the control signal.

  When the reading of the image signal and the control signal from the line-by-line storage area 344 having the line number S (0) is completed, the transmission circuit 320 similarly stores the line-by-line having the line number S (1). The image signal and control signal stored in the area 344 are read out. In the same manner, the image signals and control signals stored in all the line-by-line storage areas 344 are serially read out by the transmission circuit 320 and transmitted to the image display device 150 via the interface 322.

  The CPU 310 executes a program stored in advance in the ROM 312 in order to execute the signal storage and transmission using the transmission circuit 320, and the program is common with the program described later with reference to FIG. Therefore, detailed description is omitted here.

  The image display device 150 displays an image based on the read image signal, and further reproduces the depth of the image based on the read depth signal as the control signal, whereby the image Is displayed three-dimensionally. Further, the odor generating device 222, the acoustic device 224, and the lighting device 226 are controlled based on the read control signal, so that the image is displayed in synchronization with the image displayed by the image display device 150. A feeling is heightened.

  In the present embodiment, since the control signal to be synchronized with the image signal is stored in the RAM 314 together with the image signal, the control signal is stored in the same manner as the image signal, and further, the interface 322 common to them is used. And can be read out in the same manner as the image signal. Therefore, the image signal and the control signal can be synchronized with each other and stored in the RAM 314, read from the RAM 314, or transmitted from the RAM 314 to the outside.

  Further, in the present embodiment, since the control signal is stored in the frame-by-frame storage area 330 for each frame of the image, various controls based on the control signal are executed in synchronization with the display of each frame by the image display device 150. It becomes easy. Further, since the control signal is stored in each line storage area 344 for each scanning line, various controls based on the control signal can be easily performed in synchronization with the display of each scanning line K by the image display device 150. Become.

  As is apparent from the above description, in the present embodiment, the image display device 150 constitutes an example of the “image display device” in the above section (1), and includes an odor generating device 222, an acoustic device 224, and an illumination device. 226 and an example of the “reproducing device” in the same section, and the RAM 314 to which the frame-specific storage area 330 is allocated constitutes an example of the “storage medium” in the same section. The portion for executing the above or the above-described electronic circuit for signal storage constitutes an example of the “signal storage unit” in the same section.

  Next, a second embodiment of the present invention will be described. However, this embodiment is different from the first embodiment only in the configuration of the storage area 330 for each frame in the RAM 314, and other elements are common. Therefore, the same reference numerals or names are used for the common elements. By using and quoting, redundant description will be omitted, and only the configuration of the frame-by-frame storage area 330 will be described in detail.

  In the first embodiment, as shown in FIG. 3, an image signal storage area 350 is arranged on the upstream side of each line-based storage area 344, and a control signal storage area 352 is arranged on the downstream side thereof. Yes.

  Instead, in the present embodiment, as shown in FIG. 4, the image signal storage area 350 is disposed on the downstream side of each line-based storage area 344, while the control signal storage area 352 is located on the upstream side thereof. Is arranged.

  Since such a configuration is adopted, according to the present embodiment, the control signal is stored in the RAM 314 prior to the image signal, read out from the RAM 314 prior to the image signal, and from the image signal. It becomes easy to transmit first.

  Next, a third embodiment of the present invention will be described. However, since this embodiment has many elements in common with the first embodiment, the common elements are cited by using the same reference numerals or names, thereby omitting redundant descriptions and only different elements. This will be described in detail.

  As shown in FIG. 5, in this embodiment, unlike the first embodiment, a signal processing device 300 is connected to an image display device 400. The image display device 400 displays images on the retinas of the left and right eyes of the user. Therefore, the signal processing device 300 needs to supply the image signal and the control signal to such an image display device 400 separately for the left eye and the right eye.

  Therefore, as shown in FIG. 6, in the present embodiment, the RAM 314 includes a plurality of frame-specific storage areas 330, a left-eye storage area 330 (L) and a right-eye storage area 330 ( R) are alternately arranged.

  As shown in FIG. 5, the image display device 400 includes a receiving circuit 402, a separation circuit 404, a right eye image signal output circuit 410, a right eye control signal output circuit 412, and a left eye image signal output circuit. 420 and a control signal output circuit 422 for the left eye.

  The receiving circuit 402 is provided in common to the image signal and the control signal in order to receive the image signal (color signal and luminance signal) and the control signal (depth signal) from the signal processing device 300.

  The separation circuit 404 first separates the composite signal received from the reception circuit 402 into a composite signal for the left eye and a composite signal for the right eye. Next, each separated combined signal is separated into an image signal and a control signal as will be described later.

  As shown in FIG. 5, the image display device 400 further includes a left-eye lens 430, a left-eye lens driving device 432 that drives the left-eye lens 430, a right-eye lens that is not shown, A right-eye lens driving device (not shown) for driving the ophthalmic lens. Since the right-eye lens and the right-eye lens driving device have the same configuration as the left-eye lens 430 and the left-eye lens driving device 432, respectively, illustration and description thereof are omitted.

  As described above, in each line storage area 344 (shown in FIGS. 2 and 3), the image signal is stored in the image signal storage area 350 whose bit numbers are from P (0) to P (a). Control signals are stored in the control signal storage area 352 whose bit numbers are from P (a + 1) to P (b). Utilizing this fact, the separation circuit 404 separates the signal received from the signal processing device 300 into an image signal and a control signal depending on whether the bit number of the bit counter 362 is equal to or less than P (a).

  The image signal output circuit 420 for the left eye forms an image displayed on a display (not shown) such as a liquid crystal display on the retina of the left eye of the user (observer) by the lens 430 for the left eye. The image signal received from the signal processing device 300 is designed to be output to the display. The image signal includes a color signal of each pixel (a luminance signal for each color).

  The left-eye lens driving device 432 is designed to adjust the position (for example, the position on the optical axis) of the left-eye lens 430 based on the control signal when the control signal is supplied thereto. The control signal includes a depth signal representing the depth of the image. When the left eye lens driving device 432 moves the left eye lens 430 back and forth (in the direction indicated by the arrow in FIG. 5) to shift the focus position of the left eye lens 430, the user (observer) The focal length of the lens in the eyeball is adjusted in order to focus the own eye.

  Thereby, the user can perceive the display image by the image display apparatus 400 in three dimensions. Furthermore, according to the image display device 400, not only a stereoscopic video image with parallax which is performed in a normal three-dimensional display is displayed, but also the user (observer) has less deviation in convergence and has a more realistic feeling. Video can be displayed. In addition, fatigue of the user's eyes is reduced.

  In order to adjust the position of the left-eye lens 430, the left-eye control signal output circuit 422 supplies the control signal received from the signal processing device 300 to the left-eye lens driving device 432. Thereby, the focal position of the left-eye lens 430 is adjusted so that the depth of the image represented by the control signal is realized.

  Next, referring particularly to FIG. 7, the signal processing device 300 transmits the image signal and the control signal from the RAM 314, and the image display device 400 receives the transmitted image signal and the control signal. The signal processing for separating and displaying the image will be described in detail.

  However, since the content of the signal processing described above is common to the left-eye frame storage area 330 (L) and the right-eye frame storage area 330 (R), the left-eye storage area 330 ( L) and the right-eye storage area 330 (R) will be described in detail, and the description of the other will not be repeated.

  In addition, in FIG. 7, the above-described signal processing is represented by a flowchart. This signal processing is performed by a computer 302 of the signal processing device 300 and / or a computer program (not shown) of the image display device 400. It is possible to execute by executing.

  In the signal processing described above, first, in step S1 (hereinafter simply represented by “S1”, the same applies to other steps), the setting of the separation circuit 404 is initialized. Next, in S2, the signal processing apparatus 300 waits for the input of the vertical synchronization signal to the computer 302. If there is an input, the line number stored in the line counter 360 is set to S (0) in S3. Is set.

  Subsequently, in S4, the signal processing apparatus 300 waits for the input of the horizontal synchronizing signal to the computer 302. If there is an input, the bit number stored in the bit counter 362 is set to P (0) in S5. Is set.

  Thereafter, in S6, it is determined whether or not the line number stored in the line counter 360 is equal to or less than S (M). If the line number is less than or equal to S (M), the determination in S6 is YES. In this case, as shown in FIG. 6, the current data reading position in the frame-by-frame storage area 330 is stored in the line-by-line storage area 344 having the line number S (M) located at the lowermost end of the first storage area 340. Since it has not reached, it transfers to S7.

  In S7, it is determined whether or not the bit number of the bit counter 362 is equal to or less than P (a). If the bit number is less than or equal to P (a), the determination in S7 is YES and the process proceeds to S8. In S8, the signal from the RAM 314 is transmitted as an image signal to the image display device 400 by the transmission circuit 320 via the interface 322, and the transmitted signal is an image signal (color signal and luminance signal). Processed by the display device 400.

  Thereafter, in S9, 1 is added to the bit number of the bit counter 362, and the process returns to S7. The execution of S7 to S9 is repeated until the bit number of the bit counter 362 becomes larger than P (a) and the determination of S7 is NO.

  When the bit number of the bit counter 362 is greater than P (a), the determination in S7 is NO, and in S10, the signal from the RAM 314 is used as a control signal as a control signal by the transmission circuit 320 via the interface 322. 400, and the transmitted signal is processed by the image display apparatus 400 as a control signal (depth signal).

  Subsequently, in S11, it is determined whether or not the bit number stored in the bit counter 362 is less than P (b). If the bit number is less than P (b), the determination in S11 is YES, 1 is added to the bit number of the bit counter 362 in S9, and the process returns to S7.

  When the execution of S7, S10, S11, and S9 is repeated several times and the bit number stored in the bit counter 362 becomes P (b), the determination in S11 is NO. In this case, since transmission and reception of the signal for one line is completed, 1 is added to the line number stored in the line counter 360 in S12, and the process returns to step S4.

  When the line number of the line counter 360 becomes larger than S (M), the determination in S6 is NO and the process proceeds to S13. In S13, it is determined whether or not the line number of the line counter 360 is equal to or less than S (N). If the line number is equal to or less than S (N), the determination in S13 is YES, and in S14, a signal from the RAM 314 is transmitted as a control signal to the image display device 400 via the interface 322 by the transmission circuit 320. At the same time, the transmitted signal is processed by the image display apparatus 400 as a control signal.

  Thereafter, in S15, it is determined whether or not the bit number of the bit counter 362 is less than P (b). If the bit number is less than P (b), the determination in S15 is YES, and in S16, 1 is added to the bit number stored in the bit counter 362, and the process returns to S14. In S14, a signal from the RAM 314 is transmitted as a control signal to the image display device 400 by the transmission circuit 320 via the interface 322, and the transmitted signal is processed by the image display device 400 as a control signal. .

  When the execution of S14 to S16 is repeated several times and the bit number stored in the bit counter 362 becomes P (b), the determination in S15 is NO. In this case, since transmission and reception of signals for one line have been completed, 1 is added to the line number stored in the line counter 360 in S12, and the process returns to S4.

  If the line number of the line counter 360 is S (N), the determination in S13 is NO. In this case, transmission and reception of image signals and control signals in one frame-specific storage area 330 are completed.

  Thereafter, in the same manner, the image signals and control signals stored in all the frame-by-frame storage areas 330 are transmitted to the image display device 400. As a result, the image display device 400 processes the image signals and control signals to generate images. Is displayed.

  As is apparent from the above description, in the present embodiment, the image display device 400 constitutes an example of the “image display device” in the item (9), and the signal processing device 300 is the “signal processing device” in the same term. The RAM 314 constitutes an example of “storage medium” in the same paragraph, and the computer 302 includes an example of “first storage unit” and an example of “second storage part” in the same paragraph. It has been done.

  Next, a fourth embodiment of the present invention will be described. However, this embodiment differs from the third embodiment only in the configuration of the storage area 330 for each frame in the RAM 314, and the other elements are common, so the same reference numerals or names are used for the common elements. By using and quoting, redundant description will be omitted, and only the configuration of the frame-by-frame storage area 330 will be described in detail.

  In the third embodiment, as shown in FIG. 6, a plurality of line-by-line storage areas 344 are stored in the RAM 314 as a left-eye storage area 330 (L) and a right-eye storage area 330 (R). Are allocated alternately and in a fixed order. None of the frame-by-frame storage areas 330 stores a control signal S for identifying the left-eye frame-by-frame storage area 330 (L) and the right-eye frame-by-frame storage area 330 (R) from each other.

  Instead, in the present embodiment, as shown in FIG. 8, the image signal storage area 350 is disposed on the downstream side of each line-based storage area 344, while the control signal storage area 352 is upstream of the image signal storage area 352. Is arranged. The control signal storage area 352 stores a control signal S for identifying the left-eye frame storage area 330 (L) and the right-eye frame storage area 330 (R) from each other.

  Since such a configuration is adopted, according to the present embodiment, for example, in the separation circuit 404, the control signal S stored at the head in the storage area 330 for each frame is first referred to, so It becomes easy to determine whether the separate storage area 330 corresponds to either the left-eye frame storage area 330 (L) or the right-eye frame storage area 330 (R).

  Next, a fifth embodiment of the present invention will be described. However, since the present embodiment has many elements in common with the first embodiment described above with reference to FIG. 1, the common elements are referred to by using the same reference numerals or names, and redundant description is given. Is omitted, and only different elements will be described in detail.

  In the first embodiment, as shown in FIG. 1, the signal processing device 300 is connected to the image display device 150 and further controls the environment in which the observer observes the display image displayed by the image display device 150. The device is connected to the odor generating device 222, the acoustic device 224, and the lighting device 226.

  On the other hand, in the present embodiment, as shown in FIG. 9, a reproduction system 500 that has an image display function and an environment control function, and reproduces a physical phenomenon so that a user can associate a specific scene more realistically. The signal processing device 300 is connected to the.

  Therefore, in the present embodiment, the signal processing device 300 positionally associates the image signal for image display and the control signal for environment control with each other in the RAM 314 in the same manner as in the third embodiment. Further, the image signal and the control signal are transmitted to the reproduction system 500 using the transmission circuit 320 and the interface 322 common to them. The signal processing device 300 transmits a combined signal obtained by combining the image signal and the control signal to the reproduction system 500.

  As shown in FIG. 9, the reproduction system 500 includes a separation circuit 504 that separates a composite signal received serially from the signal processing device 300 into an image signal and a control signal. The separation circuit 504 performs signal separation in the same manner as in the third embodiment. For example, the separation circuit 504 performs signal separation in cooperation with the computer 302 of the signal processing circuit 300 executing a program similar to the program shown in FIG.

  The reproduction system 500 further includes an image control circuit 506 and an environment control circuit 508. The reproduction system 500 further includes a projector 510 as an image display device and a chair drive device 512 as an environment control device.

  As is well known, the projector 510 displays an image by projecting light reflecting the image signal onto the screen 520 based on the image signal. In order to perform this function, the image control circuit 506 supplies the image signal received from the separation circuit 504 to the projector 510.

  The chair driving device 512 moves or rotates a chair 522 (or a floor) on which an observer who observes a display image by the projector 510 in an arbitrary direction in an xyz orthogonal coordinate system defined in space or an arbitrary coordinate axis. Thereby, the observer can experience a straight line or rotational movement, vibration, impact, inclination, etc. during observation. To perform this function, the environment control circuit 508 supplies the control signal received from the separation circuit 504 to the chair driving device 512.

  An image signal and a control signal are supplied from the image control circuit 506 and the environment control circuit 508 to the projector 510 and the chair driving device 512 in a state of being synchronized with each other. As a result, the chair 522 is controlled by the chair driving device 512 in synchronization with the display of the image by the projector 510. Therefore, the observer of the image can feel a high sense of realism by the movement of the chair 522 synchronized with the display image during the observation.

  As is clear from the above description, in the present embodiment, the projector 510 constitutes an example of the “image display device” in the above item (1), and the chair drive device 512 constitutes an example of the “reproduction device” in the same term. The RAM 314 configured and allocated with the frame-specific storage area 330 constitutes an example of the “storage medium” in the same section, and a portion of the computer 302 that executes a program corresponding to the program shown in FIG. It constitutes an example of a “storage unit”.

  Further, in the present embodiment, the projector 510 constitutes an example of the “image display device” in the item (10), the signal processing device 300 constitutes an example of the “signal processing device” in the item, and the RAM 314 The “storage medium” in the section is configured, and the computer 302 configures an example of the “signal storage unit” in the section.

  Next, a sixth embodiment of the present invention will be described. However, since the present embodiment has many elements in common with the second embodiment described above with reference to FIG. 5, the common elements are referred to by using the same reference numerals or names, thereby overlapping description. Is omitted, and only different elements will be described in detail.

  As shown in FIG. 10, in the present embodiment, a retinal scanning display (hereinafter abbreviated as “RSD”) 600 as an image display device is connected to the signal processing device 300. The RSD 600 modulates the intensity of the image light of each color based on the luminance signal for each color, uses the intensity-modulated image light as modulated light, and modulates the wavefront curvature thereof based on the depth signal. The RSD 600 projects the image light directly onto the retina of the observer's eye and scans the image light on the retina, thereby enabling the observer to perceive the image in three dimensions.

  Therefore, in the present embodiment, the signal processing device 300 transmits to the RSD 600 a synthesized signal obtained by synthesizing the image signal including the luminance signal for each color and the control signal including the depth signal. The RSD 600 receives the combined signal at the receiving circuit 402. The received composite signal is then supplied to the separation circuit 404 and separated into an image signal and a control signal, that is, a luminance signal and a depth signal.

  As illustrated in FIG. 10, the RSD 600 further includes a signal processing circuit 602, a light source unit 604, a wavefront curvature modulation unit 606, and a scanning unit 608. The signal processing circuit 602 controls intensity modulation by the light source unit 604 and wavefront curvature modulation by the wavefront curvature modulation unit 606 based on the image signal and the depth signal supplied in parallel from the separation circuit 404.

  As shown in FIG. 10, the light source unit 604 includes a red light source 610, a green light source 612, and a blue light source 614 as light sources. The light source unit 604 further includes a red light source driver 620, a green light source driver 622, and a blue light source driver 624 as light source drivers.

  The light source unit 604 further includes collimator lenses 630, 632, 634, wavelength selective mirrors 640, 642, 644, and a focus lens 650.

  Based on the image signal output from the separation circuit 404, the signal processing circuit 602 applies to the red light source driver 620, the green light source driver 622, and the blue light source driver 624 that drive the red light source 610, the green light source 612, and the blue light source 614, respectively. The intensity modulation signal corresponding to each color is output.

  As shown in FIG. 10, the wavefront curvature modulation unit 208 includes a convex lens 652, a position variable mirror 654, a mirror driving unit 656, and a half mirror 658. The modulated light H emitted from the focus lens 650 of the light source unit 604 is transmitted to the half mirror 658 via the optical fiber 660. The half mirror 658 is an entrance of the modulated light H to the wavefront curvature modulation unit 208.

  As shown in FIG. 11, the position variable mirror 654 is provided on the optical axis of the convex lens 652. The position variable mirror 654 is provided to be movable between a focal position f of the convex lens 652 and a position a close to the convex lens 652 from the focal position f. In FIG. 11, the position b is an intermediate position between the position a and the focal position f. In FIG. 11, the position variable mirror 654 is shown in a state where the reflection surface thereof is located at the position a.

  As shown in FIG. 11, when the position variable mirror 654 is located at a position a closer to the convex lens 652 than the focal position f of the convex lens 652, as shown by a solid line in FIG. Perception is performed at a nearby position P1. The reason is as follows.

  In the example shown in FIG. 11, the position variable mirror 654 is located inside the focal point f of the convex lens 652. Therefore, as indicated by the alternate long and short dash line in FIG. 11, the modulated light H emitted as parallel light from the convex lens 652 side toward the position variable mirror 654 is reflected by the position variable mirror 654 and converted into diffused light. When the modulated light H thus converted into diffused light enters the observer's eye W, the observer perceives an image at a position P1 in FIG.

  On the other hand, when the position variable mirror 654 is located at the focal position f of the convex lens 652, the modulated light H reflected from the position variable mirror 654 enters the observer's eye M as parallel light. As a result, the observer perceives the image at a distant position P2, as indicated by a broken line in FIG.

  The mirror driving unit 656 shown in FIG. 11 is formed using, for example, a piezoelectric element. When the mirror driving unit 656 is formed using a piezoelectric element, for example, the position variable mirror 654 described above can be attached to a surface that intersects the electric field application direction among a plurality of surfaces of the piezoelectric element.

  In this example, when the voltage applied to the piezoelectric element, that is, the electric field is changed, the thickness of the piezoelectric element changes. If the thickness of the piezoelectric element changes, the position variable mirror 654 can be moved away from the convex lens 652 or brought closer to the convex lens 652, and as a result, the position variable mirror 654 can be moved to the position a, position b and focal position f described above. Can be moved to any of them.

  The position of the position variable mirror 654 is controlled based on the depth signal V. Specifically, the depth signal V is output from the signal processing circuit 602 to the driver 662, and the driver 662 controls the mirror driving unit 656 based on the depth signal. The position variable mirror 654 is controlled to a position reflecting the depth signal V by the mirror driving unit 656. Therefore, by changing the depth signal V, the depth position of the image to be displayed can be changed to an arbitrary position between the position P1 and the position P2 shown in FIG. 10, for example.

  As shown in FIG. 10, the scanning unit 206 includes a horizontal scanning mirror 670, relay lenses (for example, convex lenses) 672 and 674, a vertical scanning mirror 680, and relay lenses (for example, convex lenses) 682 and 684. Yes.

  As shown in FIG. 10, the horizontal scanning mirror 670 is provided to be rotatable around the rotation axis L1. The horizontal scanning mirror 670 reflects the modulated light H emitted from the half mirror 658 in a direction corresponding to the rotational position of the horizontal scanning mirror 670. The rotation of the horizontal scanning mirror 670 is controlled based on the above-described horizontal synchronization signal.

  The vertical scanning mirror 680 is provided so as to be swingable about the rotation axis L2. The rotation of the vertical scanning mirror 680 is controlled based on the above-described vertical synchronization signal.

  Relay lenses 672 and 674 transmit modulated light H reflected from horizontal scanning mirror 670 to vertical scanning mirror 680. The relay lenses 682 and 684 transmit the modulated light H reflected from the vertical scanning mirror 680 to the retina.

  The RSD 600 includes a projection unit 690 that projects the modulated light H (image light) emitted from the relay lenses 682 and 684 onto the retina of the observer's eye. The projection unit 690 includes a mirror (total reflection mirror or half mirror) 694 disposed immediately in front of the eye. The mirror 694 causes image light emitted from the relay lenses 682 and 684 toward the retina. The image light is reflected and imaged on the retina.

  Therefore, according to the present embodiment, in the signal processing device 300, as described above, the image signal G stored in the same frame-specific storage area 330 and the depth signal V as the control signal are transmitted to the same interface 322. Therefore, the image signal G and the depth signal V can be easily synchronized with each other in the RSD 600.

  In addition, a storage medium may be provided in the RSD 600, and a storage area similar to the storage area by frame 330 of the RAM 314 of the signal processing device 300 may be provided in the storage medium.

  As is clear from the above description, in the present embodiment, the RSD 600 constitutes an example of the “image display device” according to the item (10), and the signal processing device 300 is an example of the “signal processing device” in the term. The RAM 314 constitutes an example of the “storage medium” in the same term, and the computer 302 constitutes an example of the “signal storage unit” in the same term.

  As described above, some of the embodiments of the present invention have been described in detail with reference to the drawings. However, these are exemplifications, and are based on the knowledge of those skilled in the art including the aspects described in the section of [Disclosure of the Invention]. The present invention can be implemented in other forms with various modifications and improvements.

1 is a block diagram conceptually showing a signal processing device 300 according to a first embodiment of the present invention together with some peripheral devices thereof. FIG. 2 is a diagram conceptually illustrating a configuration of a RAM 314 in FIG. 1 in association with a frame configuration of an image. FIG. 3 is a diagram conceptually illustrating the configuration of a RAM 314 in FIG. 2 in more detail. It is a figure which represents notionally the structure of RAM314 in the signal processing apparatus 300 according to 2nd Embodiment of this invention. It is a block diagram which represents notionally the signal processing apparatus 300 according to 3rd Embodiment of this invention with the image display apparatus 400. FIG. It is a figure which represents notionally the structure of RAM314 in FIG. 6 is a flowchart for conceptually explaining signal processing in the signal processing device 300 and the image display device 400 shown in FIG. 5. It is a figure which represents notionally the structure of RAM314 in the signal processing apparatus 300 according to 4th Embodiment of this invention. FIG. 10 is a block diagram conceptually showing a signal processing apparatus 300 according to a fifth embodiment of the present invention, together with a reproduction system 500. FIG. 10 is a system diagram conceptually showing a retinal scanning display 600 used with a signal processing device 300 according to a sixth embodiment of the present invention. It is a side view which expands and shows the wavefront curvature modulation part 606 in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 150 Image display apparatus 222 Odor generation apparatus 224 Sound apparatus 226 Illumination apparatus 302 Computer 314 RAM
330 Storage area by frame

Claims (13)

An image display device for displaying an image is supplied with an image signal for displaying the image, while a reproduction device for reproducing a physical phenomenon other than the image is supplied with a control signal for controlling the reproduction device. A signal processing device comprising:
A storage medium;
Prior to supply to the image display device and the reproduction device, the image signal and the control signal to be processed in a state of being synchronized with each other in the image display device and the reproduction device, A signal processing device including: a signal storage unit that stores each of the storage media in a plurality of storage areas that are positionally associated with each other. further,
A common interface for the image signal and the control signal;
A transmission circuit common to both the image signal and the control signal, which transmits the image signal and the control signal read from the storage medium to the image display device and the reproduction device via the interface, respectively. The signal processing device according to claim 1, comprising: The image to be displayed by the image display device is composed of a collection of a plurality of frames,
In the storage medium, a frame-by-frame storage area for storing the image signal and the control signal for each frame of the image is allocated in the same number as the number of frames constituting the image,
The signal processing apparatus according to claim 1, wherein the signal storage unit stores the image signal and the control signal in the storage area for each frame for each frame of the image.   The said signal storage part stores the said control signal in the upstream in the direction where the said image signal and the said control signal are read and transmitted from the memory area according to each frame among the said memory areas according to each frame. 4. The signal processing device according to 3.   The said signal storage part stores the said control signal in the downstream in the direction where the said image signal and the said control signal are read and transmitted from the memory area according to each frame among the said memory areas according to each frame. 4. The signal processing device according to 3. One frame of an image to be displayed by the image display device is composed of a collection of a plurality of lines,
In each storage area for each frame, the number of storage areas for each line for storing the image signal and the control signal for each line of each frame of the image is allocated in the same number as the number of lines constituting each frame of the image. And
The signal processing device according to claim 3, wherein the signal storage unit stores the image signal and the control signal in the storage area for each line for each line of each frame of the image.   The signal storage unit stores the control signal on an upstream side in a direction in which the image signal and the control signal are read from the storage area for each line and transmitted from among the storage areas for each line. 6. The signal processing device according to 6.   The said signal storage part stores the said control signal in the downstream in the direction where the said image signal and the said control signal are read and transmitted from the storage area according to each line among the said storage areas according to each line. 6. The signal processing device according to 6. A signal processing device that supplies an image display device that displays an image, which includes an image signal for displaying the image, including an image signal for the right eye and an image signal for the left eye,
A storage medium;
The right-eye image signal and the right-eye control signal indicating that the image signal is the right-eye image signal, which should be used in a state of being synchronized with each other in the image display device, Prior to supply to the image display device, a first storage unit that stores each of the storage media in a plurality of storage areas that are positionally associated with each other;
The left-eye image signal and the left-eye control signal indicating that the image signal is the left-eye image signal, which should be used in a state of being synchronized with each other in the image display device, Prior to supply to the image display device, a signal processing device including a second storage unit that stores each of the storage media in a plurality of storage areas that are positionally associated with each other. A signal processing device that supplies an image signal including a luminance signal representing the luminance of each pixel of the image and a depth signal representing the depth of the image to an image display device that displays the image,
A storage medium;
The luminance signal and the depth signal, which should be used in a state of being synchronized with each other in the image display device, are positionally associated with each other in the storage medium prior to supply to the image display device. And a signal storage unit for storing in each of the plurality of storage areas. An image display device that receives an image signal for displaying an image and a control signal to be processed in synchronization with the image signal, and displays the image based on the received image signal and the control signal There,
A common interface for the image signal and the control signal;
Receiving the image signal and the control signal via the interface; a receiving circuit common to the image signal and the control signal;
A separation circuit for separating the image signal and the control signal received by the reception circuit;
An image display device comprising: a display unit configured to display the image based on the image signal and the control signal separated from each other by the separation circuit. The image signal includes at least one of a color signal representing the color of each pixel of the image and a luminance signal representing the luminance of each pixel,
The display unit
A light output unit configured to modulate and output light based on the image signal;
The image display device according to claim 11, further comprising: a modulation unit that modulates the modulated light output by the light output unit based on the control signal. The control signal includes a depth signal representing the depth of the image,
The image display device according to claim 12, wherein the modulation unit includes a wavefront curvature modulation unit that modulates a wavefront curvature of the modulated light output by the light output unit based on the depth signal.

Images