JP2022146782A - Display device, display system, display method and program - Google Patents

Abstract

To suppress the variation in a display position of a three-dimensional image.SOLUTION: A display device according to an embodiment of the present invention is the display device which displays a three-dimensional image with a residual image effect and comprises: an irradiation object member which displays the three-dimensional image by reflecting the irradiated image light; a drive unit which drives the irradiation object member; an image acquisition unit which acquires two-dimensional image data generated according to at least one of an angle and a position of the driven irradiation object member; an irradiation unit which irradiates the irradiation object member with the image light based on the two-dimensional image data; a detection unit which outputs a light reception signal by receiving partial image light being a portion of the image light; and a change unit which changes the two-dimensional image data on the basis of the light reception signal and drive cycle information indicating the drive cycle by the drive unit.SELECTED DRAWING: Figure 6

Description

The present application relates to a display device, a display system, a display method and a program.

Conventionally, a configuration has been disclosed in which a two-dimensional image is projected onto an irradiated member such as a projection screen while the irradiated member is being driven, and a three-dimensional image is displayed using an afterimage effect.

Also, a drive system for a projection screen of a swept-plane volumetric three-dimensional display, wherein the actuators for driving the projection screen and indicating when the actuators are in position for synchronizing the projection apparatus A configuration is disclosed that resets a counter for two-dimensional image data projected by a projection device when a home position signal is received by an arithmetic device (see, for example, Japanese Laid-Open Patent Publication No. 2002-100003).

However, in the configuration of Patent Document 1, the display position of the 3D image fluctuates because the time from the transmission of the 2D image data to the irradiation unit of the projection device to the irradiation of the image light is not constant. I have concerns.

An object of the present invention is to suppress variation in the display position of a three-dimensional image.

A display device according to an aspect of the present invention is a display device that displays a three-dimensional image by an afterimage effect, and includes an irradiated member that displays the three-dimensional image by reflecting irradiated image light; a driving unit that drives an irradiation member; an image acquisition unit that acquires two-dimensional image data generated according to at least one of the angle and position of the driven irradiated member; an irradiation unit that irradiates the member to be irradiated with image light; a detection unit that outputs a light reception signal received by receiving partial image light that is a part of the image light; drive cycle information that indicates a drive cycle of the drive unit; and a changing unit that changes the two-dimensional image data based on the received light signal.

According to the present invention, fluctuations in the display position of a three-dimensional image can be suppressed.

1 is a block diagram of an example of the overall configuration of a display device according to an embodiment; FIG. 1 is a perspective view of an example of the overall configuration of a display device according to an embodiment; FIG. 4 is a diagram of a hardware configuration example of an information processing unit of the display device according to the embodiment; FIG. 3 is a diagram of an example functional configuration of an information processing unit of the display device according to the embodiment; FIG. It is a figure which shows the example of a process by the information processing part which concerns on embodiment. It is a figure which shows the structural example of the display apparatus which concerns on 1st Embodiment. 3 is a diagram of a functional configuration example of an information processing unit of the display device according to the first embodiment; FIG. It is a figure which shows an example of two-dimensional image data. It is a figure showing an example of image light concerning a 1st embodiment. FIG. 4 is a diagram showing an example of processing by an information processing unit of the display device according to the first embodiment; FIG. 4 is a timing diagram illustrating signal timings according to the first embodiment; It is a figure which illustrates the to-be-irradiated member which concerns on a modification. It is a figure showing an example of image light concerning a 2nd embodiment. FIG. 7 is a timing diagram illustrating signal timings according to the second embodiment;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments for carrying out the invention will be described with reference to the drawings. In each drawing, the same components are denoted by the same reference numerals, and redundant description may be omitted.

The embodiments shown below are examples of display devices for embodying the technical idea of the present invention, and the present invention is not limited to the embodiments shown below. The dimensions, materials, shapes, relative positions, etc. of the components described below are intended to be illustrative rather than limiting the scope of the present invention unless otherwise specified. It is. Also, the sizes and positional relationships of members shown in the drawings may be exaggerated for clarity of explanation.

In the drawings shown below, directions may be indicated by the X-axis, Y-axis, and Z-axis. indicates a given direction within. A Y-direction along the Y-axis indicates a direction orthogonal to the predetermined direction in the plane. The Z-direction along the Z-axis indicates the direction along the axis of rotation of the spiral screen described above.

In addition, the direction in which the arrow points in the X direction is indicated as +X direction, the direction opposite to +X direction is indicated as -X direction, the direction in which the arrow points in Y direction is indicated as +Y direction, and the direction opposite to +Y direction is indicated as -Y direction. , the direction in which the arrow points in the Z direction is denoted as the +Z direction, and the direction opposite to the +Z direction is denoted as the -Z direction. It is assumed that the display device emits image light in the +Z direction. However, these do not limit the orientation of the display device, and the display device can be arranged in any orientation.

[Embodiment]
The display device 1 according to the embodiment displays a three-dimensional image with an afterimage effect. Here, a three-dimensional image refers to a three-dimensional image that is displayed in a three-dimensional space and has a human-visible volume.

(Overall Configuration Example of Display Device 1)
The overall configuration of the display device 1 will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 is a block diagram illustrating an example of the overall configuration of a display device 1. As shown in FIG.

As shown in FIG. 1 , the display device 1 has an information processing section 10 , a projector 20 , a spiral screen 30 , a motor 40 and a motor control section 41 .

The display device 1 receives the three-dimensional model data 901 and allows the user of the display device 1 to view the three-dimensional image. The 3D model data 901 is data indicating a 3D model for allowing the user to visually recognize a 3D image, and is, for example, data indicating pixel values for each 3D voxel. Specifically, the three-dimensional model data 901 is input to the information processing section 10 .

The information processing section 10 generates two-dimensional image data P based on the input three-dimensional model data 901 . Specifically, the information processing section 10 transmits a rotation instruction signal 201 to the motor control section 41 to instruct the start of rotation. The motor control unit 41 that has received the instruction transmits a rotation control signal 202 to drive the motor 40 so as to rotate the spiral screen 30 at a prescribed substantially constant speed, for example.

The spiral screen 30 is an example of an irradiated member that displays a three-dimensional image by reflecting the irradiated image light L. FIG. The spiral screen 30 is an object including a plurality of spiral-shaped members rotated by a motor 40, and functions as a screen that receives image light L irradiation. Each member has a different color. Here, a spiral is a type of three-dimensional curve that moves in a direction perpendicular to the plane of rotation while rotating.

The motor 40 is an example of a driving section that rotates the spiral screen 30 around a predetermined axis. A stepping motor, a DC (Direct Current) motor, an AC (Alternating Current) motor, or the like can be applied to the motor 40 .

A rotary encoder is attached to the motor 40 . The rotary encoder transmits an encoder signal 203 indicating the rotation angle of the rotating shaft of the motor 40 to the motor control section 41 . The motor control unit 41 generates rotation angle information 904 indicating the rotation angle of the spiral screen 30 based on the received encoder signal 203 and transmits the rotation angle information 904 to the information processing unit 10 .

Based on the received rotation angle information 904 , the information processing section 10 generates two-dimensional image data P corresponding to the rotation angle of the spiral screen 30 and transmits it to the projector 20 . The two-dimensional image data P is information representing a two-dimensional image corresponding to either the angle or the position of the rotated spiral screen 30 .

The projector 20 is an example of an irradiation unit that irradiates the image light L onto the spiral screen 30 . The projector 20 irradiates the spiral screen 30 with image light L based on the two-dimensional image data P output from the information processing section 10 .

In the display device 1, the image light L applied to the rotating spiral screen 30 is reflected at various positions by the spiral-shaped member of the spiral screen 30, and the display device 1 utilizes the afterimage effect to display a color three-dimensional image. can be visually recognized by the user. The light reflected by the spiral screen 30 includes light that enters from one surface of the spiral screen 30 , passes through the inside of the spiral screen 30 , and is reflected by the other surface of the spiral screen 30 .

Next, FIG. 2 is a perspective view illustrating an example of the overall configuration of the display device 1. As shown in FIG. As shown in FIG. 2 , the display device 1 has an information processing section 10 , a projector 20 , a motor 40 and a motor control section 41 inside a housing 60 . The display device 1 also has the spiral screen 30 and the screen case 50 on the +Z direction side of the housing 60 .

The housing 60 is a box-shaped member configured by combining panel plates including sheet metal or the like. A through hole 62 communicating with the inside of the housing 60 is provided in the top panel 61 of the housing 60 .

The screen case 50 is a cylindrical member in which the spiral screen 30 is arranged. The screen case 50 is configured including a material such as transparent resin or glass. The spiral screen 30 supported inside the screen case 50 is visible from the outside of the screen case 50 .

The screen case 50 is not limited to a cylindrical member, and may be a tubular member having an elliptical cross section or a polygonal cross section. Further, the end portion on the side opposite to the side on which the image light L is incident in the direction along the central axis of the cylinder may be open, or may be closed with a flat plate, a hollow hemispherical member, or the like.

Furthermore, the display device 1 has a motor 40 above the spiral screen 30 . A shaft center member serving as a rotating shaft of the motor 40 is connected to the spiral shaft E of the spiral screen 30 . A spiral axis is a central axis of rotation when a three-dimensional curve rotates in a spiral. The rotation of the motor 40 allows the spiral screen 30 to rotate around the spiral axis E. Note that the spiral axis E is an example of a predetermined axis.

Also, the motor 40 is connected to the motor control section 41 so as to be able to communicate therewith. The rotating shaft of the motor 40 is substantially parallel to the traveling direction of the image light L emitted from the projector 20 . The process of specifying the position of the spiral screen 30 using three-dimensional coordinates including the Z-axis with the traveling direction of the image light L as positive will be described.

Specifically, the information processing section 10 calculates the +Z direction height z(x, y) of the spiral screen 30 at each xy coordinate (x, y). The calculated height z(x, y) is the height along the rotation axis of the spiral screen 30 and corresponds to the position where the surface of the spiral screen 30 is irradiated with the image light L. The information processing unit 10 calculates in real time the height z(x, y) that changes according to time, and generates two-dimensional image data P corresponding to each time.

As a reference for the height, the XY plane that includes the point of the spiral screen 30 that is the shortest from the projector 20 is the XY plane that indicates z=0. This XY plane is a plane perpendicular to the rotation axis of the spiral screen 30, and the xy coordinates are coordinates on the XY plane.

In this embodiment, the configuration in which the information processing unit 10, the projector 20, the motor 40, and the motor control unit 41 are provided inside the housing 60 is exemplified. Some or all of them may be provided outside the housing 60 .

<Hardware Configuration Example of Information Processing Unit 10>
Next, the hardware configuration of the information processing section 10 will be described with reference to FIG. FIG. 3 is a diagram showing an example of the hardware configuration of the information processing section 10. As shown in FIG.

The information processing unit 10 is constructed by a computer, and includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an HDD (Hard Disk Drive) 104, and an external It has a device connection I/F (Interface) 105 and a network I/F 106 .

The CPU 101 executes control processing including various arithmetic processing. The ROM 102 stores programs used to drive the CPU 101, such as an IPL (Initial Program Loader). A RAM 103 is used as a work area for the CPU 101 . The HDD 104 stores various data such as programs.

The external device connection I/F 105 is an interface for connecting various external devices. The external devices in this case are devices such as the projector 20 and the motor control unit 41, for example.

A network I/F 106 is an interface for data communication with other devices via a communication network or the like. For example, the information processing section 10 receives the 3D model data 901 via the network I/F 106 .

<Functional Configuration Example of Information Processing Unit 10>
Next, with reference to FIG. 4, the functional configuration of the information processing section 10 will be described. FIG. 4 is a diagram showing an example of the functional configuration of the information processing section 10. As shown in FIG.

As shown in FIG. 4 , the information processing section 10 has a storage section 11 , a rotation angle acquisition section 12 , a calculation section 13 , an image generation section 14 and an output section 15 .

The storage unit 11 stores various information. Specifically, the storage unit 11 stores three-dimensional model data 901, three-dimensional voxel data 902, and two-dimensional image data P. FIG. Among these, the three-dimensional model data 901 is point cloud data input from the outside. Three-dimensional voxel data 902 is image data obtained by converting the three-dimensional model data 901 into luminance for each voxel. The two-dimensional image data P is information generated by the image generator 14 .

The storage unit 11 is implemented by the CPU 101 executing a process defined by a program stored in the ROM 102 or the like and controlling the RAM 103 or the HDD 104 or the like.

The rotation angle acquisition unit 12 acquires information indicating the rotation angle of the spiral screen 30 . Specifically, the rotation angle acquisition unit 12 periodically receives the rotation angle information 904 from the motor control unit 41, for example, every second. Further, the rotation angle acquisition unit 12 utilizes the fact that the rotation speed of the spiral screen 30 is substantially constant, and calculates the rotation angle based on the time that has elapsed since the rotation of the spiral screen 30 was started. Information indicating the rotation angle of the spiral screen 30 may be acquired.

Note that the rotation angle acquisition unit 12 may acquire information indicating the rotation angle of the spiral screen 30 by combining the rotation angle information 904 received from the motor control unit 41 and the calculation of the rotation angle based on the elapsed time. good. For example, the rotation angle obtaining unit 12 corrects the calculation result of the rotation angle based on the time that has elapsed since the spiral screen 30 started rotating, based on the rotation angle information 904 received periodically. As a result, even if there is an error between the actual rotation speed of the motor 40 and the specified speed, the rotation angle acquisition unit 12 corrects the rotation angle to the actual rotation angle based on the rotation angle information 904 received periodically. can do.

The rotation angle information 904 is information indicating the rotation angle of the spiral screen 30 .

The rotation angle acquisition unit 12 is implemented by the CPU 101 executing processing specified by a program stored in the ROM 102 or the like and controlling the external device connection IF 105 or the like.

Based on the rotation angle of the spiral screen 30 , the calculator 13 calculates the height in the Z direction at each xy coordinate for each rotation angle of the spiral screen 30 .

The image generator 14 outputs two-dimensional image data generated according to at least one of the angle and position of the rotated spiral screen 30 . Specifically, the image generator 14 converts the three-dimensional model data 901 into three-dimensional voxel data 902 . For example, the calculation unit 13 copies the brightness value of each coordinate for each point of the point cloud to the corresponding voxel of each coordinate. The image generation unit 14 also reduces the color of the three-dimensional voxel data 902 by dithering.

The image generation unit 14 also generates two-dimensional image data P having luminance corresponding to the height calculated by the calculation unit 13 . Specifically, the image generation unit 14 determines the brightness corresponding to each xy coordinate and generates the two-dimensional image data P in two dimensions so that a person can visually recognize the three-dimensional image shown in the three-dimensional model data 901. Generate.

The calculation unit 13 and the image generation unit 14 are implemented by the CPU 101 executing processing specified by a program stored in the ROM 102 or the like.

The output unit 15 outputs the two-dimensional image data P generated by the image generation unit 14 . Specifically, the output unit 15 transmits the two-dimensional image data P to the projector 20 .

The output unit 15 is implemented by the CPU 101 executing processing specified by a program stored in the ROM 102 or the like and controlling the external device connection IF 105 or the like.

<Example of Processing by Information Processing Unit 10>
Next, processing by the information processing unit 10 will be described.

The information processing unit 10 receives the three-dimensional model data 901, receives an operation from a user, etc., and starts control processing.

FIG. 5 is a flowchart showing an example of processing by the information processing section 10. As shown in FIG.

First, in step S11, the image generator 14 voxels the three-dimensional model data 901. FIG. The three-dimensional model data 901 includes, for example, point group information (point cloud) and mesh information. The point group information (point cloud) is a set of point data of xyz coordinates and RGB brightness. The mesh information is information indicating the xyz coordinates of the vertices of the triangles or quadrangles that make up the solid, the colors or textures of the faces of the triangles or quadrilaterals, and the like.

The image generation unit 14 generates three-dimensional voxel data 902 by copying the luminance value of each coordinate for each point of the point cloud to the corresponding voxel of each coordinate.

Subsequently, in step S<b>12 , the image generator 14 dithers the three-dimensional voxel data 902 . Specifically, the image generator 14 converts voxels having a color depth of 8 bits for each of RGB into voxels having 1 bit for RGB. For example, the image generator 14 performs dithering by error diffusion for each RGB channel. At that time, it is desirable that the image generator 14 performs highly accurate three-dimensional error diffusion instead of general two-dimensional error diffusion.

Error diffusion is one of the dithering methods that simulate intermediate colors when reducing the number of colors or gradations in an image. This is a method of adding to the color information of In the case of a two-dimensional image, the image generation unit 14 adds the error to pixels in the two-dimensional direction of the xy coordinates near the plane. do. However, if the computational load becomes a problem, the image generator 14 may perform two-dimensional error diffusion independently for each XY plane in the Z-axis direction instead of three-dimensional error diffusion.

Subsequently, in step S<b>13 , the information processing section 10 instructs the motor control section 41 to start rotating the motor 40 . The motor control unit 41 controls the motor 40 so as to rotate the spiral screen 30 at a predetermined substantially constant speed.

Thereafter, the information processing section 10 repeatedly executes the processing from step S14 to step S19 until the display is finished. In the case of displaying a moving image, the displayed content of the generated two-dimensional image data changes for each time. do. Time t is the time when the projector 20 irradiates the image light L based on the generated two-dimensional image data.

Subsequently, in step S14, the rotation angle acquisition unit 12 acquires the rotation angle information 904 at time t. Specifically, the rotation angle acquisition unit 12 acquires information indicating the rotation angle of the spiral screen 30 from the motor control unit 41 . Note that the rotation angle acquisition unit 12 may calculate the rotation angle based on a predetermined speed, and thereby acquire information indicating the rotation angle. If there is a difference between the measurement time and time t, the rotation angle acquisition unit 12 predicts and calculates the rotation angle of the spiral screen 30 at time t based on the difference between the measurement time and time t.

Subsequently, in step S15, the calculator 13 calculates the height z(x, y) at each xy coordinate. Specifically, the calculator 13 calculates the height z(x, y) by calculation based on the rotation angle of the spiral screen 30 .

Subsequently, the image generator 14 generates two-dimensional image data P in step S16. Specifically, the image generation unit 14 generates two-dimensional image data P having luminance corresponding to the calculated height z (x, y, t) as the two-dimensional image data P to be displayed at time t. .

For example, when the three-dimensional voxel data 902 is a still image, the image generator 14 converts Voxel (x, y, z) into Pixel (x, y, t). Voxel (x, y, z) is a value indicating luminance, color, transmittance, or the like for each voxel. Pixel (x, y, t) is a pixel value included in the two-dimensional image data P on which the image light L emitted at time t is based.

On the other hand, when the three-dimensional voxel data 902 is a moving image, Voxel (x, y, z, t), which is a value indicating luminance, color, transmittance, or the like for each voxel including time t, is replaced by Pixel (x, y, t ).

Regardless of whether the three-dimensional voxel data 902 is a still image or a moving image, the image generator 14 generates the height z (x, y, t) and the color Color of the spiral screen 30 at each xy coordinate at time t. A pixel value Pixel (x, y, t) at time t is calculated based on (x, y, t). The image generation unit 14 stores the generated two-dimensional image data P in the storage unit 11 .

Subsequently, in step S<b>17 , the output unit 15 transmits the two-dimensional image data P generated by the image generation unit 14 to the projector 20 .

Subsequently, in step S18, the information processing section 10 determines whether or not to end the display. The information processing unit 10 terminates the display when receiving an operation indicating the end of the display by the user, or when the transmission of all the two-dimensional image data P based on the moving image is completed when the three-dimensional model data 901 is a moving image. Then judge.

If it is determined not to end the display in step S18 (step S18, No), the information processing unit 10 returns the process to step S14, and the 2nd image displayed at the next time t, for example, the time t one second later. A process related to the dimensional image data P is executed.

On the other hand, when it is determined to end the display in step S18 (step S18, Yes), the information processing section 10 ends the process.

Through such processing by the information processing unit 10, the display device 1 can display a three-dimensional image.

[First embodiment]
Next, the display device 1a according to the first embodiment will be described. In addition, the same code|symbol is attached|subjected to the same structure part as embodiment mentioned above, and the overlapping description is abbreviate|omitted suitably. This point also applies to embodiments and modified examples that will be described later.

The display device 1a according to the present embodiment acquires two-dimensional image data P generated according to at least one of the angle and position of the spiral screen 30 rotated by the motor 40 based on the three-dimensional model data. For example, the display device 1a reads and acquires two-dimensional image data P that is generated in advance and stored in a storage unit or the like.

As the spiral screen 30 rotates, the arrival position of the image light L on the spiral screen 30 changes along the Z direction. Dimensional image data P is acquired and output to the projector 20 .

The projector 20 irradiates the spiral screen 30 with image light L based on the two-dimensional image data P, and the spiral screen 30 reflects the image light L, thereby displaying a three-dimensional image due to the afterimage effect.

In this case, if the rotation of the spiral screen 30 and the irradiation of the image light L by the projector 20 are not synchronized, the arrival position of the image light L on the spiral screen 30 deviates from the desired position, and the display position of the three-dimensional image. may vary.

In this embodiment, the two-dimensional image data P is changed based on the drive cycle information indicating the drive cycle of the motor 40 and the received light signal obtained by receiving the partial image light that is part of the image light. For example, the order of reading and acquiring the two-dimensional image data P stored in the storage unit or the like is changed. As a result, the arrival position of the image light L on the spiral screen 30 is prevented from deviating from the desired position, and fluctuations in the display position of the three-dimensional image can be suppressed.

<Configuration example of display device 1a>
FIG. 6 is a diagram showing an example of the configuration of the display device 1a according to this embodiment. As shown in FIG. 6, the display device 1a has a sensor 70. As shown in FIG.

The sensor 70 is an example of a detection unit that receives the partial image light Lp, which is a part of the image light L, and outputs a light reception signal Sen. The sensor 70 is, for example, an optical sensor including a photoelectric conversion element, and outputs a voltage signal corresponding to the light intensity of the received light.

The sensor 70 has a light-receiving surface facing the projector 20 side (-Z direction side) at a position where it can receive the partial image light Lp other than the screen light Lq directed to the spiral screen 30 out of the image light L emitted by the projector 20. It is installed like this. The installation position of the sensor 70 is not limited to the position shown in FIG. 6, and may be any position as long as it can receive the partial image light Lp. The sensor 70 is electrically connected to the information processing section 10a and outputs a received light signal Sen to the information processing section 10a.

Also, the rotary encoder 42 provided with the motor 40 transmits an encoder signal 203 including the home position signal HP to the information processing section 10a. The home position signal HP is a signal indicating the rotation origin of the encoder signal 203 and is an example of drive cycle information indicating the drive cycle _RT of the spiral screen 30 by the motor 40 . However, the drive cycle information may be a signal or the like output by a home position sensor provided in the motor 40 separately from the rotary encoder 42 .

<Functional Configuration Example of Information Processing Unit 10a>
Next, FIG. 7 is a block diagram showing an example of the functional configuration of the information processing section 10a included in the display device 1a. As shown in FIG. 7, the information processing section 10a includes a rotation angle obtaining section 12a, a storage section 11a, an image obtaining section 16, and a changing section 17. FIG. The storage unit 11 a stores a two-dimensional image data group 905 and irradiation timing deviation information 906 .

The rotation angle acquisition unit 12 a can acquire drive cycle information indicating the drive cycle _RT of the spiral screen 30 .

The two-dimensional image data group 905 is generated in advance according to at least one of the angle and position of the spiral screen 30 rotated by the motor 40 based on the three-dimensional model data 901, and is stored in the storage unit 11a. A data group consisting of dimensional image data P. FIG.

Two-dimensional image data P associated with at least one angle or position of the spiral screen 30 along the order in which the angle or position of the rotated spiral screen 30 changes is stored as a two-dimensional image data group 905. there is

The image acquisition unit 16 reads and acquires desired two-dimensional image data P from the two-dimensional image data group 905 from the storage unit 11a.

Since the spiral screen 30 is rotated at a substantially constant speed by the motor 40, the image acquisition unit 16 sequentially reads out the two-dimensional image data P in the order indicated by the image counter while counting up the image counter. Thereby, the two-dimensional image data P associated with at least one of the angle and position of the spiral screen 30 can be sequentially obtained and output to the projector 20 via the output unit 15 . As a result, in the display device 1a, the processing can be simplified and speeded up compared to the case where the information processing unit generates the two-dimensional image data P according to at least one of the angle and position of the spiral screen 30 in real time. It's like

The irradiation timing deviation information 906 is information indicating the irradiation timing deviation of the image light L to the spiral screen 30 based on the positional relationship between the motor 40 and the spiral screen 30 . For example, if the spiral screen 30 is attached at an angle around the rotation axis of the motor 40, the position of the spiral screen 30 in the Z direction according to the rotation of the motor 40 may deviate from the desired position.

The irradiation timing deviation information 906 is information indicating that the timing of irradiating the image light L onto a desired position in the Z direction on the spiral screen 30 deviates from the desired timing due to this positional deviation. It should be noted that the irradiation timing lag includes both a case where irradiation is delayed and a case where irradiation is hastened.

The shift time ΔT ₀ corresponding to the irradiation timing shift can be measured in advance when the display device 1 is manufactured. Therefore, by dividing the measured deviation time _ΔT0 by the irradiation cycle (frame rate) _FT at which the projector 20 irradiates the image light L, the irradiation timing deviation information expressed by the number of frames of the image light L is calculated. It becomes possible. The calculated irradiation timing deviation information is pre-stored in the storage unit 11 .

On the other hand, the information processing unit 10a reads and acquires the two-dimensional image data P from the two-dimensional image data group 905, but the acquisition of the two-dimensional image data P is gradually delayed with respect to the rotation of the motor 40 due to processing load and the like. Sometimes. Due to this delay, the timing of irradiating the desired position in the Z direction on the spiral screen 30 with the image light L is shifted, so that the position where the three-dimensional image is displayed is gradually shifted in the +Z direction, for example.

On the other hand, the changing unit 17 changes the two-dimensional image data P acquired by the image acquiring unit 16 based on the home position signal HP, the received light signal Sen, and the irradiation timing deviation information 906, The respective effects of irradiation timing deviation and delay due to processing load are corrected. For example, the changing unit 17 performs the above correction by changing the order of the two-dimensional image data P read out from the two-dimensional image data group 905 by the image acquiring unit 16 .

Specifically, the changing unit 17 refers to the storage unit 11 and acquires the number of frames corresponding to the irradiation timing deviation information 906 . Further, since the sensor 70 outputs the light receiving signal Sen indicating the switching period _DT at which the three _- dimensional image is switched, the changing section 17 detects the time difference ΔT1 between the switching period _DT and the driving period _RT . The changing unit 17 divides this time difference _ΔT1 by the irradiation period FT of the image light L from the projector 20, thereby obtaining the _number of differential frames corresponding to the delay due to the arithmetic processing. The drive cycle _RT corresponds to the rotation cycle of the spiral screen 30 by the motor 40. FIG.

The changing unit 17 counts up the image counter by the number of correction frames obtained by adding the number of frames corresponding to the irradiation timing shift information 906 and the number of difference frames corresponding to the delay due to the processing load. As a result, the order of the two-dimensional image data P acquired by the image acquisition unit 16 can be skipped and changed, and the influence of the irradiation timing shift and the delay due to the processing load can be corrected.

Further, when the spiral screen 30 rotates for the first time, the changing unit 17 changes the number of frames corresponding to the irradiation timing deviation information 906 to the initial value of the image counter. It is possible to correct the irradiation timing deviation in the first rotation.

Note that the processing by the changing unit 17 will be described in further detail with reference to FIG. 10 separately.

Next, FIG. 8 is a diagram showing an example of the two-dimensional image data P. As shown in FIG. As shown in FIG. 8, the two-dimensional image data P includes a figure Pp. A figure Pp is a rectangular image formed near a corner in the two-dimensional image data P, and is an example of a predetermined figure formed in a predetermined area in the two-dimensional image data P. FIG. However, the figure Pp is not limited to a rectangular image, and may be an image having any shape.

Next, FIG. 9 is a diagram showing an example of the image light L. As shown in FIG. FIG. 9 shows the image light L emitted from the projector 20 to the spiral screen 30 side as seen from the projector 20 side, and the image light L is projected according to the time along the time axis t indicated by the arrow. It shows how L is switched.

In FIG. 9, switching of the image light L is expressed as image light L(1), L(2), . The subscript of the image light L represents the numerical value of the image counter. N is a natural number and represents the total number of frames of the two-dimensional image data P output to the projector 20 within the period of the switching period _DT in which the three-dimensional image is switched.

By switching the two-dimensional image data _P at the irradiation period _FT according to the rotation of the spiral screen 30, the image light L is switched at the irradiation period FT. Also, the spiral screen 30 rotates once every driving period _RT . Further, the three-dimensional image displayed by the display device 1 is switched and updated every switching cycle _DT .

As an example, the irradiation period FT is 1/60 [seconds], and the switching period _DT is _400/60 [seconds]. That is, the projector 20 emits the image light L based on the two-dimensional image data P of 60 frames per second, and emits the image light L corresponding to the two-dimensional image data P of 400 frames within the switching cycle _DT . can.

As shown in FIG. 9 , the image light L includes partial image light Lp based on the figure Pp included in the two-dimensional image data P and screen light Lq directed to the spiral screen 30 .

In this embodiment, the color of the partial image light Lp changes from white to black or from black to white according to the switching period _DT at which the three-dimensional image is switched. The color of the partial image light Lp is black outside the period of one irradiation period _FT within the switching period _DT , and the color is white only during the period of one irradiation period _FT within the switching period _DT . Change. The period of one irradiation cycle _FT is an example of a predetermined period.

The sensor 70, which is provided to be able to receive the partial image light Lp, receives the black partial image light Lp outside the period of one irradiation period _FT within the switching period _DT . It outputs the received light signal Sen.

Since the sensor 70 receives the white partial image light Lp during one irradiation period _FT in the switching period _DT , it outputs a high-level received light signal Sen. Therefore, the display device 1 can detect the switching cycle _DT based on the light receiving signal Sen from the timing when the light receiving signal Sen output by the sensor 70 becomes High.

Although the color of the partial image light Lp is black or white in this embodiment, the color is not limited to this, and other colors may be used. Alternatively, the same color may be used, and the brightness may vary between within and outside the period of one irradiation cycle _FT within the switching cycle _DT , or both the brightness and the color may be varied. may

In the example shown in FIG. 9, the switching cycle _DT is longer than the drive cycle _RT by a time difference ΔT of ₁ minute. _The time difference ΔT1 corresponds to the delay due to processing load.

<Example of Processing by Information Processing Unit 10a>
Next, processing by the information processing section 10a will be described. FIG. 10 is a flowchart showing an example of processing by the information processing section 10a. The information processing unit 10a starts control processing upon receiving an operation from a user or the like.

First, in step S101, the changing unit 17 acquires the irradiation timing deviation information 906 with reference to the storage unit 11a.

Subsequently, in step S<b>102 , the changing unit 17 initializes an image counter according to the irradiation timing deviation information 906 . For example, if the irradiation timing shift information 906 indicates a shift of two frames, the changing unit 17 sets the initial value of the image counter to 3 (=1+2).

Subsequently, in step S103, the information processing section 10a determines whether or not the rotation angle acquisition section 12 has received the home position signal HP.

If it is determined in step S103 that the information has not been received (step S103, No), the information processing section 10a proceeds to step S105. On the other hand, if it is determined that the home position signal HP has been received (step S103, Yes), in step S104, the information processing section 10a stores the time tHP at which the home position signal _HP was received, and then proceeds to step S105. do.

Subsequently, in step S<b>105 , the information processing section 10 a determines whether or not the light receiving signal Sen has been received by the changing section 17 .

If it is determined in step S105 that it has not been received (step S105, No), the information processing section 10a proceeds to step S111. On the other hand, if it is determined that the signal has been received (step S105, Yes), in step S106, the information processing section 10a stores the time t _Sen at which the received light signal Sen is received, and then proceeds to step S107. .

Subsequently, in step S107, the changing unit 17 obtains the time difference ΔT ₁ by calculating the difference between the time t _HP and the time t _Sen.

Subsequently, in step S108, the changing unit 17 divides the time difference _{ΔT 1} by the irradiation period FT to obtain the difference frame number ΔT ₁ / _FT by calculation.

Subsequently, in step S109, the changing unit 17 acquires the number of correction frames by adding the number of frames corresponding to irradiation deviation and the number of differential frames corresponding to delay due to arithmetic processing.

Subsequently, in step S110, the changing unit 17 changes the order of the two-dimensional image data P acquired by the image acquiring unit 16 by counting up the image counter by the number of correction frames. For example, when the number of correction frames is 6, the information processing section 10a outputs the two-dimensional image data P of the first frame to the projector 20, and then outputs the two-dimensional image data P of the second frame. Instead, the order is changed so that the information processing unit 10a outputs the two-dimensional image data P of the seventh frame after six frames.

Subsequently, in step S111, the image acquisition unit 16 reads and acquires the two-dimensional image data P corresponding to the image counter from the two-dimensional image data group 905. FIG.

Subsequently, in step S<b>112 , the image acquisition unit 16 transmits the two-dimensional image data P to the projector 20 via the output unit 15 .

Subsequently, in step S113, the changing unit 17 increments the image counter by one.

Subsequently, in step S114, the information processing section 10a determines whether or not to end the display. This determination can be made based on the operation of the display device 1a by the user or the like.

If it is determined to end at step S114 (step S114, Yes), the information processing section 10a ends the process. On the other hand, when it is determined not to end (step S114, No), the information processing section 10a performs the processes after step S103 again.

Such processing by the information processing unit 10a enables the display device 1a to display a three-dimensional image.

<Timing example of each signal>
Next, with reference to FIG. 11, the timing of the home position signal HP, the light reception signal Sen, etc. in the display device 1a will be described. FIG. 11 is a timing chart illustrating signal timings according to the present embodiment.

FIG. 11 shows the home position signal HP at the top, the two-dimensional image data P acquired by the image acquisition unit 16 at the bottom, and the image light L emitted by the projector 20 at the bottom. , and the received light signal Sen from the sensor 70 is shown in the lower row.

In FIG. 11, switching of the two-dimensional image data P is expressed as two-dimensional image data P(1), P(2), . The switching is expressed as image light L(1), L(2), . . . , L(N−1), L(N). The subscripts of the two-dimensional image data P and the image light L represent numerical values of the image counter. N is a natural number and represents the total number of frames of the two-dimensional image data P output to the projector 20 within the period of the switching period _DT in which the three-dimensional image is switched.

As shown in FIG. 11, the image acquiring unit 16 acquires the two-dimensional image data P(1) according to the output of the home position signal HP, and thereafter, at a substantially constant cycle according to the rotational speed of the spiral screen 30. The two-dimensional image data P are sequentially obtained in the order of the two-dimensional image data P(1), P(2), .

In the example of FIG. 11 , a time difference ΔT ₀ in irradiation timing by the projector 20 occurs according to the positional relationship between the motor 40 and the spiral screen 30 . This shift time _ΔT0 is a shift of two frames, which is the same as the irradiation period _FT .

The changing unit 17 initializes the image counter according to the irradiation timing deviation information 906 . Since the irradiation deviation frame number is one frame, the changing unit 17 sets the initial value of the image counter to 3, thereby correcting the irradiation timing deviation in the first rotation of the spiral screen 30 .

After that, when the spiral screen 30 rotates once, the home position signal HP is output, and the image acquiring section 16 acquires the two-dimensional image data P(1).

In the example of FIG. 11, the acquisition of the two-dimensional image data P is gradually delayed with respect to the rotation of the motor 40 due to the processing load or the like, and a time difference ΔT ₁ occurs when the spiral screen 30 rotates once. When the sensor 70 receives the partial image light Lp of the image light L(1) emitted with a delay of ΔT ₁ minute, the received light signal Sen is output with a delay of ΔT ₁ minute from the home position signal HP.

Therefore, the changing unit 17 acquires the time difference ΔT1 between the home position signal HP and the received light signal Sen and divides it by the irradiation period _FT , thereby acquiring the _number of difference frames for six frames. Then, the changing unit 17 adds 2 for the number of irradiation deviation frames and 6 for the number of difference frames to obtain 8 for the number of correction frames, and increments the image counter by 8 to obtain the number of frames next to the image light L(1). , the order is changed so that the image light L(9) is applied to .

In this way, the changing unit 17 can correct the effects of the irradiation timing shift and the delay due to the processing load.

<Action and effect of the display device 1a>
As described above, the display device 1a includes the spiral screen 30 (illuminated member) that displays a three-dimensional image by reflecting the irradiated image light L, and the motor 40 (driving unit) that drives the spiral screen 30. and an image acquisition unit 16 for acquiring two-dimensional image data P generated according to at least one of the angle and position of the driven spiral screen.

The display device 1a also includes a projector 20 (irradiation unit) that irradiates the spiral screen 30 with image light L based on the two-dimensional image data P, and a rotation angle acquisition unit that acquires drive cycle information indicating the drive cycle _RT of the spiral screen 30. It has a unit 12a (driving cycle acquisition unit) and a sensor 70 (detection unit) that outputs a light reception signal Sen that receives the partial image light Lp that is part of the image light L. FIG.

In this embodiment, the two-dimensional image data P is changed based on the drive cycle information indicating the drive cycle of the spiral screen 30 and the received light signal Sen obtained by receiving the partial image light Lp, which is part of the image light. For example, the order of reading the two-dimensional image data P stored in the storage unit 11a is changed. As a result, it is possible to suppress the arrival position of the image light L on the spiral screen 30 from deviating from the desired position, thereby suppressing the fluctuation of the display position of the three-dimensional image.

For example, the time difference ΔT1 between the switching period _DT and the driving period _RT varies depending _on the magnitude of the processing load of the information processing section 10a. The delay according to the magnitude of the processing load on the unit 10a cannot be corrected accurately. On the other hand, in the present embodiment, the correction is performed based on the received light signal Sen of the partial image light Lp, so that the delay corresponding to the magnitude of the processing load of the information processing section 10a can be accurately corrected.

Further, in the present embodiment, the sensor 70 is provided at a position capable of receiving the partial image light Lp of the image light L other than the screen light Lq directed to the spiral screen 30 . Thereby, the partial image light Lp can be received without blocking the screen light Lq, and the information indicating the time difference _ΔT1 can be obtained.

Further, in the present embodiment, the two-dimensional image data P includes a figure Pp (predetermined figure) in a predetermined area in the two-dimensional image data P, and the sensor 70 receives the light reception signal of the partial image light Lp based on the figure Pp. Output Sen. Accordingly, with _a simple configuration, the partial image light Lp can be received without blocking the screen light Lq, and information indicating the time difference ΔT1 can be obtained.

Further, in the present embodiment, the sensor 70 outputs a light reception signal Sen indicating a switching period _DT at which the three-dimensional image is switched, and the changing unit 17 outputs the irradiation period FT of the image light L by the projector 20 and the switching period _D The order of the two-dimensional image data P is changed based _{on T} and the time difference ΔT1 between the driving periods _RT . As a result, it is possible to suppress the arrival position of the image light L on the spiral screen 30 from deviating from the desired position, thereby suppressing the fluctuation of the display position of the three-dimensional image.

Further, in this embodiment, the storage unit 11a stores the irradiation timing deviation information 906 of the image light L to the spiral screen 30 based on the positional relationship between the motor 40 and the spiral screen 30, and the changing unit 17 changes the irradiation period The order of the two-dimensional image data P is changed based on the _FT , the time difference ΔT ₁ , and the irradiation timing shift information 906 .

As a result, not only the delay caused by the processing load of the information processing unit 10a but also the irradiation timing deviation caused by the mounting error of the spiral screen 30 to the motor 40 can be accurately corrected.

Further, in the present embodiment, at least one of brightness and color of the partial image light Lp changes according to the switching cycle _DT . For example, the partial image light Lp changes at least one of brightness and color only during one irradiation period _FT (predetermined period) within the switching period _DT . Accordingly, with _a simple configuration, the partial image light Lp can be received without blocking the screen light Lq, and information indicating the time difference ΔT1 can be obtained.

In this embodiment, the spiral screen 30 is illustrated as an example of the member to be irradiated, but the member to be irradiated is not limited to this. Here, FIG. 12 is a diagram illustrating an irradiated member according to a modification.

A flat screen 30a shown in FIG. 12 is a plate-shaped member having a flat surface, and is an example of a member to be irradiated. The flat screen 30a can be reciprocated along the direction of an arrow 45 by a stage 40a as an example of a drive unit. This embodiment can also be applied to a display device that irradiates the reciprocating flat screen 30a with the image light L and displays a three-dimensional image by the afterimage effect, and similar effects can be obtained.

[Second embodiment]
Next, the display device 1b according to the second embodiment will be described. In the first embodiment, the partial image light Lp of the image light L emitted by the projector 20 changes at least one of brightness and color only during one irradiation period _FT within the switching period _DT . I showed the configuration to do. On the other hand, in the present embodiment, the partial image light Lpb of the image light Lb emitted by the projector 20 alternately changes at least one of brightness and color every switching cycle _DT .

FIG. 13 is a diagram showing an example of the image light Lb according to this embodiment. The view of FIG. 13 is the same as that of FIG.

As shown in FIG. 13, in this embodiment, the color of the partial image light Lpb changes from white to black or from black to white according to the switching period _DT at which the three-dimensional image is switched. Also, the color of the partial image light Lpb alternately changes from white to black or from black to white at each switching cycle _DT .

In the example of FIG. 13, the color of the partial image light Lpb is all white in the first period of the switching period _DT , and the color of the partial image light Lpb is all black in the second period of the switching period _DT . Become.

FIG. 14 is a timing chart illustrating signal timings according to the present embodiment. The view of FIG. 14 is the same as that of FIG.

As shown in FIG. 14, the light receiving signal Sen of the sensor 70 always shows High in the first cycle of the switching cycle _DT and always shows Low in the second cycle of the switching cycle _DT . Therefore, the switching period _DT can be detected at the timing when the received light signal Sen switches from High to Low or from Low to High.

As described above, the switching period _DT can also be detected by using the partial image light Lpb whose color alternately changes from white to black or from black to white at each switching period _DT .

In this embodiment, the case where the color of the partial image light Lp is black or white has been exemplified, but the color is not limited to this, and colors other than these may be used. Further, the same color may be used, and the brightness may alternately change at each switching cycle _DT , or both the brightness and the color may change.

Although the embodiments have been described above, the present invention is not limited to the specifically disclosed embodiments described above, and various modifications and changes are possible without departing from the scope of the claims. be.

For example, it is possible to configure a display system including the display device 1a and an information processing device communicably connected to the display device 1a. The display device 1a and the information processing device are communicably connected via a network such as the Internet. The information processing device is, for example, an external server such as a cloud server.

The information processing device stores a two-dimensional image data group 905 including a plurality of two-dimensional image data P generated according to at least one of the angle and position of the driven spiral screen 30 . The image acquisition unit 16 can acquire the two-dimensional image data P via the network from the two-dimensional image data group 905 stored by the information processing device.

Embodiments also include display methods. For example, the display method is a display method using a display device that displays a three-dimensional image by an afterimage effect, and a driving unit drives an irradiated member that displays the three-dimensional image by reflecting the irradiated image light. acquiring two-dimensional image data generated in accordance with at least one of an angle or position of the member to be illuminated that is driven; and applying the image light based on the two-dimensional image data to the member to be illuminated. irradiating; outputting a received light signal obtained by receiving partial image light that is a part of the image light; driving cycle information indicating a driving cycle of the driving unit; and C. modifying the dimensional image data. Such a display method can provide the same effect as the display device described above.

Embodiments also include programs. For example, the program is a program for operating a display device that displays a three-dimensional image with an afterimage effect, and the driving unit drives an irradiated member that displays the three-dimensional image by reflecting the irradiated image light. obtaining two-dimensional image data generated in accordance with at least one of the angle and position of the irradiated member being driven; irradiating the irradiated member with the image light based on the two-dimensional image data; outputting a light receiving signal obtained by receiving partial image light, which is a part of image light, and changing the two-dimensional image data based on the light receiving signal and drive cycle information indicating a driving cycle of the driving unit; let the computer do it. With such a program, the same effects as those of the display device described above can be obtained.

Numerals such as ordinal numbers and numbers used in the description of the embodiments are all exemplified to specifically describe the technology of the present invention, and the present invention is not limited to the exemplified numbers. Moreover, the connection relationship between the components is an example for specifically describing the technology of the present invention, and the connection relationship for realizing the function of the present invention is not limited to this.

Also, the division of blocks in the functional block diagram is an example, and a plurality of blocks may be implemented as one block, one block may be divided into a plurality of blocks, and/or some functions may be moved to other blocks. good. Also, a single piece of hardware or software may process functions of multiple blocks having similar functions in parallel or in a time division manner.

1, 1a Display devices 10, 10a Information processing units 11, 11a Storage units 12, 12a Rotation angle acquisition unit 13 Calculation unit 14 Image generation unit 15 Output unit 16 Image acquisition unit 17 Change unit 20 Projector (an example of irradiation unit)
30 Spiral screen (an example of irradiated member)
30a flat screen (an example of a member to be irradiated)
31a flat surface 40 motor (an example of a drive unit)
40a stage (an example of a drive unit)
41 Motor control unit 50 Screen case 60 Housing 61 Top panel 62 Through hole 201 Rotation instruction signal 202 Rotation control signal 203 Encoder signal 901 Three-dimensional model data 905 Two-dimensional image data group 906 Irradiation timing deviation information E Spiral axis (predetermined axis example)
L, Lb Image light Lp, Lpb Partial image light Lq Screen light P Two-dimensional image data Pp Graphic (an example of a predetermined graphic)
_{FT irradiation cycle R T driving} cycle D _T switching cycle ΔT ₀ shift time ΔT ₁ time difference

Japanese Patent No. 6716565

Claims (14)

A display device that displays a three-dimensional image with an afterimage effect,
an irradiated member that displays the three-dimensional image by reflecting the irradiated image light;
a driving unit that drives the member to be irradiated;
an image acquisition unit configured to acquire two-dimensional image data generated according to at least one of the angle and position of the member to be irradiated;
an irradiation unit that irradiates the irradiated member with the image light based on the two-dimensional image data;
a detection unit that outputs a light reception signal received by receiving partial image light that is a part of the image light;
A display device, comprising drive cycle information indicating a drive cycle of the drive unit, and a change unit that changes the two-dimensional image data based on the light receiving signal. The display device according to claim 1, wherein the changing section changes the order of the two-dimensional image data acquired by the image acquiring section. 3. The display device according to claim 1, wherein the detection unit is provided at a position capable of receiving the partial image light other than the irradiation light to the irradiated member. wherein the two-dimensional image data includes a predetermined figure in a predetermined area within the two-dimensional image data;
4. The display device according to any one of claims 1 to 3, wherein the detection section outputs the received light signal of the partial image light based on the predetermined figure. The detection unit outputs the received light signal indicating a switching cycle at which the three-dimensional image is switched,
The changing unit controls the order of the two-dimensional image data acquired by the image acquisition unit based on the irradiation period of the image light by the irradiation unit and the time difference between the switching period and the driving period. 5. The display device according to any one of claims 1 to 4, wherein . a storage unit for storing irradiation timing deviation information of the image light to the member to be irradiated based on the positional relationship between the driving unit and the member to be irradiated;
The display device according to claim 5, wherein the changing unit changes the order based on the irradiation period, the time difference, and the irradiation timing deviation information. 7. The display device according to any one of claims 1 to 6, wherein the partial image light changes at least one of brightness and color in accordance with a switching cycle in which the three-dimensional image is switched. 8. The display device according to claim 7, wherein the partial image light changes at least one of brightness and color only during a predetermined period within the switching period. 8. The display device according to claim 7, wherein the partial image light alternately changes at least one of brightness and color every switching period. The member to be irradiated has a spiral shape,
10. The display device according to any one of claims 1 to 9, wherein the drive unit rotates the member to be irradiated around a predetermined axis. The member to be irradiated is a plate member having a flat surface,
The display device according to any one of claims 1 to 9, wherein the drive unit reciprocates the member to be irradiated. a display device according to any one of claims 1 to 11;
an information processing device communicably connected to the display device,
The information processing device stores a two-dimensional image data group including a plurality of the two-dimensional image data generated according to at least one of the angle and position of the irradiated member to be driven;
The display system, wherein the image acquisition unit acquires the two-dimensional image data from the two-dimensional image data group stored by the information processing device. A display method using a display device for displaying a three-dimensional image with an afterimage effect,
a step of driving an irradiated member for displaying the three-dimensional image by reflecting the irradiated image light by a driving unit;
obtaining two-dimensional image data generated according to at least one of an angle or position of the driven irradiated member;
irradiating the irradiated member with the image light based on the two-dimensional image data;
a step of outputting a received light signal obtained by receiving partial image light that is a part of the image light;
A display method, comprising: changing the two-dimensional image data based on drive cycle information indicating a drive cycle of the drive unit and the light receiving signal. A program for operating a display device that displays a three-dimensional image with an afterimage effect,
driving an irradiated member that displays the three-dimensional image by reflecting the irradiated image light by a driving unit;
Acquiring two-dimensional image data generated according to at least one of the angle and position of the irradiated member being driven;
irradiating the irradiated member with the image light based on the two-dimensional image data;
outputting a received light signal obtained by receiving partial image light that is a part of the image light;
A program for causing a computer to execute a process of changing the two-dimensional image data based on drive cycle information indicating a drive cycle of the drive unit and the light receiving signal.

Images