JP2015220732A - Display system, terminal device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operability by enabling even a user who does not know setting or the like to easily operate a device separate from a display device, in the case of varying a display image by operating the separate device.SOLUTION: A display system 1 comprises a projector 100 and a terminal device 10. The terminal device 10 displays an orientation guide image 210 indicating an association between at least the positions or the orientations of the terminal device 10 and the projector 100. The terminal device 10 detects at least the position or the orientation of the terminal device 10, and the projector 100 deforms a projected image 201 in response to the variation in the position or the orientation of the terminal device 10.

Description

  The present invention relates to a display system, a terminal device, and a program.

  2. Description of the Related Art Conventionally, a system that controls the display state of an image displayed by a display device such as a projector by using a device separate from the projector is known (see, for example, Patent Documents 1 and 2). In Patent Document 1, when an operation of tilting the projector remote control is performed, the projector corrects the image according to the tilt angle of the remote control. In Patent Document 2, in a configuration in which a projector displays an image output from a mobile device on a screen, the projector tilts the image on the screen based on the tilt of the mobile device.

JP 2008-40367 A JP 2013-146049 A

In the above conventional configuration, the user needs to perform an operation of tilting a device such as a remote controller or a portable device so that a displayed image is in a desired state. In this configuration, the user needs to know in advance the correspondence between the inclination of the apparatus and the image change. If a user who does not know the correspondence relationship performs an operation, it is necessary to obtain knowledge by performing an operation of tilting the apparatus.
The present invention has been made in view of the above-described circumstances, and can be easily operated even by a user who does not know settings or the like when operating a device separate from the display device to change the display image. Thus, it aims at improving the operativity.

In order to achieve the above object, the present invention is a display system comprising a display device and a terminal device, wherein the terminal device associates the position of the terminal device with the position of the display device, and the terminal A display screen that displays an image indicating at least one of the association between the orientation of the device and the orientation of the display device, and a detection unit that detects at least one of the position and orientation of the terminal device, The display device includes a display unit that displays an image, and an image processing unit that deforms an image displayed by the display unit in accordance with a change in the position or orientation of the terminal device.
According to the present invention, even a user who does not know the setting or the like can change the display image to a desired state by operating the portable terminal device, thereby improving the operability. .

  Here, the terminal device includes the detection unit that detects the position of the terminal device, displays an image indicating the correspondence between the position of the terminal device and the position of the display device on the display screen, and displays the display The device may deform the image displayed by the display unit in accordance with a change in the position of the terminal device. In addition, the terminal device includes the detection unit that detects an orientation of the terminal device, displays an image indicating an association between the orientation of the terminal device and the orientation of the display device on the display screen, and the display device May deform the image displayed by the display unit in accordance with a change in the orientation of the terminal device.

According to the present invention, in the display system, the terminal device converts a detection result of the detection unit into a change in a position or orientation of the display device, and transmits the conversion result to the display device by a transmission unit; The image processing unit included in the display device deforms an image displayed on the display unit according to a conversion result transmitted from the terminal device.
According to the present invention, the position or orientation of the terminal device detected by the terminal device is converted into the position or orientation of the display device and transmitted to the display device. For this reason, it is possible to reduce the processing load for the display device to change the display image and to improve the processing efficiency.

The present invention is characterized in that, in the display system, the terminal device notifies the detection start or detection end of the detection unit by displaying the display screen.
According to the present invention, it is possible to notify the user who operates the terminal device of the start or end of detection, and the operability can be further improved.

In the display system according to the aspect of the invention, the display device is a projector including the display unit that projects image light onto a projection target, and an optical axis direction of the projector and a longitudinal direction of the display screen included in the terminal device The direction of the terminal device and the direction of the display unit are associated with each other so that they overlap each other.
According to the present invention, when the position or direction of the terminal device changes, the image changes so that the longitudinal direction of the display screen corresponds to the optical axis of the projector. it can.

In the display system according to the aspect of the invention, the image processing unit included in the display device regards a change in the position or orientation of the terminal device as a change in the position or orientation of the display unit, and the display unit projects the change. It is characterized in that at least one of image trapezoidal distortion correction, display magnification change, and focus adjustment is executed.
ADVANTAGE OF THE INVENTION According to this invention, operation regarding the trapezoid distortion correction of the image which a projector projects, the change of a display magnification, and a focus adjustment can be performed easily using a terminal device.

In the display system according to the aspect of the invention, the detection unit included in the terminal device may include a second direction that is substantially orthogonal to a longitudinal direction of the display screen, or an axis parallel to the third direction. Detecting an amount of rotation, and the image processing unit included in the display device performs trapezoidal distortion correction of an image projected by the display unit based on the amount of rotation of the terminal device detected by the terminal device; It is characterized by.
According to the present invention, the keystone distortion correction of the image projected by the projector is executed by rotating the terminal device about the direction substantially orthogonal to the longitudinal direction of the display screen. For this reason, the operation method of a terminal device can be increased and multifunctionality can be achieved, and operativity can be improved.

In the display system according to the aspect of the invention, the detection unit included in the terminal device detects movement of the terminal device in the longitudinal direction, and the image processing unit included in the display device is detected by the terminal device. The display magnification of the image projected by the display unit is changed corresponding to the movement of the terminal device.
According to the present invention, the display magnification of an image can be changed by an operation of moving the terminal device in the longitudinal direction of the display screen, and an operation related to the display magnification can be intuitively performed.

In order to achieve the above object, the present invention provides a terminal device, a transmission unit that transmits information to an external display device, an association between the position of the terminal device and the position of the display device, and A display screen that displays an image showing at least one of the orientation of the terminal device and the display device, a detection unit that detects at least one of the position and orientation of the terminal device, and the detection A control unit that generates information indicating a change in the position or orientation of the display device based on a change in the position or orientation of the terminal device detected by the transmission unit and transmits the information by the transmission unit.
According to the present invention, even a user who does not know the setting or the like can change the display image to a desired state by operating the portable terminal device, thereby improving the operability. .

In order to achieve the above object, the present invention is a program that can be executed by a computer that controls a terminal device, wherein the computer associates the position of the terminal device with the position of an external display device, And detecting when displaying an image indicating at least one of the correspondence between the orientation of the terminal device and the display device on a display screen and detecting at least one of the position and orientation of the terminal device Based on the change in the position or orientation of the terminal device, information indicating the change in the position or orientation of the display device is generated and transmitted to the display device.
According to the present invention, even a user who does not know the setting or the like can change the display image to a desired state by operating the portable terminal device, thereby improving the operability. .

  According to the present invention, even a user who does not know the setting or the like can change the display image to a desired state by operating the portable terminal device, thereby improving the operability. .

It is a figure which shows schematic structure of a display system. It is a block diagram which shows the structure of a terminal device. It is a block diagram which shows an example of a structure of a projector. It is a flowchart which shows the process sequence of a projector and a terminal device. It is a figure which shows the example of the image displayed on a terminal device. It is a figure explaining the correction process and deformation | transformation process which are performed by a projector.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
FIG. 1 shows a schematic configuration of a display system 1 of the present embodiment. The display system 1 of this embodiment includes a terminal device 10 as an input device and a projector 100 as a display device.
The terminal device 10 and the projector 100 are connected so as to be able to transmit and receive various data by a wireless communication method. As this wireless communication system, for example, a short-range wireless communication system such as a wireless local area network (LAN), Bluetooth (registered trademark), UWB (Ultra Wide Band), infrared communication, or a wireless communication system using a mobile phone line is used. Can be adopted. The projector 100 is connected to a plurality of terminal devices 10 and can communicate with these terminal devices 10.

The terminal device 10 is a small device that a user holds and operates. For example, the terminal device 10 is a mobile phone such as a smartphone, a tablet terminal, or a PDA (Personal Digital Assistants). The terminal device 10 has a flat terminal device main body 11 (main body). A display panel 52 (display screen) is arranged on the surface of the terminal device main body 11, and a user touch operation is performed on the surface of the display panel 52. A touch screen 53 (FIG. 2) to be detected is arranged. As shown in FIG. 1, the display panel 52 is disposed so as to cover almost the entire surface on one of the widest surfaces of the terminal device body 11. Further, the display panel 52 of the present embodiment is an elongated rectangle, and the user can clearly distinguish the long side and the short side. Further, the terminal device 10 may include various switches as other input devices of the touch screen 53.
The projector 100 projects image light onto a projection target and forms an image on the projection target surface. The projection target on which the projector 100 projects an image may be a flat surface, a curved surface, or an uneven surface, but in the present embodiment, an example of projecting onto a screen SC configured with a flat surface is shown. The screen SC may use a fixed plane such as a wall surface, or may be a hanging or rising curtain screen. FIG. 1 shows the installation state of the projector 100. The projector 100 includes a box-shaped projector main body 101 (main body), and a projection opening 114 that projects image light is provided on one surface of the projector main body 101. The projection opening 114 is an opening through which the projection optical system 113 (FIG. 3) built in the projector main body 101 emits light.

  In the present embodiment, the screen SC has a rectangular shape, and the projector 100 is disposed on the front (front) side of the screen SC. The projector 100 projects image light of a rectangular image (including a still image and a moving image), and a rectangular projection image 201 is formed on the screen SC. In the installed state of FIG. 1, the projector 100 projects image light from obliquely upward to the screen SC, so that the projected image 201 formed on the screen SC is not rectangular but has trapezoidal distortion.

In the display system 1, the position and direction of the terminal device body 11 and the position and direction of the projector body 101 are associated with each other as described later. For this reason, in the display system 1, the position and direction standards are determined for each of the terminal device body 11 and the projector body 101.
In the present embodiment, as an example, a three-dimensional orthogonal coordinate system is set for the terminal device main body 11 and the projector main body 101, and processing relating to the positions and directions of the terminal device main body 11 and the projector main body 101 is performed using this coordinate system as a reference.

The terminal device body 11 has an axis AX in the longitudinal direction of the display panel 52, an axis AY that is orthogonal to the axis AX, parallel to the display panel 52, and an axis AZ that is orthogonal to the axis AX and perpendicular to the display panel 52. Is done. The direction of rotation about the axis AX is the rotation in the CX direction, the direction of rotation about the axis AY is the rotation in the CY direction, and the direction of rotation about the axis AZ is the rotation in the CZ direction. . The axis AX, the axis AY, and the axis AZ preferably intersect at one point, and this intersection can be the origin of the coordinate system. Although the position of the origin is on the surface of the terminal device main body 11 in this embodiment, it may be the center of the terminal device main body 11.
The projector main body 101 includes an axis PX that overlaps the optical axis of the image light projected from the projection opening 114, an axis PY that is orthogonal to the axis PX and parallel to the installation surface of the projector main body 101, and an axis PX that is orthogonal to the axis PX. An axis PZ perpendicular to the installation surface is set. Further, the direction of rotation about the axis PX is the rotation in the QX direction, the direction of rotation about the axis PY is the rotation in the QY direction, and the direction of rotation about the axis PZ is the rotation in the QZ direction. . The axis PX, the axis PY, and the axis PZ preferably intersect at one point, and this intersection can be the origin of the coordinate system. In this embodiment, the position of the origin is on the optical axis of the image light projected by the projector main body 101. The origin may be located at the center of the projector main body 101 or the upper surface of the projector main body 101.

  The display system 1 executes processing for at least one of the position and the direction for the terminal device body 11 and the projector body 101. It is possible to adopt a configuration in which processing is performed for only the position or only the direction. In the present embodiment, as an example, a case will be described in which processing is performed for both the position and direction of the terminal device main body 11 and the projector main body 101.

FIG. 2 is a block diagram illustrating a configuration of the terminal device 10.
The terminal device 10 includes a control unit 20 that controls each unit of the terminal device 10. The control unit 20 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like (not shown), and controls the terminal device 10 by executing a basic control program stored in the ROM by the CPU. To do. The control unit 20 also functions as a display control unit 21, an operation detection unit 23 (control unit), and a communication control unit 22 (to be described later) by executing the application program 31 stored in the storage unit 30 (hereinafter referred to as these). Is called a functional block).

The terminal device 10 includes a storage unit 30. The storage unit 30 is a nonvolatile storage device such as a flash memory or an EEPROM (Electronically Erasable and Programmable Read Only Memory), and is connected to the control unit 20. The storage unit 30 stores various programs including the application program 31, image data 32 received from the projector 100, and the like. In addition, the storage unit 30 stores direction setting data 33. The direction setting data 33 is data that associates the position and direction of the terminal device main body 11 (FIG. 1) with the position and direction of the projector main body 101 (FIG. 1). The direction setting data 33 is used when a change in the direction or position of the terminal device body 11 detected by an angular velocity sensor 61 or an acceleration sensor 62 described later is converted into a change in the direction or position of the projector body 101.
For example, the direction setting data 33 associates the axes AX, AY, and AZ of the terminal device body 11 with each other as the axes PX, PY, and PZ. In this case, when the terminal apparatus body 11 moves to the axis AX, it is considered that the projector body 101 has moved in the direction of the axis PX. Further, the direction setting data 33 may include data for determining a magnification for converting the change amount of the position and direction of the terminal device main body 11 into the position and change amount of the projector main body 101.

  The terminal device 10 includes a wireless communication unit 40. The wireless communication unit 40 includes an antenna, an RF (Radio Frequency) circuit (not shown), and the like, and is connected to the control unit 20. The wireless communication unit 40 is controlled by the control unit 20 and transmits / receives various data to / from the projector 100 according to the wireless communication method described above. The wireless communication unit 40 functions as a transmission unit together with the communication control unit 22.

  The terminal device 10 includes a display unit 51. The display unit 51 includes a display panel 52 and is connected to the control unit 20. The display unit 51 draws a frame according to the display resolution of the display panel 52 in a drawing memory (not shown) based on the image data input from the control unit 20, and causes the display panel 52 to display an image based on the drawn frame. .

The terminal device 10 includes a touch screen 53, a switch unit 54, and an operation detection unit 55. The touch screen 53 detects a touch operation on the display panel 52 and outputs a position signal indicating the detected operation position to the operation detection unit 55. The operation detection unit 55 generates coordinate information indicating coordinates on the touch screen 53 based on the position signal input from the touch screen 53 and outputs the coordinate information to the control unit 20.
The switch unit 54 includes operation elements such as switches provided separately from the touch screen 53, and outputs an operation signal to the operation detection unit 55 when these switches are operated. The operation detection unit 55 generates operation information corresponding to the operated operator based on the operation signal input from the switch unit 54 and outputs the operation information to the control unit 20.
Based on the coordinate information or operation information input from the operation detection unit 55, the control unit 20 can detect a contact operation on the display panel 52, an operation of each operator including a switch, and an operation of moving the main body of the terminal device 10.

  The terminal device 10 includes an angular velocity sensor 61 (detection unit) and an acceleration sensor 62 (detection unit). The angular velocity sensor 61 is also called a gyro sensor, detects an angular velocity, and outputs a detection signal to the control unit 20. Although the specification of the angular velocity sensor 61 is not particularly limited, it is preferable if it can detect angular velocities in the CX direction, CY direction, and CZ direction of the terminal device body 11 (FIG. 1). The acceleration sensor 62 detects acceleration and outputs a detection signal to the control unit 20. Although the specification of the acceleration sensor 62 is not particularly limited, it is preferable that the acceleration sensor 62 can detect the acceleration in each of the axis AX, the axis AY, and the axis AZ directions of the terminal device body 11 (FIG. 1).

  The display control unit 21 included in the control unit 20 controls the display unit 51 to display various screens on the display panel 52. The display control unit 21 reads the image data 32 from the storage unit 30 or outputs the image data received via the wireless communication unit 40 to the display unit 51. The display unit 51 draws a frame according to the display resolution of the display panel 52 in a drawing memory (not shown) based on the input image data, and drives the display panel 52 based on the drawn frame.

  The motion detection unit 23 detects a change in the position and direction of the terminal device body 11 based on detection signals input from the angular velocity sensor 61 and the acceleration sensor 62, and calculates the change direction and the change amount. For example, when the position or direction of the terminal device main body 11 changes, the motion detection unit 23 changes the position in each of the axes AX, AY, and AZ, and the CX direction, CY direction, Separated into rotation in each of the CZ directions, the amount of movement of each axis and the amount of rotation in each direction are output. Here, it can be said that the position change is a movement or a displacement. For example, when the terminal device body 11 moves in the direction between the axis AX and the axis AY shown in FIG. 1, the motion detection unit 23 disassembles this movement into movement in the axis AX direction and movement in the axis AY direction. Then, the amount of movement in each direction is calculated. The same applies to rotation. Therefore, as a method of calculating the movement amount and the rotation amount by separating the movement and rotation of the terminal device main body 11 into components in a plurality of directions, for example, a known method such as a geometric calculation process may be used.

Further, when the movement detection unit 23 calculates the movement amount of each direction of the terminal device body 11 and the rotation amount about each axis, the movement detection unit 23 calculates the movement amount of the projector body 101 based on the direction setting data 33. And convert to rotation amount. In the present embodiment, the direction setting data 33 associates the axes AX, AY, and AZ of the terminal apparatus body 11 with each other as the axes PX, PY, and PZ. Therefore, the movement of the terminal apparatus body 11 in the axis AX direction is converted into the movement of the projector body 101 in the axis PX direction. In addition, the direction setting data 33 may include data related to conversion of the movement amount. For example, when the direction setting data 33 includes the magnification of the movement amount and the rotation amount, the motion detection unit 23 sets the movement amount and rotation amount of the terminal device body 11 according to the magnification of the direction setting data 33, Convert to rotation amount.
The motion detection unit 23 generates displacement data indicating the movement amount and rotation amount of the projector main body 101 obtained by the conversion, and transmits the displacement data to the projector 100 via the wireless communication unit 40.

  The operation detection unit 23 may always perform the process of generating the displacement data based on the detection signals of the angular velocity sensor 61 and the acceleration sensor 62 and the direction setting data 33, but is implemented as a function of the application program 31. That is, when the CPU constituting the control unit 20 executes the application program 31, the function of the operation detection unit 23 can be executed in software. Further, a part of the function of the operation detection unit 23 may be provided by the operating system of the terminal device 10, and the other function may be provided by the application program 31.

The communication control unit 22 controls the wireless communication unit 40 to perform wireless communication with the projector 100. The communication control unit 22 executes processing for establishing a connection with the wireless communication unit 156 (FIG. 3) included in the projector 100 when communication with the projector 100 is started or ended. Further, the communication control unit 22 transmits various data such as displacement data generated by the motion detection unit 23 to the projector 100 by the wireless communication unit 40, and controls data transmitted from the projector 100 and received by the wireless communication unit 40. To the unit 20.
For example, when data corresponding to the direction setting data 33 is transmitted from the projector 100 and this data is received by the wireless communication unit 40, the communication control unit 22 outputs the received data to the control unit 20. When the control unit 20 analyzes the data input from the communication control unit 22 and determines that the data corresponds to the direction setting data 33, the control unit 20 performs data format conversion or the like to store the direction setting data 33 as the direction setting data 33. 30.

FIG. 3 is a block diagram illustrating a configuration of the projector 100.
The projector 100 includes an interface unit (hereinafter abbreviated as I / F) 124. The projector 100 is connected to the image supply device via the I / F unit 124. For the I / F unit 124, for example, a DVI interface, a USB interface, a LAN interface, or the like to which a digital video signal is input can be used. In addition, the I / F unit 124 includes, for example, an S video terminal to which a composite video signal such as NTSC, PAL, or SECAM is input, an RCA terminal to which a composite video signal is input, a D terminal to which a component video signal is input, or the like. Can be used. Furthermore, a general-purpose interface such as an HDMI connector conforming to the HDMI (registered trademark) standard can be used for the I / F unit 124. The I / F unit 124 may include an A / D conversion circuit that converts an analog video signal into digital image data, and may be configured to be connected to the image supply device through an analog video terminal such as a VGA terminal. Note that the I / F unit 124 may perform transmission / reception of image signals by wired communication or may perform transmission / reception of image signals by wireless communication.

  The projector 100 includes a projection unit 110 (display unit) that forms an optical image roughly and an image processing system that electrically processes an image signal input to the projection unit 110. The projection unit 110 includes a light source unit 111, a light modulation device 112 including a liquid crystal panel 112A, and a projection optical system 113.

  The light source unit 111 includes a light source including a xenon lamp, an ultra-high pressure mercury lamp, an LED (Light Emitting Diode), a laser, and the like. The light source unit 111 may include a reflector and an auxiliary reflector that guide light emitted from the light source to the light modulation device 112. The light source unit 111 is a lens group (not shown) for enhancing the optical characteristics of the projection light, a polarizing plate, a light control element that reduces the amount of light emitted from the light source on the path to the light modulation device 112, or the like. May be provided.

The light modulation device 112 includes, for example, a transmissive liquid crystal panel 112A, and forms an image on the liquid crystal panel 112A in response to a signal from an image processing system described later. In this case, the light modulation device 112 includes three liquid crystal panels 112A corresponding to the three primary colors of RGB in order to perform color projection, and the light from the light source unit 111 is separated into three color lights of RGB. Is incident on the corresponding liquid crystal panel 112A. The color light modulated by passing through each liquid crystal panel 112 </ b> A is combined by a combining optical system such as a cross dichroic prism and emitted to the projection optical system 113.
The light modulation device 112 is not limited to a configuration using three transmissive liquid crystal panels 112A, and for example, three reflective liquid crystal panels may be used. In addition, the light modulation device 112 is configured by a system using a single liquid crystal panel and a color wheel, a system using three DMDs (Digital Mirror Device), a system using a single DMD and a color wheel, and the like. May be. Here, when only one liquid crystal panel 112A or DMD is used as the light modulation device 112, a member corresponding to a composite optical system such as a cross dichroic prism is unnecessary. In addition to the liquid crystal panel 112A and the DMD, any configuration that can modulate the light emitted from the light source can be used without any problem.

  The projection optical system 113 radiates the incident light modulated by the light modulation device 112 outward from the projection opening 114 (FIG. 1) using a projection lens, and forms a projection image on the screen SC.

  The projection unit 110 includes a projection optical system driving unit 121 that drives each motor included in the projection optical system 113 according to the control of the control unit 130, and a light source driving unit 122 that drives a light source included in the light source unit 111 according to the control of the control unit 130. Is connected. The projection optical system driving unit 121 and the light source driving unit 122 are connected to the bus 105.

  The projector 100 includes a wireless communication unit 156. The wireless communication unit 156 is connected to the bus 105. The wireless communication unit 156 includes an antenna, an RF (Radio Frequency) circuit, and the like (not shown), and communicates with the terminal device 10 in accordance with a wireless communication standard under the control of the control unit 130. The projector 100 and the terminal device 10 are connected so as to be able to transmit and receive various data by a wireless communication method.

  The image processing system included in the projector 100 is configured around a control unit 130 that controls the entire projector 100 in an integrated manner, and in addition, a storage unit 151, an image processing unit 125, a light modulation device driving unit 123, and an input processing unit 153. Is provided. The control unit 130, the storage unit 151, the input processing unit 153, the image processing unit 125, and the light modulation device driving unit 123 are each connected to the bus 105.

  The control unit 130 includes a CPU, ROM, RAM, and the like (not shown), and controls the projector 100 by executing a basic control program stored in the ROM by the CPU. Further, the control unit 130 functions as a projection control unit 131, a communication control unit 132, and a correction control unit 133, which will be described later, by executing the application program 31 stored in the storage unit 151 (hereinafter, these are referred to as functional blocks). Call). The correction control unit 133 functions as an image processing unit of the present invention in cooperation with the image processing unit 125.

  The storage unit 151 is a non-volatile memory such as a flash memory or an EEPROM. The storage unit 151 stores a control program used for controlling the projector 100, image data, and the like. In addition, the storage unit 151 stores direction setting data 161 and correction data 162. The direction setting data 161 is data that associates the positions and directions of the terminal device main body 11 (FIG. 1) and the projector main body 101 (FIG. 1). The association indicated by the direction setting data 161 is input by operating a remote controller (not shown) or the operation panel 155, or is stored in advance by the projector 100 as an initial value. Further, the direction setting data 161 may be input by a computer (not shown) connected to the I / F unit 124. The correction data 162 is data for correcting the projection image 201 projected by the projector 100 based on the displacement data transmitted from the terminal device 10. Specifically, the correction data 162 is a table, an arithmetic expression, a parameter or the like for generating a correction parameter from the displacement data.

  The image processing unit 125 executes resolution conversion processing that converts the image data input from the I / F unit 124 into data having a resolution that conforms to the specifications of the liquid crystal panel 112A of the light modulation device 112. The image processing unit 125 draws a display image to be displayed by the light modulation device 112 in the frame memory 126 and outputs the drawn display image to the light modulation device driving unit 123. The light modulation device driving unit 123 drives the light modulation device 112 based on the display image input from the image processing unit 125. Thereby, an image is drawn on the liquid crystal panel 112 </ b> A of the light modulation device 112, and the drawn image is projected as a projected image 201 on the screen SC via the projection optical system 113.

  Further, the image processing unit 125 executes a correction process for correcting the trapezoidal distortion of the projected image 201 by deforming the image drawn in the frame memory 126. In the correction process, so-called barrel distortion (pincushion distortion) may be corrected. The correction process is a process of correcting the distortion of the projection image 201 caused by the positional relationship between the projector 100 and the screen SC and making the projection image 201 on the screen SC an appropriate shape. The image processing unit 125 executes deformation processing such as image enlargement, reduction, and rotation. The image processing unit 125 executes deformation processing and correction processing according to the parameters input from the direction setting data 33.

In the main body of the projector 100, an operation panel 155 including various switches and indicator lamps for a user to operate is disposed. The operation panel 155 is connected to the input processing unit 153. The input processing unit 153 appropriately turns on or blinks the indicator lamp of the operation panel 155 according to the operation state or setting state of the projector 100 according to the control of the control unit 130. When a switch on the operation panel 155 is operated, an operation signal corresponding to the operated switch is output from the input processing unit 153 to the control unit 130.
Further, the projector 100 has a remote control (not shown) used by the user. The remote control includes various buttons, and transmits an infrared signal corresponding to the operation of these buttons. The main body of the projector 100 is provided with a remote control light receiving unit 154 that receives an infrared signal emitted from the remote control. The remote control light receiving unit 154 decodes the infrared signal received from the remote control, generates an operation signal indicating the operation content on the remote control, and outputs the operation signal to the control unit 130.

Next, functional blocks provided in the control unit 130 will be described.
The projection control unit 131 controls the image processing unit 125 to draw an image in the frame memory 126 based on the image data supplied from the image supply device via the I / F unit 124. In addition, the projection control unit 131 controls the light modulation device driving unit 123 to draw the image drawn in the frame memory 126 on the liquid crystal panel 112 </ b> A of the light modulation device 112. An image drawn on the liquid crystal panel 112 </ b> A of the light modulation device 112 is projected as a projection image 201 on the screen SC via the projection optical system 113.

The communication control unit 132 controls the wireless communication unit 40 to perform wireless communication with the terminal device 10. When connected to the terminal device 10, the communication control unit 132 receives displacement data transmitted from the terminal device 10. Here, when the terminal device 10 transmits displacement data, the communication control unit 132 receives the displacement data by the wireless communication unit 156 and passes it to the correction control unit 133.
Further, the communication control unit 132 transmits the direction setting data 161 stored in the storage unit 151 to the terminal device 10 in accordance with a request transmitted from the terminal device 10. In the terminal device 10, the direction setting data 33 (FIG. 2) is generated based on the direction setting data 161 and stored in the storage unit 30 (FIG. 2).

The correction control unit 133 determines a process to be performed on the projection image 201 based on the displacement data input from the communication control unit 132 and generates parameters required for the process based on the displacement data and the correction data 162. To do. In the present embodiment, the process determined by the correction control unit 133 is at least one of a correction process and a deformation process. The parameters related to the deformation process are, for example, the enlargement ratio, the reduction ratio, the rotation direction and the rotation amount, and the parameters related to the correction process are a table and an arithmetic expression indicating the correspondence of coordinates before and after correction, and an image after correction. It is a table etc. for calculating a pixel value of a constituent pixel. The transformation process includes changing the display magnification of the image, that is, enlarging the image and reducing the image, and additionally includes rotating the image.
The correction control unit 133 outputs control data and parameters indicating the determined processing to the image processing unit 125, and causes the image processing unit 125 to perform correction processing and deformation processing.

FIG. 4 is a flowchart illustrating a processing procedure of the projector 100 and the terminal device. FIG. 4A shows the operation of the projector 100, and FIG. 4B shows the operation of the terminal device 10.
The projector 100 projects an image on the screen SC by the projection unit 110 based on the image data input from the external image supply device to the I / F unit 124 (step S11). In step S11, the image processing unit 125 performs a process of drawing an image and outputting an image signal to the light modulation device driving unit 123 under the control of the projection control unit 131, and the light source driving unit 122 turns on the light source unit 111 to emit light. The modulator driving unit 123 draws an image on the liquid crystal panel 112A.

  In the terminal device 10, the application program 31 is executed when the user performs a touch operation on the touch screen 53 (step S21). By the function of the application program 31, the wireless communication unit 40 included in the terminal device 10 transmits a connection request to the wireless communication unit 156 of the projector 100 (step S22) and performs a predetermined negotiation with each other (steps S12 and S22). ). Thereby, the wireless communication connection between the terminal device 10 and the projector 100 is established.

Next, the operation detection unit 23 displays a start screen on the display panel 52. This start screen is a screen for starting a function of controlling the projection image 201 by an operation for changing the position and direction of the terminal device body 11, that is, an operation for moving the terminal device body 11.
FIG. 5 is a diagram illustrating an example of an image displayed on the display panel 52 of the terminal device 10, where (a) illustrates an example of a start screen, (b) illustrates a screen displayed during processing execution, (C) shows an end notification screen.

  As shown in FIG. 5A, the direction guidance image 210 is displayed on the start screen displayed in step S23. The direction guidance image 210 is an image imitating the shape of the projector main body 101. Further, the orientation of the projector main body 101 in the direction guide image 210 matches the association set in the direction setting data 33. As described with reference to FIG. 1, in the present embodiment, the axes AX, AY, and AZ of the terminal device body 11 are associated with each other so as to overlap the axes PX, PY, and PZ of the projector body 101. The display panel 52 corresponds to a plane parallel to the axis AX and the axis AY. Therefore, the direction guide image 210 is an image showing a state in which the axis PX overlaps the axis AX and the axis PY overlaps the axis AY on the display panel 52.

  In addition, a start button 215 is arranged on the start screen of FIG. The start button 215 is a button for instructing start of image correction / deformation processing by moving the terminal apparatus body 11.

After displaying the start screen in step S23 of FIG. 4B, the motion detection unit 23 waits until the start button 215 is operated (step S24; No), and detects that the start button 215 is operated. (Step S24; Yes), processing is started.
At this time, the image displayed on the display panel 52 is switched as shown in FIG. In the display of FIG. 5B, the start button 215 disappears, and the end button 216 is arranged instead. An end button 216 is a button for instructing the end of the process. Further, the direction guide image 210 is continuously displayed on the screen of FIG.

The motion detection unit 23 that has started the process detects the initial position of the terminal device body 11 based on the detection signals of the angular velocity sensor 61 and the acceleration sensor 62 (step S24). This initial position is a position that serves as a reference for the position and direction of the terminal apparatus body 11. The motion detection unit 23 can obtain the angle of the AX-AY plane with respect to the horizontal based on the detection value of the acceleration sensor 62. For example, when the terminal device 10 includes a geomagnetic sensor that detects the direction. The direction of the axis AX can be detected.
Next, the motion detection unit 23 detects changes in the position and direction of the terminal apparatus body 11 with respect to the initial position based on detection signals from the angular velocity sensor 61 and the acceleration sensor 62 (step S26). The motion detection unit 23 generates displacement data based on the detected change, and causes the communication control unit 22 to transmit the displacement data to the projector 100 (step S27).

When the wireless communication unit 156 receives the displacement data transmitted from the terminal device 10 (step S13), the communication control unit 132 passes the received displacement data to the correction control unit 133.
The correction control unit 133 refers to the correction data 162 stored in the storage unit 151, determines the processing content based on the displacement data, and generates a parameter (step S14). Then, the correction control unit 133 outputs control data indicating parameters of processing and parameters to the image processing unit 125, and causes the image processing unit 125 to execute processing (step S15).

FIG. 6 is a diagram illustrating a specific example of image processing executed by the image processing unit 125.
FIG. 6A shows a projection image 201 having a proper shape. In a proper projection state, the projection image 201 on the screen SC is rectangular. On the other hand, when the projector 100 projects from above the screen SC, that is, when the image light projected by the projector 100 is tilted with respect to the horizontal plane, the projected image 201 is distorted into a trapezoid as shown in FIG.

In the display system 1, when an operation for moving the terminal device body 11 is performed, the operation is converted into an operation for moving the projector body 101, and image processing corresponding to the case where the projector body 101 moves is performed.
When correcting the trapezoidal distortion as shown in FIG. 6B, the terminal device main body 11 is rotated around the axis AY (CY direction), and the operation to make the axis AX upward is performed. The motion detection unit 23 converts the rotation of the terminal device body 11 in the CY direction into the rotation of the projector body 101 in the QY direction. In FIG. 6B, since the image light of the projector 100 is downward, trapezoidal distortion can be reduced by making it upward. The operation of rotating the terminal device body 11 upward is converted into an operation of turning the image light of the projector body 101 upward, and is transmitted to the projector 100 as displacement data.

  In the display system 1, not only the axis of the terminal device body 11 overlaps the axis of the projector body 101, but also one end in the longitudinal direction of the terminal device body 11 and the front end (projection opening 114 side) of the projector body 101. It is associated. Further, the display panel 52 and the upper surface of the projector main body 101 are associated with each other. This association is set by the direction setting data 33 and 161, and the direction guide image 210 is displayed according to this association. Therefore, when the terminal device main body 11 rotates about the axis AY, it is promptly specified whether the image light of the projector main body 101 is directed upward or downward.

  In the present embodiment, the projector main body 101 is not actually rotated. When displacement data indicating rotation of the projector main body 101 is transmitted from the terminal device 10, the correction control unit 133 deforms the projection image 201 in the same manner as when the projector main body 101 is rotated. Therefore, the image having the trapezoidal distortion in FIG. 6B is corrected to an appropriate shape as shown in FIG.

  In this case, the user visually recognizes that a trapezoidal distortion has occurred because the projector main body 101 faces downward, and operates the terminal device main body 11 so that the projector main body 101 faces upward. The direction in which the terminal device body 11 is actually moved can be easily understood by looking at the direction guide image 210. For this reason, the distortion of the projected image 201 can be corrected by moving the terminal device body 11 intuitively. For example, the terminal device main body 11 is erroneously moved in the reverse direction to prevent a problem such as an increase in distortion, and the operability can be improved.

  FIG. 6C shows an example of the projected image 201 when the image light projected by the projector 100 is inclined in the horizontal direction with respect to the screen SC. In this example, the projector 100 projects from the right side toward the screen SC. When the trapezoidal distortion shown in FIG. 6C is eliminated by moving the projector main body 101, the projector main body 101 may be rotated around the axis PZ (QZ direction). Therefore, the user rotates the terminal device body 11 around the axis AZ (CZ direction). Thereby, according to the rotation of the terminal device main body 11, displacement data indicating the rotation of the projector main body 101 is transmitted from the terminal device 10 to the projector 100, and the correction control unit 133 corrects the keystone of the image.

In order for the image processing unit 125 to correct the trapezoidal distortion, a table, an arithmetic expression, and a parameter relating to image deformation (geometric correction) are required, which are corrected by the correction control unit 133 based on the correction data 162 and the displacement data. Generate.
Thus, by moving the terminal device main body 11, the projection image 201 can be deformed so as to move the projector main body 101, and the trapezoidal distortion can be corrected. Further, not only the trapezoidal distortion shown in FIGS. 6B and 6C but also the trapezoidal distortion in which the vertical and horizontal inclinations are combined can be corrected by moving the terminal device body 11.

Image deformation performed by the correction control unit 133 and the image processing unit 125 is not limited to correction processing for correcting trapezoidal distortion, and deformation processing such as enlargement, reduction, and rotation is possible.
FIG. 6D shows a deformation process for rotating the projection image 201, and FIG. 6E shows a deformation process for enlarging and reducing the projection image 201.
When the terminal device body 11 is rotated about the axis AX (CX direction), the motion detection unit 23 generates displacement data corresponding to the case where the projector body 101 is rotated about the optical axis. The correction control unit 133 can rotate the image by the image processing unit 125 and rotate the projection image 201 as indicated by a symbol E in FIG. Also in this case, by moving the terminal device body 11, the projection image 201 is deformed as if the projector body 101 was moved.

  Further, when an operation for moving the terminal device main body 11 along the axis AX is performed, the projection image 201 is deformed so that the projector main body 101 moves along the optical axis. When the projector main body 101 moves along the optical axis, the projected image 201 becomes smaller if it moves closer to the screen SC, and the projected image 201 becomes larger if it moves away from the screen SC. Based on the displacement data, the correction control unit 133 causes the image processing unit 125 to enlarge or reduce the image, and thereby the projection image 201 is enlarged as indicated by a symbol F in FIG. Reduced as shown in. Here, if the movement of the terminal device main body 11 is only the movement along the axis AX, the projection image 201 is enlarged or reduced without moving the center. When the terminal apparatus main body 11 moves also in the axis AY direction or the axis AZ direction, the center of the projection image 201 is moved corresponding to the movement amount in the axis AY direction or the axis AZ direction.

  Returning to the description of FIG. After transmitting the displacement data to the projector 100, the motion detection unit 23 determines whether or not the end button 216 displayed on the display panel 52 has been operated (step S28). When the end button 216 is not operated (step S28; No), the process returns to step S26 to detect a change in the position and direction of the terminal device body 11. When the process of step S26 is performed for the first time, a change in the position and direction of the terminal device body 11 is detected with reference to the initial position detected in step S25. However, after the second time, the terminal device detected in the previous step S26 is detected. The position and direction of the main body 11 are used as a reference.

When the end button 216 is operated, the motion detection unit 23 notifies the projector 100 of the end by the communication control unit 22 (step S29).
On the other hand, the correction control unit 133 determines whether or not the end is notified from the terminal device 10 (step S16), and returns to step S13 to receive the displacement data while the end is not notified (step S16; No). stand by. When the communication control unit 132 receives the control data of the end notification and is notified of the end (step S16; Yes), the communication control unit 132 and the communication control unit 22 are connected to the wireless communication unit 156 and the wireless communication unit 40. To terminate the communication (steps S17 and S30).

Thereafter, the correction control unit 133 determines the state of the deformed image (step S18). Thereby, the shape of the image formed on the liquid crystal panel 112A is fixed, and the shape of the projected image 201 is maintained after the correction process and the deformation process.
Moreover, in the terminal device 10, execution of the application program 31 is complete | finished (step S31).

  In the terminal device 10, when the end button 216 is operated (step S28; Yes), the screen displayed on the display panel 52 is switched to the end notification screen in FIG. An end notification image 217 is displayed on the end notification screen to notify the user of the end of the operation of moving the terminal device body 11.

  Further, in the above embodiment, the correction control unit 133 refers to the correction data 162 and drives the projection optical system drive unit 121 based on the displacement data, thereby executing the focus adjustment of the projection optical system 113. Good. For example, adjustment is performed by moving the focus of the projection optical system 113 based on displacement data corresponding to an operation of rotating the terminal apparatus body 11 about the axis AX, the axis AY, or the axis AZ. In this case, focus adjustment can be performed by an operation of moving the terminal device body 11.

As described above, the display system 1 according to this embodiment includes the projector 100 and the terminal device 10. The terminal device 10 includes an angular velocity sensor 61 and an acceleration sensor 62 as a detection unit that detects at least one of the position and orientation of the terminal device 10. The terminal device 10 displays a direction guidance image 210 indicating at least one of the association between the position of the terminal device 10 and the position of the projector 100 and the association between the orientation of the terminal device 10 and the orientation of the projector 100. To do. The projector 100 deforms the projection image 201 projected by the projection unit 110 according to a change in the position or orientation of the terminal device 10. For this reason, even a user who does not know the setting such as the association between the terminal device main body 11 and the projector main body 101 can change the projection image 201 into a desired state by operating the terminal device 10. It is possible to improve the performance.
Here, in the terminal device 10, at least one of the association between the position of the terminal device body 11 and the position of the projection unit 110 and the association between the direction of the terminal device body 11 and the direction of the projection unit 110 is at least one of them. It may be set in advance. The terminal device 10 may display the direction guidance image 210 indicating the set association on the display panel 52 of the terminal device 10. Further, the terminal device 10 detects at least one of the position and orientation of the terminal device body 11, and the projector 100 regards a change in the position or orientation of the terminal device body 11 as a change in the position or orientation of the projection unit 110. Thus, the projected image 201 may be deformed.

  Further, the motion detection unit 23 of the terminal device 10 converts the detection results of the angular velocity sensor 61 and the acceleration sensor 62 into a change in the position or orientation of the projector main body 101, and the displacement data that is the conversion result is projected by the wireless communication unit 40. To 100. The projector 100 includes a correction control unit 133 that deforms the projection image 201 according to the displacement data transmitted from the terminal device 10. For this reason, the position or orientation of the terminal device body 11 detected by the terminal device 10 is converted into the position or orientation of the projector body 101 and transmitted to the projector 100. For this reason, it is possible to reduce the processing load for the projector 100 to change the projected image 201 and to improve the processing efficiency.

  Further, the terminal device 10 notifies the start or end of detection of the angular velocity sensor 61 and the acceleration sensor 62 by displaying a start button 215 and an end notification image 217 on the display panel 52. For this reason, the user who operates the terminal device 10 can be notified of the start or end of detection, and the operability can be further improved.

  In addition, the projector 100 includes a projection unit 110 that projects image light onto a projection target, and the orientation of the terminal device body 11 is such that the optical axis direction of the projector 100 and the longitudinal direction of the display panel 52 provided in the terminal device 10 overlap. And the direction of the projection unit 110 are associated with each other. For this reason, when the position or direction of the terminal device 10 changes, the projection image 201 changes so that the longitudinal direction of the display panel 52 corresponds to the optical axis of the projector 100, so the user performs an intuitive operation. be able to.

  The projector 100 regards a change in the position or orientation of the terminal device body 11 as a change in the position or orientation of the projection unit 110, and corrects at least trapezoidal distortion correction of the image projected by the projection unit 110, changes in display magnification, and focus adjustment. Do one. For this reason, operations related to trapezoidal distortion correction of the image projected by the projector, display magnification change, that is, enlargement / reduction, and focus adjustment can be easily performed using the terminal device 10.

The terminal device 10 detects the amount of rotation of the terminal device body 11 around an axis AY direction substantially orthogonal to the longitudinal direction of the display panel 52 or an axis parallel to the axis AZ direction. The projector 100 executes trapezoidal distortion correction of the projection image 201 based on the rotation amount of the terminal device body 11 detected by the terminal device 10. For this reason, the keystone distortion correction of the projected image 201 is performed by rotating the terminal device body 11 about the direction substantially orthogonal to the longitudinal direction of the display panel 52 as an axis. For this reason, the operation method of the terminal device 10 can be increased and multifunctionality can be achieved, and operability can be improved.
Further, the terminal device 10 detects the movement of the terminal device body 11 in the axis AX direction, and the projector 100 corresponds to the movement of the terminal device 10 detected by the terminal device 10 and displays an image projected by the projection unit 110. Zoom in or out. For this reason, the display magnification of an image can be changed by the operation of moving the terminal device 10 in the longitudinal direction of the display panel 52, and the operation related to the display magnification can be intuitively performed.

  The above-described embodiment shows an example of a preferred embodiment of the present invention, and the embodiment of the present invention is not limited to this, and various modifications are possible within the scope of the present invention. Variations are possible. For example, in the above-described embodiment, the example in which the association is performed so that the axes AX, AY, and AZ of the terminal device body 11 overlap the axes PX, PY, and PZ of the projector body 101 has been described. The present invention is not limited to this, and the axes AX, AY, and AZ of the terminal apparatus main body 11 and the axes PX, PY, and PZ of the projector main body 101 are associated with each other in parallel. If this is done, the same effect as in the above embodiment can be obtained. Further, the position or direction of the terminal device main body 11 detected by the motion detection unit 23 or the change thereof is not limited to the method based on the axes AX, AY, and AZ. Polar coordinates may be set for the terminal device main body 11 and a change in position or direction based on the polar coordinates may be detected. The present invention can be applied to any method that can identify the three-dimensional displacement of the terminal device main body 11. is there. The same applies to the method of specifying the position or direction of the projector main body 101.

  Further, in the above embodiment, when the detection of the position and direction of the terminal device body 11 is started, the start button 215 is displayed on the display panel 52 to enable an operation for instructing the start, and the start notification is given. However, the present invention is not limited to this. That is, in step S23, instead of the start button 215, an image for informing the start of detection may be displayed, and detection may be started without an operation for instructing the start. Also in this case, it is possible to notify the user of detection start.

  For example, in the above embodiment, the front projection type projector 100 that projects from the front of the screen SC is shown as an example of the display device, but the present invention is not limited to this. For example, a rear projection (rear projection) type projector that projects from the back side of the screen SC can be employed as the display device. Further, a liquid crystal monitor or a liquid crystal television that displays an image on a liquid crystal display panel may be employed as the display device. A PDP (plasma display panel), CRT (cathode ray tube) display, SED (Surface-conduction Electron-emitter Display), or the like may be used as a display device. A self-luminous display device such as a monitor device or a television receiver that displays an image on an organic EL display panel called an OLED (Organic light-emitting diode) or an OEL (Organic Electro Luminescence) display may be employed. . When the present invention is applied to a configuration including these display devices, a useful effect can be obtained as in the above embodiment.

  Moreover, the input device of the present invention has been described by taking the portable terminal device 10 as an example of the terminal device body 11 which is a flat terminal device body 11 that the user holds and operates as a terminal device. However, the present invention is not limited to this. That is, the terminal device 10 according to the above-described embodiment includes the touch screen 53 and the display panel 52 that can be operated by a user touching a finger, thereby enabling intuitive operation and high operability. There are advantages. On the other hand, the present invention can be applied to any device provided with a display screen. For example, a portable game machine, a portable reproduction device that reproduces music and video, and the like can be used.

  Moreover, each function part shown in FIG.2 and FIG.3 shows a functional structure, and a specific mounting form is not restrict | limited in particular. That is, it is not always necessary to mount hardware corresponding to each function unit individually, and it is of course possible to adopt a configuration in which the functions of a plurality of function units are realized by one processor executing a program. In addition, in the above embodiment, a part of the function realized by software may be realized by hardware, or a part of the function realized by hardware may be realized by software. In addition, specific detailed configurations of other parts of the display system 1 can be arbitrarily changed without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Display system, 10 ... Terminal device, 11 ... Terminal apparatus main body (main body), 20 ... Control part, 21 ... Display control part, 22 ... Communication control part (transmission part), 23 ... Operation | movement detection part (control part), DESCRIPTION OF SYMBOLS 30 ... Memory | storage part, 31 ... Application program, 33 ... Direction setting data, 40 ... Wireless communication part (transmission part), 51 ... Display part, 52 ... Display panel (display screen), 53 ... Touch screen, 55 ... Operation detection part , 61 ... Angular velocity sensor (detection unit), 62 ... Acceleration sensor (detection unit), 100 ... Projector (display device), 101 ... Projector body (main body), 110 ... Projection unit (display unit), 111 ... Light source unit, 112 DESCRIPTION OF SYMBOLS ... Light modulation apparatus, 112A ... Liquid crystal panel, 113 ... Projection optical system, 114 ... Projection opening part, 121 ... Projection optical system drive part, 122 ... Light source drive part, 123 ... Light modulation apparatus drive part, 24 ... I / F unit, 125 ... image processing unit, 126 ... frame memory, 130 ... control unit, 131 ... projection control unit, 132 ... communication control unit, 133 ... correction control unit (image processing unit), 151 ... storage unit 156: Wireless communication unit 161: Direction setting data 162 ... Correction data 201 ... Projection image 210 ... Direction guidance image 215 ... Start button 216 ... End button 217 ... End notification image AX, AY, AZ ... Axis, PX, PY, PZ ... Axis, SC ... Screen.

Claims (9)

A display system comprising a display device and a terminal device,
The terminal device
A display screen for displaying an image indicating at least one of the association between the position of the terminal device and the position of the display device, and the association between the orientation of the terminal device and the orientation of the display device;
A detection unit that detects at least one of the position and orientation of the terminal device,
The display device
A display for displaying an image;
A display system comprising: an image processing unit that deforms an image displayed by the display unit in accordance with a change in position or orientation of the terminal device. The terminal device includes a control unit that converts the detection result of the detection unit into a change in the position or orientation of the display device, and transmits the conversion result to the display device by a transmission unit,
The image processing unit included in the display device deforms an image displayed by the display unit according to a conversion result transmitted from the terminal device;
The display system according to claim 1.   The display system according to claim 1, wherein the terminal device notifies the detection start or the detection end of the detection unit by displaying the display screen. The display device is a projector including the display unit that projects image light onto a projection target;
The orientation of the terminal device and the orientation of the display unit are associated with each other so that the optical axis direction of the projector and the longitudinal direction of the display screen included in the terminal device overlap.
The display system according to claim 1, wherein:   The image processing unit included in the display device regards a change in the position or orientation of the terminal device as a change in the position or orientation of the display unit, and corrects the trapezoidal distortion of the image projected by the display unit, and the display magnification. The display system according to claim 4, wherein at least one of change and focus adjustment is executed. The detection unit included in the terminal device detects a rotation amount of the terminal device around an axis parallel to a second direction or a third direction substantially orthogonal to the longitudinal direction of the display screen,
The image processing unit included in the display device performs trapezoidal distortion correction of an image projected by the display unit based on a rotation amount of the terminal device detected by the terminal device. 5. The display system according to 5.   The detection unit included in the terminal device detects the movement of the terminal device in the longitudinal direction, and the image processing unit included in the display device corresponds to the movement of the terminal device detected by the terminal device. The display system according to claim 4, wherein the display magnification of an image projected by the display unit is changed. A terminal device,
A transmission unit for transmitting information to an external display device;
A display screen for displaying an image indicating at least one of the association between the position of the terminal device and the position of the display device, and the association between the orientation of the terminal device and the display device;
A detection unit for detecting at least one of the position and orientation of the terminal device;
A control unit that generates information indicating a change in the position or orientation of the display device based on the change in the position or orientation of the terminal device detected by the detection unit, and transmits the information by the transmission unit;
A terminal device comprising: A program executable by a computer controlling the terminal device,
By the computer
Displaying on the display screen an image indicating at least one of the association between the position of the terminal device and the position of the external display device, and the association between the orientation of the terminal device and the display device;
When at least one of the position and orientation of the terminal device is detected, information indicating a change in the position or orientation of the display device is generated based on the detected change in the position or orientation of the terminal device, and the display device Sending to
A program characterized by

Images