JP2018147210A - Display system, display device, terminal device, control method of display system, control program for display device, and control program for terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display system that suppresses degradation of visibility of a projected image by displaying additional information.SOLUTION: The display system 100 includes: a projector device 10; and a terminal device 80 capable of communicating with the projector device 10. The projector device 10 includes: a projection unit 200 for displaying an image based on image data; a communication unit 60 for transmitting the image data to the terminal device 80 and receiving positional information transmitted from the terminal device 80; and a control unit 30 for extracting additional information from the image data based on the positional information and causing the communication unit 60 to transmit the image data including the additional information. The terminal device 80 includes: a communication unit 82 for receiving the image data to be transmitted and transmitting the positional information; a display unit 94 for displaying an image based on the received image data; an operation unit 92 for instructing the displayed image; and a control unit 90 for generating positional information based on a position of the instructed image and causing the communication unit 82 to transmit the generated positional information.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a display system, a display device, a terminal device, a display system control method, a display device control program, and a terminal device control program.

In some cases, detailed information is required for a desired portion in the image displayed by the display device. In this case, as shown in Patent Document 1 below, a technique is disclosed in which the color name of the area is displayed when the cursor is moved to a desired area of the image displayed on the display unit of the digital camera and a predetermined operation is performed. Has been.
In recent years, in meetings and classes, the information terminal carried by each user and the projector device are synchronized, and the projector device enlarges the image and projects it on the screen, and the image projected by the projector device is displayed on the information terminal. A system for improving the visibility of a user by displaying the same image on the display unit of the information terminal is also put into practical use. The technique shown in Patent Document 1 below can be easily applied to such a system.

  For example, when the user wants to know information about a desired part of the image displayed on the display unit of the information terminal, when the user designates the desired part on the information terminal, the color of the desired part on the image projected on the screen The name is displayed. Thereby, the user can know the color name of the desired portion of the image.

JP 2005-202452 A

However, since the color name of the desired part is displayed in the image projected on the screen, if the desired part is different for each user, each color name is added to the image and displayed. For this reason, there is a problem that the visibility of the original image is lowered.
The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a system that avoids a reduction in the visibility of a projected image due to display of additional information.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

[Application Example 1]
The display system according to this application example is a display system including a display device and a terminal device capable of communicating with the display device, and the display device includes a first display unit that displays an image based on image data; A first communication unit that transmits the image data to the terminal device and receives position information transmitted from the terminal device; and extracts additional information from the image data based on the position information, and the first communication A first controller that causes the terminal device to transmit the image data including the additional information to the terminal device, wherein the terminal device receives the image data transmitted from the display device, and transmits the position information to the terminal device. A second communication unit that transmits to the display device, a second display unit that displays the image based on the image data received by the second communication unit, and the image displayed on the second display unit Instructions When, the instruction unit generates the positional information based on the position of the image indicated a second control unit for transmitting the generated positional information to the second communication unit, characterized in that it comprises a.

  According to such a configuration, the image data transmitted from the display device is received by the terminal device, the image indicated by the image data is displayed on the second display unit of the terminal device, and position information based on the position where the image is indicated Is transmitted to the display device. The display device extracts additional information from the image data based on the position information, and transmits the image data including the additional information to the terminal device. Therefore, since the image including the additional information is displayed on the second display unit of the terminal device, the image including the additional information is not displayed on the image displayed on the first display unit of the display device. Decrease in visibility can be avoided.

[Application Example 2]
In the display system according to the application example, the first display unit may display an image based on the image data received from the image output device.

[Application Example 3]
In the display system according to the application example, the first control unit causes the first communication unit to transmit first image data indicating the first image displayed on the first display unit to the terminal device, and When the communication unit receives the position information from the terminal device, the communication unit generates composite image data obtained by combining the additional information extracted based on the position information and the first image, and the generated composite image data is It is preferable to transmit the first communication unit to the terminal device.

  According to such a configuration, the first control unit of the display device generates composite image data obtained by combining the additional information extracted based on the position information transmitted from the terminal device and the first image, and the generated composite Since the image data is transmitted to the terminal device, the terminal device does not require image composition processing, and the processing load on the terminal device can be reduced.

[Application Example 4]
In the display system according to the application example, the first control unit causes the first communication unit to transmit first image data indicating the first image displayed on the first display unit to the terminal device, and When one communication unit receives the position information from the terminal device, additional information image data indicating an additional information image including the additional information extracted based on the position information is generated based on the position information. Preferably, the additional information image data is transmitted from the first communication unit to the terminal device.

  According to such a configuration, the first control unit of the display device generates the additional information image data of the additional information image including the additional information extracted based on the position information transmitted from the terminal device, and generates the generated additional information. Since the image data is transmitted to the terminal device, the processing burden on the display device can be reduced.

[Application Example 5]
In the display system according to the application example, the second control unit synthesizes the first image indicated by the first image data received by the second communication unit and the additional information image indicated by the additional information image data. Preferably, the synthesized image data is generated, and a synthesized image based on the generated synthesized image data is displayed on the second display unit.

  According to such a configuration, the second control unit of the terminal device can synthesize the additional information image indicated by the received additional information image data and the first image, and display the synthesized image.

[Application Example 6]
In the display system according to the application example, the image data includes the first image data layer indicating the first image, and the additional information data layer in which the additional information is described corresponding to the drawing position of the first image. It is preferable to have.

  According to such a configuration, since the first image data and the additional information data are separated from the image data, one of the data can be easily acquired as necessary.

[Application Example 7]
In the display system according to the application example, the additional information may indicate color information of the first image.

[Application Example 8]
In the display system according to the application example described above, the additional information may indicate attribute information of objects constituting the first image.

[Application Example 9]
In the display system according to the application example, the additional information may indicate character information describing the first image.

[Application Example 10]
In the display system according to the application example, it is preferable that the terminal device includes a storage unit that stores the image data.

  According to such a configuration, the terminal device can store image data.

[Application Example 11]
In the display system according to the application example described above, it is preferable that the terminal device includes a plurality of terminals, and the first control unit causes the terminal device to transmit the image data including the additional information.

  According to such a configuration, since the image data including the additional information is transmitted to a plurality of terminal devices, the image data including the additional information is transmitted to the terminal device other than the terminal device that transmitted the position information, and displayed. Can be made.

[Application Example 12]
In the display system according to the application example, the first control unit statistically processes the position information transmitted from each terminal device, and reflects the result of the statistical processing on the image displayed on the first display unit. It is preferable to make it.

  According to such a configuration, the first control unit of the display device statistically processes the position information transmitted from the plurality of terminal devices, and displays the result of the statistical processing on the first display unit. The statistical result of the position information instructed in can be made known.

[Application Example 13]
The display device according to this application example is a display device that can communicate with a terminal device, and includes a first display unit that displays an image based on image data, the image data transmitted to the terminal device, and the terminal device. A first communication unit that receives position information transmitted from the first communication unit; and a first communication unit that extracts additional information from the image data based on the position information and causes the first communication unit to transmit the image data including the additional information. And a control unit.

  According to such a configuration, the image data transmitted from the display device is received by the terminal device, the image indicated by the image data is displayed on the second display unit of the terminal device, and position information based on the position where the image is indicated Is transmitted to the display device. The display device extracts additional information from the image data based on the position information, and transmits the image data including the additional information to the terminal device. Therefore, since the image including the additional information is displayed on the second display unit of the terminal device, the image including the additional information is not displayed on the image displayed on the first display unit of the display device. Decrease in visibility can be avoided.

[Application Example 14]
A terminal device according to this application example is a terminal device capable of communicating with a display device, and receives a second communication unit that receives the image data transmitted from the display device and transmits the position information to the display device. A second display unit that displays an image based on the image data received by the second communication unit, an instruction unit that instructs the image displayed on the second display unit, and the instruction unit that is instructed by the instruction unit A second control unit configured to generate the position information based on a position of an image and to transmit the generated position information to the second communication unit.

  According to such a configuration, the terminal device receives the image data transmitted from the display device, displays the image indicated by the image data on the second display unit, and the position information based on the position where the image is indicated is displayed on the display device. Sent to. Additional information is extracted from the image data based on the transmitted position information, and image data including the additional information is transmitted to the terminal device. Accordingly, since the image including the additional information is displayed on the second display unit of the terminal device, it is possible to avoid a decrease in the visibility of the image displayed on the display device.

[Application Example 15]
A display system control method according to this application example is a display system control method including a display device and a terminal device capable of communicating with the display device, wherein the display device displays an image based on image data. The display device transmits the image data to the terminal device, displays the image based on the image data received by the terminal device, and the terminal device is based on a position designated with respect to the image. Generating position information, the terminal device transmitting the position information to the display device, extracting additional information from the image data based on the position information received by the display device, and extracting the additional information from the display device The image data including additional information is transmitted to the terminal device, and the image is displayed based on the image data received by the terminal device.

  According to such a method, the image data transmitted from the display device is received by the terminal device, the image indicated by the image data is displayed on the second display unit of the terminal device, and the position information based on the position where the image is indicated Is transmitted to the display device. The display device extracts additional information from the image data based on the position information, and transmits the image data including the additional information to the terminal device. Therefore, since the image including the additional information is displayed on the second display unit of the terminal device, the image including the additional information is not displayed on the image displayed on the first display unit of the display device. Decrease in visibility can be avoided.

[Application Example 16]
The display device control program according to this application example is a display device control program capable of communicating with a terminal device, and has a function of displaying an image based on image data and a function of transmitting the image data to the terminal device. A function of receiving position information generated by the terminal device, a function of extracting additional information from the image data based on the position information, and a function of transmitting the image data including the additional information to the terminal device And having a computer execute.

  According to such a configuration, the display device transmits image data to the terminal device, receives position information transmitted by the terminal device with respect to the image data, and extracts additional information from the image data based on the received position information. Then, the image data including the additional information is transmitted to the terminal device. Therefore, although the image including the additional information is transmitted to the terminal device, since the image including the additional information is not displayed on the display device, it is possible to avoid a decrease in visibility in the display device.

[Application Example 17]
The control program for the terminal device according to this application example is a control program for the terminal device that can communicate with the display device, and displays the image based on the function of receiving the image data transmitted by the display device and the image data. A function for generating position information based on a position designated with respect to the image, a function for transmitting the position information to the display device, and the image data including additional information transmitted by the display device And a function of displaying the image based on the image data including the additional information.

  According to such a configuration, the terminal device receives the image data transmitted from the display device, displays the image indicated by the image data, and transmits position information based on the position where the image is indicated to the display device. Thus, image data including additional information based on the position information is received and displayed. Therefore, the terminal device can display an image including additional information.

The figure which shows schematic structure of the display system which concerns on embodiment. The block diagram which shows the function structure of a display system. The figure explaining the structure of content data. The figure which shows the optical system of a projection part typically. The flowchart which shows the flow of the display process by a display system. The figure which shows the example of a display of the synthesized image displayed on the terminal device. The figure which shows the example of a display of the synthesized image displayed on the terminal device.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment)
FIG. 1 is a diagram showing a schematic configuration of a display system 100 according to an embodiment to which the present invention is applied. The display system 100 includes a projector device 10 and terminal devices 80A and 80B.
The projector device 10 is one of display devices, and is installed above a screen SC such as a whiteboard having a display surface. Further, the projector device 10 is communicably connected to the terminal devices 80A and 80B via wireless communication.
In the present embodiment, the terminal device 80A is a notebook personal computer (computer), and the terminal device 80B is a tablet terminal. The terminal devices 80A and 80B may be high-function mobile phones such as smartphones. Further, the number of terminal devices 80A and 80B that can be connected to the projector device 10 is not limited to two. Further, the communication with the projector device 10 is not limited to wireless communication, and may be wired communication.

In the present embodiment, the projector apparatus 10 is assumed to be an apparatus having an interactive function.
The projector device 10 projects an image based on the input content data 350 (FIG. 2) onto a screen SC as a projection surface. This projector device 10 is a short focus type, and is assumed to be installed directly above the screen SC and project an image obliquely downward.
The user can add a desired graphic or the like to the image of the screen SC projected by the projector device 10 by operating the indicator 70.

Further, the projector device 10 transmits image data of an image projected on the screen SC to the terminal devices 80A and 80B. The terminal devices 80A and 80B generate an image based on the received image data, and display the generated image on each display unit 94. The user can instruct an image displayed on the display unit 94 of the terminal devices 80A and 80B with a finger FG (FIGS. 6A and 6B), a pointing device (not shown), or the like.
FIG. 2 is a block diagram illustrating a functional configuration of the display system 100.
The terminal device 80 includes a communication unit 82 having a reception unit 84 and a transmission unit 86, a control unit 90, an operation unit 92, a display unit 94, and a storage unit 96. The communication unit 82 corresponds to the second communication unit, and the control unit 90 corresponds to the second control unit. The operation unit 92 corresponds to an instruction unit, and the display unit 94 corresponds to a second display unit.
In the present embodiment, the communication unit 82 receives image data transmitted from the projector device 10 and transmits information related to the position to the projector device 10. The display unit 94 displays an image based on the image data received by the communication unit 82. Further, the operation unit 92 gives an instruction to the image displayed on the display unit 94. Further, the control unit 90 generates position information based on the position of the image specified by the operation unit 92 and causes the communication unit 82 to transmit the generated information to the projector device 10.

  The control unit 90 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a DRAM (Dynamic Random Access Memory), etc., not shown, and reads a basic control program stored in the ROM into the DRAM. It is a kind of computer that executes and controls the projector device 10. In addition, the control unit 90 realizes a function by executing a program stored in the storage unit 96. The storage unit 96 is assumed to be a ROM capable of storing a program, for example.

In the present embodiment, the terminal device 80 is assumed to be a multi-function mobile terminal such as a tablet terminal, and employs a touch panel in which the display unit 94 and the operation unit 92 are integrated.
The projector device 10 includes a data input unit 11.
The data input unit 11 may be a communication interface such as a USB interface, a wired or wireless LAN interface, for example. For example, a server device or another projector may be connected to the LAN interface provided in the data input unit 11.

The data input unit 11 may include an image input terminal to which an analog video signal or digital image data is input. The image input terminal is a VGA terminal, DVI (Digital Visual Interface), S video terminal, RCA terminal, D terminal, HDMI connector conforming to the HDMI (registered trademark) standard, or the like. The data input unit 11 may include an interface circuit and an image processing circuit corresponding to these image input terminals. The data input unit 11 may have a reading function for reading image data stored in a flash memory or the like.
The projector device 10 can be broadly divided into an image processing system that processes image data and a projection unit 200 that forms an optical image.

<Functions of image processing system>
The projector device 10 includes a communication unit 60, an operation panel 19, a position detection unit 50, a control unit 30, a storage unit 35, an image processing unit 40, a light source driving unit 14, and a light modulation device driving unit 15 as functional units of an image processing system. And a projection optical system drive unit 16.
The communication unit 60 corresponding to the first communication unit includes a transmission unit 62 and a reception unit 64, and communicates with the terminal device 80 based on the control of the control unit 30. In the present embodiment, the communication unit 60 includes, for example, Bluetooth (registered trademark) (including BTLE: Bluetooth Low Energy), Wi-Fi (registered trademark) (Wi-Fi: Wireless Fidelity), Zigbee (registered trademark), and NFC. (Near field communication), communication corresponding to wireless communication standards such as ANT + (registered trademark) is assumed.
In the present embodiment, the communication unit 60 transmits image data to the terminal device 80 and receives position information transmitted from the terminal device 80.

The operation panel 19 is provided in the exterior housing of the projector device 10 and includes various switches and indicator lamps.
The storage unit 35 stores a control program 36 executed by the control unit 30 and data processed by the control unit 30.
The indicator 70 is separate from the projector device 10 and is gripped by the user. The indicator 70 includes an operation switch 72 and a display information transmission unit 74 that outputs an infrared signal. The display information transmission unit 74 periodically transmits an infrared signal, modulates the infrared signal according to the operation state (ON / OFF) of the operation switch 72, and transmits data indicating ON / OFF of the operation switch 72.
The position detection unit 50 includes an imaging unit 51, a display information reception unit 52, an imaging control unit 53, a pointer detection unit 54, and a coordinate calculation unit 55.

The imaging unit 51 includes an imaging optical system, an imaging element, an interface circuit, and the like, and images the projection direction of the projection optical device 290. The imaging optical system of the imaging unit 51 is arranged in the same direction as the projection optical device 290, and has an angle of view that covers a range in which the projection optical device 290 projects an image on the screen SC. Moreover, CCD and CMOS are mentioned as an image pick-up element. The interface circuit reads and outputs the detection value of the image sensor.
The imaging control unit 53 causes the imaging unit 51 to perform imaging and generates captured image data. When the imaging unit 51 performs imaging under the control of the imaging control unit 53, the indicator 70 operated on or near the screen SC is imaged together with the image projected on the screen SC.

The display information receiving unit 52 outputs received data based on the signal transmitted by the display information transmitting unit 74. The reception data output by the display information receiving unit 52 includes data indicating the operation state of the operation switch 72.
The indicator detection unit 54 detects the position of the indicator 70 based on the captured image data generated by the imaging control unit 53.
The coordinate calculation unit 55 calculates the coordinates of the position indicated by the tip of the indicator 70 on the screen SC, that is, the coordinates of the operation position, based on the position of the indicator 70 in the captured image data specified by the indicator detection unit 54. To do.

The storage unit 35 stores a control program 36 executed by the control unit 30 and data processed by the control unit 30.
The control unit 30 corresponds to a first control unit, and includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a DRAM (Dynamic Random Access Memory), etc., not shown, and a basic control program stored in the ROM. It is a kind of computer that controls the projector device 10 by reading it into a DRAM and executing it by a CPU. Further, the control unit 30 executes functions of the projection control unit 31, the detection control unit 32, and the additional information display control unit 33 by executing the control program 36 stored in the storage unit 35.
In the present embodiment, the control unit 30 extracts additional information from the image data based on the information related to the position transmitted from the terminal device 80 and causes the communication unit 60 to transmit image data including the additional information to the terminal device 80. It has a function.

The projection control unit 31 acquires the content of the operation performed by the operator based on the operation data instructed from the operation panel 19. The projection control unit 31 controls the image processing unit 40, the light modulation device driving unit 15, the projection optical system driving unit 16, and the light source driving unit 14 according to the operation performed by the operator, and projects an image on the screen SC. . Further, the projection control unit 31 controls the projection optical system driving unit 16 to execute focus adjustment, zoom adjustment, aperture adjustment, and the like by the projection optical device 290.
The detection control unit 32 controls the position detection unit 50 to detect the operation position of the indicator 70 and detects the coordinates of the operation position and the operation state of the operation switch 72.

Further, the detection control unit 32 controls the execution of drawing for the image processing unit 40 having a drawing function based on the operation position of the indicator 70 and the operation state of the operation switch 72.
As one drawing function, for example, the image processing unit 40 draws a line segment based on the movement trajectory of the indicator 70 on the screen SC in a superimposed manner (whiteboard function). May be provided.
The additional information display control unit 33 controls generation of additional information to be added to the projected image based on an instruction transmitted from the terminal device 80 via the communication unit 82. Further, the additional information display control unit 33 controls transmission of the generated additional information to the terminal device 80 that has transmitted the instruction.
The user of the projector device 10 can set in advance whether or not to generate additional information based on an instruction transmitted from the terminal device 80 by operating the operation panel 19 or the like. Further, the type of additional information to be generated can be set in advance.

The image processing unit 40 includes an image input unit 41, an image processing control unit 42, a drawing processing unit 43, an additional information extraction unit 45, and a frame memory 44, and processes data input via the data input unit 11.
The image processing unit 40 has a function of generating image data to be projected on the screen SC from the projection unit 200 and a function of generating image data regarding additional information acquired from the content data 350.
The image input unit 41 temporarily holds the input content data 350. For example, the content data 350 can be assumed to be transmitted from the terminal device 80 </ b> A as an image output device and input when the projector device 10 receives the content data 350.

<Function to generate image data to be projected>
The image processing control unit 42 acquires main image data (see FIG. 3) included in the content data 350 held by the image input unit 41, appropriately executes various conversion processes such as resolution conversion and color conversion, and is set in advance. The image data based on the formatted format is generated.
The drawing processing unit 43 develops an image for each frame in the frame memory 44 based on the image data processed by the image processing control unit 42.
The image data developed in the frame memory 44 is output to the light modulator driving unit 15.

The light modulation device driving unit 15 drives the light modulation device 280 based on the image data output from the image processing unit 40 to perform drawing, and optically enlarges and projects the image drawn by the projection optical device 290. As a result, the main image 380 (FIG. 3) based on the image data is projected onto the screen SC.
Further, the control unit 30 transmits the image data developed in the frame memory 44 to the terminal device 80 via the communication unit 60. The image data to be transmitted may be main image data included in the content data 350, or may be image data of an image drawn on the screen SC when the whiteboard function is effective. . The terminal device 80 displays a main image 380 based on the received image data on the display unit 94.

Thereby, the user who operates the terminal device 80 can visually recognize the same image projected on the screen SC on the display unit 94 of the terminal device 80.
<Function for generating image data related to additional information>
The additional information extraction unit 45 extracts additional information from the content data 350 held by the image input unit 41 based on an instruction from the additional information display control unit 33, and sends the extracted additional information to the image processing control unit 42.
Here, FIG. 3 is a diagram for explaining the configuration of the content data 350. In the present embodiment, the content data 350 includes a main image data layer (first image data layer) indicating data of the main image 380 and additional information data in which additional information is described corresponding to the drawing position of the main image 380. It consists of three layers, additional information data A and additional information data B. The number of layers is not limited.

The main image data is image data composed of a set of dots like photographic data and drawing data. In the case of FIG. 3, the main image data is photograph data obtained by photographing a landscape.
The additional information data A is color information 372 (FIG. 6A) corresponding to the position on the main image data, for example, text data indicating a color name. In the case of FIG. 3, the additional information data A describes a color name corresponding to the object of the photo data (for example, a color in which a mountain is drawn is “yellowish green”).
The additional information data B is text data indicating information regarding the attribute of the object corresponding to the position on the main image data. In the case of FIG. 3, the additional information data B describes the object name (for example, the mountain name is “XX mountain”) corresponding to the object of the photo data.

In addition, as other additional information, various text information such as an explanation regarding the subject of the photo data, a language subtitle in the case of a moving image, and a lyrics of music can be assumed.
Here, for example, when the type of additional information to be generated is color information 372, the additional information extraction unit 45 corresponds to an indicated position (position information) indicating information regarding a position transmitted from the terminal device 80. The color name of the target area of the main image 380 is extracted from the additional information data A. The extracted color name is sent to the image processing control unit 42 as additional information.
The image processing control unit 42 generates an image related to additional information sent from the additional information extraction unit 45 based on an instruction from the additional information display control unit 33.
In addition, the following two modes can be assumed as the modes for generating the image related to the additional information.

One aspect is a case where the image processing control unit 42 generates composite image data (composite image data) obtained by combining additional information with the main image 380 (FIG. 6A).
In this case, the control unit 30 transmits the composite image data generated by the image processing control unit 42 to the terminal device 80 via communication. The terminal device 80 displays the composite image indicated by the received composite image data on the display unit 94.
Another aspect is a case where the image processing control unit 42 generates additional information image data (additional information image data) targeting additional information.
In this case, the control unit 30 sends the additional information image data to the terminal device 80. The terminal device 80 receives the data of the additional information image, generates combined image data indicating a combined image obtained by combining the main image 380 and the additional information image, and displays the combined image data on the display unit 94.

In any case, the user who operates the terminal device 80 can visually recognize the composite image in which the additional information is added to the main image 380 projected on the screen SC on the display unit 94 of the terminal device 80.
<Explanation of projection function>
Next, the projection unit 200 will be described. The projection unit 200 corresponds to a first display unit that displays an image based on image data, and includes a light source device 255, a light modulation device 280, and a projection optical device 290.
FIG. 4 is a diagram schematically illustrating the optical system of the projection unit 200. A schematic configuration of the optical system will be described with reference to FIG.

The optical system of the projection unit 200 is configured as an optical unit 251. The optical unit 251 includes an optical component casing 252, a light source device 255, an illumination optical device 260, a color separation optical device 265, a relay optical device 270, a light modulation device 280, and a projection optical device 290. The optical components constituting each of these devices are accommodated in an optical component casing 252.
The light source device 255 includes an arc tube 256 that emits a light beam and a reflector 257. The light source device 255 reflects the light beam emitted from the arc tube 256 by the reflector 257, aligns the emission direction, and emits the light toward the illumination optical device 260. The illumination optical axis OC is a central axis of a light beam emitted from the light source device 255 to the illuminated area side. The light source may be a xenon lamp, an ultra high pressure mercury lamp, an LED (Light Emitting Diode), a laser light source, or the like.

The illumination optical device 260 includes lens arrays 261 and 262, a polarization conversion element 263, a superimposing lens 264, and a field lens 269. The illumination optical device 260 generates illuminance in a plane orthogonal to the illumination optical axis OC with respect to the light beam emitted from the light source device 255. It has a function to make uniform.
The color separation optical device 265 includes dichroic mirrors 266 and 267 and a reflection mirror 268. The light beam emitted from the illumination optical device 260 is converted into three colors of red (R) light, green (G) light, and blue (B) light. The light is separated into colored light and guided to the three liquid crystal devices 285R, 285G, and 285B.
The relay optical device 270 includes an incident side lens 272, a relay lens 276, and reflection mirrors 274 and 278. Since the optical path length of the relay optical device 270 is longer than the optical path lengths of the other color lights with respect to the color light (B light in this embodiment) separated by the color separation optical device 265, the light divergence, etc. The use efficiency of light is prevented from being lowered, and the light is guided to the liquid crystal device 285B.

The light modulation device 280 includes three incident-side polarizing plates 284, three liquid crystal devices 285R, 285G, and 285B, three emission-side polarizing plates 286, and a cross dichroic prism 288. The liquid crystal devices 285R, 285G, and 285B modulate each color light separated by the color separation optical device 265 according to an image signal. The cross dichroic prism 288 synthesizes the color lights modulated by the liquid crystal devices 285R, 285G, and 285B and emits them to the projection optical device 290 side.
The light modulation device 280 is not limited to a method using a liquid crystal panel, and other methods such as a DLP (Digital Light Processing) method and an LCOS (Liquid Crystal On Screen) method can be assumed.

The projection optical device 290 includes a projection lens 292 having an ultrashort focus and a reflection mirror 294 having a curved surface. The projection optical device 290 enlarges the light beam modulated and synthesized by the light modulation device 280 by the projection lens 292, reflects it by the reflection mirror 294, and magnifies and projects the image signal toward the display surface of the screen SC. An image based on is displayed on the display surface.
The projection optical device 290 includes a zoom lens that performs enlargement / reduction of a projected image and a focus adjustment, a zoom adjustment motor that adjusts the degree of zoom, a focus adjustment motor that adjusts focus, and the like.
The projection unit 200 includes a projection optical system drive unit 16 that drives each motor included in the projection optical device 290 according to the control of the control unit 30, and a light source drive unit that drives a light source included in the light source device 255 according to the control of the control unit 30. 14 is connected.

<Image display processing>
FIG. 5 is a flowchart showing the flow of processing of the display control method (control program 36) by the display system 100.
In this flowchart, description will be made assuming that the image processing control unit 42 generates data of a composite image.
First, the projector device 10 projects a main image (first image) 380 indicated by main image data (first image data) included in the content data 350 on the screen SC (step S300).
Next, the projector device 10 transmits main image data to the terminal device 80 (step S302).

The terminal device 80 receives the main image data (step S304), and displays the main image 380 indicated by the received main image data (step S306).
Next, the terminal device 80 determines whether or not the displayed main image 380 is instructed (step S308).
If it is determined that the displayed main image 380 is not instructed (No in step S308), the process returns to step S306.
On the other hand, when it is determined that the displayed main image 380 is instructed (Yes in step S308), the terminal device 80 calculates the coordinate value (position information) instructed on the main image 380 (step S310).

Next, the terminal device 80 transmits the calculated coordinate value data to the projector device 10 (step S312).
The projector device 10 receives the coordinate value data (step S314).
Next, the projector device 10 determines whether or not to display additional information (step S316).
If it is determined that no additional information is to be displayed (No in step S316), the image display process is terminated.
On the other hand, when it is determined that additional information is to be displayed (Yes in step S316), the set additional information data is acquired (step S318).

Next, the projector device 10 determines a target area from the coordinate values indicated by the coordinate value data, and extracts additional information corresponding to the target area from the additional information data (step S320).
Next, the projector device 10 generates a composite image obtained by combining the main image 380 and the additional information (step S322).
Next, the projector device 10 transmits the composite image data to the terminal device 80 that has transmitted the coordinate value data (step S324).
The terminal device 80 receives the composite image data (step S326). Next, the terminal device 80 displays the composite image indicated by the received composite image data (step S328), and ends the image display process. The terminal device 80 may store the displayed composite image in the storage unit 96 so as to be readable.

6A and 6B are diagrams illustrating display examples of the composite image displayed on the terminal device 80. FIG.
FIG. 6A shows a case where the additional information data A is set to be added to the main image 380. When the user designates “mountain” in the main image 380 with the finger FG on the display unit 94 of the terminal device 80, the color information “yellowish green” corresponding to the designated position of “mountain” is extracted from the additional information data A. Further, color information (RGB values) corresponding to the designated position is acquired from the main image data, and two pieces of information are added to the main image 380 as color information 372 and displayed. The RGB values may be described in the additional information data A or other additional information data.

The color information 372 may be either “yellowish green” or RGB values. For example, only RGB values may be displayed for color blind persons.
FIG. 6B shows a case where the additional information data B is set to be added to the main image 380. When the user designates “house” in the main image 380 with the finger FG on the display unit 94 of the terminal device 80, the attribute information “XX's house” corresponding to the designated position of “house” is obtained from the additional information data B. The attribute information 374 is extracted and added to the main image 380 for display.

According to the embodiment described above, the following effects can be obtained.
(1) The main image data transmitted from the projector device 10 projecting the main image 380 is received by the terminal device 80, and the main image indicated by the main image data is displayed on the display unit 94 of the terminal device 80. When the main image 380 displayed on the display unit 94 is instructed by the user, position information based on the instructed position is transmitted to the projector device 10. The projector device 10 extracts additional information from the content data 350 based on the position information, and transmits image data including the additional information to the terminal device 80. Thereby, the user who instructed the main image 380 can visually recognize an image including additional information displayed on the display unit 94 of the terminal device 80. For example, by displaying the color information of the designated area as the additional information, the color image of the main image 380 can be transmitted to the color blind person. In addition, since an image including additional information is not displayed on the main image 380 projected by the projector device 10, other users can visually recognize the projected main image without lowering the visibility.

(2) The control unit 30 of the projector device 10 generates composite image data obtained by combining the additional information extracted based on the position information transmitted from the terminal device 80 and the main image 380, and uses the generated composite image data as a terminal. Transmit to device 80. Therefore, the terminal device 80 does not require image synthesis processing, and the processing load on the terminal device 80 can be reduced.
(3) The control unit 30 of the projector device 10 generates additional information image data of an additional information image including additional information extracted based on the position information transmitted from the terminal device 80, and the generated additional information image data is transmitted to the terminal. Transmit to device 80. Then, the control unit 90 of the terminal device 80 combines the additional information image indicated by the received additional information image data with the main image 380, and displays the combined image. Thereby, the processing burden on the projector device 10 side can be reduced.
(4) Since the main image data and the additional information data are separated from the content data 350, one of the data can be easily acquired.

As mentioned above, although this invention was demonstrated based on embodiment shown in figure, this invention is not limited to this embodiment, The modification as described below can also be assumed.
(1) The projector device 10 is not limited to a mode in which the composite image data and the additional information image data are transmitted only to the terminal device 80 that has transmitted the coordinate value data. The composite image data and the additional information image data may be transmitted to another terminal device 80 that is communicably connected to the projector device 10.

(2) When the display system 100 is configured by a plurality of terminal devices 80, the control unit 30 performs statistical processing on the target area transmitted from each terminal device 80 and performs statistical processing on the projected image. May be reflected. For example, a place of added value requested by many terminal devices 80 may be highlighted and displayed on the screen SC.
Moreover, the apparatus which implements the above methods may be realized by a single apparatus or may be realized by combining a plurality of apparatuses, and includes various aspects.

  DESCRIPTION OF SYMBOLS 10 ... Projector apparatus, 11 ... Data input part, 14 ... Light source drive part, 15 ... Light modulation apparatus drive part, 16 ... Projection optical system drive part, 19 ... Operation panel, 30 ... Control part, 31 ... Projection control part, 32 Detecting control unit 33 Additional information display control unit 35 Storage unit 36 Control program 40 Image processing unit 41 Image input unit 42 Image processing control unit 43 Drawing processing unit 44 Frame memory 45 ... additional information extraction unit 50 ... position detection unit 51 ... imaging unit 52 ... reception unit 53 ... imaging control unit 54 ... indicator detection unit 55 ... coordinate calculation unit 60 ... communication unit 62 ... Transmitter, 64 ... Receiver, 70 ... Indicator, 72 ... Operation switch, 74 ... Transmitter, 80, 80A, 80B ... Terminal device, 82 ... Communication unit, 84 ... Receiver, 86 ... Transmitter, 90 ... Control part, 92 ... Operating part, 94 ... Table 96, storage unit, 100 ... display system, 200 ... projection unit, 251 ... optical unit, 252 ... optical component housing, 255 ... light source device, 256 ... light emitting tube, 257 ... reflector, 260 ... illumination optical device, 261, 262 ... lens array, 263 ... polarization conversion element, 264 ... superposition lens, 265 ... color separation optical device, 266, 267 ... dichroic mirror, 268 ... reflection mirror, 269 ... field lens, 270 ... relay optical device, 272 ... Incident side lens, 274, 278 ... Reflection mirror, 276 ... Relay lens, 280 ... Light modulation device, 284 ... Incident side polarizing plate, 285R, 285G, 285B ... Liquid crystal device, 286 ... Emission side polarizing plate, 288 ... Cross dichroic prism 290: Projection optical device, 292: Projection lens, 294: Reflection mirror, 35 ... content data, 372 ... color information, 374 ... attribute information, 380 ... main image.

Claims (17)

A display system comprising a display device and a terminal device capable of communicating with the display device,
The display device
A first display for displaying an image based on the image data;
A first communication unit that transmits the image data to the terminal device and receives position information transmitted from the terminal device;
A first control unit that extracts additional information from the image data based on the position information and causes the first communication unit to transmit the image data including the additional information to the terminal device;
The terminal device
A second communication unit that receives the image data transmitted from the display device and transmits the position information to the display device;
A second display unit that displays the image based on the image data received by the second communication unit;
An instruction unit for instructing the image displayed on the second display unit;
A display system comprising: a second control unit that generates the position information based on the position of the image instructed by the instruction unit, and transmits the generated position information to the second communication unit. The display system according to claim 1,
The display system, wherein the first display unit displays an image based on the image data received from an image output device. The display system according to claim 1,
The first control unit causes the first communication unit to transmit first image data indicating the first image displayed on the first display unit to the terminal device, and the first communication unit transmits the first image data from the terminal device to the terminal device. Upon receipt of the position information, it generates composite image data obtained by combining the additional information extracted based on the position information and the first image, and sends the generated composite image data from the first communication unit to the terminal device. A display system characterized by transmitting. The display system according to claim 1,
The first control unit transmits first image data indicating the first image displayed on the first display unit from the first communication unit to the terminal device, and the first communication unit transmits the first image data from the terminal device to the terminal device. When the position information is received, the additional information image data indicating the additional information image including the additional information extracted based on the position information is generated based on the position information, and the generated additional information image data is generated in the first information. A display system that causes a communication unit to transmit to the terminal device. The display system according to claim 4,
The second control unit generates combined image data by combining the first image indicated by the first image data received by the second communication unit and the additional information image indicated by the additional information image data. A display system, wherein a composite image based on the composite image data is displayed on the second display unit. The display system according to any one of claims 2 to 5,
The image data includes the first image data layer indicating the first image and an additional information data layer in which the additional information is described corresponding to a drawing position of the first image. Display system. The display system according to any one of claims 2 to 6,
The display system, wherein the additional information indicates color information of the first image. The display system according to any one of claims 2 to 6,
The display system, wherein the additional information indicates attribute information of an object constituting the first image. The display system according to any one of claims 2 to 6,
The display system according to claim 1, wherein the additional information indicates character information describing the first image. The display system according to any one of claims 1 to 9,
The terminal system includes a storage unit that stores the image data. The display system according to any one of claims 1 to 10,
The terminal device includes a plurality of terminals.
The display system according to claim 1, wherein the first control unit causes the terminal device to transmit the image data including the additional information. The display system according to claim 11, wherein
The first control unit statistically processes the position information transmitted from each of the terminal devices, and reflects the result of the statistical processing on the image displayed on the first display unit. A display device capable of communicating with a terminal device,
A first display for displaying an image based on the image data;
A first communication unit that transmits the image data to the terminal device and receives position information transmitted from the terminal device;
A display device, comprising: a first control unit that extracts additional information from the image data based on the position information and transmits the image data including the additional information to the first communication unit. A terminal device capable of communicating with a display device,
A second communication unit that receives image data transmitted from the display device and transmits position information to the display device;
A second display unit that displays an image based on the image data received by the second communication unit;
An instruction unit for instructing the image displayed on the second display unit;
A terminal device comprising: a second control unit configured to generate the position information based on the position of the image instructed by the instruction unit, and to transmit the generated position information to the second communication unit. A display system control method comprising a display device and a terminal device capable of communicating with the display device,
The display device displays an image based on the image data;
The display device transmits the image data to the terminal device;
Displaying the image based on the image data received by the terminal device;
The terminal device generates position information based on the position instructed with respect to the image,
The terminal device transmits the position information to the display device;
Extracting additional information from the image data based on the position information received by the display device;
Transmitting the image data including the additional information extracted by the display device to the terminal device;
A display system control method, comprising: displaying the image based on the image data received by the terminal device. A control program for a display device capable of communicating with a terminal device,
A function for displaying an image based on image data;
A function of transmitting the image data to the terminal device;
A function of receiving the position information generated by the terminal device;
A function of extracting additional information from the image data based on the position information;
A display device control program causing a computer to execute a function of transmitting the image data including the additional information to the terminal device. A control program for a terminal device capable of communicating with a display device,
A function of receiving image data transmitted by the display device;
A function of displaying an image based on the image data;
A function of generating position information based on a position instructed with respect to the image;
A function of transmitting the position information to the display device;
A function of receiving the image data including the additional information transmitted by the display device;
A control program for a terminal device, which causes a computer to execute a function of displaying the image based on the image data including the additional information.

Images