JP6015354B2 - Image display system and method for controlling image display system - Google Patents

Description

  The present invention relates to an image display system and an image display system control method.

  Conventionally, an information display system having an information processing device such as a PC (personal computer), an information display device such as a projector, and a plurality of pointing devices is known (Patent Document 1). In such an information display system, the PC registers only an authenticated pointing device from among a plurality of pointing devices. As a result, since only the pointing device that is permitted to be authenticated is registered, an unauthorized pointing operation by an outsider or the like can be prevented in advance.

JP 2004-348577 A

  However, in the information display system (image display system) of Patent Document 1, since the pointing device is registered in the PC, it is not suitable for a usage pattern in which the PC is replaced with one projector. . Accordingly, there has been a demand for an image display system that enables a pointing operation using only a registered pointing device even in a usage pattern in which a PC is used after being replaced.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 An image display system according to this application example is an image display system that includes an image display device that displays an image based on image information, and one or more portable information terminals. A device information transmission unit that transmits device information of the portable information terminal, an operation reception unit that receives a pointing operation, an operation information transmission unit that transmits the pointing operation received by the operation reception unit as pointing operation information, The image display device includes a device information receiving unit that receives the device information from the portable information terminal, an operation information receiving unit that receives the pointing operation information from the portable information terminal, and the device information receiving unit. Device information for generating a device information list in which one or more portable information terminals are registered based on the device information received by A pointer display setting unit that sets, as pointer display setting information, whether or not to display a pointer image corresponding to the pointing operation information for the portable information terminal registered in the device information list, An image combining unit configured to combine the pointer image corresponding to the pointing operation information with the image based on the image information based on the pointer display setting information;

  Such an image display system includes an image display device and a portable information terminal. The portable information terminal includes a device information transmission unit, an operation reception unit, and an operation information transmission unit. The device information transmission unit transmits device information of the portable information terminal. The operation reception unit receives a pointing operation. The operation information transmission unit transmits pointing operation information. The image display device includes a device information receiving unit, an operation information receiving unit, a device information list generating unit, a pointer display setting unit, and an image composition unit. The device information receiving unit receives device information from the portable information terminal. The operation information receiving unit receives pointing operation information from the portable information terminal. The device information list generation unit generates a device information list of the portable information terminal. The pointer display setting unit sets, as pointer display setting information, whether or not to display a pointer image for portable information terminals registered in the device information list. The image composition unit synthesizes a pointer image corresponding to the pointing operation information with the image based on the pointer display setting information. That is, the image display device generates a device information list, sets whether or not to display a pointer image for the portable information terminal registered in the device information list, and based on the set pointer display setting information, A pointer image corresponding to the pointing operation information is combined with the image. As a result, the image display device can receive the pointing operation information and switch the pointer image between display and non-display for the portable information terminals registered in the device information list.

  Application Example 2 In the image display system according to the application example, the image display system further includes an information processing device, and the information processing device receives the pointer display setting information or the device information list from the image display device. A pointer display setting reception unit that receives the pointer display setting information received by the pointer display setting reception unit or a pointer image corresponding to the pointing operation information for the portable information terminal registered in the device information list. A second pointer display setting unit that sets whether to display on the image display device as second pointer display setting information; and a second pointer that transmits the second pointer display setting information to the image display device. A pointer display setting transmission unit, and the image display device includes the pointer display setting. A pointer display setting transmission unit that transmits information or the device information list to the information processing device, a second pointer display information reception unit that receives the second pointer display setting information from the information processing device, and the second And a pointer display setting changing unit that changes the setting of the pointer display setting unit based on the second pointer display setting information received by the pointer display information receiving unit.

  According to such an image display system, the information processing apparatus is further provided. The information processing apparatus includes a pointer display setting reception unit, a second pointer display setting unit, and a second pointer display setting transmission unit. The pointer display setting receiving unit receives pointer display setting information or a device information list from the image display device. The second pointer display setting unit sets, as the second pointer display setting information, whether or not to display a pointer image on the image display device for the portable information terminal registered in the pointer display setting information or the device information list. . The second pointer display setting transmission unit transmits second pointer display setting information. The image display device further includes a pointer display setting transmission unit, a second pointer display information reception unit, and a pointer display setting change unit. The pointer display setting transmission unit transmits pointer display setting information or a device information list to the information processing device. The second pointer display information receiving unit receives second pointer display setting information from the information processing apparatus. The pointer display setting change unit changes the setting of the pointer display setting unit based on the second pointer display setting information. Accordingly, the information processing apparatus receives the pointer display setting information, sets whether to display a pointer image for the registered portable information terminal, and sets the set second pointer display setting information as an image. Send to display device. Since the image display device changes the setting of the pointer display setting unit based on the second pointer display setting information, the image display device synthesizes a pointer image corresponding to the pointing operation information based on the second pointer display setting information. be able to. Accordingly, the pointer image can be switched between display and non-display for the portable information terminal registered in the pointer display setting information, that is, the device information list, by the information processing device.

  Application Example 3 In the image display system according to the application example, the information processing apparatus is the portable information terminal.

  According to such an image display system, the information processing apparatus is a portable information terminal. Accordingly, the portable information terminal can switch the pointer image to display or non-display for the portable information terminal registered in the device information list.

  Application Example 4 In the image display system according to the application example, the operation reception unit of the portable information terminal includes a touch panel, and the pointing operation is received by the touch panel.

  According to such an image display system, the portable information terminal has a touch panel and accepts a pointing operation. Thereby, the user can perform a pointing operation on the touch panel.

  Application Example 5 In the image display system according to the application example, the image display device further includes an image transmission unit that transmits information of the combined image combined by the image combining unit to the portable information terminal, The portable information terminal further includes an image receiving unit that receives information of the composite image from the image display device, and the touch panel displays the composite image based on the information of the composite image received by the image receiving unit. Receiving the pointing operation.

  According to such an image display system, the image display device transmits the information of the composite image to the portable information terminal by the image transmission unit. In addition, the portable information terminal receives information of the composite image from the image display device by the image receiving unit. The touch panel of the portable information terminal displays a composite image and accepts a pointing operation. Thereby, the user can perform a pointing operation while visually recognizing the composite image displayed on the portable information terminal.

  Application Example 6 An image display system control method according to this application example is an image display system control method including an image display device that displays an image based on image information, and one or more portable information terminals. The portable information terminal transmits, as pointing operation information, a device information transmitting step for transmitting device information of the portable information terminal, an operation receiving step for receiving a pointing operation, and the pointing operation received by the operation receiving step. An operation information transmitting step, wherein the image display device receives the device information from the portable information terminal, and receives an operation information receiving step from the portable information terminal. And based on the device information received by the device information receiving step. A device information list generating step for generating a device information list in which one or a plurality of portable information terminals are registered, and a pointer corresponding to the pointing operation information for the portable information terminals registered in the device information list A pointer display setting step for setting whether or not to display an image as pointer display setting information, and based on the pointer display setting information, the pointer image corresponding to the pointing operation information is added to the image based on the image information. And an image composition step for composition.

  According to such an image display system, the image display device can receive the pointing operation information and can switch the display or non-display of the pointer image for the portable information terminal registered in the device information list.

  In addition, when the above-described image display system and the control method of the image display system are constructed using a computer provided in the image display device, the portable information terminal, and the information processing device, the above form and the above application example Can be configured in the form of a program for realizing the function or a recording medium on which the program is recorded so as to be readable by the computer. Recording media include flexible disk, HDD (Hard Disk Drive), CD-ROM (Compact Disk Read Only Memory), DVD (Digital Versatile Disk), Blu-ray Disc (registered trademark), magneto-optical disk, nonvolatile memory card , Image display devices, portable information terminals, internal storage devices of information processing devices (semiconductor memories such as RAM (Random Access Memory) and ROM (Read Only Memory)), and external storage devices (USB (Universal Serial Bus) memory, etc.) For example, various media that can be read by the computer can be used.

1 is a perspective view illustrating an image display system according to a first embodiment. 1 is a block diagram showing a schematic configuration of a projector. The block diagram which shows schematic structure of a smart phone. The sequence diagram showing operation | movement of an image display system. It is explanatory drawing showing a device information and a device information list, (a) is explanatory drawing of apparatus information, (b) is explanatory drawing of a device information list. Explanatory drawing showing the selection screen based on pointer display setting information. It is explanatory drawing of the synthesis | combination of an input image and a pointer image, (a) is explanatory drawing of an input image, (b) is explanatory drawing of a pointer image, (c) is explanatory drawing of a synthesized image. The flowchart of the process of a smart phone. The flowchart of a process of a projector. The flowchart of the image composition process of a projector. The flowchart of the pointer display setting reception process of PC. The sequence diagram showing operation | movement of the image display system which concerns on 2nd Embodiment.

(First embodiment)
Hereinafter, as a first embodiment, an image display system including a projector as an image display device, a smartphone as a portable information terminal, and a PC as an information processing device will be described.

FIG. 1 is a perspective view showing an image display system according to the first embodiment.
As shown in FIG. 1, the image display system 1 includes a projector 100, smartphones 201, 202, and 203, and a PC 300. The PC 300 is, for example, a notebook personal computer. The projector 100 receives image information supplied from the PC 300 and projects an image corresponding to the image information onto a projection surface S such as a screen. In this embodiment, the PC 300 and the projector 100 are connected by a USB (Universal Serial Bus) cable C1, and an image signal is supplied from the PC 300 to the projector 100 via the USB cable C1, and the control signal Transmission / reception is performed. The smartphones 201, 202, and 203 can transmit and receive control information and the like to and from the projector 100 using wireless LAN communication.

FIG. 2 is a block diagram illustrating a schematic configuration of the projector 100.
As shown in FIG. 2, the projector 100 includes an image projection unit 10, a control unit 20, an operation unit 21, a pointer display setting unit 22, an image signal input unit 30, an image processing unit 31, an OSD processing unit 32, and a wireless LAN communication unit. 50 etc.

  The image projection unit 10 includes a light source device 11 as a light source, three liquid crystal light valves 12R, 12G, and 12B as light modulation devices, a projection lens 13 as a projection optical system, a liquid crystal drive unit 14, and the like. The image projection unit 10 corresponds to a display unit. The image projection unit 10 modulates light emitted from the light source device 11 into image light using the liquid crystal light valves 12R, 12G, and 12B, and projects the image light from the projection lens 13. The image is displayed on the projection surface S.

  The light source device 11 includes a discharge-type light source lamp 11a made of an ultra-high pressure mercury lamp, a metal halide lamp, or the like, and a reflector 11b that reflects light emitted from the light source lamp 11a toward the liquid crystal light valves 12R, 12G, and 12B. Has been. The light emitted from the light source device 11 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and red (R), green (G), which are the three primary colors of light by a color separation optical system (not shown), After being separated into blue (B) color light components, they are incident on the liquid crystal light valves 12R, 12G, and 12B, respectively.

  The liquid crystal light valves 12R, 12G, and 12B are configured by a liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates. The liquid crystal light valves 12R, 12G, and 12B include a rectangular pixel region in which a plurality of pixels (not shown) are arranged in a matrix, and a driving voltage can be applied to the liquid crystal for each pixel. Yes. When the liquid crystal driving unit 14 applies a driving voltage corresponding to the input image information to each pixel, each pixel is set to a light transmittance corresponding to the image information. For this reason, the light emitted from the light source device 11 is modulated by transmitting through the pixel regions of the liquid crystal light valves 12R, 12G, and 12B, and image light corresponding to image information is formed for each color light. The formed image light of each color is synthesized for each pixel by a color synthesis optical system (not shown) to become color image light, and then enlarged and projected by the projection lens 13.

  The control unit 20 includes a CPU (Central Processing Unit), a RAM used for temporary storage of various data, a non-volatile ROM, and the like, and the CPU operates according to a control program stored in the ROM so that the projector 100 operations are centrally controlled. That is, the control unit 20 functions as a computer.

  The operation unit 21 includes a plurality of operation keys for the user to give various instructions to the projector 100. The operation keys provided in the operation unit 21 of the present embodiment include a power key for switching on / off the power, a menu key for displaying a menu image for various settings, and a direction key used for selecting an item in the menu image. And a determination key for confirming the selected item.

  When the user operates various operation keys of the operation unit 21, the operation unit 21 receives this operation and outputs a control signal corresponding to the operated operation key to the control unit 20. Then, when a control signal is input from the operation unit 21, the control unit 20 performs processing based on the input control signal to control the operation of the projector 100. In addition, it is good also as a structure which used the remote control (not shown) which can be operated remotely instead of the operation part 21 or with the operation part 21 as an input operation part. In this case, the remote controller transmits an operation signal such as an infrared ray corresponding to the operation content of the user, and a remote control signal receiving unit (not shown) receives this and transmits it to the control unit 20.

  The pointer display setting unit 22 has a memory. The pointer display setting unit 22 sets information as to whether or not to display a pointer image on the projection image for each of the smartphones 201, 202, and 203 that are connected to the projector 100. The control unit 20 performs writing to and reading from the pointer display setting unit 22.

  The image signal input unit 30 includes a plurality of input terminals, and various types of image signals are input to these input terminals from an image supply device such as a personal computer or a video playback device. In this embodiment, an image signal is input from the PC 300. The image signal input unit 30 converts the input image signal into image information in a format that can be processed by the image processing unit 31, and outputs the image information to the image processing unit 31.

  The image processing unit 31 defines the image information input from the image signal input unit 30 as image information representing the gradation of each pixel of the liquid crystal light valves 12R, 12G, and 12B, that is, a drive voltage applied to each pixel. Convert to image information. Further, the image processing unit 31 performs an image quality adjustment process for adjusting the image quality such as brightness, contrast, sharpness, hue, and the like on the converted image information based on an instruction from the control unit 20. Are output to the OSD processing unit 32.

  The OSD processing unit 32 performs OSD (on-screen display) such as a menu image and a message image on an image based on input image information (hereinafter referred to as “input image”) based on an instruction from the control unit 20. A process for superimposing and displaying an image is performed. The OSD processing unit 32 includes an OSD memory (not shown) and stores OSD image information representing graphics, fonts, and the like for forming an OSD image. When the control unit 20 instructs to superimpose the OSD image, the OSD processing unit 32 reads the necessary OSD image information from the OSD memory, and the image processing unit so that the OSD image is superimposed at a predetermined position on the input image. The OSD image information is combined with the image information input from 31. The image information combined with the OSD image information is output to the liquid crystal drive unit 14. When there is no instruction to superimpose the OSD image from the control unit 20, the OSD processing unit 32 outputs the image information input from the image processing unit 31 to the liquid crystal driving unit 14 as it is. In the present embodiment, the OSD processing unit 32 synthesizes a pointer image with an input image based on an instruction from the control unit 20. The OSD processing unit 32 corresponds to an image composition unit.

  The liquid crystal driving unit 14 drives the liquid crystal light valves 12R, 12G, and 12B according to the image information input from the OSD processing unit 32. Thereby, the light emitted from the light source device 11 is modulated according to the image information by the liquid crystal light valves 12R, 12G, and 12B and projected from the projection lens 13.

  The wireless LAN communication unit 50 communicates with the smartphones 201, 202, and 203 by wireless LAN. The wireless LAN communication unit 50 operates based on an instruction from the control unit 20, and transmits and receives control information and the like to and from the smartphones 201, 202, and 203. For example, the wireless LAN communication unit 50 establishes connection with the smartphones 201, 202, and 203 and receives device information of the smartphones 201, 202, and 203. Moreover, the projection image information corresponding to the image information projected by the projector 100 is transmitted to the smartphones 201, 202, 203, and the pointing operation information is received from the smartphones 201, 202, 203. The pointing operation information received by the wireless LAN communication unit 50 is input to the control unit 20, and the control unit 20 instructs the OSD processing unit 32 to display it as a pointer image. The wireless LAN communication unit 50 corresponds to a device information reception unit, an operation information reception unit, and an image transmission unit.

Next, the configuration of the smartphones 201, 202, and 203 will be described. Here, the configurations of the smartphones 201, 202, and 203 are the same.
FIG. 3 is a block diagram illustrating a schematic configuration of the smartphones 201, 202, and 203.

  As shown in FIG. 3, the smartphones 201, 202, and 203 include a touch screen 210, a second control unit 220, a second image processing unit 230, a second wireless LAN communication unit 240, and the like.

  The touch screen 210 includes a display device 212 that displays an image, and a touch panel 211 fixed on the display device 212. The display device 212 is connected to the second image processing unit 230, and the touch panel 211 is connected to the second control unit 220.

  The display device 212 includes a liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates, a drive unit (not shown) that drives the liquid crystal panel, and the like. Transparent electrodes (pixel electrodes) to which a drive voltage can be applied for each minute region (pixel) are formed in a matrix in a rectangular region (display region).

  The touch panel 211 includes a light-transmitting lower (display device 212 side) substrate such as glass and transparent plastic, and a light-transmitting and flexible upper substrate (both not shown) such as a plastic film. It is a resistive film type touch panel arranged to face each other with a predetermined interval, and a transparent electrode is formed on the inner surface of each substrate over almost the entire surface. The upper substrate of the touch panel 211 is provided with a rectangular area (operation area) for performing a touch operation (pressing operation). When the user touches the operation area with a finger or a touch pen, the upper substrate is bent. The upper and lower transparent electrodes are in contact with each other, and a signal (detection signal) corresponding to the contact position (operation position) is output to the second control unit 220.

  Here, the display area of the display device 212 and the operation area of the touch panel 211 are set to the same shape and size, and the operation area of the touch panel 211 and the display area of the display device 212 are viewed from above. It is fixed to the display device 212 so as to match. Therefore, the user can instruct a desired position of the image displayed in the display area by a touch operation. The touch panel 211 corresponds to an operation reception unit. Note that the touch panel 211 is not limited to the resistive film type, and other types of touch panels such as a capacitance type can also be used.

  The second control unit 220 includes a CPU, a RAM used for temporary storage of various data, a non-volatile ROM, and the like, and the smartphones 201 and 202 are operated by the CPU operating according to a control program stored in the ROM. , 203 is controlled in an integrated manner. That is, the second control unit 220 functions as a computer.

  The second image processing unit 230 generates image data based on the execution of the control program of the second control unit 220, and further displays image display data for display in the display area of the display device 212 based on the image data. Is generated. Display data of the generated image is output to the display device 212 in units of frames. The display device 212 displays an image based on the display data of this image.

  The second wireless LAN communication unit 240 performs communication with the projector 100 via a wireless LAN. The second wireless LAN communication unit 240 operates based on an instruction from the second control unit 220 and transmits / receives control information and the like to / from the projector 100. For example, the second wireless LAN communication unit 240 establishes a connection with the projector 100 and transmits device information of the smartphones 201, 202, and 203. In addition, it receives projection image information projected by the projector 100 and transmits pointing operation information operated by the touch panel 211. The second wireless LAN communication unit 240 corresponds to a device information transmission unit, an operation information transmission unit, and an image reception unit.

  In the present embodiment, the second control unit 220 incorporates an application program for using the smartphones 201, 202, and 203 as a pointing device, and the user touches the touch panel 211 while the application program is activated. When the touch operation is performed, the second control unit 220 can transmit the pointing operation information based on the touch operation from the second wireless LAN communication unit 240.

Next, the operation of the image display system 1 (projector 100, smartphones 201, 202, 203, PC 300) will be described.
FIG. 4 is a sequence diagram illustrating the operation of the image display system 1. The image display system 1 of the present embodiment has three smartphones 201, 202, and 203, but is represented as one in the sequence diagram. An image signal is always input from the PC 300 to the projector 100, but is not displayed on the sequence diagram.

  When an application program for using the smartphones 201, 202, 203 as a pointing device is activated, the smartphones 201, 202, 203 search for connectable projectors (SQ101). Upon receiving the search request, the projector 100 returns a response (SQ102). The smartphones 201, 202, and 203 transmit a connection request to the projector 100 that has responded (SQ103). The projector 100 establishes a communication connection in response to the connection request (SQ104).

  The projector 100 starts transmitting the projection image information output by the OSD processing unit 32 to the smartphones 201, 202, and 203 that have established connections (SQ105). Smartphones 201, 202, and 203 transmit device information to projector 100 (SQ106).

  The projector 100 generates a device information list based on the device information received from the smartphones 201, 202, and 203 (SQ107). Here, the projector 100 generates default information of pointer display setting information indicating whether or not to display a pointer image for each of the smartphones 201, 202, and 203 based on the device information list, and the pointer display setting unit 22. (SQ108). In the default information of the pointer display setting information, the pointer display is all “ON”.

Here, the device information and the device information list will be described.
5A and 5B are explanatory diagrams showing the device information and the device information list. FIG. 5A is an explanatory diagram of the device information, and FIG. 5B is an explanatory diagram of the device information list.

  As shown in FIG. 5A, the device information T1 includes the transmitted smartphone ID and user information. Further, as shown in FIG. 5B, the device information list T2 is generated based on the device information received by the projector 100, and the IDs of the three smartphones 201, 202, and 203 that have been established and the user's information. Contains information.

  Returning to FIG. 4, the projector 100 transmits the pointer display setting information to the PC 300 (SQ109). The PC 300 displays a selection screen based on the received pointer display setting information, and accepts a setting as to whether or not to display a pointer image for each of the smartphones 201, 202, and 203 (SQ110). That is, the operator (presenter) of the PC 300 selects whether to display the pointer and stores it in an internal memory (not shown). A receiving unit (not shown) of the PC 300 corresponds to a pointer display setting receiving unit, and an internal memory for storing pointer display settings corresponds to a second pointer display setting unit.

Here, a selection screen displayed by the PC 300 based on the pointer display setting information will be described.
FIG. 6 is an explanatory diagram showing a selection screen based on the pointer display setting information.

  As shown in FIG. 6, on the selection screen M1, “ON” and “OFF” of the pointer display can be set for each of the three smartphones 201, 202, and 203 based on the pointer display setting information. Specifically, “ON” and “OFF” can be set by pull-down menus SL1, SL2, and SL3. Furthermore, when the setting by the operator of the PC 300 is completed, the pointer display setting can be confirmed by pressing the “end setting” button SL4. The pointer display setting information set here is set as second pointer display setting information.

  Returning to FIG. 4, the PC 300 transmits the second pointer display setting information to the projector 100 (SQ111). A transmission unit (not shown) of the PC 300 corresponds to a second pointer display setting transmission unit. The projector 100 changes the setting value of the pointer display setting unit 22 based on the received second pointer display setting information (SQ112).

  When the user operates the smartphones 201, 202, and 203, pointing operation information for moving the pointer is transmitted (SQ113). The projector 100 receives the pointing operation information, combines the pointer image with the input image in accordance with the setting value of the pointer display setting unit 22, and projects the combined image (SQ114).

Here, a composite image of the input image and the pointer image will be described.
7A and 7B are explanatory diagrams of composition of the input image and the pointer image. FIG. 7A is an explanatory diagram of the input image, FIG. 7B is an explanatory diagram of the pointer image, and FIG. 7C is an explanatory diagram of the composite image. is there.

  FIG. 7A shows an input image G1 based on an image signal input from the PC 300 to the projector 100. FIG. FIG. 7B shows a pointer image G2 generated as an OSD image by the OSD processing unit 32 of the projector 100 based on the pointing operation information transmitted from the smartphones 201, 202, and 203. Here, any of the smartphones 201, 202, and 203 represents a state in which the pointer display is “ON”, and pointers P1, P2, and P3 are displayed. The pointers P1, P2, and P3 are displayed in different colors so that they can be identified.

  FIG. 7C illustrates a composite image G3 in which the pointer image G2 is combined with the input image G1 by the OSD processing unit 32 of the projector 100.

Next, a process until the smartphones 201, 202, and 203 establish a connection with the projector 100 and start transmission of pointing operation information will be described in detail.
FIG. 8 is a flowchart of processing of the smartphones 201, 202, and 203. The processes performed by the smartphones 201, 202, and 203 are the same.

  The second control unit 220 of the smartphones 201, 202, and 203 instructs the second wireless LAN communication unit 240 to search for a connectable projector (step S101). When the connectable projector 100 is found, the second control unit 220 issues an instruction to the second wireless LAN communication unit 240, transmits a connection request to the projector 100, and establishes a communication connection (step S102). .

  When the communication connection is established, since the projection image information is transmitted from the projector 100, the smartphones 201, 202, and 203 receive the second wireless LAN communication unit 240, and the second control unit 220 receives the second image. Display is started on the display device 212 via the processing unit 230 (step S103). And the 2nd control part 220 transmits apparatus information T1 from the 2nd wireless LAN communication part 240 (step S104). Here, it is assumed that the device information T1 is stored in a memory (not shown) of the second control unit 220. And the 2nd control part 220 transmits the pointing operation information performed with the touch panel 211 from the 2nd wireless LAN communication part 240 (step S105).

  Thereafter, the smartphones 201, 202, and 203 transmit pointing operation information while receiving projection image information.

Next, a process until the projector 100 establishes connection with the smartphones 201, 202, and 203 and starts receiving pointing operation information will be described in detail.
FIG. 9 is a flowchart of processing of the projector 100.

  When the search request is received from the smartphones 201, 202, and 203, the control unit 20 of the projector 100 issues an instruction to the wireless LAN communication unit 50 and transmits a response to the search request (step S201). Next, when receiving a connection request from the smartphones 201, 202, and 203, the control unit 20 issues an instruction to the wireless LAN communication unit 50, establishes a communication connection, and notifies the smartphones 201, 202, and 203 (step). S202). Then, the control unit 20 issues an instruction to the wireless LAN communication unit 50 and starts transmitting projection image information corresponding to the image information output from the OSD processing unit 32 (step S203).

  The wireless LAN communication unit 50 receives the device information T1 from the smartphones 201, 202, and 203 and notifies the control unit 20 of the device information T1. Then, the control unit 20 generates a device information list T2 (Step S204). The control unit 20 at this time corresponds to a device information list generation unit. Furthermore, the control unit 20 generates pointer display setting information based on the device information list T2, and stores it in the pointer display setting unit 22 (step S205). Then, the control unit 20 transmits pointer display setting information to the PC 300 (step S206).

  When the pointer display setting is set by the PC 300, the wireless LAN communication unit 50 receives the second pointer display setting information (step S207). The control unit 20 writes the second pointer display setting information in the pointer display setting unit 22 (step S208). The control unit 20 and the pointer display setting unit 22 at this time correspond to a pointer display setting change unit. And the control part 20 starts reception of the pointing operation information of the smart phone 201,202,203 (step S209).

  As described above, the projector 100 establishes connection with the smartphones 201, 202, and 203 and starts receiving pointing operation information. In addition, the projector 100 changes the setting value of the pointer display setting unit 22 based on the second pointer display setting information set by the operator of the PC 300.

Next, a process in which the projector 100 combines a pointer image with an input image based on the pointing operation information received from the smartphones 201, 202, and 203 will be described in detail.
FIG. 10 is a flowchart of image composition processing of the projector 100.

  The control unit 20 of the projector 100 acquires pointing operation information from the smartphones 201, 202, and 203 (step S301). The control unit 20 refers to the pointer display setting unit 22 and issues an instruction to the OSD processing unit 32 to generate a pointer image for the pointer set to be displayable (step S302). The OSD processing unit 32 combines a pointer image with the input image (step S303).

  The synthesized image synthesized in this way is projected from the image projection unit 10 of the projector 100.

Next, processing when the PC 300 accepts pointer display setting by the operator will be described in detail.
FIG. 11 is a flowchart of the pointer display setting reception process of the PC 300.

  When the PC 300 receives the pointer display setting information from the projector 100, the PC 300 displays a selection screen M1 based on the pointer display setting information on the screen (step S401). The PC 300 determines whether or not the pointer display setting has been changed (step S402). That is, the operator operates the pull-down menus SL1, SL2, and SL3 to determine whether or not the display setting has been changed.

  If the pointer display setting has been changed (step S402: YES), the PC 300 changes the setting value of the pointer display setting and stores it in the internal memory of the PC 300 (step S403). Then, the process returns to step S402.

  If the pointer display setting has not been changed (step S402: NO), the PC 300 determines whether or not the setting end button SL4 has been selected (step S404). If the setting end button SL4 is selected (step S404: YES), the setting value of the pointer display setting is transmitted to the projector 100 as the second pointer display setting information (step S405). Then, the PC 300 deletes the selection screen M1 (step S406). Then, the pointer display setting reception process ends.

  If the setting end button SL4 is not selected (step S404: NO), the process returns to step S402.

  Thus, the operator can change the display setting of the pointer image by using the selection screen M1 of the PC 300.

According to the first embodiment described above, the following effects can be obtained.
(1) In the image display system 1, when the connection between the projector 100 and the smartphones 201, 202, and 203 is established, the projector 100 generates a device information list T2. The projector 100 transmits pointer display setting information based on the device information list T2 to the PC 300. Based on the pointer display setting information, the PC 300 displays a selection screen M1 for setting the pointer image display on / off for each of the smartphones 201, 202, and 203. The operator of the PC 300 switches on / off the display of the pointer image through the selection screen M1. The pointer display setting set by the operator of the PC 300, that is, the second pointer display setting information is transmitted to the projector 100. Then, the projector 100 combines the pointer image with the input image based on the pointer display setting, and projects the combined image. Accordingly, when a pointing operation is performed on the smartphones 201, 202, and 203, respective pointer images are displayed on the projection image of the projector 100. Further, since the projector 100 includes the pointer display setting unit 22 and the OSD processing unit 32 synthesizes the pointer image with the input image, even if the PC 300 is replaced with another PC, the pointer display setting may be followed. it can. In addition, since the PC 300 can individually switch on / off the pointer images of the smartphones 201, 202, and 203, the operator of the PC 300 can display only the necessary pointer images, which is highly convenient. .

  (2) The smartphones 201, 202, and 203 have a touch panel 211 and accept a pointing operation. The pointing operation information is transmitted to the projector 100 by wireless LAN communication. Thereby, since the user can perform a pointing operation on the touch panel 211, convenience is improved.

  (3) The projector 100 transmits the projection image information output from the OSD processing unit 32, that is, the composite image, to the smartphones 201, 202, and 203. Touch screen 210 of smartphones 201, 202, and 203 displays a composite image and accepts a pointing operation. Thereby, since the user can perform a pointing operation while visually recognizing the composite image displayed on the smartphones 201, 202, and 203, convenience is improved.

(Second Embodiment)
In the second embodiment, a mode in which pointer image display setting is performed by the projector 100 will be described.

  The configuration of the image display system 2 according to the second embodiment is the same as that of the image display system 1 according to the first embodiment. That is, the image display system 2 includes a projector 100 as an image display device, smartphones 201, 202, and 203 as portable information terminals, and a PC 300 as an information processing device.

  The configuration of the projector 100 is the same as that in FIG. The configuration of the smartphones 201, 202, and 203 is the same as that in FIG. The PC 300 is the same as in the first embodiment. Therefore, the description is omitted.

Next, the operation of the image display system 2 (projector 100, smartphones 201, 202, 203, PC 300) will be described.
FIG. 12 is a sequence diagram illustrating the operation of the image display system 2 according to the second embodiment. The image display system 2 according to the present embodiment has three smartphones 201, 202, and 203, but is represented as one in the sequence diagram. An image signal is always input from the PC 300 to the projector 100, but is not displayed on the sequence diagram.

  Sequences SQ201 to SQ207 are the same as sequences SQ101 to SQ107 in the first embodiment of FIG. Therefore, the description is omitted.

  Based on the device information list T2, the projector 100 generates pointer display setting information, which is default information for pointer display settings for determining whether or not to display a pointer image, for each of the smartphones 201, 202, and 203 (SQ208). In the default information of the pointer display setting information, the pointer display is all “ON”.

  The projector 100 displays a selection screen based on the pointer display setting information on the projected image, and accepts a setting as to whether or not to display a pointer image for each of the smartphones 201, 202, and 203 (SQ209). That is, the operator (presenter) operates the operation unit 21 of the projector 100 to select whether or not to display the pointer. Here, the selection screen is the same as the selection screen M1 of the first embodiment. The projector 100 sets the set pointer display setting information in the pointer display setting unit 22 (SQ210).

  When the user operates the smartphones 201, 202, and 203, pointing operation information for moving the pointer is transmitted (SQ211). The projector 100 combines the pointer image with the input image and projects the combined image (SQ212).

  As described above, in the image display system 2, the operator can set the pointer image on / off by operating the operation unit 21 of the projector 100. Then, similarly to FIG. 7, the composite image G3 in which the pointer image G2 is combined with the input image G1 can be projected by the OSD processing unit 32 of the projector 100.

According to 2nd Embodiment mentioned above, there can exist an effect similar to the effect (2) and (3) of 1st Embodiment. In addition, the following effects can be obtained.
(1) In the image display system 2, when the connection between the projector 100 and the smartphones 201, 202, and 203 is established, the projector 100 generates a device information list T2. The projector 100 generates pointer display setting information based on the device information list T2. Based on the pointer display setting information, the projector 100 projects a selection screen for setting the pointer image display on / off for each of the smartphones 201, 202, and 203. The operator (presenter) switches on / off the display of the pointer image by operating the operation unit 21 of the projector 100 while the selection screen is displayed. The pointer display setting information set by the operator is written in the pointer display setting unit 22. Then, the projector 100 combines the pointer image with the input image based on the pointer display setting information, and projects the combined image. Accordingly, by operating the projector 100, the operator can switch on / off the pointer images of the smartphones 201, 202, and 203, which is highly convenient. Further, since the pointer display setting operation is performed without using the PC 300, the processing as the image display system 2 can be simplified.

  (2) In the image display system 2, since the PC 300 does not exchange control signals with the projector 100, it is only necessary to supply an image signal. Therefore, it is not necessary to limit to the PC 300 (personal computer), and any general-purpose image supply device may be used, so that convenience is improved.

  In addition, it is not limited to embodiment mentioned above, It is possible to implement by adding various change, improvement, etc. A modification will be described below.

  (Modification 1) In the above embodiment, when the connection is established, the projector 100 transmits the projection image information to the smartphones 201, 202, and 203. However, the projection image information may not be transmitted. In this case, an image based on the projection image information is not displayed on the touch screen 210 of the smartphones 201, 202, and 203, but a pointing operation is accepted and transmitted to the projector 100.

  (Modification 2) In the first embodiment, the projector 100 transmits the pointer display setting information to the PC 300, but may transmit the device information list T2. Then, the PC 300 may receive the pointer display setting by the operator based on the device information list T2 and generate the second pointer display setting information.

  (Modification 3) In the first embodiment, the information processing apparatus is the PC 300. However, the information processing apparatus is not limited to the PC, and is an information processing apparatus capable of transmitting an image signal to the projector 100 and transmitting / receiving a control signal. I just need it. For example, the information processing apparatus may be a portable information terminal such as a smartphone.

  (Modification 4) In the said embodiment, although the image display systems 1 and 2 shall have the smart phones 201, 202, and 203 as a portable information terminal, a portable information terminal is not limited to a smart phone. The portable information terminal may be a tablet PC or a notebook PC. Smartphones, tablet PCs, notebook PCs, and the like may be mixed. Further, when the portable information terminal does not have a touch panel, the pointing operation may be detected by a pointing device such as a touch pad.

  (Modification 5) In the said embodiment, although the image display systems 1 and 2 have the three smart phones 201, 202, and 203, the number of smart phones is not limited to this. The number of smartphones may be singular or plural.

  (Modification 6) In the above embodiment, the projector 100 is described as an example of the image display device, but the image display device is not limited to the projector. For example, the present invention can be applied to a rear projector, a liquid crystal display, a plasma display, an organic EL (Electro Luminescence) display, and the like that are integrally provided with a transmissive screen.

  (Modification 7) In the above embodiment, the communication between the smartphones 201, 202, 203 and the projector 100 is wireless LAN communication, but is not limited to wireless LAN communication. For example, communication by Bluetooth (registered trademark) or USB may be used.

  (Modification 8) In the above embodiment, the projector 100 inputs an image signal from the PC 300 via the USB cable C1, but the projector 100 may input the image signal by wireless communication using radio waves or the like.

  (Modification 9) In the above-described embodiment, the light source device 11 includes the discharge-type light source lamp 11a. However, a solid light source such as an LED (Light Emitting Diode) light source or a laser, or another light source is used. It can also be used.

  (Modification 10) In the above embodiment, the projector 100 uses the transmissive liquid crystal light valves 12R, 12G, and 12B as the light modulator, but the reflective light modulator such as a reflective liquid crystal light valve. It is also possible to use. In addition, it is possible to use a micromirror array device that modulates light emitted from a light source by controlling the emission direction of incident light for each micromirror as a pixel.

  DESCRIPTION OF SYMBOLS 1, 2 ... Image display system, 10 ... Image projection part, 11 ... Light source device, 11a ... Light source lamp, 11b ... Reflector, 12R, 12G, 12B ... Liquid crystal light valve, 13 ... Projection lens, 14 ... Liquid crystal drive part, 20 DESCRIPTION OF SYMBOLS ... Control part, 21 ... Operation part, 22 ... Pointer display setting part, 30 ... Image signal input part, 31 ... Image processing part, 32 ... OSD processing part, 50 ... Wireless LAN communication part, 100 ... Projector, 201, 202, DESCRIPTION OF SYMBOLS 203 ... Smartphone, 210 ... Touch screen, 211 ... Touch panel, 212 ... Display apparatus, 220 ... 2nd control part, 230 ... 2nd image processing part, 240 ... 2nd wireless LAN communication part, 300 ... PC, C1 ... USB cable .

Claims (5)

An image display system comprising an image display device that displays an image based on image information, one or more portable information terminals, and an information processing device ,
The portable information terminal
A device information transmitter for transmitting device information of the portable information terminal;
An operation accepting unit for accepting a pointing operation;
An operation information transmitting unit that transmits the pointing operation received by the operation receiving unit as pointing operation information;
Have
The image display device includes:
A device information receiving unit for receiving the device information from the portable information terminal;
An operation information receiving unit for receiving the pointing operation information from the portable information terminal;
A device information list generating unit that generates a device information list in which one or more portable information terminals are registered based on the device information received by the device information receiving unit;
A pointer display setting unit for setting, as pointer display setting information, whether or not to display a pointer image corresponding to the pointing operation information for the portable information terminal registered in the device information list;
Based on the pointer display setting information, an image combining unit that combines the pointer image corresponding to the pointing operation information with an image based on the image information;
I have a,
The information processing apparatus includes:
A pointer display setting receiving unit for receiving the pointer display setting information or the device information list from the image display device;
Whether to display a pointer image corresponding to the pointing operation information on the image display device for the pointer display setting information received by the pointer display setting receiving unit or the portable information terminal registered in the device information list , As a second pointer display setting information, a second pointer display setting unit,
A second pointer display setting transmission unit for transmitting the second pointer display setting information to the image display device;
Have
The image display device includes:
A pointer display setting transmission unit for transmitting the pointer display setting information or the device information list to the information processing device;
A second pointer display information receiving unit for receiving the second pointer display setting information from the information processing apparatus;
An image further comprising: a pointer display setting changing unit that changes the setting of the pointer display setting unit based on the second pointer display setting information received by the second pointer display information receiving unit. Display system. The image display system according to claim 1 ,
The image processing system, wherein the information processing apparatus is the portable information terminal. The image display system according to claim 1 or 2 ,
The operation receiving unit of the portable information terminal is configured to have a touch panel, and the pointing operation is received by the touch panel. The image display system according to claim 3 ,
The image display device includes:
An image transmitting unit that transmits information of the combined image combined by the image combining unit to the portable information terminal;
The portable information terminal
An image receiving unit that receives information of the composite image from the image display device;
The image display system, wherein the touch panel displays the composite image based on the information of the composite image received by the image receiving unit and accepts the pointing operation. An image display system control method comprising: an image display device that displays an image based on image information; one or a plurality of portable information terminals; and an information processing device .
The portable information terminal
A device information transmission step of transmitting device information of the portable information terminal;
An operation accepting step for accepting a pointing operation;
An operation information transmitting step for transmitting the pointing operation received by the operation receiving step as pointing operation information;
Run
The image display device includes:
A device information receiving step for receiving the device information from the portable information terminal;
An operation information receiving step for receiving the pointing operation information from the portable information terminal;
A device information list generating step for generating a device information list in which one or more portable information terminals are registered based on the device information received by the device information receiving step;
Pointer display setting step for setting, as pointer display setting information, whether or not to display a pointer image corresponding to the pointing operation information for the portable information terminal registered in the device information list;
An image synthesis step of synthesizing the pointer image according to the pointing operation information with an image based on the image information based on the pointer display setting information;
Run
The information processing apparatus includes:
A pointer display setting receiving step for receiving the pointer display setting information or the device information list from the image display device;
Whether or not to display a pointer image corresponding to the pointing operation information on the image display device for the portable information terminal registered in the pointer display setting information received in the pointer display setting reception step or the device information list A second pointer display setting step for setting as the second pointer display setting information;
A second pointer display setting transmission step of transmitting the second pointer display setting information to the image display device;
Run
The image display device includes:
A pointer display setting transmission step of transmitting the pointer display setting information or the device information list to the information processing device;
A second pointer display information receiving step for receiving the second pointer display setting information from the information processing apparatus;
A pointer display setting changing step of changing the setting of the pointer display setting step based on the second pointer display setting information received in the second pointer display information receiving step ; Control method of image display system.

Images