JP2012194324A - Image display device, terminal device, image display system, and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device and the like which can reduce mis-operations by a user in a terminal device when the image display device changes a content of an image in response to an instruction from the terminal device to display the changed image.SOLUTION: A projector 100 which is a kind of an image display device includes: a display side image generation unit 160 for generating a first image; a projection unit 190 as a display side display unit for displaying the first image; a display side communication unit 110 for receiving instruction information indicating a content change instruction of the first image from a terminal device; a display side information generation unit 130 for, before displaying a second image which is generated by changing the first image according to the content change instruction, generating preview image information indicating the second image. Before displaying the second image, the communication unit 110 transmits the preview image information to the terminal device.

Description

  The present invention relates to an image display device, a terminal device, an image display system, and an image display method.

  For example, Japanese Patent Application Laid-Open No. 2004-54783 describes a display system that receives captured image data that has undergone size conversion processing from a plurality of terminal devices, and synthesizes and displays the image data on a single screen. In addition, the publication describes that the user enlarges, deletes, or adds an image of a specific terminal device by operating a remote controller (remote controller) of the image display device. .

JP 2004-54783 A

  However, for example, when a presenter enlarges an image of a terminal device used by the participant with a remote controller in response to a request from a participant in a meeting or the like, the presenter specifies the image, grasps the requested content, and requests The remote control operation must be performed according to the operation, which takes time. In the above publication, it is described that a split screen to be enlarged can be designated from the terminal device side, but a specific method is not described. In addition, when the configuration of the image displayed by the image display device changes in accordance with such designation from the terminal device side, an incorrect image is displayed by the image display device when the user of the terminal device operates incorrectly. May end up.

  Some aspects of the present invention solve the above-described problems, thereby reducing erroneous operations by the user of the terminal device in a situation where the image display device changes and displays the content of the image according to an instruction from the terminal device. An image display device, a terminal device, an image display system, and an image display method that can be used are provided.

  An image display device according to one aspect of the present invention includes a display-side image generation unit that generates a first image, a display-side display unit that displays the first image, and the first image from a terminal device. A display-side communication unit that receives instruction information indicating a content change instruction, and the second image is displayed prior to displaying the second image in which the first image is changed according to the content change instruction. A display-side information generation unit that generates preview image information, wherein the display-side communication unit transmits the preview image information to the terminal device prior to display of the second image. To do.

  The terminal device according to one aspect of the present invention transmits instruction information indicating a content change instruction of the first image to an image display device that displays the first image, and the content change instruction. A terminal-side communication unit that receives preview image information indicating the second image prior to display on the image display device of the second image in which the first image is changed in response to the first image; and the preview image information A terminal-side image generation unit that generates a preview image based on the terminal, a terminal-side display unit that displays the preview image, a reception unit that receives an operation, and a terminal-side information generation unit that generates the instruction information according to the operation , Including.

  An image display system according to one aspect of the present invention includes the image display device and the terminal device.

  The image display method according to one aspect of the present invention is such that the terminal device accepts an operation indicating a content change instruction for the first image displayed on the image display device, and the content change instruction is received according to the operation. Is transmitted to the image display device, the image display device receives the instruction information from the terminal device, and the second image in which the first image is changed in response to the content change instruction. Prior to display of the image, preview image information indicating the second image is generated and transmitted to the terminal device, and the terminal device receives the preview image information from the image display device, and the preview image A preview image based on information is generated and displayed.

  According to the present invention, the image display device can transmit the preview image information prior to the display of the changed second image, and the terminal device can display the preview image based on the preview image information. The user can confirm the changed content before the display on the image display device is changed. Thereby, an image display apparatus etc. can reduce the erroneous operation by the user of a terminal device.

  The display-side communication unit receives information indicating cancellation from the terminal device after transmitting the preview image information, and the display-side image generation unit receives information indicating the cancellation by the display-side communication unit. Then, it is not necessary to make a change according to the configuration change instruction. According to this, the image display device can prevent the user of the terminal device from displaying the second image due to an erroneous operation of the user by canceling in a state where the preview image is displayed.

  The display-side communication unit receives information indicating the change from the terminal device after transmitting the preview image information, and the display-side image generation unit receives the information indicating the change by the display-side communication unit. Then, the second image changed according to the configuration change instruction may be generated, and the display-side display unit may display the second image. According to this, since the user of the terminal device can display the second image after confirming the user by giving a change instruction while the preview image is displayed, the user of the terminal device can display the second image. It is possible to prevent the second image from being displayed due to an erroneous operation.

  The display-side communication unit receives image information from a plurality of terminal devices, and the display-side image generation unit includes a whole image including an individual image based on image information for each terminal device as the first image. And the display-side display unit may display the entire image. According to this, the image display device receives the image information from the plurality of terminal devices, and generates preview image information even when a new individual image is added to the entire image in response to the change instruction. Therefore, it is possible to make the user of the terminal device confirm the changed content more smoothly.

  The image display device is a device that receives image information from a plurality of the terminal devices, and displays an entire image including individual images based on image information for each of the terminal devices as the first image, The terminal-side image generation unit is an image for changing the configuration of the whole image, and includes an individual image arrangement area indicating the arrangement of the individual image in the whole image, and an icon for each terminal device. Generating a configuration change image including an icon arrangement area, the terminal-side display unit displays the configuration change image, and the receiving unit receives an operation related to the configuration change according to an operation related to each icon, The terminal-side information generation unit may generate the instruction information according to an operation related to the configuration change. According to this, when the configuration of the entire image is changed by an icon operation, the user of the terminal device can check the changed entire image before the display of the entire image on the image display device is changed. .

It is a figure which shows an example of the image display system in a 1st Example. It is a functional block diagram of the projector in a 1st Example. FIG. 2 is a hardware block diagram of the projector in the first embodiment. It is a functional block diagram of PC in a 1st Example. It is a flowchart which shows the image display procedure in a 1st Example. It is a figure which shows an example of the structure change image in a 1st Example. It is a figure which shows an example of the whole image in a 1st Example. It is a figure which shows another example of the structure change image in 1st Example. It is a figure which shows another example of the whole image in a 1st Example.

  Hereinafter, an embodiment in which the present invention is applied to an image display system using a projector and a PC (Personal Computer) will be described with reference to the drawings. In addition, the Example shown below does not limit the content of the invention described in the claim at all. In addition, all the configurations shown in the following embodiments are not necessarily essential as means for solving the invention described in the claims.

(First embodiment)
FIG. 1 is a diagram illustrating an example of an image display system according to the first embodiment. The image display system is configured to include a projector (image display device) 100 and four PCs (terminal devices) 200-1 to 200-4 that are wiredly connected via a hub 300. The number of PCs 200 is not limited to four. The connection method is not limited to wired connection, and may be wireless connection.

  Each PC 200 captures an image being displayed on its own apparatus and transmits it to the projector 100 as image information. The projector 100 projects the entire image 30 including the individual image 20 based on the image information on the screen 10. Here, four individual images 20-1 to 20-4 are used, but the projector 100 can change the configuration of the individual image 20 included in the entire image 30 in accordance with an operation on the PC 200. Is possible.

  The projector 100 according to the present embodiment shows the changed image (second image) before changing the configuration of the entire image (first image) 30 when the configuration change request for the entire image 30 is made. It has a function of generating preview image information and transmitting it to the PC 200 that has made the configuration change request. Further, the PC 200 has a function of making the above-described configuration change request and displaying a preview image based on the received preview image information. Next, functional blocks of the projector 100 and the PC 200 having such functions will be described.

  FIG. 2 is a functional block diagram of the projector 100 according to the first embodiment. The projector 100 transmits and receives information to and from the PC 200 (display side), a communication unit 110 (display side), a storage unit 120, a display image information and the like (display side) information generation unit 130, and (display side) control. The image forming unit 160 includes a unit 150, a (display side) image generation unit 160, and a projection unit (display side display unit) 190. The storage unit 120 stores image data 122, setting data 124 indicating the configuration of the entire image 30, and the like.

  The projector 100 may function as each of these units using the following hardware. FIG. 3 is a hardware block diagram of the projector 100 according to the first embodiment. For example, the communication unit 110 is a wired communication unit 910, the storage unit 120 is a RAM 920, a flash ROM 922, the information generation unit 130, the control unit 150 is a CPU 930, the image generation unit 160 is an image processing circuit 960, and the projection unit 190 is , A lamp driving circuit 990, a lamp 991, an illumination optical system 992, a liquid crystal driving circuit 993, a liquid crystal light valve 994, a lens 995, and the like.

  Next, functional blocks of the PC 200 will be described. FIG. 4 is a functional block diagram of the PC 200 in the first embodiment. The PC 200 transmits / receives information to / from the projector 100 (terminal side), a communication unit 210 (terminal side), a storage unit 220 (terminal side), an information generation unit 230, a reception unit 240 that receives user operations, and (terminal) Side) control unit 250, (terminal side) image generation unit 260, and (terminal side) display unit 290. The storage unit 220 stores image data 222, setting data 224, and the like. Since the hardware configuration of the PC 200 is general, the description thereof is omitted.

  Next, a display procedure for the entire image 30 and the like in the projector 100 and the PC 200 will be described. FIG. 5 is a flowchart showing an image display procedure in the first embodiment. The information generation unit 230 of each PC 200 captures the image generated by the image generation unit 260 to generate image information, and the communication unit 210 transmits the image information to the projector 100 (step S1). The communication unit 110 of the projector 100 receives image information from each PC 200, and the control unit 150 updates the image data 122 based on the image information (step P1).

  In this embodiment, regardless of whether the entire image 30 is a display target, the communication unit 210 of each PC 200 transmits image information to the projector 100, and the communication unit 110 of the projector 100 receives image information from each PC 200. Receive. Further, the communication unit 210 of the PC 200 may transmit image information indicating a continuously captured moving image, or may transmit image information indicating a still image.

  The image generation unit 160 generates the entire image 30 including the individual image 20 according to the setting based on the image data 122 and the setting data 124, and the projection unit 190 projects the entire image 30 (step P2). On the other hand, the image generation unit 260 of the PC 200 generates a later-described configuration change image based on the image data 222 and the setting data 224, and the display unit 290 displays the configuration change image (step S2). In a state where the configuration change image is displayed, the user performs an operation of changing the configuration of the entire image 30, and the control unit 250 issues a content change instruction for the entire image 30 in accordance with the operation received by the receiving unit 240. The instruction information shown is generated, and the communication unit 210 transmits the instruction information to the projector 100 (step S3).

  The communication unit 110 of the projector 100 receives instruction information from the PC 200, and the information generation unit 130 displays preview image information indicating the image after the change according to the content change instruction based on the instruction information and the image data 122. The communication unit 110 transmits the preview image information to the PC 200 that transmitted the instruction information (step P3). The communication unit 210 of the PC 200 receives the preview image information, generates a preview image indicating the entire image whose configuration has been changed according to the change instruction based on the preview image information, and the display unit 290 displays the preview image. Is displayed (step S4).

  Here, a change in the entire image due to an operation in a state where the configuration change image is displayed will be described. FIG. 6 is a diagram illustrating an example of the configuration change image 500 in the first embodiment. FIG. 7 is a diagram illustrating an example of the entire image 31 in the first embodiment. FIG. 8 is a diagram illustrating another example of the configuration change image 501 in the first embodiment. FIG. 9 is a diagram illustrating another example of the entire image 30 in the first embodiment.

  The configuration change image 500 is an individual composed of display mode button images 510 to 514 for changing the number of individual images 20 constituting the entire images 30 and 31, and four display target regions 531 to 534 of 2 rows and 2 columns. An image arrangement area 530, a display button image 520 for instructing display of the entire image 30, an image mute button image 522 for instructing to display a user logo image or the like instead of the entire image 30, and the current entire image 30 A pause button image 524 for giving an instruction to maintain the display, an icon arrangement area 540 in which icons 550 to 556 associated with the respective PCs 200 are arranged, and the display target areas 531 to 534 are moved according to the operation. And a rectangular cursor image 590 for selecting the individual image 20 to be displayed. The configuration change image 500 includes a menu image indicating “file”, “tool”, and “help”, an image indicating a connected projector name, and the like.

  For example, the configuration change image 500 illustrated in FIG. 6 is an image displayed on the screen of the PC 200-1 (computer name is “CPA”). In the individual image arrangement area 530, a mark image 570 indicating CPA is arranged in the display target area 531 in the upper left area, and a mark image 572 showing CPB (PC200-2) is arranged in the display target area 532 in the upper right area. A mark image 574 indicating CPC (PC200-3) is arranged in the display target area 533 in the lower left area, and the mark image is depressed in the display target area 534 in the lower right area because no mark image is arranged. A hollow image 580 having a shape is arranged. Further, when the entire image 30 is being displayed, the background of the mark images 570 to 574 is displayed in white, and when not being displayed, the background of the mark images 570 to 574 is displayed in gray. For example, in the example showing the case where the display mode button image 512 is selected in a state where the cursor image 590 shown in FIG. 6 is in the position of the display target area 531, the background of the mark images 570 and 572 is white, The image 30 shows that two individual images of the PCs 200-1 and 200-2 are arranged side by side. The background of the hollow image 580 is gray.

  In the icon arrangement area 540, icons 552 to 556 indicating other PCs 200 from the left are arranged in the participation order (connection order to the projector 100) in the other apparatus area 544 on the right side, and the own apparatus area 542 on the left side. An icon 550 that indicates the own device is fixedly arranged regardless of the order of participation. The background of the icons 550 to 556 changes according to the display state in the individual image arrangement area 530. For example, in the example shown in FIG. 6, the icon background images 560 and 562 in the background of the icons 550 and 552 that are in the display state in which the mark image is displayed and the individual images are displayed are displayed in white. The icon background image 564 in the background of the icon 554 in the display standby state in which an image is displayed and no individual image is displayed is displayed in gray, and the icon 556 in the non-display state in which no mark image is displayed. Nothing is displayed in the background. Furthermore, the icon 550 of the own terminal device is displayed larger than the icons 552 to 556 of the other terminal device, and the mark image 570 of the own terminal device is displayed larger than the mark images 572 and 574 of the other terminal device. The icons 550 to 556 are displayed in different colors, and the mark images 570 to 574 are also displayed in different colors. Further, the host name of the PC 200 (name setting by the user is also possible) is added to the icons 550 to 556 and the mark images 570 to 574 and displayed.

  In the configuration change image 500 shown in FIG. 6, the PCs 200-1 and 200-2 are to be displayed. Therefore, in the entire image 31 projected by the projector 100, as shown in FIG. 20-2 are displayed side by side. As described above, even in this case, the communication unit 110 receives image information from all the PCs 200-1 to 200-4.

  In the state of the configuration change image 500 shown in FIG. 6, the user of the PC 200-1 places the icon 556 in the display target area 534 by drag and drop operation, and sets the number of individual images 20 included in the entire image 30 to 4. When the display mode button image 514 indicating that the individual image is to be changed is clicked, the identification information of the PC 200 constituting the individual image 20, the instruction information indicating the presence / absence of display is transmitted to the projector 100 by the process of step S 3.

  In this case, the image generation unit 260 of the PC 200-1 generates the configuration change image 501 including the preview image 600, as shown in FIG. 8, based on the preview image information from the projector 100. The preview image 600 includes four images showing still images based on image information from the PCs 200 corresponding to the four individual images 20, a “change” button image for instructing to reflect the change, and no change is reflected. A “cancel” button image for instructing is included.

  The control unit 250 determines whether or not the “change” button image is clicked by the user based on the information from the reception unit 240 (step S5), and the “cancel” button image is displayed without being clicked. If clicked, the information generating unit 230 generates cancel notification information indicating that the “cancel” button image has been clicked, and the communication unit 210 transmits the cancel notification information to the projector 100 (step S6). . On the other hand, when the “change” button image is clicked, the information generation unit 230 generates change notification information indicating that the “change” button image is clicked, and the communication unit 210 transmits the change notification information to the projector 100. (Step S7).

  The control unit 150 of the projector 100 determines whether or not the change notification information is received by the communication unit 110 (step P4). If the change notification information is received, the change content indicated by the change notification information is reflected. Thus, the setting data 124 is updated, the information generation unit 130 generates setting information indicating the contents of the setting data 124, and the communication unit 110 transmits the setting information to each PC 200 (step P5). As a result, for example, the entire image 30 shown in FIG. 9 is projected in a state in which the changed content is reflected at the next projection of the entire image. Note that when the cancel notification information is received, the control unit 150 does not update the setting data 124.

  The communication unit 210 of each PC 200 receives the setting information, and the control unit 150 updates the setting data 224 based on the setting information (step S8). Accordingly, the configuration change image is displayed in a state in which the changed content is reflected when the next configuration change image is displayed.

  As described above, according to the present embodiment, the projector 100 can transmit the preview image information prior to displaying the changed image, and the PC 200 can display the preview image 600 based on the preview image information. The user of the PC 200 can check the changed content before the display on the projector 100 is changed. Thereby, the projector 100 can reduce erroneous operations by the user of the PC 200.

  In addition, according to the present embodiment, the projector 100 prevents the user of the PC 200 from displaying the entire image 30 after the change due to a user's erroneous operation by performing a cancellation in a state where the preview image 600 is displayed. Can do. Further, according to the present embodiment, the projector 100 allows the user of the PC 200 to display the entire image 30 after the change after confirming the user by giving a change instruction while the preview image 600 is displayed. Therefore, it is possible to prevent the entire image 30 from being displayed due to an erroneous operation by the user.

  Furthermore, according to the present embodiment, the projector 100 receives image information from all the PCs 200 that can be displayed regardless of whether or not the individual images 20 in the entire image 30 are displayed, so that the images of the PCs 200 not being displayed are displayed. Can be generated and transmitted to the PC 200. Accordingly, when the user of the PC 200 changes the configuration of the entire image 31 by an icon operation, the user can check the changed entire image 30 before the display of the entire image 31 on the projector 100 is changed.

(Other examples)
In addition, application of this invention is not limited to the Example mentioned above, A deformation | transformation is possible. For example, the content change instruction for changing the first image to the second image is not limited to the change of the arrangement of the individual images 20 in the entire image 30, for example, a modification that changes the size or the like of the first image, Emphasis such as underlining the first image, change from the first image to the second image by changing the supply device (source), or the like may be used.

  The image generation unit 260 of the PC 200 also displays an image indicating help such as “placeable”, “projectable”, “interruptible”, “non-display”, and the like during the above-described drag-and-drop operation (drag). A configuration change image including an image indicating the above may be generated, and the display unit 290 may display the configuration change image. According to this, even when the user has not completed the drag-and-drop operation, the user can grasp the operation result and know what operation should be performed. The operation related to the icon is not limited to the drag and drop operation, and may be, for example, a click operation, a right click operation, a double click operation, a drag operation, a flick operation, or the like.

  In addition, the preview image 600 is arranged in front of the configuration change image 501 in a non-transparent manner, but may be displayed in a state where the background is transparent, or only the preview image 600 is used instead of the configuration change images 500 and 501. May be displayed. Further, “change” and “cancel” in the preview image 600 are not essential, and may be changed or canceled by a keyboard operation, for example. In addition, the image generation unit 160 of the projector 100 automatically responds to the content change instruction if no cancel notification information is received after a predetermined time (for example, 1 minute) has elapsed since the preview image information was transmitted. Two images may be generated.

  The image display device is not limited to the projector 100, and may be, for example, a display, a white board having an image display function, a television, or the like. Further, the terminal device is not limited to the PC 200, and may be, for example, a portable information terminal device, a mobile phone, or the like. For example, in the case of a portable information terminal device corresponding to a touch operation, an erroneous operation is likely to occur. However, by applying the above-described embodiment, the display of the image display device is not changed by a user's erroneous operation, and the user can Touch operation can be performed comfortably and accurately.

  The computer included in the projector 100 may function as the information generation unit 130 by reading a program stored in the information storage medium. The computer included in the PC 200 may function as the information generation unit 230 by reading a program stored in the information storage medium. As such an information storage medium, for example, a CD-ROM, DVD-ROM, ROM, RAM, HDD, or the like can be applied.

  The projector 100 is not limited to a liquid crystal projector (transmission type, reflection type such as LCOS), and may be a projector using a digital micromirror device, for example. Further, the projector 100 is not limited to the front projection type projector, and may be a rear projection type projector or may be used in a ceiling-suspended form. The projection unit 190 may employ a self-light emitting element including a solid light source such as an organic EL element, a silicon light emitting element, a laser diode, and an LED instead of the lamp. Further, the function of the projector 100 may be distributed to a plurality of devices (for example, a PC and a projector).

  10 screen, 20 individual image, 30, 31 whole image, 100 projector (image display device), 110 communication unit (display side communication unit), 120 storage unit (display side storage unit), 122 image data, 124 setting data, 130 Information generation unit (display side information generation unit), 150 control unit (display side control unit), 160 image generation unit (display side image generation unit), 190 projection unit (display side display unit), 200 PC (terminal device), 210 communication unit (terminal side communication unit), 220 storage unit (terminal side storage unit), 222 image data, 224 setting data, 230 information generation unit (terminal side information generation unit), 240 reception unit, 250 control unit (terminal side) Control unit), 260 image generation unit (terminal side image generation unit), 290 display unit (terminal side display unit), 300 hub, 500, 501 configuration change image, 51 -514 Display mode button image, 520 Display button image, 522 Image mute button image, 524 Pause button image, 530 Individual image arrangement area, 531 to 534 Display target area, 540 Icon arrangement area, 542 Own apparatus area, 544 Other apparatus Area, 550-556 icon, 560-564 icon background image, 570-574 mark image, 580 dimple image, 590 cursor image, 600 preview image, 910 wired communication unit, 920 RAM, 922 flash ROM, 930 CPU, 960 image processing Circuit, 990 lamp driving circuit, 991 lamp, 992 illumination optical system, 993 liquid crystal driving circuit, 994 liquid crystal light valve, 995 lens

Claims (8)

A display-side image generation unit that generates a first image;
A display side display unit for displaying the first image;
A display-side communication unit that receives instruction information indicating a content change instruction of the first image from a terminal device;
A display-side information generation unit that generates preview image information indicating the second image prior to displaying the second image in which the first image has been changed in response to the content change instruction;
Including
The display-side communication unit transmits the preview image information to the terminal device prior to displaying the second image.
Image display device. The image display device according to claim 1,
The display-side communication unit receives information indicating cancellation from the terminal device after transmitting the preview image information,
The display-side image generation unit does not perform a change according to the configuration change instruction when the information indicating the cancellation is received by the display-side communication unit.
Image display device. The image display device according to claim 1 or 2,
The display-side communication unit receives information indicating a change from the terminal device after transmitting the preview image information,
When the information indicating the change is received by the display-side communication unit, the display-side image generation unit generates the second image that has been changed according to the configuration change instruction,
The display-side display unit displays the second image;
Image display device. The image display device according to any one of claims 1 to 3,
The display-side communication unit receives image information from a plurality of terminal devices,
The display-side image generation unit generates an entire image including an individual image based on image information for each terminal device as the first image,
The display-side display unit displays the entire image;
Image display device. Instruction information indicating an instruction to change the content of the first image is transmitted to an image display device that displays the first image, and the second image in which the first image has been changed according to the content change instruction Prior to displaying an image on the image display device, a terminal-side communication unit that receives preview image information indicating the second image;
A terminal-side image generation unit that generates a preview image based on the preview image information;
A terminal side display unit for displaying the preview image;
A reception unit for receiving operations;
A terminal-side information generation unit that generates the instruction information in response to the operation;
A terminal device including The terminal device according to claim 5,
The image display device is a device that receives image information from a plurality of the terminal devices, and displays an entire image including individual images based on image information for each of the terminal devices as the first image,
The terminal-side image generation unit is an image for changing the configuration of the whole image, and includes an individual image arrangement area indicating the arrangement of the individual image in the whole image, and an icon for each terminal device. A configuration change image including an icon arrangement area is generated,
The terminal-side display unit displays the configuration change image,
The accepting unit accepts an operation related to the change of the configuration according to an operation related to each icon,
The terminal-side information generation unit generates the instruction information according to an operation related to the configuration change.
Terminal device. The image display device according to any one of claims 1 to 4,
The terminal device according to claim 5 or 6,
Including image display system. The terminal device
Accepting an operation indicating a content change instruction of the first image displayed on the image display device;
In response to the operation, instruction information indicating the content change instruction is transmitted to the image display device,
The image display device
Receiving the instruction information from the terminal device;
Prior to displaying the second image in which the first image has been changed in response to the content change instruction, preview image information indicating the second image is generated and transmitted to the terminal device,
The terminal device is
Receiving the preview image information from the image display device;
Generating and displaying a preview image based on the preview image information;
Image display method.