JP4947203B2 - Image supply apparatus and image display program - Google Patents

Description

  The present invention relates to image display control in an image supply device and an image display device.

  When giving a presentation, there is a case where it is desired to display only a screen of a specific window on the external monitor instead of the full screen displayed on the display device. In this regard, there is known a technique for outputting only data of a window selected by a mouse pointer from a plurality of windows displayed on a display device to an external monitor (Patent Document 1).

JP 2000-339130 A

  However, in the related art, when a plurality of image display devices are connected to the image supply device at the same time, the same image is displayed on the plurality of image display devices, or 1 is displayed on the plurality of image display devices. There was a problem that it was difficult to divide and display two images.

  SUMMARY An advantage of some aspects of the invention is to solve at least one of the above-described problems and improve the convenience of operation of the image supply apparatus.

SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples. An application example of the present invention is an image supply apparatus that supplies an image to N (N is an integer of 2 or more) image display apparatuses, and forms a display unit and N display areas in the display unit. The N display areas are arranged in the display unit so that a one-to-one correspondence is visually recognized between the N display images displayed by the image display device and the N display areas. An image display control unit to be arranged, and an image supply unit that supplies an image displayed in each display region to the corresponding image display device, and the image display control unit selects one display region by a user Then, a selection means for selecting an operable function for the screen displayed in the selected display area is displayed, and the selectable function includes the screen displayed in the display area. Mi to display the same screen in other display areas At least one of a ringing function, a multi-screen function for dividing a screen displayed in the display area with another display area, and an editing function for editing the contents of the screen displayed in the display area An image supply device including one of the two.
According to this application example, an operable function including at least one of a mirroring function, a multi-screen function, and an editing function is displayed on the screen displayed in the display area. Can be improved.

[Application Example 1]
An image display control method in an image supply device for supplying images to N (N is an integer of 2 or more) image display devices, wherein: (a) the N image displays on a display unit different from the image display device N display areas corresponding to the apparatus are formed, and a one-to-one correspondence is visually recognized between the N display images displayed by the image supply apparatus and the N display areas. Arranging the N display areas in the display unit, and (b) supplying an image displayed in each display area to the corresponding image display device. Image display control method.
According to this application example, the image displayed on the display area of the display unit of the image supply device can be used to visually recognize the image displayed on the image display device. It becomes possible to improve the convenience.

[Application Example 2]
The image supply apparatus according to Application Example 1, wherein the step (a) allows a user to move the arrangement positions of the N display areas.
According to this application example, when the arrangement of the images displayed by the image display devices is changed, the arrangement of the display areas can be changed according to the arrangement.

[Application Example 3]
In the image supply device according to Application Example 1 or Application Example 2, in the step (a), a reduced desktop area in which a desktop screen is reduced is formed in the display unit.
According to this application example, it is possible to operate the image supply device using the desktop screen.

[Application Example 4]
In the image supply device according to Application Example 3, in the step (a), one or more windows are formed in the reduced desktop area, and the correspondence between one window and the display area on the display unit. An image display control method, comprising: displaying an image displayed in the selected window in the selected display area when the button is designated.
According to this application example, the image displayed in the window can be displayed in the display area and supplied to the image display device.

[Application Example 5]
In the image supply device according to any one of Application Example 1 to Application Example 4, in the step (a), when one display area is selected, the screen displayed in the selected display area is displayed. An image display control method characterized by displaying an operable function.
According to this application example, functions that can be operated on the screen displayed in the display area are displayed, so that the operability of the image supply apparatus can be improved.

[Application Example 6]
In the image supply device according to any one of Application Example 1 to Application Example 4, in the step (a), a cursor for selecting a display area is displayed, and when the cursor moves on one display area, An image display control method, wherein an operable function is displayed on a screen displayed in the display area.
According to this application example, a function that can be operated by moving the cursor over the display area without selecting the display area is displayed, so that the operability of the image supply apparatus can be improved.

[Application Example 7]
In the image supply device according to Application Example 5 or Application Example 6, the selectable function includes a mirroring function for displaying the same screen as the screen displayed in the display area in another display area, and the display area. It includes at least one of a multi-screen function for dividing and displaying a displayed screen with another display area, and an editing function for editing the screen displayed in the display area. Image display control method.
According to this application example, the operability of the image supply apparatus can be improved by these functions.

[Application Example 8]
In the image supply device according to Application Example 7, when the editing function is executed, the image display control unit forms an editing screen for editing editing of the screen displayed in the display area. And displaying the image.
According to this application example, the screen can be easily edited.

  The present invention can be realized in various forms. For example, in addition to an image display control method, various forms such as an image supply device, an image display control program, a storage medium storing an image display control program, and the like. Can be realized.

It is explanatory drawing which shows schematic structure of the image supply system containing the image supply apparatus which concerns on a 1st Example. FIG. 3 is a functional block diagram schematically illustrating an internal configuration of the image supply apparatus according to the first embodiment. It is explanatory drawing which shows an example of a structure of the identification image management file F1. It is a functional block diagram which shows typically the internal structure of the image display apparatus used in a 1st Example. It is explanatory drawing which shows an example of a structure of the identification image management file F34. It is a flowchart which shows operation | movement of an image display apparatus. It is a flowchart which shows operation | movement of an image supply apparatus. It is a flowchart which shows operation | movement of an image supply apparatus. It is explanatory drawing which shows the screen displayed on the display for display 40 during acquiring projector information I33. 5 is an explanatory diagram showing a selection screen of the image display device 30. FIG. It is explanatory drawing which shows the whole image supply system at the time of image display apparatus selection. It is explanatory drawing which shows the state by which the image display apparatus was selected. It is explanatory drawing which shows an example of the correspondence of window storage area A1-A3 which stores the image data for a display, the storage area for projector supply, and SPJ1-SPJ3. It is explanatory drawing which shows an operation screen. It is explanatory drawing which shows the image display system at the time of selection completion. 5 is an explanatory diagram illustrating an example of an association operation between content and an image display device 30. FIG. 5 is an explanatory diagram illustrating an example of an association operation between content and an image display device 30. FIG. It is explanatory drawing which shows the image display system which is displaying the image on an image display apparatus. It is explanatory drawing which shows the image display system which is each displaying the window on the two image display apparatuses 30 (PJ1, PJ3). It is explanatory drawing which shows the operation screen in a 2nd Example. FIG. 21 is an explanatory diagram showing a state where a mirror icon 591 is selected on the operation screen shown in FIG. 20. 1 is an overall view of an image display system immediately after a drop screen 533 is dropped on a small screen 534. FIG. FIG. 21 is an explanatory diagram showing a state in which a multi-screen icon 592 is selected on the operation screen shown in FIG. 20. 1 is an overall view of an image display system immediately after a drop screen 533 is dropped on a small screen 534. FIG. FIG. 24 is an overall view of the image display system immediately after the drop screen 533 is dropped on the small screen 536 from the state shown in FIG. 23. It is explanatory drawing which shows an edit screen. It is explanatory drawing which shows the edit screen after switching. It is explanatory drawing which shows a modification. It is explanatory drawing which shows a modification.

  Hereinafter, an image supply system according to the present invention will be described based on examples with reference to the drawings.

First embodiment:
FIG. 1 is an explanatory diagram showing a schematic configuration of an image supply system including an image supply apparatus according to the first embodiment. The image supply system 10 includes an image supply device 20 and an image display device 30. The image supply system 10 is also referred to as an image display system 10, and the image supply apparatus 20 is also referred to as an image transfer apparatus. A plurality of image display devices 30 are connected to the image supply device 20. The image supply device 20 and the image display device 30 are connected via, for example, a wireless local area network (LAN).

・ Configuration of image supply device:
FIG. 2 is a functional block diagram schematically illustrating the internal configuration of the image supply apparatus according to the first embodiment. The image supply device 20 is a personal computer, for example, and is connected to an input device 41 such as a display 40 for display, a keyboard, and a mouse. The image supply apparatus 20 includes a central processing unit (CPU) 200, a random access memory (RAM) 210, a hard disk drive (HDD) 220, a drawing memory (VRAM) 230, and an input / output interface 240. The CPU 200, RAM 210, HDD 220, VRAM 230, and input / output interface 240 are connected via a common bus 250 so that bidirectional communication is possible.

  The CPU 200 is a logic circuit that executes various arithmetic processes. For example, the CPU 200 loads and executes various programs and modules stored in the HDD 220 in the RAM 210. The RAM 210 is a volatile memory, and temporarily stores calculation results of the CPU 200 and display image data to be supplied to the image display device 30. The VRAM 230 is a memory for expanding and temporarily buffering display image data drawn based on the data, and generally allows reading and writing of data at a higher speed than the RAM 210.

  The HDD 220 is a magnetic disk storage device that stores the image supply program P1 and the identification image management program P2. Note that a nonvolatile semiconductor memory may be provided instead of the HDD 220. The image supply program P1 stored in the HDD 220 includes a window selection module M1, a projector designation module M2, a storage control module M3, a display image data generation module M4, an image processing module M5, a communication control module M6, and a projector information acquisition module M7. And a connected projector management module M8 and a display control module M9. The identification image management program P2 includes an identification image management file F1 and an identification image file F2. Each module implements various functions by being executed by the CPU 200.

  The image supply program P1 is a program for supplying an image displayed on the display 40 connected to the image supply apparatus 20 to an external image output device. More specifically, the image supply program P1 in the present embodiment can supply a plurality of contents displayed on the display for display 40 to each image output device in units of contents. Here, the content is a display screen provided in application units, each document creation screen in word processor software, each presentation screen in presentation software, a playback screen for playing streamed video content, and still image editing Includes screens and display screens. The content also includes a so-called desktop screen displayed as the background of the display 40 for display. Note that these contents are also referred to as windows when Windows (registered trademark) is used as an operating system.

  The window selection module M1 is a module that is executed to select a desired window from a plurality of windows displayed on the display 40 for display. Specifically, the window selected from the plurality of windows by the operator via the input device 41 is specified. For example, by assigning a unique number to a window (open window) displayed on the display 40, each window can be identified and the selected window can be specified. Note that there may be one window displayed on the display 40 for display. In this case, the window selection module M1 specifies the window determined by the operator via the input device 41.

  The projector designation module M2 is a module for designating the image display device 30 that outputs the window selected by the window selection module M1.

  The storage control module M3 is a module for associating the selected window with the designated image display device 30 and storing them in the RAM 210 or the HDD 220. The storage control module M3 also depends on the number of windows at least part of which are displayed on the display 40, the number of image display devices 30 connected to the image supply device 20, and the maximum resolution of the display 40. Thus, a window storage area (content storage area) for storing window display image data and a projector supply storage area for storing image data to be sent to the image display device 30 are secured in advance on the RAM 210. It should be noted that at least one of a window storage area corresponding to the number of windows and a projector supply storage area corresponding to the number of image display devices 30 may be secured in the RAM 210 or the HDD 220.

  The display image data generation module M4 is a module for generating display image data for each window displayed on the display 40 for display. The display image data generation module M4 is a window that exists on the display 40 for display, in other words, a window that is hidden behind another window, and a part of the display image data generation module M4 protrudes from the display screen of the display 40 for display. The display image data can be generated for all the windows even for the windows that do not exist. In this process, for example, not only in the window being operated (active window) but also in other windows, display image data is once drawn on the VRAM 230 at the time of selection, and the drawn display image data is stored in the RAM 210. This is realized by storing in a predetermined position. In this case, whenever a window other than the active window is selected, the display of the other window can be updated by executing the drawing process for the other window. Alternatively, when the capacity of the VRAM 230 is large, display image data for a plurality of windows may be stored on the VRAM 230.

  The image processing module M5 is a module for executing various image processing on the display image data supplied to the image display device 30. Image processing executed by the image processing module M5 includes, for example, image processing such as resolution conversion processing, sharpness, luminance adjustment, and color balance. Further, in this embodiment, the image display apparatus 30 transmits the image to the image display device 30 in accordance with various operations on the layout display window displayed in the layout display area on the display 40, for example, movement and deformation (resizing). For changing the image data for display. Specifically, the projection position of the image projected by the image display device 30 is moved in response to the movement operation on the layout display window, and the image projected by the image display device 30 in response to the deformation operation on the layout display window. Deform.

  The communication control module M6 controls transmission of connection information to the image display device 30, connection establishment, and transmission of display image data, or the input / output interface 240 for receiving projector information I33 from the image display device 30. It is a module that controls

  The projector information acquisition module M7 is a module for acquiring projector information I33 (see FIG. 4) from the image display device 30. The projector information I33 includes, for example, the maximum resolution supported by the image display device 30, the color profile (eg, ICC profile) of the image display device 30, identification information for specifying the image display device 30, and other information of the image display device 30. Contains information about image playback characteristics.

  The connected projector management module M8 is a module for managing the number of image display devices 30 connected to the image supply device 20, that is, the attachment / detachment of the image display device 30 with respect to the image supply device 20.

  The display control module M9 is a module for displaying an image using display image data on the display 40 and displaying a layout display area and a layout display window in a predetermined area on the display 40. is there. The display control module M9 also changes the display of the layout display window based on an operation on the layout display window, for example, movement or deformation (resizing). The display control module M9 also changes the size of the window displayed on the display 40 when the operation on the layout display window is transformed (resized). Further, the display control module M9 displays a plurality of layout display areas for the layout display window of the window that protrudes from the display display 40, and includes a plurality of areas including the portion that protrudes from the display display 40 screen. It is displayed over the layout display area.

  The identification image management program P2 manages the association between the image display device 30 and the identification image using the identification image management file F1 and the identification image file F2. FIG. 3 is an explanatory diagram showing an example of the configuration of the identification image management file F1. The identification image management file F1 stores an association between an identification image and an identification color for each image display device 30. The identification image file F2 stores identification image data. In this embodiment, the identification image file F2 stores image data of “sunflower”, “apple”, “broccoli”, and “grape”, but any image can be used as long as it can be distinguished from other images. .

  The input / output interface 240 shown in FIG. 2 exchanges signals between the image supply device 20 and an external device, for example, the image display device 30, for example, wirelessly, and includes transmission / reception including, for example, an antenna and a switch for switching between transmission and reception. A part. By providing the transmission / reception unit, an antenna access point (AP) function or a station (STA) function for transmitting and receiving transmission / reception signals is realized. The input / output interface 240 also receives an input signal from the input device 41 such as a keyboard and a mouse, and outputs display image data to the display 40.

  The device determination / selection unit is realized using, for example, a projector designation module M2, a storage control module M3, a projector information acquisition module M7, a connected projector management module M8, a display control module M9, and an identification image management program P2. When the window and the image display device 30 are associated with each other, the window selection module M1 is also used as the device determination / selection unit. The image supply unit is realized using, for example, a display image data generation module M4, an image processing module M5, and a communication control module M6.

・ Configuration of image display device:
FIG. 4 is a functional block diagram schematically showing the internal configuration of the image display apparatus used in the first embodiment. The image display device 30 is, for example, a projector. As shown in FIG. 4, the image display device 30 includes a central processing unit (CPU) 300, a random access memory (RAM) 310, a nonvolatile memory (ROM) 320, a drawing memory (VRAM) 330, an image display unit 340, An optical system 350, an input / output interface 360, and an operation unit 380 are provided. The CPU 300, RAM 310, EPROM 320, VRAM 330, image display unit 340, input / output interface 360, and operation unit 380 are connected via a common bus 370 so that bidirectional communication is possible.

  The CPU 300 is a logic circuit that executes various arithmetic processes. For example, various programs and modules stored in the EPROM 320 are expanded on the RAM 310 and executed. The RAM 310 is a volatile memory and temporarily stores the calculation result of the CPU 300. The VRAM 330 is a memory for temporarily buffering drawing data drawn based on display image data.

  The EPROM 320 is a semiconductor memory that stores the projector information transmission module M31, the drawing module M32, the projector information I33, the identification image management file F34, and the identification image file F35. Instead of EPROM 320, a magnetic disk storage device may be used.

  The projector information transmission module M31 is a module for transmitting stored projector information to the image supply device 20. For example, when the connection between the image display apparatus 30 and the image supply apparatus 20 is established, the stored projector information I33 is acquired, and the projector information I33 is transmitted to the image supply apparatus 20 via the input / output interface 360. Send.

  The drawing module M <b> 32 analyzes the display image data received from the image supply device 20 via the input / output interface 360 and draws it on the VRAM 330. Specifically, the drawing module M32 analyzes the received display image data, acquires information such as the number of colors, size (vertical and horizontal), coordinates, and image format, and uses the acquired information on the VRAM 330. For example, pixel values are arranged by a bitmap method.

  FIG. 5 is an explanatory diagram showing an example of the configuration of the identification image management file F34. The identification image management file F34 stores a list of identification images and identification colors, and a flag indicating which identification image is used as a default identification image. The identification image file F35 stores identification image data. In this embodiment, the identification image file F35 stores image data of “sunflower”, “apple”, “broccoli”, and “grape”, and the image of “sunflower” is the default image. The default identification image is set to be different for each image display device 30. However, when the default identification image is duplicated, the default identification image is determined by an operation at the operation unit 380 or an instruction from the image supply device 20. It is possible to change the image.

  The image display unit 340 is used to generate an image for projection using the drawing data stored in the VRAM 330. The image display unit 340 may be of any type, for example, an image display unit that modulates light from an RGB light source using a liquid crystal panel, an image display that modulates using a digital micromirror device (DMD) or reflective liquid crystal. Or the like can be used.

  The optical system 350 includes a plurality of lenses, and is used to project an image generated by the image display unit 340 onto a projection surface with a desired size.

  The operation unit 380 is used when the image display device 30 is operated manually or when various settings are set / changed. Here, the various settings include, for example, settings of a network and which identification image is set as a default identification image.

・ Operation of the image display device:
FIG. 6 is a flowchart showing the operation of the image display apparatus. When the image supply program P1 of the image supply device 20 is activated, a request for projector information I33 is sent from the image supply device 20. In step S <b> 120, the CPU 300 transmits projector information I <b> 33 to the image supply device 20. Specifically, in each image display device 30, the CPU 300 executes the projector information transmission module M <b> 31, acquires the projector information I <b> 33 from the ROM 320, and transmits it to the image supply device 20. The projector information I33 includes information indicating which identification image the image display device 30 uses as a default identification image.

  In step S <b> 150, the CPU 300 projects an identification image on the screen 50 using the image display unit 340 and the optical system 350. As a result, the user can know which identification image corresponds to which image display device 30.

  In step S160, when display data is received from the image supply device 20, in step S170, the CPU 300 projects the display data on the screen using the image display unit 340 and the optical system 350. If no display data is sent from the image supply device 20 in step S180, the CPU 300 projects an identification image on the screen using the image display unit 340 and the optical system 350 in step S190.

Operation of the image supply device:
7 and 8 are flowcharts showing the operation of the image supply apparatus. When the image supply program P1 is started in step S210, in step S230, the CPU 200 receives the projector information I33 from the image display device 30, and uses each projector information I33 acquired from each image display device 30 to use each image display device 30. The maximum supported resolution, color profile, identification information, and other image reproduction characteristics are stored in the HDD 220 in association with each image display device 30. As described above, the projector information I33 includes information indicating which identification image the image display device 30 uses. In step S240, the CPU 200 determines whether or not the identification images sent from the different image display devices 30 are duplicated. If the identification images are duplicated, the CPU 200 displays to change the identification image in step S250. Display on the display 40.

  FIG. 9 is an explanatory diagram showing a screen displayed on the display 40 during acquisition of the projector information I33. In the projector information acquisition screen 500, an indicator 502 and a connection button 504 are displayed. When the projector information I33 is received from the image display device 30, the CPU 200 displays a selection screen for the image display device 30 in step S260.

  FIG. 10 is an explanatory diagram showing a selection screen of the image display device 30. The selection screen 510 displays selection fields 512 to 515 showing all the image display devices 30 that have received the projector information I33, a mouse cursor 524, and a connection button 504. The selection fields 512 to 515 are provided with an identification image display field 516, a device name display field 518, an IP address display field 520, and a radio wave intensity display field 522.

  FIG. 11 is an explanatory diagram showing an overall view of the image supply system when the image display device is selected. A selection screen 510 shown in FIG. 10 is displayed on the display 40 for display, and a projected image from each image display device 30 is displayed on the screen 50. Here, four identification images are displayed on the selection screen 510 corresponding to the four image display devices 30, whereas the screen 50 corresponds to the image display devices 30 of PJ1 to PJ3. Three identification images are displayed. This is because the selection screen 510 identifies all the image display devices 30 (PJ1 to PJ4) detected (received the projector information I33) including the image display devices 30 (PJ4) arranged in different conference rooms. This is because an image is displayed. The identification image displayed in the identification image display field 516 is the same image as the image projected from the corresponding image display device 30. Therefore, according to the present embodiment, since the user can select the image display device 30 using the identification image displayed in the identification image display field 516, the determination or selection of the image display device 30 is easy, and image supply is possible. The convenience of operation of the system 10 can be improved. In step S <b> 270, the CPU 200 detects selection of the image display device 30.

  FIG. 12 is an explanatory diagram showing a state in which the image display device is selected. In this figure, among the selection columns 512 to 515, the selection columns 512 to 514 are highlighted, and three image display devices 30 corresponding to these selection columns 512 to 514 are selected. The CPU 200 can detect the selection of the image display device 30 by detecting a click with the mouse cursor 524 on the selection fields 512 to 514. When the connection button 504 is clicked with the mouse cursor 524, the connection with the selected image display device 30 is completed.

  The CPU 200 executes the connected projector management module M8, specifies the number of image display devices 30 connected to the input / output interface 240, executes the storage control module M3, and executes the storage control module M3. A storage area for supplying projectors according to the number is secured on the RAM 210 or the HDD 220 (step S280). The CPU 200 executes the storage control module M3 to secure a window storage area corresponding to the number of windows on the RAM 210 (step S290).

  FIG. 13 is an explanatory diagram showing an example of the correspondence between the window storage areas A1 to A3 for storing display image data and the projector supply storage areas SPJ1 to SPJ3. In the example of FIG. 13, projector supply storage areas SPJ1 to SPJ3 are secured (assigned) to the image display device 30 (PJ1 to PJ3), respectively. The number of the image display devices 30 is specified by, for example, the CPU 200 detecting the number of wireless ports to which the image display device 30 is connected based on detection of connection establishment in wireless communication. Note that the storage areas for projector supply SPJ1 to SPJ3 and the window storage areas A1 to A3 for storing display image data do not necessarily have to be continuous. The projector supply storage areas SPJ1 to SPJ3 have a capacity corresponding to the resolution of the primary display (desktop screen) of the display 40 for display.

  For example, in Windows (registered trademark), each window is managed by a number called a handle, and is displayed (opened) on the display 40 by the CPU 200 executing the API function “EnumWindows”. ) You can get the handles of all windows. Therefore, the CPU 200 secures a plurality of window storage areas necessary for storing all the windows in the RAM 210 in accordance with the acquired number of handles. In addition, the capacity | capacitance according to the resolution of the desktop screen (primary display) of the display 40 is ensured as the capacity | capacitance of each window storage area.

  In step S300 of FIG. 8, the CPU 200 displays an operation screen 530. FIG. 14 is an explanatory diagram showing an operation screen. FIG. 15 is an explanatory diagram showing the image display system when selection is completed. As shown in FIG. 14, a small screen 532-536 and a desktop window 540 are displayed on the operation screen 530. The number of small screens 532 to 536 corresponds to the number of selected image display devices 30. The image displayed on the small screens 532 to 536 is the same image as the identification image projected by the image display device 30 as shown in FIG. 15. For example, the corresponding image from the identification image file F 2 is displayed on the small screen of the VRAM 230. Displayed by writing to addresses corresponding to 532-536. The desktop window 540 reduces and displays the entire desktop screen before starting the screen supply program P1.

  The CPU 200 executes the display image data generation module M4 to generate (capture) display image data for all windows displayed on the display 40. In the example of FIG. 14, two windows 545 and 550 are displayed in the desktop window 540. These two windows 545 and 550 can be said to be contents provided by the application. When a part of the window protrudes from the desktop window 540, the protruding part is not displayed on the desktop window 540, but display image data for the entire window including the protruding part is generated. Further, the protruding portion includes both a case where the position of the window is offset and a case where the entire window does not fit in the desktop window 540. In the former case, the generated display image data can be stored in one window storage area. In the latter case, the generated display image data is stored across a plurality of window storage areas. Is done.

  For example, when the operating system is Windows (registered trademark), display image data corresponding to all windows displayed on the display 40 is generated by forming a layered window. The CPU 200 uses the handle of each window acquired previously, and the layered setting API “WS_EX_LAYERED” is used for the current window style acquired by “GetWindowLong” and “GetWindowLong” which are API functions for acquiring the setting value of the current window. Each of the windows is formed into a layered window by sequentially executing an API function “SetWindowLong” for registering “OR” and an API function “SetLayeredWindowAttributes” for setting the layered parameter of the designated window. In each layered window, the entire window is captured, that is, display image data corresponding to the entire window is generated.

  The display image data generation module M4 generates display image data by expanding (drawing) display image data based on application data corresponding to each window. Each of the generated display image data is sequentially stored in the window storage area previously secured on the RAM 210. In the example of FIG. 13, display image data for the desktop window 540 is stored in the first window storage area A1, and display image data for the windows 550 and 545 are stored in the second and third window storage areas A2 and A3, respectively. ing. In this embodiment, the storage control module M3 manages the window storage areas A1 to A3 using the coordinates (X, Y). For example, a window (display image data for display) on the display screen of the display 40 for display. ) Is managed with reference to the upper left coordinates. In addition, the projection position of the image with respect to the projection frame when projected corresponds to the storage position of the display image data stored in each window storage area, and by specifying the coordinates in each window storage area, The position of the projected image can be specified. Each pixel data constituting the display image data can also be specified using coordinates applied to the window storage area.

  In step S310, the CPU 200 detects selection of content, and in step S320, the CPU 200 executes the projector designation module M2 and detects selection of the image display device 30 that is the content supply destination.

  16 and 17 are explanatory diagrams illustrating an example of the operation of associating the content with the image display device 30. FIG. When the mouse cursor 524 is clicked on the title bar 547 of the window 545, the window 545 is selected, and as shown in FIG. 16, arrows 570 for the small screens 532-536 corresponding to the displayable image display device 30 are displayed. Is displayed. As shown in FIG. 17, when the mouse cursor 524 is dragged and dropped onto the previous small screen indicated by the arrow 570, for example, the small screen 532, the CPU 200 executes the storage control module M <b> 3 to execute the window 545 and the small screen 532. Is associated with the image display device 30 corresponding to. Specifically, the CPU 200 executes the storage control module M3, stores a window storage area for storing display image data corresponding to the selected window, a projector supply storage area corresponding to the designated image display device, Is associated.

  In step S330, the CPU 200 sends the contents of the selected window 545 to the selected image display device 30. Specifically, the CPU 200 executes the storage control module M3 to supply projector image data, which is a storage area for supplying the display image data of the window 545 stored in the window storage area to the image display device 30 (PJ1). Copy or move to a storage area. The association between each image display device 30 (PJ1 to PJ3) and each storage area is, for example, the port number to which each image display device 30 (PJ1 to PJ3) is connected, or each image display device 30 (PJ1). To PJ3) can be realized by associating the MAC address of the communication control module with coordinate information defining each storage area.

  When the association between the selected window and the designated image display device is completed, the CPU 200 executes the image processing module M5 and performs image processing on display image data as necessary. In the present embodiment, image processing for display image data is executed on each projector supply storage area, SPJ1 to SPJ3. In the image processing, for example, resolution conversion processing, image quality adjustment processing such as sharpness, luminance adjustment, and color balance, and display image data composition processing using the projector information I33 are executed. When it is requested to project a plurality of windows onto one image display device 30 by the synthesis process, display image data according to the image displayed on the display 40 is displayed on the image display device 30. Can be supplied.

  The CPU 200 further executes the communication control module M6, and each image display device 30 (PJ1) corresponding to the image data for display stored in each of the projector supply storage areas SPJ1 to SPJ3 subjected to image processing. To PJ3). Note that after the association between the window and the image display device 30 is completed, generation of window display image data on the display 40 for display and transmission of display image data to each of the image display devices 30 (PJ1 to PJ3). Are repeatedly executed at a predetermined timing. Alternatively, when the content is content that does not involve time transition, generation of display image data of the corresponding window and display on each image display device 30 (PJ1 to PJ3) at the timing when the window becomes active. The image data may be transmitted. Thereby, even after the window and the image display device 30 are associated with each other, it is possible to always project an image corresponding to the latest window.

  FIG. 18 is an explanatory diagram showing an image display system displaying an image on the image display device. The contents (FIG. 14) displayed in the window 545 are displayed on the small screen 532 and the projection screen of the image display device 30 (PJ1). Note that identification images are displayed on the projection screens of the small screens 534 and 536 and the image display device 30 (PJ2, PJ3).

  FIG. 19 is an explanatory diagram showing an image display system displaying windows on two image display devices 30 (PJ1, PJ3). The content displayed in the window 545 (FIG. 14) is displayed on the small screen 532 and the projection screen of the image display device 30 (PJ1), and the content displayed in the window 550 is the small screen 536 and the image display device 30. (PJ3) is displayed on the projection screen. As described above, it is also possible to supply images of a plurality of windows to a plurality of image display devices 30.

  As described above, according to the present embodiment, since the image display device 30 can be selected using the identification image, the determination or selection of the image display device 30 is facilitated, and the operation of the image supply system 10 is convenient. It becomes possible to improve the nature. The identification image displayed on the image display device 30 and the identification image displayed on the display 40 of the image supply device 20 are preferably the same image, but may be different as long as they are corresponding images. Good.

  Also, the timing (FIGS. 10 to 12) for determining / selecting the supply destination image display device that supplies the image to be displayed, and the image that actually supplies the image from the selected supply destination image display device It is only necessary to be able to determine / select an image display device using an identification image at least one of timings (FIGS. 14 to 17) for selecting a supply device.

  In the present embodiment, when the identification images corresponding to the image display device 30 overlap, the image supply device 20 changes the identification image corresponding to the image display device 30, so that the identification images do not overlap.

  In the present embodiment, the small screens 532 to 536 are arranged so that a one-to-one correspondence is visually recognized between the display image displayed by the image display device 30 and the small screens 532 to 536. Therefore, the appearance of the projected image of the image display apparatus can be assumed from the appearance of the small screens 532 to 536, and the convenience of operation of the image supply apparatus 20 can be improved.

  Furthermore, in this embodiment, the CPU 200 displays the desktop window 540, so that it is easy to select an image to be supplied to the image display device using the window in the desktop window 540. As a result, the convenience of operation of the image supply device 20 can be improved.

  In this embodiment, the positions of the small screens 532 to 536 are arranged so that a one-to-one correspondence between the display image displayed by the image display device 30 and the small screens 532 to 536 is visually recognized. However, when the position of the display image displayed by the image display device 30 changes, for example, the position and size may be changed by a user operation, for example, a drag operation.

Second embodiment:
FIG. 20 is an explanatory diagram showing an operation screen in the second embodiment. Four function icons 591 to 594 are displayed at the four corners of the small screen 532 of the operation screen 530. These function icons 591 to 594 are used to realize a mirroring function, a multi-screen function, an editing function, and a function for stopping image transmission to the image display device 30, respectively. Hereinafter, the function icons 591 to 594 are also referred to as “mirror icon 591”, “multi-screen icon 592”, “edit icon 593”, and “transmission stop icon 594”, respectively. Here, the mirroring function means a function for displaying the same window on two or more image display devices 30, and the multi-screen function means that one window is divided and displayed by two or more projectors. These function icons 591 to 594 are displayed at the four corners of the small screen 532 when the small screen 532 is selected by the mouse cursor 524. Here, for example, when the small screen 532 is clicked with the mouse cursor 524, the CPU 200 detects that the small screen 532 is selected. Note that the function icons 591 to 594 may be displayed when it is detected that the mouse cursor 524 has simply moved onto the small screen 532 without depending on the mouse cursor 524 being clicked.

  FIG. 21 is an explanatory diagram showing a state where the mirror icon 591 is selected on the operation screen shown in FIG. For example, when the mirror icon 591 is clicked with the mouse cursor 524, the mirror icon 591 is selected. When the mirror icon 591 is selected, a drop screen 533 and an arrow 570 are displayed on the operation screen 530. At this time, a mirror icon 595 is displayed on a small screen (small screens 534 and 536 in this embodiment) that can be selected as a drop destination. The drop screen 533 is the same screen as the small screen 532, but is displayed in a lighter color than the small screen 532, for example, in order to let the user know that it is the drop screen 533. An arrow 570 and a mirror icon 595 are used to indicate a small screen that can be selected as a drop destination of the drop screen 533 and a function realized by the drop. This screen indicates that the drop screen 533 can be dropped onto the small screens 534 and 536, and that the mirror screen is displayed by the drop.

  FIG. 22 is an overall view of the image display system immediately after the drop screen 533 is dropped on the small screen 534. The same window 545 (FIG. 8) is displayed on the small screen 532 and the small screen 534, and the contents of the window 545 are displayed on the image display devices 30 of SPJ1 and SPJ2. A one-to-one correspondence is visually recognized between the display image displayed by the image display device 30 and the small screens 532 to 536.

  FIG. 23 is an explanatory diagram showing a state where the multi-screen icon 592 is selected on the operation screen shown in FIG. Here, a multi-screen icon 596 is displayed on the small screens 534 and 536 instead of the mirror icon 595.

  FIG. 24 is an overall view of the image display system immediately after the drop screen 533 is dropped on the small screen 534. The window 545 is divided into left and right parts, the left half of the window 545 (FIG. 14) is displayed on the small screen 532, and the right half is displayed on the small screen 534. Further, the left half of the window 545 is displayed on SPJ1, and the right half is displayed on SPJ2. Even in this case, a one-to-one correspondence is visually recognized between the display image displayed by the image display device 30 and the small screens 532 to 536. Depending on the size of the window 545, the screen displayed on the small screen 534 or the image display device 30 (SPJ2) may be an image of a portion hidden on the right side of the window 545.

  FIG. 25 is an overall view of the image display system immediately after the drop screen 533 is dropped on the small screen 536 from the state shown in FIG. In this case, the screen of the window 545 is divided into three and displayed on each of the small screens 532 to 536 and each of SPJ1 to SPJ3.

  FIG. 26 is an explanatory diagram showing an edit screen. For example, in FIG. 20, when the edit icon 593 is selected, an edit screen 600 in which the content of the small screen 532 is expanded to the entire size of the display 40 is displayed. On the editing screen 600, a return icon 602, a transmission stop icon 604, and a program stop icon 606 are displayed. A return icon 602 is used to return the edit screen 600 to the operation screen 530. The transmission stop icon 604 is used to stop the transfer of the image to the image display device 30. The program stop icon 606 is used to stop the execution of the image supply program P1. Further, when detecting that the mouse cursor 524 is moved to the end of the screen (right end in this embodiment), the CPU 200 displays an arrow 608. In this state, when detecting that the arrow 608 is clicked by the mouse cursor 524, the CPU 200 switches the screen displayed on the editing screen 600 to the content of the small screen 536. FIG. 27 is an explanatory diagram showing an editing screen after switching. When detecting that the mouse cursor 524 has been moved to the end of the screen (the left end in this embodiment), the CPU 200 displays an arrow 610 for returning to editing the small screen 534. The scroll bar slider may be displayed instead of the arrows 608 and 610, and the content displayed on the editing screen 600 may be moved by moving the scroll bar slider.

  In the edit screen 600, the CPU 200 allows the user to modify / change the content content. Since the editing screen 600 is larger than the small screens 532 to 536, editing is easy and the convenience of operation of the image supply device 20 can be improved.

  As described above, according to the second embodiment, various functions such as the mirroring function, the multi-screen function, and the editing function are realized, so that the convenience of the image supply apparatus can be improved. In the second embodiment, the operable functions are visually displayed and selected, so that the convenience of the image supply device 20 can be improved.

Variations:
FIG. 28 is an explanatory diagram showing a modification. In the above-described embodiment, since the projection screens of the image display device 30 are horizontally arranged, the CPU 200 displays the small screens 532 to 536 horizontally, but depending on how the projection screens are arranged, the small screens 532 to 536 are displayed. You may change the way of arranging. For example, when the projection image of the image display device 30 is arranged in a 2 × 2 grid pattern, the CPU 200 may arrange the small screens 532 to 538 in a 2 × 2 grid pattern. In general, when the projection image of the image display device 30 is arranged in an n × m grid pattern, the CPU 200 may arrange the small screens in an n × m grid pattern.

  FIG. 29 is an explanatory diagram showing another modification. When the size of the image projected by the image display device 30 is different, the size of the small screen may be changed according to the size. As shown in FIG. 29, when the size of the image displayed by the image display device 30 (PJ2) is larger than the size of the image displayed by the image display device 30 (PJ1, PJ3), the CPU 200 displays the small screen 534. The size of the small screens 532 and 536 may be displayed small.

  The embodiments of the present invention have been described above based on some examples. However, the above-described embodiments of the present invention are for facilitating the understanding of the present invention and limit the present invention. It is not a thing. The present invention can be changed and improved without departing from the spirit and scope of the claims, and it is needless to say that the present invention includes equivalents thereof.

    DESCRIPTION OF SYMBOLS 10 ... Image display system, 20 ... Image supply apparatus, 30 ... Image display apparatus, 40 ... Display for display, 41 ... Input device, 50 ... Screen, 200 ... CPU, 210 ... RAM, 220 ... Hard disk, 230 ... VRAM, 240 ... I / O interface, 250 ... Bus, 300 ... CPU, 310 ... RAM, 320 ... ROM, 330 ... VRAM, 340 ... Image display unit, 350 ... Optical system, 360 ... I / O interface, 370 ... Bus, 380 ... Operation unit , 500 ... Projector information acquisition screen, 502 ... Indicator, 504 ... Connect button, 510 ... Selection screen, 512 to 515 ... Selection field, 516 ... Identification image display field, 518 ... Device name display field, 520 ... IP address display field, 522 ... Radio field intensity display field, 524 ... Mouse cursor, 530 ... Operation screen, 32 to 536 ... small screen, 533 ... drop screen, 540 ... desktop window, 545 ... window, 547 ... title bar, 550 ... window, 570 ... arrow, 591, 595 ... mirror icon, 592, 596 ... multi-screen icon, 593 ... Edit icon, 594 ... Transmission stop icon, 600 ... Edit screen, 602 ... Return icon, 604 ... Transmission stop icon, 606 ... Program stop icon, 608 ... Arrow, 610 ... Arrow, A1-A3 ... Window storage area, F1 ... Identification image management file, F2 ... identification image file, F34 ... identification image management file, F35 ... identification image file, I33 ... projector information, M1 ... window selection module, M2 ... projector designation module, M3 ... storage control module, M4 ... display for Image data generation module, M5 ... image processing module, M6 ... communication control module, M7 ... projector information acquisition module, M8 ... connected projector management module, M9 ... display control module, M31 ... projector information transmission module, M32 ... drawing module, P1 ... Image transfer program, P2 ... Identification image management program, SPJ1 to SPJ3 ... Projector supply storage area

Claims (5)

An image supply device that supplies images to N (N is an integer of 2 or more) image display devices,
A display unit;
N display areas are formed in the display unit, and a one-to-one correspondence is visually recognized between the N display images displayed by the image display device and the N display areas. An image display control unit for arranging the N display areas in the display unit,
An image supply unit that supplies the image displayed in each display area to the corresponding image display device;
With
When one display area is selected by the user, the image display control unit displays a selection unit for selecting a function operable on a screen displayed in the selected display area ,
The selectable function includes a mirroring function for displaying the same screen as the screen displayed in the display area in another display area, and dividing the screen displayed in the display area into another display area. An image supply apparatus comprising at least one of a multi-screen function for displaying and an editing function for editing the contents of a screen displayed in the display area . The image supply device according to claim 1.
The image display control unit displays a cursor for allowing the user to select the display area. When the cursor is moved on the display area by the user, the image display control unit displays the cursor displayed on the display area. An image supply apparatus that displays a selection means for selecting a function that can be operated by the user. The image supply apparatus according to claim 1 or 2 ,
When the edit function is executed, the selectable function is displayed by forming the edit screen for editing the contents of the screen displayed in the display area. An image supply apparatus. An image display control program in an image supply device that supplies images to N (N is an integer of 2 or more) image display devices,
(A) N display areas corresponding to the N image display devices are formed in a display unit different from the image display device, and the N display images displayed by the image supply device and the N display images are displayed. A function of arranging the N display areas in the display unit so that a one-to-one correspondence with the display area is visually recognized;
(B) a function of supplying an image displayed in each display area to the corresponding image display device;
(C) a function of causing the user to select one of the N display areas;
(D) a function for displaying a selection means for selecting a function operable on the screen displayed in the selected display area;
Is realized on a computer ,
The selectable function includes a mirroring function for displaying the same screen as the screen displayed in the display area in another display area, and dividing the screen displayed in the display area into another display area. multi-screen function, the image display control program wherein among the editing function to edit the contents of the screen displayed in the display area includes at least one, you and displaying.   An image display control method in an image supply device for supplying images to N (N is an integer of 2 or more) image display devices,
(A) N display areas corresponding to the N image display devices are formed in a display unit different from the image display device, and the N display images displayed by the image supply device and the N display images are displayed. The N display areas are arranged in the display unit so that a one-to-one correspondence with the display area is visually recognized,
(B) supplying the image displayed in each display area to the corresponding image display device;
(C) causing the user to select one of the N display areas,
(D) displaying a selection means for selecting an operable function for the screen displayed in the selected display area;
  The selectable function includes a mirroring function for displaying the same screen as the screen displayed in the display area in another display area, and dividing the screen displayed in the display area into another display area. An image display control method comprising at least one of a multi-screen function for displaying and an editing function for editing the contents of a screen displayed in the display area.

Images