JP2017223743A - Information processing device, display device, information processing system, information processing program, and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable state operation to a display device by operation in a multi-projection system.SOLUTION: An information processing device causes a plurality of display devices to display images corresponding to contents of processing executed by the plurality of display devices, and causes the display devices to execute the processing according to operation with respect to the displayed images. The information processing device includes: an image display control part which causes the display devices to display the images; an operation position recognition part which recognizes positions of the operation performed to display surfaces on which the display devices display the images; a device identification part which identifies the display devices displaying the operated images on the basis of the recognized positions; an image identification part which identifies the operated images on the basis of the recognized positions; a processing content determination part which determines the contents of the processing corresponding to the identified images; and a processing execution control part which causes the identified display devices to execute the processing whose contents is determined.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an information processing device, a display device, an information processing system, an information processing program, and an information processing method.

  In recent years, a multi-projection system is known in which a plurality of display devices such as projectors are arranged side by side and a single whole image is projected in a pseudo manner (see, for example, Patent Document 1). There is also known an interactive system that enables an interactive operation such that when a user writes an image on a projection image by a display device such as a projector, the written image is reproduced on the original image.

  However, in the interactive operation in the conventional multi-projection system, even though the image written on the projection image by the user can be reproduced on the original image, for example, a display device for power-off operation, voice operation, image adjustment operation, etc. This state operation cannot be performed. This is not limited to an operation called an interactive operation, and is a problem that occurs in various operations.

  The present invention has been made to solve such a problem, and an object of the present invention is to enable a state operation on a display device by an operation in a multi-projection system.

  In order to solve the above problems, according to one embodiment of the present invention, an image corresponding to the content of processing executed by a display device is displayed on a plurality of the display devices, and the display is performed according to an operation on the displayed image. An information processing apparatus that causes the apparatus to execute the process, and an image display control unit that displays the image on the display apparatus, and a position of an operation performed on a display surface on which the display apparatus displays the image. An operation position recognition unit for recognizing, a device identification unit for identifying a display device displaying the operated image based on the recognized position, and the image operated based on the recognized position. An image identification unit to be identified, a process content determination unit that determines the content of the process according to the identified image, and a process execution control unit that causes the identified display device to execute the process for which the content has been determined When Characterized in that it comprises a.

  ADVANTAGE OF THE INVENTION According to this invention, the state operation to a display apparatus by operation in a multi-projection system can be enabled.

It is a figure which shows the operation | use form of the multi-projection system which concerns on embodiment of this invention. It is a block diagram which shows typically the hardware constitutions of the projection control apparatus which concerns on embodiment of this invention. It is a block diagram which shows typically the hardware constitutions of the projector which concerns on embodiment of this invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the icon image data management table which concerns on embodiment of this invention. It is a figure which shows an example of the icon image projection position management table which concerns on embodiment of this invention. It is a figure which shows an example of the projection area | region management table which concerns on embodiment of this invention. It is a figure which shows the projection area | region to the projection surface by the projector which concerns on embodiment of this invention. It is a figure which shows an example of the operation content management table which concerns on embodiment of this invention. It is a block diagram which shows typically the function structure of the projector which concerns on embodiment of this invention. FIG. 11 is a sequence diagram for explaining processing when an interactive operation is performed in the multi-projection system according to the embodiment of the present invention. It is a figure which shows the mode at the time of moving the projected icon image by interactive operation in the multi-projection system which concerns on embodiment of this invention. It is a figure which shows the mode at the time of moving the projected icon image by interactive operation in the multi-projection system which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when moving a projected icon image by an interactive operation in the multi-projection system according to the embodiment of the present invention. FIG. 10 is a sequence diagram for explaining processing when moving a projected icon image by an interactive operation in the multi-projection system according to the embodiment of the present invention. FIG. 10 is a sequence diagram for explaining processing when moving a projected icon image by an interactive operation in the multi-projection system according to the embodiment of the present invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the model-specific projectable icon image management table which concerns on embodiment of this invention. In the multi-projection system which concerns on embodiment of this invention, it is a figure which shows a mode when the icon image according to the model is projected on each projector. FIG. 10 is a sequence diagram for explaining processing when the projection control apparatus 1 determines an icon image to be projected according to the projector model in the multi-projection system according to the embodiment of the present invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the projectable icon image management table classified by state which concerns on embodiment of this invention. In the multi-projection system which concerns on embodiment of this invention, it is a figure which shows a mode when the icon image according to the state is projected on each projector. In the multi-projection system which concerns on embodiment of this invention, it is a figure which shows a mode when the icon image according to the state is projected on each projector. FIG. 7 is a sequence diagram for explaining processing when the projection control apparatus 1 determines an icon image to be projected according to the state of the projector in the multi-projection system according to the embodiment of the present invention. FIG. 7 is a sequence diagram for explaining processing when the projection control apparatus 1 determines an icon image to be projected according to the state of the projector in the multi-projection system according to the embodiment of the present invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the operation classification management table classified by model which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when an interactive operation of an icon image is performed in the multi-projection system according to the embodiment of the present invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the operation classification management table classified by model which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when an interactive operation of an icon image is performed in the multi-projection system according to the embodiment of the present invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the operation content transmission destination management table which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when an interactive operation of an icon image is performed in the multi-projection system according to the embodiment of the present invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the operation content transmission destination management table according to state which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when an interactive operation of an icon image is performed in the multi-projection system according to the embodiment of the present invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the operation classification transmission destination management table according to model which concerns on embodiment of this invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the interlocking operation management table which concerns on embodiment of this invention. It is a figure which shows a mode when the icon image is interactively operated in the multiprojection system which concerns on embodiment of this invention. It is a figure which shows a mode when the icon image is interactively operated in the multiprojection system which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when an icon image is interactively operated in the multi-projection system according to the embodiment of the present invention. It is a figure which shows a mode when the icon image is interactively operated in the multiprojection system which concerns on embodiment of this invention. It is a figure which shows a mode when the icon image is interactively operated in the multiprojection system which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when an icon image is interactively operated in the multi-projection system according to the embodiment of the present invention. It is a figure which shows a mode when the icon image is interactively operated in the multiprojection system which concerns on embodiment of this invention. It is a figure which shows a mode when the icon image is interactively operated in the multiprojection system which concerns on embodiment of this invention. In the multi-projection system which concerns on embodiment of this invention, it is a figure which shows a mode when a user touches the area | region where the icon image of a projection surface is not projected using an interactive pen. In the multi-projection system which concerns on embodiment of this invention, it is a figure which shows a mode when a user touches the area | region where the icon image of a projection surface is not projected using an interactive pen. In the multi-projection system which concerns on embodiment of this invention, it is a sequence diagram for demonstrating the process when a user touches the area | region where the icon image of a projection surface is not projected. It is a figure which shows the operation | use form of the multi-projection system which concerns on embodiment of this invention. It is a figure which shows the operation | use form of the multi-projection system which concerns on embodiment of this invention. It is a block diagram which shows typically the hardware constitutions of the projection control apparatus which concerns on embodiment of this invention. It is a block diagram which shows typically the function structure of the projection control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the projection area identification image which the projection control apparatus which concerns on embodiment of this invention makes a projector project. It is a sequence diagram for demonstrating the process at the time of the projection control apparatus concerning embodiment of this invention producing a projection area management table. It is a figure which shows the mode at the time of moving the projected icon image by interactive operation in the multi-projection system which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when moving a projected icon image by an interactive operation in the multi-projection system according to the embodiment of the present invention. It is a figure which shows a mode at the time of enlarging the icon image currently projected by interactive operation in the multi-projection system which concerns on embodiment of this invention. FIG. 11 is a sequence diagram for explaining processing when enlarging a projected icon image by interactive operation in the multi-projection system according to the embodiment of the present invention. It is a figure which shows the mode at the time of moving the projected icon image by interactive operation in the multi-projection system which concerns on embodiment of this invention. FIG. 10 is a sequence diagram for explaining processing when moving a projected icon image by an interactive operation in the multi-projection system according to the embodiment of the present invention. FIG. 10 is a sequence diagram for explaining processing when moving a projected icon image by an interactive operation in the multi-projection system according to the embodiment of the present invention.

Embodiment 1 FIG.
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In this embodiment, as an example of the information processing system, a multi-projection system in which a plurality of projectors that are display devices are arranged side by side and a single whole image is projected in a pseudo manner will be described.

  In addition, the multi-projection system according to the present embodiment is configured so that an interactive operation can be performed such that when a user writes an image on a projected image by a projector, the written image is reproduced on the original image. Yes.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is to extend the projector function by performing projector state operations such as power-off operation, voice operation, and image adjustment operation by interactive operation. It is possible to carry out with a simple configuration.

  First, an operation mode of the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an operation mode of a multi-projection system according to the present embodiment.

  As shown in FIG. 1, the multi-projection system according to this embodiment is configured by connecting a projection control device 1, projectors 2a, 2b, 2c, and a PC (Personal Computer) 3.

  Hereinafter, when it is not necessary to distinguish the projectors 2a, 2b, and 2c, they are collectively referred to as the projector 2. In the present embodiment, a multi-projection system in which three projectors 2 are connected will be described. However, the number of projectors is not limited to three, and the same configuration (a configuration in which a plurality of projectors are connected). ), It can be applied to the same system configuration even if it is not called multi-projection.

  The projection control device 1, the projector 2, and the PC 3 are, for example, USB (Universal Serial Bus), Bluetooth (registered trademark), Wi-Fi (Wireless Fidelity) (registered trademark), FeliCa (registered trademark), IrDA (Infrared Data Association), respectively. ) (Registered trademark), Ethernet (registered trademark), PCIe (Peripheral Component Interconnect Express), VGA (Video Graphics Array), DVI (Digital Visual Interface) and the like. Are connected by an interface.

  The PC 3 inputs image data to the projector 2. The projector 2 projects an image on a projection surface 5 (display surface) such as a wall or a screen based on image data input from the outside or image data stored by itself. In the multi-projection system according to the present embodiment, the projectors 2a, 2b, and 2c are configured to project one whole image in a pseudo manner using these three projectors. In the following, it is assumed that areas where the projectors 2a, 2b, and 2c project images onto the projection surface 5 are 5a, 5b, and 5c, respectively.

  As shown in FIG. 1, in the multi-projection system according to the present embodiment, the interactive pen 4 which is a tool for the user to perform an interactive operation on the projection image on the projection surface 5 by the projector 2 is provided. It has been.

  The projection control device 1 (information processing device) reads a state of an operation (hereinafter referred to as “interactive operation”) performed on the projection image of the interactive pen 4 by the user, and uses the image data of the written image by the interactive operation as a projector. 2 or PC 3 and the written image is reproduced on the original image. In the present embodiment, the case where the interactive pen 4 is used will be described for the sake of convenience of explanation. However, the present invention is not limited to the form of a name or pen, and an operation such as a finger of a user who is an operator can be detected. Any of the known methods can be applied.

  In addition, the projection control apparatus 1 transmits image data of the icon image 6 for the user to perform the state operation of the projector 2 by interactive operation, causes the image data to be projected to the projector 2, and the state corresponding to the interactive operation on the icon image 6 The corresponding projector 2 is caused to perform the operation. Here, the state operation is a state operation of the projector 2 such as a power OFF operation, a voice operation, an image adjustment operation, or the like.

  Next, the hardware configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram schematically showing a hardware configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 2, the projection control apparatus 1 according to this embodiment includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, an NVRAM (Non Volatile Random Access Memory). 14, an operation display device 15, a communication I / F 16, and an imaging device 17 are connected via a bus 18.

  The CPU 11 is a calculation unit and controls the operation of the projection control apparatus 1 as a whole. The RAM 12 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 11 processes information. The ROM 13 is a read-only nonvolatile storage medium, and stores programs such as firmware.

  The NVRAM 14 is a non-volatile storage medium that can read and write information, and stores various data such as image data, various programs such as an OS (Operating System), various control programs, and application programs.

  The operation display device 15 is a user interface for inputting information to the projection control device 1, and is realized by an input device such as a keyboard, a mouse, a button, or a touch panel. The operation display device 15 is a visual user interface for the user to check the state of the projection control device 1, and is realized by a display device such as an LCD (Liquid Crystal Display). The communication I / F 16 is an interface for the projection control apparatus 1 to communicate with other apparatuses.

  The imaging device 17 is a device capable of recognizing depth information, and is an input interface for optically imaging and reading a state of an interactive operation on a projection image using the interactive pen 4, such as a camera or a sensor. Realized by an input device.

  In such a hardware configuration, for example, a program stored in a storage medium such as the ROM 13 or the NVRAM 14 is read out to the RAM 12 or the like, and the CPU 11 performs an operation according to the program loaded in the RAM 12 or the like, whereby the software control unit Composed. A functional block that realizes the function of the projection control apparatus 1 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.

  Next, the hardware configuration of the projector 2 according to the present embodiment will be described with reference to FIG. FIG. 3 is a block diagram schematically showing a hardware configuration of the projector 2 according to the present embodiment.

  As shown in FIG. 3, the projector 2 according to the present embodiment includes a CPU 21, a RAM 22, a ROM (Read Only Memory) 23, an NVRAM 24, an operation display device 25, a communication I / F 26, and an image projection device 27 via a bus 28. Connected and configured.

  The CPU 21 is a calculation means and controls the operation of the entire projector 2. The RAM 22 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 21 processes information, for example. The ROM 23 is a read-only nonvolatile storage medium, and stores programs such as firmware.

  The NVRAM 24 is a non-volatile storage medium capable of reading and writing information, and stores various data such as image data, and various programs such as an OS, various control programs, and application programs. In the present embodiment, an example in which various programs are stored in the NVRAM 24 has been shown. However, the present invention can also be applied to a form in which the program is stored in a storage medium such as the RAM 22 or the ROM 23. More specifically, an HDD (Hard Disc Drive), The present invention can also be realized by using an external storage medium (CD-ROM, SD, USB, etc.) connected to the projector.

  The operation display device 25 is a user interface for inputting information to the projector 2, and is realized by an input device such as a keyboard, a mouse, a button, or a touch panel. The operation display device 25 is a visual user interface for the user to check the state of the projector 2, and is realized by a display device such as an LCD.

  The communication I / F 26 is an interface for the projector 2 to communicate with other devices.

  The image projection device 27 modulates the light beam emitted from the light source to form a projection image, and magnifies and displays the formed projection image on the projection surface 5 such as a wall or a screen.

  In such a hardware configuration, for example, a program stored in a storage medium such as the ROM 23 or the NVRAM 24 is read out to the RAM 22 or the like, and the CPU 21 performs an operation according to the program loaded in the RAM 22 or the like. Composed. A functional block that realizes the function of the projector 2 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.

  Next, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 4 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 4, the projection control apparatus 1 according to the present embodiment includes an icon image storage unit 101, an icon image projection position storage unit 102, an icon image projection control unit 103, an interactive operation recognition unit 104, and a projection area storage unit 105. An operation target device identification unit 106, an operation icon image identification unit 107, an operation content storage unit 108, an operation content determination unit 109, and a communication unit 110.

  The icon image storage unit 101 stores image data of the icon image 6 (hereinafter referred to as “icon image data”) to be projected on the projector 2.

  In the present embodiment, as shown in FIG. 5, such information includes an icon in which an icon image identification ID for identifying each icon image 6 and a storage location of the icon image data are associated with each other. It is managed by an image data management table. FIG. 5 is a diagram showing an example of an icon image data management table according to the present embodiment.

  The icon image projection position storage unit 102 stores the projection position of the icon image 6 by the projector 2 (hereinafter referred to as “icon image projection position”).

  In the present embodiment, as shown in FIG. 6, such information includes an icon image projection position in which each icon image identification ID is associated with the projection position of the icon image specified by the icon image identification ID. It is stored as a management table. FIG. 6 is a diagram showing an example of an icon image projection position management table according to the present embodiment.

  The icon image projection control unit 103 (image display control unit, process execution control unit, process execution availability determination unit) refers to the icon image projection position management table (FIG. 6), and the icon image to be projected on each projector 2. The icon image data is read from the icon image storage unit 101 with reference to the icon image data management table (FIG. 5). Then, the icon image projection control unit 103 refers to the icon image projection position management table (FIG. 6), grasps the projection position of the icon image 6 based on the read icon image data, and displays the icon image data and the projection. The position is input to the corresponding projector 2 via the communication unit 110.

  An interactive operation recognition unit 104 (an operation position recognition unit, a movement operation recognition unit, and a size change operation recognition unit) recognizes an interactive operation on a projection image using the interactive pen 4, and the interactive operation is performed at any position on the projection plane 5. Recognize whether the operation is interactive.

  The projection area storage unit 105 stores a projection area on the projection plane 5 by each projector 2. In the present embodiment, as shown in FIG. 7, such information includes a device identification ID for identifying each projector 2, an IP address of the projector 2, and a projection onto the projection plane 5 by the projector 2. It is stored as a projection area management table in which area coordinates are associated. FIG. 7 is a diagram showing an example of a projection area management table according to the present embodiment.

  FIG. 8 shows a projection area on the projection plane 5 by each projector 2 as described above. FIG. 8 is a diagram showing a projection area onto the projection plane 5 by the projector 2 according to the present embodiment. 7 and 8, the device identification ID of the projector 2a is device_a, the device identification ID of the projector 2b is device_b, and the device identification ID of the projector 2c is device_c.

  The operation target device identification unit 106 (device identification unit) refers to the projection region management table (FIG. 7) when the interactive operation is recognized by the interactive operation recognition unit 104, which interactive operation to which projector 2 is performed. To identify.

  The operation icon image identification unit 107 (image identification unit) refers to the icon image projection position management table (FIG. 6) when the interactive operation is recognized by the interactive operation recognition unit 104, and to which icon image 6 is interactive. Identify whether it is an operation.

  The operation content storage unit 108 stores the operation content of the state operation executed in the projector 2 when each icon image 6 is interactively operated. In the present embodiment, as shown in FIG. 9, such information is associated with each icon image identification ID and the operation content when the icon image specified by the icon image identification ID is interactively operated. Stored as a stored operation content management table. FIG. 9 is a diagram showing an example of the operation content management table according to the present embodiment. As shown in FIG. 9, in the projector 2 according to the present embodiment, for example, state operations of the projector 2 such as a power-off operation, a voice operation, and an image adjustment operation are operation A, operation B, operation C,. The icon image identification IDs of the icon images corresponding to these operations are stored as action_a, action_b, action_c,.

  The operation content determination unit 109 (processing content determination unit, process execution device determination unit) refers to the operation content management table (FIG. 9) when the icon image interactively operated by the operation icon image identification unit 107 is identified. Then, the operation content of the state operation executed in the projector 2 is determined. Then, the operation content determination unit 109 transmits the determined operation content to the corresponding projector 2 via the communication unit 110. The communication unit 110 transmits / receives information to / from another apparatus by the projection control apparatus 1.

  Next, the functional configuration of the projector 2 according to the present embodiment will be described with reference to FIG. FIG. 10 is a block diagram schematically showing a functional configuration of the projector 2 according to the present embodiment.

  As shown in FIG. 10, the projector 2 according to the present embodiment includes an image projection unit 201, a state operation control unit 202, and a communication unit 203.

  The image projection unit 201 superimposes an icon image based on the icon image data input from the projection control device 1 on the projection plane 5 on an image based on image data input from the outside or image data stored in itself. Project. The state operation control unit 202 executes the state operation according to the operation content transmitted from the projection control apparatus 1. The communication unit 203 transmits / receives information between the projector 2 and another device.

  Next, processing when an interactive operation of the icon image 6 is performed in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 11 is a sequence diagram for explaining processing when an interactive operation is performed in the multi-projection system according to the present embodiment.

  As shown in FIG. 11, first, in the projector 2, when the state operation control unit 202 receives an icon image display operation by a user operation (S <b> 1101), the icon image data is transmitted to the projection control apparatus 1 via the communication unit 203. A transmission request is made (S1102).

  When the icon image projection control unit 103 receives the icon image data transmission request from the projector 2 via the communication unit 110 in the projection control apparatus 1, the icon image projection position management table (FIG. 6) and the projection area Referring to the management table (FIG. 7), the icon image to be projected on the projector 2 that is the transmission request source of icon image data and its projection position are confirmed (S1103).

  Then, in the projection control apparatus 1, the icon image projection control unit 103 reads the icon image data of the icon image confirmed in S1103 from the icon image storage unit 101 with reference to the icon image data management table (FIG. 5) (S1104). ).

  Then, in the projection control apparatus 1, the icon image projection control unit 103 transmits the read icon image data and the projection position thereof to the projector 2 that is the transmission request source of the icon image data via the communication unit 110 (S1105).

  In the projector 2, when the image projection unit 201 receives the icon image data and the projection position from the projection control apparatus 1 via the communication unit 203, the image projection unit 201 superimposes the icon image 6 on the image being projected at the received projection position. To project (S1106).

  In the projection control apparatus 1, the interactive operation recognition unit 104 recognizes an interactive operation performed by the user using the interactive pen 4, and recognizes to which position on the projection plane 5 the interactive operation is performed (S1107). ).

  In the projection control apparatus 1, the operation icon image identification unit 107 refers to the icon image projection position management table (FIG. 6) based on the position recognized in S 1107, which icon image 6 is the interactive operation. Is identified (S1108).

  Then, in the projection control device 1, the operation target device identification unit 106 identifies which projector 2 is the interactive operation with reference to the projection area management table (FIG. 7) based on the position recognized in S1107. (S1109).

  In the projection control device 1, the operation content determination unit 109 determines the operation content of the state operation with reference to the operation content management table (FIG. 9) based on the icon image identified in S1108 (S1110).

  In the projection control apparatus 1, the icon image projection control unit 103 transmits the operation content determined in S1110 to the projector 2 identified in S1109 via the communication unit 110 (S1111).

  In the projector 2, when the state operation control unit 202 receives the operation content from the projection control apparatus 1 via the communication unit 203, the state operation control unit 202 executes the state operation according to the received operation content (S1112).

  As described above, in the multi-projection system according to the present embodiment, the state operations of the projector 2 such as the power-off operation, the voice operation, and the image adjustment operation by the interactive operation can be easily performed without expanding the function of the projector. This can be done with a configuration.

Embodiment 2. FIG.
In the first embodiment, an example has been described in which when a projected icon image 6 is interactively operated, a state operation corresponding to the icon image 6 is executed in the projector that projects the icon image 6.

  On the other hand, in the present embodiment, an example in which the projected icon image 6 is moved by an interactive operation will be described.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the moving operation by the interactive operation of the projected icon image 6 is performed with a simple configuration without expanding the function of the projector. Is to make it possible.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1, it shall show the same or an equivalent part, and abbreviate | omits detailed description.

  First, in the multi-projection system according to the present embodiment, a state in which a projected icon image is moved by an interactive operation will be described with reference to FIGS. 12 and 13. FIG. 12 and FIG. 13 are diagrams illustrating a state when the projected icon image is moved by an interactive operation in the multi-projection system according to the present embodiment.

  In the multi-projection system according to the present embodiment, when the projected icon image is moved by interactive operation, the user moves the icon image 6 to a position where the icon image 6 is to be moved using the interactive pen 4. Here, the moving operation of the icon image 6 includes, for example, a drag operation. The drag operation is an operation of moving the interactive pen 4 while the interactive pen 4 is in contact with the icon image 6 on the projection surface 5.

  Then, as shown in FIG. 12, the icon image 6 moves from the original position to a position where the movement of the interactive pen 4 has stopped. Alternatively, as shown in FIG. 13, the icon image 6 moves following the movement of the interactive pen 4 from the original position.

  When the icon image 6 moves in this way, the icon image projection control unit 103 sets the latest projection position of the icon image in the icon image projection position management table (FIG. 6) stored in the icon image projection position storage unit 102. Update to information.

  Next, in the multi-projection system according to the present embodiment, processing for moving a projected icon image by interactive operation will be described with reference to FIGS. FIG. 14 to FIG. 16 are sequence diagrams for explaining processing when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment. In FIG. 14, a case where the projector 2a accepts an icon image display operation by a user operation will be described as an example.

  As shown in FIG. 14, first, the projection control device 1 and the projector 2a perform the same processing as S1101 to S1105 described with reference to FIG. 11 (S1401 to S1406).

  In the projection control apparatus 1, the interactive operation recognition unit 104 recognizes the movement operation of the icon image 6 by the user using the interactive pen 4, and the movement operation is performed from which position on the projection plane 5 to which position. Is recognized (S1407).

  In the projection control apparatus 1, the operation icon image identification unit 107 refers to the icon image projection position management table (FIG. 6) based on the position recognized in S 1407, to which icon image 6 the movement operation is performed. Is identified (S1408).

  Then, in the projection control device 1, the operation target device identification unit 106 refers to the projection area management table (FIG. 7) based on the position recognized in S1407, and to which icon image 6 the projector 2 projects. It is identified whether the operation is a moving operation (S1409).

  In the projection control apparatus 1, the icon image projection control unit 103 updates the projection position of the icon image in the icon image projection position management table (FIG. 6) to the latest information based on the position recognized in S1407 (S1410). .

  In the projection control apparatus 1, the icon image projection control unit 103 is moved across the projectors 2 having different icon images 6 with reference to the projection area management table (FIG. 7) based on the position recognized in S1407. It is determined whether or not (S1411).

  As illustrated in FIG. 15, in the projection control apparatus 1, the icon image projection control unit 103 determines that the icon image 6 is not moved across different projectors 2 in the determination process in S <b> 1411 (S <b> 1411). / NO), the updated projection position of the icon image 6 to be moved in S1410 is transmitted to the projector 2a identified in S1409 via the communication unit 110 (S1501).

  In the projector 2 a, when the image projection unit 201 receives the updated projection position from the projection control apparatus 1 via the communication unit 203, the image projection unit 201 projects the icon image 6 that is the target of the movement operation onto the updated projection position. The image is superimposed and projected on the inside image (S1502).

  On the other hand, as shown in FIG. 16, in the projection control apparatus 1, the icon image projection control unit 103 determines in the determination process in S <b> 1411 that the icon image 6 has been moved across different projectors 2 (S <b> 1411 / YES). ) The projector 2 identified in S1409 is notified of the end of the projection of the icon image 6 to be moved by the communication unit 110 (S1601). In FIG. 16, the icon image 6 will be described as an example in which the icon image 6 is moved across the projector 2a and the projector 2b.

  In the projector 2a, when the projection of the icon image 6 that is the object of the moving operation is notified from the projection control apparatus 1 via the communication unit 203, the image projecting unit 201 ends the projection of the icon image 6. (S1602).

  In the projection control apparatus 1, the icon image projection control unit 103 refers to the projection area management table (FIG. 7) based on the position recognized in S1407, and the icon image of the icon image 6 that is the target of the moving operation. The data and the updated projection position in S1410 are transmitted to the projector 2b corresponding to the movement destination via the communication unit 110 (S1603).

  In the projector 2b, when the image projection unit 201 receives the icon image data and the projection position from the projection control device 1 via the communication unit 203, the image projection unit 201 superimposes the icon image 6 on the image being projected at the received projection position. To project (S1604).

  As described above, in the multi-projection system according to the present embodiment, it is possible to perform a moving operation by interactive operation of the projected icon image 6 with a simple configuration without expanding the function of the projector. Become.

Embodiment 3 FIG.
In the first and second embodiments, the model of each projector 2 is not considered. However, when there are a plurality of projectors 2, all of them are not necessarily the same model, and the types of state operations that can be executed differ depending on the model.

  Therefore, in the present embodiment, an example will be described in which the icon image projected on the projector 2 is changed for each model, that is, the icon image corresponding to the model of each projector 2 is projected on each projector 2.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the state operation according to the difference in the capabilities of the projector 2 can be interactively operated with a simple configuration without expanding the functions of the projector 2. It is to be able to perform more appropriately.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1, 2, it shall show the same or an equivalent part, and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 17 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 17, the projection control apparatus 1 according to the present embodiment includes a model-specific projectable icon image storage unit 111 in addition to the configuration of the first embodiment.

  The model-specific projectable icon image storage unit 111 stores an icon image identification ID of an icon image that can be projected for each model of the projector 2.

  In this embodiment, as shown in FIG. 18, such information includes a model identification ID for identifying each model and an icon image identification ID of an icon image that can be projected by the projector 2 of that model. It is stored as an associated model-type projectable icon image management table. FIG. 18 is a diagram showing an example of a model-specific projectable icon image management table according to the present embodiment.

  The icon image projection control unit 103 refers to this model-specific projectable icon image management table (FIG. 18), grasps the icon image to be projected on each projector 2, and stores the icon image data in the icon image data management table. Read from the icon image storage unit 101 with reference to FIG.

  Next, in the multi-projection system according to the present embodiment, a state when each projector 2 projects an icon image corresponding to the model will be described with reference to FIG. FIG. 19 is a diagram showing a state in which an icon image corresponding to the model is projected on each projector 2 in the multi-projection system according to the present embodiment.

  As shown in FIG. 19, the multi-projection system according to the present embodiment changes the icon image 6 projected on the projector 2 for each model, that is, the icon image 6 corresponding to the model of each projector 2 is displayed on each projector 2. It is comprised so that it may project.

  The multi-projection system according to the present embodiment is configured as described above, so that the state operation according to the difference in the capabilities of the projector 2 can be appropriately performed by the interactive operation with a simple configuration without performing the function expansion of the projector 2. It is to make it possible to do.

  Next, in the multi-projection system according to this embodiment, processing when the projection control apparatus 1 determines an icon image to be projected according to the model of the projector 2 will be described with reference to FIG. FIG. 20 is a sequence diagram for explaining processing when the projection control apparatus 1 determines an icon image to be projected according to the model of the projector 2 in the multi-projection system according to the present embodiment.

  As shown in FIG. 20, first, in the projector 2, when the state operation control unit 202 accepts an icon image display operation by a user operation (S <b> 2001), the icon image data is transmitted to the projection control device 1 via the communication unit 203. A transmission request is made (S2002).

  In the projection control apparatus 1, when the icon image projection control unit 103 receives the icon image data transmission request from the projector 2 via the communication unit 110, the icon image projection control unit 103 receives the icon image projection control unit 103 via the communication unit 110. The projector 2 is inquired about the model (S2003).

  In the projector 2, when the state operation control unit 202 receives a model inquiry from the projection control apparatus 1 via the communication unit 203, the state operation control unit 202 notifies the projection control apparatus 1 of its own model via the communication unit 203 (S <b> 2004). ).

  In the projection control apparatus 1, when the icon image projection control unit 103 is notified of the model from the projector 2 via the communication unit 110, the icon image projection control unit 103 refers to the model-specific projectable icon image management table (FIG. 18). The icon image that can be projected by the projector 2 of the selected model is selected (S2005).

  In the projection control apparatus 1, the icon image projection control unit 103 refers to the icon image projection position management table (FIG. 6) and the projection area management table (FIG. 7), and the projector that is the icon image data transmission request source. 2 confirms the icon image to be projected onto the screen 2 and its projection position (S2006).

  Then, in the projection control apparatus 1, the icon image projection control unit 103 reads the icon image data of the icon image confirmed in S2006 from the icon image storage unit 101 with reference to the icon image data management table (FIG. 5) (S2007). .

  Then, in the projection control apparatus 1, the icon image projection control unit 103 transmits the read icon image data and the projection position thereof to the projector 2 that is the icon image data transmission request source via the communication unit 110 (S2008).

  In the projector 2, when the image projection unit 201 receives the icon image data and the projection position from the projection control apparatus 1 via the communication unit 203, the image projection unit 201 superimposes the icon image 6 on the image being projected at the received projection position. To project (S2009).

  As described above, the multi-projection system according to the present embodiment changes the icon image projected on the projector 2 for each model, that is, projects the icon image corresponding to the model of each projector 2 on each projector 2. It is configured as follows.

  The multi-projection system according to the present embodiment is configured as described above, so that the state operation according to the difference in the capabilities of the projector 2 can be appropriately performed by the interactive operation with a simple configuration without performing the function expansion of the projector 2. Can be done.

  In the present embodiment, the projection control apparatus 1 performs the process of selecting an icon image that can be projected for each model, but the projector 2 may perform the process. When configured in this manner, the projector 2 selects and projects icon image data that can be projected from the icon image data transmitted from the projection control apparatus 1.

Embodiment 4 FIG.
In the first to third embodiments, for example, the state of the projector 2 such as when no image data is input, during projection, during standby, and during power saving is not considered. However, the types of state operations that can be executed differ depending on the state of the projector 2.

  Therefore, in the present embodiment, an example will be described in which the icon image projected on the projector 2 is changed for each state, that is, an icon image corresponding to the state of the projector 2 is projected on each projector 2.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the state operation according to the state of the projector 2 is appropriately performed by the interactive operation with a simple configuration without performing the function expansion of the projector 2. It is to make it possible to do.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-3, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 21 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 21, the projection control apparatus 1 according to the present embodiment includes a state-specific projectable icon image storage unit 112 in addition to the configuration of the first embodiment.

  The state-by-state projectable icon image storage unit 112 stores an icon image identification ID of an icon image that can be projected for each state of the projector 2.

  In the present embodiment, as shown in FIG. 22, such information is classified by state in which each state of the projector 2 is associated with an icon image identification ID of an icon image that can be projected by the projector 2 in that state. It is stored as a projectable icon image management table. FIG. 22 is a diagram showing an example of a state-by-state projectable icon image management table according to the present embodiment.

  The icon image projection control unit 103 refers to this state-by-state projectable icon image management table (FIG. 22), grasps the icon image to be projected on the projector 2 in each state, and converts the icon image data into icon image data. Read from the icon image storage unit 101 with reference to the management table (FIG. 5).

  Next, in the multi-projection system according to the present embodiment, a state when each projector 2 projects an icon image corresponding to the state will be described with reference to FIGS. 23 and 24. FIG. FIG. 23 and FIG. 24 are diagrams showing a state when an icon image corresponding to the state is projected on each projector 2 in the multi-projection system according to the present embodiment.

  The icon image projected by the projector 2 differs between when the image shown in FIG. 23 is not projected and when the image shown in FIG. 24 is projected. As described above, the multi-projection system according to the present embodiment is configured to change the icon image to be projected on the projector 2 for each state, that is, to cause each projector 2 to project an icon image corresponding to the state of the projector 2. ing.

  The multi-projection system according to the present embodiment is configured as described above, so that the state operation according to the state of the projector 2 can be appropriately performed by interactive operation with a simple configuration without performing the function expansion of the projector 2. Is possible.

  Next, in the multi-projection system according to the present embodiment, processing when the projection control apparatus 1 determines an icon image to be projected according to the state of the projector 2 will be described with reference to FIGS. 25 and 26 are sequence diagrams for explaining processing when the projection control apparatus 1 determines an icon image to be projected according to the state of the projector 2 in the multi-projection system according to the present embodiment.

  As shown in FIG. 25, first, in the projector 2, when the state operation control unit 202 accepts an icon image display operation by a user operation (S2501), the state operation control unit 202 detects its own state (S2502). Then, the detected state is notified to the projection control apparatus 1 (S2503), and a transmission request for icon image data is sent to the projection control apparatus 1 (S2504).

  In the projection control apparatus 1, when the icon image projection control unit 103 is notified of the model from the projector 2 via the communication unit 110 and receives a transmission request for icon image data, the icon image management table for each state capable of projection. Referring to FIG. 22, an icon image that can be projected by projector 2 in the notified state is selected (S2505).

  In the projection control apparatus 1, the icon image projection control unit 103 refers to the icon image projection position management table (FIG. 6) and the projection area management table (FIG. 7), and the projector that is the icon image data transmission request source. 2 confirms the icon image to be projected onto the screen 2 and its projection position (S2506).

  In the projection control apparatus 1, the icon image projection control unit 103 reads out the icon image data of the icon image confirmed in S2506 from the icon image storage unit 101 with reference to the icon image data management table (FIG. 5) (S2507). .

  Then, in the projection control apparatus 1, the icon image projection control unit 103 transmits the read icon image data and the projection position thereof to the projector 2 that is the transmission request source of the icon image data via the communication unit 110 (S2508).

  In the projector 2, when the image projection unit 201 receives the icon image data and the projection position from the projection control apparatus 1 via the communication unit 203, the image projection unit 201 superimposes the icon image 6 on the image being projected at the received projection position. To project (S2509).

  In the projector 2, when the state operation control unit 202 detects a state change (S2510), the state operation control unit 202 notifies the projection control apparatus 1 of the changed state via the communication unit 203 (S2511).

  As shown in FIG. 26, in the projection control apparatus 1, the icon image projection control unit 103 notifies the projector 2 via the communication unit 110 of the end of the projection of the icon image currently being projected.

    In the projector 2, when the projection of the icon image 6 currently being projected is notified from the projection control apparatus 1 via the communication unit 203, the image projecting unit 201 ends the projection of the icon image 6 (S 2602). ).

  Then, the projection control device 1 and the projector 2 perform the same processing as S2505 to S2509 described with reference to FIG. 11 (S2603 to S2607).

  As described above, the multi-projection system according to the present embodiment changes the icon image projected on the projector 2 for each state, that is, causes each projector 2 to project an icon image corresponding to the state of the projector 2. It is configured.

  The multi-projection system according to the present embodiment is configured as described above, so that the state operation according to the state of the projector 2 can be appropriately performed by interactive operation with a simple configuration without performing the function expansion of the projector 2. Is possible.

Embodiment 5. FIG.
In the first to fourth embodiments, an example has been described in which when a certain icon image is interactively operated, the projector 2 of any model executes the same state operation regardless of the model of the projector 2.

  However, when there are a plurality of projectors 2, all of them are not necessarily the same model, and the types of state operations that can be executed differ depending on the model.

  Therefore, in the present embodiment, even when the same icon image is interactively operated, the operation content of the state operation is changed for each model of the projector 2, that is, the operation content corresponding to the model of each projector 2. An example of causing the projector 2 to execute the state operation will be described.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the state operation according to the difference in the capabilities of the projector 2 can be interactively operated with a simple configuration without expanding the functions of the projector 2. It is to be able to perform more appropriately.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-4, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 27 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 27, the projection control apparatus 1 according to the present embodiment includes a model-specific operation content storage unit 113 in addition to the configuration of the first embodiment.

  The model-specific operation content storage unit 113 stores the operation content of the state operation when each icon image is interactively operated for each model of each projector 2.

  In this embodiment, as shown in FIG. 28, such information includes, for each icon image identification ID, the model identification ID of each projector 2 and the operation contents of the state operation that can be executed by the projector 2 of that model. It is stored as the associated model-specific operation content management table. FIG. 28 is a diagram showing an example of the model-specific operation content management table according to the present embodiment.

  The icon image projection control unit 103 refers to the model-specific operation content management table (FIG. 28) and grasps the operation content of the state operation to be executed by each projector 2.

  Next, processing when an interactive operation of the icon image 6 is performed in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 29 is a sequence diagram for explaining processing when an interactive operation on the icon image 6 is performed in the multi-projection system according to the present embodiment.

  As shown in FIG. 29, first, the projection control device 1 and the projector 2 perform the same processing as S1101 to S1109 described with reference to FIG. 11 (S2901 to S2909).

  In the projection control apparatus 1, the operation content determination unit 109 inquires of the projector 2 identified in S2909 about the model via the communication unit 110 (S2910).

  In the projector 2, when the state operation control unit 202 receives an inquiry about the model from the projection control apparatus 1 via the communication unit 203, the state operation control unit 202 notifies the projection control apparatus 1 of its own model via the communication unit 203 (S <b> 2911). ).

  In the projection control apparatus 1, when the operation content determination unit 109 is notified of the model from the projector 2 via the communication unit 110, the type of model is determined based on the notified model and the icon image identified in S 2908. With reference to the operation content management table (FIG. 28), the operation content of the state operation is determined (S2912).

  In the projection control device 1, the icon image projection control unit 103 transmits the operation content determined in S2912 to the projector 2 identified in S2909 via the communication unit 110 (S2913).

  In the projector 2, when the state operation control unit 202 receives the operation content from the projection control device 1 via the communication unit 203, the state operation control unit 202 executes the state operation according to the received operation content (S2914).

  As described above, the multi-projection system according to the present embodiment changes the operation contents of the state operation for each model of the projector 2 even when the same icon image is interactively operated, The projector 2 is configured to cause the projector 2 to execute a state operation with an operation content corresponding to the model of the projector 2.

  The multi-projection system according to the present embodiment is configured as described above, so that the state operation according to the difference in the capabilities of the projector 2 can be appropriately performed by the interactive operation with a simple configuration without performing the function expansion of the projector 2. It is to make it possible to do.

Embodiment 6 FIG.
In the fifth embodiment, even when the same icon image is interactively operated, the operation content of the state operation is changed for each model of the projector 2, that is, with the operation content corresponding to the model of each projector 2. The example in which the state operation is executed by the projector 2 has been described.

  On the other hand, in the present embodiment, even when the same icon image is interactively operated, the operation content of the state operation is changed for each state of the projector 2, that is, the operation content corresponding to the state of each projector 2 An example of causing the projector 2 to execute the state operation will be described.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the state operation according to the state of the projector 2 is appropriately performed by the interactive operation with a simple configuration without performing the function expansion of the projector 2. It is to make it possible to do.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-5, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 30 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 30, the projection control apparatus 1 according to the present embodiment includes a state-specific operation content storage unit 114 in addition to the configuration of the first embodiment.

  The state-specific operation content storage unit 114 stores the operation content of the state operation when each icon image is interactively operated for each state of the projector 2.

  In this embodiment, as shown in FIG. 31, in this embodiment, the state of the projector 2 and the operation contents of the state operation that can be executed by the projector 2 in that state are associated with each icon image identification ID. Stored as an operation content management table for each state. FIG. 31 is a diagram showing an example of the model-specific operation content management table according to the present embodiment.

  The icon image projection control unit 103 refers to the state-specific operation content management table (FIG. 31) and grasps the operation content of the state operation to be executed by each projector 2.

  Next, processing when the interactive operation of the icon image 6 is performed in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 32 is a sequence diagram for explaining processing when an interactive operation on the icon image 6 is performed in the multi-projection system according to the present embodiment.

  As shown in FIG. 32, first, the projection control device 1 and the projector 2 perform the same processing as S1101 to S1106 described with reference to FIG. 11 (S3201 to S3206).

  Then, in the projector 2, the state operation control unit 202 notifies its own state (S3207).

  Then, the projection control apparatus 1 performs the same processing as S1107 to S1109 described with reference to FIG. 11 (S3208 to S3210).

  Then, in the projection control apparatus 1, the operation content determination unit 109 refers to the state-specific operation content management table (FIG. 31) based on the state in S3207 and the icon image identified in S3209. The contents are determined (S3211).

  In the projection control apparatus 1, the icon image projection control unit 103 transmits the operation content determined in S3211 to the projector 2 identified in S3210 via the communication unit 110 (S3212).

  In the projector 2, when the state operation control unit 202 receives the operation content from the projection control apparatus 1 via the communication unit 203, the state operation control unit 202 executes the state operation according to the received operation content (S3213).

  As described above, the multi-projection system according to the present embodiment changes the operation contents of the state operation for each state of the projector 2 even when the same icon image is interactively operated. The projector 2 is configured to cause the projector 2 to execute a state operation with an operation content corresponding to the state of the projector 2.

  The multi-projection system according to the present embodiment is configured as described above, so that the state operation according to the state of the projector 2 can be appropriately performed by interactive operation with a simple configuration without performing the function expansion of the projector 2. Is possible.

Embodiment 7 FIG.
In the first to sixth embodiments, the transmission destination of the operation content is not considered. Therefore, in the present embodiment, an example will be described in which the transmission destination of the operation content is changed according to the operation content, that is, the transmission destination of the operation content is changed according to the interactively operated icon image.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is to enable the state operation of the projector 2 to be performed efficiently.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-6, the same or an equivalent part shall be shown, and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 33 is a block diagram schematically showing the functional configuration of the projection control apparatus 1 according to this embodiment.

  As shown in FIG. 33, the projection control apparatus 1 according to the present embodiment includes an operation content transmission destination storage unit 115 in addition to the configuration of the first embodiment.

  The operation content transmission destination storage unit 115 stores the transmission destination of the operation content of the state operation when each icon image is interactively operated for each icon image identification ID of the icon image.

  In this embodiment, as shown in FIG. 34, in this embodiment, for each icon image identification ID, the operation content when the icon image is interactively operated and the transmission destination of the operation content are associated with each other. Stored as an operation content transmission destination management table. FIG. 34 is a diagram showing an example of an operation content transmission destination management table according to the present embodiment.

  The operation content determination unit 109 refers to the operation content transmission destination management table (FIG. 34) and grasps the transmission destination of the operation content of the state operation.

  Next, processing when the interactive operation of the icon image 6 is performed in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 35 is a sequence diagram for explaining processing when an interactive operation on the icon image 6 is performed in the multi-projection system according to the present embodiment.

  As shown in FIG. 35, first, the projection control device 1 and the projector 2 perform the same processing as S1101 to S1109 described with reference to FIG. 11 (S3501 to S3509).

  In the projection control apparatus 1, the operation content determination unit 109 determines the operation content with reference to the operation content transmission destination management table (FIG. 34) based on the icon image identified in S3508 (S3510). The transmission destination of the operation content is determined (S3511).

  In the projection control apparatus 1, the icon image projection control unit 103 transmits the operation content determined in S3510 to the transmission destination determined in S3511 via the communication unit 110 (S3512).

  In the projector 2, when the state operation control unit 202 receives the operation content from the projection control apparatus 1 via the communication unit 203, the state operation control unit 202 executes the state operation according to the received operation content (S3513).

  As described above, the multi-projection system according to the present embodiment changes the transmission destination of the operation content according to the operation content, that is, changes the transmission destination of the operation content according to the icon image that has been interactively operated. It is configured as follows.

  With this configuration, the multi-projection system according to the present embodiment can efficiently perform the state operation of the projector 2.

Embodiment 8 FIG.
In the seventh embodiment, the state of each projector 2 is not considered. Therefore, in the present embodiment, the transmission destination of the operation content is determined according to the operation content, but an example of switching whether to transmit the operation content to the transmission destination according to the state of each projector 2 will be described. To do.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the state operation according to the difference in the state of each projector 2 can be interactively performed with a simple configuration without performing the function expansion of the projector 2. It is to be able to perform appropriately by operation.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-7, the same or an equivalent part shall be shown, and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 36 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 36, the projection control apparatus 1 according to the present embodiment includes a state-specific operation content transmission destination storage unit 116 in addition to the configuration of the first embodiment.

  Whether the operation content transmission destination storage unit 116 for each state transmits the operation content according to the operation content when the icon image is interactively operated, the transmission destination of the operation content, and the state of the projector 2 for each icon image. Remember if not.

  In the present embodiment, as shown in FIG. 37, such information includes, for each icon image identification ID, the operation contents when the icon image is interactively operated, the transmission destination of the operation contents, the projector 2. Whether or not to transmit the operation content according to the state is stored as a state-specific operation content transmission destination management table. FIG. 37 is a diagram showing an example of a state-specific operation content transmission destination management table according to the present embodiment.

  The operation content determination unit 109 refers to the state-specific operation content transmission destination management table (FIG. 37) and grasps the transmission destination of the operation content of the state operation.

  Next, processing when the interactive operation of the icon image 6 is performed in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 38 is a sequence diagram for explaining processing when an interactive operation on the icon image 6 is performed in the multi-projection system according to the present embodiment.

  As shown in FIG. 38, first, the projection control device 1 and the projector 2 perform the same processing as S1101 to S1109 described with reference to FIG. 11 (S3801 to S3809).

  In the projection control apparatus 1, the operation content determination unit 109 determines the operation content with reference to the operation content transmission destination management table (FIG. 37) based on the icon image identified in S3808 (S3810). The transmission destination of the operation content is determined (S3811).

  Furthermore, in the projection control apparatus 1, the operation content determination unit 109 refers to the operation content transmission destination management table (FIG. 37) to determine whether or not to transmit the operation content determined in S3810 to the transmission destination determined in S3811. (S3812).

  In the projection control apparatus 1, the icon image projection control unit 103 transmits the operation content determined in S3510 to the transmission destination determined in S3812 via the communication unit 110 (S3813).

  In the projector 2, when the state operation control unit 202 receives the operation content from the projection control device 1 via the communication unit 203, the state operation control unit 202 executes the state operation according to the received operation content (S3814).

  As described above, the multi-projection system according to the present embodiment determines the transmission destination of the operation content according to the operation content, but transmits the operation content to the transmission destination according to the state of each projector 2. It is configured to switch whether or not to do.

  The multi-projection system according to the present embodiment is configured as described above so that the state operation corresponding to the difference in the state of each projector 2 can be appropriately performed by interactive operation with a simple configuration without performing the function expansion of the projector 2. Can be performed.

Embodiment 9 FIG.
In the seventh embodiment, the model of each projector 2 is not considered. Therefore, in the present embodiment, the transmission destination of the operation content is determined according to the operation content, but an example of switching whether to transmit the operation content to the transmission destination according to the model of each projector 2 will be described. To do.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the state operation according to the difference in the capabilities of the projectors 2 can be interactively performed with a simple configuration without expanding the functions of the projectors 2. It is to be able to perform appropriately by operation.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-8, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 39 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 39, the projection control apparatus 1 according to the present embodiment includes a model-specific operation content transmission destination storage unit 117 in addition to the configuration of the first embodiment.

  For each icon image, the model-specific operation content transmission destination storage unit 117 transmits the operation content according to the operation content when the icon image is interactively operated, the transmission destination of the operation content, and the model of the projector 2. Remember if not.

  In the present embodiment, as shown in FIG. 40, such information includes, for each icon image identification ID, the operation contents when the icon image is interactively operated, the transmission destination of the operation contents, the projector 2. Is stored as a model-specific operation content transmission destination management table that associates whether or not to transmit the operation content depending on the model. FIG. 40 is a diagram showing an example of the model-specific operation content transmission destination management table according to the present embodiment.

  The operation content determination unit 109 refers to the model-specific operation content transmission destination management table (FIG. 40) and grasps the transmission destination of the operation content of the state operation.

  Note that in the multi-projection system according to the present embodiment, the processing when the interactive operation of the icon image 6 is performed is the same as FIG.

  As described above, the multi-projection system according to the present embodiment has been determined as the transmission destination of the operation content, but is configured to switch whether to transmit the operation content according to the model of each projector 2. ing.

  The multi-projection system according to the present embodiment is configured as described above, so that the state operation according to the difference in capability of each projector 2 can be appropriately performed by interactive operation with a simple configuration without performing the function expansion of the projector 2. Can be performed.

Embodiment 10 FIG.
In the first to ninth embodiments, when an icon image 6 projected by a certain projector 2 is interactively operated, the projector 2 or a predetermined one as shown in FIGS. 34, 37, and 40 is determined. The example in which the operation content corresponding to the icon image 6 is transmitted to the projector 2 is described.

  On the other hand, in the present embodiment, an example will be described in which when an icon image 6 projected by a certain projector 2 is interactively operated, the icon image 6 is projected onto another projector 2.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the user can freely select the projector 2 for which the state operation is desired, and the state operation of the plurality of projectors 2 is performed. Is to be able to be performed continuously.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-9, the same or an equivalent part shall be shown, and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 41 is a block diagram schematically showing the functional configuration of the projection control apparatus 1 according to this embodiment.

  As shown in FIG. 41, the projection control apparatus 1 according to the present embodiment includes an interlocking operation storage unit 118 in addition to the configuration of the first embodiment.

  For each icon image, the linked operation storage unit 118 performs operation when the icon image is interactively operated, whether or not to project the icon image on another projector 2 when the icon image is interactively operated, That is, it stores whether or not to interlock.

  In this embodiment, as shown in FIG. 42, such information includes, for each icon image identification ID, the operation contents when the icon image is interactively operated, and when the icon image is interactively operated. Whether or not to project the icon image on another projector 2, that is, whether or not to interlock is stored as an associated operation management table. FIG. 42 is a diagram showing an example of the linked operation management table according to the present embodiment.

  The operation content determination unit 109 refers to the linked operation management table (FIG. 42) and determines whether or not to project the icon image on another projector 2 when the icon image is interactively operated.

  Next, the state when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment will be described with reference to FIGS. 43 and 44. FIGS. 43 and 44 are diagrams illustrating a state when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment.

  When the icon image 6 projected by the projector 2c is interactively operated as shown in FIG. 43, the multi-projection system according to this embodiment corresponds to the icon image 6 in the projector 2c as shown in FIG. The state operation is executed, and the same icon image as that icon image is projected on the other projectors 2a and 2b.

  With the multi-projection system according to the present embodiment configured as described above, the user can freely select the projector 2 that wants to perform the state operation, and the state operations of the plurality of projectors 2 can be continuously performed. Can be performed.

  Next, processing when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 45 is a sequence diagram for explaining processing when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment.

  As shown in FIG. 45, first, the projection control device 1 and the projector 2a perform the same processing as S1101 to S1106 described with reference to FIG. 11 (S4501 to S4506).

  Then, in the projection control apparatus 1, the icon image projection control unit 103 refers to the linked operation management table (FIG. 42) based on the icon image 6 identified in S4502, and displays the icon image 6 as another projector 2b, It is determined whether or not to project also on 2c, that is, whether or not the operation content corresponding to the icon image 6 is operation content linked to the other projectors 2b and 2c (S4507).

  In the projection control apparatus 1, when the icon image projection control unit 103 determines in the determination process in S <b> 4507 that the operation content is linked to the other projectors 2 b and 2 c, the icon of the icon image 6 identified in S <b> 4502. The image data and the projection position thereof are transmitted to the other projectors 2b and 2c via the communication unit 110 (S4508).

  In the projection control apparatus 1, when the icon image projection control unit 103 determines that the operation content is not linked to the other projectors 2b and 2c in the determination process in S4507, the processes after S4508 are not necessary.

  In the projectors 2b and 2c, when the image projection unit 201 receives the icon image data and the projection position from the projection control device 1 via the communication unit 203, the image that is projecting the icon image 6 to the received projection position. (S4509).

  As described above, in the multi-projection system according to the present embodiment, when an icon image 6 projected by a certain projector 2 is interactively operated, the icon image 6 is projected onto another projector 2. It is configured.

  In the multi-projection system according to the present embodiment, the user can freely select the projector 2 for which the state operation is to be performed, and the state operations of the plurality of projectors 2 can be continuously performed.

Embodiment 11 FIG.
In the tenth embodiment, an example has been described in which when an icon image 6 projected by a certain projector 2 is interactively operated, the icon image 6 is projected onto another projector 2.

  On the other hand, in the present embodiment, when an icon image 6 projected by a certain projector 2 is interactively operated, if an icon image different from the icon image is projected on the other projector 2, the other projector 2, an example in which the projection of the different icon image is terminated and the same icon image as the interactively operated icon image is projected on the other projector 2 will be described.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that the user can freely select the projector 2 for which the state operation is desired, and the state operation of the plurality of projectors 2 is performed. Is to be able to be performed continuously.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-10, the same or an equivalent part shall be shown, and detailed description is abbreviate | omitted.

  First, the state when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment will be described with reference to FIGS. 46 and 47. 46 and 47 are diagrams illustrating a state when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment.

  46, when the icon image 6 projected by the projector 2c is interactively operated as shown in FIG. 46, the icon image is displayed on the projector 2c as shown in FIGS. 6 is executed, the other projectors 2b and 2c are caused to finish projecting an icon image different from the icon image, and the same icon image as the interactively operated icon image is displayed on the other projectors 2a and 2b. Is also configured to project.

  With the multi-projection system according to the present embodiment configured as described above, the user can freely select the projector 2 that wants to perform the state operation, and the state operations of the plurality of projectors 2 can be continuously performed. Can be performed.

  Next, a process when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 48 is a sequence diagram for explaining processing when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment.

  As shown in FIG. 48, first, the projection control device 1 and the projector 2a perform the same processing as S4501 to S4507 described with reference to FIG. 45 (S4801 to S4807).

  In the projection control apparatus 1, when the icon image projection control unit 103 determines in the determination process in S4807 that the operation content is also linked to the other projectors 2b and 2c, the other projectors 2b and 2c are currently projecting. The end of the projection of the icon image 6 being performed is notified to the other projectors 2b and 2c via the communication unit 110 (S4808).

  In the projection control apparatus 1, when the icon image projection control unit 103 determines that the operation content is not linked to the other projectors 2b and 2c in the determination process in S4807, the process after S4808 is not necessary.

  In the projectors 2b and 2c, when the projection of the icon image 6 being projected is notified from the projection control apparatus 1 via the communication unit 203, the image projecting unit 201 ends the projection of the icon image 6 ( S4809).

  In the projection control device 1, the icon image projection control unit 103 transmits the icon image data of the icon image 6 identified in S4802 and the projection position thereof to the other projectors 2b and 2c via the communication unit 110 ( S4810).

  In the projectors 2b and 2c, when the image projection unit 201 receives the icon image data and the projection position from the projection control device 1 via the communication unit 203, the image that is projecting the icon image 6 to the received projection position. (S4811).

  As described above, in the multi-projection system according to the present embodiment, when an icon image 6 projected by a certain projector 2 is interactively operated, an icon image different from the icon image is projected on the other projector 2. If it is, the projection of the different icon image is terminated on the other projector 2, and the same icon image as the interactively operated icon image is projected on the other projector 2.

  The multi-projection system according to the present embodiment is configured as described above, so that the user can freely select the projector 2 that wants to perform the state operation, and the state operations of the plurality of projectors 2 can be continuously performed. Is to be able to do it.

Embodiment 12 FIG.
In the tenth and eleventh embodiments, when the icon image 6 projected by a certain projector 2 is interactively operated, the example in which the icon image 6 is projected onto another projector 2 has been described.

  On the other hand, in the present embodiment, when the icon image 6 projected by a certain projector 2 is interactively operated and the other projector 2 projects the icon image, the icon image is displayed on the other projector 2. An example of terminating the projection will be described.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is that it is possible to save the user from performing unnecessary operations.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-11, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, the state when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment will be described with reference to FIGS. 49 and 50. 49 and 50 are diagrams illustrating a state when the icon image 6 is interactively operated in the multi-projection system according to the present embodiment.

  As shown in FIG. 49, when the icon image 6 projected by the projector 2c is interactively operated, the multi-projection system according to the present embodiment displays the icon image on the projector 2c as shown in FIGS. 6 is executed, and the projection of the icon image being projected on the other projectors 2b and 2c is terminated.

  With this configuration, the multi-projection system according to the present embodiment can save the user from performing unnecessary operations.

  Note that in the multi-projection system according to the present embodiment, the processing when the interactive operation of the icon image 6 is performed is the same as S4801 to S4809 described with reference to FIG.

  As described above, in the multi-projection system according to the present embodiment, when the icon image 6 projected by a certain projector 2 is interactively operated, the other projector 2 projects an icon image. The other projector 2 is configured to finish projecting the icon image.

  With this configuration, the multi-projection system according to the present embodiment can save the user from performing unnecessary operations.

Embodiment 13 FIG.
In the first to twelfth embodiments, the example in which the user projects the icon image by directly operating the projector 2 has been described. On the other hand, in the present embodiment, an example will be described in which when the user touches a region on the projection surface 5 where the icon image is not projected using the interactive pen 4, the projector 2 projects an icon image on the region.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is to enable the user to save the trouble of operating the projector 2.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-12, the same or an equivalent part shall be shown, and detailed description is abbreviate | omitted.

  First, in the multi-projection system according to the present embodiment, the state when the user touches the area where the icon image of the projection surface 5 is not projected using the interactive pen 4 will be described with reference to FIGS. 51 and 52. To do. FIGS. 51 and 52 are diagrams illustrating a state when the user touches a region on the projection surface 5 where the icon image is not projected using the interactive pen 4 in the multi-projection system according to the present embodiment.

  As shown in FIG. 52, the multi-projection system according to the present embodiment uses the interactive pen 4 to touch an area on which the icon image is not projected, as shown in FIG. An icon image 6 is projected onto the area by the projector 2.

  With this configuration, the multi-projection system according to the present embodiment can save the user from operating the projector 2.

  Next, in the multi-projection system according to the present embodiment, processing when the user touches a region on the projection surface 5 where the icon image is not projected will be described with reference to FIG. FIG. 53 is a sequence diagram for explaining processing when the user touches an area on the projection surface 5 where the icon image is not projected in the multi-projection system according to the present embodiment.

  As shown in FIG. 53, first, in the projection control apparatus 1, the interactive operation recognition unit 104 recognizes an interactive operation by the user using the interactive pen 4, and the interactive operation is an interactive operation for any position on the projection plane 5. It is recognized whether it exists (S5301).

  In the projection control apparatus 1, the interactive operation recognition unit 104 determines whether the interactive operation is an interactive operation on the icon image (S5302).

  Then, in the projection control apparatus 1, when the interactive operation recognition unit 104 determines in the determination processing in S5302 that the operation is not an interactive operation on the icon image, the icon image projection position management table (FIG. 6) is based on the position recognized in S5301. ) And referring to the projection area management table (FIG. 7), the icon image to be projected by the projector 2 and its projection position are confirmed (S5303).

  In the projection control apparatus 1, the icon image projection control unit 103 reads the icon image data of the icon image confirmed in S5303 from the icon image storage unit 101 with reference to the icon image data management table (FIG. 5) (S5304). ).

  Then, in the projection control apparatus 1, the icon image projection control unit 103 transmits the read icon image data and the projection position thereof to the projector 2 that is the transmission request source of the icon image data via the communication unit 110 (S5305).

  In the projector 2, when the image projection unit 201 receives the icon image data and the projection position from the projection control apparatus 1 via the communication unit 203, the image projection unit 201 superimposes the icon image 6 on the image being projected at the received projection position. To project (S5306).

  As described above, when the user touches a region on the projection surface 5 where the icon image is not projected using the interactive pen 4, the multi-projection system according to the present embodiment displays an icon on the projector 2 in that region. An image is projected.

  With this configuration, the multi-projection system according to the present embodiment can save the user from operating the projector 2.

Embodiment 14 FIG.
In the first to thirteenth embodiments, examples in which the projection control device 1 and the projector 2 are realized as different devices have been described. On the other hand, in the present embodiment, as shown in FIG. 54, at least one of the projectors 2a, 2b, and 2c and the projection control apparatus 1 may be integrated and realized. FIG. 54 is a diagram showing an operation mode of the multi-projection system according to the present embodiment.

  FIG. 54 shows an example in which the projector 2a and the projection control device 1 are integrated, but either the projector 2b or 2c and the projection control device 1 may be integrated. .

  The multi-projection system according to the present embodiment is configured as described above, so that the projection control device 1 is not necessary.

Embodiment 15 FIG.
In the first to thirteenth embodiments, examples in which the projection control device 1 and the projector 2 are realized as different devices have been described. In the fourteenth embodiment, the example in which the projector 2 and the projection control apparatus 1 are integrated is described.

  On the other hand, in the present embodiment, as shown in FIG. 55, an example in which the projection surface 5 and the projection control apparatus 1 are realized in an integrated manner will be described. FIG. 55 is a diagram illustrating an operation mode of the multi-projection system according to the present embodiment.

  The multi-projection system according to the present embodiment is configured as described above, so that the projection control device 1 is not necessary.

  When the multi-projection system according to the present embodiment is configured in this way, the projection control apparatus 1 performs projection using the interactive pen 4 by the touch sensor 19 as shown in FIG. You may be comprised so that the mode of the interactive operation to an image may be read. FIG. 56 is a block diagram schematically showing a hardware configuration of the projection control apparatus 1 according to the present embodiment.

Embodiment 16 FIG.
In the first to fifteenth embodiments, the example in which the projection control apparatus 1 stores the projection area management table (FIG. 7) in advance in the projection area storage unit 105 has been described. On the other hand, in the present embodiment, an example in which a projection area management table (FIG. 7) is automatically created will be described.

  The multi-projection system according to the present embodiment is configured in this way, so that, for example, the arrangement of the projectors 2 is replaced, the projector 2 that is normally used is replaced with another projector 2, or the number of projectors 2 is increased. Even if there is a change in the configuration of the multi-screen such as when it is changed, the multi-screen setting can be automatically performed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1, 2, it shall show the same or an equivalent part, and detailed description is abbreviate | omitted.

  First, the functional configuration of the projection control apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 57 is a block diagram schematically showing a functional configuration of the projection control apparatus 1 according to the present embodiment.

  As shown in FIG. 57, the projection control apparatus 1 according to the present embodiment includes a projection area identification image storage unit 119 and a projection area identification control unit 120 in addition to the configuration of the first embodiment.

  The projection area identification image storage unit 119 is image data of an image projected by each projector 2, and as shown in FIG. 58, image data (hereinafter referred to as pattern image 7) indicating each vertex of the image projected by each projector 2. , “Pattern image data”). The projection area identification image storage unit 119 stores image data of QR code (registered trademark) 8 (hereinafter referred to as “QR code image data”) including information for identifying each projector 2.

  FIG. 58 is a diagram showing an example of a projection area identification image that the projection control apparatus 1 according to the present embodiment projects onto the projector 2. Hereinafter, the pattern image 7 and the QR code 8 are collectively referred to as “projection area identification image”, and the image data is collectively referred to as “projection area identification image data”.

  The projection area identification control unit 120 (display area identification unit) reads projection area identification image data from the projection area identification image storage unit 119, transmits the projection area identification image data to each projector 2 via the communication unit 110, and projects and projects the projection area identification image data. The projection area identification image is recognized, and a projection area management table (FIG. 7) is created based on the recognized information. Then, the projection area identification control unit 120 stores the created projection area management table (FIG. 7) in the projection area storage unit 105.

  Next, processing when the projection control apparatus 1 according to the present embodiment creates the projection area management table (FIG. 7) will be described with reference to FIG. FIG. 59 is a sequence diagram for explaining processing when the projection control apparatus 1 according to the present embodiment creates the projection area management table (FIG. 7).

  As shown in FIG. 59, first, in the projection control apparatus 1, the projection area identification control unit 120 reads projection area identification image data from the projection area identification image storage unit 119 (S5901), and each projector via the communication unit 110. 2 (S5902).

  In each projector 2, when the image projection unit 201 receives the projection region identification image data from the projection control device 1 via the communication unit 203, the image projection unit 201 projects the projection region identification image according to the received projection region identification image data. 5 (S5903).

  In the projection control apparatus 1, the projection area identification control unit 120 recognizes the projected projection area identification image (S5904), identifies each projector 2 from the recognized QR code 8, and recognizes the recognized pattern. The projection area (coordinates) of each projector 2 is recognized from the image 7 (S5905).

  Then, the projection area identification control unit 120 creates a projection area management table (FIG. 7) based on the recognized information (S5906), and stores the created projection area management table (FIG. 7) in the projection area storage unit 105. (S5907).

  As described above, the multi-projection system according to the present embodiment is configured to automatically create the projection area management table (FIG. 7).

  The multi-projection system according to the present embodiment is configured in this way, so that, for example, the arrangement of the projectors 2 is replaced, the projector 2 that is normally used is replaced with another projector 2, or the number of projectors 2 is increased. Even if there is a change in the configuration of the multi-screen such as when it is changed, the multi-screen setting can be automatically performed.

Embodiment 17. FIG.
In the second embodiment, no consideration has been given to the case where the icon image 6 is positioned across the projection areas of the plurality of projectors 2 as a result of the operation of moving the icon image 6. However, as a result of the movement operation of the icon image 6, the icon image 6 may be positioned across the projection areas of the plurality of projectors 2.

  Therefore, in the present embodiment, a case will be described in which the icon image 6 is positioned across the projection areas of the plurality of projectors 2 as a result of the movement operation of the icon image 6. With this configuration, the multi-projection system according to this embodiment can project the icon image 6 at an arbitrary position.

  First, in the multi-projection system according to the present embodiment, a state in which a projected icon image is moved by an interactive operation will be described with reference to FIG. FIG. 60 is a diagram illustrating a state when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment.

  In the multi-projection system according to the present embodiment, when the projected icon image is moved by interactive operation, the user moves the icon image 6 to a position where the icon image 6 is to be moved using the interactive pen 4. As a result, as shown in FIG. 60, the icon image 6 may be positioned across the projection areas of the plurality of projectors 2.

  Next, processing when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 61 is a sequence diagram for explaining processing when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment.

  First, the projection control apparatus 1 performs the same processing as S1407 to S1410 described with reference to FIG. 14 (S6101 to S6104).

  In the projection control apparatus 1, the icon image projection control unit 103 refers to the projection area management table (FIG. 7) based on the position recognized in S 6101, and positions the icon image 6 across different projectors 2. It is determined whether or not it has been moved (S6105).

  In the projection control apparatus 1, when the icon image projection control unit 103 determines in the determination process in S <b> 6105 that the icon image 6 has been moved to a position across different projectors 2, the icon image projection control unit 103 stores the icon from the icon image storage unit 101. The icon image data of the image 6 is read to generate divided image data (S6106), and the generated divided image data and the updated projection position in S6104 are transmitted to the corresponding projector 2 via the communication unit 110 (S6107). ).

  In the projector 2, when the image projection unit 201 receives the divided image data and the projection position from the projection control device 1 via the communication unit 203, the image projection unit 201 displays the icon image 6 corresponding to the divided image data at the received projection position. The image is projected superimposed on the image being projected (S6108).

Embodiment 18 FIG.
In the first embodiment, an example has been described in which when a projected icon image 6 is interactively operated, a state operation corresponding to the icon image 6 is executed in the projector that projects the icon image 6.

  On the other hand, in this embodiment, an example in which the projected icon image 6 is enlarged by interactive operation will be described.

  In the multi-projection system configured as described above, one of the gist according to the present embodiment is to perform an enlargement operation by interactive operation of the projected icon image 6 with a simple configuration without expanding the function of the projector. Is to make it possible.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-17, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, in the multi-projection system according to the present embodiment, a state in which a projected icon image is enlarged by interactive operation will be described with reference to FIG. FIG. 62 is a diagram showing a state when the projected icon image is enlarged by interactive operation in the multi-projection system according to the present embodiment.

  In the multi-projection system according to the present embodiment, when the projected icon image is enlarged by interactive operation, the user uses the interactive pen 4 to drag to the position where the frame of the icon image 6 is to be enlarged.

  Then, as shown in FIG. 62, the icon image 6 is enlarged from the original size to the position where the interactive pen 4 is stopped.

  Next, processing when the projected icon image is enlarged by interactive operation in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 63 is a sequence diagram for explaining processing when the projected icon image is enlarged by interactive operation in the multi-projection system according to the present embodiment.

  As shown in FIG. 63, first, in the projection control apparatus 1, the interactive operation recognition unit 104 recognizes the enlargement operation (size change operation) of the icon image 6 using the interactive pen 4 by the user, and the movement operation is projected. It is recognized from which position on the surface 5 to which position the enlargement operation is performed (S6301).

  Then, the projection control apparatus 1 performs the same processing as S1408 and S1409 described with reference to FIG. 14 (S6302 and S6303).

  In the projection control apparatus 1, the icon image projection control unit 103 reads the icon image data of the icon image 6 identified in S6302 from the icon image storage unit 101 (S6304), and the read icon image data in S6301. Enlargement processing is performed based on the recognized position to generate enlarged image data (S6305).

  Then, in the projection control apparatus 1, the icon image projection control unit 103 refers to the projection area management table (FIG. 7) and determines whether or not the icon image 6 is at a position across different projectors 2. (S6306).

  Then, in the projection control apparatus 1, when the icon image projection control unit 103 determines in the determination process in S6306 that the icon image 6 is in a position across different projectors 2, the icon image projection control unit 103 divides the enlarged image data generated in S6305. Image data is generated (S6307), and the generated divided image data is transmitted to the corresponding projector 2 via the communication unit 110 (S6308).

  In the projector 2, when the image projection unit 201 receives the divided image data and the projection position from the projection control device 1 via the communication unit 203, the image projection unit 201 displays the icon image 6 corresponding to the divided image data at the received projection position. The image is projected superimposed on the image being projected (S6309).

  As described above, the multi-projection system according to the present embodiment is configured to be able to perform an enlargement operation by interactive operation of the icon image 6 being projected. Therefore, the multi-projection system according to the present embodiment can be performed with a simple configuration without expanding the function of the projector.

  In the present embodiment, the example of enlarging the icon image 6 has been described, but the same applies to the case of reducing the icon image 6.

Embodiment 19. FIG.

  In the second embodiment, the example in which the projected icon image 6 is moved by interactive operation has been described. However, since the types of state operations that can be performed differ depending on the model and state of the projector 2 that projects an image on the projection area to which the image is to be moved, it is necessary to prevent interactive operation even if the icon image 6 is moved.

  Therefore, in the multi-projection system according to the present embodiment, when the icon image 6 is moved to the projection area by the projector 2 that cannot execute the state operation corresponding to the icon image 6 that is the target of the movement operation, The icon image 6 is projected so that an interactive operation cannot be performed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-17, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, in the multi-projection system according to the present embodiment, a state in which a projected icon image is moved by an interactive operation will be described with reference to FIG. FIG. 64 is a diagram showing a state when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment.

  In the multi-projection system according to the present embodiment, when the projected icon image is moved by interactive operation, the user moves the icon image 6 to a position where the icon image 6 is to be moved using the interactive pen 4.

  However, the projector 2 that projects an image on the destination projection area may not be able to execute the state operation corresponding to the icon image 6 that is the target of the movement operation, depending on the model and state.

  In such a case, as shown in FIG. 64, the multi-projection system according to the present embodiment applies the projection operation to the projection area by the projector 2 that cannot execute the state operation corresponding to the icon image 6 that is the target of the movement operation. When the icon image 6 is moved, the icon image 6 is projected so that an interactive operation cannot be performed.

  With this configuration, the multi-projection system according to the present embodiment can appropriately notify the user of the executable state operation and the inoperable state operation.

  Next, processing when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment will be described with reference to FIG. FIG. 65 is a sequence diagram for explaining processing when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment.

  First, the projection control apparatus 1 performs the same processing as S1407 to S1410 described with reference to FIG. 14 (S6501 to S6504).

  In the projection control apparatus 1, the icon image projection control unit 103 inquires of the projector 2 that projects an image on the area after the icon image 6 has been moved about the model and state via the communication unit 110 (S6505).

  In the projector 2, when the state operation control unit 202 receives an inquiry about the model and state from the projection control device 1 via the communication unit 203, the state operation control unit 202 notifies the projection control device 1 of the model and state via the communication unit 203. (S6506).

  In the projection control apparatus 1, when the model and state are notified from the projector 2 via the communication unit 110, the icon image projection control unit 103 manages the model-specific projectable icon image management based on the notified model and state. With reference to the table (FIG. 18) and the state-by-state projectable icon image management table (FIG. 22), it is determined whether or not the icon image 6 subjected to the moving operation can be projected (S6507).

  Then, in the projection control apparatus 1, when the icon image projection control unit 103 determines in the determination process in S6507 that the icon image 6 that is the target of the movement operation cannot be projected, the icon image 6 cannot be interactively operated. Is read from the icon image storage unit 101 (S6508).

  In the projection control apparatus 1, the icon image projection control unit 103 transmits the read operation disabled icon image data and the projection position updated in S6504 to the projector 2 via the communication unit 110 (S6509).

  In the projector 2, when the image projecting unit 201 receives the operation disabled icon image data and the projection position from the projection control device 1 via the communication unit 203, the operation disabled icon corresponds to the received projection position according to the image data. The operation-impossible icon image is superimposed on the image being projected and projected (S6510).

  As described above, in the multi-projection system according to the present embodiment, the icon image 6 moves to the projection area by the projector 2 that cannot execute the state operation corresponding to the icon image 6 that is the object of the movement operation. If it is, the icon image 6 is projected so that an interactive operation cannot be performed.

  With this configuration, the multi-projection system according to the present embodiment can appropriately notify the user of the executable state operation and the inoperable state operation.

Embodiment 20. FIG.
In the nineteenth embodiment, when the icon image 6 is moved to the projection area by the projector 2 that cannot execute the state operation corresponding to the icon image 6 that is the object of the moving operation, the interactive operation cannot be performed. An example in which the icon image 6 is projected on the screen has been described.

  On the other hand, in the present embodiment, when the projector 2 that projects an image on the projection area to which the icon image 6 is moved cannot execute the state operation corresponding to the icon image 6, the icon image 6 is prohibited from moving. The case where it does is demonstrated.

  With this configuration, the multi-projection system according to the present embodiment can appropriately notify the user of the executable state operation and the inoperable state operation.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, about the structure which attaches | subjects the code | symbol similar to Embodiment 1-17, the same or an equivalent part shall be shown and detailed description is abbreviate | omitted.

  First, with reference to FIG. 66, a description will be given of processing for moving a projected icon image by an interactive operation in the multi-projection system according to the present embodiment. FIG. 66 is a sequence diagram for explaining processing when the projected icon image is moved by interactive operation in the multi-projection system according to the present embodiment.

  First, the projection control apparatus 1 performs the same processing as S1407 to S1409 described with reference to FIG. 14 (S6601 to S6603).

  In the projection control apparatus 1, the icon image projection control unit 103 inquires of the projector 2 that projects an image on the area after the icon image 6 has been moved through the communication unit 110 about the model and state (S6604).

  In the projector 2, when the state operation control unit 202 receives an inquiry about the model and state from the projection control device 1 via the communication unit 203, the state operation control unit 202 notifies the projection control device 1 of the model and state via the communication unit 203. (S6605).

  In the projection control apparatus 1, when the model and state are notified from the projector 2 via the communication unit 110, the icon image projection control unit 103 manages the model-specific projectable icon image management based on the notified model and state. With reference to the table (FIG. 18) and the state-by-state projectable icon image management table (FIG. 22), it is determined whether or not the icon image 6 subjected to the moving operation can be projected (S6606).

  In the projection control apparatus 1, if the icon image projection control unit 103 determines in the determination process in S6507 that the icon image 6 that is the target of the movement operation cannot be projected, the process is ended.

  As described above, in the multi-projection system according to this embodiment, the projector 2 that projects an image on the projection area to which the icon image 6 is moved cannot execute the state operation corresponding to the icon image 6. The icon image 6 is prohibited from moving.

  With this configuration, the multi-projection system according to the present embodiment can appropriately notify the user of the executable state operation and the inoperable state operation.

DESCRIPTION OF SYMBOLS 1 Projection control apparatus 2 Projector 2a Projector 2b Projector 3 PC
4 Interactive Pen 5 Projection Surface 5a Projection Area 5b Projection Area 5c Projection Area 6 Icon Image 7 Pattern Image 8 QR Code (Registered Trademark)
11 CPU
12 RAM
13 ROM
14 NVRAM
15 Operation display device 16 Communication I / F
17 Imaging Device 18 Bus 19 Touch Sensor 21 CPU
22 RAM
23 ROM
24 NVRAM
25 Operation Display Device 26 Communication I / F
27 Image projection device 28 Bus 101 Icon image storage unit 102 Icon image projection position storage unit 103 Icon image projection control unit 104 Interactive operation recognition unit 105 Projection area storage unit 106 Operation target device identification unit 107 Operation icon image identification unit 108 Operation content storage Unit 109 operation content determination unit 110 communication unit 111 model-specific projectable icon image storage unit 112 state-specific projectable icon image storage unit 113 model-specific operation content storage unit 114 state-specific operation content storage unit 115 operation content transmission destination storage unit 116 state Separate operation content transmission destination storage unit 117 Model-specific operation content transmission destination storage unit 118 Interlocking operation storage unit 119 Projection area identification image storage unit 120 Projection area identification image recognition unit 201 Image projection unit 202 State operation control unit 203 Communication unit

JP 2005-274937 A

Claims (22)

An information processing device that causes an image corresponding to the content of processing executed by a display device to be displayed on a plurality of the display devices, and causes the display device to execute the processing according to an operation on the displayed image,
An image display control unit for displaying the image on the display device;
An operation position recognition unit for recognizing a position of an operation performed on a display surface on which the display device displays the image;
A device identification unit for identifying a display device displaying the operated image based on the recognized position;
An image identification unit for identifying the operated image based on the recognized position;
A processing content determination unit that determines the content of the processing according to the identified image;
A process execution control unit that causes the identified display device to execute the process whose content is determined;
An information processing apparatus comprising: A movement operation recognition unit for recognizing the movement operation of the image based on the recognized position;
The image display control unit, when the movement operation of the image is recognized, changes the display position of the image from a position before movement by the movement operation to a position after movement. The information processing apparatus described.   The said image display control part displays the said image according to the content of the process which the said display apparatus can perform on the said display apparatus according to the model of the said display apparatus. Information processing device.   The said image display control part displays the said image according to the content of the process which the said display apparatus can perform on the said display apparatus according to the state of the said display apparatus. The information processing apparatus according to item 1.   The information processing apparatus according to claim 1, wherein the processing content determination unit determines the content of the processing according to a model of the display device.   The information processing apparatus according to claim 1, wherein the processing content determination unit determines the content of the processing according to a state of the display device. A process execution device determination unit that determines a display device that executes the process according to the identified image or the determined content of the process,
The information processing apparatus according to claim 1, wherein the process execution control unit causes the determined display device to execute the process.   The information processing apparatus according to claim 7, wherein the process execution control unit determines a display apparatus that executes the process according to a state of the display apparatus.   The information processing apparatus according to claim 7, wherein the process execution control unit determines a display apparatus that executes the process according to a model of the display apparatus.   When an operation is performed on the image, the image display control unit displays the same image as the operated image on a display device other than the display device that displays the operated image. The information processing apparatus according to claim 1, wherein the information processing apparatus is displayed.   When an operation is performed on the image, the image display control unit ends display of another image displayed by a display device other than the display device displaying the image on which the operation has been performed. The information processing apparatus according to claim 1, wherein the same image as the operated image is displayed.   When the operation on the image is performed, the image display control unit ends the display of another image displayed by a display device other than the display device displaying the image on which the operation has been performed. The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus.   The image display control unit causes the display device to display the image at a position where the image is not displayed when an operation on a position where the image is not displayed on the display surface is recognized. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 1, further comprising: a display area identifying unit that associates each display area with the plurality of display apparatuses with each display apparatus.   The said image display control part divides | segments the said image and displays it on each display apparatus so that the said image may be displayed on the position which straddles between the said several display apparatus. The information processing apparatus according to item 1. A resize operation recognizing unit for recognizing a resize operation of the image based on the recognized position;
The said image display control part changes the size of the said image, and displays it on the said display apparatus, when the said size change operation of the said image is recognized. Information processing device. A movement operation recognition unit for recognizing the movement operation of the image based on the recognized position;
When the moving operation is recognized, the display device that displays the image at a position after the movement by the moving operation can execute processing according to the image that is the target of the moving operation. A process execution determination unit for determining whether to execute the process,
With
When it is determined that the image display control unit cannot be executed as a result of the process execution determination, the image display control unit is a target of the movement operation on a display device that displays the image at a position after movement by the movement operation. The information processing apparatus according to claim 1, wherein the image is displayed so that the image cannot be operated. A movement operation recognition unit for recognizing the movement operation of the image based on the recognized position;
When the moving operation is recognized, the display device that displays the image at a position after the movement by the moving operation can execute processing according to the image that is the target of the moving operation. A process execution determination unit for determining whether to execute the process,
With
When it is determined that the image display control unit cannot be executed as a result of the process execution determination, the image display control unit is a target of the movement operation on a display device that displays the image at a position after movement by the movement operation. The information processing apparatus according to claim 1, wherein the image is not displayed.   A display device comprising the information processing device according to claim 1. Information that causes a plurality of display devices and images corresponding to the contents of processing executed by the display devices to be displayed on the plurality of display devices, and causes the display device to execute the processing according to an operation on the displayed image An information processing system comprising a processing device,
The information processing apparatus includes:
An image display control unit for displaying the image on the display device;
An operation position recognition unit for recognizing a position of an operation performed on a display surface on which the display device displays the image;
A device identification unit for identifying a display device displaying the operated image based on the recognized position;
An image identification unit for identifying the operated image based on the recognized position;
A processing content determination unit that determines the content of the processing according to the identified image;
A process execution control unit that causes the identified display device to execute the process whose content is determined;
An information processing system comprising: An image corresponding to the content of processing executed by the display device is displayed on a plurality of the display devices, and the information processing device is operated to cause the display device to execute the processing according to an operation on the displayed image. An information processing program,
Displaying the image on the display device;
Recognizing a position of an operation performed on the display surface on which the display device displays the image;
Identifying a display device displaying the operated image based on the recognized position;
Identifying the manipulated image based on the recognized position;
Determining the content of the process according to the identified image;
Causing the identified display device to execute the process whose content has been determined;
An information processing program for causing an information processing apparatus to execute. An image corresponding to the content of processing executed by the display device is displayed on a plurality of the display devices, and the information processing device is operated to cause the display device to execute the processing according to an operation on the displayed image. An information processing method,
Displaying the image on the display device;
Recognizing the position of the operation performed on the display surface on which the display device displays the image;
Identifying a display device displaying the operated image based on the recognized position;
Identifying the manipulated image based on the recognized position;
Determining the content of the process according to the identified image;
An information processing method, comprising: causing the identified display device to execute the process whose content is determined.