JP2009080663A - Image projection system, image projection device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image projection system which smoothly performs collaboration and/or information sharing among a plurality of persons by reducing a load to a communication channel and enabling an image data transmitted from another terminal to be edited and operated. <P>SOLUTION: In the image projection system, the image projection device includes an image acquisition unit acquiring an image data residing on a predetermined display region in each terminal device, an image processing unit synthesizing the acquired image data, an image projection unit projecting an image based on the synthesized image data, and an operation instruction processing unit transmitting an image operation instruction to the terminal device having transmitted the image data as an operation target when receiving the image operation instruction. The terminal device includes a memory unit storing a data file, an image generation unit generating an image data based on the data file, a predetermined region image transmission unit transmitting to the image projection device the image data corresponding to a part or the whole of the image when the image resides in the predetermined display region, and an editing unit editing the data file according to the image operation instruction when receiving the image operation instruction from the image projection device. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image projection system and an image projection apparatus and program used therefor, and more particularly to an image projection system capable of efficiently performing joint work and information sharing by a plurality of people.

  Conventionally, as an image projection apparatus, for example, a projector that inputs image information from a computer apparatus or the like, displays the image on a liquid crystal display element, irradiates light on the liquid crystal display element, and projects the enlarged image on a projection screen. Widely used.

  This type of projector is often used in a meeting or the like where a plurality of people participate, and by using such a projector, discussion can be promoted while a plurality of participants see one enlarged image at the same time. I can go.

On the other hand, by connecting a plurality of terminal devices via a communication path such as a network, information sharing and collaborative work in conferences and the like are often efficiently performed. For example, in Patent Document 1, as shown in FIG. 33, in a conference support system including a server and a plurality of terminal devices, the server 510 transmits image data 530a transmitted from the plurality of terminal devices 520a to 520c. ˜530c are combined, the combined image data 540 is transmitted to the plurality of terminal devices 520a to 520c, and an image based on the image data 540 is displayed on the screen of each of the terminal devices 520a to 520c. A conference support system 500 is disclosed that allows a person to discuss while looking at the same image.
JP 2006-31359 A

  By connecting a projector to a terminal device or server that constitutes a conference support system as in Patent Document 1, a plurality of participants can view a single enlarged image at the same time, and each participant as necessary It is possible to proceed with the discussion while editing the image of his terminal device.

  However, in the invention described in Patent Document 1, since the server transmits image information synthesized for each of a plurality of terminal devices, the number of terminal devices connected to the server via a communication path such as a network increases. Therefore, the amount of image information to be transmitted increases in proportion to the number of terminal devices, which places a heavy load on the communication path, and it is not possible to smoothly share information in a conference or the like.

  Furthermore, in the invention described in Patent Document 1, editing of images held by each terminal device must be performed by operating the operation unit of the terminal device that generates the image. The work could not be done smoothly.

  Therefore, the present invention reduces the load on the network and enables images to be shared and collaborated smoothly by a plurality of people by enabling image editing other than the terminal device that generates the images. It is an object of the present invention to provide a projection system, and an image projection apparatus and program used therefor.

  In order to solve the above problem, the invention described in claim 1 acquires a plurality of terminal devices and image data from the plurality of terminal devices via a communication path, and projects an image based on the image data. In the image projection system comprising an image projection device, the image projection device obtains image data of an image in a predetermined display area of each terminal device via the communication path, and the plurality of terminals An image processing unit that synthesizes image data of an image in a predetermined display area of the apparatus, an image projection unit that projects an image based on the image data synthesized by the image processing unit, and an image that is projected by the image projection unit When an image operation command for operating a predetermined image is acquired, the image operation command is sent to the terminal device that has transmitted the image data of the image to be operated by the image operation command. An operation command processing unit for transmitting via a communication path, wherein the terminal device stores a data file, an image generation unit for generating image data based on the data file, and the image generation unit A predetermined area image transmitting unit that transmits part or all of the image data of the image to the image projecting device via the communication path when the position of the image based on the image data generated in is in the predetermined display area; And an editing unit that edits the data file in response to the image operation command when the image operation command is received from the image projection device via the communication path.

According to a second aspect of the present invention, in the first aspect of the invention, the terminal device includes a display unit capable of displaying an image based on the image data generated by the image generation unit, and the predetermined display area. A virtual display area setting section for setting a virtual display area adjacent to the display area of the display section.

  The invention according to claim 3 is the invention according to claim 1 or 2, wherein the terminal device operates an image in a predetermined display area of the terminal device projected by the image projection device. And an operation command transmission unit that transmits an image operation command corresponding to the operation to the image projection device via the communication path when the operation unit is operated in a predetermined manner. It is characterized by.

  According to a fourth aspect of the present invention, in the third aspect of the present invention, the terminal device includes an instruction unit for instructing an image projected by the image projection device, and the operation command transmission unit. Transmits an image instruction command corresponding to the operation to the image projecting device via the communication path when the instruction unit is operated in a predetermined manner, and the image processing unit of the image projecting device receives from the terminal device When an image instruction command is received, a pointer image is synthesized at a position based on the image instruction command together with image data of an image in a predetermined display area of the plurality of terminal devices.

  The invention according to claim 5 is the invention according to any one of claims 1 to 4, wherein the control unit of the terminal device uses the image generation unit based on the edited data file. Each time image data in the predetermined display area is generated, the image data of the image in the predetermined display area is transmitted to the image projection device via the communication path.

  According to a sixth aspect of the invention, in the first aspect of the invention according to any one of the first to fifth aspects, the image processing unit of the image projection device is an image of an image in a predetermined display area of each terminal device. A different hierarchical level is assigned to each data, and the image data is synthesized by superimposing and synthesizing the image data in the hierarchical level order.

  According to a seventh aspect of the invention, in the sixth aspect of the invention, the image acquisition unit of the image projection device projects the image projection out of image data of an image in a predetermined display area of each terminal device. The image data of the image projected by the image unit is requested to the terminal device, and the predetermined area image transmitting unit of the terminal device has a position of the image based on the image data generated by the image generating unit in the predetermined display area. The image data of the requested image among the images is transmitted to the image projection apparatus.

  The invention according to claim 8 is the invention according to any one of claims 1 to 7, wherein the predetermined area image transmitting unit of the terminal device is associated with the image data in addition to the image data. Image attribute information that is information to be transmitted to the image projection apparatus via the communication path, and the image acquisition unit of the image projection apparatus acquires the image attribute information via the communication path, and the image projection The image processing unit of the apparatus synthesizes image data of images in a predetermined display area of the plurality of terminal devices based on the image attribute information.

  The invention according to claim 9 is the invention according to claim 8, wherein the operation command processing unit of the image projection device stores image data of an image to be operated by the acquired image operation command as the image data. The determination is based on the image attribute information acquired by the image acquisition unit.

  According to a tenth aspect of the present invention, there is provided an image projection apparatus that acquires image data of an image in a predetermined display area of a plurality of terminal devices via a communication path, and projects an image based on the image data. An image acquisition unit that acquires image data of an image in a predetermined display area of the terminal device, an image processing unit that combines image data of images in the predetermined display area of the plurality of terminal devices, and a combination by the image processing unit An image projecting unit that projects an image based on the image data and an image operation command for operating a predetermined image out of the images projected by the image projecting unit. And an operation command processing unit that transmits the image operation command to the terminal device that has transmitted the image data of the image via the communication path.

  According to the eleventh aspect of the present invention, when the position of an image generated based on a data file by an application program is in a predetermined display area, part or all of the image data of the image is sent to the image projection device. A means for transmitting via a communication path; a means for operating an image projected by the image projection apparatus; and an image operation command corresponding to an operation when the operation means is operated in a predetermined manner. Means for transmitting via the communication path, and when the image operation command is received from the image projection device via the communication path, causes the application program to edit the data file according to the image operation command. The program is characterized by functioning as means.

  According to the first, tenth, and eleventh aspects of the present invention, the image based on the image data synthesized by the image processing unit of the image projection device is projected on a large screen such as a screen by the image projection unit of the image projection device. Thus, since it is not necessary to transmit the image data of the synthesized image to each terminal device, the load on the communication path can be reduced. As a result, many terminal devices are connected to the image projection device. In addition, information can be shared smoothly by a plurality of people.

  Furthermore, when the image projection apparatus acquires an image operation command for operating a predetermined image among the images projected by the image projection unit, the image projection apparatus transmits image data of an image to be operated by the image operation command. Since the image operation command is transmitted to the terminal device, and the terminal device edits the data file in response to the image operation command, the image can be edited from a device other than the terminal device that generates the image. , It is possible to smoothly collaborate by multiple people.

  According to the second aspect of the present invention, by providing the terminal device with a virtual display area as a predetermined display area separately from the display area of the display unit, information sharing and collaborative work by a plurality of persons can be performed smoothly. be able to. For example, since the user of the terminal device can clearly distinguish a predetermined display area and an area other than the predetermined display area, it is possible to prevent an unintended image from being projected and displayed. Further, since the image of the display area of the display unit is not projected and displayed by the image projection apparatus, the display area of the display unit can be used as a work space only for the user of the terminal device.

  According to the third aspect of the present invention, an image in a predetermined display area of another terminal device can be operated, and further, the operation of the image is performed to the terminal device that has transmitted the image data of the operation target image. Since it is performed by transmitting an image operation command, a user of a terminal device can operate an image of another terminal device by operating the terminal device, and as a result, a joint operation performed by a plurality of people. Work can be performed smoothly.

  According to the invention described in claim 4, the user of the terminal device can grasp where he / she is pointing in the area projected by the image projection device, and can be collaborated by a plurality of people. Work can be easily performed.

  According to the fifth aspect of the present invention, since the image projected by the image projection device can be updated in real time, it becomes possible to smoothly share information and collaborate with multiple people.

  According to the invention described in claim 6, since the image processing unit of the image projection device superimposes and synthesizes the image data of the image in the predetermined display area of each terminal device in the hierarchical level, the resolution of the image projection device is increased. Even if the angle of view is not increased, the projected and displayed image does not become difficult to see, and as a result, information sharing and collaborative work by a plurality of people can be performed smoothly.

  According to the seventh aspect of the present invention, when the predetermined area image transmission unit of the terminal device is combined with a plurality of image data by the image processing unit of the image projection apparatus among the image data of the image in the predetermined display area. In addition, since image data of a portion of the image that is not projected by the image projection unit is not transmitted to the image projection device, extra image data is not transmitted to the image projection device, and the data size of the transmitted image data can be reduced. As a result, the burden on the communication path can be reduced.

  According to the invention described in claim 8, since the image projection apparatus can synthesize image data based on the image attribute information, for example, the image attribute information is information on the position and size of the image. Thus, it is possible to project and display the image data arranged on the basis of the information.

  According to the ninth aspect of the present invention, since the image data of the image to be operated by the acquired image operation command is determined based on the image attribute information, the image data of the image to be operated is determined. It is not necessary to request each terminal device separately for each operation, and the burden on the communication path can be reduced.

[1. Overview of image projection system]
Hereinafter, an image projection system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an overall system configuration of an image projection system in this embodiment, FIG. 2 is a schematic configuration diagram of an image projection apparatus used in the image projection system in this embodiment, and FIG. 3 is this embodiment. It is a schematic block diagram of the terminal device used for the image projection system in a form.

  As shown in FIG. 1, the image projection system S according to the present embodiment includes an image projection device 1 and a plurality of terminal devices (here, terminal devices 2 a, 2) connected to the image projection device 1 via a communication path 3. 2b), and each terminal device 2a among images generated by an application program (hereinafter also simply referred to as “application”) executed by the plurality of terminal devices 2a and 2b. , 2b, the image data of the image in the predetermined display area is synthesized as one image data, and an image based on the synthesized image data is projected on a large screen such as a screen. In addition, the image projection system S receives a predetermined image among images projected by the image projection device from an arbitrary terminal device or a remote control device (not shown) to another terminal device via the image projection device 1. By transmitting an image operation command for operation, not only an image generated by an application executed on its own terminal device among images projected on a large screen based on the image operation command. An image generated by an application running on another terminal device can also be edited.

  In the present embodiment, a case where two terminal devices are connected to the image projection device 1 will be described. However, the number of terminal devices connected to the image projection device 1 is not limited to this. In the following, when any one of the terminal devices 2a and 2b is expressed, it may be expressed as the terminal device 2.

  In the image projection system S according to the present embodiment, as shown in FIG. 2, the image projection apparatus 1 includes an image acquisition unit 10, an image processing unit 11, an image projection unit 12, an operation command processing unit 13, and a storage. Part 14. As shown in FIG. 3, the terminal device 2 includes a storage unit 20, an image generation unit 21, a predetermined area image transmission unit 22, an editing unit 23, a display unit 24, and a virtual display region setting unit 25. , An operation unit 26, an operation command transmission unit 27, and an instruction unit 28.

  The overall operation of the image projection system S according to the present embodiment is mainly a connection operation for connecting the image projection device 1 and the terminal device 2 and a plurality of image data acquired from each terminal device 2. Then, a projection operation for projecting the synthesized image data and an editing operation for editing an arbitrary data file in response to a request from the terminal device 2 are performed. Below, an example of the flow of the whole operation | movement of the image projection system S concerning this embodiment is demonstrated roughly with reference to FIGS.

  First, the connection operation will be described with reference to FIG. FIG. 4 is a sequence diagram illustrating an example of a connection operation in the image projection system S of the present embodiment. This operation is performed in each of the terminal device 2a and the terminal device 2b.

  As shown in FIG. 4, first, when the user of the terminal device 2 performs an activation operation on the terminal device 2 using the operation unit 26 (step S01), the terminal device 2 receives an operation command transmission unit 27. A connection request signal is transmitted to the image projection apparatus 1 (step S02). Next, when the image projection apparatus 1 receives the connection request signal, the image acquisition apparatus 10 sets the image projection apparatus 1 to the terminal apparatus 2 from the image acquisition unit 10 in order to unify the resolution of the image data acquired from the plurality of terminal apparatuses 2. The resolution information that has been set is transmitted (step S03).

  Next, the terminal device 2 creates a virtual display area as a predetermined display area based on the received resolution information (step S04). As shown in FIG. 1, in the terminal devices 2a and 2b, the virtual display areas are virtual display areas 45a and 45b adjacent to the display areas 40a and 40b of the respective display units 24. The virtual display area setting unit 25 is set. Hereinafter, when any one of the display areas 40a and 40b appears, it is expressed as the display area 40, and when any one of the virtual display areas 45a and 45b is expressed, it may be expressed as a virtual display area 45. .

  In the present embodiment, the virtual display area 45 is set as the predetermined display area as described above. This predetermined display area is, for example, a part of the display area of the display unit 24 provided in the terminal device 2. May be provided.

  When the virtual display area 45 is created in step S04, the terminal device 2 notifies the image projecting device 1 that the activation work has been completed from the operation command transmission unit 27 (step S05). Then, the image projection device 1 that has received the notification notifies the terminal device 2 that the connection has been completed from the operation command processing unit 13 (step S06), whereby the image projection device 1 and the terminal device 2 are connected. The connection process is complete.

  Next, the projection operation will be described with reference to FIG. FIG. 5 is a sequence diagram showing an example of the projection operation in the image projection system S of the present embodiment.

  As shown in FIG. 5, when the user A performs an operation for executing the application program of the terminal device 2a (step S07), the terminal device 2a executes the application program that is the operation target, and the application data Image data corresponding to the file is generated (step S08). The execution operation of the application program is performed by the user A using the operation unit 26.

  Here, the data file is a saved data file of an application executed by various applications such as spreadsheet software and graphic creation software possessed by the terminal device 2, and is stored in the storage unit 20 possessed by each terminal device 2. ing.

  The application program functions as the image generation unit 21 and the editing unit 23 in the terminal device 2. In other words, when the user of the terminal device 2 performs an operation of executing a data file using the operation unit 26, the application program performs an image based on the data file stored in the storage unit 20 as the image generation unit 21 (for example, FIG. 1, data of images 30 a to 30 d generated by the terminal device 2 a and images 30 e to 30 g generated by the terminal device 2 b are generated. Further, when the user of the terminal device 2 performs a predetermined operation on the image data generated by the image generation unit 21 using the operation unit 26 or the instruction unit 28, the application program becomes the editing unit 23. Edit the data file based on the operation.

  As described above, when the image data based on the data file is generated by the image generation unit 21, the terminal device 2a displays an image based on the generated image data on the display unit 24 (step S09).

  Also in the terminal device 2b, the processing from the above steps S07 to S09 is performed. Here, the processing from step S10 to S12 in FIG. 5 is the same as the processing from step S07 to S09, and therefore the description thereof is omitted.

  Next, when an image generated by an application executed on the terminal device 2a is positioned in the virtual display area 45a by the operation of the user A (step S13), the terminal device 2a displays the image in the virtual display area 45a. Is detected (step S14), and the image attribute information is updated based on the detection result (step S15). The image attribute information is information related to the image in the virtual display area 45, and information such as the position and size of the image in addition to identification information (window ID) for identifying each image in the virtual display area 45. The details will be described later.

  As an operation by the user to position the image displayed in the display area 40 of the display unit 24 in the virtual display area 45, the user moves the image to the virtual display area 45 using the operation unit 26 described later. A predetermined button is provided at a predetermined position (for example, a caption bar) of the image displayed in the display area 40, and when the user presses this button using the operation unit 26, the image moves to the virtual display area 45. You may make it do.

  When the image attribute information is updated, the terminal device 2a transmits the updated image attribute information to the image projection device 1 (step S16). Here, the processing of steps S14 to S16 is performed by the predetermined area image transmission unit 22.

  In the terminal device 2b, the above steps S13 to S16 are also performed. Here, in FIG. 5, the processing from step S17 to S20 is the same as the processing from step S13 to S16, and thus the description thereof is omitted.

  Next, when receiving image attribute information from each terminal device 2, the image projecting device 1 updates the information in the image attribute information management table (step S21). The image attribute information management table is a table for managing image attribute information related to a plurality of image data acquired from a plurality of terminal devices 2, and is stored in a predetermined area of the storage unit 14 provided in the image projection device 1. Is done. Here, the reception of the image attribute information and the update of the image attribute information management table are performed by the image acquisition unit 10.

  Next, the image projection device 1 transmits image data request information to the terminal devices 2a and 2b based on the information in the image attribute information management table (steps S22 and S23). This image data request information is for requesting the terminal device 2 for image data of an image projected by the image projection unit 12 of the image projection apparatus 1 among the image data of the image in the virtual display area 45. That is, when the image in the virtual display area 45b is superimposed and synthesized with another image by the image processing unit 11 of the image projection device 1, the image data of the image of the portion that is not hidden by the other image (the portion that can be visually recognized). Only to send. The image projection apparatus 1 transmits this image data request information from the image acquisition unit 10.

  Then, each terminal device 2a, 2b transmits part or all of the image data in the virtual display areas 45a, 45b to the image projection device 1 via the communication path 3 based on the image data request information. (Steps S24 and S25). The transmission of the image data is performed by the predetermined area image transmission unit 22.

  Finally, the image projection device 1 that has received the image data combines the image data acquired from the terminal devices 2a and 2b based on the information in the image attribute information management table, and further, the image based on the combined image data. (Hereinafter also referred to as “composite image”) is projected by the image projection unit 12 (step S26). Here, the image processing unit 11 combines the image data acquired from the terminal devices 2a and 2b.

  That is, for example, as shown in FIG. 1, the image 30c and the image 30d are located in the virtual display area 45a of the terminal device 2a, and the image 30f and the image 30g are located in the virtual display area 45b of the terminal device 2b. In this case, the image projection device 1 acquires the image data of the images 30c and 30d acquired from the terminal device 2a and the image data of the images 30f and 30g acquired from the terminal device 2b by the image acquisition unit 10, and The image processing unit 11 combines these image data, and the image projection unit 12 projects a combined image 50 based on the combined image data. Note that the image 30c is located over both the virtual display area 45a and the area 40a other than the virtual display area 45a. In this case, the image projection device 1 includes the virtual display area of the image 30c. Only the image data of the image of the part located at 45a is acquired.

  As described above, the image based on the image data synthesized by the image processing unit of the image projection device is projected on a large screen such as a screen by the image projection unit of the image projection device, and thus the image of the image synthesized on each terminal device. Since it is not necessary to transmit data, the load on the communication path can be reduced. As a result, even when many terminal devices are connected to the image projection device, the information sharing between the above-mentioned multiple people is facilitated. Can be done.

  Further, in the terminal device 2 according to the present embodiment, not all the image data of the image in the virtual display area 45 is transmitted, but the image processing unit 11 of the image projection device 1 uses the image data of another terminal device 2. The image data of the portion hidden by the other image data is not transmitted. That is, for example, as shown in FIG. 1, a composite image 50 generated by combining the image data of the images 30c and 30d of the terminal device 2a and the image data of the images 30f and 30g of the terminal device 2b is a projection area. In the case where the image 30d is projected onto the image 60d, there is a portion that is hidden and not projected by the image 30f and the image 30g. Therefore, the predetermined area image transmission unit 22 of the terminal device 2b combines the image data of the image 30d. Accordingly, the image data of the portion of the image that is hidden by the image 30f and the image 30g is not transmitted, and only the image data of the portion of the image that is to be projected onto the projection region 60 of the image projection device 1 is transmitted to the image projection device 1. To send to.

  Thus, when the predetermined area image transmission unit 22 of the terminal device 2 is combined with a plurality of image data by the image processing unit 11 of the image projection apparatus 1 out of the image data of the image in the virtual display area 45, Since the image data of the portion of the image that is not projected by the image projection unit 12 is not transmitted to the image projection device 1, excess image data is not transmitted to the image projection device 1, and the data size of the transmitted image data can be reduced. As a result, the burden on the communication path 3 can be reduced.

  Further, as described above, in the image projection system S in the present embodiment, the predetermined area image transmission unit 22 of the terminal device 2 transmits the image attribute information, which is information related to the image data, via the communication path 3. 1, the image acquisition unit 10 of the image projection device 1 acquires image attribute information via the communication path 3, and the image processing unit 11 of the image projection device 1 uses a plurality of terminals based on the image attribute information. The image data of the image in the virtual display area 45 of the device 2 is synthesized. With this configuration, the image projection apparatus 1 can synthesize image data based on the image attribute information. For example, by using the image attribute information as information on the position and size of the image, Based on the information, the image data can be arranged and projected and displayed.

  In the present embodiment, the control unit of the terminal device 2 generates an image in the virtual display area 45 each time image data in the virtual display area 45 is generated based on the edited data file by the image generation unit. The image data is transmitted to the image projection apparatus 1.

  That is, as shown in FIG. 5, every time the image attribute information is updated in step S15, the updated image attribute information is transmitted to the image projecting device 1, whereby the user of the terminal device 2 performs a predetermined operation. Can be smoothly performed from when the image data is transmitted to when the image data is transmitted to the image projection apparatus 1 at step S24. In other words, since the image projected by the image projection apparatus 1 can be updated in real time, it becomes possible to smoothly share information and collaborate with multiple people.

  Further, in the present embodiment, by providing the terminal device 2 with a virtual display area 45 as a predetermined display area separately from the display area 40 of the display unit 24, information sharing and collaborative work by a plurality of people can be performed smoothly. be able to. For example, the user of the terminal device 2 can clearly distinguish between a predetermined display area and an area other than the predetermined display area, so that an unintended image can be prevented from being projected and displayed. Further, since the image of the display area 40 of the display unit 24 is not projected and displayed by the image projection apparatus 1, the display area 40 of the display unit 24 can be used as a work space for only the user of the terminal device 2.

  By the way, in the image projection system S according to the present embodiment, it is possible to edit an arbitrary data file in response to a request from the terminal device 2. That is, in this embodiment, when the image projection apparatus 1 acquires an image operation instruction for operating an arbitrary image among the images projected by the image projection unit 12 from another terminal apparatus or the like, The processing unit 13 transmits the image transmission information to the terminal device 2 that has transmitted the image data of the image to be operated by the image operation command. When the terminal device 2 receives the image operation command, the editing unit 23 receives the image operation command. Thus, the data file is edited in accordance with the image operation command.

  Hereinafter, this editing operation will be described in more detail with reference to FIG. FIG. 6 is a sequence diagram illustrating an example of an editing operation in the image projection system S of the present embodiment.

  As shown in FIG. 6, a user A of the terminal device 2a performs a predetermined operation input (for example, for an image in the virtual display area 45b of the terminal device 2b out of the image 50 projected by the image projecting device 1). When the image is moved (step S27), the terminal device 2a acquires an image operation command based on the operation (step S28). Here, the operation of the image in the virtual display area 45 of the terminal device 2 projected by the image projection device 1 is performed by the user using the operation unit 26 or the instruction unit 28.

  Next, the terminal device 2a discards the image operation input in order to prevent the operation by the user A from being executed on the terminal device 2a (step S29), and sends the image operation command to the image via the communication path 3. It transmits to the projection apparatus 1 (step S30). Here, the discard of the image operation input and the transmission of the image operation command are performed by the operation command transmission unit 27 of the terminal device 2.

  Next, when an image operation command is received from the terminal device 2a, the image projection device 1 causes the operation command processing unit 13 to perform processing for distributing the image operation command to each terminal device 2 to which the image operation command is to be transmitted ( Step S31). Here, the image operation command is distributed so as to be transmitted to the terminal device 2b.

  Further, the image projection device 1 determines the hierarchical level assigned to each image in the virtual display area 45 of each terminal device 2 based on the received image operation command and the image attribute information acquired by the image acquisition unit 10. Update (step S32). That is, the image projection apparatus 1 determines which image has been operated based on the image operation command and the image attribute information, and sets the hierarchical level of the image managed in the image attribute information management table to the top layer. Then, a process of sequentially lowering the hierarchical level of other images is performed. Here, the update of the hierarchical level is performed by the image processing unit 11.

  As described above, in the present embodiment, the image processing unit 11 of the image projection device 1 assigns a different hierarchical level to each image data of the image in the virtual display area 45 of each terminal device 2, and combines the image data. This is performed by superimposing and synthesizing image data in order of hierarchical levels.

  That is, as illustrated in FIG. 1, the image processing unit 11 of the image projecting device 1 assigns hierarchical levels to the images 30 c, 30 d, 30 f, and 30 g in the virtual display area 45 of each terminal device 2, 30c → image 30d → image 30g → image 30f are superimposed and combined in this order, and an image based on the combined image data (synthesized image 50) is projected.

  With this configuration, the image processing unit 11 of the image projection device 1 superimposes and synthesizes the image data of the images in the virtual display area 45 of each terminal device 2 in the hierarchical level order. Or, even if the angle of view is not increased, the projected and displayed image is not easily seen, and as a result, information sharing and collaborative work by a plurality of people can be performed smoothly.

  Then, the image projection device 1 transmits the image operation command received from the terminal device 2a in step S30 to the terminal device 2b via the communication path 3 by the operation command processing unit 13 (step S33), and receives the image operation command. The terminal device 2b reproduces the operation input based on the image operation command (step S34), and the application edits the data file being executed as the editing unit according to the reproduced operation input (step S35). .

  As described above, in the image projecting system S according to the present embodiment, when the image projecting apparatus 1 acquires an image operation command for operating a predetermined image among the images projected by the image projecting unit 12, The image operation command is transmitted via the communication path 3 to the terminal device 2 that has transmitted the image data of the image to be operated by the image operation command, and the terminal device 2 transmits the image operation command from the image projection device 1 to the communication path. Since the data file is edited in response to the image operation command when received via the terminal 3, not only the image of the terminal device 2 but also the image transmitted from the other terminal device 2 is edited. It is possible to collaborate with a plurality of people smoothly.

  In the image projection system S according to the present embodiment, the terminal device 2 includes an instruction unit 28 for instructing an image projected by the image projection device 1, and the operation command transmission unit 27 includes the instruction unit 28. When a predetermined operation is performed, an image instruction command corresponding to the operation is transmitted to the image projection device 1, and when the image processing unit 11 of the image projection device 1 receives the image instruction command from the terminal device 2, The pointer image is combined with the image data of the image in the virtual display area 45 of the plurality of terminal devices 2 at a position based on the command.

  That is, for example, as shown in FIG. 1, pointer images P <b> 1 and P <b> 2 based on an image instruction command as well as a composite image 50 based on image data acquired from each terminal device 2 as an image projected by the image projection device 1. Project.

  With this configuration, the user of the terminal device 2 can grasp where the user is pointing in the area projected by the image projection device 1.

[2. Specific configuration of image projection system]
(Regarding the configuration of the image projector 1)
Next, the configuration of the image projection apparatus 1 will be described. FIG. 7 is a configuration diagram of the image projection apparatus 1 in the present embodiment, FIG. 8 is a diagram illustrating an example of an image attribute information management table stored in the image projection apparatus 1 in the present embodiment, and FIG. FIG. 10 is a diagram for explaining coordinates defined in the projection area 60 of the image projection apparatus 1 in the embodiment, and FIG. 10 is an example of a connection information management table stored in the image projection apparatus 1 in the present embodiment. FIG. 12 is an example of a pointer information management table stored in the image projection apparatus 1 in the present embodiment, and FIG. 12 is a diagram illustrating an example of image processing of the image projection apparatus 1 in the present embodiment.

  As shown in FIG. 7, the image projection apparatus 1 communicates with an operation panel 101 for performing various operations, a storage unit 102 that is a non-volatile memory for holding setting information, data files, and the like, and a terminal device 2. Interface 104, a video signal input circuit 105 for inputting a video signal from the outside, a video signal input via the video signal input circuit 105, and image data acquired via the interface 104 are subjected to predetermined processing. An image processing circuit 106, an image projection unit 107 that projects an image based on an image signal output from the image processing circuit 106, and a control unit 108 that controls the entire image projection apparatus 1 are provided. Built in.

  As for the operation panel 101, when the user operates the operation panel 101 in the image projection apparatus 1, the control unit 108 performs control according to the operation content.

  The storage unit 102 includes a flash memory and the like. Information on resolution set in the image projection apparatus 1, image data of a pointer image, and image data of an image in the virtual display area 45 of each terminal device 2. , The image attribute information storage area 110 for storing the image attribute information management table for managing the position information, size information, etc. of the image, and the connection status of the terminal device 2 connected to the image projection apparatus 1 are managed. It has a connection information storage area 111 for storing a connection information management table, and a pointer information storage area 112 for storing a pointer information management table for storing pointer position information and the like.

  The interface 104 is a USB interface capable of communicating with an external device, and is acquired by the control unit 108 when acquiring image data, an image operation command, or the like from the terminal device 2 or communicating with an external computer device. Used. The interface 104 may be a wireless or wired LAN interface instead of the USB interface.

  The video signal input circuit 105 inputs video signals such as composite video signals (for example, NTSC video signals) and component video signals (for example, RGB signals).

  The image processing circuit 106 performs processing such as synthesis of a plurality of image data on the video signal input to the video signal input circuit 105 or the image data acquired via the interface 104 based on control by the control unit 108. Do. The image signal generated by processing in this way is input to the image projection unit 107.

  The image projection unit 107 includes a lamp driving circuit 120, a light source 121, an illumination optical system 122, a transmissive liquid crystal panel 123 (hereinafter referred to as “LCD 123”), an imaging optical system 124, and an LCD driving circuit 125. And a focus adjustment circuit 126.

  The light source 121 is composed of a lamp or the like, and is driven to light up and emit light based on a signal output from the lamp driving circuit 120 controlled by the control unit 108. The light emitted from the light source 121 is applied to the LCD 123 as illumination light by the illumination optical system 122.

  The LCD 123 is driven by the LCD drive circuit 125 and displays an image on its display surface. The image thus displayed is emitted from the LCD 123 as light by the illumination light from the illumination optical system 122. Subsequently, the emitted light is projected onto the screen (projection surface) through the imaging optical system 124 and the projection opening (not shown) of the housing. As described above, the image displayed on the LCD 123 is projected onto the screen. The focus adjustment circuit 126 can adjust the focus of the image projected on the screen.

  The control unit 108 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and the CPU reads out and executes a program stored in advance in the ROM, thereby executing an image. An image acquisition unit that acquires image data of an image in the virtual display area 45 of the terminal device 2, an image processing unit that synthesizes image data of an image in the virtual display area 45 of the terminal device 2, and an image projection unit When an image operation command for operating an arbitrary image among the images projected at 107 is acquired, this image operation is transmitted to the terminal device 2 that has transmitted the image data of the image to be operated by the image operation command. It functions as an operation command processing unit that transmits commands.

  As an image acquisition unit, the control unit 108 acquires image data or an image operation command of an image in the virtual display area 45 of the terminal device 2 from the terminal device 2 via the interface 104. The image operation command can also be acquired from a remote control device (not shown).

  Further, the control unit 108 functions as an image processing unit together with the image processing circuit 106 to synthesize image data of images in the virtual display areas 45 of the plurality of terminal devices 2. The composition of the image data by the image processing unit is executed based on the image attribute information management table and the connection information management table stored in the storage unit 102.

  Here, the image attribute information management table will be described with reference to FIG.

  As shown in FIG. 8, the image attribute information management table relates to the name of the terminal device 2 (owner PC) that has transmitted the image in the virtual display area 45 of each terminal device 2, the position and size at which the image is to be displayed. Information for identifying the image (information on the file name of the image data, and information on the order (hierarchy level) in which each image data is superimposed when the image processing unit synthesizes the plurality of image data) ID).

  Information on the position and size of the image in the virtual display area 45 of each terminal device 2 is represented by coordinates defined in the projection area 60 projected by the image projection apparatus 1. That is, as shown in FIG. 9, the image projection apparatus 1 in the present embodiment defines the vertical direction of the projection region 60 as the X direction, the horizontal direction as the Y direction, and the top left vertex as the origin. The image position information is the coordinate information of the upper left vertex of each image in the virtual display area 45, and the image size information is the coordinate of the width (W) and height (H) of the image. It is information expressed in numerical values, and based on this position information and size information, it is determined at what position and in what size the projection area 60 projected by the image projection apparatus 1 projects the image in the virtual display area 45. be able to. For example, in FIG. 9, an image 30 f has an upper left vertex at the position of coordinates (400, 30), and the image size is 460 in width (W) and 310 in height (H).

  Further, the name of the terminal device 2 (owner PC) that transmitted the image data is associated with the connection information management table shown in FIG. In this connection information management table, as shown in FIG. 10, the name of the terminal device 2 connected to the image projection device 1 is the connection status (whether it is connected to the image projection device 1 or not connected) and It is stored in association with the IP address assigned to each terminal device 2.

  Further, as an image processing unit, the control unit 108 displays a pointer image at a position based on the image instruction command transmitted by the operation command transmission unit of the terminal device 2, and the images in the virtual display areas 45 of the plurality of terminal devices 2. Combine with image data. Here, the synthesis of the pointer images is executed based on the information in the pointer information management table.

  As shown in FIG. 11A, the pointer information management table includes an image file name of a pointer image assigned to the terminal device 2 connected to the image projection device 1 and a projection area 60 projected by the image projection device 1. Is stored in association with the name of the terminal device 2. 11B shows pointer information when the operation unit or the instruction unit of the terminal device 2c connected to the image projection device 1 is not in the virtual display area 45 (when it is in the display area 40 by the display unit). It is an example of a management table.

  Here, in the present embodiment, a different hierarchical level is assigned to each image data of the image in the virtual display area 45 of each terminal device 2, and the image data is synthesized by superimposing the image data in the hierarchical level order. It is said. That is, when combining the image data of the image in the virtual display area 45 of each terminal device 2, the control unit 108 refers to the information on the hierarchical level stored in the image attribute information management table, and this hierarchical level is high. Image data of an image that is formed by superimposing images in order is generated.

  For example, the images 30c, 30d, 30f-k in the virtual display areas 45a-45d of the terminal devices 2a-2d in the right diagram of FIG. , 30k, 30j, 30g, and 30f, as shown in the left diagram of FIG. 12A, these images are superimposed and displayed in the projection area 60 as shown in this diagram.

  Note that, as a method of combining a plurality of pieces of image data by the image processing unit, as described above, in addition to the method of displaying the image data acquired from each terminal device 2 over the entire projection region 60, FIG. As shown in FIG. 6, the projection area 60 may be divided and displayed for each terminal device 2. With this configuration, the user of the terminal device 2 can easily grasp from which terminal device 2 the image projected by the image projecting device 1 is acquired. The collaborative work etc. performed in can be performed efficiently.

  Further, when the control unit 108 functions as an operation command processing unit together with the interface 104, when the image operation command for operating an arbitrary image among the images projected by the image projection unit 107 is acquired, This image operation command is transmitted to the terminal device 2 that has transmitted the image data of the image to be operated by the image operation command.

  Here, in the present embodiment, when an image operation command is transmitted to the terminal device 2, the image data of the image to be operated by the image operation command and the terminal device 2 to which the image operation command is to be transmitted are The determination is made based on the image attribute information acquired by the acquisition unit.

  With this configuration, it is not necessary to separately request each terminal device 2 for information for determining the image data of the image to be operated for each operation, and the burden on the communication path 3 can be reduced. it can.

(Regarding the configuration of the terminal device 2)
Next, the configuration of the terminal device 2 will be described. FIG. 13 is a configuration diagram of the terminal device 2 in the present embodiment.

  The terminal device 2 in the present embodiment can be applied to a general personal computer or a dedicated terminal. As shown in FIG. 13, the LCD 200 as a display unit, a graphics controller 201 for driving the LCD 200, and various data Etc., an interface 203 for communicating with the image projection apparatus 1 via the communication path 3, a USB bus controller 204 for inputting / outputting data to / from a USB device, A USB connector 205 as a connection port to be connected, a keyboard 206 and a mouse 207 (corresponding to an instruction unit and an operation unit) capable of inputting predetermined information by a user's operation, and a control unit 208 for controlling the entire terminal device 2; These various elements are composed of the first bus 209 and the second bus. They are connected to each other via a 210. In the figure, reference numeral 211 denotes a bus controller for transferring data between the first bus 209 and the second bus 210.

  The hard disk device 202 functions as a storage unit. The hard disk device 202 includes an operating system (OS) program, document creation software, presentation software, spreadsheet software, and graphic creation software for the terminal device 2. In addition to various application programs such as the above, data files created by this application program are stored. In addition to the application program, an image sharing program is stored as a processing program for the image projection system S in the present embodiment.

  The image sharing program may be downloaded from a server (not shown) connected to the communication path 3 to the hard disk device 202 of the control unit 208 via the interface 203, for example. -After being recorded on a recording medium such as a ROM, it may be read into the hard disk device 202 of the control unit 208 via a recording medium drive (not shown).

  The interface 203 is a USB interface capable of communicating with an external device, and is acquired by the control unit 208 when acquiring image data, an image operation command, or the like from the terminal device 2 or communicating with an external computer device. Used. The interface 203 may be a wireless or wired LAN interface instead of the USB interface.

  The control unit 208 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and the CPU reads and executes an image sharing program stored in the hard disk device 202. Thus, the terminal device 2 is caused to function as a predetermined region image transmission unit, a virtual display region setting unit, and an operation command transmission unit.

  The control unit 208 reads out and executes various application programs stored in the hard disk device 202 by the CPU, thereby causing the control unit 208 to function as an image generation unit and an editing unit.

  The CPU of the control unit 208 executes various application programs stored in the hard disk device 202, functions as an image generation unit, and generates image data based on the data file. The generated image data is displayed on the LCD 200 as an image based on the image data by the LCD 200 and the graphics controller 201 as a display unit.

  The control unit 208 functions as a predetermined area image transmission unit together with the interface 203 so that when the position of the image based on the image data generated by the image generation unit is in the virtual display area 45, a part or all of the image The image data is transmitted to the image projector 1 via the communication path 3. Here, the predetermined display area in the present embodiment is a virtual display area 45 set so as to be adjacent to the display area 40 of the display unit. This virtual display area 45 is stored in the hard disk device 202 by the CPU of the control unit 208. It is set by executing the stored image sharing program and functioning as a virtual display area setting unit.

  Here, in the image projection system S according to the present embodiment, every time image data in the virtual display area 45 is generated based on the edited data file by the image generation unit, an image of the image in the virtual display area 45 is displayed. Data is transmitted to the image projection apparatus 1.

  With this configuration, the image projected by the image projection apparatus 1 can be updated in real time, so that information can be shared and collaboratively performed by a plurality of people.

  When transmitting this image data, BMP (Bit Map) data obtained by capturing an image in the virtual display area 45 is converted into JPEG (Joint Photographic Experts Group) data. As described above, by compressing the image data to be transmitted to the image projection apparatus 1, it is possible to reduce the load on the communication path 3.

  Further, the control unit 208 functions as an editing unit so that when an image operation command is received from the image projection device 1 via the communication path 3, the operation input is reproduced from the image operation command, and the operation input is performed in accordance with the operation input. Edit the data file. The image operation command is received by the interface 203.

  In addition, the control unit 208 functions as an operation command transmission unit together with the interface 203, and when a predetermined operation / instruction is performed by the keyboard 206 or the mouse 207 when the pointer is positioned in the virtual display area 45, An image operation command corresponding to the operation / instruction is transmitted to the image projection apparatus 1. At this time, in order to prevent the operation / instruction from being executed by the terminal device 2, the control unit 208 transmits the image operation command to the image projection device 1 after discarding the operation input information or the instruction information. . Here, “operation” is a command for editing a data file being executed by an application of the own device or another terminal device, and “instruction” is an image projected by the image projection device 1. This is a command for displaying or moving a pointer image that points to.

  As described above, by using the keyboard 206 and the mouse 207 as the operation unit, the image in the virtual display area 45 of the other terminal device 2 projected by the image projection device 1 can be operated and edited. By using 207 as an instruction unit, the user of the terminal device 2 can be further made aware of which of the areas projected by the image projection device 1 is instructed. Furthermore, since the operation and instruction of the image are performed by transmitting an image operation command to the terminal device that transmitted the image data of the operation target image, the image is operated without imposing a heavy load on the communication path 3. be able to.

(Specific operation of the image projector)
Next, an example of a specific operation of the image projection apparatus 1 will be described with reference to FIGS. FIG. 14 is a main process flowchart of the image projection apparatus 1 according to the present embodiment.

  As shown in FIG. 14, when a power switch (not shown) of the image projection apparatus 1 is pressed, the control unit 108 of the image projection apparatus 1 performs a connection process (step S100). This connection process is a process for the image projection apparatus 1 to connect to the terminal device 2 via the communication path 3. This process is a process from steps S200 to S205 in FIG. 15, and will be described later.

  Next, the control unit 108 determines whether image attribute information has been received from the terminal device 2 (step S110). In this process, if it is determined that the image attribute information has been received from the terminal device 2 (step S110: Yes), the control unit 108 performs an image attribute information update process (step S120). In this image attribute information update process, the image attribute information management table is updated in accordance with information transmitted from the terminal device 2. This process is a process from steps S300 to S308 in FIG. 16, and will be described later.

  When the image attribute information update process in step S120 is completed, the control unit 108 performs a display area calculation process (step S130). This display area calculation process calculates the display area in the projection area 60 of each image projected by the image projection apparatus 1. This process is a process from steps S400 to S403 in FIG. 17 and will be described later.

  In step S110, when image attribute information is not received from the terminal device 2 (step S110: No), the control unit 108 determines whether pointer information is received (step S140). If it is determined in this process that the pointer information has been received (step S140: Yes), the control unit 108 updates the pointer information management table based on the pointer information transmitted from the terminal device 2 as the pointer information update process. (Step S150).

  When the processing of step S130 and step S150 is completed, the control unit 108 performs image projection processing (step S160). In this image projection process, image data acquired from a plurality of terminal devices 2 and a pointer image are combined. This process is a process from step S600 to S612 in FIG. 19 and will be described later.

  Next, the control unit 108 determines whether an image operation command has been received from the terminal device 2 (step S170). In this process, when it is determined that an image operation command has been received from the terminal device 2 (step S170: Yes), the control unit 108 performs an operation command distribution process (step S180). In this operation command distribution process, the image operation command is transmitted to the terminal device 2 that has transmitted the image data of the image to be operated by the image operation command received from the terminal device 2. This process is a process from steps S700 to S702 in FIG. 20, and will be described later.

  When the process of step S180 is completed, or when no image operation command is received from the terminal device 2 in step S170 (step S170: No), the control unit 108 determines whether or not the power is turned off ( If the power is not turned off (step S190), the process proceeds to step S100. On the other hand, if it determines with the power supply having been turned off (step S190: Yes), the control part 108 will complete | finish a main process.

  Next, the connection process in step S100 will be specifically described with reference to FIG. FIG. 15 is a connection process flowchart of the image projection apparatus 1 according to the present embodiment.

  As shown in FIG. 15, when the connection process is started, the control unit 108 of the image projection apparatus 1 determines whether or not a connection request signal has been received from the terminal apparatus 2 (step S200). In this process, if it is determined that the connection request signal has been received from the terminal device 2 (step S200: Yes), the terminal device 2 that has transmitted the connection request signal is stored in the storage unit 102 of the image projection device 1. The resolution information is notified (step S201). Thereby, the resolution of the virtual display region 45 created by the virtual display region setting unit of each terminal device 2 can be unified, and the appearance of the image projected by the image projection device 1 can be improved.

  Next, the control unit 108 determines whether an activation completion notification has been received from the terminal device 2 (step S202). In this process, when it is determined that the activation completion notification is received from the terminal device 2 (step S202: Yes), the control unit 108 updates the connection information management table (step S203). That is, the control unit 108 newly provides a column of the terminal device 2 newly connected to the image projection device 1 in the connection information management table, and provides information on the IP address and connection state of the terminal device 2 of the terminal device 2. It is stored in association with the name.

  Next, the control unit 108 updates the pointer information management table (step S204). That is, the control unit 108 newly provides a column for the terminal device 2 newly connected to the image projection device 1 in the pointer information management table, and the image file name of the pointer image assigned to the terminal device 2 and the position of the pointer. Information is stored in association with the name of the terminal device 2.

  In addition, when the information of the terminal device 2 is newly added to this pointer information management table, the position of the pointer is displayed in the display area 40 of the display unit of the terminal device 2, so the position information of the pointer information management table In the column, “none” is displayed. In the present embodiment, the pointer image assigned to each terminal device 2 is automatically assigned in the process of step S204. However, the pointer image may be selected by each user.

  Next, the control unit 108 notifies the terminal device 2 that the connection process has been completed (step S205). When this process ends, or when the connection request signal is not received from the terminal device 2 in step S200 (step S200: No), the control unit 108 ends the connection process.

  Next, the image attribute information update processing in step S120 will be specifically described with reference to FIG. FIG. 16 is a flowchart of an image attribute information update process of the image projection apparatus 1 according to this embodiment.

  As illustrated in FIG. 16, when the image attribute information update process is started, the control unit 108 determines whether or not an image attribute information addition flag is set in the image attribute information transmitted from the terminal device 2 (step S <b> 16). S300). In this process, when it is determined that new addition of image attribute information has been performed (step S300: Yes), the control unit 108 sets the image attribute information of the image newly located in the virtual display area 45 as image attribute information. A new management table is added (step S301), and a storage area for the image data of the image is secured (step S302).

  When the process of step S302 is completed, the control unit 108 updates the hierarchy level information of each image managed in the image attribute information management table as a hierarchy level update process (step S303). That is, the control unit 108 sets the hierarchy level of the newly added image to the virtual display area 45 to “1”, and sequentially lowers the other images to a hierarchy one level lower than the currently assigned hierarchy level. (For example, an image whose hierarchical level is set to “2” is updated to “3”). Since the newly added image is displayed in the foreground in the virtual display area 45, a collaborative work by a plurality of persons can be performed smoothly.

  When it is determined in step S300 that the image attribute information addition flag is not set in the image attribute information transmitted from the terminal device 2 (step S300: No), the control unit 108 transmits the image attribute transmitted from the terminal device 2. It is determined whether the image attribute information deletion flag is set in the information (step S304). If it is determined in this process that the image attribute information has been deleted (step S304: Yes), the control unit 108 deletes the image attribute information of the image to be deleted from the image attribute information management table (step S305). ), The hierarchical level of the other image is updated (step S306).

  When it is not determined in step S304 that the image attribute information has been deleted (step S304: No), the control unit 108 updates the image attribute information based on the image attribute information received from the terminal device 2 (step S307). When the processing in step S307 ends, the control unit 108 sets the hierarchical level of the image based on the updated image attribute information to “1” and sequentially lowers the hierarchical level of other images as hierarchical level update processing (step S308). ).

  When the processes of steps S303, S306, and S308 are completed, the control unit 108 ends the image attribute information update process.

  Next, the display area calculation process in step S130 will be described with reference to FIG. FIG. 17 is a flowchart of the display area calculation process of the image projection apparatus 1 according to this embodiment.

  As shown in FIG. 17, when the display area calculation process is started, the control unit 108 determines whether or not the image attribute information update process in step S120 has been performed (step S400). If it is determined in this process that the image attribute information update process has been performed (step S400: Yes), the control unit 108 acquires the image attribute information of each terminal device 2 from the image attribute information management table (step S401).

  Next, based on the acquired image attribute information, the control unit 108 calculates a display area to be displayed in the projection area 60 of the image projection apparatus 1 for each image (step S402). In other words, in the present embodiment, the display area of each image displayed in the projection area 60 of the image projection apparatus 1 is calculated before each terminal apparatus 2 is requested to transmit image data. Thus, by calculating the display area of each image in advance, when requesting the terminal device 2 to transmit image data in the image projection processing described later, for example, as shown in FIG. Since it can be instructed not to transmit the image data of the portion 35 that is not displayed in the projection area 60 when the respective images are combined, unnecessary image data is not transmitted, and an extra burden is placed on the communication path 3. There is nothing.

  Note that in the processing of step S402, the display area is calculated sequentially from an image having a lower hierarchy. By doing so, the amount of calculation can be reduced, so that the processing speed can be increased.

  Next, the control unit 108 determines whether or not all image display areas have been calculated (step S403). Here, in the present embodiment, as described above, since the display area is calculated in order from the image set at the lowest hierarchical level, the above determination is set at the highest hierarchical level. This is determined by whether or not the display area of the existing image has been calculated. In this process, when it is not determined that the display areas of all images have been calculated (step S403: No), the control unit 108 shifts the process to step S402. On the other hand, when it is determined in step S403 that display areas of all images have been calculated (step S403: Yes), or when it is not determined in step S400 that image attribute information update processing has been performed (step S400: No), the control unit 108. Ends the display area calculation process.

  Next, the image projection processing in step S160 will be specifically described with reference to FIG. FIG. 19 is an image projection processing flowchart of the image projection apparatus 1 in the present embodiment.

  As shown in FIG. 19, when the image projection process is started, the control unit 108 determines whether or not the display area calculation process in step S130 has been performed (step S600). In this process, when it is determined that the display area calculation process has been performed (step S600: Yes), the control unit 108 shifts the process to step S601.

  In step S601, the control unit 108 determines whether or not a part of the image projected on the image projection device 1 is hidden. This determination is made based on the calculation result in the display area calculation process in step S130. In this process, when it is not determined that a part of the image projected on the image projection device 1 is hidden (step S601: Yes), the control unit 108 transmits the image so as to transmit all of the image data to the terminal device 2. A request signal is transmitted (step S602).

  On the other hand, if it is determined in step S601 that a part of the image projected on the image projection device 1 is hidden (step S601: No), the control unit 108 selects an image based on the result calculated in the display area calculation process. The display area to be displayed is divided into a plurality of rectangular areas (step S603). That is, for example, as shown in FIG. 20, when a part of the image 35g in the image 30g is hidden and not displayed, the control unit 108 determines a part of the image 30g displayed by the image projection device 1 as a rectangular area 38a. And 38b. Then, the control unit 108 transmits an image data request signal for requesting transmission of image data for each rectangular area to the terminal device 2 (step S604).

  When the processes of steps S602 and S604 are completed, the control unit 108 determines whether image data has been received from the terminal device 2 (step S605). In this process, if it is determined that image data has been received from the terminal device 2 (step S605: Yes), the control unit 108 decompresses the received image data (step S606). This is because the image data transmitted from the terminal device 2 is transmitted in a compressed state, as will be described later.

  Next, the control unit 108 stores the received image data in the image data storage area secured in the image attribute information update process (step S607), and pastes the image data in the designated display area (step S608). . Next, the control unit 108 determines whether or not all of the image data of the image in the virtual display area 45 of each terminal device 2 has been pasted (step S609). If it is determined in this process that all of the image data has been pasted (step S609: Yes), the control unit 108 proceeds to step S612 and does not determine that all of the image data has been pasted (step S612). Step S609: No), the process proceeds to step S601. That is, the processing from step S601 to S608 is performed for each image data. In step S608, by pasting each image data to the display area, the virtual display area 45 of each terminal device 2 is displayed. The image data of a certain image is synthesized.

  On the other hand, when it is not determined in step S600 that the display area has been calculated (step S600: No), the control unit 108 determines whether or not the pointer information management table has been updated (step S610). In this process, when it is determined that the pointer information management table has been updated (step S610: Yes), the control unit 108 transfers the image data of the pointer image to the projection area 60 of the image projector 1 based on the updated pointer information. The image data of the projected image is combined (step S611), and the process proceeds to step S612.

  In step S612, the control unit 108 projects the image data combined in the process of step S608 or the image based on the image data combined in the process of step S611 from the image projection unit 107 (step S612). When the process of step S612 ends, the control unit 108 ends the image projection process.

  Next, the operation command distribution process in step S180 will be specifically described with reference to FIG. FIG. 21 is a flowchart of operation command distribution processing of the image projection apparatus 1 according to the present embodiment.

  As shown in FIG. 21, when the operation command distribution process is started, the control unit 108 refers to the pointer information management table and acquires the position information of the pointer of the terminal device 2 that has transmitted the image operation command (step S700). . Next, the control unit 108 specifies the terminal device 2 (owner PC) that has transmitted the image data by specifying the image data including the acquired position coordinates of the pointer with reference to the image attribute information management table ( In step S701, an image operation command is transmitted to the identified terminal device 2 (step S702). When this process ends, the control unit 108 ends the operation command distribution process.

(Specific operation of terminal device)
Next, an example of a specific operation of the terminal device 2 will be described with reference to FIGS. FIG. 22 is a main process flowchart of the terminal device 2 in the present embodiment.

  As shown in FIG. 22, when a power switch (not shown) of the terminal device 2 is pressed, the control unit 208 of the terminal device 2 performs a connection process (step S1000). This connection process is a process for connecting to the image projector 1 via the communication path 3. This process is a process from step S1100 to S1104 in FIG. 23 and will be described later.

  When the connection process in step S1000 ends, the control unit 208 proceeds to the image attribute information transmission process in step S1010. In this image attribute information transmission process, image attribute information notification data is created in response to an operation performed on an image in the virtual display area 45, and the image attribute information notification data is transmitted to the image projection apparatus 1. It is. This process will be described later, which is a process from step S1200 to S1209 in FIG.

  When the image attribute information transmission process in step S1010 ends, the control unit 208 proceeds to the operation command transmission process in step S1020. In this operation command transmission process, when an image projected on the image projection device 1 is operated or instructed by the keyboard 206 or the mouse 207, an image operation command based on this operation or instruction is sent to the image projection device 1. To be sent. This process will be described later, which is a process from step S1300 to step S1305 in FIG.

  When the operation command transmission process in step S1020 ends, the control unit 208 shifts the process to the image data transmission process in step S1030. In this image data transmission process, image data is transmitted to the image projection apparatus 1 based on an image transmission request transmitted from the image projection apparatus 1. This process will be described later, which is a process from step S1400 to step S1402 in FIG.

  When the image data transmission process in step S1030 ends, the control unit 208 shifts the process to the operation command reproduction process in step S1040. In this operation command reproduction process, an image data file in the virtual display area 45 is edited based on an image operation command transmitted from the image projection apparatus 1. This process will be described later, which is the process from step S1500 to S1502 in FIG.

  When the connection process in step S1040 ends, the control unit 208 determines whether or not the connection state with the image projection apparatus 1 has been released (step S1050). If it is determined in this process that the connection state with the image projection apparatus 1 has not been released (step S1050: No), the control unit 208 moves the process to step S1010. On the other hand, when determining that the connection state with the image projection apparatus 1 has been released (step S1050: Yes), the control unit 208 ends the main process.

  Next, the connection process in step S1000 will be specifically described with reference to FIG. FIG. 23 is a connection process flowchart of the terminal device 2 in the present embodiment.

  As shown in FIG. 23, when the connection process is started, the control unit 208 transmits a connection request signal to the image projection apparatus 1 (step S1100).

  Next, the control unit 208 determines whether or not resolution information has been received from the image projection apparatus 1 (step S1101). In this process, if it is determined that resolution information has been received from the image projection apparatus 1 (step S1101: Yes), the control unit 208 creates a virtual display area 45 adjacent to the display area by the LCD 200 (step S1102). At this time, the resolution of the created virtual display area 45 is set based on the resolution information received from the image projection apparatus 1 in step S1101.

  When the process of step S1102 ends, the control unit 208 notifies the image projection apparatus 1 that the preparation for activation has been completed (step S1103). Then, the control unit 208 determines whether or not a connection completion notification is received from the image projection device 1 (step S1104), and determines that the connection completion notification is notified from the image projection device 1 (step S1104: Yes). The control unit 208 ends the connection process.

  Next, the image attribute information transmission processing in step S1010 will be specifically described with reference to FIG. FIG. 24 is a flowchart of image attribute information transmission processing of the terminal device 2 in the present embodiment.

  As shown in FIG. 24, when the image attribute information transmission process is started, the control unit 208 determines whether or not an image has been added to the virtual display area 45 (step S1200). This determination is made based on whether or not the user has performed a predetermined operation on the image in the display area of the LCD 200 using the mouse 207. Here, the predetermined operation is performed by moving an image in the display area of the LCD 200 to the virtual display area 45 or pressing a predetermined button provided in the image. If it is determined in this process that an image has been added to the virtual display area 45 (step S1200: Yes), the control unit 208 moves the process to step S1201.

  In step S1201, the control unit 208 acquires the image attribute information of the image newly added to the virtual display area 45 (step S1201), and sets an image attribute information addition flag (step S1202).

  When it is not determined in step S1200 that an image has been added to the virtual display area 45 (step S1200: No), the control unit 208 has moved or deleted the image in the virtual display area 45 from the virtual display area 45. It is determined whether or not (step S1203). In this process, when it is determined that the image in the virtual display area 45 has moved or deleted from the virtual display area 45 (step S1203: Yes), the control unit 208 moves or deleted the image from the virtual display area 45. Window ID is acquired (step S1204), and a deletion flag of image attribute information is set (step S1205).

  In step S1203, when it is not determined that the image in the virtual display area 45 has moved or deleted from the virtual display area 45 (step S1203: No), the control unit 208 determines the image attributes of the image in the virtual display area 45. It is determined whether or not the information has been updated (step S1206). This determination is made based on whether or not the position or size of the image in the virtual display area 45 has been changed. In this process, when it is determined that the image attribute information of the image in the virtual display area 45 has been updated (step S1206: Yes), the control unit 208 acquires the updated image attribute information (step S1207).

  When the processes of steps S1202, S1205, and S1207 are completed, the control unit 208 creates image attribute information notification data corresponding to the result of each process (step S1208), and communicates with the image projection apparatus 1 via the communication path 3. (Step S1209). That is, when a new image is added to the virtual display area 45, among the image attribute information of the added image, the window ID of the image, position information, size information, information on the file name of the image data, and the image Image attribute information notification data including additional flag data of attribute information is created and transmitted to the image projection apparatus 1. When an image in the virtual display area 45 is moved out of the virtual display area 45 or deleted, a window including the window ID of the moved or deleted image and deletion flag data of the image attribute information is displayed. Information notification data is created and transmitted to the image projection apparatus 1. When the image attribute information is updated, image attribute information notification data including the image attribute information of the updated image is created and transmitted to the image projection apparatus 1.

  When the process of step S1209 is completed or when it is not determined in step S1206 that the image attribute information has been updated (step S1206: No), the control unit 208 ends the image attribute information transmission process.

  Next, the operation command transmission process in step S1020 will be specifically described with reference to FIG. FIG. 25 is an operation command transmission process flowchart of the terminal device 2 in the present embodiment.

  As illustrated in FIG. 25, when the operation command transmission process is started, the control unit 208 determines whether an operation input has been performed on an image projected on the image projection apparatus 1 by the keyboard 206 or the mouse 207. (Step S1300). In this process, when it is determined that an operation input has been performed (step S1300: Yes), the control unit 208 acquires operation input information based on the operation input (step S1301), and the operation based on the operation input is performed by the user's terminal. In order to prevent execution by the apparatus 2, the operation input information is discarded (step S1302).

  Next, the control unit 208 acquires the position information of the pointer displayed in the projection area 60 of the image projection apparatus 1 (step S1303), and generates an image operation command including the position information of the pointer and operation input information. Then, this image operation command is transmitted to the image projection apparatus 1 via the communication path 3 (step S1305).

  When the process of step S1305 is completed, or when it is not determined in step S1300 that an operation input has been performed on the image projected by the image projection apparatus 1 (step S1300: No), the control unit 208 receives an operation command. The transmission process ends.

  Next, the image data transmission processing in step S1030 will be specifically described with reference to FIG. FIG. 26 is a flowchart of image data transmission processing in the present embodiment.

  As shown in FIG. 26, when the image data transmission process is started, the control unit 208 determines whether or not there is a transmission request for image data of the image in the virtual display area 45 from the image projection device 1 (step S1400). This determination is made based on whether or not an image data transmission request signal has been received from the image projection apparatus 1. In this process, when it is determined that there is a request for transmission of image data (step S1400: Yes), the control unit 208, based on the received image data transmission request, part or all of the image data in the virtual display area 45. The captured image data is compressed by converting the captured image data from BMP (Bit MaP) format to JPEG (Joint Photographic Experts Group) format (step S1401), and the compressed image data is projected as an image. It transmits to the apparatus 1 via the communication path 3 (step S1402). When the process of step S1402 is completed, or when it is not determined in step S1400 that there has been a request for transmission of image data from the image projection apparatus 1 (step S1400: No), the control unit 208 ends the image data transmission process.

  Next, the operation command reproduction process in step S1040 will be specifically described with reference to FIG. FIG. 27 is an operation command transmission process flowchart of the terminal device 2 in the present embodiment.

  As shown in FIG. 27, when the operation command reproduction process is started, the control unit 208 determines whether or not an image operation command has been received from the image projection device 1 (step S1500). In this process, when it is determined that an image operation command has been received from the image projection apparatus 1 (step S1500: Yes), the control unit 208 reproduces the received image operation command (step S1501) and becomes an operation target. An editing operation based on the image operation command is executed on the application program corresponding to the data file (step S1502).

  As mentioned above, some of the embodiments of the present invention have been described in detail with reference to the drawings. However, these are merely examples, and the present invention is described in other forms in which various modifications and improvements are made based on the knowledge of those skilled in the art. It is possible to carry out the invention.

  For example, in this embodiment, the timing at which the image data in the virtual display area 45 of each terminal device 2 is transmitted to the image projection device 1 is managed by the image projection device 1, but the timing at which this image data is transmitted. May be managed by each terminal device 2.

  When the terminal device 2 manages the transmission timing of image data, the image data transmission processing of the terminal device 2 shown in FIG. 26 may be changed as follows.

  For example, the control unit 208 of the terminal device 2 may determine whether or not there is a change in the image in the virtual display area, and the image data may be transmitted only when there is a change.

  That is, as shown in FIG. 28, when the image data transmission process is started, the control unit 208 determines whether or not there is a change from the image data previously transmitted to the image projection device 1 (step S1460). This determination is made based on whether an image operation command is received or whether a redrawing message (for example, a WM_PAINT message) is received from the OS program of the terminal device 2. In this process, if it is determined that there has been a change from the image data transmitted to the image projection device 1 last time (step S1460: Yes), the control unit 208 captures an image in the virtual display area 45 (step S1461). Next, the control unit 208 compresses the captured image data (step S1462), and transmits the compressed image data to the image projection apparatus 1 via the communication path 3 (step S1463). Then, when the process of step S1463 is completed, or when it is not determined that there has been a change from the image data transmitted last time in step S1460 (step S1460: No), the control unit 208 ends the image data transmission process.

  Further, in the above modification, when there is a change from the previously transmitted image data, not all of the image data is transmitted, but only the image data that is different from the previously transmitted image data is transmitted. Good.

  That is, as shown in FIG. 29, when the image data transmission process is started, the control unit 208 captures an image in the virtual display area 45 (step S1450).

  Next, the control unit 208 determines whether or not there has been a change from the image data previously transmitted to the image projection apparatus 1 (step S1451). In this process, when it is determined that there has been a change from the image data transmitted to the image projection device 1 last time (step S1451: Yes), the control unit 208 calculates the image data of the image transmitted last time and the image data of the image captured this time. The difference is extracted and the difference image data is stored (step S1452). Then, the difference image data is compressed (step S1453), and the compressed image data is transmitted to the image projection apparatus 1 (step S1454). Then, when this process is ended or when it is not determined that there has been a change from the image data transmitted last time in step S1451 (step S1451: No), the control unit 208 ends the image data transmission process.

  Here, when the terminal device 2 manages the transmission timing of the image data as described above, the processing from steps S601 to S609 in the image projection processing of the image projection device 1 may be changed as follows.

  That is, as shown in FIG. 30, if it is determined in step S600 of FIG. 19 that the display area has been calculated (step S600: Yes), has the control unit 108 of the image projection device 1 received image data from the terminal device 2? It is determined whether or not (step S671). If it is determined in this process that image data has been received from the terminal device 2 (step S671: Yes), the process proceeds to step S672. The processing from step S672 to S674 is the same as the processing from step S606 to S608 in FIG. And when the process of step S674 is complete | finished, or when not determining with having received image data from the terminal device 2 in step S671 (step S671: No), the control part 108 transfers a process to step S612.

  Further, the processing from step S601 to S609 in FIG. 19 acquires all image data of the image in the virtual display area 45 of each terminal device 2, and pastes the image data in the display area assigned to each image data. However, only the image data of the image displayed in the foreground when projected by the image projection apparatus 1 may be acquired.

  That is, as shown in FIG. 31, when it is determined in step S600 that the display area has been calculated (step S600: Yes), the control unit 108 refers to the image attribute information management table and assigns the hierarchy assigned to each image data. It is determined whether or not the level is “1” (step S651). In this process, when it is not determined that the hierarchy level is “1” (step S651: No), the control unit 108 shifts the process to step S657.

  On the other hand, when determining that the hierarchy level is “1” (step S651: Yes), the control unit 108 transmits the image data having the hierarchy level set to “1” to the terminal device 2 (owner PC). Then, an image data transmission request signal is transmitted (step S652), and the process proceeds to step S654. Here, the processing from step S654 to S656 is the same as the processing from step S606 to S608 in FIG.

  When the process of step S656 ends, the control unit 108 determines whether all the hierarchical levels of the image data managed in the image attribute information management table have been referred to (step S657). In this process, when it is not determined that all the hierarchical levels of the image data have been referenced (step S657: No), the control unit 108 shifts the process to step S651. On the other hand, if it is determined in step S657 that the hierarchical levels of all image data have been referenced (step S657: Yes), the control unit 108 proceeds to step S612 in FIG.

  In the present embodiment, in the image data processing of the terminal device 2, the control unit 208 of the terminal device 2 transmits image data based on a transmission request for image data transmitted from the image projection device 1. However, only the image data of the image displayed in the foreground among the plurality of images in the virtual display area 45 of each terminal device 2 may be transmitted to the image projection device 1.

  That is, as shown in FIG. 32, when the image data transmission process is started, the control unit 208 of the terminal device 2 determines whether or not a predetermined time has passed (step S1470). In this process, if it is determined that a certain time has elapsed (step S1470: Yes), the control unit 208 captures only the image in the foreground among the plurality of images in the virtual display area 45 (step S1471). Next, the control unit 208 compresses the captured image data (step S1472), and transmits the compressed image data to the image projection apparatus 1 via the communication path 3 (step S1473). Then, when the process of step S1473 is completed, or when it is not determined in step S1470 that the fixed time has elapsed (step S1470: No), the control unit 208 ends the image data transmission process.

1 is a diagram showing an overall system configuration of an image projection system in the present embodiment. It is a schematic block diagram of the image projector used for the image projection system in this embodiment. It is a schematic block diagram of the terminal device used for the image projection system in this embodiment. It is a sequence diagram which shows an example of the connection operation | movement in the image projection system of this embodiment. It is a sequence diagram which shows an example of the projection operation | movement in the image projection system of this embodiment. It is a sequence diagram which shows an example of the edit operation | movement in the image projection system of this embodiment. It is a block diagram of the image projector in this embodiment. It is a figure which shows an example of the image attribute information management table memorize | stored in the image projector in this embodiment. It is a figure for demonstrating the coordinate prescribed | regulated to the projection area | region of the image projector in this embodiment. It is an example of the connection information management table memorize | stored in the image projector in this embodiment. It is an example of the pointer information management table memorize | stored in the image projector in this embodiment. It is a figure which shows an example of the image process of the image projector in this embodiment. It is a figure which shows an example of the image process of the image projector in this embodiment. It is a block diagram of the terminal device in this embodiment. It is a main process flowchart of the image projector in this embodiment. It is a connection process flowchart of the image projector in this embodiment. It is an image attribute information update process flowchart of the image projector in this embodiment. It is a display area calculation process flowchart of the image projector in this embodiment. It is the schematic of the display area of each image data calculated in the display area calculation process of the image projector in this embodiment. It is an image projection process flowchart of the image projector in this embodiment. It is explanatory drawing which showed an example of the aspect of a division | segmentation when the display area of image data is divided | segmented into a rectangular area in the image projection process of the image projector in this embodiment. It is an operation command distribution process flowchart of the image projector in this embodiment. It is a main process flowchart of the terminal device in this embodiment. It is a connection process flowchart of the terminal device in this embodiment. It is an image attribute information transmission process flowchart of the terminal device in this embodiment. It is an operation command transmission process flowchart of the terminal device in this embodiment. It is an image data transmission process flowchart of the terminal device in this embodiment. It is an operation command transmission process flowchart of the terminal device in this embodiment. It is a flowchart which shows the modification of the image data transmission process of the terminal device in this embodiment. It is a flowchart which shows the modification of the image data transmission process of the terminal device in this embodiment. It is a flowchart which shows the modification of the image projection process of the image projector in this embodiment. It is a flowchart which shows the modification of the image projection process of the image projector in this embodiment. It is a flowchart which shows the modification of the image data transmission process of the terminal device in this embodiment. It is explanatory drawing of a prior art example.

Explanation of symbols

S image projection system 1 image projection device 2 terminal device 3 communication path

Claims (11)

In an image projection system comprising a plurality of terminal devices and an image projection device that obtains image data from the plurality of terminal devices via a communication path and projects an image based on the image data,
The image projector is
An image acquisition unit that acquires image data of an image in a predetermined display area of each of the terminal devices via the communication path;
An image processing unit that combines image data of images in a predetermined display area of the plurality of terminal devices;
An image projection unit that projects an image based on the image data synthesized by the image processing unit;
When an image operation command for operating a predetermined image among images projected by the image projection unit is acquired, this image is transmitted to the terminal device that has transmitted the image data of the image to be operated by the image operation command. An operation command processing unit that transmits an operation command via the communication path,
The terminal device
A storage unit for storing data files;
An image generation unit for generating image data based on the data file;
A predetermined area image that transmits part or all of the image data of the image to the image projection device via the communication path when the position of the image based on the image data generated by the image generation unit is in the predetermined display area A transmission unit;
An image projection system comprising: an editing unit that edits the data file in response to the image operation command when the image operation command is received from the image projection device via the communication path. The terminal device
A display unit capable of displaying an image based on the image data generated by the image generation unit;
The image projection system according to claim 1, further comprising: a virtual display region setting unit that sets a virtual display region adjacent to the display region of the display unit as the predetermined display region. The terminal device
An operation unit for operating an image in a predetermined display area of the terminal device projected by the image projection device;
2. An operation command transmission unit that transmits an image operation command corresponding to the operation to the image projection device via the communication path when the operation unit is operated in a predetermined manner. Or the image projection system of Claim 2. The terminal device
An instruction unit for indicating an image projected by the image projection device;
The operation command transmission unit transmits an image instruction command corresponding to the operation to the image projection device via the communication path when the instruction unit is operated in a predetermined manner.
When the image processing unit of the image projection device receives an image instruction command from the terminal device, the image processing unit displays a pointer image at a position based on the image instruction command, and image data of an image in a predetermined display area of the plurality of terminal devices The image projection system according to claim 3, wherein the image projection system is combined with the image projection system. The control unit of the terminal device
Each time image data in the predetermined display area is generated based on the edited data file by the image generation unit, image data of the image in the predetermined display area is transferred to the image projection device via the communication path. The image projection system according to claim 1, wherein the image projection system transmits the image to the projector. The image processing unit of the image projector is
2. A different hierarchical level is assigned to each image data of an image in a predetermined display area of each terminal device, and the image data is synthesized by superimposing and synthesizing the image data in the hierarchical level order. The image projection system according to claim 5. The image acquisition unit of the image projection device requests image data of an image projected by the image projection unit from the image data in a predetermined display area of each terminal device to the terminal device,
The predetermined area image transmission unit of the terminal device projects the image data of the requested image among the images when the position of the image based on the image data generated by the image generation unit is in the predetermined display area. The image projection system according to claim 6, wherein the image projection system transmits the image to a device. The predetermined area image transmission unit of the terminal device transmits, in addition to the image data, image attribute information that is information related to the image data to the image projection device via the communication path,
The image acquisition unit of the image projection device acquires the image attribute information via the communication path,
The image processing unit of the image projection device combines image data of images in a predetermined display area of the plurality of terminal devices based on the image attribute information. 2. The image projection system according to item 1.   The operation command processing unit of the image projection device determines image data of an image to be operated by the acquired image operation command based on the image attribute information acquired by the image acquisition unit. The image projection system according to claim 8. In an image projection apparatus that acquires image data of images in a predetermined display area of a plurality of terminal devices via a communication path, and projects an image based on the image data.
An image acquisition unit that acquires image data of an image in a predetermined display area of each of the terminal devices;
An image processing unit that combines image data of images in a predetermined display area of the plurality of terminal devices;
An image projection unit that projects an image based on the image data synthesized by the image processing unit;
When an image operation command for operating a predetermined image among images projected by the image projection unit is acquired, this image is transmitted to the terminal device that has transmitted the image data of the image to be operated by the image operation command. An image projection apparatus comprising: an operation command processing unit that transmits an operation command via the communication path. Computer
Means for transmitting part or all of the image data of the image to the image projection device via the communication path when the position of the image generated based on the data file by the application program is in the predetermined display area;
Means for manipulating the image projected by the image projection device;
Means for transmitting an image operation command corresponding to the operation to the image projection device via the communication path when the operation means is operated in a predetermined manner;
When the image operation command is received from the image projection device via the communication path, the program causes the application program to execute editing of the data file according to the image operation command. .