WO2009113676A1

WO2009113676A1 - Image display system, display device used in same system, and information processing method

Info

Publication number: WO2009113676A1
Application number: PCT/JP2009/054910
Authority: WO
Inventors: 矢田裕紀; 安江範巳
Original assignee: ブラザー工業株式会社
Priority date: 2008-03-14
Filing date: 2009-03-13
Publication date: 2009-09-17
Also published as: JP2009222919A

Abstract

Provided is an image display system which enables smooth sharing of information and collaborative work among plural persons by a reduction in the load on a communication path by selectively reducing the data amount of image data relating to application windows transmitted via the communication path. An image display system (S) is provided with a window selecting means for selecting one or more application windows (30) from among plural application windows (30) displayed on a display device (1) and a transmission data amount reducing means for reducing the data amount of image data relating to an application window (30) other than the application window (30) selected by the window selecting means among image data relating to application windows (30) transmitted from a terminal device (2) to the display device (1) via a communication path (4).

Description

Image display system, display device used in the system, and information processing method

The present invention acquires image data of one or more terminal devices and an application window generated by application activation in the terminal devices via a communication path, and a plurality of applications / images are displayed on a display screen based on the image data. The present invention relates to an image display system including a display device that displays a window on a display device, a display device used in the system, and an information processing method.

2. Description of the Related Art Conventionally, as a display device, a projector or the like that inputs image information from a computer device or the like, displays the image on a liquid crystal display element, and irradiates light on the liquid crystal display element to project it on a projection screen has been widely used. ing. This type of projector is often used in a meeting or the like where a plurality of people participate, and by using such a projector, discussion can be promoted while a plurality of participants see one enlarged image at the same time. It is possible to go.

On the other hand, by connecting a plurality of terminal devices through a communication path such as a network, information sharing and collaborative work in conferences and the like are often efficiently performed. For example, Patent Document 1 discloses a conference support system 500 including a server 510 and a plurality of terminal devices 520a to 520c as shown in FIG. According to the conference support system 500, the plurality of terminal devices 520a to 520c transmit the image data 530a to 530c of the application window to the server 510 via the communication path, and the server 510 receives the received image data 530a. ˜530c are combined, the combined image data 540 is transmitted to each of the terminal devices 520a to 520c, and an image based on the image data 540 is displayed on the screen of each of the terminal devices 520a to 520c. Discussions can be made while viewing the same image.

Furthermore, if a projector is connected to a terminal device or server that constitutes a conference support system as in Patent Document 1, a user of the terminal device can display only an image for presentation, for example, a projected image area of the projector. On the other hand, information for reference only during the presentation by the user of the terminal device can be displayed in the display area of the display unit of the terminal device, so that the presentation can be performed more smoothly. It becomes.
JP 2006-31359 A

However, in the above system, when each terminal device transmits image data of an application window to the server, the image data of all the application windows is transmitted as it is regardless of the purpose of use of the application window. Therefore, when the number of image data transmitted via a communication path such as a network increases, a large load is applied to the communication path, which may hinder smooth progress of a conference using the system. .

Therefore, the present invention reduces the load on the communication path by selectively reducing the data amount of the image data of the application window transmitted through the communication path, so that information can be shared and shared by multiple people. It is an object of the present invention to provide an image display system capable of performing work smoothly, a display device used in the system, and an information processing method.

In order to achieve the above object, according to one aspect of the present invention, one or more terminal devices and a display device are provided, and image data of an application window generated by activation of an application in the terminal device is transmitted as a communication path. In an image display system that displays a plurality of application windows on a display screen based on the image data, the display device displays one or more applications from the plurality of application windows displayed on the display device. Window selection means for selecting a window and applications other than the application window selected by the window selection means among the image data of the application window transmitted from the terminal device to the display device via the communication path・A transmission data amount reduction means for reducing the data amount of the image data of Indou, it was to have.

In order to achieve the above object, according to another aspect of the present invention, there is provided one or more terminal devices and a display device, and image data of an application window generated by activation of an application in the terminal device is transmitted as a communication path. In the image display system that displays a plurality of application windows on the display screen based on the image data, the display device includes information including the image data transmitted from the terminal device. Received via the communication path, image display means for displaying an application window on a display screen based on the image data acquired from the terminal device by the reception processing means, and the reception processing means According to the operation information acquired from the terminal device, the application acquired from the terminal device. Window selection means for selecting one or more application windows from the image data of the application window, and notification means for notifying the terminal device of the content specified by the window selection means via the communication path The terminal device stores storage means for storing a data file, image generation means for generating image data of an application window based on the data file by executing an application, and an image displayed on the display device. An operating means for operating, information on operation by the operating means, and transmission processing means for transmitting image data of the application window generated by the image generating means to the display device via the communication path; The specified content notified by the notification means of the display device In response, transmission for reducing the amount of image data of application windows other than the application window selected by the window selection means from among the image data of application windows transmitted to the display device via the communication path. Data amount reduction means.

As described above, the amount of image data of the application window other than the application window selected by the window selection unit is reduced by the transmission data amount reduction unit, so that the load on the communication path can be reduced. Even when the number of image data to be transmitted to the display device is increased, it is possible to smoothly perform collaborative work by a plurality of persons. In addition, since the application selection window that does not reduce the data amount can be selected by the window selection means, smooth progress such as collaborative work by a plurality of persons is not hindered.

Further, in the image display system, the transmission data amount reducing means may determine the data amount of the image data of the application window other than the application window specified by the window selecting means by using the application data specified by the window selecting means. A configuration may be adopted in which the data amount is smaller than the data amount of the window image data.

With this configuration, the load on the communication path when image data is transmitted from the terminal device to the display device can be reduced, and the number of image data transmitted to the display device increases. However, it is possible to smoothly perform joint work by a plurality of people.

Further, in the image display system, the transmission data amount reducing means is a part other than the application window designated by the window selecting means among the image data of the application window transmitted to the display device via the communication path. By reducing the image size of the image data of the application window, the data amount of the image data of the application window other than the application window specified by the window selection unit may be reduced.

With this configuration, it is possible to reduce the amount of image data of application windows other than the application window specified by the window selection unit.

Further, in the image display system, when the resolution set in the terminal device is larger than the resolution set in the display device, the transmission data amount reducing unit is configured to reduce the application window at a magnification according to the difference. After changing the image size of the image data, among the application window image data transmitted from the terminal device to the display device via the communication path, other than the application window selected by the window selection means The application window may be configured to reduce the amount of image data.

With this configuration, it is possible to reduce the amount of window image data to be transmitted to the display device, and to prevent a situation in which, for example, the window image does not fit in the projected image area of the display device. it can.

In the image display system, when the data file is a moving image file, the transmission data amount reducing unit does not select an application window for displaying a moving image based on the moving image file by the window selecting unit. A still image is extracted from the moving image data based on the moving image file at a predetermined frame interval, and the transmission processing unit extracts the image data of the still image extracted by the transmission data amount reducing unit via the communication path. You may make it the structure transmitted to the said display apparatus.

By configuring in this way, not only reducing the image size of the moving image data of the application window that displays the moving image based on the moving image file, but also reducing the number of update frames of the moving image data, The data amount of the moving image data can be further reduced.

Further, in the image display system, the transmission data amount reduction means may be configured to vary the data amount reduction mode of the image data according to the type of application that executes the data file.

By configuring in this way, the window that has become an unselected application window by the window selection means, the optimal amount of data is reduced for each application that executes the data file. Etc. can be performed more smoothly.

In order to achieve the above object, according to another aspect of the present invention, there is provided one or more terminal devices and a display device, and image data of a plurality of application windows generated by starting up an application in the terminal device. An information processing method in an image display system that is acquired via a communication path and displays a plurality of application windows on a display screen on the display screen based on the image data, the plurality of applications displayed on the display device A step of selecting one or more application windows from the window; and image data of the application window transmitted from the terminal device to the display device via the communication path, other than the selected application window Application window A step of reducing the data amount of the image data, it was decided to have a.

In order to achieve the above object, according to another aspect of the present invention, image data of a plurality of application windows generated by starting an application in a terminal device is acquired via a communication path, and based on the image data In a display device that displays a plurality of application windows on the display screen, reception processing means for receiving information including the image data transmitted from the terminal device via the communication path, and the terminal by the reception processing means An image display means for displaying an application window on a display screen based on image data obtained from the apparatus; and an application window obtained from the terminal apparatus in accordance with operation information obtained from the terminal apparatus by the reception processing means. One or more of the image data A window selection means for selecting a window, the contents of the specified by the window selecting means was to have a notification unit configured to notify the terminal device via the communication path.

According to the present invention, the amount of image data of the application window other than the application window selected by the window selection unit is reduced by the transmission data amount reduction unit, so that the load on the communication path is reduced. Thus, even when the number of image data transmitted to the display device is increased, it is possible to smoothly perform a collaborative work by a plurality of persons. In addition, since the application selection window that does not reduce the data amount can be selected by the window selection means, smooth progress such as collaborative work by a plurality of persons is not hindered.

1 is a diagram showing an overall system configuration of an image display system in the present embodiment. It is a schematic block diagram of the projector used for the image display system in this embodiment. It is a schematic block diagram of the terminal device used for the image display system in this embodiment. It is the figure which showed a mode that the data amount of the image data transmitted to a projector was reduced. It is the figure which showed a mode that the data amount of the image data transmitted to a projector was reduced. It is the figure which showed a mode that the data amount of the image data transmitted to a projector was reduced. It is a figure which shows the reduction aspect of the data amount set for every application. It is a block diagram of the projector in this embodiment. It is a figure which shows an example of the image attribute information management table memorize | stored in the projector in this embodiment. It is a figure for demonstrating the coordinate prescribed | regulated to the projection image area | region of the projector in this embodiment. It is an example of the connection information management table memorize | stored in the projector in this embodiment. It is an example of the cursor information management table memorize | stored in the projector in this embodiment. It is a block diagram of the terminal device in this embodiment. FIG. 9 is a diagram illustrating a state of a window image displayed in a projection image area of the projector after the data amount of the window image data is reduced by the transmission data amount reducing unit from the state illustrated in FIG. 8. It is a main process flowchart of the projector in this embodiment. It is an image projection process flowchart of the projector in this embodiment. 6 is a flowchart of a projector operation command distribution process according to the present embodiment. It is a main process flowchart of the terminal device in this embodiment. It is an image data transmission process flowchart in this embodiment. It is an active window in this embodiment, a reference window transmission process flowchart. It is an inactive window transmission process flowchart in this embodiment. It is a figure which shows a prior art example.

Explanation of symbols

S Image display system 1 Projector 2 Terminal device 4 Communication path 30 Application window

[1. Overview of image display system]
Hereinafter, an image display system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an overall system configuration of an image display system in the present embodiment, FIG. 2 is a schematic configuration diagram of a projector used in the image display system in the present embodiment, and FIG. 3 is a diagram in the present embodiment. It is a schematic block diagram of the terminal device used for an image display system.

As shown in FIG. 1, an image display system S according to the present embodiment includes a projector 1 as a display device and a plurality of terminal devices (here, terminal devices 2a, 2) connected to the projector 1 via a communication path 4. 2b), the

cursors

5a, 5b in the

virtual display areas

45a, 45b of the plurality of

terminal devices

2a, 2b, and application programs (hereinafter simply referred to as “ Among the application windows (hereinafter sometimes simply referred to as “windows”) generated by the activation of “applications”), they are in the

virtual display areas

45a and 45b of the

terminal devices

2a and 2b. The image data of the

windows

30a and 30b is synthesized as one image data, and an image based on the synthesized image data Hereinafter sometimes referred to as "display image".) Is a system for displaying on the display screen.

In the present embodiment, the case where two terminal devices are connected to the projector 1 will be described, but the number of terminal devices connected to the projector 1 is not limited to this. In the following, when any one of the

terminal devices

2a and 2b is represented, it may be represented as the terminal device 2, and when any one of the

virtual display regions

45a and 45b is represented, the virtual display region 45 may be represented. When representing any one of the

cursors

5a and 5b, it may be represented as the cursor 5, and when representing any one of the windows 30a to 30e, it may be represented as the window 30. There is.

Here, in the image display system S according to the present embodiment, as shown in FIG. 2, the projector 1 includes a reception processing unit 10, an image display unit 11, a window selection unit 12, a notification unit 13, and an operation command. And processing means 14.

As shown in FIG. 3, the terminal device 2 includes a storage unit 20, an image generation unit 21, an operation unit 22, a transmission processing unit 23, a transmission data amount reduction unit 24, an editing unit 25, a virtual unit, Display area setting means 26.

An overall outline of the image display system S configured as described above will be described with reference to FIGS. 4A to 4C and FIG. 4A to 4C are diagrams showing how the amount of image data transmitted to the projector is reduced, and FIG. 5 is a diagram showing how the amount of data set for each application is reduced.

First, the terminal device 2 uses the image generation unit 21 to generate image data of the application window 30 based on the data file stored in the storage unit 20. The generation of the image data of the application window 30 is performed by executing the application.

Here, the data file is a saved data file of an application executed by various applications such as spreadsheet software and graphic creation software possessed by the terminal device 2, and is stored in the storage means 20 possessed by each terminal device 2. ing.

The application program functions as the image generation means 21 and the editing means 25 in the terminal device 2. That is, when the user of the terminal device 2 performs an operation of executing a data file using the operation unit 22, the application program performs an image based on the data file stored in the storage unit 20 as the image generation unit 21 (for example, FIG. 1, the data of the

windows

30a, 30c, and 30d generated by the terminal device 2a and the

windows

30b and 30e) generated by the terminal device 2b are generated. Further, when the user of the terminal device 2 performs a predetermined operation on the image data of the window 30 generated by the image generation unit 21 using the operation unit 22, the application program is operated as the editing unit 25. Edit the data file based on

Also, the projector 1 combines the image data of the cursor 5 and the window 30 in the virtual display area 45 of each terminal device 2 and projects and displays an image based on the combined image data in the projection image area 60.

When combining the cursor 5 and the window 30 in the virtual display area 45, first, the terminal device 2 uses the transmission processing unit 23 to display information on the operation by the operation unit 22 and the application window 30 generated by the image generation unit 21. The image data is transmitted to the projector 1 via the communication path 4, and the projector 1 receives the transmitted information via the communication path 4 by the reception processing means 10.

Then, the projector 1 arranges the image data of the cursor 5 and the window 30 on the projection image area 60 based on the information acquired by the reception processing means 10 by the image display means 11 and synthesizes them. By generating image data for projection and projecting an image based on the image data for projection, an image 30 ′ of the window 30 in the virtual display area 45 of each terminal device 2 (hereinafter referred to as “window image 30 ′”). Or the image of the cursor 5 is synthesized and displayed in the projected image area 60.

Note that the virtual display area 45 in this embodiment is a virtual area that is apparently set to be adjacent to the display area 40 of the terminal device 2 and is set by the virtual display area setting means 26 of the terminal device 2. Is.

Also, in the image display system S in the present embodiment, any data file can be edited in response to a request from the terminal device 2. That is, in the present embodiment, when the projector 1 obtains an operation command for operating an arbitrary window image 30 ′ of the display image from the terminal device 2, the operation command processing unit 14 performs the operation command according to the operation command. This operation command is transmitted to the terminal device 2 that has transmitted the image data of the window image 30 ′ to be operated. When the terminal device 2 receives the operation command, the editing device 25 sends a data file in accordance with this operation command. I am going to edit it.

For example, when the user of the terminal device 2a operates the operation unit 22, a predetermined operation input (for example, the window image 30b ′) is performed on the window image 30b ′ in the virtual display area 45b of the terminal device 2b among the display images. Terminal device 2a acquires the information of the operation input.

Next, the terminal device 2 a transmits an operation command corresponding to the operation input to the projector 1 via the communication path 4 by the transmission processing unit 23.

When the projector 1 receives an operation command from the terminal device 2a, the operation command processing means 14 performs a process of distributing the operation command to the terminal device 2 to be transmitted. Here, when the user of the terminal device 2a operates the window image 30b ′ of the terminal device 2b in the display image, and the operation command corresponding to the operation input is transmitted from the terminal device 2a, the operation command is Sorted to be transmitted to the device 2b.

The terminal device 2b that has received the operation command from the projector 1 reproduces the operation input based on the operation command, and the application edits the data file being executed as the editing unit 25 in accordance with the reproduced operation input. Do.

The image display system S according to the present embodiment further reduces the amount of image data of any window 30 among the windows 30 transmitted to the projector 1 via the communication path 4.

That is, in the image display system S according to the present embodiment, when the user of the terminal device 2 performs a predetermined operation on the operation unit 22, the projector 1 displays the window that is the target of the operation as a window selection unit. 12, and the notification unit 13 notifies the terminal device 2 of the content specified by the window selection unit 12 via the communication path 4. Then, the terminal device 2 that has received the notification selects a window from the image data of the window 30 to be transmitted to the projector 1 via the communication path 4 according to the designated content notified by the notification means 13 of the projector 1. The amount of image data of windows other than the window 30 selected by the means 12 is reduced.

Here, in the image display system S according to the present embodiment, when an arbitrary window image 30 ′ of the display image is operated by the operation unit 22 of the terminal device 2, the window 30 that is the target of the operation is displayed. While selecting by the window selection means 12, selection by the window selection means 12 of windows 30 other than the window 30 which is the target of the operation is cancelled. Hereinafter, an application window selected by the window selection unit 12 is referred to as an “active window”, and an application window not selected by the window selection unit 12 is referred to as an “inactive window”. The active window may be selected from a remote control device (not shown).

In the image display system S according to the present embodiment, the transmission data amount reduction unit 24 reduces the image size of the image data of the application window 30 other than the application window 30 specified by the window selection unit 12. The data amount of the image data of the application window 30 other than the application window 30 designated by the window selection means is reduced.

That is, for example, as shown in FIG. 4A, the window image 30a ′, the window image 30b ′, and the cursor 5a of the terminal device 2a are displayed in the projected image area 60 of the projector 1, and the window image 30a ′ is set as the active window. 4B, when the user of the terminal device 2a performs an operation (so-called click operation) for selecting the window image 30b ′ with respect to the window image 30b ′, the projector 1 The window selection means 12 sets the window image 30b ′ as an active window and sets the window image 30a ′ as an inactive window.

Next, the projector 1 transmits, to the terminal device 2b, which is the transmission source of the window image 30b ′, by the notification means 13 to the effect that the window image 30b ′ is set as the active window, and transmits the window image 30a ′. The fact that the window image 30a ′ is set to the inactive window is transmitted to the original terminal device 2a. The notification that the window image 30 ′ is set as the active window is notified together with the operation command transmitted by the operation command processing means 14.

Next, when the notification by the notification means 13 of the projector 1 is received, the terminal device 2a captures the window 30a in its own virtual display area 45a, reduces the image size of the captured image, and transmits the transmission processing means. 23, the reduced image data is transmitted to the projector 1 via the communication path 4. Further, the terminal device 2 b transmits the image data of the window 30 b in its own virtual display area 45 b to the projector 1 via the communication path 4 by the transmission processing unit 23. As described above, when the terminal device 2 receives the notification from the projector 1 by the notification unit 13, the terminal device 2 does not directly change the image size of the window 30 in its own virtual display area 45, but instead of directly changing the image of the captured image of the window 30. The image size is to be changed.

Then, the projector 1 causes the image display means 11 to display a display image on the display screen based on each image data acquired from the

terminal devices

2a and 2b. As a result, as shown in FIG. 4C, the projected image area 60 of the projector 1 is set to the window image 30a ′ in which the image size is reduced by setting the inactive window and the virtual display area 45b by being set to the active window. The window image 30b ′ having the same image size as that of the window 30b is displayed.

As described above, according to the image display system S according to the present embodiment, the transmission data amount reducing unit 24 reduces the data amount of the image data of the windows 30 other than the window 30 selected by the window selecting unit 12. For this reason, the load on the communication path 4 can be reduced, and even when the number of image data transmitted to the projector 1 as a display device increases, it is possible to smoothly perform joint work by a plurality of persons. It becomes.

Moreover, since the window 30 that does not reduce the amount of data can be selected and changed according to the situation by the window selection means 12, smooth progress such as joint work by a plurality of persons is not hindered. In other words, in the present embodiment, only the window 30 to be operated by the user of the terminal device 2 is set as the active window by the window selection means 12, so that it is not particularly necessary to display during the operation of the active window. The data amount of the image data in the other window 30 can be reduced by the transmission data amount reducing unit 24.

Further, in the image display system S according to the present embodiment, when the resolution set in the terminal device 2 is larger than the resolution set in the projector 1, the transmission data amount reducing unit 24 applies the application at a magnification according to the difference. After the image size of the image data of the window 30 is changed, the image data of the application window 30 transmitted from the terminal device 2 to the projector 1 via the communication path 4 is further selected by the window selection unit 12 The amount of image data in the application window 30 other than the application window 30 is reduced.

With this configuration, the amount of image data of the window 30 transmitted to the projector 1 can be reduced, and a situation in which the window image 30 ′ cannot fit in the projection image area 60 can be prevented. .

Further, in the image display system S according to the present embodiment, the transmission data amount reducing unit 24 changes the data amount reduction mode of the image data according to the type of application that executes the data file.

That is, in the present embodiment, as shown in FIG. 5, the window 30 that is the target of data amount reduction is image creation software or moving image among various application programs stored in the storage unit 20 of the terminal device 2. If it is executed by the creation software, the image size of the image data to be transmitted to the projector 1 is reduced to 1/16 of the original window 30 and is executed by the document creation software or the web browser software. If the image data is to be transmitted to the projector 1, the image size of the image data to be transmitted to the projector 1 is reduced to 1/9 of the original window 30. The image size of data is reduced to 1/4 of the original window 30. .

By adopting such a configuration, a window that has become an inactive window is reduced in an optimal amount of data for each application that executes the data file, and therefore, collaborative work by a plurality of people can be performed more smoothly.

In the image display system S according to the present embodiment, there is an application window (hereinafter also referred to as “moving image window”) that displays a moving image based on a moving image file in the virtual display area 45 of the terminal device 2. In this case, the terminal device 2 extracts a still image from the moving image data for each frame, and transmits the image data of the extracted still image to the projector 1 via the communication path 4 by the transmission processing unit 23. Yes. When the moving image window is set as an inactive window, the transmission data amount reduction unit 24 of the terminal device 2 extracts still images from the moving image data based on the moving image file at predetermined frame intervals, and transmits them. The processing unit 23 transmits the image data of the still image extracted by the transmission data amount reducing unit 24 to the projector 1 via the communication path 4.

As described above, when the data file is a moving image file, not only the image size of the moving image data of the application window 30 displaying the moving image based on the moving image file is reduced, but also the number of updated frames of the moving image data is set. Since the reduction is made, the data amount of the moving image data can be further reduced.

Hereinafter, a more specific example of the configuration and operation of the above-described image display system S will be specifically described with reference to the drawings.

[2. Specific configuration of projector system]
(About the configuration of the projector 1)
First, the configuration of the projector 1 will be specifically described with reference to the drawings. 6 is a configuration diagram of the projector 1 in the present embodiment, FIG. 7 is a diagram illustrating an example of an image attribute information management table stored in the projector 1 in the present embodiment, and FIG. 8 is a diagram of the projector 1 in the present embodiment. FIG. 9 is an example of a connection information management table stored in the projector 1 in the present embodiment, and FIG. 10 is a diagram of the projector 1 in the present embodiment. It is an example of the cursor information management table memorize | stored in FIG.

As illustrated in FIG. 6, the projector 1 includes an operation panel 101 for performing various operations, a storage unit 102 that is a nonvolatile memory for holding setting information, data files, and the like, and infrared rays that perform wireless communication using infrared rays. The communication unit 103, the interface 104 for communicating with the terminal device 2, the video signal input circuit 105 for inputting a video signal from the outside, and the video signal input via the video signal input circuit 105 and the interface 104 An image processing circuit 106 that performs predetermined processing on the acquired image data, an image projection unit 107 that projects an image based on an image signal output from the image processing circuit 106, and a control unit 108 that controls the entire projector 1 These are built in the housing.

The operation panel 101 includes buttons for performing various operations, a display unit (for example, an LCD), and the like. When the user operates the operation panel 101 in the projector 1, control according to the operation content is controlled. This is executed by the unit 108.

The storage unit 102 includes a flash memory, and the like. The resolution information set in the projector 1, the image data of the cursor of each terminal device 2, and the window 30 in the virtual display area 45 of each terminal device 2. The image attribute information storage area 110 for storing the image attribute information management table for managing the position information, size information, etc. of the window 30 and the connection status of the terminal device 2 connected to the projector 1. It has a connection information storage area 111 for storing a connection information management table to be managed, and a cursor information storage area 112 for storing a cursor information management table for managing position information of the cursor 5 and the like.

The infrared communication unit 103 is for performing infrared communication with a remote control device (not shown), and performs processing for converting an infrared signal received by the infrared light receiving unit 131 into data. And an infrared control unit 132 for performing.

The interface 104 is a USB interface capable of communicating with an external device, and is acquired by the control unit 108 when acquiring image data, an image operation command, or the like from the terminal device 2 or communicating with an external computer device. Used. The interface 104 may be a wireless or wired LAN interface instead of the USB interface.

The video signal input circuit 105 inputs video signals such as composite video signals (for example, NTSC video signals) and component video signals (for example, RGB signals).

The image processing circuit 106 performs processing such as synthesis of a plurality of image data on the video signal input to the video signal input circuit 105 or the image data acquired via the interface 104 based on control by the control unit 108. Do. The image signal generated by processing in this way is input to the image projection unit 107.

The image projection unit 107 includes a light source driving circuit 120, a light source 121, an illumination optical system 122, a transmissive liquid crystal panel 123 (hereinafter referred to as “LCD 123”), an imaging optical system 124, and an LCD driving circuit 125. And a focus adjustment circuit 126.

The light source 121 is composed of a lamp or the like, and is driven to turn on and emit light based on a signal output from the light source driving circuit 120 controlled by the control unit 108. The light emitted from the light source 121 is applied to the LCD 123 as illumination light by the illumination optical system 122.

The LCD 123 is driven by the LCD drive circuit 125 and displays an image on its display surface. The video displayed in this way is irradiated with illumination light emitted from the light source 121 via the illumination optical system 122, thereby generating image light. Subsequently, the image light is projected onto the screen (projection surface) through the imaging optical system 124 and the projection opening (not shown) of the housing. As described above, the image displayed on the LCD 123 is projected onto the screen. The focus adjustment circuit 126 can adjust the focus of the image projected on the screen.

The control unit 108 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and the CPU reads and executes a program stored in advance in the ROM, whereby the projector 1 is caused to function as a reception processing means, an image display means, a window selection means, a notification means, and an operation command processing means.

As a reception processing unit, the control unit 108 receives the image data of the window 30 in the virtual display area 45 of the plurality of terminal devices 2, the position coordinates of the cursor 5, the size of the virtual display area 45, or an image operation command, and the interface 104 and the communication path 4. Receive via. The image operation command can also be acquired from a remote control device (not shown).

Further, the control unit 108 functions as an image display unit together with the image processing circuit 106, the image projection unit 107, and the LCD 123, thereby synthesizing the image data acquired from the terminal device 2 by the reception processing unit, and based on the synthesized data. The application window 30 and the cursor 5 are displayed in the projected image area 60 as a display screen. The composition of the image data by the image display unit is executed based on the image attribute information management table, the connection information management table, and the cursor information management table stored in the storage unit 102.

Here, the image attribute information management table will be described with reference to FIG.

As shown in FIG. 7, the image attribute information management table includes the name of the terminal device 2 (owner PC) that transmitted the image data of the window 30 in the virtual display area 45 of each terminal device 2, and the virtual display of the window 30. The information on the size on the area 45 and the projected image area 60 and the position where the window 30 should be displayed, the information on the file name of the image data, and the plurality of image data are superimposed when the image display means synthesizes the plurality of image data. Information relating to the matching order (hierarchy level), the data amount of the image data, and the setting state of the window 30 are stored in association with information (window ID) for identifying the image.

Information regarding the position where the window 30 in the virtual display area 45 of each terminal device 2 is to be displayed is represented by the coordinate position on the projection image area 60 and the coordinate position on the virtual display area 45.

In the present embodiment, the coordinates of the virtual display area 45 set in each terminal device 2 are defined with the top left vertex as the origin, and one pixel (one pixel) is the minimum unit, and the virtual display area 45 The upper limit is determined according to the set number of pixels.

For example, when the number of pixels of the virtual display area 45a set in the terminal device 2a is 1200 × 1000, the coordinates (X, Y) defined in the virtual display area 45a are expressed as follows: X, Y) = (0, 0) to (1200, 1000).

Further, the coordinates of the projected image area 60 of the projector 1 are also defined with the upper left vertex as the origin, similarly to the virtual display area 45 set in each terminal device 2, and one pixel (1 pixel) is the minimum unit. The upper limit is determined according to the number of pixels set in the projection image area 60. For example, as shown in FIG. 8, on the projected image area 60, the position coordinates of the window 30a are (X, Y) = (50, 250), and the position coordinates of the window 30b are (X, Y) = (500 , 100), and the position coordinates of the window 30c are (X, Y) = (500, 400).

The size information of the window 30 in the virtual display area 45 and the window image 30 ′ in the projection image area 60 is the coordinate value of the width (W) and height (H) of the window 30 or window image 30 ′. It is the information represented. For example, as shown in FIG. 8, the image size of the window image 30a ′ is (W, H) = (640, 600).

Also, the name of the terminal device 2 (owner PC) that transmitted the image data is associated with the connection information management table shown in FIG. In this connection information management table, as shown in FIG. 9, the name of the terminal device 2 connected to the projector 1 is the connection status (whether it is connected to the projector 1 or not connected) and each terminal device 2. Is stored in association with the IP address assigned to.

Further, the control unit 108 functions as an image display unit, thereby displaying the image of the cursor 5 at a position based on the operation information transmitted by the transmission processing unit of the terminal device 2 and the virtual display of each terminal device 2. The image data is combined with the image data of the window 30 in the area 45. Here, the composition of the image of the cursor 5 is executed based on the information in the cursor information management table.

As shown in FIG. 10, the cursor information management table includes the image file name of the cursor image assigned to the terminal device 2 connected to the projector 1 and the position information (X, Y) of the cursor image in the projection image area 60. It is stored in association with the name of the terminal device 2.

Here, in the present embodiment, a different hierarchical level is assigned to each image data of the image in the virtual display area 45 of each terminal device 2, and the image data is synthesized by superimposing the image data in the hierarchical level order. It is said. That is, when the control unit 108 synthesizes the image data of the window 30 in the virtual display area 45 of each terminal device 2, the control unit 108 refers to the hierarchical level information stored in the image attribute information management table. Image data of an image that is formed by superimposing images in descending order is generated.

And the control part 108 synthesize | combines the image data of the cursor 5 and the window 30 in the virtual display area 45 of each terminal device 2 with reference to these tables.

As a result, the cursor 5 and the window 30 in the virtual display area 45 of each terminal device 2 are positioned on the projected image area 60 corresponding to the position coordinates (X, Y) on each virtual display area 45 ( (X, Y).

By the way, each window 30 has an active window set for the window 30 to be operated, an inactive window set for the window 30 not to be operated, and when performing an operation. It is set to any state of the reference window set as the reference window 30. This state is set by window selection means.

That is, the control unit 108 functions as a window selection unit, and selects one or more application windows from the image data of the window 30 acquired from the terminal device 2 according to the operation information acquired from the terminal device 2. To do.

Specifically, when an arbitrary window image 30 ′ of the display image is operated by the operation unit of the terminal device 2, the control unit 108 sets the window 30 that is the target of the operation as an active window. At the same time, the window 30 other than the window 30 that is the target of the operation and the window 30 set as the reference window is set as an inactive window.

In the present embodiment, the application window selected by the window selection means indicates the window 30 set as the active window and the reference window, and is an application window other than the application window selected by the window selection means. Indicates a window 30 set as an inactive window.

Here, the reference window is set by a specific operation command by the operation means of the terminal device 2. Here, in the present embodiment, the “specific operation command” is “performing the click operation of the mouse 207 while pressing the Ctrl key of the keyboard 206 of the terminal device 2 on the window image 30 ′”. . When the control unit 108 detects the specific operation command, the control unit 108 sets the window 30 that is the target of the operation as a reference window. The setting state of each window 30 set in this way is stored in the image attribute information management table.

Also, the control unit 108 functions as a notification unit together with the interface 104, thereby notifying the terminal device 2 of the content specified by the window selection unit via the communication path 4. Here, the information transmitted to the terminal device 2 by the notification means includes the window ID of the window 30 that is the subject of the notification, and any of the active window, the inactive window, and the reference window. Contains information about what has been set.

In addition, the control unit 108 functions as an operation command processing unit together with the interface 104, so that an image operation command for operating an arbitrary window image 30 ′ of the window images 30 ′ projected by the image projection unit 107. Is acquired, the image operation command is transmitted to the terminal device 2 that has transmitted the image data of the window image 30 ′ to be operated by the image operation command.

Here, in the present embodiment, as described above, when an arbitrary window image 30 ′ of the display image is operated by the operation unit of the terminal device 2, the window 30 that is the target of the operation is changed to the active window. Therefore, when the image operation command is transmitted to the terminal device 2, the control unit 108 transmits the content specified by the window selection unit at the same time.

In this embodiment, when an image operation command is transmitted to the terminal device 2, the image data of the window 30 to be operated by the image operation command and the terminal device 2 to which the image operation command is to be transmitted are received. The determination is made based on the image attribute information acquired by the processing means.

With such a configuration, it is not necessary to separately request each terminal device 2 for information for determining the image data of the image to be operated for each operation, and the burden on the communication path 4 can be reduced. it can.

(Regarding the configuration of the terminal device 2)
Next, the configuration of the terminal device 2 will be described. FIG. 11 is a configuration diagram of the terminal device 2 in the present embodiment, and FIG. 12 is a projection image area of the projector 1 after the data amount of the window image data is reduced by the transmission data amount reduction unit from the state shown in FIG. FIG. 6 is a diagram showing a state of a window image displayed at 60.

The terminal device 2 in the present embodiment can be applied to a general personal computer or a dedicated terminal, and stores an LCD 200, a graphics controller 201 for driving the LCD 200, and various data as shown in FIG. An interface 203 for performing communication between the hard disk device 202 and the projector 1 via the communication path 4, a USB bus controller 204 for inputting / outputting data to / from the USB device, and a connection port connected thereto A USB connector 205, a keyboard 206 and a mouse 207 capable of inputting predetermined information by a user operation, and a control unit 208 that controls the entire terminal device 2 are configured. 209 and the second bus 210 are connected to each other. In the figure, reference numeral 211 denotes a bus controller for transferring data between the first bus 209 and the second bus 210. The keyboard 206 and the mouse 207 correspond to operation means for operating the image displayed in the projection image area 60 of the projector 1.

The hard disk device 202 functions as a storage unit. The hard disk device 202 includes an operating system (OS) program, document creation software, presentation software, spreadsheet software, and graphic creation software for the terminal device 2. In addition to various application programs such as the above, data files created by this application program are stored. In addition to the application program, an image sharing program as a processing program for the image display system S in the present embodiment is stored.

The image sharing program may be downloaded from a server (not shown) connected to the communication path 4 to the hard disk device 202 of the control unit 208 via the interface 203, or may be a CD. It may be recorded on a recording medium such as ROM (Compact Disc Read Read Only Memory) and then read into the hard disk device 202 of the control unit 208 via a recording medium drive (not shown).

The interface 203 is a USB interface capable of communicating with an external device, and is acquired by the control unit 208 when acquiring image data, an image operation command, or the like from the terminal device 2 or communicating with an external computer device. Used. The interface 203 may be a wireless or wired LAN interface instead of the USB interface.

The control unit 208 includes a CPU, a ROM, a RAM, and the like, and the CPU reads and executes the image sharing program stored in the hard disk device 202, whereby the terminal device 2 is set as a transmission processing unit and a virtual display area setting. It functions as a means.

Also, the control unit 208 reads out and executes various application programs stored in the hard disk device 202 by the CPU, thereby causing them to function as image generation processing means, transmission data amount reduction means, editing means, and the like.

The CPU of the control unit 208 executes various application programs stored in the hard disk device 202 and functions as an image generation processing unit, thereby generating image data of the application window 30 based on the data file by executing the application. To do. The generated image data is displayed on the LCD 200 as an application window 30 based on the image data by the LCD 200 and the graphics controller 201.

In addition, the control unit 208 functions as a transmission processing unit together with the interface 203, so that operation information by the keyboard 206 and the mouse 207, image data of the application window 30, the image size and position coordinates of the image data, the image data And the position coordinates of the cursor 5 are transmitted to the projector 1 via the communication path 4.

Here, when transmitting the image data of the window 30, BMP (Bit Map) data obtained by capturing the window 30 in the virtual display area 45 is converted into JPEG (Joint Photographic Experts Group) data.

Further, the control unit 208 functions as an editing processing unit, so that when an image operation command is received from the projector 1 via the communication path 4, the operation input is reproduced from the image operation command, and according to the operation input. Edit the data file. The image operation command is received by the interface 203.

Further, the control unit 208 functions as a transmission processing unit together with the interface 203, so that when a predetermined operation is performed with the keyboard 206 or the mouse 207 when the cursor 5 is positioned in the virtual display area 45, the operation is performed. An image operation command corresponding to the above is transmitted to the projector 1. Here, “operation” refers to displaying a command for editing a data file being executed by an application of the terminal device or another terminal device, or a cursor 5 pointing to an image projected by the projector 1 or It is a command for that movement.

The virtual display area 45 is set by the CPU of the control unit 208 executing an image sharing program stored in the hard disk device 202 and functioning as a virtual display area setting unit.

Further, the control unit 208 functions as a transmission data amount reduction unit, so that the application window 30 to be transmitted to the projector 1 via the communication path 4 in accordance with the designated content notified by the notification unit of the projector 1. Of the image data, the amount of image data of the inactive window is reduced.

That is, when the control unit 208 receives a notification from the projector 1 that the window 30 transmitted by itself is set as an inactive window, the control unit 208 determines the data amount of the image data of the window 30 having the window ID included in the notification. Reduce.

Here, the data amount of the image data of the window 30 is reduced by reducing the image size of the window 30.

When reducing the image size of the window 30, the control unit 208 converts BMP data obtained by capturing the window 30 into JPEG data, and reduces the converted JPEG data. At that time, the control unit 208 reduces the window 30 from the lower right part of the window 30 toward the upper left part. With this configuration, even when the image data of the window 30 is reduced, the position coordinates of the window 30 stored in the image attribute information management table of the projector 1 do not change.

In addition, the control unit 208 reduces the data amount of the image data in the window 30 in a manner corresponding to the type of application that executes the data file.

That is, in this embodiment, the window 30 set as an inactive window is executed by image creation software or moving image creation software among various application programs stored in the hard disk device 202 of the terminal device 2. If the image data is to be transmitted to the projector 1, the image size of the image data is reduced to 1/16 of the original window 30, and the image data is executed by the document creation software or the web browser software. If the image size of the image data to be transmitted to the projector 1 is reduced to 1/9 of the original window 30 and executed by spreadsheet software, the image size of the image data to be transmitted to the projector 1 is Reduced to 1/4 of the window 30 It is.

For example, in the state shown in FIG. 8, the window 30 is executed by spreadsheet software, the window 30a is set as an active window, the window 30b is set as an inactive window, and the window 30c is set as a reference window. When the window image 30b ′ is set as an active window and the window image 30a ′ is set as an inactive window by the operation of the user 207 of the device 2b, the control unit 208 of the terminal device 2a 1 receives a notification that the window image 30a is set as an inactive window, the BMP data obtained by capturing the window 30a is converted into JPEG data, and the image size of the image data is the original window. So that 1/4 of the image size of c 30, reduced toward the upper left portion of the image based on the image data from the lower right. Then, by transmitting the image data of the reduced image to the projector 1, as shown in FIG. 12, a window image of size (W, H) = (320, 300) is displayed in the projected image area 60 of the projector 1. 30a ′ is displayed at the position of coordinates (X, Y) = (50, 250).

Since the window 30b is set as an active window, the window image 30b ′ having the size (W, H) = (500, 500) in the projected image area 60 has the coordinates (X, Y) = (500, 100). It will be displayed at the position. Further, since the window image 30c ′ is set as a reference window, the setting state is not changed by the user's operation of the mouse 207 of the terminal device 2b.

In addition, when there is a moving image window in the virtual display area 45 and the moving image window is set as an inactive window, the control unit 208 functions as a transmission data amount reducing unit, and thereby based on the moving image file. Still images are extracted from the moving image data at predetermined frame intervals, and function as transmission processing means to transmit the extracted still image data to the projector 1 via the communication path 4.

(Specific operation of projector 1)
Next, an example of a specific operation of the projector 1 will be described with reference to FIGS. FIG. 13 is a main process flowchart of the projector 1 in the present embodiment. The following processes are executed by the control unit 108 of the projector 1 functioning as the above-described units.

As shown in FIG. 13, when a power switch (not shown) of the projector 1 is pressed, the control unit 108 of the projector 1 performs a connection process (step S100).

This connection process is a process for the projector 1 to connect to the terminal device 2 via the communication path 4. Specifically, first, when the control unit 108 of the projector 1 receives the connection request signal transmitted from the terminal device 2, the control unit 108 notifies the resolution information stored in the storage unit 102 of the projector 1. When the activation completion notification is received from the terminal device 2, the connection information management table is updated based on information included in the activation completion notification. That is, the control unit 108 newly provides a column for the terminal device 2 newly connected to the projector 1 in the connection information management table, and provides information on the IP address and connection state of the terminal device 2 as the name of the terminal device 2. Store it in association. Next, the control unit 108 updates the cursor information management table. That is, the control unit 108 newly provides a column of the terminal device 2 newly connected to the projector 1 in the cursor information management table, and the image file name of the cursor image assigned to the terminal device 2 and the position information of the cursor image. Is stored in association with the name of the terminal device 2. Then, the control unit 108 notifies the terminal device 2 that the connection process has been completed, and ends the connection process.

When the connection process in step S100 is completed, the control unit 108 performs an image projection process (step S110). In this image projection processing, the image attribute information management table and the cursor information management table are updated according to the information transmitted from the terminal device 2, and the windows 30 acquired from the plurality of terminal devices 2 based on the information in these tables. The image data and the cursor image are synthesized, and a display image is projected based on the synthesized image data. This process is a process from steps S200 to S210 in FIG. 14, and will be described later.

When the image projection processing in step S110 is completed, the control unit 108 determines whether an image operation command has been received from the terminal device 2 (step S120). In this process, when it is determined that an image operation command has been received from the terminal device 2 (step S120: Yes), the control unit 108 performs an operation command distribution process (step S130). In this operation command distribution process, the image operation command is transmitted to the terminal device 2 that has transmitted the image data of the image to be operated by the image operation command received from the terminal device 2, and the setting state of the window 30 is set to each terminal. This is a notification to the device 2. This process is a process from steps S300 to S309 in FIG. 15, and will be described later.

When the process of step S130 is completed, or when no image operation command is received from the terminal device 2 in step S120 (step S120: No), the control unit 108 determines whether or not the power is turned off ( Step S140) When the power is not turned off (Step S140: No), the process proceeds to Step S100. On the other hand, if it determines with the power supply having been turned off (step S140: Yes), the control part 108 will complete | finish a main process.

Next, the image projection processing in step S110 will be specifically described with reference to FIG. FIG. 14 is an image projection processing flowchart of the projector 1 in the present embodiment.

As shown in FIG. 14, when the image projection process is started, the control unit 108 determines whether image attribute information is received from the terminal device 2 (step S200). In this process, when it is determined that the image attribute information has been received from the terminal device 2 (step S200: Yes), the control unit 108 updates the image attribute information management table based on the received image attribute information (step S201). ). For example, when the received image attribute information is transmitted by newly adding the window 30 to the projected image area 60, the control unit 108 is newly located in the virtual display area 45. The image attribute information of the window 30 is newly added to the image attribute information management table, and a storage area for the image data of the window 30 is secured.

Also, the control unit 108 updates the information on the hierarchical level of each image managed in the image attribute information management table. That is, the control unit 108 sets the hierarchy level of the window 30 newly added to the virtual display area 45 to “1”, and the other windows 30 are one level lower than the currently assigned hierarchy level. It is sequentially updated and updated (for example, an image whose hierarchical level is set to “2” is updated to “3”). At this time, the state of the window 30 whose hierarchical level is set to “1” is set as the active window, and the state of the windows 30 other than the window 30 set as the reference window among the other windows 30 is set. Is set as an inactive window, and information regarding the setting state is stored in the image attribute information.

When the received image attribute information is transmitted by deleting the window 30 from the projection image area 60, the control unit 108 sets the image attribute information of the window 30 to be deleted as the image attribute information. While deleting from the management table, information on the hierarchical level and setting state of other images is updated.

When the process of step S201 is completed, the control unit 108 sends an image data request signal for requesting transmission of image data of the window 30 together with information on the state set in the window 30 which is the content designated by the window selection unit. It transmits with respect to the terminal device 2 (step S202).

Next, when receiving the image data from the terminal device 2, the control unit 108 decompresses the received image data (step S203). This is because the image data transmitted from the terminal device 2 is transmitted in a compressed state, as will be described later.

Next, the control unit 108 stores the received image data in the image data storage area secured in the image attribute information update process (step S204), and pastes the image data in the designated display area (step S205). . Next, the control unit 108 determines whether or not all of the image data of the image in the virtual display area 45 of each terminal device 2 has been pasted (step S206). If it is determined in this process that all of the image data has been pasted (step S206: Yes), the control unit 108 proceeds to step S210, and when the image data has not been pasted (step S206). S206: No), the process proceeds to step S202. That is, the processing from step S202 to S205 is performed for each image data, and in step S205, the image data is pasted to the display area, whereby the virtual display area 45 of each terminal device 2 is displayed. The image data of a certain image is synthesized.

On the other hand, when image attribute information is not received in step S200 (step S200: No), the control unit 108 determines whether or not cursor information is received from the terminal device 2 (step S207). In this determination, if it is determined that the cursor information is received from the terminal device 2 (step S207: Yes), the control unit 108 updates the information in the cursor information management table based on the received cursor information (step S208). Then, based on the information stored in the cursor information management table, the control unit 108 combines the image data of the cursor 5 with the image data of the image projected on the projection image area 60 of the projector 1 (step S209), and processing Goes to step S210.

In step S210, the control unit 108 projects a display image based on the combined image data from the image projection unit 107. When this process ends, the control unit 108 ends the image projection process.

Next, the operation command distribution process in step S130 will be specifically described with reference to FIG. FIG. 15 is a flowchart of the operation command distribution process of the projector 1 in this embodiment.

As shown in FIG. 15, when the operation command distribution process is started, the control unit 108 determines whether or not the operation based on the received image operation command is an operation for designating the window 30 as a reference window ( Step S300). This determination is based on whether or not an image operation command based on an operation of clicking the mouse 207 while pressing the Ctrl key of the keyboard 206 on the window image 30 ′ in the projection image area 60 is received as a specific operation command. It is to be judged. In this process, when it is determined that the operation based on the received image operation command is an operation for designating the window 30 as a reference window, the control unit 108 sets the window 30 that is the target of the operation as a reference window. (Step S301).

On the other hand, when the operation based on the received image operation command is not an operation for designating the window 30 as a reference window in step S300 (step S300: No), the control unit 108 performs an operation based on the received image operation command. Then, it is determined whether or not the operation is for canceling the selection of the reference window (step S302). This determination is performed as an image operation command based on an operation of clicking the mouse 207 while pressing the Ctrl key of the keyboard 206 on the window image 30 ′ set as a reference window in the projection image area 60 as a specific operation command. Is determined based on whether or not a message is received. In this process, when it is determined that the operation based on the received image operation command is an operation for canceling the selection of the reference window, the control unit 108 sets the window 30 that is the target of the operation as an inactive window. (Step S303).

On the other hand, when the operation based on the received image operation command is not an operation for canceling the selection of the reference window in step S302 (step S302: No), the control unit 108 refers to the cursor information management table, and The position information of the cursor of the terminal device 2 that has transmitted the operation command is acquired (step S304). Then, the control unit 108 specifies the terminal device 2 (owner PC) that has transmitted the image data by specifying the image data including the acquired cursor position coordinates with reference to the image attribute information management table (step S110). S305).

Next, the control unit 108 refers to the image attribute information to determine whether or not the window 30 that is the target of the operation according to the received image operation command is set as an inactive window (step S306). In this process, if it is determined that the window 30 that is the target of the operation according to the received image operation command is set as an inactive window (step S306: Yes), the control unit 108 makes the window 30 an active window. In addition to setting (step S307), windows 30 other than the window 30 set as the window 30 and the reference window are set as inactive windows (step S308), and the setting contents are stored in the image attribute information management table. .

When the process of step S308 is completed, or when the window 30 to be operated by the received image operation command is not set as an inactive window in step S304 (step S306: No), the control unit 108. Notifies the owner PC identified in step S304 of the image operation command and the setting content of the window 30 that is the target of the operation, and the change to the owner PC of the window 30 in which other setting content has been changed. The subsequent setting contents are notified (step S309).

When the processes of steps S301, S303, and S309 are completed, the control unit 108 ends the operation command distribution process.

(Specific operation of terminal device)
Next, an example of a specific operation of the terminal device 2 will be described with reference to FIGS. FIG. 16 is a main process flowchart of the terminal device 2 in the present embodiment. The following processes are executed by the control unit 208 of the terminal device 2 functioning as the above-described units.

As shown in FIG. 16, when a power switch (not shown) of the terminal device 2 is pressed, the control unit 208 of the terminal device 2 performs a connection process (step S500). This connection process is a process for connecting to the projector 1 via the communication path 4. Specifically, first, control unit 208 transmits a connection request signal including information on the IP address of the own terminal device to projector 1. When the resolution information is received from the projector 1, the projector 1 is notified that the start-up preparation has been completed. When the connection completion notification is received from the projector 1, the connection process is terminated.

When the connection process in step S500 ends, the control unit 208 determines whether an operation input has been performed on the image projected on the projector 1 by the keyboard 206 or the mouse 207 (step S501). If it is determined in this process that an operation input has been made (step S501: Yes), the process proceeds to step S502.

In step S502, the control unit 208 determines whether the image attribute information has been updated. This determination is based on whether or not an operation for moving the window 30 in the display area of the LCD 200 to the virtual display area 45 is performed by an operation with the user's mouse 207 or the like (whether the window 30 is newly added to the virtual display area 45 No), whether the window 30 in the virtual display area 45 has been moved or deleted, or whether the position or size of the window 30 in the virtual display area 45 has been changed.

In this determination, if it is determined that the image attribute information has been updated (step S502: Yes), the control unit 208 generates image attribute information based on the updated information, and the image attribute information is transmitted via the communication path 4. It transmits to the projector 1 (step S503). That is, when a new window 30 is added to the virtual display area 45, among the image attribute information of the added window 30, the window ID of the window 30, position information, size information, and information on the file name of the image data And image attribute information notification data including additional flag data of the image attribute information is generated and transmitted to the projector 1. When the window 30 in the virtual display area 45 is moved or deleted from the virtual display area 45, the window ID of the moved or deleted window 30 and the deletion flag data of the image attribute information are displayed. The image attribute information notification data including it is created and transmitted to the projector 1. When the position or size of the window 30 in the virtual display area 45 is changed, image attribute information notification data including the image attribute information of the changed window 30 is created and transmitted to the projector 1.

In step S502, when the image attribute information has not been updated (step S502: No), the control unit 208 determines whether or not an operation for moving the cursor 5 has been performed (step S504). If it is determined in this process that the movement operation of the cursor 5 has been performed (step S504: Yes), the control unit 208 transmits cursor information to the projector 1 based on the movement operation of the cursor 5 (step S505).

When the processing of steps S503 and S505 is completed, or when the movement operation of the cursor 5 is not performed in step S504 (step S504: No), the control unit 208 operates the operation input information based on the operation input and the cursor 5. Is obtained, and an image operation command is created based on the information (step S506). Then, the control unit 208 transmits the created image operation command to the projector 1 via the communication path 4 (step S507).

When the process of step S507 is completed, or when no operation input is performed in step S501 (step S501: No), the control unit 208 performs an image data transmission process (step S508). In this image data transmission process, the image data of the window 30 is transmitted according to the setting contents of the window 30 and the type of application that executes the window 30. This image data transmission process is a process from steps S600 to S602 in FIG. 17, and will be described later.

When the process of step S508 is completed, the control unit 208 determines whether an image operation command has been received from the projector 1 (step S509). In this process, when it is determined that an image operation command has been received from the projector 1 (step S509: Yes), the control unit 208 reproduces the received image operation command, thereby causing an application corresponding to the data file to be operated. The program is caused to execute an editing operation based on the image operation command (step S510).

When the process of step S510 is completed, or when an image operation command is not received from the projector 1 in step S509 (step S509: No), the control unit 208 determines whether or not the connection state with the projector 1 has been released. Is determined (step S511). If it is determined in this process that the connection state with the projector 1 has not been released (step S511: No), the control unit 208 moves the process to step S501. On the other hand, if it determines with the connection state with the projector 1 having been cancelled | released (step S511: Yes), the control part 208 will complete | finish a main process.

Next, the image data transmission process in step S508 will be specifically described with reference to FIG. FIG. 17 is a flowchart of image data transmission processing in the present embodiment.

As shown in FIG. 17, when the image data transmission process is started, the control unit 208 determines whether an image data transmission request is received from the projector 1 (step S600). If it is determined in this process that an image data transmission request has been received from the projector 1, the control unit 208 performs an active window / reference window transmission process (step S601). In this process, the image data of the window 30 set as an active window or a reference window is transmitted to the projector 1. This process is a process from steps S700 to S706 in FIG. 18, which will be described later.

Next, the control unit 208 performs an inactive window transmission process (step S602). This inactive window transmission process transmits image data of the window 30 set as an inactive window to the projector 1. This process is a process from steps S800 to S807 in FIG. 19, and will be described later.

When the process of step S602 is completed, or when the image data request signal is not received from the projector 1 in step S600 (step S600: No), the control unit 208 ends the image data transmission process.

Next, the active window and reference window transmission processing in step S601 will be specifically described with reference to FIG. FIG. 18 is a flowchart of active window and reference window transmission processing in the present embodiment.

As shown in FIG. 18, when the active window / reference window transmission process is started, the control unit 208 notifies the received image data request signal that the setting content of the target window 30 is the active window or the reference window. Is determined (step S700). If it is determined in this process that the setting content of the target window 30 includes a notification that the setting content is an active window or a reference window (step S700: Yes), the control unit 208 determines that the target of the image data transmission request is The current window 30 is captured (step S701).

Next, the control unit 208 determines whether or not the resolution set for its terminal device 2 is larger than the resolution set for the projector 1 (step S702). In this process, if it is determined that the resolution set in the terminal device 2 is larger than the resolution set in the projector 1 (step S702: Yes), the control unit 208 uses the magnification corresponding to the difference in the application window 30. The image size of the image data is reduced (step S703). With this configuration, it is possible to reduce the amount of image data of the window 30 transmitted to the projector 1 and to prevent a situation in which the window image 30 ′ cannot fit in the projected image area 60. .

When the process of step S703 is completed, or when the resolution set in the terminal device 2 is smaller than the resolution set in the projector 1 in step S702 (702: No), the control unit 208 captures. The image data obtained in this way is compressed by converting BMP data into JPEG data (step S704). Then, the control unit 208 transmits the compressed image data to the projector 1 via the communication path 4 (step S705).

When the process of step S705 is completed or when the received image data request signal does not include a notification that the setting content of the target window 30 is an active window or a reference window in step S700 (step S700) S700: No), the control unit 208 determines whether or not the processing has been performed on all the windows 30 set as the active window or the reference window (step S706). In this processing, when processing has not been performed for all of these windows 30 (step S706: No), the control unit 208 proceeds to step S701 and performs processing for all of the windows 30. If it is determined that the control window 208 has been determined (step S706: Yes), the control unit 208 ends the active window and reference window transmission processing.

Next, the inactive window transmission process in step S602 will be specifically described with reference to FIG. FIG. 19 is a flowchart of inactive window transmission processing in the present embodiment.

As shown in FIG. 19, when the inactive window transmission process is started, the control unit 208 determines whether or not the window 30 that is the target of the image data transmission request is a moving image window (step S800). In this process, when it is determined that the window 30 that is the target of the image data transmission request is a moving image window (step S800: Yes), the control unit 208 converts a still image from a moving image data of the moving image window to a predetermined frame. Capture at intervals (step S801).

On the other hand, when the window 30 that is the target of the image data transmission request is not a moving image window in step S800 (step S800: No), the control unit 208 determines whether or not there is a change from the previously transmitted image data. (Step S802). In this process, when it is determined that there is a change from the previously transmitted image data (step S802: Yes), the control unit 208 extracts the difference and stores the image data (step S803).

When the processing in step S801 or step S803 is completed, the control unit 208 reduces the image data captured or stored in step S801 or step S803 (step S804). Here, when the resolution set in the terminal device 2 is larger than the resolution set in the projector 1, the control unit 208 reduces the image size of the image data of the application window 30 with a magnification corresponding to the difference.

Then, the control unit 208 executes the window 30 that is the target of the image data transmission request by image creation software or moving image creation software among various application programs stored in the terminal device 2. In some cases, the image size of the image data is reduced to 1/16 of the original window 30 image size, and if the image data is to be executed by document creation software or web browser software, go to the projector 1. When the image size of the image data to be transmitted is reduced to 1/9 of the image size of the original window 30 and executed by spreadsheet software, the image size of the image data to be transmitted to the projector 1 is changed to the original size. The image is reduced to ¼ of the image size of the window 30. When the image size of the image data in the window 30 is reduced in accordance with the resolution of the projector 1, the control unit 208 uses the reduced image data for the window 30 instead of the original window 30 image data. Scale down as a reference.

Next, the control unit 208 compresses the reduced image data by converting the BMP data into JPEG data (step S805), and transmits the compressed image data to the projector 1 via the communication path 4. (Step S806).

When the process of step S806 is completed, or when there is no change from the previously transmitted image data in step S802 (step S802: No), the control unit 208 applies to all the windows 30 set as inactive windows. Then, it is determined whether or not processing has been performed. In this processing, when processing is not performed for all of these windows 30 (step S807: No), the control unit 208 proceeds to step S800 and performs processing for all of the windows 30. If it is determined that it has been determined (step S807: Yes), the control unit 208 ends the inactive window transmission process.

Thus, in the image display system S according to the present embodiment, the amount of image data of the window 30 set as an inactive window is reduced, so that the image data is transmitted from the terminal device 2 to the projector 1. The load on the communication path 4 can be reduced, and even when the number of image data to be transmitted to the projector 1 as a display device increases, it is possible to smoothly collaborate with a plurality of people. It becomes. Moreover, since the user of the terminal device 2 can change the window 30 that does not reduce the data amount according to the situation, smooth progress such as collaborative work by a plurality of persons is not hindered.

In the image display system S according to the present embodiment, since the image size of the image data of the window 30 set as the inactive window is reduced, the data of the image data of the window 30 set as the inactive window is set. The amount can be reduced. Further, by reducing the image size of the window 30 set as the inactive window, the projection image area 60 of the projector 1 can be used more effectively as the work area of the window 30 set as the active window.

Further, in the image display system S according to the present embodiment, the reduction mode of the data amount of the image data is changed according to the type of the application that executes the data file. Therefore, the window 30 set as the inactive window is changed. The optimal amount of data can be reduced for each application that executes data files, and collaborative work by a plurality of people can be performed more smoothly.

By the way, the image display system S according to the present embodiment can change various settings. For example, in the above, the image data transmitted to the projector 1 by reducing the image size of the window 30 set as an inactive window at a reduction rate according to the type of application program that executes the data file of the window 30. However, instead of this, the data amount of the image data of the application window other than the application window specified by the window selection unit is changed to the value of the application window specified by the window selection unit. It is also possible to reduce the data amount to be smaller than the image data amount.

In such a case, when the control unit 108 of the projector 1 transmits an image data request signal to the terminal device 2 that is the transmission source of the window 30 set as an inactive window in step S202 of FIG. Among the data amounts of the windows 30 set as the active window and the reference window among the data amounts of the windows 30 stored in the image attribute information management table, together with the notification that is set as an inactive window A small data amount value is transmitted to the terminal device 2.

Then, the control unit 208 of the terminal device 2 refers to the value of the data amount received from the projector 1 when reducing the image size of the image data of the window 30 set as the inactive window in step S802 of FIG. Thus, the image size of the image data in the window 30 is reduced to be 40% of the value of the received data amount.

Then, the control unit 208 of the terminal device 2 compresses the reduced image data, and transmits the compressed image data to the projector 1 via the communication path 4.

As described above, the reduction amount of the data amount of the image data of the window 30 set as the inactive window can be changed according to the data amount of the image data of the window 30 set as the active window or the reference window. Therefore, when image data is transmitted from the terminal device 2 to the projector 1, the load on the communication path 4 can be reduced, and the number of image data transmitted to the projector 1 as a display device increases. Even if it exists, it becomes possible to perform joint work etc. smoothly by several persons.

As mentioned above, some of the embodiments of the present invention have been described in detail with reference to the drawings. However, these are merely examples, and the present invention is variously modified and improved based on the knowledge of those skilled in the art. It is possible to carry out the invention.

Claims

One or more terminal devices and a display device are provided, and image data of an application window generated by application activation in the terminal device is acquired via a communication path, and a plurality of applications are displayed on a display screen based on the image data. In the image display system for displaying a window on the display device,
Window selection means for selecting one or more application windows from a plurality of application windows displayed on the display device;
Reduces the data amount of application window image data other than the application window selected by the window selection means from the application window image data transmitted from the terminal device to the display device via the communication path. An image display system comprising: a transmission data amount reduction means for performing transmission.
One or more terminal devices and a display device are provided, and image data of an application window generated by application activation in the terminal device is acquired via a communication path, and a plurality of applications are displayed on a display screen based on the image data. In the image display system for displaying a window on the display device,
The display device
Reception processing means for receiving information including the image data transmitted from the terminal device via the communication path;
Image display means for displaying an application window on a display screen based on image data acquired from the terminal device by the reception processing means;
Window selection means for selecting one or more application windows from the image data of the application window acquired from the terminal device according to the operation information acquired from the terminal device by the reception processing means;
Notification means for notifying the terminal device of the content specified by the window selection means via the communication path;
The terminal device
Storage means for storing data files;
Image generating means for generating application window image data based on the data file by executing an application;
Operating means for operating the image displayed on the display device;
Transmission processing means for transmitting operation information by the operation means and image data of the application window generated by the image generation means to the display device via the communication path;
The application window selected by the window selection means among the image data of the application window to be transmitted to the display device via the communication path according to the designated content notified by the notification means of the display device An image display system comprising: a transmission data amount reduction means for reducing the data amount of image data of an application window other than the above.
The transmission data amount reducing means is
The data amount of the image data of the application window other than the application window designated by the window selection unit is set to be smaller than the data amount of the image data of the application window designated by the window selection unit. The image display system according to claim 1, wherein the image display system is reduced.
The transmission data amount reducing means is
By reducing the image size of the image data of the application window other than the application window specified by the window selection means among the image data of the application window transmitted to the display device via the communication path, The image display system according to any one of claims 1 to 3, wherein a data amount of image data of an application window other than the application window designated by the window selection unit is reduced.
The transmission data amount reducing means is
When the resolution set in the terminal device is larger than the resolution set in the display device, after changing the image size of the image data of the application window at a magnification according to the difference, the communication path is further changed The amount of data of application window image data other than the application window selected by the window selection means is reduced from the image data of the application window transmitted from the terminal device to the display device. The image display system according to any one of claims 1 to 4.
When the data file is a moving image file, the transmission data amount reducing unit is based on the moving image file when an application window for displaying a moving image based on the moving image file is not selected by the window selecting unit. Extract still images from moving image data at predetermined frame intervals,
6. The transmission processing unit according to claim 2, wherein the transmission processing unit transmits the image data of the still image extracted by the transmission data amount reduction unit to the display device via the communication path. Image display system.
The transmission data amount reducing means is
The image display system according to any one of claims 2 to 6, wherein a reduction mode of the data amount of the image data is made different according to a type of application that executes the data file.
One or more terminal devices and a display device are provided, and image data of a plurality of application windows generated by activation of an application in the terminal device is acquired via a communication path, and a plurality of images are displayed on a display screen based on the image data. An information processing method in an image display system for displaying the application window of the display on the display device,
Selecting one or more application windows from a plurality of application windows displayed on the display device;
Reducing the amount of image data of application windows other than the selected application window, among image data of application windows transmitted from the terminal device to the display device via the communication path; An information processing method characterized by comprising:
In a display device that acquires image data of a plurality of application windows generated by starting an application in a terminal device via a communication path, and displays a plurality of application windows on a display screen based on the image data.
Reception processing means for receiving information including the image data transmitted from the terminal device via the communication path;
Image display means for displaying an application window on a display screen based on image data acquired from the terminal device by the reception processing means;
Window selection means for selecting one or more application windows from the image data of the application window acquired from the terminal device according to the operation information acquired from the terminal device by the reception processing means;
A display device comprising: notification means for notifying the terminal device of contents designated by the window selection means via the communication path.