JP2002057964A - Projector and projection display system, and method for it and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology by which a user makes a projection type display device easily execute processing with respect to contents of an image to be projected and displayed. SOLUTION: The projection type display device is connected to an external input device having an input section via a network. The projection type display device is provided with a network interface section for connection to the network, an image data generating section that executes prescribed processing with respect to contents of a projected and displayed image on the basis of control information that is fed to the network interface section via the network and generated by operating the input section of the external input device and generates image data to represent the image, to be projected and displayed an optoelectronic device that generates image light in response to the image data, and a projection optical system that projects the image light obtained by the optoelectronic device.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a projector for projecting and displaying an image, and more particularly, to a projector connectable to a network, that is, a projection display device.

[0002]

2. Description of the Related Art In recent years, projectors are often used in presentations. FIG. 24 is an explanatory diagram showing a conventional projector. Projector PJZ
Displays an image on the screen SC based on the analog image signal AV1 supplied from the image supply device 900.

[0003] By operating the remote controller RM, a user can cause the projector PJZ to execute various processes. For example, by operating the remote controller RM, a decorative image such as the pointer image PPJ can be superimposed on the original image ORG projected and displayed on the screen SC. Thus, if the decoration image can be superimposed on the original image ORG, the presentation can be performed more effectively.

[0004]

However, there is a problem that it is difficult to cause the projector PJZ to execute the processing relating to the content of the image to be projected and displayed by using the remote controller RM. This is because the operability of the remote controller RM is not so high. Further, when the remote controller RM is used, it is necessary to hand over the remote controller RM when a plurality of persons sequentially give a presentation using one projector, so that it is difficult to smoothly switch presentations. Met.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problem in the prior art, and provides a technique that allows a user to easily execute a process relating to the content of an image to be projected and displayed on a projector. The purpose is to provide.

[0006]

In order to solve at least a part of the above problems, a first device of the present invention is connected to an external input device having an input unit via a network. A projector, comprising: a network interface unit for connecting to the network; and operation information supplied to the network interface unit via the network, the operation information being generated by operating the input unit of the external input device. An image data generating unit for executing a predetermined process relating to the content of the image to be projected and displayed based on the operation information, and generating image data representing the image to be projected and displayed; An electro-optical device that forms image light; and a projection optical system that projects image light obtained by the electro-optical device. And wherein the door.

In this projector, based on operation information supplied via a network interface unit,
Since the image data can be generated by executing the processing related to the content of the image to be projected and displayed, the user operates the input unit provided in the external input device to project and display the image on the projector. It is possible to easily execute the processing related to the content of the image.

Further, if a plurality of external input devices are connected to the network, the presentation can be smoothly switched when a plurality of persons sequentially present using one projector.

In the above projector, the image to be projected and displayed is formed of an original image and a decoration image superimposed on the original image, and the decoration image data representing the decoration image is supplied from the external input device. Not prepared by the image data generator, the image data generator,
Based on the operation information supplied from the external input device, by generating the image data by combining the original image data representing the original image and the decoration image data,
It is preferable that the decoration image is superimposed on a predetermined position in the original image.

[0010] This allows the user to easily superimpose the decoration image on the original image projected and displayed by operating the input unit provided in the external input device.

In the above projector, the operation information includes at least position information generated by operating a pointing device as the input unit of the external input device, and the image data generation unit includes It is preferable that a pointer image as the decoration image is superimposed on a predetermined position in the original image based on the information.

With this configuration, the user can easily move the pointer image superimposed on the original image projected and displayed by moving the pointing device provided in the external input device.

[0013] In the projector, the position information is preferably coordinate value information specified by the pointing device.

This makes it possible to easily associate the position designated by the pointing device with the position of the pointer image superimposed on the projected and displayed original image.

Further, in the above projector, the operation information further includes switch information generated by operating a switch provided on the pointing device, and the image data generation section includes the operation information. It is preferable that a decorative image of a type different from that of the pointer image is superimposed in a designated range in the original image based on the position information and the switch information included in the original image.

As described above, if the operation information includes the position information and the switch information, a range can be designated in the original image. Therefore, in the designated range, a decoration image of a type different from the pointer image can be displayed. It becomes possible to superimpose.

In the above projector, the operation information further includes key information generated by operating a keyboard as the input unit of the external input device, and the image data generation unit includes the key data. It is preferable that a code image as the decoration image is superimposed on the original image based on the information.

With this arrangement, the user can easily superimpose a code image such as a character on the projected and displayed original image by operating the keyboard provided on the external input device.

Alternatively, in the above projector,
The image to be projected and displayed is formed of an original image and a decoration image superimposed on the original image, and the operation information includes a series of drawing conditions necessary for drawing the decoration image in the original image. Information, wherein the image data generating unit includes:
On the basis of the drawing condition information supplied from the external input device, decorative image data representing the decorative image is prepared, and the original image data representing the original image and the decorative image data are combined to form the image data. , The decorative image may be superimposed on a predetermined position in the original image.

As described above, even when the operation information includes a series of drawing information necessary for drawing the decoration image in the original image, the user operates the input unit provided in the external input device. Thus, the decorative image can be easily superimposed on the original image projected and displayed.

[0021] In the above projector, the image data generation unit may be configured to execute the synthesis using the decorative image data supplied from the external input device.

With this configuration, a decorative image that cannot be generated by the image data generating unit of the projector can be superimposed on the original image.

In the above projector, the drawing condition information includes information for using a drawing condition for the decoration image already superimposed in the original image, and the image data generation unit includes Based on the condition information, using the decoration image data already prepared,
Preferably, the synthesis is performed.

In this way, for example, when changing the drawing position of the decoration image already superimposed on the original image, the image data generation unit does not need to newly prepare the decoration image data. Further, when the decorative image data is supplied from an external input device, there is an advantage that the data transmission amount between the projector and the external input device can be considerably reduced.

According to a second aspect of the present invention, there is provided a projection display system including an external input device connected via a network and a projector, wherein the external input device includes an input unit, and a user inputting the input unit. An operation information generation unit that detects an operation and generates operation information based on the detection result; and a first network interface unit that connects to the network and supplies the operation information to the projector via the network. The projector comprises: a second network interface unit for connecting to the network; and an image projected and displayed based on operation information supplied to the second network interface unit via the network. Performs predetermined processing on the contents of the image and generates image data representing the image to be projected and displayed An image data generation unit of the order, and electro-optical device for forming image light in response to the image data,
A projection optical system for projecting image light obtained by the electro-optical device.

Since the projection display system includes the projector, which is the first device of the present invention, it has the same operation and effect as when the first device is used, and the user is provided with the external input device. By operating the input unit, it is possible to easily cause the projector to execute processing relating to the content of the image to be projected and displayed.

In the above-mentioned projection display system,
The external input device further includes a display unit, and the operation information generation unit causes the display unit to display an operation information generation area that is an area for generating the operation information accompanying the operation of the pointing device. The operation of the pointing device may be detected only when a pointer image corresponding to the pointing device is displayed in the operation information generation area.

With this configuration, the operation information is generated only when the pointer image is displayed in the operation information generation area. Therefore, the user can display the pointer image in an area other than the operation information generation area to perform pointing. Other operations can be performed using the device.

In the above-mentioned projection display system,
It is preferable that the operation information generation area is associated with an image area to be projected and displayed.

This makes it possible to make the positional relationship of the pointer image in the operation information generating area substantially equal to the positional relationship of the pointer image in the projected and displayed image area.

According to the method of the present invention, in an external input device having an input unit, an operation for generating operation information accompanying an operation of the input unit supplied to a projector connected to the external input device via a network is provided. An information generation method, comprising: (a) detecting an operation of the input unit by a user; and (b) generating the operation information based on a detection result.

With this configuration, the user can generate operation information by operating the input unit provided in the external input device. Also, if this operation information is supplied to the projector, it is possible to easily cause the projector to execute a predetermined process relating to the content of the image to be projected and displayed.

In the above method, the step (a) comprises:
(A-1) displaying, on a display unit provided in the external input device, an operation information generation area that is an area for generating the operation information associated with an operation of a pointing device as the input unit; a-2) detecting an operation of the pointing device only when a pointer image corresponding to the pointing device is displayed in the operation information generation area.

With this configuration, the operation information is generated only when the pointer image is displayed in the operation information generation area. Therefore, the user can display the pointer image in an area other than the operation information generation area to perform the pointing operation. Other operations can be performed using the device.

A computer program according to the present invention generates, in a computer as an external input device having an input unit, operation information associated with an operation of the input unit supplied to a projector connected to the external input device via a network. A computer program for causing the computer to realize a function of detecting an operation of the input unit by a user and a function of generating the operation information based on a detection result.

When the computer program is executed by the external input device, the user can generate operation information by operating the input unit provided in the external input device, as in the method of the present invention. Also, if this operation information is supplied to the projector, it is possible to easily cause the projector to execute a predetermined process relating to the content of the image to be projected and displayed.

A computer-readable recording medium according to the present invention is characterized by recording the above-mentioned computer program.

When the computer program recorded on the recording medium is executed by the external input device, the same operation and effect as those of the method of the present invention can be obtained.

The present invention provides a computer program for realizing the functions of a projector and a projection display system, a recording medium storing the computer program,
The present invention can be realized in various modes such as a data signal embodied in a carrier wave including the computer program.

[0040]

DETAILED DESCRIPTION OF THE INVENTION First Embodiment: Next, an embodiment of the present invention will be described based on an embodiment. FIG. 1 is an explanatory diagram showing a projection display system as a first embodiment of the present invention. This projection display system includes a projector PJ1
(Ie, projection display device PJ1) and computer PC
The projector PJ1 and the computer PC1 are connected via a network NW such as a LAN. Note that the computer PC1 in FIG. 1 corresponds to an external input device in the present invention.

As shown in FIG. 1, the computer PC1
Has a mouse MS as a pointing device. As described later, the operation information OPS accompanying the operation of the mouse MS is transmitted to the projector P via the network NW.
It is supplied to J1. The projector PJ1 has the operation information O
Based on the PS, a predetermined process related to the content of the image to be projected and displayed is executed. For example, the projector PJ1
Original image ORG displayed on screen SC based on operation information OPS supplied via network NW
Can display the pointer image PPJ. In the first embodiment, the computer PC1 supplies operation information OPS to the projector PJ1, and supplies image data representing an original image ORG, a pointer image PPJ, and the like forming an image to be projected and displayed. Not.

FIG. 2 is an explanatory diagram showing a schematic configuration of the projector PJ1 of FIG. Projector PJ1 is a CP
U100, an external storage device 102, an internal storage device 104 such as a ROM or a RAM, and an analog image signal input unit 1.
08, an image processing unit 110, a liquid crystal light valve driving unit 120, a liquid crystal light valve 130, a decoration image processing unit 140, a menu image processing unit 150, a remote control signal processing unit 160, and a memory card MC. A reading device 170 for reading image data and the like, and a network interface unit 180 are provided. CPU10
0, the external storage device 102, the internal storage device 104,
An image processing unit 110, a decoration image processing unit 140, a menu image processing unit 150, a remote control signal processing unit 160,
Reading device 170 and network interface unit 18
0 are mutually connected by the bus 100b.
The liquid crystal light valve 130 is almost uniformly illuminated by the illumination optical system 200, and the image light formed in the liquid crystal light valve 130 is projected on the screen SC by the projection optical system 220. In FIG. 2, the illustration of the optical systems 200 and 220 is simplified.

Note that the projector PJ1 of this embodiment is
Input devices such as a keyboard and a mouse can also be connected via an interface (not shown).

The analog image signal input unit 108 receives an analog image signal AV from an external image supply device (not shown).
1 is supplied. As the analog image signal AV1, for example, image signals such as an RGB signal representing a computer image supplied from a personal computer and a composite image signal representing a moving image supplied from a video recorder or a television receiver are supplied. The analog image signal input unit 108 has a function of AD-converting the analog image signal AV1 and outputting digital image data DV1.

The image processing section 110 has a function of synthesizing original image data and decorative image data to generate synthesized image data. Thus, a decoration image such as the pointer image PPJ (FIG. 1) represented by the decoration image data can be superimposed on the original image ORG represented by the original image data (FIG. 1). The original image data is temporarily written to a frame memory (not shown) in the image processing unit 110. When reading the original image data written in the frame memory, the image processing unit 110 combines the original image data and the decoration image data, and supplies the combined image data DDV to the liquid crystal light valve driving unit 120.

The original image data is the image data DV1 supplied from the analog image signal input unit 108.
Image data supplied from the network via the network interface unit 180, menu image data supplied from the menu image processing unit 150, image data read from the memory card MC and supplied from the reading device 170, and the like. . On the other hand, as the decoration image data, decoration image data supplied from the decoration image processing unit 140 is used.

Here, the decorative image means an image (additional image) prepared independently of the original image, and is projected and displayed on the screen SC by being superimposed (added) on the original image. You.

The liquid crystal light valve driving section 120 generates image display data SD according to the composite image data DDV supplied from the image processing section 110. The liquid crystal light valve 130 is driven by the image display data SD. At this time, the liquid crystal light valve 130 is
To form image light representing an image.

The decoration image processing section 140 has a function of generating decoration image data representing a decoration image and supplying the generated decoration image data to the image processing section 110. Specifically, the decoration image processing unit 14
Reference numeral 0 denotes pointer image data representing the pointer image PPJ (FIG. 1), an image of a specific shape (for example, a pointing image) created at a desired size by specifying a range using the pointer image PPJ, or a drawing image ( For example, various kinds of decoration image data such as a box image and a frame image are generated and supplied to the image processing unit 110. The generated decoration image data is stored in the decoration image memory 142 in the decoration image processing unit 140.

The menu image processing unit 150 generates menu image data representing a menu image, and
0 is provided. The user can make various settings related to the projector PJ1 according to the menu image.

The network interface unit 180
Connect the projector PJ1 to the LAN and connect the computer P
The operation information OPS supplied from C1 via the LAN is
It has a function of supplying to the CPU 100 via the bus 100b. The CPU 100 controls the image processing unit 110, the decoration image processing unit 140, the menu image processing unit 150, and the like based on the operation information OPS. For example, the pointer image P superimposed on the operation information OPS in the original image ORG
When the position information indicating the position of the PJ (FIG. 1) is included, the decoration image processing unit 140 converts the pointer image data into the image processing unit 11 based on the operation information (position information) OPS.
Supply 0. As a result, the image processing unit 110 can combine the original image data and the pointer image data based on the operation information (position information) OPS.
The pointer image PPJ is superimposed on a predetermined position in the original image ORG. The network interface unit 180 uses the image data supplied via the LAN as the original image data,
It has the function of supplying to

Remote control signal processing section 160 (FIG. 2) controls projector PJ based on a control signal from remote control RM.
1 controls the function of each unit. For example, the remote control signal processing unit 160, based on a control signal from the remote control RM,
By controlling the function of the decoration image processing unit 140, the pointer image PPJ can be superimposed on a predetermined position in the original image ORG. However, in the projection display system of this embodiment, the pointer image PPJ is moved to a predetermined position in the original image ORG by operating the mouse MS (FIG. 1) of the computer PC1 connected to the LAN instead of the remote controller RM. It is possible to superimpose.

The CPU 100 and the image processing unit 1 shown in FIG.
10 and the decoration image processing unit 140 correspond to an image data generation unit in the present invention.

FIG. 3 is an explanatory diagram showing a schematic configuration of the computer PC1 of FIG. Computer PC1 is a CP
U300, an external storage device 310, a ROM 320,
A RAM 330, a display unit 350, and an input unit 360 such as a mouse MS and a keyboard KB are provided. Further, the computer PC1 includes a network interface unit 380 for connecting to a LAN.

The operation information generating unit 33 is provided in the RAM 330.
A program for realizing the second function is stored. The operation information generation unit 332 has a function of detecting an operation of the input unit 360 by the user and generating operation information OPS based on the detection result. The generated operation information OPS
Is supplied to the projector PJ1 via the network interface unit 380.

A computer program for realizing the function of the operation information generating section 332 is provided in a form recorded on a computer-readable recording medium such as a flexible disk or a CD-ROM. The computer reads the computer program from the recording medium and transfers it to an internal storage device or an external storage device. Alternatively, a computer program may be supplied to a computer via a communication path. When implementing the functions of the computer program, the computer program stored in the internal storage device is executed by the microprocessor of the computer. Further, a computer may read a computer program recorded on a recording medium and directly execute the computer program.

In this specification, a computer is
The concept includes a hardware device and an operation system, and means a hardware device that operates under the control of the operation system. In the case where an operation system is unnecessary and a hardware device is operated by an application program alone, the hardware device itself corresponds to a computer. The hardware device includes at least a microprocessor such as a CPU and means for reading a computer program recorded on a recording medium. The computer program includes a program code that causes such a computer to realize the functions of the above-described units. Some of the functions described above may be realized by an operation system instead of the application program.

The "recording medium" in the present invention includes a flexible disk, a CD-ROM, a magneto-optical disk, an IC card, a ROM cartridge, a punch card, a printed matter on which a code such as a bar code is printed, and an internal storage of a computer. Device (RAM, ROM, etc.)
And various computer-readable media such as an external storage device.

FIG. 4 is an explanatory diagram showing an example of a use form of the projection display system of FIG. In the projection display system of FIG. 4, one projector PJ1 and a plurality of computers PC1, PC2,... Are connected via a LAN. With this projection display system, for example, when the mouse MS is moved in the first computer PC1, the operation information OP generated with the movement of the mouse MS
S is supplied to the projector PJ1 via the LAN.
Then, the projector PJ1 can move the pointer image PPJ superimposed on the original image ORG displayed on the screen SC in conjunction with the mouse MS. The same applies to the other computers PC2, PC3,. When such a projection display system is used, it is not necessary to hand over the remote control RM when a plurality of persons make a presentation sequentially using one projector PJ1, so that the presentation can be smoothly switched. it can.

FIG. 5 is a flowchart showing a processing procedure between projector PJ1 and computer PC1. In step T101, the projector PJ1 displays the original image ORG on the screen SC.

The computer PC1 determines in step S101
, An operation information generation program for generating operation information OPS accompanying the operation of the input unit 360 is started. At this time, the operation information generation program stored in the external storage device 310 of FIG. 3 is expanded in the RAM 330 and functions as the operation information generation unit 332. When the operation information generation program starts, an operation detection window DW is displayed on the display unit 350 of the computer PC1.

FIG. 6 shows the display unit 35 of the computer PC1.
FIG. 9 is an explanatory diagram showing an operation detection window DW displayed at 0. The display unit 350 shown in FIG. 6 includes an operation detection window DW and a memo display window MW for displaying a memo describing contents to be presented in the presentation.
And are displayed.

The operation detection window DW includes a “PJ selection” button B1, a “resolution selection” button B2, a “menu” button B3, a “start” button BS, an “end” button BE, and an operation information generation button. Area GA. Here, the operation information generation area GA means an area for generating operation information OPS accompanying the operation of the mouse MS. In FIG. 6, the pointer image PPC corresponding to the mouse MS is displayed in the entire area of the display unit 350, but the pointer image PPC is displayed in the operation information generation area GA.
The operation information OPS accompanying the operation of the mouse MS is generated only when the information is displayed in the box. In this way, when the user operates the mouse MS by displaying the pointer image PPC in an area other than the operation information generation area GA, the operation information OPS of the mouse MS is not generated.
Using the mouse MS, other operations such as changing a memo displayed in the memo display window MW can be performed.

In step S102 of FIG. 5, the setting for projector PJ1 is performed. Specifically, the user selects a projector to be used, and sets a resolution suitable for the selected projector.

The selection of the projector used by the user is executed by selecting the "PJ selection" button B1 provided in the operation detection window DW. "Select PJ" button B1
Is clicked with the mouse MS, a selection field (not shown) for selecting a projector is displayed. L
When a plurality of projectors are connected to the AN, information on the plurality of projectors is displayed in the selection field. The user selects the projector “PJ1” used by the user from one or more projectors displayed in the selection field.

The setting of the resolution suitable for the projector PJ1 is executed by selecting the "resolution selection" button B2 provided in the operation detection window DW. "Select resolution"
When button B2 is clicked with mouse MS, a selection field (not shown) for selecting a resolution is displayed. For example, the resolution of the effective display area of the liquid crystal light valve 130 (FIG. 2) provided in the projector PJ1 is XG
In the case of A (1024 × 768), “XGA” is selected as the resolution of the projector PJ1. As described above, by setting the resolution of the projector PJ1, it is possible to associate the operation information generation area GA with the image area of the original image ORG projected and displayed on the screen SC. That is, the positional relationship of the pointer image PPC in the operation information generation area GA and the positional relationship of the pointer image PPJ in the original image ORG can be substantially matched.

When the setting for projector PJ1 is completed in step S102, step S103
, The computer PC1 outputs start information indicating the start of transmission of the operation information OPS. This is executed by the user selecting a “start” button BS provided in the operation detection window DW. When the user selects the “start” button BS, start information is output from the network interface unit 380 and supplied to the network interface unit 180 of the projector PJ1 via the LAN.

Upon receiving the start information, in step T102, projector PJ1 makes preparations for superimposing and displaying pointer image PPJ in original image ORG. Specifically, CPU 100 causes decoration image processing section 140 to prepare pointer image data based on the start information supplied to network interface section 180.

In FIG. 4, the projector PJ1
Is supplied with the start information from the first computer PC1, the projector PJ1 performs processing based on only the operation information OPS from the first computer PC1 until end information (step S108) described later is supplied. And ignores information from other computers PC2, PC3,. Thus, the projector PJ1 is monopolized by the first computer PC1.

In step S104, the user operates the input unit 3
The mouse MS as 60 is operated. Here, mouse M
The operation of S means an operation of the user moving the mouse MS itself, an operation of pressing a switch provided on the mouse MS, and the like.

In step S105, the operation of the mouse MS as the input unit 360 is detected. And step S
At 106, operation information OPS is generated based on the detection result at step S105.

As described above, the operation information generation unit 332 of the present embodiment performs the operation of the mouse MS only when the pointer image PPC corresponding to the mouse MS is displayed in the operation information generation area GA of the operation detection window DW. Detect operation.
Then, the position where the pointer image PPC is displayed in the operation information generation area GA is set to the set projector P.
The coordinate value is obtained according to the resolution of J1 (step S102). In this embodiment, the resolution of the projector PJ1 is
Since XGA (1024 × 768) is set, when the pointer image PPC is displayed at the upper left end of the operation information generation area GA, the coordinate value is (1, 1), and when it is displayed at the center. The coordinate value is (512, 384), and when displayed at the lower right corner, the coordinate value is (102).
4,768). This coordinate value information becomes the position information of the mouse MS and is output as the operation information OPS.

In step S107, the computer PC
1 transmits the operation information OPS. The operation information OP
S is converted into a data format for network by the network interface unit 380 (FIG. 3) and output.

The projector PJ1 performs step T103.
, An image is displayed based on the operation information OPS. Specifically, based on the operation information OPS, the original image O
A predetermined position in the RG (that is, the operation information generation area GA
Position corresponding to the position of the pointer image PPC
To display the pointer image PPJ. Note that the computer PC1 supplies operation information OPS to the projector PJ1, but does not supply pointer image data representing the pointer image PPJ.

By repeatedly executing steps S104 to S107 and T103, the pointer image PPJ in the original image ORG projected and displayed on the screen SC can be moved in conjunction with the movement of the mouse MS.

In step S108, end information indicating the end of the transmission of the operation information OPS is output. This is executed when the user selects the “end” button BE provided in the operation detection window DW. When the user selects the “end” button BE, end information is output from the network interface unit 380 and supplied to the network interface unit 180 of the projector PJ1 via the LAN.

Upon receiving the end information, the projector PJ1 deletes the pointer image PPJ superimposed on the original image ORG in Step T104. In particular,
CPU 100 operates as network interface unit 180
Image processing unit 14 based on the end information supplied to
0 causes the output of the pointer image data to be stopped.

Incidentally, in the above step S104,
The case where the operation of simply moving the mouse MS is executed has been described. However, when the operation of moving the mouse MS while pressing the switch provided on the mouse MS is executed, an area in the original image ORG projected and displayed is displayed. Can be specified. In the projector PJ1 of the present embodiment, by specifying an area, it is possible to superimpose a decoration image of a type different from a pointer image such as a box image or an enclosing frame image on a specified area in the original image ORG. . As can be seen from this description, step S106
In, not only the position information of the mouse MS but also the switch information of the mouse MS is generated as the operation information OPS.

FIG. 7 shows a pointer image P in the original image ORG.
It is explanatory drawing which shows the process at the time of superimposing the box image PB in the original image ORG using PJ. Box image PB
Is the size of the box image P in the original image ORG.
It is determined by designating two opposing vertices of B (start and end). FIG. 7 (A-1) to (A-3)
Indicates an operation information generation area GA included in the operation detection window DW (FIG. 6). FIGS. 7 (B-1) to 7 (B)
-3) is a screen SC by the projector PJ1.
The original image ORG displayed above is shown.

In FIG. 7 (A-1), the computer PC1
Start point P for specifying the area by operating mouse MS
Specify 1C. This is performed by the user moving the mouse MS to move the pointer image PPC to the start point P1C and pressing the switch of the mouse MS. At this time, as shown in FIG. 7B-1, in the original image ORG, the start point P1J is set by the pointer image PPJ.
Is specified. When the start point P1J is specified in the original image ORG, the start point image PS indicating the start point of the box image PB is superimposed on the position of the start point P1J.

In FIG. 7A-2, when the user sets the mouse MS
While holding down the switch, the mouse MS is moved to the end point P2 of the area.
Move to C. At this time, a frame with a line segment connecting the start point P1C and the end point P2C as a diagonal line is displayed as a broken line in the operation information generation area GA. On the other hand, in the original image ORG, as shown in FIG. 7B-2, when the start image PS is displayed, the end image PE instead of the pointer image PPJ is displayed.
Is displayed, and the end point P2J in the original image ORG is designated using the end point image PE.

In FIG. 7A-3, when the user sets the mouse MS
Stop pressing the switch. At this time, FIG.
As shown in 3), in the original image ORG, the box image PB is superimposed on the range set by the start point P1J and the end point P2J.

The start image PS, the end image PE,
Decorative image data representing each decorative image with the box image PB is prepared by the decorative image processing unit 140 (FIG. 2) and supplied to the image processing unit 110.

The type of the decoration image such as the box image PB to be superimposed on the original image ORG is designated in advance by selecting the “menu” button B3 included in the operation detection window DW (FIG. 6). That is, the user operates the “menu” button B3 on the computer PC1.
When is selected, menu display start information is supplied to the projector PJ1 via the LAN. Projector PJ1
CPU 100 in the network interface unit 1
The menu image processing unit 150 and the image processing unit 110 are controlled based on the menu display start information supplied to the menu screen 80, and the menu image is used as the original image ORG on the screen SC.
Display on top. The user selects the type of the decoration image to be used by using the pointer image PPJ superimposed and displayed in the original image ORG (menu image). The menu image is displayed using the remote control RM, and the remote control R
It is also possible to select the type of the decoration image to be used using M.

In the above description, the input unit 3 of the computer PC1
Although the case where the mouse MS is operated as 60 has been described, the operation information OPS is also generated when the keyboard KB is operated as the input unit 360. That is, when the user operates the keyboard KB in step S104, in steps S105 and S106, the operation information generation unit 332 detects a key operation and generates operation information OPS including key information based on the detection result. In step T103, the projector PJ1 operates the operation information OPS (step S1) supplied from the computer PC1.
07), an image is displayed. FIG. 8 is an explanatory diagram showing an image projected and displayed by the user operating the keyboard KB as the input unit 360. In FIG. 8, a code image PM composed of the characters “Here!” Corresponding to the key information is superimposed near the position specified by the pointer image PPJ in the original image ORG. As described above, if the key information is included in the operation information OPS, a code image such as a character can be superimposed on the original image ORG, so that the presentation can be performed more effectively. Code image data representing the code image is prepared by the decoration image processing unit 140 and supplied to the image processing unit 110.

In this embodiment, the operation of the keyboard KB is detected only when the pointer image PPC exists in the operation information generation area GA included in the operation detection window DW (FIG. 6). By displaying the pointer image PPC in an area other than the information generation area GA,
It is possible to perform other operations using the keyboard KB, for example, operations such as editing the contents of a memo in the memo display window MW.

As described above, the projection display system of the first embodiment includes the external input device PC1 and the projector PJ1 connected via the network NW. The external input device PC1 includes an input unit 360 by a user.
And an operation information generation unit 332 that detects the operation of (1) and generates operation information OPS based on the detection result. And
The projector PJ1 generates an image in which the decoration image represented by the decoration image data is superimposed on a predetermined position in the original image represented by the original image data based on the operation information OPS supplied via the network NW. Image data generating units 100 and 11 for generating image data DDV to be represented
0,140. As described above, the computer PC1 sends the operation information OP to the projector PJ1.
S is supplied, but decorative image data representing a decorative image to be superimposed on the original image is not supplied. Thus, the user can easily superimpose the decoration image on the original image by operating the input unit 360 provided in the external input device PC1.

B. Second Embodiment: In the first embodiment, the original image OR projected and displayed on the projector PJ1 (that is, the projection display device PJ1) by the user operating the input unit 360 of the computer PC1 (FIG. 3).
Although the case where the pointer image PPJ and the decoration image different from the pointer image are superimposed in G has been described, the user operates the input unit 360 of the computer PC1 to directly edit the contents of the original image ORG projected and displayed. It is also possible.

This is because the projector PJ1 (FIG. 2)
This can be realized by storing the application program in the external storage device 102. That is, when the projector PJ1 activates an application program stored in the external storage device 102, the application program is developed in the internal storage device (RAM) 104 and executed by the CPU 100. The execution screen data generated by the application program
The image data is supplied to the image processing unit 110 and used as original image data. As a result, the user operates the input unit 360 of the computer PC1 to generate an original image (execution image) O generated by the application program.
It is possible to directly edit the contents of the RG.

Incidentally, in recent years, SBC (Server Based C)
The use of application programs by the omputing method has been promoted. Conventionally, an application program has been used by a so-called download method. In the use of an application program by a download method, a user dynamically downloads a desired application program from a server to a client machine, installs the downloaded application program on the client machine, and uses the application program.

On the other hand, in the use of an application program by the SBC method, a user executes an application program on a server, and a client machine uses an execution screen of the application program on the server. At this time, operation information such as a keyboard and a mouse is supplied from the client device to the server, and update data of the execution screen is supplied from the server to the client device. As a result, the operation of the application program can be separated from the client machine, so that the application program can be used without depending on the performance of the client machine. The execution screen data is supplied as data in a predetermined format, and the client machine
An execution screen is displayed based on the supplied data in a predetermined format.

In this embodiment, the projector PJ1
(Projection display device PJ1) can also function as the client device described above. In this case, since the projector PJ1 does not need to store the application program itself, the capacity of the external storage device 102 or the internal storage device 104 can be made relatively small.

FIG. 9 is an explanatory view showing a projection display system according to the second embodiment. This projection display system includes a projector PJ1 (projection display device PJ1), a computer PC1, and a server SB. The projector PJ1, the computer PC1, and the server SB are connected via a network NW.

The projector PJ1 functions as the client machine described above, and projects and displays an execution screen of an application program supplied from the server SB on the screen SC. The internal configuration of the projector PJ1 is as follows.
Since it is almost the same as FIG. 2, detailed description is omitted. However, the network interface unit 180 (FIG. 2)
Has a viewer unit (not shown) therein, and the viewer unit prepares execution screen data representing an execution screen based on the supplied data DT in a predetermined format. This execution screen data is supplied to the image processing unit 110 (FIG. 2) and used as original image data.

In this projection display system, the user operates the input unit 360 (FIG. 3) of the computer PC1 to project and display the image, similarly to the case where the projector PJ1 stores the application program in the external storage device 102. The contents of the original image (execution screen) ORG to be edited can be directly edited.

FIG. 10 is an explanatory diagram showing a process for directly editing the contents of the original image ORG projected and displayed on the screen SC. In FIG. 10, an execution screen generated by the document creation program is displayed as the original image ORG.

In FIG. 10A, the user moves the mouse MS provided on the computer PC1 to superimpose the pointer image PPJ at a desired position in the original image (execution screen) ORG projected and displayed. At this time, the operation information OPS including the position information supplied from the computer PC1
Is used in the projector PJ1 for the process of superimposing the pointer image PPJ, as in the first embodiment. In FIG. 10A, the pointer image PPJ is superimposed at the position of the character “M” in the original image ORG.

In FIG. 10 (B), the user enters the mouse MS
Is pressed (clicked) to display a cursor CS at a desired position in the original image (execution screen) ORG. At this time, the operation information OPS including the switch information supplied from the computer PC1 is temporarily supplied to the projector PJ1, and the projector PJ1 transmits the supplied operation information OPS to the server SB via the network NW. The server SB follows the operation information OPS including the position information of the mouse MS, the switch information, and the like.
A cursor is displayed at a predetermined position in the execution screen generated by the document creation program. And the server SB
Displays the update screen on which the cursor is displayed on the network N
W to the projector PJ1, and the projector PJ1 uses the updated screen as the original image ORG on the screen S
Projection display on C. At this time, FIG.
As shown in (B), the projector PJ1 superimposes and displays the pointer image PPJ in the original image (update screen) ORG based on the operation information OPS.

In FIG. 10C, a user operates a key on a keyboard KB provided in the computer PC1 to input characters and the like at a cursor position in the original image ORG. At this time, the operation information OPS including the key information supplied from the computer PC1 is temporarily supplied to the projector PJ1, and the projector PJ1 transmits the supplied operation information OPS to the server SB via the network NW. The server SB inputs characters and the like at the cursor position in the execution screen generated by the document creation program according to the operation information OPS including the key information of the keyboard KB. Then, the server SB supplies the edited update screen to the projector PJ1 via the network NW, and the projector PJ1 projects and displays the update screen as the original image ORG on the screen SC. In FIG. 10C, an original image (update screen) ORG in which the character "L" is inserted between the characters "K" and "M" is displayed.

As shown in FIGS. 10A to 10C, the user operates the input unit 360 provided on the computer PC1 to directly change the contents of the original image (execution screen) ORG projected and displayed. Can be edited. In addition,
In FIG. 10, a case has been described where the projector PJ1 projects and displays the execution screen of the application program supplied from the server SB on the screen SC.
Also when the projector PJ1 projects and displays an execution screen generated by an application program stored in the internal storage device 104, the original image (execution screen) O
The contents of RG can be edited directly. In the former case, as described above, there is an advantage that the capacity of the external storage device 102 and the internal storage device 104 provided in the computer PC1 can be relatively small. On the other hand, in the latter case, there is an advantage that the projector PJ1 does not need to transmit the operation information OPS once supplied from the computer PC1 to the server SB. The projector PJ1
The CPU 100 in the projector PJ1 causes the network interface unit 180 to execute the process of supplying the operation information OPS from the to the server SB.

In the first embodiment, when the input section 360 is operated at a position where the pointer image PPJ is superimposed on the original image ORG, a decoration image different from the pointer image PPJ is superimposed on the original image ORG. it can. On the other hand, in the second embodiment, if the input unit 360 is operated at a position where the pointer image PPJ is superimposed on the original image ORG, the contents of the original image (execution screen) ORG can be edited. In the second embodiment, the original image (execution screen) ORG
Further, a decoration image of a type different from that of the pointer image PPJ can be superimposed on the original image ORG. That is, the projector PJ1 superimposes the decoration image on the original image ORG based on the operation information OPS supplied after the pointer image PPJ is superimposed on the original image ORG (decoration mode).
And a process (edit mode) for directly editing the contents of the original image (execution screen) ORG. Note that such switching of the processing mode is performed in the menu image, and the CPU 100 switches the processing mode according to the set processing mode.
(FIG. 2) controls each part.

As described above, also in the second embodiment, the projection display system includes the external input device PC1 and the projector PJ1 connected via the network NW. The external input device PC1 includes an operation information generation unit 332 that detects an operation of the input unit 360 by the user and generates operation information OPS based on the detection result.
In the projector PJ1, the pointer image is superimposed on a predetermined position in the original image based on the operation information OPS supplied via the network NW, and the contents of the original image (execution screen) ORG are edited. Image data generators 100 and 11 for generating image data DDV representing an image
0,140. As described above, by operating the input unit 360 provided in the external input device PC1, the user can easily cause the projector PJ1 to execute the process regarding the content of the image to be projected and displayed.

C. Third Embodiment: In the first embodiment, FIGS.
As described with reference to FIG. 7, the projector PJ1 prepares a decoration image in advance, and thereafter determines the drawing position of the decoration image and draws the decoration image on the original image. In particular,
When drawing the pointer image PPJ on the original image ORG, the projector PJ1 prepares the pointer image PPJ based on the operation information including the start information transmitted in step S103 of FIG. 5 (step T102). And
The projector PJ1 draws a pointer image PPJ at a predetermined position in the original image ORG based on operation information including position information given thereafter (step T10).
3). When the box image PB is drawn on the original image ORG, based on the operation information including the selection information generated by the user selecting the box image in the menu image displayed by the projector PJ1, The projector PJ1 prepares a box image. Then, projector PJ1 draws box image PB at a predetermined position in original image ORG based on operation information including position information and switch information given thereafter.

As described above, in the first embodiment, first, the operation information for designating the type of the decoration image to be prepared is supplied to the projector, and thereafter, the operation for designating the position of the decoration image in the original image and the like are performed. By supplying the information to the projector, the projector superimposes the decoration image on the original image. In other words, the decoration image is superimposed on the original image by supplying the operation information to the projector in a stepwise manner.

However, the operation information supplied to the projector may include, for example, a series of drawing condition information (hereinafter also referred to as a drawing command) necessary for drawing a box image on an original image. In the third embodiment, the decoration image is superimposed on the original image by supplying operation information including such drawing condition information to the projector. Since the internal configurations of the projector and the computer constituting the projection display system of the third embodiment are the same as those of the first embodiment (FIGS. 2 and 3), detailed description will be omitted.

FIG. 11 is a flowchart showing a processing procedure between the projector PJ1 and the computer PC1 in the third embodiment. As in the first embodiment, the projector PJ1 sets the screen SC in step T201.
The original image ORG is displayed above.

The computer PC1 determines in step S201
, An operation information generation program for generating operation information OPS accompanying the operation of the input unit 360 is started. However, the operation information generation program of the present embodiment has a function of generating operation information OPS including a series of drawing commands necessary for drawing a decoration image in an original image. When the operation information generation program starts, the computer PC
On the first display unit 350, an operation detection window DW2 is displayed.

FIG. 12 is an explanatory diagram showing an operation detection window DW2 displayed on the display unit 350 of the computer PC1 in the third embodiment. Like the operation detection window DW of the first embodiment (FIG. 6), the operation detection window DW2 includes a “PJ selection” button B1, a “resolution selection” button B2, a “start” button BS, and “ End "button BE. Further, the operation detection window DW2 includes a drawing palette PL for drawing a decorative image such as a box image, an enclosing frame image, a line image, and a free curve image, and a drawing area DA for drawing such a decorative image. And

In step S202 of FIG. 11, settings are made for the projector PJ1 as in the first embodiment. With this setting, the drawing area DA and the screen SC
The image area of the original image ORG projected and displayed above can be associated.

At step S203, as in the first embodiment, the computer PC1 outputs start information. Then, in step T202, the projector PJ1 is monopolized by the computer PC1. However, in this embodiment, the projector PJ1 does not prepare the pointer image data even when receiving the start information. That is, in the present embodiment, the projector PJ1 draws a decoration image (for example, a box image) different from the pointer image without displaying the pointer image in the original image ORG displayed on the screen SC. In addition, similarly to the first embodiment,
A pointer image may be displayed in the original image ORG.

In step S204, the user inputs
The mouse MS as 60 is operated. Specifically, the decoration image is drawn in the drawing area DA using the drawing palette PL. In step S205, the operation information generation unit 332
Detects a series of operations of the mouse MS. In particular,
The type, size, color, and the like of the decoration image drawn in the drawing area DA are detected according to a series of operations of the mouse MS. Then, in step S206, step S205
The operation information OPS including the drawing command is generated based on the detection result in.

At step S207, the computer PC
1 transmits operation information OPS (drawing command). In step T203, the projector PJ1 displays an image based on the operation information OPS. In particular,
The projector PJ1 draws a decorative image at a predetermined position in the original image based on the operation information OPS.

When another decorative image is to be drawn in the original image, the processes of steps S204 to S207 and T203 may be repeatedly executed.

In step S208, end information is output as in the first embodiment. Thereby, step T20
4, the projector P by the computer PC1
J1's monopoly is lifted.

FIG. 13 shows an original image O in the third embodiment.
FIG. 9 is an explanatory diagram illustrating a process when a box image PBb is drawn in RG. FIGS. 13 (A-1) to 13 (A-3) show FIG.
2 shows a drawing area DA. Fig. 13 (B-1)-
(B-3) shows the original image O displayed on the screen SC.
RG is shown.

First, the user operates the mouse MS on the computer PC1 to select the type and color of the decoration image on the drawing palette PL shown in FIG. Here, it is assumed that a red box image is selected as the decoration image, and a mode in which the box image is displayed in a translucent state on the original image is selected.

Next, in FIG. 13A-1, the start point (X1, Y1) of the box image is designated by operating the mouse MS of the computer PC1. Then, FIG. 13 (A-2)
Then, the end point (X2, Y2) of the box image is designated.
As shown in FIGS. 13 (B-1) and 13 (B-2), when the user designates the start point and the end point of the box image, the original image ORG displayed by the projector PJ1 contains the image shown in FIG. The pointer images PPJ as shown in (B-1) and (B-2) are not displayed. When the start point and the end point are designated, as shown in FIG.
The box image PBa is drawn at a position (range) determined by the start point and the end point. The box image PBa displayed in the drawing area DA is a red image as selected on the drawing palette PL in FIG.

Box image PB in drawing area DA
When the drawing of “a” is completed, the operation information generation unit 332 (FIG. 3)
Generates operation information OPS including a drawing command in response to a series of operations by the mouse MS executed to draw the box image in the original image. Projector PJ1
Is based on the drawing command included in the operation information OPS, as shown in FIG. 13B-3, within the range determined by the start point (X1, Y1) and the end point (X2, Y2) in the original image ORG. , And draws a box image PBb. The box image PBb is a red image. The box image PBb is drawn in a semi-transparent state on the original image ORG.

FIG. 14 is an explanatory diagram showing an example of a drawing command generated when the box image PBa is drawn in the drawing area DA. In addition, reference numerals L1, L2, L3,... Attached to the left side in FIG. 14 are convenience numerals indicating a line number of a series of drawing commands, and are not added to actual drawing commands.

As shown, the start and end of the drawing command are defined by "begin" and "end" in lines L1 and L7. The line L2 includes the character string “draw (box)”, which instructs the drawing of the box image PBb. Lines L3 and L4 include the character strings of "sp (X1, Y1)" and "ep (X2, Y2)", and thereby the box image PB
The start point and end point of b are specified. In line L5, "cl (25
5,0,0) ", which indicates the color of the box image PBb. In this embodiment, the colors of the decoration image are R, G, and B, respectively. It is specified by a gradation value when represented by 256 gradations, and “255,
"0,0" indicates red. In line L6, "wg (0.5)"
Of the box image P
The ratio of the weighted addition when superimposing Bb on the original image ORG is indicated. In FIG. 14, since the ratio of the weighted addition is set to “0.5”, the box image PBb is drawn in a semi-transparent state on the original image ORG as shown in FIG. The Rukoto. If the weighted addition ratio is set to “1”, the box image PBb is drawn instead of a part of the original image ORG as shown in FIG. 7 (B-3). .

The box image PB shown in FIG.
b is the CP of FIG. 2 according to the drawing command shown in FIG.
The image is drawn by U100, the image processing unit 110, and the decoration image processing unit 140. Specifically, the decoration image processing unit 14
0 generates box image data representing the box image PBb according to the supplied drawing command. At this time, the decorative image processing unit 140
A drawing condition including box image data for the box image PBb is stored in 42.

FIG. 15 is an explanatory diagram schematically showing drawing conditions of the box image PBb stored in the decoration image memory 142 (FIG. 2) when the drawing command shown in FIG. 14 is supplied to the projector PJ1. . As shown, the box image PB is stored in the first area M1 in the memory 142.
A character string "box" indicating "b" is stored. In the second and third areas M2 and M3, the drawing position of the box image PBb, that is, the coordinate values of the start point and the end point are stored. The ratio of the weighted addition is stored in the fourth area M4. Then, in the fifth area M5, red box image data having a size determined by the start point and the end point is stored.

The image processing unit 110 (FIG. 2) converts the original image data and the box image data based on the drawing conditions (ie, the starting point and the ending point and the ratio of the weighted addition) supplied from the decorative image processing unit 140. Combine. Specifically, the image processing unit 110 outputs the original image data as it is as the composite image data DDV outside the range determined by the start point and the end point. On the other hand, within the range determined by the starting point and the ending point, the combined image data DDV is output by combining the original image data and the box image data in accordance with the weighted addition ratio. Thereby, a box image PBb as shown in FIG. 13B-3 is drawn in the original image ORG.

FIG. 16 is an explanatory diagram showing a process for moving the box image PBb drawn in the original image ORG. FIG. 16A shows the drawing area DA of FIG. 12, and FIG. 16B shows the original image ORG displayed on the screen SC.

As shown in FIG. 16A, the user operates the mouse MS on the computer PC1 to move the box image PBa drawn in FIG. 13A-3 to a desired position in the drawing area DA. Can be moved. In FIG. 16A, the box image PBa
Has moved by (ΔX, ΔY). Box image P
When the movement of Ba is completed, the operation information generating unit 332 (FIG. 3) detects a series of operations by the mouse MS executed to draw the box image at different positions in the original image, and includes a drawing command. Generate operation information OPS.

Based on the drawing command, the projector PJ1 draws the box image PBb again at a different position in the original image ORG, as shown in FIG. Specifically, the projector PJ1 once erases the box image PBb drawn in the range determined by the start point (X1, Y1) and the end point (X2, Y2) in the original image ORG. Then, at the position shifted by (ΔX, ΔY), in other words, the starting point (X1 + ΔX, Y1 + Δ) in the original image ORG
Y) and the box image PBb is drawn again in the range determined by the end point (X2 + ΔX, Y2 + ΔY).
Note that this box image PBb is also a red image,
It is drawn in a translucent state on the original image ORG.

FIG. 17 is an explanatory diagram showing an example of a drawing command generated when the box image PBa in the drawing area DA is moved. As shown in the figure, the line L2 includes the character string "move", which instructs movement of the decoration image. In line L3, "(X1, Y1)-(X2, Y
2) "is included, thereby specifying the range in which the decoration image to be moved is drawn. Here, the box image PBb shown in FIG. Is specified as a decoration image. In line L4, “(Δ
X, ΔY) ", whereby the movement amount of the box image PBb is specified.

FIG. 18 is an explanatory diagram schematically showing drawing conditions of the box image PBb stored in the decoration image memory 142 (FIG. 2) when the drawing command shown in FIG. 17 is supplied to the projector PJ1. . The contents stored in the memory 142 are almost the same as those in FIG. 15, but the contents of the second and third areas M2 and M3 are changed. Specifically, the coordinate value of the start point of the box image PBb is (X1, Y1)
From (X1 + ΔX, Y1 + ΔY), and the coordinate value of the end point is changed from (X2, Y2) to (X2 + ΔX, Y2 + ΔY).

The image processing unit 110 includes the decoration image processing unit 14
The original image data and the box image data are synthesized based on the changed drawing conditions supplied from 0 (that is, the changed start point and end point and the weighted addition ratio).
As a result, a box image P as shown in FIG.
Bb is drawn in the original image ORG.

As described above, the drawing command shown in FIG. 17 includes information for using the drawing conditions for the decoration image already superimposed on the original image. Original image ORG
When the box image PBb once displayed in the box image is moved to a different position and displayed again, if the drawing command in FIG. 17 is used, the decoration image processing unit 140 can easily set the drawing conditions of the box image PBb after the movement. Can be prepared. That is, if a drawing command as shown in FIG. 14 is used, the decoration image processing unit 140 must newly generate and prepare drawing conditions for the box image PBb after the movement. On the other hand, when a drawing command as shown in FIG.
Can use drawing conditions already prepared in the memory 142. Specifically, it is only necessary to use the decoration image data as it is and to partially change other drawing conditions.

FIGS. 16 to 18 have described the processing when the box image PBb displayed in the original image ORG is moved. In the present embodiment, the box image PBb is moved.
Can be copied to another position in the original image ORG and displayed.

FIG. 19 is an explanatory diagram showing processing when copying the box image PBb drawn in the original image ORG. FIG. 19A shows the drawing area DA in FIG. 12, and FIG. 19B shows the original image ORG displayed on the screen SC.

As shown in FIG. 19A, the user operates the mouse MS on the computer PC1 to move the box image PBa drawn in FIG. 13A-3 to a desired position in the drawing area DA. Can be copied to In FIG. 19A, the second box image PBa ′ is (ΔX, Δ
Y). When the copy of the box image is completed, the operation information generation unit 332 (FIG. 3)
Detects a series of operations performed by the mouse MS to copy and draw a box image to a different position in the original image and generate operation information OPS including a drawing command.

The projector PJ1 draws a second box image PBb 'in the original image ORG as shown in FIG. 19B based on the drawing command. In particular,
The projector PJ1 has a start point (X1 +
ΔX, Y1 + ΔY) and end point (X2 + ΔX, Y2 + Δ)
In the range determined by Y), the second box image P
Bb 'is drawn. Note that the second box image PBb ′
Is also a red image, and is drawn in a translucent state on the original image ORG.

FIG. 20 is an explanatory diagram showing an example of a drawing command generated when the box image PBa in the drawing area DA is copied. As shown in the figure, the line L2 includes a character string of "copy", which instructs to copy the decoration image. In line L3, "(X1, Y1)-(X
2, Y2) ", which specifies the range in which the decorative image to be copied is drawn. Here, the box image P shown in FIG.
Bb is specified as a decoration image to be moved. The line L4 includes the character string “(ΔX, ΔY)”, whereby the drawing position of the second box image PBb ′ with respect to the first box image PBb is specified.

FIG. 21 shows two box images PB stored in the decoration image memory 142 (FIG. 2) when the drawing command shown in FIG. 20 is supplied to the projector PJ1.
It is explanatory drawing which shows the drawing conditions of b and PBb 'typically.
In five areas M1 to M5 in the memory 142, FIG.
And the first box image PB
A set of drawing conditions for b is stored. Other 5
In two areas M6 to M10, the second box image PB
A set of drawing conditions for b ′ is stored. Second
The drawing conditions for the box image PBb ′ are generated using the drawing conditions for the first box image PBb, and have substantially the same contents. However, the coordinate values of the start point and end point of the second box image PBb ′ stored in the seventh and eighth regions M7 and M8 have been changed. Specifically, the coordinate values of the start point and the end point of the first box image PBb are (X1, Y1) and (X2, Y2), but the start point and the end point of the second box image PBb ′. Are (X1 + ΔX, Y1 + ΔY), (X2 + Δ
X, Y2 + ΔY).

The image processing unit 110 includes the decoration image processing unit 14
Based on two sets of drawing conditions supplied from 0, the original image data and the two box image data are combined. As a result, two box images P as shown in FIG.
Bb and PBb 'are drawn in the original image ORG.

As described above, the drawing command shown in FIG. 20 also includes information for using the drawing conditions for the decorative image already superimposed on the original image, similarly to the drawing command of FIG. For this reason, the decoration image processing unit 140
By copying and using the drawing conditions for the first box image PBb already prepared in the memory 142, the drawing conditions for the second box image PBb ′ can be easily prepared. Specifically, the decoration image processing unit 140 copies the decoration image data and uses it as it is, and only needs to partially change other drawing conditions.

In FIGS. 16 to 21, the original image ORG
The processing for moving or copying the box image PBb displayed in the box has been described. However, when the size or color of the box image PBb is changed or when the box image PBb is superimposed on the original image ORG, weighting is performed. It is preferable to execute the same processing even when the addition ratio is changed. That is, the operation information generation unit 332
It is preferable to generate a drawing command for using the drawing condition of the already drawn decorative image. In this case, the decoration image processing unit 140 does not need to newly prepare drawing conditions including decoration image data for drawing a new decoration image.

As described above, the projection display system according to the third embodiment includes the external input device PC1 and the projector PJ1 connected via the network NW. The external input device PC1 includes an input unit 360 by a user.
And an operation information generation unit 332 that detects the operation of (1) and generates operation information OPS based on the detection result. here,
The operation information of the present embodiment includes a series of drawing condition information necessary for drawing a decoration image in an original image. Then, the projector PJ1 prepares the decoration image data representing the decoration image based on the drawing condition information included in the operation information supplied via the network NW, and prepares the original image data representing the original image and the decoration image data. And image data generating sections 100, 110, and 140 for superimposing a decorative image on a predetermined position in the original image by generating image data DDV by combining the image data DDV and the original image. Even using such operation information OPS, the user can use the external input device PC1
By operating the input unit 360 provided in the original image, the decorative image can be easily superimposed on the original image.

In this embodiment, the drawing command (FIGS. 14, 17, and 2) is operated by operating the mouse MS.
Although the operation information including 0) is generated, the drawing command may be directly generated by operating the keyboard KB.

D. Fourth Embodiment: In the third embodiment, a case will be described in which the decorative image processing unit 140 generates a decorative image such as a box image by itself based on a drawing command, and the generated decorative image is displayed on the original image. did. In the present embodiment, a decoration image that cannot be generated by the decoration image processing unit 140,
For example, a case will be described in which a bitmap image including an arbitrary pattern is displayed on an original image.

FIG. 22 is an explanatory diagram showing a process for drawing a bitmap image including an arbitrary pattern in the original image ORG. FIG. 22A shows the drawing area DA in FIG. 12, and FIG. 22B shows the original image ORG displayed on the screen SC.

As shown in FIG. 22A, the user operates the mouse MS on the computer PC1 to cause the bitmap image PBMa in the drawing area DA.
(Image of tree) can be displayed. In particular,
By operating the mouse MS, the prepared bitmap image PBMa is pasted at a desired position in the drawing area DA. Note that in FIG. 22A, the bitmap image PBMa has a start point (X1, Y1) in the drawing area DA.
And the range determined by the end points (X2, Y2)
It is pasted. Then, the bitmap image PBM
When a is pasted at a desired position in the drawing area DA,
The operation information generation unit 332 (FIG. 3) detects a series of operations by the mouse MS executed to draw the bitmap image in the original image, and detects operation information O including a drawing command.
Generate PS.

As shown in FIG. 22B, the projector PJ1 places the bitmap in the range determined by the start point (X1, Y1) and the end point (X2, Y2) in the original image ORG, as shown in FIG. The image PBMb is drawn.

FIG. 23 is an explanatory diagram showing an example of a drawing command generated when the bitmap image PBMa is displayed in the drawing area DA. As shown, row L2
Contains the string "draw (picture.bmp)"
Thereby, the bitmap image data “picture.bmp”
Is instructed to draw the bitmap image BMPb represented by. This image data "picture.bmp"
Not provided in projector PJ1. For this reason,
The computer PC1 stores operation information O including a drawing command.
Along with the PS, the image data “picture.bmp” is supplied to the projector PJ1. In lines L3 and L4, "sp (X1, Y
1) A character string of "," ep (X2, Y2) "is included, which indicates a start point and an end point of the bitmap image BMPb. In line L5," wg (1.0) " A character string is included, so that the bitmap image PBMb is
The ratio of weighted addition when superimposing on RG is indicated. In FIG. 23, since the ratio of the weighted addition is set to “1.0”, the bitmap image PBMb is
As shown in FIG. 2B, the image is drawn instead of a part of the original image ORG.

The image processing unit 110 includes the decoration image processing unit 14
Based on the drawing conditions supplied from 0, the original image data and the supplied bitmap image data are combined. Thereby, the bitmap image P as shown in FIG.
BMb is drawn in the original image ORG.

The third embodiment (FIGS. 16 to 18, FIG. 1)
Similarly to FIGS. 9 to 21), the bitmap image PBMb superimposed on the original image ORG can be moved or copied. Then, in this case, a drawing command for using the drawing conditions for the already superimposed bitmap image is generated. By using such a drawing command, similarly to the third embodiment, the decorative image processing unit 140 does not need to newly prepare drawing conditions including bitmap image data for drawing a new bitmap image. Therefore, a new bitmap image drawing condition can be easily prepared. Further, since bitmap image data having a relatively large data size does not need to be transmitted from the computer PC1 to the projector PJ1, the amount of data transmission between the computer PC1 and the projector PJ1 can be considerably reduced.

The present invention is not limited to the above examples and embodiments, but can be implemented in various modes without departing from the scope of the invention.
For example, the following modifications are possible.

(1) In the above embodiment, the computer PC
1 includes a mouse MS as the input unit 360, but may include another pointing device such as a tablet, a trackball, a trackpad, or a joystick instead of the mouse MS. These pointing devices also have the same function as the mouse MS, and correspond to the pointing device in the present invention.

(2) In the first and second embodiments, the mouse MS as the input unit 360 is used to specify the superimposed position of the pointer image PPJ in the original image ORG. Is not provided, the superimposed position of the pointer image PPJ may be designated using the directional keys of the keyboard KB. Alternatively, the superimposition position of the pointer image PPJ may be designated by a coordinate value using a numeric keypad. As described above, the direction keys and the numeric keypad of the keyboard KB also function as the pointing device in the present invention.

(3) In the first and second embodiments, the position information of the mouse MS included in the operation information OPS is represented by a coordinate value, but the position information is represented by a vector value indicating a movement amount. You may. However, in this case, it is preferable to perform bidirectional communication. That is, when a part of a series of position information generated by moving the mouse MS is not supplied to the projector PJ1, if the position information is represented by a vector value, the pointer in the operation information generation area GA The positional relationship between the image PPC and the positional relationship between the pointer image PPJ in the projected and displayed original image ORG will not match. As described above, when the position information is represented by a vector value indicating the movement amount,
The projector PJ1 may transmit a reception signal to the computer PC1 every time the projector PJ1 receives the operation information OPS.
Then, when the reception signal is not received, the computer PC1 may transmit the operation information OPS again. On the other hand, if the position information is represented by coordinate values, even when a part of a series of position information generated by moving the mouse MS is not supplied to the projector PJ1, the position information in the operation information generation area GA The positional relationship between the pointer image PPC and the positional relationship between the pointer image PPJ in the projected and displayed original image ORG can be substantially matched. Therefore, when the position information is represented by coordinate values, the computer PC1 sends the projector PJ
There is an advantage in that only one-way communication to 1 is required. Generally, the operation information OPS may be transmitted by one-way communication from the computer PC1 to the projector PJ1, or may be transmitted by two-way communication between the projector PJ1 and the computer PC1.

(4) In the first and second embodiments, the operation information generation section 332 stored in the RAM 330 of the computer PC1 displays the operation information generation area GA on the display section 350.
Although FIG. 6 is displayed, the operation information generation area GA may not be displayed. In this case, the operation information OPS accompanying the operation of the mouse MS is generated if the pointer image PPC is displayed somewhere in the entire display area of the display unit 350.

In the third and fourth embodiments, the operation information generating section 332 displays the drawing area DA (FIG. 1) on the display section 350.
2) is displayed, and a decorative image such as a box image is drawn in the drawing area DA, but the decorative image may not be drawn. Further, the drawing area DA may not be displayed. However, when a decorative image is drawn in the drawing area DA, there is an advantage that the user can easily check the decorative image to be drawn.

In the above embodiment, the computer P
C1 includes the display unit 350, but the display unit 350 may be omitted.

The external input device of the present invention generally includes an input unit, an operation information generation unit that detects an operation of the input unit by a user, generates operation information based on the detection result, and is connected to a network. And a network interface unit for supplying the projector to the projector via a network.

(5) In the above embodiment, the user operates the input unit 360 of the computer PC1 to
The decorative image such as the pointer image PPJ is superimposed on the original image ORG, and the content of the original image (execution screen) ORG generated by the application program is directly edited. The user operates the input unit 3 of the computer PC1.
By operating 60, it is also possible to cause the projector PJ1 to execute another process related to the image projected and displayed.

For example, when the projector PJ1 needs to input a data name when storing image data in the external storage device 102, the user operates the keyboard KB provided in the computer PC1 to input the data name. A data name can be input and displayed on the input screen.

When the projector PJ1 needs to input a password when using image data stored in the memory card MC as original image data, the user operates the keyboard KB provided in the computer PC1. Thus, the password can be input and displayed on the password input screen. At this time, it is preferable that a code such as “*” different from the code input by the user is displayed on the password input screen projected and displayed.

Furthermore, in the third and fourth embodiments, a decoration image such as a box image or a bitmap image different from the pointer image is superimposed on the original image. However, a solid image such as a black image or a white image prepared by a projector or the like may be used as the original image.
Further, the decorative image may be superimposed on the entire original image so that the original image does not appear in appearance. This is, for example,
In FIG. 13 (B-3) and FIG. 22 (B), the decoration image P
This corresponds to the case where the sizes of Bb and PBMb are set to substantially the same size as the size of the original image ORG. In this case, the operation information supplied from the external input device to the projector only needs to include drawing condition information in which the start point and the end point of the decoration image are the upper left point and the lower right point of the original image.

As described above, the image data generating section provided in the projector of the present invention generally includes operation information supplied to the network interface section via the network, and operates the input section of the external input device. Any processing may be used as long as it executes a predetermined process relating to the content of the image to be projected and displayed based on the operation information generated by the above and generates image data representing the image to be projected and displayed.

Note that the predetermined processing relating to the content of the image to be projected and displayed in the image data generating section is performed at a predetermined position in the original image represented by the original image data based on the operation information. This means a process in which the display content of the image (that is, the picture in the image) is changed, such as superimposition of the displayed decorative image.

(6) In the above embodiment, the projector
It has a liquid crystal light valve as an electro-optical device,
Instead of this, a micromirror-type light modulation device, a CRT, or the like may be provided. For example, a DMD (digital micromirror device) (trademark of TI) can be used as the micromirror light modulation device.
The electro-optical device may be any device that forms image light according to image data.

(7) In the above embodiment, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software is replaced by hardware. You may do so.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing a projection display system as a first embodiment of the present invention.

FIG. 2 is an explanatory diagram showing a schematic configuration of a projector PJ1 of FIG.

FIG. 3 is an explanatory diagram illustrating a schematic configuration of a computer PC1 in FIG. 1;

FIG. 4 is an explanatory diagram showing an example of a use form of the projection display system of FIG. 1;

FIG. 5 is a flowchart illustrating a processing procedure between the projector PJ1 and the computer PC1.

FIG. 6 is an explanatory diagram showing an operation detection window DW displayed on the display unit 350 of the computer PC1.

FIG. 7 is an explanatory diagram showing processing when a box image PB is superimposed on the original image ORG using the pointer image PPJ in the original image ORG.

FIG. 8 shows a keyboard KB used as an input unit 360 by a user.
FIG. 9 is an explanatory diagram showing an image projected and displayed by operating.

FIG. 9 is an explanatory diagram illustrating a projection display system according to a second embodiment.

FIG. 10 shows an original image O projected and displayed on a screen SC.
FIG. 9 is an explanatory diagram showing a process when directly editing the contents of RG.

FIG. 11 is a flowchart showing a processing procedure between a projector PJ1 and a computer PC1 in a third embodiment.

FIG. 12 shows an operation detection window DW2 displayed on the display unit 350 of the computer PC1 in the third embodiment.
FIG.

FIG. 13 is an explanatory diagram showing processing when a box image PBb is drawn in an original image ORG in the third embodiment.

FIG. 14 is an explanatory diagram illustrating an example of a drawing command generated when a box image PBa is drawn in a drawing area DA.

FIG. 15 shows an example in which the drawing command shown in FIG.
FIG. 4 is an explanatory diagram schematically showing drawing conditions of a box image PBb stored in a decoration image memory 142 (FIG. 2) when supplied to J1.

FIG. 16 shows a box image P drawn in an original image ORG.
It is explanatory drawing which shows the process at the time of moving Bb.

FIG. 17 is an explanatory diagram illustrating an example of a drawing command generated when the box image PBa in the drawing area DA is moved.

FIG. 18 shows a drawing command shown in FIG.
FIG. 4 is an explanatory diagram schematically showing drawing conditions of a box image PBb stored in a decoration image memory 142 (FIG. 2) when supplied to J1.

FIG. 19 is a box image P drawn in an original image ORG.
FIG. 9 is an explanatory diagram showing processing when copying Bb.

FIG. 20 is an explanatory diagram illustrating an example of a drawing command generated when the box image PBa in the drawing area DA is copied.

FIG. 21 shows a drawing command shown in FIG.
Two box images PBb, PBb ′ stored in the decoration image memory 142 (FIG. 2) when supplied to J1.
FIG. 3 is an explanatory diagram schematically showing the drawing conditions of FIG.

FIG. 22 is an explanatory diagram showing a process for drawing a bitmap image including an arbitrary pattern in an original image ORG.

FIG. 23 shows a bitmap image PBMa in a drawing area DA.
FIG. 9 is an explanatory diagram showing an example of a drawing command generated when is displayed.

FIG. 24 is an explanatory diagram showing a conventional projector.

[Explanation of symbols]

 100 CPU 100b Bus 102 External storage device 104 Internal storage device 108 Analog image signal input unit 110 Image processing unit 120 Liquid crystal light valve driving unit 130 Liquid crystal light valve 140 Decorative image processing unit 142 Decorative image Memory 150 Menu image processing unit 160 Remote control signal processing unit 170 Reading device 180 Network interface unit 200 Illumination optical system 220 Projection optical system 300 CPU 310 External storage device 320 ROM 330 RAM 332 Operation information Generating unit 350 ... Display unit 360 ... Input unit 380 ... Network interface unit 900 ... Image supply device B1, B2, B3, BE, BS ... Button PL ... Drawing palette DW, DW2 ... Operation detection window GA ... Operation information generation area DA … Drawing area B: Keyboard MC: Memory card MS: Mouse MW: Memo display window NW: Network OPS: Operation information ORG: Original image PC1: Computer PJZ, PJ1: Projector PPC: Pointer image PPJ: Pointer image RM: Remote control SB: Server SC: screen

Claims (20)

[Claims] 1. A projector connected via a network to an external input device having an input unit, wherein the projector is supplied to the network interface unit via the network. The operation information, based on the operation information generated by operating the input unit of the external input device, performs a predetermined process related to the content of the image to be projected and displayed, the image to be projected and displayed An image data generation unit for generating image data to be represented, an electro-optical device that forms image light according to the image data, and a projection optical system that projects the image light obtained by the electro-optical device. A projector characterized in that: 2. The projector according to claim 1, wherein the image to be projected and displayed is formed of an original image and a decoration image superimposed on the original image, and the decoration image data representing the decoration image is Not supplied from the external input device, prepared by the image data generating unit, the image data generating unit, based on the operation information supplied from the external input device, original image data representing the original image and A projector that superimposes the decoration image on a predetermined position in the original image by generating the image data by combining the decoration image data. 3. The projector according to claim 2, wherein the operation information includes at least position information generated by operating a pointing device as the input unit of the external input device. A projector configured to superimpose a pointer image as the decoration image on a predetermined position in the original image based on the position information. 4. The projector according to claim 3, wherein the position information is coordinate value information specified by the pointing device. 5. The projector according to claim 3, wherein the operation information further includes switch information generated by operating a switch provided on the pointing device; A projector, wherein a data generation unit superimposes a decoration image of a different type from the pointer image in a specified range in the original image based on the position information and the switch information included in the operation information. 6. The projector according to claim 5, wherein the operation information further includes key information generated by operating a keyboard as the input unit of the external input device. A projector configured to superimpose a code image as the decoration image on the original image based on the key information. 7. The projector according to claim 1, wherein the image to be projected and displayed is formed of an original image and a decoration image superimposed on the original image, and the operation information includes the decoration image. The image data generating unit includes a series of drawing condition information necessary for drawing in the original image, and the image data generation unit displays a decoration representing the decoration image based on the drawing condition information supplied from the external input device. While preparing the image data, by superimposing the decorative image at a predetermined position in the original image by generating the image data by combining the original image data representing the original image and the decorative image data, projector. 8. The projector according to claim 7, wherein the image data generation unit is capable of executing the synthesis using the decoration image data supplied from the external input device. 9. The projector according to claim 7, wherein the drawing condition information includes information for using a drawing condition for the decoration image already superimposed in the original image, The projector, wherein the image data generation unit executes the combining using the prepared decoration image data based on the drawing condition information. 10. A projection display system comprising an external input device and a projector connected via a network, wherein the external input device detects an input unit and an operation of the input unit by a user, and detects a detection result. An operation information generation unit that generates operation information based on the first information, and a first for connecting to the network and supplying the operation information to the projector via the network.
A projector, comprising: a second network interface for connecting to the network; and operation information supplied to the second network interface via the network. An image data generating unit for executing predetermined processing relating to the content of the image to be projected and displayed, and generating image data representing the image to be projected and displayed; and an electro-optical device for forming image light according to the image data. A projection display system, comprising: a projection optical system that projects image light obtained by the electro-optical device. 11. The projection display system according to claim 10, wherein the image to be projected and displayed is formed of an original image and a decoration image superimposed on the original image, and a decoration image representing the decoration image. Data is not supplied from the external input device, but is prepared by the image data generating unit, and the image data generating unit is configured to output the original image representing the original image based on the operation information supplied from the external input device. A projection display system that superimposes the decoration image at a predetermined position in the original image by generating the image data by combining the data with the decoration image data. 12. The projection display system according to claim 11, wherein the input unit includes a pointing device, and the operation information includes at least position information generated by operating the pointing device. A projection display system, wherein the image data generating unit superimposes a pointer image as the decoration image on a predetermined position in the original image based on the position information. 13. The projection display system according to claim 12, wherein the external input device further includes a display unit, and wherein the operation information generation unit causes the operation unit to operate the pointing device in accordance with an operation of the pointing device. An operation information generation area that is an area for generating operation information is displayed, and the operation of the pointing device is detected only when a pointer image corresponding to the pointing device is displayed in the operation information generation area. Projection display system. 14. The projection display system according to claim 13, wherein the operation information generation area is associated with an image area to be projected and displayed. 15. The projection display system according to claim 10, wherein the image to be projected and displayed is formed of an original image and a decoration image superimposed on the original image, and the operation information is the decoration. The image data generator includes a series of drawing condition information necessary for drawing an image in the original image, and the image data generating unit converts the decoration image based on the drawing condition information supplied from the external input device. By preparing the decoration image data to be represented and combining the original image data representing the original image and the decoration image data to generate the image data, the decoration image is superimposed on a predetermined position in the original image. Do, projection display system. 16. An operation information generating method for generating operation information associated with an operation of the input unit supplied to a projector connected to the external input device via a network in the external input device having an input unit. So,
An operation information generation method, comprising: (a) detecting an operation of the input unit by a user; and (b) generating the operation information based on a detection result. 17. The operation information generating method according to claim 16, wherein the step (a) includes: (a-1) using a pointing device as the input unit on a display unit provided in the external input device. Displaying an operation information generation area that is an area for generating the operation information associated with the operation;
2) detecting an operation of the pointing device only when a pointer image corresponding to the pointing device is displayed in the operation information generation area;
And an operation information generation method. 18. A computer program for causing a computer as an external input device including an input unit to generate operation information associated with an operation of the input unit supplied to a projector connected to the external input device via a network. A computer program for causing a computer to realize a function of detecting an operation of the input unit by a user and a function of generating the operation information based on a detection result. 19. The computer program according to claim 18, wherein the function of detecting an operation of the input unit is provided on a display unit provided in the external input device, in accordance with an operation of a pointing device as the input unit. A function of displaying an operation information generation area that is an area for generating the operation information; and operating the pointing device only when a pointer image corresponding to the pointing device is displayed in the operation information generation area. A computer program comprising: a detecting function. 20. A computer-readable recording medium for recording the computer program according to claim 18.