JP6264114B2 - Projection apparatus and program - Google Patents

Description

  The present invention relates to a projection apparatus and a program.

  2. Description of the Related Art Conventionally, a system is known in which when a user designates a projection screen projected on a screen or the like with a pointing device, the coordinates of the designated position are acquired and processing according to the designated position is performed. In such a system, a technique for easily aligning a pointer with a position intended by a user has been proposed.

  For example, in Patent Document 1, when the coordinate difference between the pointer coordinates of the pointing device and the coordinates of a selection target such as an icon on the projection screen is within a predetermined range, the coordinates of the pointer are converted to the coordinates of the selection target. Thus, a technique is described in which a pointer can be automatically guided to a selection target intended by a user (see, for example, Patent Document 1).

JP 2013-77226 A

  By the way, in the projection apparatus, when the resolution of the input image (the total number of pixels of the image) and the resolution of the projection screen do not match, the input image is subjected to scaling processing and converted to the projection screen resolution before projection. However, when the input image is downscaled (converted to a low resolution) with a scaling factor smaller than 1 and then projected as a projection screen, the icon on the projection screen is displayed small (see FIG. 6). There was a problem that it was difficult to match. Patent Document 1 does not describe the problem of operability caused by the scaling magnification.

  An object of the present invention is to make it easier to align a pointer at a location intended by a user and improve operability regardless of the scaling factor.

In order to solve the above problem, a projection apparatus according to claim 1 is provided.
Calculating means for calculating a scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen;
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the scaling factor calculated by the calculating means;
Obtaining means for obtaining coordinates of a position designated by the pointing device on the projection screen;
Detecting means for detecting the coordinates of the pointer on the projection screen based on the input image based on the coordinates acquired by the acquiring means for the number of frames set by the setting means;
Is provided.

  According to the present invention, regardless of the scaling factor, it is easy to align the pointer at the location intended by the user, and operability can be improved.

It is a figure which shows the example of whole structure of the projection system which concerns on embodiment of this invention. It is a block diagram which shows the functional structure of the projection apparatus of FIG. It is a block diagram which shows the functional structure of the pointing device of FIG. It is a flowchart which shows the projection control process performed by CPU of FIG. It is a flowchart which shows the filter number setting process performed in step S1 of FIG. It is a figure which shows an example of the projection screen which projected the input image by downscaling to the output resolution of a projector. It is a figure which shows an example of the projection screen which projected the input image without the scaling process. It is a figure which shows an example of the projection screen which projected the input image by scaling up to the output resolution of a projector.

  EMBODIMENT OF THE INVENTION Below, the form for implementing this invention is demonstrated using drawing. However, the embodiments described below are given various technically preferable limitations for carrying out the present invention. Therefore, the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[Configuration of Projection System 100]
FIG. 1 is a diagram showing an overall configuration of a projection system 100 according to the present invention. The projection system 100 includes a projection device 1, a pointing device 2, a screen 3, and a PC (Personal Computer) 4. The projection system 100 projects an image based on the video signal output from the PC 4 onto the screen 3 as a projection screen 31 by the projection device 1. On the screen 3, a cursor 32 (pointer image) indicating the position of the pointer on the projection screen 31 is displayed. The cursor 32 is synthesized with the image input from the PC 4 by the projection device 1 in accordance with the position designated by the pointing device 2, and moves according to the operation of the pointing device 2 by the user.

[Configuration of Projector 1]
FIG. 2 is a block diagram showing a functional configuration of the projection apparatus 1. As shown in FIG. 2, the projection apparatus 1 includes a CPU (Central Processing Unit) 10, a ROM (Read Only Memory) 11, a RAM (Random Access Memory) 12, a video signal input unit 13, a light irradiation device 14, and a display element 15. , A projection lens 16, a lens control unit 17, a wireless communication unit 18, an audio device 19, a key input unit 101, a USB controller 102 unit, and the like.

  The CPU 10 reads the program 11a stored in the ROM 11, expands it in the work area of the RAM 12, controls each unit according to the program, and executes various processes including a projection control process and a filter number setting process described later. . The CPU 10 functions as a scaling unit and a synthesis unit by executing projection control processing. Moreover, it functions as a calculation unit, a setting unit, and a detection unit by executing the filter number setting process. Further, the CPU 10 functions as an acquisition unit in cooperation with the wireless communication unit 18.

The ROM 11 stores a program 11a corresponding to the projection apparatus 1 and data used by these programs. The program 11a includes a program for executing a projection control process and a filter number setting process which will be described later.
The ROM 11 stores a filter number acquisition table 11b. The filter number acquisition table 11b will be described later.

  The RAM 12 forms a temporary storage area for the program 11a, input or output data, parameters, and the like in the various processes that are executed and controlled by the CPU 10. For example, the RAM 12 has a filter number setting area 12a for storing the number of filters set in a filter number setting process (to be described later), and a coordinate data storage area for sequentially storing coordinate data acquired from the pointing device 2. 12b is formed.

  The video signal input unit 13 includes, for example, video input terminals such as an HDMI (registered trademark) terminal, an RGB terminal, and a DVI terminal, and receives video signals such as RGB signals and video signals input from the PC 4 via the video input terminal. The image data is converted into image data (input image) or audio data of a predetermined standard and output to the CPU 10.

  The light irradiation device 14 is, for example, time-divisionally divided into light (for example, infrared light) other than R (red light), G (green light), B (blue light), and visible light in accordance with a control signal output from the CPU 10. ) In a circular manner. The display element 15 is irradiated with R, G, B primary color light and infrared light from the light irradiation device 14.

The display element 15 is, for example, a micromirror element having a plurality of (in the case of XGA, horizontal 1024 pixels × vertical 768 pixels) micromirrors arranged in an array. The display element 15 forms an optical image with the reflected light by displaying an image by turning on / off the tilt angle of each micromirror at a high speed in accordance with a control signal output from the CPU 10.
The display element 15 forms a light image based on the input image when the primary color light is irradiated, and when the infrared light is irradiated, the display element 15 has different gradations according to the coordinate position of the projection screen 31. An optical image for projecting the detection image pattern is formed.

The projection lens 16 projects the optical image formed by the display element 15 onto the screen 3 according to a predetermined magnification that is determined by the optical zoom position of the projection lens 16. By projecting the optical image onto the screen 3, the input image and the position detection image are displayed on the screen 3 as the projection screen 31. Note that the position detection image is formed by infrared light and therefore cannot be seen by human eyes.
The lens control unit 17 controls the projection lens 16 to perform zooming and focusing.
The light irradiation device 14, the display element 15, the projection lens 16, and the lens control unit 17 function as a projection unit.

  The wireless communication unit 18 communicates with the pointing device 2 in accordance with a control signal output from the CPU 10.

  The audio device 19 includes a D / A converter, an amplifier, a speaker, and the like. After the audio signal of the video signal is converted into an analog signal by the D / A converter in accordance with the control signal output from the CPU 10, the analog audio signal is predetermined by the amplifier And output as sound from the speaker.

  The key input unit 101 includes a plurality of operation buttons and outputs a user operation signal to the CPU 10.

  A USB controller (Universal Serial Bus) 102 communicates with the USB controller of the PC 4, and pointer coordinate data (referred to as pointer coordinate data) and operation data detected based on the coordinate data received from the pointing device 2 are stored in the PC 4. Send.

[Configuration of pointing device 2]
FIG. 3 is a block diagram showing a functional configuration of the projection apparatus 1. As shown in FIG.
The pointing device 2 includes a control unit 20, an optical sensor 21, an operation unit 22, a wireless communication unit 23, and the like.

  The control unit 20 includes a CPU, ROM, RAM, and the like. The CPU of the control unit 20 reads a program stored in the ROM, develops it in the work area of the RAM, and controls each unit according to the program.

  The optical sensor 21 receives infrared light corresponding to the position detection image projected on the screen 3, generates an electrical signal corresponding to the intensity of the received infrared light, and outputs the electrical signal to the control unit 20. The control unit 20 generates coordinate data indicating the position coordinates instructed by the pointing device 2 based on the electrical signal from the optical sensor 21, and transmits the coordinate data to the projection device 1 by the wireless communication unit 23.

  The operation unit 22 includes, for example, a right button and a left button, and outputs an operation signal of each button to the control unit 20. Based on the operation signal of each button from the operation unit 22, the control unit 20 associates the operation data of each button with the coordinate data corresponding to the timing when the operation signal is input, and the wireless communication unit 23 causes the projection apparatus 1. Send to.

  The wireless communication unit 23 communicates with the projection device 1 in accordance with a control signal output from the control unit 20.

[Configuration of PC4]
The PC 4 is a computer device that includes a CPU, ROM, RAM, operation unit, display unit, storage unit, video signal output unit, USB controller, and the like. The CPU of the PC 4 displays an image based on the video signal on the display unit and outputs the video signal to the projection device 1 according to a program stored in the ROM. Further, based on the pointer coordinate data and the operation data received from the projection apparatus 1 via the USB controller, a process corresponding to the operation of the icon or the like on the projection screen 31 is executed.

[Operation of Projector 1]
Next, the operation of this embodiment will be described.
FIG. 4 is a flowchart of the projection control process executed by the CPU 10 of the projection apparatus 1. The projection control process is executed in cooperation with the CPU 10 and the program 11a stored in the ROM 11 when input of an input image is started.

First, the CPU 10 executes a filter number setting process (step S1).
FIG. 5 shows a flowchart of the filter number setting process executed in step S1 of FIG. The filter number setting process is executed in cooperation with the CPU 10 and the program 11a.

  In the filter number setting process, the CPU 10 first acquires the resolution of the input image (step S101). The resolution here does not mean the density of pixels in the image, but the total number of pixels of the image (the number of pixels in the vertical direction of the image × the number of pixels in the horizontal direction of the image).

  Next, the CPU 10 acquires the resolution of the projection screen 31, that is, the output resolution of the projection device 1 (the resolution of the display element 15) (step S102).

  Next, the CPU 10 calculates a scaling magnification based on the resolution of the input image and the output resolution of the projection apparatus 1 (step S103). Scaling here means increasing or decreasing the number of pixels of the input image (resolution conversion). The scaling magnification is a magnification for increasing or decreasing the number of pixels. When the number of pixels is not increased or decreased, the scaling factor is 1.

Next, the CPU 10 reads the filter number acquisition table 11b stored in the ROM 11, acquires the filter number corresponding to the scaling factor calculated in step S103 (step S104), and sets the acquired filter number in the filter number of the RAM 12 The area 12a is set (step S105), and the process proceeds to step S2 in FIG.
The number of filters refers to the number of coordinates (number of frames) used for coordinate averaging when detecting the coordinates of the pointer on the projection screen 31 based on the input image (projecting the input image). The filter number acquisition table 11b is a table that stores the optimum number of filters for the scaling factor in association with the scaling factor. In the filter number acquisition table 11b, on the basis of the number of filters when the scaling factor is 1, the smaller the number of filters is associated with the scaling factor larger than 1, and the larger the number of filters is associated with the smaller scaling factor. It has been.

Here, the relationship between the scaling factor and the number of filters will be described.
FIG. 6 shows an example of a projection screen 31 in which an input image is projected after being downscaled (reduced in resolution) to the output resolution of the projection apparatus 1. FIG. 6 shows, as an example, a projection screen 31 when an input image of 1600 × 1200 pixels is projected after being downscaled to 1024 × 768 pixels.
FIG. 7 shows an example of a projection screen 31 obtained by projecting an input image without scaling processing. FIG. 7 shows a projection screen 31 of 1024 × 768 pixels as an example.
FIG. 8 shows an example of a projection screen 31 on which an input image is projected after being upscaled (higher resolution) to the output resolution of the projection apparatus 1. FIG. 8 shows, as an example, a projection screen 31 when an input image of 800 × 600 pixels is upscaled to 1024 × 768 pixels.

  As shown in FIG. 6, when the input image is downscaled, the number of pixels such as icons and buttons in the image is also downscaled, and the icons and buttons displayed on the projection screen 31 are also reduced. When the pointing device 2 is used, hand shake tends to occur as compared with a mouse of a personal computer supported by a desk and capable of stable operation. Therefore, it is difficult to align the pointer with a small icon or the like, which causes stress on the user.

  The coordinate data of the position coordinates on the projection screen 31 instructed by the pointing device 2 is acquired by the pointing device 2 for each frame of the projection screen 31, transmitted to the projection device 1, and received by the wireless communication unit 18. When this coordinate data is detected as it is as the position of the pointer, the responsiveness (following performance) of the pointer movement is good, but errors in coordinate acquisition and camera shake are reflected as they are. Therefore, in the projection apparatus 1, the coordinate data acquired in each of the number of frames set as the number of filters is averaged, the averaged coordinates are detected as the coordinates of the pointer, and the coordinates of the detected coordinates on the projection screen 31 are detected. The cursor 32 is displayed at the position, or the pointer coordinate data is transmitted to the PC 4 together with the operation data to execute processing corresponding to the operation. As the number of filters is increased, position blur due to camera shake or the like is alleviated. Therefore, when the scaling factor is smaller than 1, the number of filters is increased from the reference value to prevent camera shake, and the user points to the position intended by the user. To improve the operability.

  On the other hand, as shown in FIG. 8, when the input image is upscaled, the number of pixels such as an icon in the image is also upscaled, and the icons, buttons, and the like displayed on the projection screen 31 are increased. If the icon or button is large, it is easy to place the pointer on it even if there is some hand shake. On the other hand, if the number of filters is increased, the followability of the pointer with respect to the operation on the pointing device 2 is deteriorated, so that the user feels stress. Therefore, in the present embodiment, when the scaling factor is larger than 1, by reducing the number of filters from the reference, followability of pointer movement is improved and operability is improved.

  Returning to FIG. 4, in step S <b> 2, the CPU 10 scales the input image with a scaling factor calculated based on the resolution of the input image and the output resolution of the projection apparatus 1 (step S <b> 2).

  Next, the CPU 10 acquires coordinate data and operation data transmitted from the pointing device 2 by the wireless communication unit 18 and stores them in the coordinate data storage area 12b of the RAM 12 (step S3). Here, coordinate data for the maximum number of filters stored in the filter number acquisition table 11b can be stored in the coordinate data storage area 12b in association with the frame number of the frame from which the coordinate data was acquired. In step S3, if the coordinate data stored in the coordinate data storage area 12b exceeds the specified number, the CPU 10 deletes the oldest coordinate data and stores new coordinate data in the coordinate data storage area 12b. To do.

  Next, the CPU 10 averages the coordinates with the number of filters set in the filter number setting area 12a, and detects the averaged coordinates as the coordinates of the pointer on the projection screen 31 based on the input image (step S4). For example, the CPU 10 reads out the coordinate data for the number of filters stored in the coordinate data storage area 12b from the new one, and calculates the average of each of the x coordinate and the y coordinate, thereby averaging the coordinates. If coordinate data for the set number of filters has not yet been stored in the filter number setting area 12a, averaging is performed using the coordinate data stored in the filter number setting area 12a.

  Next, the CPU 10 combines the image of the cursor 32 with the position of the coordinate averaged in step S4 of the scaled input image (step S5), and points the coordinate data of the averaged coordinate as pointer coordinate data. The operation data acquired from the apparatus 2 is transmitted to the PC 4 via the USB controller 102 (step S6). Then, the CPU 10 controls the light irradiation device 14, the display element 15, and the lens control unit 17 to project a composite image obtained by combining the cursor 32 onto the screen 3 as the projection screen 31 (Step S <b> 7).

Next, the CPU 10 determines whether or not the next input image (frame) exists (step S8). When determining that the next input image exists (step S8; YES), the CPU 10 determines whether or not the resolution of the input image has been changed (step S9). If it is determined that the resolution of the input image has been changed (step S9; YES), the CPU 10 returns to step S1. When determining that there is no change in the resolution of the input image (step S9; NO), the CPU 10 returns to step S2.
On the other hand, if it is determined in step S8 that the next input image does not exist (step S8; NO), the CPU 10 ends the projection control process.

As described above, the CPU 10 of the projection apparatus 1 calculates the scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen, and based on the input image based on the calculated scaling factor. The number of filters, which is the number of frames used when detecting the position of the pointer on the projection screen 31, is set. Then, the coordinates of the pointer on the projection screen 31 based on the input image are detected based on the coordinates for the set number of filters acquired from the pointing device 2. Specifically, the CPU 10 averages the coordinates for the set number of frames, and detects the averaged coordinates as the coordinates of the pointer on the projection screen 31 based on the input image.
Therefore, regardless of the scaling factor, the pointer can be easily positioned at the location intended by the user, and the operability can be improved.

  For example, when the scaling factor is downscaling, the CPU 10 sets the number of filters more than a predetermined reference. Therefore, in the downscaled projection screen 31 in which icons or the like are displayed small, it is easy to place the pointer at the position intended by the user by alleviating the situation where it is difficult to align the pointer to the position intended by the user due to hand shake or the like. And operability can be improved.

  For example, when the scaling factor is upscaling, the CPU 10 sets the number of filters to be smaller than a predetermined reference. Therefore, in the upscaled projection screen 31 on which icons and the like are displayed large, it is possible to improve followability of pointer movement and improve operability.

Further, the CPU 10 scales the input image by the calculated scaling factor,
The cursor 32 is synthesized at the pointer position of the scaled input image, and the projection screen 31 is projected based on the synthesized image obtained by synthesizing the cursor 32. Accordingly, the position of the detected pointer can be visualized and reflected on the projection screen 31.

  In addition, the description content in the said embodiment is a suitable example of the projection system which concerns on this invention, and is not limited to this.

  For example, in the above embodiment, the pointing device 2 includes the optical sensor 21, projects a position detection image formed by infrared light onto the screen 3, and receives the position detection projection image with the optical sensor 21. By doing so, the position coordinates designated by the pointing device 2 are obtained, but the present invention is not limited to this. For example, a photographing unit that photographs the projection screen 31 of the screen 3 may be provided in the projection device 1, and the position coordinates of the pointing device 2 may be obtained based on the photographed image obtained by the photographing unit.

  For example, in the above embodiment, the coordinates of the pointers are detected by averaging the coordinates for the number of filters set by the filter number setting process. For example, for the coordinates for the number of filters, The averaging may be performed after weighting is performed according to the acquired time (for example, the weight is increased as the newly acquired coordinates are increased).

In the above embodiment, the case where the projection apparatus 1 is a DLP (Digital Light Processing) (registered trademark) projector using a micromirror element has been described as an example. However, the present invention is not limited to this, and for example, a CRT projector, Other projectors such as a liquid crystal projector may be used.
In addition, the detailed configuration and detailed operation of each apparatus constituting the projection system can be changed as appropriate without departing from the spirit of the invention.

Although the embodiment of the present invention has been described above, the technical scope of the present invention is not limited to the above-described embodiment, but is defined based on the description in the claims. Furthermore, the technical scope of the present invention also includes an equivalent range in which modifications unrelated to the essence of the present invention are added from the description of the claims.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Calculating means for calculating a scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen;
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the scaling factor calculated by the calculating means;
Obtaining means for obtaining coordinates of a position designated by the pointing device on the projection screen;
Detecting means for detecting the coordinates of the pointer on the projection screen based on the input image based on the coordinates acquired by the acquiring means for the number of frames set by the setting means;
A projection apparatus comprising:
<Claim 2>
The detection means averages the coordinates acquired by the acquisition means for the number of frames set by the setting means, and detects the averaged coordinates as coordinates of a pointer on a projection screen based on the input image. Item 4. The projection device according to Item 1.
<Claim 3>
The projection apparatus according to claim 1, wherein the setting unit sets the number of coordinates larger than a predetermined reference when the scaling magnification is downscaling.
<Claim 4>
The projection device according to any one of claims 1 to 3, wherein the setting means sets the number of coordinates to be smaller than a predetermined reference when the scaling magnification is upscaling.
<Claim 5>
Scaling means for scaling the input image by the calculated scaling factor;
Combining means for combining a pointer image with the detected pointer position of the scaled input image;
Projecting means for projecting a projection screen based on the input image based on a composite image obtained by combining the pointer images;
A projection apparatus according to any one of claims 1 to 4.
<Claim 6>
Computer
Calculation means for calculating a scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen;
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the scaling factor calculated by the calculating means;
Obtaining means for obtaining coordinates of a position designated by the pointing device on the projection screen;
Detecting means for detecting the coordinates of the pointer on the projection screen based on the input image based on the coordinates acquired by the acquiring means for the number of frames set by the setting means;
Program to function as.

100 Projection System 1 Projection Device 10 CPU
11 ROM
11a Program 11b Filter number acquisition table 12 RAM
12a Filter number setting area 12b Coordinate data storage area 13 Video signal input unit 14 Light irradiation device 15 Display element 16 Projection lens 17 Lens control unit 18 Wireless communication unit 19 Audio device 101 Key input unit 102 USB controller 2 Pointing device 20 Control unit 21 Optical sensor 22 Operation unit 23 Wireless communication unit 3 Screen 31 Projection screen 32 Cursor 4 PC

Claims (6)

Calculating means for calculating a scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen;
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the scaling factor calculated by the calculating means;
Obtaining means for obtaining coordinates of a position designated by the pointing device on the projection screen;
Detecting means for detecting the coordinates of the pointer on the projection screen based on the input image based on the coordinates acquired by the acquiring means for the number of frames set by the setting means;
A projection apparatus comprising:   The detection means averages the coordinates acquired by the acquisition means for the number of frames set by the setting means, and detects the averaged coordinates as coordinates of a pointer on a projection screen based on the input image. Item 4. The projection device according to Item 1.   The projection apparatus according to claim 1, wherein the setting unit sets the number of frames more than a predetermined reference when the scaling magnification is downscaling.   The projection device according to any one of claims 1 to 3, wherein the setting means sets the number of frames to be smaller than a predetermined reference when the scaling factor is upscaling. Scaling means for scaling the input image by the calculated scaling factor;
Combining means for combining a pointer image with the detected pointer position of the scaled input image;
Projecting means for projecting a projection screen based on the input image based on a composite image obtained by combining the pointer images;
A projection apparatus according to any one of claims 1 to 4. Computer
Calculation means for calculating a scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen;
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the scaling factor calculated by the calculating means;
Obtaining means for obtaining coordinates of a position designated by the pointing device on the projection screen;
Detecting means for detecting the coordinates of the pointer on the projection screen based on the input image based on the coordinates acquired by the acquiring means for the number of frames set by the setting means;
Program to function as.

Images