JP6500974B2 - Detection apparatus, detection method and program - Google Patents

Description

The present invention relates to a detection device, a detection method, and a program.

  2. Description of the Related Art Conventionally, there is known a system in which, when a user points on a projection screen projected on a screen or the like with a pointing device, the coordinates of the indicated position are acquired and processing is performed according to the indicated position. In such a system, techniques have been proposed to make it easy to set the pointer to the position intended by the user.

  For example, in Patent Document 1, when the difference between the coordinates of the pointer of the pointing device and the coordinates of the selection target such as an icon on the projection screen is within a predetermined range, the coordinates of the pointer are converted to the coordinates of the selection target Thus, there has been described a technology capable of automatically guiding a pointer to a selection object intended by the user (see, for example, Patent Document 1).

JP, 2013-77226, A

  By the way, in the projection apparatus, when the resolution of the input image (the total number of pixels of the image) and the resolution of the projection screen do not match, the input image is scaled and converted to the resolution of the projection screen before projection. However, when the input image is downscaled (converted to a low resolution) with a scaling factor smaller than 1 and then projected as a projection screen, the icon on the projection screen is displayed small (see FIG. 6). There was a problem that it was difficult to fit. Patent Document 1 does not describe the problem of operability caused by this scaling factor.

  An object of the present invention is to make it easy to put a pointer at a place intended by the user regardless of the scaling factor, and to improve operability.

In order to solve the above-mentioned subject, a detection device according to claim 1 is
A setting unit on the basis of the resolution and the display surface of the input image resolution, sets the number of frames to be used for detecting the position of the pointer on the projection screen based on the entering force image,
Acquisition means for acquiring coordinates of a position designated by a pointing device on the display surface;
A detection unit that detects coordinates of a pointer on a display surface based on the input image based on the coordinates acquired by the acquisition unit for the number of frames set by the setting unit;
Equipped with

  According to the present invention, regardless of the scaling factor, the pointer can be easily placed at the place intended by the user, and operability can be improved.

It is a figure showing an example of whole composition of a projection system concerning an embodiment of the present invention. It is a block diagram which shows the functional structure of the projection apparatus of FIG. It is a block diagram which shows the functional structure of the pointing device of FIG. It is a flowchart which shows the projection control processing performed by CPU of FIG. It is a flowchart which shows the number setting process of filters performed in FIG.4 S1. It is a figure which shows an example of the projection screen which downscaled and projected the input image to the output resolution of a projector. It is a figure which shows an example of the projection screen which projected the input image without scaling processing. It is a figure which shows an example of the projection screen which upscaled and projected the input image to the output resolution of a projector.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are subject to various technically preferable limitations for practicing the present invention. Therefore, the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[Configuration of Projection System 100]
FIG. 1 is a view showing the overall configuration of a projection system 100 according to the present invention. The projection system 100 includes a projection device 1, a pointing device 2, a screen 3, and a PC (Personal Computer) 4. The projection system 100 projects an image based on a video signal output from the PC 4 onto the screen 3 as the projection screen 31 by the projection device 1. On the screen 3, a cursor 32 (pointer image) indicating the position of the pointer on the projection screen 31 is displayed. The cursor 32 is one synthesized with the image input from the PC 4 by the projection device 1 in accordance with the position indicated by the pointing device 2, and is moved according to the operation of the pointing device 2 by the user.

[Configuration of Projection Device 1]
FIG. 2 is a block diagram showing a functional configuration of the projection device 1. As shown in FIG. 2, the projection device 1 includes a central processing unit (CPU) 10, a read only memory (ROM) 11, a random access memory (RAM) 12, a video signal input unit 13, a light irradiation device 14, and a display element 15. A projection lens 16, a lens control unit 17, a wireless communication unit 18, an audio device 19, a key input unit 101, a USB controller 102, and the like are provided.

  The CPU 10 reads the program 11a stored in the ROM 11, expands it in the work area of the RAM 12, controls each part according to the program, and executes various processes including the projection control process and the filter number setting process described later. . The CPU 10 functions as a scaling unit and a combining unit by executing the projection control process. Also, by executing the filter number setting process, it functions as a calculation means, a setting means, and a detection means. The CPU 10 also functions as an acquisition unit in cooperation with the wireless communication unit 18.

The ROM 11 stores a program 11a corresponding to the projection device 1, data used by these programs, and the like. The program 11a includes a program for executing projection control processing and filter number setting processing described later.
In addition, the filter number acquisition table 11 b is stored in the ROM 11. The filter number acquisition table 11b will be described later.

  The RAM 12 forms a temporary storage area for the program 11a, input or output data, parameters, and the like in the above-described various processes executed and controlled by the CPU 10. For example, the RAM 12 is a filter number setting area 12a for storing the number of filters (described in detail later) set in the filter number setting process described later, and a coordinate data storage area for sequentially storing coordinate data acquired from the pointing device 2 Form 12b.

  The video signal input unit 13 includes, for example, video input terminals such as an HDMI (registered trademark) terminal, an RGB terminal, and a DVI terminal, and receives video signals such as RGB signals and video signals input from the PC 4 via the video input terminal. It is converted into image data (input image) and audio data of a predetermined standard, and is output to the CPU 10.

  The light irradiation device 14 receives light (eg, infrared light) other than visible light (eg, red light), G (green light), B (blue light), and visible light according to a control signal output from the CPU 10, for example. ) Is emitted cyclically. The display element 15 is irradiated with the R, G, B primary color light and infrared light from the light irradiation device 14.

The display element 15 is, for example, a micro mirror element having a plurality of micro mirrors (1024 horizontal pixels × 768 vertical pixels in the case of XGA) arranged in an array. The display element 15 forms an optical image by the reflected light by displaying the image by turning on / off the tilt angle of each micro mirror at high speed according to the control signal output from the CPU 10.
The display element 15 forms a light image based on the input image when the primary color light is irradiated, and when the infrared light is irradiated, the position where the gradation is different according to the coordinate position of the projection screen 31 A light image for projecting a detection image pattern is formed.

The projection lens 16 projects the light image formed by the display element 15 onto the screen 3 in accordance with a predetermined magnification determined at the optical zoom position of the projection lens 16. By projecting the light image on the screen 3, the input image and the position detection image are displayed as the projection screen 31 on the screen 3. In addition, since the image for position detection is formed of infrared light, it is invisible to human eyes.
The lens control unit 17 controls the projection lens 16 to perform zooming and focusing.
The light irradiation device 14, the display element 15, the projection lens 16, and the lens control unit 17 function as projection means.

  The wireless communication unit 18 communicates with the pointing device 2 in accordance with the control signal output from the CPU 10.

  The audio device 19 includes a D / A converter, an amplifier, a speaker, and the like, converts an audio signal of a video signal into an analog signal by a D / A converter according to a control signal output from the CPU 10, and determines the analog audio signal by an amplifier. Amplified to the volume of and output as sound from the speaker.

  The key input unit 101 includes a plurality of operation buttons and the like, and outputs a user operation signal to the CPU 10.

  The USB controller (Universal Serial Bus) 102 communicates with the USB controller of the PC 4 and transmits coordinate data (called pointer coordinate data) of pointer detected based on coordinate data received from the pointing device 2 and operation data to the PC 4 Send.

[Configuration of pointing device 2]
FIG. 3 is a block diagram showing a functional configuration of the projection device 1. As shown in Figure 3,
The pointing device 2 includes a control unit 20, an optical sensor 21, an operation unit 22, a wireless communication unit 23, and the like.

  The control unit 20 is configured of a CPU, a ROM, a RAM, and the like. The CPU of the control unit 20 reads a program stored in the ROM, expands it in a work area of the RAM, and controls each unit according to the program.

  The light sensor 21 receives infrared light corresponding to the position detection image projected on the screen 3, generates an electric signal according to the intensity of the received infrared light, and outputs the electric signal to the control unit 20. The control unit 20 generates coordinate data indicating position coordinates designated by the pointing device 2 based on the electrical signal from the light sensor 21, and transmits the coordinate data to the projection device 1 by the wireless communication unit 23.

  The operation unit 22 includes, for example, a right button, a left button, and the like, and outputs an operation signal of each button to the control unit 20. The control unit 20 associates the operation data of each button with the coordinate data according to the timing when the operation signal is input based on the operation signal of each button from the operation unit 22 and causes the wireless communication unit 23 to use the projection device 1 Send to

  The wireless communication unit 23 communicates with the projection device 1 according to the control signal output from the control unit 20.

[Configuration of PC 4]
The PC 4 is a computer device provided with a CPU, a ROM, a RAM, an operation unit, a display unit, a storage unit, a video signal output unit, a USB controller, and the like. The CPU of the PC 4 causes the display unit to display an image based on the video signal according to a program stored in the ROM, and outputs the video signal to the projection device 1. Further, based on pointer coordinate data and operation data received from the projection device 1 via the USB controller, processing corresponding to operation of an icon or the like on the projection screen 31 is executed.

[Operation of Projection Device 1]
Next, the operation of this embodiment will be described.
FIG. 4 is a flowchart of the projection control process executed by the CPU 10 of the projection device 1. The projection control process is executed by the cooperation of the CPU 10 and the program 11 a stored in the ROM 11 when the input of the input image is started.

First, the CPU 10 executes a filter number setting process (step S1).
FIG. 5 shows a flowchart of the filter number setting process executed in step S1 of FIG. The filter number setting process is executed by the cooperation of the CPU 10 and the program 11a.

  In the filter number setting process, the CPU 10 first acquires the resolution of the input image (step S101). The resolution herein does not refer to the density of pixels in an image, but to the total number of pixels of the image (the number of pixels in the vertical direction of the image × the number of pixels in the horizontal direction of the image).

  Next, the CPU 10 acquires the resolution of the projection screen 31, that is, the output resolution of the projection device 1 (the resolution of the display element 15) (step S102).

  Next, the CPU 10 calculates a scaling factor based on the resolution of the input image and the output resolution of the projection device 1 (step S103). As used herein, scaling refers to increasing or decreasing the number of pixels of an input image (resolution conversion). The scaling factor refers to the scaling factor of the number of pixels. If the number of pixels is not increased or decreased, the scaling factor is 1x.

Next, the CPU 10 reads the number-of-filters acquisition table 11b stored in the ROM 11, acquires the number of filters according to the scaling factor calculated in step S103 (step S104), and sets the acquired number of filters as the number of filters in the RAM 12. The area 12a is set (step S105), and the process proceeds to step S2 in FIG.
The number of filters means the number of coordinates (number of frames) used for coordinate averaging when detecting the coordinates of the pointer on the projection screen 31 based on the input image (projecting the input image). The filter number acquisition table 11 b is a table in which the number of filters optimum for the scaling factor is stored in association with the scaling factor. In the number-of-filters acquisition table 11b, based on the number of filters when the scaling ratio is 1, the smaller the number of filters is associated as the scaling ratio is larger than 1, the larger the number of filters is associated as the scaling ratio becomes smaller. It is done.

Here, the relationship between the scaling factor and the number of filters will be described.
FIG. 6 shows an example of a projection screen 31 which is projected by downscaling (reduction of resolution) of the input image to the output resolution of the projection device 1. FIG. 6 shows the projection screen 31 when the input image of 1600 × 1200 pixels is downscaled to 1024 × 768 pixels and projected as an example.
FIG. 7 shows an example of a projection screen 31 obtained by projecting an input image without scaling processing. FIG. 7 shows a projection screen 31 of 1024 × 768 pixels as an example.
FIG. 8 shows an example of a projection screen 31 which is projected by upscaling (resolution increase) of the input image to the output resolution of the projection device 1. FIG. 8 shows, as an example, the projection screen 31 when the input image of 800 × 600 pixels is upscaled to 1024 × 768 pixels.

  As shown in FIG. 6, when the input image is downscaled, the number of pixels such as icons and buttons in the image is also downscaled, and the icons and buttons displayed on the projection screen 31 are also reduced. When the pointing device 2 is used, camera shake is more likely to occur compared to a mouse of a personal computer supported by a desk and capable of stable operation, so it is difficult to set a pointer on a small icon or the like, which causes user stress.

  Coordinate data of position coordinates on the projection screen 31 designated by the pointing device 2 is acquired by the pointing device 2 for each frame of the projection screen 31, transmitted to the projection device 1, and received by the wireless communication unit 18. If this coordinate data is detected as the position of the pointer as it is, the response (followability) of the pointer movement is good, but an error in coordinate acquisition and camera shake are reflected as it is. Therefore, in the projection device 1, the coordinate data acquired in each of the frames set as the number of filters is averaged, and the averaged coordinates are detected as the coordinates of the pointer. The cursor 32 is displayed at the position, and pointer coordinate data is transmitted to the PC 4 together with operation data to execute processing according to the operation. As the number of filters is increased, blurring of the position due to camera shake or the like is alleviated. When the scaling factor is smaller than 1, camera blurring is prevented by increasing the number of filters beyond the reference, and a pointer to the position intended by the user Make it easy to match and improve operability.

  On the other hand, as shown in FIG. 8, when the input image is upscaled, the number of pixels such as icons in the image is also upscaled, and the icons, buttons, etc. displayed on the projection screen 31 become large. When the icon or button is large, it is easy to set the pointer there even if there is some hand movement. On the other hand, when the number of filters is increased, the followability of the pointer with respect to the operation on the pointing device 2 is deteriorated, and the user feels stress. Therefore, in the present embodiment, when the scaling factor is larger than 1, the followability of pointer movement is improved and operability is improved by reducing the number of filters below the reference.

  Returning to FIG. 4, in step S2, the CPU 10 scales the input image with a scaling factor calculated based on the resolution of the input image and the output resolution of the projection apparatus 1 (step S2).

  Next, the CPU 10 acquires coordinate data and operation data transmitted from the pointing device 2 by the wireless communication unit 18 and stores the acquired coordinate data and operation data in the coordinate data storage area 12 b of the RAM 12 (step S3). Here, the coordinate data storage area 12b can store coordinate data for the maximum number of filters stored in the filter number acquisition table 11b in association with the frame number of the frame for which the coordinate data is acquired. In step S3, when the coordinate data stored in the coordinate data storage area 12b exceeds the specified number, the CPU 10 deletes the oldest coordinate data and stores new coordinate data in the coordinate data storage area 12b. Do.

  Next, the CPU 10 performs coordinate averaging with the number of filters set in the filter number setting area 12a, and detects the averaged coordinates as the coordinates of the pointer on the projection screen 31 based on the input image (step S4). For example, the CPU 10 performs coordinate averaging by reading out coordinate data for the number of filters stored in the coordinate data storage area 12b from new ones and calculating an average of each of the x coordinate and the y coordinate. When coordinate data for the set number of filters is not stored in the filter number setting area 12a yet, averaging is performed using the coordinate data stored in the filter number setting area 12a.

  Next, the CPU 10 combines the image of the cursor 32 at the position of the coordinates averaged in step S4 of the scaled input image (step S5), and performs pointing using the coordinate data of the averaged coordinates as pointer coordinate data. It transmits to PC4 via the USB controller 102 with the operation data acquired from the apparatus 2 (step S6). Then, the CPU 10 controls the light emitting device 14, the display element 15, and the lens control unit 17 to project the composite image in which the cursor 32 is composited on the screen 3 as the projection screen 31 (step S7).

Next, the CPU 10 determines whether the next input image (frame) is present (step S8). If it is determined that the next input image exists (step S8; YES), the CPU 10 determines whether the resolution of the input image has been changed (step S9). If it is determined that the resolution of the input image has been changed (step S9; YES), the CPU 10 returns to step S1. If it is determined that there is no change in the resolution of the input image (step S9; NO), the CPU 10 returns to step S2.
On the other hand, when it is determined in step S8 that the next input image does not exist (step S8; NO), the CPU 10 ends the projection control process.

As described above, according to the CPU 10 of the projection device 1, the scaling factor of the input image is calculated based on the resolution of the input image and the resolution of the projection screen, and the scaling factor of the input image is calculated based on the calculated scaling factor. The number of filters, which is the number of frames used when detecting the position of the pointer on the projection screen 31, is set. Then, the coordinates of the pointer on the projection screen 31 based on the input image are detected based on the coordinates for the set number of filters acquired from the pointing device 2. Specifically, the CPU 10 averages the coordinates for the set number of frames, and detects the averaged coordinates as the coordinates of the pointer on the projection screen 31 based on the input image.
Therefore, regardless of the scaling factor, the pointer can be easily placed at the place intended by the user, and operability can be improved.

  For example, when the scaling factor is downscaling, the CPU 10 sets the number of filters larger than a predetermined reference. Therefore, in the downscaled projection screen 31 where icons and the like are displayed small, it is easy to place the pointer at the position intended by the user by alleviating the situation where it is difficult for the user to position the pointer at the place intended by the user. Operation can be improved.

  Also, for example, when the scaling factor is upscaling, the CPU 10 sets the number of filters smaller than a predetermined reference. Therefore, the follow-up property of the pointer movement can be enhanced and the operability can be improved on the up-scaled projection screen 31 in which the icons and the like are displayed large.

  The CPU 10 also scales the input image with the calculated scaling factor, combines the cursor 32 at the position of the pointer of the scaled input image, and projects the projection screen 31 based on the combined image into which the cursor 32 is combined. . Therefore, the position of the detected pointer can be visualized and reflected on the projection screen 31.

  In addition, the description content in the said embodiment is a suitable example of the projection system which concerns on this invention, and is not limited to this.

  For example, in the above embodiment, the pointing device 2 includes the light sensor 21, projects the position detection image formed by the infrared light on the screen 3, and receives the position detection projection image by the light sensor 21. Although it has been decided to acquire the position coordinates designated by the pointing device 2 by doing this, the present invention is not limited to this. For example, the projection device 1 may be provided with photographing means for photographing the projection screen 31 of the screen 3 and position coordinates of the pointing device 2 may be acquired based on the photographed image acquired by the photographing means.

  Further, for example, in the above embodiment, the coordinates of the pointer are detected by averaging the coordinates of the number of filters set by the process of setting the number of filters. The weighting may be performed according to the acquired time (for example, the weight of the newly acquired coordinate may be increased), and the averaging may be performed.

In the above embodiment, the projector 1 is a digital light processing (DLP) (registered trademark) projector using a micro mirror element as an example. However, the present invention is not limited to this. For example, a CRT projector, It may be a projector of another type such as a liquid crystal projector.
In addition, the detailed configuration and the detailed operation of each device constituting the projection system can be appropriately modified without departing from the scope of the invention.

Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the above-described embodiments, and may be determined based on the claims. Furthermore, the equivalent scope which added the change which is not related to the essence of this invention from description of a claim is also included in the technical scope of this invention.
In the following, the invention described in the claims initially attached to the request for this application is appended. The item numbers of the claims described in the appendix are as in the claims attached at the beginning of the application for this application.
[Supplementary Note]
<Claim 1>
Calculating means for calculating a scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen;
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the scaling factor calculated by the calculation means;
Acquisition means for acquiring coordinates of a position designated by a pointing device on the projection screen;
A detection unit that detects coordinates of a pointer on a projection screen based on the input image based on the coordinates acquired by the acquisition unit for the number of frames set by the setting unit;
A projection device comprising:
<Claim 2>
The detection means averages the coordinates acquired by the acquisition means for the number of frames set by the setting means, and detects the averaged coordinates as coordinates of a pointer on a projection screen based on the input image. Item 1. A projection device according to item 1.
<Claim 3>
The projection apparatus according to claim 1, wherein the setting unit sets the number of coordinates more than a predetermined reference when the scaling factor is downscaling.
<Claim 4>
The projection apparatus according to any one of claims 1 to 3, wherein the setting unit sets the number of coordinates smaller than a predetermined reference when the scaling factor is upscaling.
<Claim 5>
Scaling means for scaling the input image by the calculated scaling factor;
Combining means for combining a pointer image at the position of the detected pointer of the scaled input image;
Projection means for projecting a projection screen based on the input image based on the synthesized image obtained by synthesizing the pointer image;
The projection apparatus according to any one of claims 1 to 4, comprising:
<Claim 6>
Computer,
Calculating means for calculating a scaling factor of the input image based on the resolution of the input image and the resolution of the projection screen;
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the scaling factor calculated by the calculation means;
Acquisition means for acquiring coordinates of a position designated by a pointing device on the projection screen;
A detection unit that detects coordinates of a pointer on a projection screen based on the input image based on the coordinates acquired by the acquisition unit for the number of frames set by the setting unit;
Program to function as.

100 Projection system 1 Projection device 10 CPU
11 ROM
11a program 11b filter number acquisition table 12 RAM
12a Filter number setting area 12b Coordinate data storage area 13 Video signal input unit 14 Light irradiation device 15 Display element 16 Projection lens 17 Lens control unit 18 Wireless communication unit 19 Audio device 101 Key input unit 102 USB controller 2 Pointing device 20 Control unit 21 Optical sensor 22 Operation unit 23 Wireless communication unit 3 Screen 31 Projection screen 32 Cursor 4 PC

Claims (7)

Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the resolution of the input image and the resolution of the display surface;
Acquisition means for acquiring coordinates of a position designated by a pointing device on the display surface;
A detection unit that detects coordinates of a pointer on a display surface based on the input image based on the coordinates acquired by the acquisition unit for the number of frames set by the setting unit;
A detection device comprising:   The detection means averages the coordinates acquired by the acquisition means for the number of frames set by the setting means, and detects the averaged coordinates as coordinates of a pointer on a projection screen based on the input image. The detection device according to Item 1. The setting means, if scaling magnification is downscaling, detecting device according to claim 1 or 2 set many than a predetermined reference number the frames. The detection apparatus according to claim 3, wherein the setting unit sets the number of frames smaller than a predetermined reference when the scaling factor is upscaling. Scaling means for scaling the input image by the calculated scaling factor;
Combining means for combining a pointer image at the position of the detected pointer of the scaled input image;
Projection means for projecting a projection screen based on the input image based on the synthesized image obtained by synthesizing the pointer image;
The detection apparatus as described in any one of Claim 3 or 4 provided with. A detection method implemented using a detection device, comprising
Setting the number of frames used when detecting the position of the pointer on the projection screen based on the input image based on the resolution of the input image and the resolution of the display surface;
An acquisition step of acquiring coordinates of a position designated by a pointing device on the display surface;
Detecting the coordinates of the pointer on the display surface based on the input image based on the coordinates acquired by the acquisition step for the number of frames set by the setting step;
Detection methods including: Computer,
Setting means for setting the number of frames used when detecting the position of the pointer on the projection screen based on the resolution of the input image and the resolution of the display surface;
Acquisition means for acquiring coordinates of a position designated by a pointing device on the display surface;
A detection unit that detects coordinates of a pointer on a display surface based on the input image, based on the coordinates acquired by the acquisition unit for the number of frames set by the setting unit;
Program to function as.

Images