JP2007086962A - Screen position indicating system and screen position indicating method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a screen position indicating system which can input an indicated position with less processing load while giving a user a feeling as if the user is operating a computer screen directly. <P>SOLUTION: The screen position indicating system includes; a camera 16 which acquires a moving image of a computer screen projected with a projector 14; a pointer 20 which illuminates an arbitrary position of the projected computer screen; a screen area determination means which determines an area of the projected computer screen in the moving image; a luminescent position determination means which determines the luminescent position, which the pointer 20 shows, in the moving image; and an indicated position determination means which determines an indicated position on the computer screen based on the area in the moving image determined by the screen area determination means and the luminescent position in the moving image determined by the luminescent position determination means. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a screen position instruction system and a screen position instruction method, and more particularly to a screen position instruction system and a screen position instruction method for determining a user instruction position on a computer screen projected on a screen or a wall.

  When performing operations on a computer screen projected by a projector or the like, operation means such as a mouse and a keyboard connected to the computer are often used. For this reason, when performing operations such as moving pages or selecting menus while giving a presentation, it is necessary to return to the computer once in the middle of the presentation and operate the mouse, etc., or ask someone else to operate the mouse. In some cases, this could hinder smooth presentations.

Conventionally, in order to solve such a problem, a laser pointer is provided with a plurality of buttons, and a computer is remotely operated by these buttons (Patent Document 1 below), and a pointer is moved by complicated image processing and position calculation. There is one that specifies the pointing position (Patent Document 2 below).
JP 2000-207122 A JP 2000-200169 A

  However, the former has a difficulty that a feeling that the computer screen is directly operated is difficult to obtain, and the latter has a difficulty that the processing load is large.

  The present invention has been made in view of the above problems, and its purpose is to provide a screen position indicating system capable of inputting an indicating position with a light processing load while giving a feeling that the computer screen is directly operated. And providing a screen position indication method.

  In order to solve the above problems, a screen position indication system according to the present invention includes a camera that acquires an image of a computer screen projected by a projection unit, a pointer that emits an arbitrary position of the projected computer screen, Screen area determination means for determining an area of the projected computer screen in the image; Light emission position determination means for determining a light emission position by the pointer in the image; Area in the image determined by the screen area determination means And indicated position determining means for determining the indicated position on the computer screen based on the light emitting position in the image determined by the light emitting position determining means.

  The screen position indication method according to the present invention includes a screen area determination step for determining an area of the projected computer screen in an image on which the computer screen projected by the projection unit is projected, and a pointer in the image. On the computer screen based on the light emission position determining step for determining the light emission position, the area in the image determined in the screen area determination step, and the light emission position in the image determined in the light emission position determination step. An instruction position determination step for determining an instruction position.

  According to the present invention, a computer screen is projected onto a wall or a screen and the image is taken. Then, the computer screen area is determined from the image. In addition, the user causes the pointer to emit light at an arbitrary position on the projected computer screen. Then, the light emission position is determined from the image. Then, the designated position on the computer screen is determined based on the area of the computer screen in the image and the light emission position by the pointer. The determined indication position is used for updating the computer screen, for example. In the present invention, the indicated position on the computer screen can be determined by a relatively light process of determining the area of the computer screen and the light emission position by the pointer from the image. In addition, since the user directly indicates the projected computer screen with the pointer, the user can feel that the computer screen is directly operated.

  In one aspect of the present invention, the image processing apparatus further includes a unit that is attached to the projection unit and irradiates light having a specific wavelength to a predetermined position in a projection range by the projection unit, and the screen region determination unit includes the identification in the image. An area of the projected computer screen in the image is determined based on the position of the wavelength light. This makes it possible to reliably determine the area of the computer screen.

  In the aspect of the invention, the pointer includes a light emitting element that is projected from the pointer, and a unit that causes the light emitting element to emit light when the light emitting element is pressed. In this way, it is possible to emit light at an arbitrary position on the projected computer screen by pressing a light emitting element protruding from the pointer on a screen or a wall on which the computer screen is projected.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a configuration diagram of a screen position instruction system according to an embodiment of the present invention. As shown in the figure, the screen position instruction system 10 includes a personal computer 12, a projector 14, a camera 16, and a pointer 20. The projector 14 is connected to the display terminal of the personal computer 12 and projects the display screen of the personal computer 12 onto the screen 18. The camera 16 is also connected to the personal computer 12 and generates an image in front of the camera every predetermined time and transmits it to the personal computer 12. In the personal computer 12, a document used for a presentation by the user is stored in advance, and an image of the document is displayed on the display 12 a of the personal computer 12 and supplied to the projector 14. The projector 14 projects an image of this document on the screen 18. Here, the document includes operation objects such as the yes button 18b and the no button 18c, and when these operation objects are clicked on the personal computer 12 using a pointing device such as a mouse, images of other documents are accordingly displayed. Is displayed on the display 12a, and the computer screen is updated. The updated computer screen is projected on the screen 18 by the projector 14.

  Further, in the screen position indication system 10, when the user who makes a presentation holds the pointer 20 in hand and touches the operation object projected on the screen 18 with the tip, the tip of the pointer 20 emits light. This situation is captured by the camera 16 and input to the personal computer 12. The personal computer 12 calculates from the moving image supplied from the camera 16 which position the computer screen projected in the image is located and which position emitted light, and from this, the projected computer screen Which position is pointed to by the user, that is, which position is clicked is determined.

  Here, as shown in FIG. 2, the pointer 20 is provided with a light emitting element 20a such as an LED at the tip, and a switch is attached to the base of the light emitting element 20a. When the light emitting element 20a is pressed against the screen 18 or the like, this switch is turned on and the light emitting element 20a having a predetermined wavelength is turned on. When the screen is separated from the screen 18 or the like, the switch is turned off and the light emitting element 20a is turned off. Thus, the light emission 18e can be generated at an arbitrary position on the projected computer screen 18a. The light emitted from the light emitting element 20a may be invisible light.

  A filter 22 is attached to the light projecting portion of the projector 14. The filter 22 projects light of a predetermined wavelength on the corner of the projection range 18a and prevents light of this wavelength from being projected on the other part. The image is projected onto the screen 18 via 22. The light having the predetermined wavelength is desirably invisible light, for example. When the filter 22 is attached to the light projecting portion of the projector 14, the marker 18d is projected on each corner of the rectangular projection range 18a of the projector 14 on the screen 18.

  In the personal computer 12, the position of the marker 18 d and the position of the light emission 18 e by the pointer 20 are determined from the moving image captured by the camera 16. Here, the camera 16 includes a filter that emphasizes and projects light having a predetermined wavelength centered on the wavelength of light emitted from the light emitting element 20 a of the pointer 20 and the wavelength of light of the marker 18 projected by the filter 22. It is desirable to image the projection range 18a of the projector 14 through this filter. FIG. 3 is a diagram showing one frame of a moving image captured by the camera 16. As shown in the figure, an image showing the position of the marker 18d and the position of the light emission 18e by the pointer 20 is obtained by the personal computer 12 by the camera 16 provided with a filter. Then, the position of the marker 18d is recognized from this image, the projection range 18a of the projector 14 is determined from the shooting range of the camera 16, and the relative position of the light emission 18e by the pointer 20 therein, for example, The position coordinate of the light emission 18e is determined with the upper left corner of the projection range 18a as the origin. Then, it is determined that the position is clicked. If the light emission 18e continuously appears in the moving image, it is determined that the click is continued. Further, when the light emission 18e appears in the moving image and disappears after moving to another location, it is assumed that a so-called drag-and-drop operation has been performed. Updates are made.

  In the screen position indication system 10 according to the present embodiment, by pressing the tip of the pointer 20 to an arbitrary position on the computer screen projected on the screen 18, an arbitrary position on the computer screen can be indicated, which is a very intuitive operation. Can be realized.

  The present invention is not limited to the above embodiment. For example, the laser pointer 30 shown in FIG. 4 may be used to emit light at an arbitrary designated position on the computer screen 18a. The pointer 30 emits a laser beam and can emit an arbitrary position on the screen 18 placed at a distant position. The pointer 30 is provided with a button 30a. When the user presses the button 30a, the wavelength of the emitted light changes, and the color of the light emission 32 at the designated position on the screen 18 changes accordingly. It is supposed to be. Even in this case, the user's designated position on the computer screen can be determined by detecting the light emission position of the predetermined wavelength in the projection range 18a from the moving image taken by the camera 16.

It is a figure which shows the structure of the screen position instruction | indication system which concerns on one Embodiment of this invention. It is a figure which shows a pointer. It is a figure explaining the calculation method of an indication position. It is a figure which shows another pointer.

Explanation of symbols

  10 screen position indicating system, 12 personal computer, 14 projector, 16 camera, 18 screen, 20, 30 pointer.

Claims (4)

A camera for acquiring an image of a computer screen projected by the projection means;
A pointer that emits light at an arbitrary position on the projected computer screen;
Screen area determining means for determining an area of the projected computer screen in the image;
A light emission position judging means for judging a light emission position by the pointer in the image;
An instruction position determination means for determining an instruction position on the computer screen based on an area in the image determined by the screen area determination means and a light emission position in the image determined by the light emission position determination means;
A screen position indicating system characterized by comprising: The screen position indicating system according to claim 1,
Means for attaching light of a specific wavelength to a predetermined position of a projection range by the projection means, attached to the projection means;
The screen area determination means determines the area of the projected computer screen in the image based on the position of light of the specific wavelength in the image.
A screen position indicating system characterized by that. In the screen position indication system according to claim 1 or 2,
The pointer is
A light emitting element projecting from the pointer;
Means for causing the light emitting element to emit light when the light emitting element is pressed,
A screen position indicating system characterized by that. A screen area determination step of determining an area of the projected computer screen in an image in which the computer screen projected by the projection unit is projected;
A light emission position determination step of determining a light emission position by a pointer in the image;
An instruction position determination step for determining an instruction position on the computer screen based on an area in the image determined in the screen area determination step and a light emission position in the image determined in the light emission position determination step;
A screen position indicating method comprising:

Images