JP2000029621A - Computer system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a virtual keyboard and a virtual mouse with excellent handleability in an actual use state with respect to a wearable computer or the like. SOLUTION: A video camera 11 and a head-mounted display 12 are integrated and connected to a computer main body 20. Plural LEDs 41a-41j mounted to the fingers of a user are connected to a computer and driven by appropriate code signals, the images of the LEDs flickering in mutually different patterns are picked up by the video camera and the spatial positions of the respective LEDs are fetched to the computer. The key of the virtual keyboard 100 and the button of the virtual mouse 200 displayed on the screen 12s of a display are accessed by a luminescent point BP corresponding to the spatial positions of the respective LEDs and a desired input operation is performed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a computer device suitable for, for example, a so-called wearable computer worn by a user, and more particularly to information input means.

[0002]

2. Description of the Related Art Conventionally, a graphical user interface (GUI) has been widely used in a desktop computer and a so-called notebook computer, and the information input means corresponding to the GUI has excellent intuitiveness and visibility. Mice are widely used.

On the other hand, a so-called wearable computer is sometimes used mainly for reading out required information in, for example, maintenance of an aircraft.

[0004] This wearable computer is a head-mounted display (hereinafter, referred to as "head-mounted display") mounted on a user's head.
(Sometimes abbreviated as HMD) and a small and portable computer body.

The input of commands or control operations to the wearable computer as described above may be by voice, by a one-handed keyboard or a space mouse, or by a small pointing device incorporated in the computer body.

[0006]

However, in the wearable computer as described above, in the case of input by voice, the computer program understands the voice of the user, and
As a result, the required control is executed, so that the time required for the control is prolonged, and there has been a problem that its accuracy is not yet sufficient.

When a one-handed keyboard, a space mouse, or the like is used, the configuration is made up of three parts: a computer main body, an HMD, and an information input mechanism, and all of them are not necessarily easy to use in actual use. There was a problem. A similar problem arises with a small pointing device built into the computer body.

[0008] When character input is required, it is difficult for a small computer such as a wearable computer or a mobile computer to realize an easy-to-use input mechanism that can physically match the size of the user's finger. there were. Similarly, the pointing device is also easy to use but difficult to realize.

In view of the above, an object of the present invention is to provide a computer device having easy-to-use virtual information input means that replaces a real keyboard or mouse.

[0010]

According to a first aspect of the present invention, there is provided a computer apparatus which moves in a space in response to a user's operation input, and a light-emitting body on the space in which the light-emitting body is located. An image sensor for imaging the illuminant to detect the position, a head-mounted display equipped with the image sensor, and position information of the illuminant based on a video signal from the image sensor. Information input means for inputting to the
Virtual input unit generating and displaying means for generating a virtual input unit and a second virtual input unit of a mouse type and displaying the virtual input unit on the display, and at a position on the screen of the display corresponding to the position information of the light emitter. Mark generating and displaying means for displaying a specific mark, wherein the first position is determined by the position of the mark in the first virtual input section or the second virtual input section.
The input to the virtual input section or the second virtual input section is designated.

In the computer apparatus according to the first aspect of the present invention, the virtual keyboard input unit and the virtual mouse input unit which are as easy to use as a real keyboard are provided by the mark displayed at the position corresponding to the position information of the light emitter. The input operation to the unit is realized, and the use range of the wearable computer or the like is greatly expanded.

A computer device according to a second aspect of the present invention is the computer device according to the first aspect,
The light-emitting body is a plurality of light-emitting diodes, and each light-emitting diode blinks in a different pattern from each other.

In the computer device according to the second aspect of the present invention, a plurality of light emitting diodes can be identified with certainty, and a virtual keyboard input unit and a virtual mouse input unit equivalent to a real keyboard or mouse can be easily formed. Is achieved.

According to a third aspect of the present invention, there is provided a computer device wherein the plurality of light emitting diodes can be mounted on a user's finger.

In the computer device according to the third aspect of the present invention, when the user moves his / her finger, the luminous body attached to the finger can be freely displaced, and the usability in an actual use state can be improved. Is significantly improved.

According to a fourth aspect of the present invention, there is provided a computer device according to the first aspect,
The electronic camera is a semiconductor imaging device type camera.

In the computer apparatus according to the fourth aspect of the present invention, a small and lightweight semiconductor imaging device type camera is integrally formed with a head-mounted display and can be mounted on a user's head, so that the camera can be used in actual use. Usability is improved.

According to a fifth aspect of the present invention, there is provided a computer device according to the first aspect,
The virtual input section generation / display means selectively displays a plurality of rows of keys of the first virtual input section line by line.

In the computer device according to the fifth aspect of the present invention, a desired key can be securely accessed at the time of input using the virtual keyboard.

[0020]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment in which a computer device according to the present invention is applied to a wearable computer will be described below with reference to FIGS.

[Structure of Embodiment] FIG. 1 shows a mechanical structure of an embodiment of the present invention, and FIG. 2 shows an electric structure thereof.

In FIG. 1, a wearable computer includes a head mounted on a user's head K, a computer main body 20, and left and right hands HL and H for input operations.
And a light emitting unit 40 mounted on the fingertip of R.

The mounting head 10 is formed integrally with a video camera 11 using a CCD image pickup device and a head mounted display (HMD) 12 using a liquid crystal display device. Is connected to the computer main body 20. The computer main body 20 may be a notebook type or a wearable computer in which a monitor of a large liquid crystal display element is viewed from the notebook type.

The light emitting section 40 includes ten light emitting diodes (LEDs) 41a, 41b,..., 41j.
Connected to 0.

Each of the light emitting diodes 41a to 41j emits, for example, infrared light, is formed into a ring shape, and can be mounted on ten fingers of both hands. Moreover, it can also be integrally formed in a glove shape.

In the video camera 11 according to this embodiment, the infrared cut filter which is usually mounted is removed corresponding to the light emitting section 40 as described above.

Then, the image of the light-emitting unit 40 captured by the video camera 11 is supplied to the computer 20 and subjected to the processing described below, and the image output from the computer 20 is displayed on the HMD 12.

As shown in FIG.
Comprises a CPU 21, a ROM 22, and a RAM 23,
Each is connected to the system bus 24. ROM22
Has a BIOS (Basic I / O System)
The RAM 23 is mainly used as a work area for calculation.

A hard disk drive (HDD) 25 for auxiliary storage, a floppy disk drive 26 and a CD-ROM drive 27 are connected to the system bus 24, and a code generation / drive circuit 31 and a video capture circuit 32 are connected to the system bus 24. And a graphic accelerator (video card) 33, and a display signal processing circuit 34 is connected to the graphic accelerator 33.

The code generation / drive circuit 31 includes a light emitting section 4
The ten light emitting diodes 41a to 41j of 0 are connected via a cable 42, for example, as shown in FIG.
Zero kinds of code signals are supplied from the code generation / drive circuit 31 to the light emitting diodes 41a to 41j.

The video capture circuit 32 is supplied with video signals of the light-emitting diodes 41 a to 41 j from the video camera 11.

The display signal processing circuit 34 has an HMD
12 is connected, and the display signal processing circuit 34 displays a graphic image so as to be suitable for display on the HMD 12.
The signal supplied from the accelerator 33 is processed.
Therefore, the display signal processing circuit 34 includes a microcomputer, an LCD drive circuit, and the like (not shown).

A DC power supply circuit 2
8 supplies a predetermined power.

The code generating / driving circuit 31 and the display signal processing circuit 34 can be constituted as external devices of the computer main body 20, but for simplicity, FIG.
Then, it is configured as an internal device of the computer main body 20. Also, illustration of an interface or a port interposed between the bus 24 and each component is omitted.

As described above, the code generation / drive circuit 31
Is configured as an external device of the computer main body 20, together with a small battery such as a lithium battery and the light emitting diodes 41a to 41j, for example, by integrally forming a glove shape, the connection cord is unnecessary, and Can be eliminated.

[Imaging Processing] Next, the imaging processing according to the embodiment of the present invention will be described with reference to FIGS.

In this embodiment, the code generation / drive circuit 31 includes, for example, a common header pattern "110" and different address patterns "0110" to "1011" as shown in FIG. Ten kinds of code signals are generated and supplied to the light emitting diodes 41a to 41j of the light emitting unit 40.

For example, as shown in FIG.
When the code “101” is supplied to the light emitting diode 41a, the light emitting diode 41a is turned on when the code is “1” and is turned off when the code is “0”.

In this embodiment, the light emitting diode 41
When the blinking patterns of the light-emitting diodes 41a to 41j are captured by performing an electric “panning shot” when the blinking patterns of the light-emitting diodes 41a to 41j are captured by the video camera 11,
The image is captured as a vertical spatial pattern as shown in FIG.

The blinking pattern of the light emitting diode 41a corresponding to the code "1101101" as shown in FIG. 3A starts from the leftmost bright spot BPa as shown in FIG. It is imaged as a spatial pattern consisting of points.

Similarly, "1" as shown in FIG.
Light emitting diode 4 corresponding to the code “101011”
The blinking pattern 1j is imaged as a spatial pattern consisting of five vertically arranged bright points starting from the rightmost bright point BPj as shown in FIG.

When shooting the above-mentioned blinking pattern,
The blinking cycle of the light emitting diode is set to, for example, 4H (horizontal period) on and 4H off blinking, and the cycle of the vertical transfer pulse for panning is set to 2H, thereby avoiding erroneous pattern recognition due to synchronization deviation. be able to.

From the code generation / drive circuit 31 of the computer main body 20, the ten kinds of codes having different patterns as described above are output from the light emitting diode 41 of the light emitting section 40.
a to 41j, the light emitting diode 4
The blinking patterns of 1a to 41j are different from each other.

As a result, in the input processing described later,
Each of the light emitting diodes 41a to 41j (a spatial pattern corresponding to the light emitting diodes 41a to 41j) can be identified in an image obtained by capturing the infrared signal from the light emitting unit 40 with the video camera 11. Since the code shown in FIG. 3 uses 4 bits for the address, up to 16 LEDs can be identified.

The light emitting diodes 41a to 41j
Is identified by the coordinates of each of the bright points BPa, BPb,..., BPj from the left end to the right end of the top row shown in FIG.

In FIG. 4, for the sake of simplicity, the bright spot arrays corresponding to the respective light emitting diodes 41a to 41j are also arranged in the horizontal direction, but as described above, they are formed into a ring shape or a glove shape. In general, when worn on ten fingers of both hands, the bright spot rows are not aligned in the horizontal direction.

The code corresponding to the above blinking pattern is supplied through a serial port (RS232C), but a required code can be supplied through a USB port, a parallel port, or the like.

The video camera 11 based on the panning described above
Is captured by the video capture circuit 32 of the computer main unit 20 at a video frame period. That is, each frame is taken in as a digital data file, and C
The signal processing is performed by the PU 21 and each light emitting diode 41 is processed.
Position detection and individual identification of the planes a to 41j are performed, and the positions of the left and right fingers can all be specified.

In this case, a general-purpose capture card is used as the video capture circuit 32. Processing functions dedicated to the detection of the spatial position of each light emitting diode and the individual identification are mounted on the video capture circuit 32. If the position information of each light emitting diode is transmitted to the CPU 21, the load on the CPU 21 is reduced, and the processing speed is improved.

[Input Operation Using Virtual Keyboard]
The input operation using the virtual keyboard according to the embodiment of the present invention will be described with reference to FIGS.

As shown in FIG. 5, in this embodiment,
GU is displayed on the screen 12s of the head mounted display.
The virtual keyboard 100F as I is displayed.

On the screen 12s of the display,
An input character display area 101 of an appropriate application is set.

The virtual keyboard 100F of this embodiment
For example, similarly to a standard IBM English type desktop personal computer, for example, a function / character key group 110, a simultaneous press key group 120, a control key group 130, a cursor movement key group 140.

It is assumed that the numeric keypad is not displayed due to the display space of the screen 12s.

In this embodiment, the simultaneous pressing key group 12
0 is composed of five keys such as a “Tab” key 121, a “CapsLock” key 122, a “Shift” key 123, a “Ctrl” key 124, and an “Alt” key 125. The function / character key group 110 is provided at a location away from the group.

Further, "Tab", "Capsloc"
Each of the keys "k", "Ctrl" and "Alt" is a toggle key having a function of displaying to the user whether it is currently valid or invalid.

In this embodiment, a row selection key group 150 is provided. The row selection key group 150 has six keys 1 corresponding to the function / character key group 110 having a six-row configuration.
It consists of 51-156.

In the above-described virtual keyboard 100F, the bright spots BPL and BPR corresponding to the light emitting diodes mounted on the fingers of the left and right hands of the user enter (access) areas such as appropriate character keys. Thus, equivalently, the character key or the like is depressed, and keyboard input becomes possible.

For this input, ten bright points corresponding to all the right and left fingers can be used, or only one bright point corresponding to one finger can be used.

As shown in FIG. 5, in this embodiment,
By arranging the simultaneous pressing key group 120, the control key group 130, and the cursor moving key group 140 apart from the function / character key group 110 and configuring them in two rows or one column, the bright spots BPL and BPR are improved. Have direct access.

A six-line function / character key group 110
, A row selection key group 150 is provided, and six keys 1
By selecting one of the keys 51 to 156, for example, the third key 153 shaded in FIG. 5 with the bright spot BPL of the left hand as shown by the dashed arrow, the function / character key group 110 is displayed. Either row, for example, the third row (Q, W, {
‥) becomes selectable as shown by hatching in FIG. 5, and by accessing a desired key with a bright spot BPR of the right hand,
The key can be activated.

In this case, the activated key can be easily recognized by the user by changing the color of the key top.

Then, as shown by the dashed arrow in FIG.
When the “Shift” key 123 is accessed and this key 123 is activated as shown by the shaded area, the characters on the third line of the function / character key group 110 are capitalized, or the symbol at the top is input. Then, it is appropriately displayed in the input character display area 101.

In the virtual keyboard 100F as described above, the key arrangement that allows direct access and the line selection for the function / character key group having a multi-line configuration allow, for example, a function / character key input at the time of keyboard input. In accessing a desired key of the character key group 110, even if the user crosses over another key, the other key can be clearly distinguished from the desired key.

The virtual keyboard 100 as described above
In F, the display of the virtual keyboard can be made the same as what is actually input, corresponding to the selection of uppercase / lowercase, which is toggled by the “Shift” key and the “Capslock” key on the standard keyboard. .
In addition, “;” and “ten” may display only one of the corresponding symbols, or may simultaneously display them. You can also make it stand out.

Then, the "Ctrl" key 124 and the "Al
Since the “t” key 125 can be maintained in an activated state independently, the “Delete” key of the control key group 130 is further added.
By activating the "e" key, a system reset input operation on an IBM personal computer is performed.
“Ctrl” + “Alt” + “Delete” is also possible.

Further, the size of the font displayed on the virtual keyboard can be set to a size that is easy for the user to use.

The type of font displayed on the virtual keyboard can be selected.

The font displayed on the virtual keyboard can be the one currently selected by the OS (basic software).

[Input Operation Using Another Virtual Keyboard] The keyboard 100F as shown in FIG. 5 can be used as an extension of a standard keyboard, but occupies a large area on the screen of the display. Thus, the input character display area 101 of the application becomes narrow.

As shown in FIG. 6, by sequentially displaying each line of the virtual keyboard, the input character display area of the application can be enlarged.

That is, in FIG. 6, a virtual keyboard 100A as a GUI is displayed on the screen 12s of the head mounted display.

An input character display area 101 for an appropriate application is set on the display screen 12s.

In the virtual keyboard 100A shown in FIG.
Similar to the virtual keyboard 100F shown in FIG. 5, the simultaneous pressing key group 120 includes a “Tab” key 121 and a “Ca” key.
“psLock” key 122 and “Shift” key 12
3, five keys such as a "Ctrl" key 124 and an "Alt" key 125, which are arranged at the left end on the screen 12s.

In the virtual keyboard 100A,
Two keys 157, "row up" and "row down"
158 is provided at the lower left end of the screen 12s.

The "row up" key 157 or the "row down" key 158 is selected, for example, by the bright spot BPL on the left, and can sequentially display each row of the virtual keyboard 100A. Then, the desired key in the selected and displayed row can be accessed by the right hand bright spot BPR.

Then, "row up" or "row down"
Regardless of the up / down instruction by the keys 157 and 158, the simultaneously pressed key group 120 is always displayed on the screen 12s.

FIG. 6 shows the function / character key group 110 described above.
The third line 113 of the character “Q, W, E $” is displayed, indicating that the character can be selected. In this state, the desired one key can be accessed and activated by the right hand bright spot BPR.

As shown by the broken line arrow in FIG.
When the “shift” key 123 is accessed and this key 123 is activated, as indicated by shading, the function
The characters "Q, W, $" in the third line 113 of the character key group 110
“‥” is displayed in the input character display area 101 as appropriate in upper case or by inputting the upper symbol.

At the time of this key input, the bright spots B of the left and right hands
PL and BPR are identified by the address, and the bright spot B on the left hand
PL is "row up" and "row down" key 157,1
By limiting the function so that only 58 is activated, key input errors can be reduced.

Then, as shown in FIG. 6, “Q, W, E
In the state where the third line 113 of the character “‥‥” is displayed, by accessing the “line down” key 158 with the bright spot BPL on the left and activating it, as shown in FIG.
“A, S, D ‥‥” of the function / character key group 110 described above
Is switched and displayed.

The virtual keyboard 100F, 1 as described above
When inputting at 00A or the like and using three or more light emitting diodes, for example, five light emitting diodes each attached to the left and right fingers, a plurality of light emitting diodes overlap and can be distinguished. It may go against the purpose of the present invention to make full use of the individual identifiable points of the light emitting diode.

In this case, when the application is started,
First, set the number of light emitting diodes used by software, such as counting all light emitting diodes on the screen, and release the key input mode when that number of keys disappears on the screen, for example, The user is visually recognized by displaying a warning or erasing the entire virtual keyboard.

If the characteristic value of the light emitting diode is detected and measured at the time of counting, errors due to noise or the like can be extremely reduced.

Further, double pressing of a key and the like are excluded. For example, replace the "Tab" key with a latch function,
Because it has been changed from usage such as double push.

Then, when an overlap of the light emitting diodes occurs, the key input is not accepted, and when the address of the light emitting diode cannot be specified, a warning is displayed. However, the absolute number of currently detected keys is not particularly managed. When a light emitting diode with a valid address is detected, key input is valid.

As described above, in this embodiment, it is possible to realize virtual keyboard input means which is used in a normal desktop computer and which is as easy to use as a real keyboard, and can be used in a wearable computer or the like. Can be greatly expanded.

[Input Operation Using Virtual Mouse] Next, FIG.
The input operation using the virtual mouse according to the embodiment of the present invention will be described with reference to FIGS.

In this embodiment, a virtual mouse 200 as shown in FIG. 8 is displayed on the screen of the head-mounted display as a GUI. This virtual mouse 200
Is a pointer section 201, a mouse movement button 202,
A left down lock button 203, a left button 204,
A right button 205 and a right-down lock button 206 are provided.

Then, as shown in FIG. 8A, when the bright spot BP which is a display mark corresponding to the light emitting diode mounted on the user's finger is outside the area of the virtual mouse 200,
The virtual mouse 200 has not been activated.

A. Movement of the Whole Mouse As shown in FIG. 8A, the inactive state in which the bright spot BP is outside the area of the virtual mouse 200 is changed to the bright spot BP in the area of the mouse 200, for example, the position shown by the dotted line BPt in FIG. When the mouse is moved, the virtual mouse 200 is activated, and is displayed to the user, for example, by highlighting the entire area.

Then, the bright spot BP is moved to the end of the mouse movement button 202, and equivalently, the mouse movement button 2
By pressing down 02, the entire mouse 200 can be moved. The shape of the mouse moving button 202 is preferably circular (or a polygon close to a circle).

The activation display as described above is used only for the recognition of the user, and is not directly related to the substantial movement of the mouse.

B. Left Button Click As shown in FIG. 8B, the left button 204 is moved back and forth once between the area of the left button 204 and the area of the mouse 200 while keeping the bright spot BP within the area of the mouse 200.
Corresponds to a single click. In the case of two clicks, this click operation is performed twice within a predetermined time.

C. Object Drag While Holding Left Button Down As shown in FIG. 8C, by moving the bright spot BP to the area of the lock button 203 left down, equivalently, the left button of the mouse 200 is kept pressed down. And
The virtual mouse 200 is moved using the mouse movement button 202 as described in the above section a. The ON / OFF of the push-down lock button 203 is a toggle operation.

D. Mouse Right Button Click While the luminescent spot BP is within the mouse 200 area, the mouse is reciprocated once between the area of the right button 205 and the area of the mouse 200, so as to correspond to the single click of the right button 205. In the case of two clicks, this click operation is performed twice within a predetermined time.

E. Object drag while holding down the right button By moving the bright spot BP to the area of the lock button 206 by pressing down the right button, equivalently, the right button of the mouse 200 is kept pressed. Then, as in the above item a,
The movement is performed using the mouse movement button 202.

Note that the ON / OFF of the push-down lock button 206 is a toggle operation. The object dragging while holding down the right button is not used in the IBM personal computer.
The possibility is shown in correspondence with the term.

As shown in FIG. 9, a virtual mouse 200 as described above is displayed on the display screen 12s, for example,
As shown in FIG. 6 described above, the virtual keyboard 100L is displayed together with the virtual keyboard 100L having an “L” shape.

In this case, similar to a normal desktop personal computer, for example, a specific position (default position) 200d on the screen as shown by a dotted line in FIG.
At any time, the cursor can be moved to a desired position only when necessary, and returned to the default position again after a certain period of time.

[0101] The virtual mouse 200 is
Its shape must be relatively large. Therefore, if the mouse 200 remains at the position where the mouse 200 is moved when the cursor is moved, the screen is unsightly.
When the bright spot BP corresponding to the light emitting diode mounted on the user's finger comes out of the area of the virtual mouse 200, or a little after passing out of the area of the virtual mouse 200, the default position 200d By returning to, the visibility of the screen is improved.

Further, as shown in FIG. 10, the shape of the virtual mouse can be changed to a smaller icon 200i a predetermined time after the cursor returns to the default position.

In this case, the icon 2 visually recognized by the user
00i may be set appropriately, and the functional region 202i corresponding to the light emitting diode mounted on the user's finger and accessed by the bright spot BP is equivalently circular.

As described above, according to this embodiment, it is possible to realize virtual mouse input means which is used in a normal desktop computer and is as easy to use as a real mouse, and can be used in a wearable computer or the like. Can be greatly expanded.

[Other Embodiments] In the above embodiment, the case where the present invention is applied to a virtual keyboard and a virtual mouse has been described. However, the present invention is not limited to the above embodiment. For example, an entirely new input algorithm can be realized by attaching the light emitting unit to the hand of the signer.

[0106]

As described above, according to the first aspect of the present invention, it is possible to realize a virtual keyboard input unit and a virtual mouse input unit which are as easy to use as a real keyboard.

Further, according to the second aspect of the present invention, it is possible to easily realize a virtual keyboard input unit and a virtual mouse input unit equivalent to a real keyboard and mouse.

According to the third aspect of the present invention, the usability in an actual use state can be remarkably improved.

According to the fourth aspect of the present invention, the usability in an actual use state can be improved.

According to the fifth aspect of the present invention, a desired key can be securely accessed at the time of input using the virtual keyboard.

[Brief description of the drawings]

FIG. 1 is a conceptual diagram showing a mechanical configuration of an embodiment of a computer device according to the present invention.

FIG. 2 is a block diagram showing an electrical configuration of the embodiment of the present invention.

FIG. 3 is a waveform diagram for explaining an imaging process according to the embodiment of the present invention.

FIG. 4 is a conceptual diagram illustrating an imaging process according to the embodiment of the present invention.

FIG. 5 is a conceptual diagram showing a display state of the virtual keyboard according to the embodiment of the present invention.

FIG. 6 is a conceptual diagram showing another display state of the virtual keyboard according to the embodiment of the present invention.

FIG. 7 is a conceptual diagram showing another display state of the virtual keyboard according to the embodiment of the present invention.

FIG. 8 is a conceptual diagram showing a display state of a virtual mouse according to the embodiment of the present invention.

FIG. 9 is a conceptual diagram showing a display state of a virtual mouse according to the embodiment of the present invention.

FIG. 10 is a conceptual diagram showing a display state of a virtual mouse according to the embodiment of the present invention.

[Explanation of symbols]

Reference Signs List 10: mounting head, 11: video camera, 12: head mounted display (HMD), 12s: display screen, 13: connection cable, 20: computer body,
21 ... CPU, 22 ... ROM, 23 ... RAM, 25 ... Hard Disk Drive (HDD), 26 ... Floppy Disk Drive (FDD), 27 ... CD-ROM Drive, 28 ... DC Power Supply, 31 ... Code Generation / Drive Circuit, 32 ... video capture circuit, 33 ... graphic accelerator,
34: display control / drive circuit, 40: light emitting unit, 41a to 4
1j: Light emitting diode (LED), 100A, 100
B, 100F: virtual keyboard, 100L: virtual keyboard display area, 101: input character display area, 110: function / character key group, 120: simultaneous press key group, 130: control key group, 140: cursor movement key group, 150 ... Line selection key group, 157... Line up key, 158... Line down key, 200... Virtual mouse, 201.
... Mouse move button, 203 ... Left down lock button, 204 ... Left button, 205 ... Right button, 206 ... Right down lock button, BP, BPa to BPj, BP
L, BPR ... bright spot

Claims (6)

[Claims] A light-emitting body that moves in a space in response to a user's operation input; an image sensor that images the light-emitting body in order to detect a position of the light-emitting body in the space; A mounted head-mounted display, position information input means for inputting position information of the illuminant to a computer body based on a video signal from the image sensor, a first virtual input unit of a keyboard type, and a mouse type Virtual input section generation display means for generating the second virtual input section and displaying the same on the display; and displaying a specific mark at a position on the screen of the display corresponding to the position information of the light emitter. Mark generating and displaying means, and the first virtual input unit or the second virtual input unit depends on the position of the mark in the first virtual input unit or the second virtual input unit.
A computer device for designating an input to a virtual input unit of the computer. 2. The computer device according to claim 1, wherein said illuminant is a plurality of light emitting diodes, and each of said light emitting diodes blinks in a different pattern from each other. 3. The computer device according to claim 2, wherein said plurality of light emitting diodes can be mounted on a finger of a user. 4. The computer device according to claim 1, wherein said image sensor is a semiconductor image sensor. 5. The computer device according to claim 1, wherein said virtual input section generating and displaying means is configured to selectively display a plurality of rows of keys one by one as said first virtual input section. Computer device. 6. The computer device according to claim 2, wherein said light emitting diode is an infrared light emitting diode.