JP3355707B2 - Command processing device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a command processing device, and more particularly, to a command processing device which detects a hand movement and controls switching of display data.

[0002]

2. Description of the Related Art Conventionally, as a command processing device, for example, a personal computer (hereinafter abbreviated as a personal computer) or a word processor (Word P-roc) has been used.
essor; hereinafter, abbreviated as word processor), etc., usually uses a keyboard, and a process corresponding to a key command input from the keyboard, for example, a page switching process is executed by a personal computer, a word processor, or the like, and the processing result is obtained. Is displayed on the display device.

However, when the information to be displayed has a page structure and there are a plurality of pages as information, it is not possible to simultaneously display and output all pages on the display device.

[0004] Therefore, it is necessary to switch the page to display and output. Conventionally, page switching is performed by inputting a key command for page switching from a keyboard.

In recent years, personal computers and word processors that display icons on a display device and switch pages by operating the icons with a pointing device such as a mouse have appeared.

[0006]

However, in such a conventional command processing device, a page switching command is input using a keyboard or the like, or page switching is performed by an icon displayed on a display device. Therefore, each time a page is switched, it is necessary to perform a key input or to operate an icon with a pointing device, and there is a problem that the page switching operation is troublesome.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a command processing device capable of easily performing display data switching control by a series of hand movements.

[0008]

SUMMARY OF THE INVENTION A command processing device according to the present invention recognizes an input hand image and compares whether the image corresponds to an initial pattern image stored in advance, and an initial pattern image. In the case where the first finger shift corresponds to the first finger shift detection mode, the first finger shift value and the second finger shift value are detected.
A command generation means for generating a first display control command when the displacement of the second finger is larger than the displacement of the first finger, and a second display control command when the displacement of the second finger is larger than the displacement of the first finger; Display control means for controlling display data switching based on the first display control command or the second display control command.

[0009] In this case, the first display control command and the second display control command generated by the command generation means include the display data displayed by the display control means on the next page. And a display control command for switching to the previous page.

The detecting means detects the value of the displacement of the little finger and the value of the displacement of the thumb.
The command generating means generates a first display control command when the displacement of the little finger is larger than the displacement of the thumb, and generates a second display control command when the displacement of the thumb is greater than the displacement of the little finger. Is also good.

[0011]

[0012]

According to the command processing device of the present invention, when the input hand image corresponds to the initial pattern image, the mode is entered into the finger movement detection mode, and then the first finger shift value and A second finger shift value is detected, and if the first finger shift is larger than the second finger shift, a first display control command is generated, and the second finger shift is determined by the first finger shift command. By issuing the second display control command when the finger is larger than the finger shift,
Display data switching control can be performed by a series of hand movements.

In this case, the display data can be switched to the next page and the previous page by the first display control command and the second display control command.

Further, the value of the displacement of the little finger and the value of the displacement of the thumb are detected, and when the displacement of the little finger is larger than the displacement of the thumb, the first display control command is issued when the displacement of the thumb is larger than the displacement of the little finger. Alternatively, a second display control command can be generated.

[0015]

[0016]

An embodiment will be described below with reference to the drawings.

FIGS. 1 to 5 show an embodiment of a command processing apparatus according to the present invention.

First, the configuration will be described.

FIG. 1 is an external view of the command processing device 1. The command processing device 1 includes a display unit of a rear projection type display system and a photographing unit using a camera.

That is, in the command processing device 1, the projector 3 and the camera 4 are housed in a box-shaped case 2, and the surface of the box-shaped case 2 is slanted in order to improve visibility and operability. It is an inclined surface. A translucent screen 5 is provided on the obliquely inclined surface of the box-shaped case 2, and information such as characters and images and icon images for various commands are displayed on the screen 5 from the projector 3 in the box-shaped case 2. Is projected from the back and displayed on the screen 5.

The command processing device 1 recognizes the shape of the hand placed on the screen 5 and a series of hand movements,
Perform command processing.

The projector 3 has, for example, a lens, a liquid crystal panel, a light source, and the like arranged in order. The projector 3 projects light from the light source from the back of the liquid crystal panel, and projects display contents of the liquid crystal panel onto the screen 5 via the lens. I do.

The camera 4 is, for example, a CCD (Charge Cou
pled Device) It is composed of a camera etc. and has a screen 5
The upper hand shape and a series of hand movements are photographed.

FIG. 2 is a block diagram of the command processing device 1.

In this figure, the command processing device 1
A camera 4, an image recognition unit 6, an image memory 7, an image processing unit 8, a main memory 9, a display memory 10, a display unit 11, and the like are provided. The display unit 11 is a generic name for the projector 3 and the screen 5 in FIG. It was done.

The camera 4 shown in FIG. 1 sequentially outputs images of the captured hand shape and hand movement to the image recognition unit 6.

The image recognizing section 6 samples the video input from the camera 4 at predetermined timings, recognizes the pattern of the hand shape and a series of hand movements, and stores the pattern image of the recognized hand shape in the image memory. 7 is output.

The image memory 7 stores a plurality of hand-shaped pattern images input from the image recognizing unit 6, and the pattern images stored in the image memory 7 are read out by the image processing unit 8. The image memory 7 stores an initial pattern image of a hand corresponding to a predetermined command, particularly, a page switching command. The initial pattern image is not limited to the one stored in the image memory 7, and may be stored in the main memory 9, for example.

The main memory 9 stores various processing programs executed by the image processing section 8 and also stores system data, various data displayed on the display section 11, and the like.
In particular, the main memory 9 stores various types of page information such as character data and image data in units of pages. As described later, switching of the page of the page information is performed by a command input by hand movement. Image processing unit 8
Do.

The image processing unit 8 controls each unit of the command processing device 1 in accordance with a program stored in the main memory 9 to perform processing as the command processing device 1, in particular,
Based on the shape of the hand photographed by the camera 4 and a series of movements thereof, a page switching process of page information displayed on the display unit 11 is performed.

The display memory 10 has a memory area corresponding to the display area of the display unit 11. When page information and icon information read from the main memory 7 by the image processing unit 8 are sequentially written, the information is displayed. The data is sequentially transferred to the display unit 11 and displayed on the display unit 11.

Although not shown in FIG. 2, the command processing device 1 has an I / O for controlling the transfer of data to and from an external computer or the like, and displays data from the external computer on the display unit 11. May be displayed and output.

Next, the operation of this embodiment will be described.

The command processing device 1 includes various information and icons stored in the main memory 9 and the image memory 7.
Is projected from the projector 3 onto the screen 5 for display and output, and the user of the command processing device 1 uses the icons displayed on the screen 5 to display information displayed on the screen 5. By editing or placing your hand on the screen 5 and changing the shape of your hand,
The page of the page information displayed on the screen 5 is switched.

That is, the user of the command processing device 1 places his / her hand on the screen 5 and switches his / her hand to input the page switching command in order to switch the page of the page information displayed on the screen 5. When the user wants to switch the page to the next page after the shape corresponding to the initial pattern image, move the little finger in a substantially left-right direction or a substantially up-down direction as shown by a broken line and an arrow in FIG. When switching is desired, the thumb is moved substantially in the left-right direction as indicated by the broken line and the arrow in FIG.

The command processing for switching pages based on the hand shape is performed as follows.

That is, as shown in FIG. 5, the command processing device 1 reads the image on the screen 5, in particular, the image of the hand with the camera 4, and the image recognition section 6 reads the image of the hand input from the camera 4. Is fetched at predetermined time intervals as a hand pattern image and output to the image memory 7. The image processing unit 8 writes the pattern image into the address i of the image memory 7 (step S1), and compares the written hand pattern image with an initial pattern image stored in the image memory 7 in advance (step S2). .

If it is determined in step S2 that the read image matches an initial pattern image other than the page switching initial pattern image, the process proceeds to a process corresponding to the initial pattern image command, and the other processes are performed. Is performed (step S3).

If the read hand pattern image does not match any of the initial pattern images stored in the image memory 7 in step S2, the process returns to step S1 and the operation is repeated from the image reading.

In step S2, if the read hand pattern image matches the page switching initial pattern image,
The image processing section 8 performs a page switching response display for displaying and outputting a message indicating that the apparatus has entered the page switching response mode stored in the main memory 9 in advance (step S4).

When the page switching response display is performed, the address value i is incremented by "1" after a predetermined time has elapsed (step S5), the next image is read, and the pattern image of the read image is stored in the image memory. 7 is written and stored in the incremented address i (step S6).

Next, it is checked whether or not the address i has reached a preset value N (step S8).
Is not N, the process returns to step S5,
Similarly, after a predetermined time has elapsed, the next read pattern image is written to the incremented address i (steps S5 to S7).

That is, from step S5 to step S8
In the above process, the hand shape on the screen 5 is fetched as a pattern image at predetermined time intervals, and is sequentially written from the address i to the address N of the image memory 7.

When the address value becomes N in step S8, the pattern images from address i to address N in the image memory 7 are sequentially compared (step S9), and the maximum value of the deviation of the change pattern of the thumb of these pattern images is determined. For example, the moving distance of the thumb when the thumb changes to the position farthest from the position of the image written at the address i is stored in the register t (step S10). Also, the maximum value of the deviation of the change pattern of the little finger of these pattern images, for example, the moving distance of the little finger when the little finger changes to the position farthest from the position of the image written at address i is stored in the register s. It is stored (step S11).

Then, whether the value of the register t is much larger than the value of the register s (t >> s) is compared (step S12), and it is detected whether the thumb has moved or the little finger has moved.

In step S12, when t >> s, that is, when the maximum value of the displacement of the thumb is much larger than the maximum value of the displacement of the little finger, it is determined that the previous page is designated by the thumb. Then, the information of the previous page is read out from the main memory 9 and transferred to the display memory 10 so that the display unit 1
1, that is, the information of the previous page is displayed and output on the screen 5 (step S13). After that, the pattern images from the address i to the address N in the image memory 7 are cleared, and the process ends (step S14).

If it is not t >> s in step S12, it is checked whether t << s, that is, whether the maximum value of the displacement of the little finger is much larger than the maximum value of the displacement of the thumb (step S15). ).

In step S15, when t << s,
That is, when the maximum value of the displacement of the little finger is much larger than the maximum value of the displacement of the thumb, it is determined that the next page has been designated by the little finger, and the information of the next page is read from the main memory 9 and displayed. The display is transferred to the memory 10 and the display of the display unit 11, that is, the screen 5 is switched to the information of the next page and output (step S16). Thereafter, the pattern images from the address i to the address N in the image memory 7 are cleared, and the processing is terminated (step S).
14).

If t << s is not satisfied in step S15, it is determined that neither the thumb nor the little finger has moved sufficiently to instruct page switching, and the address i in the image memory 7 is determined.
After clearing the pattern images from to the address N (step S17), the process returns to step S4, and the same processing as described above is repeated from the page switching response display.

As described above, according to this embodiment,
After placing a hand on the screen 5 and changing the shape of the hand into a predetermined initial pattern image for a page switching command, the thumb or the little finger is moved in a substantially horizontal direction or a substantially horizontal direction according to the page switching direction. And the command processing device 1
Detects the movement of the thumb or the little finger of this hand, switches the page information to the previous page or the next page, and
Display above. As a result, the pages can be easily switched simply by changing the shape of the hand.

In this case, for example, when one page of page information is displayed and output on the screen 5, the page information is switched to the previous page or the next page, and
When page information for two pages is displayed and output on the screen 5, the page information is switched as if turning a page.

In this embodiment, the shape of a human hand is captured by the camera 4 and recognized, and a series of hand movements are recognized based on a change in the image of the hand. And a series of hand movements can be recognized, and the command processing device 1 can have a simple configuration.

Further, a predetermined hand shape for the page switching command is stored in the image memory 7, and the hand shape on the screen 5 is compared with the hand shape for the page switching command stored in the image memory 7. Only when the command is recognized as a page switching command, the pages of the page information are switched based on a series of movements of the hand shape. Therefore, the page switching command can be executed without error, and the command processing can be performed. Accuracy can be improved.

Also, as a series of hand movements, the left and right movements of the thumb and the right and left or substantially up and down movements of the little finger are recognized, and when the movement of the little finger is detected, the next page is switched.
When the movement of the thumb is detected, the page is switched to the previous page, so that the command can be recognized by the movement of the distant fingers such as the thumb and the little finger, so that the command processing can be performed accurately and the movement of the finger can be performed. The command processing can be performed only by using this command, and the page switching command can be more easily input.

In the above embodiment, the shape of the hand is photographed by the camera 4 in the box-shaped case 5. However, the hand is not limited to the camera, but is limited to the one provided in the box-shaped case 5. Instead, it may be provided outside the box-shaped case 5.

In the above embodiment, the command is instructed by the movement of the right hand. However, the command is not limited to the right hand, and may be the left hand.

Further, it goes without saying that the movement of the hand is not limited to the contents of the above embodiment.

The command processing device is not limited to the form of the command processing device 1 of the above embodiment.
It can also be applied to personal computers and word processors.

[0059]

According to the present invention, a hand image is recognized, and if this corresponds to an initial pattern image stored in advance, a finger movement detection mode is entered, and display control is performed by subsequent finger movements. Since the command is generated, a series of movements of the hand and the finger can be accurately recognized by the stepwise recognition, and further, the displacement of the first finger and the displacement of the second finger can be relatively determined. Since different display control commands are generated by the comparison, a plurality of commands can be generated by more accurately recognizing the characteristics of the finger movement.

[0060]

[0061]

[0062]

[Brief description of the drawings]

FIG. 1 is an external configuration diagram of an embodiment of a command processing device according to the present invention.

FIG. 2 is a circuit block diagram of the command processing device of FIG. 1;

FIG. 3 is a diagram illustrating a state in which switching of the next page is instructed by a little finger.

FIG. 4 is a diagram showing a state in which switching of a previous page is instructed by a thumb.

FIG. 5 is a flowchart showing a command instruction process by the command processing device of FIG. 1;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Command processing device 2 Box-shaped case 3 Projector 4 Camera 5 Screen 6 Image recognition part 7 Image memory 8 Image processing part 9 Main memory 10 Display memory 11 Display part

Continuation of front page (58) Field surveyed (Int.Cl. ⁷ , DB name) G06F 3/033 310 G06F 3/03 380 G06T 1/00

Claims (3)

(57) [Claims] 1. A comparison means for recognizing an input hand image and comparing whether the image corresponds to a previously stored initial pattern image, and a finger movement detection mode if the input image corresponds to the initial pattern image. Detecting means for detecting the value of the displacement of the first finger and the value of the displacement of the second finger, and the first display control when the displacement of the first finger is larger than the displacement of the second finger. A command generating means for generating a second display control command when the displacement of the second finger is larger than the displacement of the first finger; A command processing device, comprising: display control means for performing switching control of display data based on the command. 2. The first display control command and the second display control command generated by the command generation means are display control commands for switching display data displayed by the display control means to a next page and a previous page. The command processing device according to claim 1, wherein: 3. The detecting means detects the value of the displacement of the little finger and the value of the displacement of the thumb. If the displacement of the little finger is larger than the displacement of the thumb, the command generating means outputs the first display control command. 2. The command processing device according to claim 1, wherein the second display control command is generated when the displacement of the thumb is larger than the displacement of the little finger.