CN1635455A - Method for controlling virtual aquatic animal activity using gesture - Google Patents

Method for controlling virtual aquatic animal activity using gesture Download PDF

Info

Publication number
CN1635455A
CN1635455A CNA2003101245084A CN200310124508A CN1635455A CN 1635455 A CN1635455 A CN 1635455A CN A2003101245084 A CNA2003101245084 A CN A2003101245084A CN 200310124508 A CN200310124508 A CN 200310124508A CN 1635455 A CN1635455 A CN 1635455A
Authority
CN
China
Prior art keywords
shui nationality
images
gestures
virtual
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2003101245084A
Other languages
Chinese (zh)
Inventor
胡学增
粱兆正
许永顺
吴为昊
柯少敏
肖建敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHANGHAI SCIENCE & TECHNOLOGY MUSEUM
Original Assignee
SHANGHAI SCIENCE & TECHNOLOGY MUSEUM
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI SCIENCE & TECHNOLOGY MUSEUM filed Critical SHANGHAI SCIENCE & TECHNOLOGY MUSEUM
Priority to CNA2003101245084A priority Critical patent/CN1635455A/en
Publication of CN1635455A publication Critical patent/CN1635455A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

This invention discloses a method to control virtual aquatic animals by signs, which comprises the following steps: a, displaying the aquatic animals kinds and their relationships; b, collecting signs images; c, identifying the images in step b; d, selecting the aquatic animals according to the signs in step c; e, the control device receiving initial action signals for another signal collecting; f, identifying the signs images in step e; g, selecting actions according to signs in step f; h, generating a series of images of actions in step g; I, control device detecting the animals positions and its relationship with others for operations; j, control device detecting whether the signals are received.

Description

Use gesture and control the method for virtual Shui nationality activity
Technical field
The present invention relates to virtual technology, especially design a kind of method of the virtual Shui nationality activity of control that uses gesture.
Background technology
The sea floor world and the seabed Shui nationality are all very interesting, but because the restriction of various conditions, people can't touch the sea floor world and the seabed Shui nationality usually.
So, realize that by virtual reality technology the activity of the sea floor world view and the seabed Shui nationality becomes one and well selects.The same with most of virtual technologies, realize that the sea floor world view and the seabed Shui nationality need following hardware system:
Image capture device mainly is an image of gathering the participant, includes control command information in participant's the image;
Image recognition apparatus identifies the image of representing control command from the image of above-mentioned image capture device collection;
Opertaing device, according to the control command that the participant sends, opertaing device is handled accordingly;
Image forming apparatus, the control of opertaing device generates corresponding image down again, and this image is meant ambient image or background image.
Display device, display environment or background image are that the participant has a kind of sensation on the spot in person.
For the participant, be the key factor that influences participant's interest how to virtual animal issue an order, present order receiving equipment is confined to manual input, needs the participant to use specific keyboard or controller to come input instruction, has therefore brought many inconvenience to the participant.So mode how to improve input command has just become an important problem.
Summary of the invention
The purpose of this invention is to provide a kind of with the control method of gesture as the order input mode.
The present invention adopts following technical scheme:
A kind of using gesture controlled the method for virtual Shui nationality activity, be applied in to comprise image capture device, and image recognition apparatus, on the hardware system of image forming apparatus, display device and opertaing device, this method comprises:
A. show described Shui nationality kind and mutual relationship, described display device shows the kind of the predefined Shui nationality, and shows the mutual relationship between them;
B. described opertaing device receives the beginning acquired signal, and described image capture device is gathered images of gestures;
C. the images of gestures that image capture device is gathered described in the described image recognition apparatus identification b is divided it in predefined gesture kind, if can't discern, then gets back to step b and gathers images of gestures again one time;
D. described opertaing device is selected its pairing a kind of Shui nationality according to the images of gestures that identifies described in the c, and the described images of gestures and the described Shui nationality are corresponding in advance;
E. described opertaing device receives the signal that comes into play, and described image capture device is gathered images of gestures again;
F. the images of gestures that image capture device is gathered described in the described image recognition apparatus identification e is divided it in predefined gesture kind, if can't discern, then gets back to step e and gathers images of gestures again one time;
G. described opertaing device is selected its pairing a kind of action according to the images of gestures that identifies described in the f, and described images of gestures and described action are corresponding in advance;
H. described image forming apparatus is according to determined action among the g, and the Shui nationality that generate described kind carry out a series of images of described action;
I. described opertaing device detects the described mutual relationship of the positions of the described Shui nationality and it and other virtual Shui nationality, operates according to testing result;
Whether i. described opertaing device detects receives end signal, if receive, then finishes whole process; If do not finish, then arrive step e and continue to gather images of gestures.
According to one embodiment of the present of invention, the mutual relationship among the described step a is a food chain relation, described step I, in described mutual relationship also be the food chain relation, preserve predefined food chain in the described opertaing device and concern and in described step a, show; Described all Shui nationality are all set a predation scope, if described Shui nationality have its food to exist in its predation scope, the then described Shui nationality are made the predation action, if the described Shui nationality enter its predator's predation scope, then prey behind the prey, is reselected a kind of Shui nationality to step b.Perhaps parasitism.In another embodiment, the mutual relationship among the described step a is a food chain relation, and the described mutual relationship in the described step I also is a parasitism, preserves predefined parasitism in the described opertaing device and shows in described step a; Described all Shui nationality are all set a parasitic scope of activities, if described Shui nationality have its host to exist in its parasitic scope of activities, the then described Shui nationality are made parasitic action, behind the parasitism, reselect a kind of Shui nationality to step b; If having it to post the survivor in its parasitic scope, the described Shui nationality exist, then by parasitism.
According to one embodiment of the present of invention, described step c identification images of gestures, earlier described images of gestures is carried out binaryzation, determine that according to its gray scale the hand direct picture still is the back of the hand face image, discern the edge of described images of gestures again, determine the classification of described images of gestures according to the quantity that thrusts out one's fingers.Can described images of gestures be divided into 10 classes according to the pros and cons of hand and the quantity that thrusts out one's fingers.
According to one embodiment of the present of invention, described step h generates image, according to determined action, determines the multiple image to moving; Preserve the image of predefined corresponding everything in the described image forming apparatus, and each action is corresponding with multiple image wherein.
After having adopted technical scheme of the present invention, the participant can make to use gesture and control the activity of the virtual Shui nationality, has made things convenient for the participant widely, has improved participant's interest.
Description of drawings
Fig. 1 is the process flow diagram of one embodiment of the present of invention.
Fig. 2 A-E is the synoptic diagram of the gesture of one embodiment of the present of invention use.
Fig. 3 is a block diagram of realizing hardware device of the present invention.
Embodiment
Further specify technical scheme of the present invention below in conjunction with embodiment and accompanying drawing.
At first have a look and realize hardware device of the present invention, as shown in Figure 3, comprise image capture device 31, image recognition apparatus 32, image forming apparatus 33, display device 34 and opertaing device 35.Wherein image capture device 31 is can be common camera or thermal camera, consider that the environment that shows the virtual Shui nationality may be more dim, preferably adopt thermal camera, among the embodiment described below again, the thermal camera that just is to use is as image capture device 31.Image forming apparatus 33 can be the computing machine that the operation figure generates software, for example moves the computing machine of OpenInventor or OpenGL.And opertaing device 35 can use common computing machine to realize.
Method of the present invention may further comprise the steps, as shown in Figure 1:
A. show Shui nationality kind and mutual relationship, display device 34 shows the kind of the predefined Shui nationality, and shows the mutual relationship between them.In general, the quantity of the quantity of Shui nationality kind and the gesture of definition is identical, in this embodiment, owing to defined 10 kinds of gestures, so the kind of the Shui nationality is no more than 10 kinds, mutual relationship between the Shui nationality has a lot, illustrates for two examples here: food chain relation, and in opertaing device 35, preserve predefined food chain relation and in step a, show predation between each Shui nationality and the relation of prey; Parasitism is preserved predefined parasitism and show this parasitism in step a in the opertaing device 35;
B. opertaing device 35 receives the beginning acquired signal, and image capture device 31 is gathered images of gestures.Among this embodiment, opertaing device 35 uses common computing machine to realize, so the beginning acquired signal here is to be imported by the input equipment of common computer, is not to be gathered by image capture device 31.Among this embodiment, image capture device 31 is infrared cameras, and it will gather participant's gesture, and certainly, the participant also needs hand is put in the acquisition range of infrared camera.
C. the images of gestures that image capture device 31 is gathered among the image recognition apparatus 32 identification b is divided it in predefined gesture kind, if can't discern, then gets back to step b and gathers images of gestures again one time.In this embodiment, following method is adopted in identification: earlier images of gestures is carried out binaryzation, determine that according to its gray scale the hand direct picture still is the back of the hand face image, in general, the gray scale of positive (palm of the hand) is lower and the gray scale back side (the back of the hand) is higher, can a pre-defined threshold value, be higher than this threshold value and be judged as the back side, be lower than this threshold value and be judged as the front; Discern the edge of images of gestures again,, preserved the image of the gesture of corresponding various finger quantity in the model bank, determine the finger quantity in the images of gestures and classify with this according to the edge of the images of gestures of extracting in model bank, carrying out fuzzy diagnosis.When images acquired, be certain to have useless interfering picture to occur, so also need the processing disturbed after with the images of gestures binaryzation, this also is known in the industry technology, the present invention just uses this technology.In the time of can't discerning if disturb serious, gather image again one time.
D. opertaing device 35 is according to the images of gestures that identifies among the c, select its pairing a kind of Shui nationality, the images of gestures and the Shui nationality are corresponding in advance, this said in the above, the corresponding a kind of Shui nationality of a kind of gesture, this corresponding relation is predefined, and may be displayed on the display device 34 when the rapid c of previous step.Among this embodiment, the quantity of gesture is 10 kinds, so the quantity of the Shui nationality is no more than 10 kinds.
E. opertaing device 35 receives the signal that comes into play, this signal that comes into play also is to import by the input equipment of computing machine, after importing this active signal, explanation is through with to the selection of Shui nationality kind, to enter below the actions of Shui nationality control, thus this moment image capture device 31 to gather images of gestures again be the control that is used for Shui nationality action.
F. the images of gestures that image capture device 31 is gathered among the image recognition apparatus 32 identification e is divided it in predefined gesture kind, if can't discern, then gets back to step e and gathers images of gestures again one time; This step is similar to the processing procedure of step c, and its difference is the corresponding a kind of action of a kind of gesture, and this corresponding relation is predefined, and may be displayed on the display device 34 when the rapid e of previous step.Among this embodiment, the quantity of gesture is 10 kinds, and therefore the quantity of corresponding action is no more than 10 kinds.
G. opertaing device 35 is selected its pairing a kind of action according to the images of gestures that identifies among the f, and images of gestures and action are corresponding in advance;
H. image forming apparatus 33 is according to determined action among the g, generates a series of images that the Shui nationality of the kind of selecting are moved.Can determine multiple image according to determined action to moving; Preserve the image of predefined corresponding everything in the image forming apparatus 33, and each action is corresponding with multiple image wherein.
I. opertaing device 35 detects the mutual relationship of the positions of the Shui nationality and it and other virtual Shui nationality, operates according to testing result; Be described respectively with reference to two kinds of mutual relationship food chains relation and the parasitism described among the step a.If be set at the food chain relation, preserve predefined food chain in the opertaing device 35 and concern and in step a, show; For all Shui nationality are all set a predation scope, if Shui nationality have its food to exist in its predation scope, then the Shui nationality are made the predation action, if the Shui nationality enter its predator's predation scope, then prey behind the prey, is reselected a kind of Shui nationality to step b.If the parasitism of being set at is preserved predefined parasitism and is shown in described step a in the opertaing device 35; All Shui nationality are all set a parasitic scope of activities, if Shui nationality have its host to exist in its parasitic scope of activities, then the Shui nationality are made parasitic action, behind the parasitism, reselect a kind of Shui nationality to step b; If having it to post the survivor in its parasitic scope, the Shui nationality exist, then by parasitism.
J. opertaing device 35 detects and whether receives end signal, if receive, then finishes whole process; If do not finish, then arrive step e and continue to gather images of gestures.The end signal that opertaing device 35 receives is a timing signal or a termination signal.Because opertaing device 35 is a common computer among this embodiment, so timing signal can produce by software timing by this computing machine, and termination signal can be by the input equipment input of this computing machine.
In this embodiment, defined 10 kinds of gestures altogether, 5 kinds in the front of hand, 5 kinds at the back side, Fig. 2 A-E illustrates the synoptic diagram of the 5 kinds of gestures in the back side of hand, is 1 respectively and points 5 fingers.Certainly, can also define a greater variety of gestures, just described no longer one by one here, but this change should be regarded as within invention scope of the present invention.
The invention provides a kind of method of the virtual Shui nationality activity of control that uses gesture, the participant can be made use gesture and control the activity of the virtual Shui nationality, made things convenient for the participant widely, improved participant's interest.
The foregoing description provides to being familiar with the person in the art and realizes or use of the present invention; those skilled in the art can be under the situation that does not break away from invention thought of the present invention; the foregoing description is made various modifications or variation; thereby protection scope of the present invention do not limit by the foregoing description, and should be the maximum magnitude that meets the inventive features that claims mention.

Claims (9)

1. the method for the virtual Shui nationality activity of control that uses gesture is applied in and comprises image capture device, image recognition apparatus, and on the hardware system of image forming apparatus, display device and opertaing device, this method comprises:
A. show described Shui nationality kind and mutual relationship, described display device shows the kind of the predefined Shui nationality, and shows the mutual relationship between them;
B. described opertaing device receives the beginning acquired signal, and described image capture device is gathered images of gestures;
C. the images of gestures that image capture device is gathered described in the described image recognition apparatus identification b is divided it in predefined gesture kind, if can't discern, then gets back to step b and gathers images of gestures again one time;
D. described opertaing device is selected its pairing a kind of Shui nationality according to the images of gestures that identifies described in the c, and the described images of gestures and the described Shui nationality are corresponding in advance;
E. described opertaing device receives the signal that comes into play, and described image capture device is gathered images of gestures again;
F. the images of gestures that image capture device is gathered described in the described image recognition apparatus identification e is divided it in predefined gesture kind, if can't discern, then gets back to step e and gathers images of gestures again one time;
G. described opertaing device is selected its pairing a kind of action according to the images of gestures that identifies described in the f, and described images of gestures and described action are corresponding in advance;
H. described image forming apparatus is according to determined action among the g, and the Shui nationality that generate described kind carry out a series of images of described action;
I. described opertaing device detects the described mutual relationship of the positions of the described Shui nationality and it and other virtual Shui nationality, operates according to testing result;
Whether j. described opertaing device detects receives end signal, if receive, then finishes whole process; If do not finish, then arrive step e and continue to gather images of gestures.
2. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 1 is characterized in that, the mutual relationship among the described step a is food chain relation or parasitism.
3. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 1 is characterized in that described image capture device is an infrared camera.
4. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 1, it is characterized in that, described step c identification images of gestures, earlier described images of gestures is carried out binaryzation, determine that according to its gray scale the hand direct picture still is the back of the hand face image, discern the edge of described images of gestures again, determine the classification of described images of gestures according to the quantity that thrusts out one's fingers.
5. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 4 is characterized in that, according to the pros and cons of hand and the quantity that thrusts out one's fingers described images of gestures is divided into 10 classes.
6. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 1 is characterized in that described step h generates image, according to determined action, determines the multiple image to moving; Preserve the image of predefined corresponding everything in the described image forming apparatus, and each action is corresponding with multiple image wherein.
7. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 1 is characterized in that, described step I, described mutual relationship are the food chain relation, preserves predefined food chain in the described opertaing device and concerns and show in described step a; Described all Shui nationality are all set a predation scope, if described Shui nationality have its food to exist in its predation scope, the then described Shui nationality are made the predation action, if the described Shui nationality enter its predator's predation scope, then prey behind the prey, is reselected a kind of Shui nationality to step b.
8. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 1 is characterized in that described step I, described mutual relationship are parasitism, preserves predefined parasitism in the described opertaing device and shows in described step a; Described all Shui nationality are all set a parasitic scope of activities, if described Shui nationality have its host to exist in its parasitic scope of activities, the then described Shui nationality are made parasitic action, behind the parasitism, reselect a kind of Shui nationality to step b; If having it to post the survivor in its parasitic scope, the described Shui nationality exist, then by parasitism.
9. the method for the virtual Shui nationality activity of control that uses gesture as claimed in claim 1 is characterized in that, described step j, the end signal that described opertaing device receives are a timing signal or termination signals.
CNA2003101245084A 2003-12-30 2003-12-30 Method for controlling virtual aquatic animal activity using gesture Pending CN1635455A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2003101245084A CN1635455A (en) 2003-12-30 2003-12-30 Method for controlling virtual aquatic animal activity using gesture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2003101245084A CN1635455A (en) 2003-12-30 2003-12-30 Method for controlling virtual aquatic animal activity using gesture

Publications (1)

Publication Number Publication Date
CN1635455A true CN1635455A (en) 2005-07-06

Family

ID=34845028

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2003101245084A Pending CN1635455A (en) 2003-12-30 2003-12-30 Method for controlling virtual aquatic animal activity using gesture

Country Status (1)

Country Link
CN (1) CN1635455A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102236409A (en) * 2010-04-30 2011-11-09 宏碁股份有限公司 Motion gesture recognition method and motion gesture recognition system based on image
CN104662587A (en) * 2012-07-27 2015-05-27 日本电气方案创新株式会社 Three-dimensional user-interface device, and three-dimensional operation method
CN106054627A (en) * 2016-06-12 2016-10-26 珠海格力电器股份有限公司 Control method and device based on gesture recognition and air conditioner

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102236409A (en) * 2010-04-30 2011-11-09 宏碁股份有限公司 Motion gesture recognition method and motion gesture recognition system based on image
CN104662587A (en) * 2012-07-27 2015-05-27 日本电气方案创新株式会社 Three-dimensional user-interface device, and three-dimensional operation method
CN104662587B (en) * 2012-07-27 2017-07-04 日本电气方案创新株式会社 Three-dimensional user interface device and three-dimensional manipulating method
CN106054627A (en) * 2016-06-12 2016-10-26 珠海格力电器股份有限公司 Control method and device based on gesture recognition and air conditioner

Similar Documents

Publication Publication Date Title
CN107885327B (en) Fingertip detection method based on Kinect depth information
CN109829467A (en) Image labeling method, electronic device and non-transient computer-readable storage medium
CN109685037B (en) Real-time action recognition method and device and electronic equipment
JP5703194B2 (en) Gesture recognition apparatus, method thereof, and program thereof
CN114241548A (en) Small target detection algorithm based on improved YOLOv5
CN1315024C (en) Video recognition input system
CN1783110A (en) Desk top scanning with hand operation
JPH09507937A (en) How to split handwriting input
CN106325485A (en) Gesture detection and identification method and system
WO2021098147A1 (en) Vr motion sensing data detection method and apparatus, computer device, and storage medium
CN110572636B (en) Camera contamination detection method and device, storage medium and electronic equipment
CN110889387A (en) Real-time dynamic gesture recognition method based on multi-track matching
CN112507918A (en) Gesture recognition method
CN110717058A (en) Information recommendation method and device and storage medium
CN111414910A (en) Small target enhancement detection method and device based on double convolutional neural network
CN114723010B (en) Automatic learning enhancement method and system for asynchronous event data
CN110334631B (en) Sitting posture detection method based on face detection and binary operation
CN1635455A (en) Method for controlling virtual aquatic animal activity using gesture
CN110334576B (en) Hand tracking method and device
CN110414363B (en) Feature recognition system based on high-speed image processing
Nikhil et al. Finger recognition and gesture based virtual keyboard
CN115188080A (en) Traffic police gesture recognition method and system based on skeleton recognition and gated loop network
CN1570953A (en) Human face detecting method under mobile computing environment
Triki et al. Imaging and HMI: Fondations and complementarities
CN1436426A (en) Adaptive early exit techniques for image correlation minimum distortion calculation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication