CN108479057A - A kind of animated stories performance system based on natural human-computer interaction - Google Patents
A kind of animated stories performance system based on natural human-computer interaction Download PDFInfo
- Publication number
- CN108479057A CN108479057A CN201810253464.1A CN201810253464A CN108479057A CN 108479057 A CN108479057 A CN 108479057A CN 201810253464 A CN201810253464 A CN 201810253464A CN 108479057 A CN108479057 A CN 108479057A
- Authority
- CN
- China
- Prior art keywords
- module
- gesture
- infrared
- host
- plot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/55—Controlling game characters or game objects based on the game progress
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/822—Strategy games; Role-playing games
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/807—Role playing or strategy games
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
- A63F2300/8082—Virtual reality
Abstract
The invention discloses a kind of animated stories performance system based on natural human-computer interaction, including plot, several subsystems and Cloud Server, plot include preset scenes for plot and corresponding role；Subsystem includes at least a player, gesture detector, host, display module；Gesture detector includes infrared supplementary lighting module, is connect with infrared supplementary lighting module infrared photography module, link block, the image processing module being connect respectively with infrared photography module and link block.A kind of animated stories performance system based on natural human-computer interaction of the present invention, it is reasonable for structure, have many advantages, such as simple in structure, easy to use, interaction nature, effectively solves the problems, such as that existing digitlization system interaction of telling a story is unnatural.
Description
Technical field
The present invention relates to man-machine interactive system fields, more particularly, to a kind of animated stories table based on natural human-computer interaction
Drill system.
Background technology
Known story performance has great significance to child growth, can improve childrenese ability to express, logic is thought
Ability, imagination and creativity are examined, is the effectively means of education.With the development of computer technology, occur carrying for children
Digitlization for telling a story, creating story is told a story system, such as Toontastic, Storytelling Alice Wayang
Authoring, Picture This！, ShadowStory etc. can provides for children based on tradition such as mouse, keyboard, touch screens
The educational games environment of human-computer interaction technology.Due to being restricted by traditional interaction technique, such system generally existing interactive mode
The problem of complexity, tale characters and action are relatively fixed, type is few, and children can play the insufficient space of creation.In addition, child and
Preschool child's cognitive ability is immature, can not adapt to conventional conventional human's interactive means.With Computer Animated Graph and people
Virtual reality technology is incorporated in children education field and has become possibility by the further development of machine interaction technique, must so having
It is empty to provide more intuitive, more natural human-computer interaction for children for the educational games product for merging virtual reality interaction technique
Quasi- experience.
Invention content
The technical problem to be solved by the present invention is to：It is above-mentioned in order to solve the problems, such as, it provides a kind of based on nature
The animated stories performance system of human-computer interaction, it is reasonable for structure, have many advantages, such as simple in structure, easy to use, interaction nature, has
Effect solves the problems, such as that existing to digitize system interaction of telling a story unnatural.
The technical solution adopted by the present invention to solve the technical problems is：A kind of animated stories based on natural human-computer interaction
Performance system, including plot, several subsystems and Cloud Server, the plot further include preset story field
Scape and corresponding role；
The subsystem include an at least player, gesture detector, with gesture detector be connected with each other host, with
The display module of host connection；The gesture detector includes infrared supplementary lighting module, it is infrared to be connect with infrared supplementary lighting module
Photographing module, link block, the image processing module being connect respectively with infrared photography module and link block；
The player plays the part of one in story according to plot selection or several roles, player pass through in hand
Gesture interaction is carried out in the investigative range of gesture detector, the gesture information detected connection is delivered to host by gesture detector；
The order of character location and action in several control scenes for plot, and these order difference are preset in the host
A kind of corresponding gesture information；The host is carried out pair by the gesture information and the default gesture information that are passed to gesture detector
Than, match and execute corresponding order, while sending command information to Cloud Server, the Cloud Server is according to the order received
The host of information and development of action into other subsystems sends identical order and makes its execution, the host in each subsystem
By display module corresponding visual feedback is provided to player.
Further, the gesture detector further includes the motion sensor for detecting player's hand exercise.
Further, the gesture detector further includes for controlling infrared supplementary lighting module, the keying of infrared photography module
Infrared proximity transducer.
Further, the infrared supplementary lighting module, infrared photography module working end are towards identical.
The beneficial effects of the invention are as follows：A kind of animated stories performance system based on natural human-computer interaction is showed using virtual
Real technical modelling scenes for plot and tale characters, without additionally making stage property to tell a story, by gesture interaction mode with
If virtual scene is interacted than keyboard and mouse touch screen etc. more naturally, using head-mounted display, also it is avoided that and can not find
The trouble of keyboard and mouse or touch tablet；Its is reasonable for structure, has many advantages, such as simple in structure, easy to use, interaction nature, effectively
Solve the problems, such as that existing digitlization system interaction of telling a story is unnatural.
Description of the drawings
Present invention will be further explained below with reference to the attached drawings and examples.
Fig. 1 is a kind of overall structure signal of animated stories performance system based on natural human-computer interaction of the present invention
Figure；
Fig. 2 is a kind of subsystem structure signal of animated stories performance system based on natural human-computer interaction of the present invention
Figure；
Fig. 3 is a kind of gesture panel detector structure of animated stories performance system based on natural human-computer interaction of the present invention
Schematic diagram.
Attached drawing acceptance of the bid note is described below：
1, plot, 2, subsystem, 21, player, 22, gesture detector, 221, infrared supplementary lighting module, 222, infrared take the photograph
As module, 223, link block, 224, image processing module, 23, display module, 24, host, 3, Cloud Server.
Specific implementation mode
In conjunction with the accompanying drawings, the present invention is further explained in detail.These attached drawings are simplified schematic diagram, only with
Illustration illustrates the basic structure of the present invention, therefore it only shows the composition relevant to the invention.
A kind of animated stories performance system based on natural human-computer interaction as shown in Figure 1 to Figure 3, including plot 1,
Several subsystems 2 and Cloud Server 3, the plot 1 further include preset scenes for plot and corresponding role；
The subsystem 2 includes an at least player 21, gesture detector 22, is connected with each other with gesture detector 22
Host 24, the display module 23 being connect with host 24；
The infrared photography that the gesture detector 22 includes infrared supplementary lighting module 221, connect with infrared supplementary lighting module 221
Module 222, link block 223, the image processing module 224 being connect respectively with infrared photography module 222 and link block 223；
The player 21 selects to play the part of one or several roles in story according to plot 1, and player 21 is logical
It crosses and carries out gesture interaction in the investigative range of gesture detector 22, gesture detector 22 connects the gesture information detected defeated
It send to host 24；
The order of character location and action in several control scenes for plot, and these orders point are preset in the host 24
A kind of gesture information is not corresponded to；The host 24 passes through the gesture information for being passed to gesture detector 22 and default gesture information
It compared, matched and executed and order (controlling the position of institute's figure and/or action in prefabricated scene) accordingly, while to
Cloud Server sends command information, and the Cloud Server 3 is according to the command information and development of action received to other subsystems 2
In host 24 send identical order and make its execute (make in other subsystems 2 corresponding role make identical position with/
Or action changes), the host 24 in each subsystem 2 provides corresponding visual feedback by display module 23 to player 21.
The command information and development of action that basis said herein receives refer to premised on development of action, in development of action
When lag is with command information information, the execution of the command information also will rearward, i.e. development of action to a certain key point (such as needs to move
Dynamic character location or role need to make certain action) when detected corresponding corresponding command information can just be performed, with
Exempt from plot and entanglement occurs.
In a kind of possible plot, player 21 may be selected " free schema " and voluntarily create plot, and be needed according to plot
The position of random control role and action.
In one embodiment, the subsystem 21 may be at different places, they are mutual by Cloud Server 3
Connection is interactive, and player 21 voluntarily selects role and plays the part of on the basis of same plot 1, and Cloud Server 3 can also incite somebody to action
The player 21 that same plot plays the part of different role is selected to be combined connection；Certainly, 2 player 21 of subsystem can also select
Property connection Cloud Server 3 store story progress, or disconnect Cloud Server 3 carry out single cpu mode.
In one embodiment, the gesture detector 22 further includes the motion-sensing for detecting 21 hand exercise of player
Device.
In one embodiment, the gesture detector 22 further includes for controlling infrared supplementary lighting module 221, infrared taking the photograph
The infrared proximity transducer opened and closed as module 222.
In one embodiment, the infrared supplementary lighting module 221,222 working end of infrared photography module are towards identical.
A kind of animated stories performance system based on natural human-computer interaction of the present invention, it is reasonable for structure, utilize void
Quasi- reality technology simulation scenes for plot and tale characters, without additionally making stage property to tell a story, by gesture interaction side
If formula is interacted than keyboard and mouse touch screen etc. with virtual scene more naturally, using head-mounted display, also it is avoided that and looks for
Less than the trouble of keyboard and mouse or touch tablet；Its is reasonable for structure, has many advantages, such as simple in structure, easy to use, interaction nature,
Effectively solve the problems, such as that existing digitlization system interaction of telling a story is unnatural.
It is enlightenment with above-mentioned desirable embodiment according to the present invention, through the above description, relevant staff is complete
Various changes and amendments can be carried out without departing from the scope of the technological thought of the present invention' entirely.The technology of this invention
Property range is not limited to the contents of the specification, it is necessary to determine its technical scope according to right.
Claims (4)
1. a kind of animated stories performance system based on natural human-computer interaction, it is characterized in that：Including plot (1), Ruo Ganzi
System (2) and Cloud Server (3), the plot (1) further include preset scenes for plot and corresponding role；
The subsystem (2) includes an at least player (21), gesture detector (22), is mutually interconnected with gesture detector (22)
The host (24) connect, the display module (23) being connect with host (24)；The gesture detector (22) includes infrared light filling mould
Block (221), link block (223), is taken the photograph with infrared the infrared photography module (222) being connect with infrared supplementary lighting module (221) respectively
As the image processing module (224) of module (222) and link block (223) connection；
The player (21) plays the part of one or several roles in story, player (21) according to plot (1) selection
By carrying out gesture interaction, the gesture information that gesture detector (22) will detect in the investigative range of gesture detector (22)
Connection is delivered to host (24)；
The order of character location and action in several control scenes for plot, and these order difference are preset in the host (24)
A kind of corresponding gesture information；The host (24) is believed by the gesture information for being passed to gesture detector (22) with default gesture
Breath is compared, matched and is executed corresponding order, while sending command information, the Cloud Server (3) to Cloud Server (3)
Identical order is sent according to host (24) of the command information and development of action received into other subsystems (2) and makes it
It executes, the host (24) in each subsystem (2) provides corresponding visual feedback by display module (23) to player (21).
2. a kind of animated stories performance system based on natural human-computer interaction according to claim 1, it is characterized in that：It is described
Gesture detector (22) further include detect player (21) hand exercise motion sensor.
3. a kind of animated stories performance system based on natural human-computer interaction according to claim 1, it is characterized in that：It is described
Gesture detector (22) further include for controlling infrared supplementary lighting module (221), infrared photography module (222) opens and closes infrared connecing
Nearly sensor.
4. a kind of animated stories performance system based on natural human-computer interaction according to claim 1, it is characterized in that：It is described
Infrared supplementary lighting module (221), infrared photography module (222) working end is towards identical.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810253464.1A CN108479057A (en) | 2018-03-26 | 2018-03-26 | A kind of animated stories performance system based on natural human-computer interaction |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810253464.1A CN108479057A (en) | 2018-03-26 | 2018-03-26 | A kind of animated stories performance system based on natural human-computer interaction |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108479057A true CN108479057A (en) | 2018-09-04 |
Family
ID=63337885
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810253464.1A Pending CN108479057A (en) | 2018-03-26 | 2018-03-26 | A kind of animated stories performance system based on natural human-computer interaction |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108479057A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109745700A (en) * | 2019-01-14 | 2019-05-14 | 蔡松乔 | A kind of sense organ asymmetry game system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102495674A (en) * | 2011-12-05 | 2012-06-13 | 无锡海森诺科技有限公司 | Infrared human-computer interaction method and device |
| CN102999153A (en) * | 2011-09-08 | 2013-03-27 | 北京林业大学 | Two-dimensional data object control system and method based on natural man-machine interaction |
| CN103093658A (en) * | 2013-01-14 | 2013-05-08 | 中国科学院软件研究所 | Child real object interaction story building method and system |
| US20160073033A1 (en) * | 2014-09-08 | 2016-03-10 | Fumihiko Inoue | Electronic apparatus |
| CN106502402A (en) * | 2016-10-25 | 2017-03-15 | 四川农业大学 | A kind of Three-Dimensional Dynamic Scene Teaching system and method |
| CN107308638A (en) * | 2017-06-06 | 2017-11-03 | 中国地质大学（武汉） | A kind of entertaining rehabilitation training of upper limbs system and method for virtual reality interaction |
-
2018
- 2018-03-26 CN CN201810253464.1A patent/CN108479057A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102999153A (en) * | 2011-09-08 | 2013-03-27 | 北京林业大学 | Two-dimensional data object control system and method based on natural man-machine interaction |
| CN102495674A (en) * | 2011-12-05 | 2012-06-13 | 无锡海森诺科技有限公司 | Infrared human-computer interaction method and device |
| CN103093658A (en) * | 2013-01-14 | 2013-05-08 | 中国科学院软件研究所 | Child real object interaction story building method and system |
| US20160073033A1 (en) * | 2014-09-08 | 2016-03-10 | Fumihiko Inoue | Electronic apparatus |
| CN106502402A (en) * | 2016-10-25 | 2017-03-15 | 四川农业大学 | A kind of Three-Dimensional Dynamic Scene Teaching system and method |
| CN107308638A (en) * | 2017-06-06 | 2017-11-03 | 中国地质大学（武汉） | A kind of entertaining rehabilitation training of upper limbs system and method for virtual reality interaction |
Non-Patent Citations (1)
| Title |
|---|
| 一路向南_CSDN: "【手势交互】10. Wii Remote", 《HTTPS://BLOG.CSDN.NET/HUIBAILINGYU/ARTICLE/DETAILS/47259721》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109745700A (en) * | 2019-01-14 | 2019-05-14 | 蔡松乔 | A kind of sense organ asymmetry game system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7441198B2 (en) | Virtual collaboration window system and method | |
| LaViola et al. | 3D spatial interaction: applications for art, design, and science | |
| JP2022535325A (en) | Arm Gaze-Driven User Interface Element Gating for Artificial Reality Systems | |
| KR20120123330A (en) | Camera navigation for presentations | |
| Wang et al. | Coordinated 3D interaction in tablet-and HMD-based hybrid virtual environments | |
| JP2022535182A (en) | Artificial reality system with personal assistant elements gating user interface elements | |
| Bossavit et al. | Design choices and their implications for 3d mid-air manipulation techniques | |
| CN113892075A (en) | Corner recognition gesture-driven user interface element gating for artificial reality systems | |
| CN107589839A (en) | A kind of multifunctional operating platform based on Unity3D | |
| Okada et al. | Component-based approach for prototyping of Tai Chi-based physical therapy game and its performance evaluations | |
| CN108479057A (en) | A kind of animated stories performance system based on natural human-computer interaction | |
| McCaffery et al. | Exploring heritage through time and space supporting community reflection on the highland clearances | |
| Steed | Defining interaction within immersive virtual environments | |
| Flotyński et al. | Extended Reality Environments | |
| George et al. | Nomad devices for interactions in immersive virtual environments | |
| JP2022153476A (en) | Animation creation system | |
| Bottoni et al. | Copuppet: Collaborative interaction in virtual puppetry | |
| US20220351452A1 (en) | Animation production method | |
| CN207115783U (en) | Mixed reality interactive teaching system | |
| Wu et al. | Costume design and animation synthesis for personalized avatars | |
| Okada | 3D visual component based approach for immersive collaborative virtual environments | |
| CN114660918B (en) | Holographic stereoscopic image display device, method, device and medium | |
| Garcia et al. | Modifying a game interface to take advantage of advanced I/O devices | |
| Mazalek et al. | Pictures at an exhibition: design of a hybrid puppetry performance piece | |
| Quandt et al. | Signing avatars in a new dimension: Challenges and opportunities in virtual reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180904 |