CN103093658B - Child real object interaction story building method and system - Google Patents
Child real object interaction story building method and system Download PDFInfo
- Publication number
- CN103093658B CN103093658B CN201310012991.0A CN201310012991A CN103093658B CN 103093658 B CN103093658 B CN 103093658B CN 201310012991 A CN201310012991 A CN 201310012991A CN 103093658 B CN103093658 B CN 103093658B
- Authority
- CN
- China
- Prior art keywords
- story
- processing unit
- role
- toy
- computer processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000003993 interaction Effects 0.000 title abstract description 8
- 239000000463 material Substances 0.000 claims abstract description 59
- 230000002452 interceptive effect Effects 0.000 claims abstract description 37
- 238000012545 processing Methods 0.000 claims abstract description 28
- 230000033001 locomotion Effects 0.000 claims description 33
- 230000005540 biological transmission Effects 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 208000037656 Respiratory Sounds Diseases 0.000 claims description 2
- 206010037833 rales Diseases 0.000 claims description 2
- 238000009877 rendering Methods 0.000 abstract 2
- 230000000694 effects Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000013461 design Methods 0.000 description 5
- 230000001133 acceleration Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 241000699666 Mus <mouse, genus> Species 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000004321 preservation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 230000008131 children development Effects 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 230000003930 cognitive ability Effects 0.000 description 1
- 230000008133 cognitive development Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 239000004575 stone Substances 0.000 description 1
- 230000004083 survival effect Effects 0.000 description 1
- 230000007474 system interaction Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Landscapes
- Toys (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a child real object interaction story building method and a system. The child real object interaction story building method includes a first step of building an operation display environment where real objects tell stories, and storing predefined story role serial numbers, story material serial numbers and model rendering rules into a rule base of a processing unit, a second step of carrying out selection of scene layouts and roles through utilization of a real object interactive tool, a third step of enabling a user to place a selected toy on the real object interactive tool and carrying out operations to the toy, a fourth step of reading radio frequency identification devices (RFID) tag information of the toy, collecting operating signals and transmitting the operating signals to the processing unit through the real object interactive tool, a fifth step of carrying out controlling, rendering and storing to the story roles and carrying out storing to voice information collected by a speech input unit through the processing unit, and a sixth step of storing recorded role control information and the recorded voice information into a story base as a story through the processing unit. The child real object interaction story building method and the system simplify story creation and provide creation pleasure.
Description
Technical field
The invention belongs to field of human-computer interaction, be specifically related to a kind of story creation method and system of children-oriented, particularly relate to a kind of children-oriented mutual story creation method in kind and system.
Background technology
Telling a story is a kind of traditional educational mode, for helping children to understand the world, transmits values, knowledge and faith.Meanwhile, telling a story is the important step that children society and cognitive ability are developed, and is also the major part of its life.Tell a story in child growth and play important role, it can help children to promote ability of language expression, logical thinking ability, imagination and creativity.In addition, tell a story and can also help to cultivate the core competence of the following survival and developments of these children such as creativity, problem solving ability, interchange and collaboration capabilities.Meanwhile, along with the high speed development of infotech and the universal of personal computer, the use of computing machine has appeared at the various aspects in our life, such as amusement, teaching and office etc.Digitized electronic equipment has also become the indispensable part of our daily life, and by these digital form, we can the world better around awareness and understanding.Universal also along with Information technology of activity of telling a story, from traditional instrument of telling a story to the environment transition of telling a story of computer supported.20 th century later start the system of telling a story just having occurred utilizing computer technology to carry out the creation of assisting child story and tell about, for children provide the space can giving the rein to imagination and create power, but due to the desktop interactive mode that this kind of story system great majority are based on keyboard and mouse, and this interactive mode is have certain difficulty for underage child study and operation.McNerney analyzes the interactive mode of physics, think that electronic toy can help children's development senior thought pattern by freely playing the part of, and this tangible interface is more direct for children, simple and acceptant.The cognitive development being of value to children alternately in kind, is a kind of interactive mode being more suitable for children compared to conventional desktop mice/keyboard mutuality mode, can uses for reference children and tell a story in activity.
At present existing based on material object mutual tell a story in system StoryMat, child hold on a woollen blanket down toy carry out role playing and story creation.Wherein, woollen blanket can record the voice of children thus record story content, but it does not give tale characters more attribute on down toy, and the operation of children to toy is more single.Meanwhile, the restriction of the space that woollen blanket is limited and toy kind, can the performance of limiting child widely when story is told about.MIT exploitation Picture This! Be then that the toy representing tale characters for each is equipped with camera, when children tell about in story, the content of story can be watched from the visual angle of this role by different role camera with it, just as film divides mirror.Although these systems both provide mutual environment of telling a story in kind, all there is following problem: mutual stage property and interactive environment limited, system configuration is fixed, and interactive operation type is more single.These limitation make story creation be restricted.
Summary of the invention
For the technical matters existed in prior art, the object of the present invention is to provide a kind of children-oriented mutual story creation method in kind and system, the method that the present invention adopts multiple sensors to combine with computer virtual scene, user freely can arrange scenes for plot, and the motion of virtual tale characters in computing machine is operated by the toy controlled in hand, carry out story creation and tell about.
The present invention to tell a story the advantage of system by combining in kind mutual and desktop, select suitable sensing technology, a mutual naturally material object is provided to tell a story system, allow children in writing space more freely, make full use of the diversity of the material that the metaphor of physical operations and computing machine provide, create simply and easily and tell about story.
For achieving the above object, the technical scheme of this invention is:
A children-oriented mutual story creation method in kind, the steps include:
1) operation and display environment that a set of material object tells a story is set up, and predefined tale characters numbering, story material numbering and role are played up rale store in rule base, play up for tale characters selection, story selection of materials, tale characters in scene layout and move.User can be identified and be analyzed by the tell a story Understanding module of program of computer-internal the operation of material object, and calculates in logic processing module and perform corresponding function, and net result is presented in the story display environment of computing machine;
2) design realizes interactive tool in kind, controls the object in scenes for plot, complete selection and the operation of scene layout and role by this instrument;
3) layout of scenes for plot comprises the selection of background layout and story material; Wherein, all physical operationss all complete on interactive tool in kind, and the scenes for plot that layout is good shows on the computer screen;
4), in story layout, the result of all operations is fed back by the electronic module of physics and screen;
5) interactive tool in kind and computing machine carry out radio communication, interactive tool in kind is according to the numbering of the role pre-defined, physics toy is associated with tale characters, select different toys to be namely in scenes for plot, have selected corresponding tale characters, computing machine calls and plays up tale characters from Multimedia Material Bank;
6) to the operation of physics toy, user operation signal is gathered by interactive tool in kind, and control signal is transferred in computing machine, control signal, to control signal analysis and calculating, is mapped to the motion that tale characters is corresponding by the Understanding of computing machine and logic processing module; Wherein, exist between the motion of tale characters and the operation of user and directly associate, meet operating habit and the cognition of user, simultaneously also by the operation map of physical space in virtual background of story;
7) user is to the control information operation of interactive tool in kind, tells a story in the logic processing module of program in computer-internal, obtains different internal manipulation instructions, and performs corresponding function according to these instructions;
8) after the input of logic processing module to user processes, its Output rusults comprises two parts, one is the feedback on screen, namely the material in Multimedia Material Bank and role is carried out playing up presenting in background of story, the feedback exported on instrument in kind exactly in addition;
9) in the process of telling a story, except operating material object, user can also input voice by Mike.The animation produced when the voice of computer recording user and user operation, both are stored in the story storehouse of computing machine together, and when the broadcasting of final story, story is play in the mode of sound and animation.
Wherein, operate display environment to export for carrying out input and a display and loudspeaker by interactive tool in kind and microphone.Instrument in kind associates with story material with the numbering of material by predefined tale characters, and before system worked well of telling a story, instrument in kind needs to carry out initialization.
Wherein, described interactive tool in kind is the major control means that user creates story, and story tells about the design needing scenes for plot and the interaction controlled between tale characters.Operations different on interactive tool in kind can produce different control informations, and such as, in scene layout, computing machine is numbered in conjunction with predefined material, completes story selection of materials and background setting.In tale characters controls, object operation instrument is associated with the role-act in computing machine scenes for plot and motion again, realizes the feedback of interaction effect in kind.
In described method, consider the use of children, the design of interactive tool in kind will be easy to the understanding of children.The result that operation on interface and screen feed back is consistent, and does not occur ambiguity.
In method, by physics toy and virtual tale characters are bound, realize controlling virtual tale characters by operating physical toy, because children are convenient to realize to the operation of toy i.e. easy understand, can understand and operate the role in story by convenient for children like this, carrying out story and tell about.
In method, toy map tale characters when the operation of user can in story display environment Real-time Feedback motion conditions.
Further, when user operation toy in kind, its all data wirelessly with compunication, such user can operate system in environment more freely.Computing machine carries out real-time listening to the input on interactive tool in kind, when having data in the serial ports buffer zone of computing machine, just carries out digital independent and process.
Further, by arranging different mark codes to different tale characters, different identification codes is arranged for different material simultaneously, like this when user selectes certain role and material, system for content identifies according to identification code, obtain object to be processed, and inter-process is carried out to it, afterwards by result feedback to scenes for plot or on instrument in kind.
Further, user can be told about story by microphone, plays the broadcasting being carried out sound and animation by loudspeaker and display.The voice of story and animation are stored by self-defining storage format.
System framework of the present invention as shown in Figure 1, comprises interface alternation layer, inter-process layer and data resource layer.The relation of this three is: interface alternation layer is the user interface of user and system interaction, wherein the data of mutual input can by the sensor in inter-process layer, electronic module and voice module gather, sensor and electronic module by Serial Port Transmission in computing machine, voice are directly transferred in computing machine by microphone, by the identification module in computing machine, the data gathered are identified and understood, and the logic processing module sending to computer-internal to tell a story in program carries out corresponding function execution, scenes for plot and role are played up and upgrades, last at interface alternation layer with voice, the mode that image and electronics export carries out information output and feedback.Playing up and playing of logic processing module, story is all carried out in program is told a story in the inside of a computing machine, the participation of all regular storehouse of whole data handling procedure and Multimedia Material Bank, such as when playing up tale characters and scenes for plot, the material in material database will be called and generate in systems in which.The story completed is stored in story storehouse.
Interactive tool in kind comprises:
1. interactive tool Story Box in kind (scene and story controller) and Story Teller (role controller), the former uses when scenes for plot layout, and the latter is for the process to role during child resistant toy.Each instrument is provided with LED and is used to refer to current mode of operation, and understand for the ease of children, be all aided with description and interpretation by picture on the surface of instrument.There is a single-chip microcomputer Story Box and Story Teller inside, are used for carrying out Data Detection and transmission; Platform in Story Teller is responsible for gathering motion control information and Role Identity identification, comprises RFID reader, motion identification module and wireless communication module; The selection gathering the story material be applied in scenes for plot layout is responsible for by platform in Story Box, comprises the elements such as button, rocking bar and LED.
2.Arduino single-chip microcomputer platform, be mainly used for data that Storage and Processing (such as filtering noise data and parameter correct) sensor collects and with the controller carrying out between computing machine communicating (particular hardware design sees Fig. 2).The singlechip control panel being responsible for controlling is connected with RFID reader (J8) with the motion identification module (J9) be made up of three-axis gyroscope and three axis accelerometer, wireless sensing module (J7) respectively, constitutes a set of sensor combinations.RFID reader, wireless sensing module and single-chip microcomputer platform carry out data transmission by SPI protocol, take same SPI data line, and gyroscope and accelerometer sensing module pass through I
2c agreement carries out data transmission.
3. sensor and electronic module, carry out the state of interactive controlling for gathering user and background of story based on the electronic module of button and rocking bar, RFID radio frequency sensor is used for tale characters identification, the motion identification module be made up of three axis accelerometer and three-axis gyroscope for gathering tale characters motion state, and carrys out the information of indication feedback by LED.
4. the input recognition processing module of instrument in kind, for identifying the data gathered and resolve.Single Chip Microcomputer (SCM) program can carry out carrying out the basic operation such as sensor parameters rectification and compensation, filter false data, data storage to the data collected.The logic processing module of background of story, receives the data sent from instrument in kind, performs corresponding function according to the analysis of instruction, the calculating of such as movement angle and the execution of role movement etc.
Background of story in computing machine comprises:
1. multimedia input and output, computing machine is by the voice of microphone record children, and the voice that the animation of tale characters on screen operation produced and story are told about are exported by display and loudspeaker.
2. story is played up and segment signal output, and wherein story is played up and comprised that scenes for plot is played up, story material is played up, tale characters is played up.Signal exports the state mainly being indicated current operation on instrument in kind by the on off state of LED.
3. database, wherein, Multimedia Material Bank provides various material resource and the tale characters of middle needs of telling a story.Story storehouse is for having stored the story told about.Rule base is then store the rule that predefined role numbers and role plays up, and is convenient to playing up and controlling of role.
Native system as shown in Figure 3, comprises interactive tool in kind (Story Teller and Story Box) and comprises 3D and to tell a story the computing machine of environment and database.User can carry out with Story Box and Story Teller alternately.Story Box is provided with the button and rocking bar that use for selection of materials during scenes for plot layout, receive the electronic signal that user operates generation on button and rocking bar, transmitted by USB data line and computing machine, logic processing module in a computer decides to perform different instructions (such as select ground, select sky and navigation etc.) according to rule base.Contain sensing combination in Story Teller, and communicate with the mode of computing machine by wireless transmission.User places the toy of a bottom with RFID label tag on Story Teller, and catch its 360 degree of range tilt toy all around, inner RFID reader can perception toy characters, then the acceleration when module acquisition toy combined by accelerometer and gyroscope is tilted and angular velocity data, these data are transferred to computing machine by the mode of wireless transmission.The story program of computer-internal is calculated by the Kalman filtering algorithm simplified different data, draws the direction that corresponding instruction tale characters moves.All operating results present in real time on screen, and play up tale characters, story material and scene in conjunction with Multimedia Material Bank, and the animation of role movement.
Compared with prior art, the present invention has following advantage and technique effect:
1. the advantage of tangible interface in story layout.
In the present invention, the mode directly pressed with rocking bar shake is adopted to carry out layout to virtual scenes for plot, provide simple directly selection mode on the one hand, the operation of the difficulty such as instead of the clicking of conventional mouse/keyboard mode, pull, on the other hand, the navigation of children in three-dimensional environment that be operating as of rocking bar provides effective metaphor, has also cultivated sense of direction simultaneously.
2. mutual direct crawl in kind and tilt operation more meet the operating habit of children, are simple and easy to use.
The interactive tool in kind of control role motion provided by the invention, take children's grasping toy in daily life and carry out the experience that tale characters plays the part of, children are allowed directly to capture physics toy and inclination toy to control tale characters and the direction of instruction movement, compared with traditional mode by mouse movement, control more direct and nature, especially for body kinematics function also immature preprimary child, the mutual mode of this material object is easy to learn.
3. children can create more abundant story content.
The abundant material that physical operations and multimedia provide by the present invention combines, compared with the pattern of telling a story of traditional story-book, while it allows children operate in real physical environment, abundant story material can be added in the virtual world, enriched story effect and improved experience of telling a story.
4. activity space of telling a story is freer.
The constraint of children when using system of the present invention not by physical space, can be freely movable, and the virtual scenes for plot that simultaneous computer provides is the expansion of physical world, makes story carry out telling about becoming possibility in more wide space.
5. hardware cost is low, and be easy to configuration, extendability is strong.
In the present invention, the sensor cost of use is lower, and adopts the design of splicing, and modules is separate, can add new module simply, therefore, improves the expansion of instrument widely.Compared with traditional interactive system in kind, the present invention constructs opening platform freely, and children can configure different contents (story material and tale characters etc.) by it, more flexibly.
Accompanying drawing explanation
Fig. 1 native system Organization Chart;
The hardware elementary diagram (not comprising the schematic diagram of each sensor assembly) that Fig. 2 native system is main;
The system diagram of Fig. 3 native system;
The base conditioning process flow diagram of Fig. 4 native system.
Embodiment
In order to make those skilled in the art better understand, below in conjunction with drawings and embodiments, this exchange method is described in further detail:
Realization flow of the present invention as shown in Figure 4.Mainly be divided into state initialization, scenes for plot layout and role selecting, story to tell about to store and broadcasting three phases with story.Below describe the function of each module in each stage in detail:
1. system and tool initialization
At system state initial phase, mainly each assembly in system is carried out initial work, comprise the initialization of background of story, namely empty story region and a newly-built blank scenes for plot; The initial work of all buttons, LED and rocking bar on Story Box, namely at predefine correlation parameter and electronic component ID; Story Teller initial work, namely defines correlation parameter, RFID sensor initial configuration, motion identification module parameter corrects and wireless communication module main frame and from machine parameter configuration.Then enter poll listen phase, the program of telling a story in computing machine is monitored respectively to Story Box and Story Teller two assemblies, judges the input of user and performs corresponding operation.
2. scenes for plot layout and role selecting
This stage is layout scenes for plot and selection tale characters mainly.Story Box has seven buttons and a rocking bar.Button is divided into two groups, and three buttons in a group represent story Foreground selection and story selection of materials, and their sides are respectively equipped with a LED to indicate current editing mode.Four button representative systems order in another group (newly-built story, start to tell about, preserve story and play story).In default situations, mobile rocking bar can change the visual angle in background of story, namely navigates in virtual background of story, also can determine the position that story material is played up.When carrying out background and selection of materials, rocking bar can serve as selection tool, moves left and right and can browse and select the story material of the preview that screen shows.In Story Teller, RFID reader is for identifying tale characters, and the Real-time Feedback on LED and screen can point out user current state.Whole virtual background of story is the 3D environment played up based on OpenGL, and screen presents, and interface is divided into two parts, and top is main scenes for plot region, shows all elements (comprising story background, material and role) of story.Below is menu bar, comprises story and tells about the prompting of state, system exit button and and the list of selectable story material.Multi-media Material resources bank provides abundant virtual resource, the story creation of assisted user.
(1) scenes for plot layout.
Scenes for plot layout comprises Foreground selection and story selection of materials, first on Story Box, press the button (such as sky and ground) of Foreground selection, computing machine receives the low level (acquiescence is high level) of the digital port at corresponding button place by serial ports, the digital port that the LED be associated is connected is exported high level, LED starts flicker, and system can show concrete background material resource from Multi-media Material library call at screen.Then, browse material by moving left and right rocking bar, on screen, current selected material can be highlighted.After the selection completing background, after again pressing Foreground selection button, computing machine calls Multimedia Material Bank, can render current highlighted background material, the LED of correspondence extinguished simultaneously at the center of scenes for plot.Adopt and use the same method, also can select story material, system provides tree, flower, stone and house etc. material.
(2) tale characters is selected.
A radio-frequency (RF) tag is posted bottom each toy, No. ID of RFID is defined as the numbering of tale characters in systems in which, RFID reader in Story Teller initiatively sends a string query statement every 15 milliseconds, when not receiving radio-frequency (RF) tag, 5 fixing bytes can be received, when have radio-frequency (RF) tag near time, the byte content received will change, and wherein contains the ID of radio-frequency (RF) tag.By this method, just can identify the toy posting different radio frequency label, thus be mapped as different tale characters.The center being created on story home court scene area is played up in the tale characters meeting under the calling of Multimedia Material Bank identified.
To arrange and in role's adding procedure at scenes for plot, user freely can carry out selection of materials, the interpolation of navigation and role and switching, and three kinds of operations do not have sequencing, and this also allows user to change stage property and the element of story at any time.
3. story is told about, preserves and is play
When user presses " starting to tell about " button, system will enter story and tell about the stage, now screen can be pointed out and tell about in story, again press " starting to tell about " button and then can suspend telling about of story, same screen also can be pointed out story suspend, in this stage, the assembly of main operation is Story Teller.First toy bottom being posted radio-frequency (RF) tag is placed on Story Teller, and system can identify and lock current detected role.Switch open on Story Teller, the LED on side can receive high level luminescence, and instruction starts tale characters setting in motion.At this moment the hand-held and toy that tilts, motion identification module can obtain 3-axis acceleration and three axis angular rates, then passes through I
2c agreement stores data in the register of single-chip microcomputer, is then sent to the wireless module main frame be connected with computing machine from the wireless module Story Teller from machine by SPI protocol, and the form of transmission is a string byte packet representing query statement.Main frame checks once receive in buffer memory whether have data every 15 milliseconds, after receiving byte packet, can tentatively judge and de-packaging operation, resolves and restoring data, is transferred data in the program of display background of story by serial ports.
In a program, up-to-date six data received are calculated at every turn, what adopt is the algorithm of Kalman filtering simplified, namely on the basis of the gestures of object calculated by 3-axis acceleration, in conjunction with the attitude information that three axis angular rates calculate,, finally obtain the reference direction vector of role movement.In calculating, the data gone out by acceleration analysis respectively account for weight with the data gone out by angular velocity calculation, both weight ratios obtain by experiment, the numerical value 1: 10 that final employing is fixing, precision can decrease in theory, but finds through test, has reached enough accurate in the process that the measurement at attitude inclination angle uses user, therefore, the method be applicable to children tell a story this to precision be not be strict with scene in.After role obtains motion vector, binding rule storehouse, carry out motion calculation in the structure of actor model with constraint (such as can not leave ground) that be subject to and play up, the direction of movement in virtual scenes for plot is consistent with the direction of motion calculated.The movement velocity of tale characters is directly proportional to the angle of inclination of user.Such user is in practical operation, and concrete vergence direction and angle have mapped directly to the direction of motion of role on Virtual Space and speed, is convenient to user and understands the cognitive load also reducing user.Meanwhile, in the telling about of story, user can give an oral account plot by microphone, and when tale characters occurs mutual, user can carry out role playing, describes for tale characters adds story.
In the process that story is told about, user can freely switch different tale characters, the role that needs operate being put on Story Teller, carrying out the control of role movement, to move in scenes for plot and the role different from other carries out interaction with regard to achieving multiple role like this.Meanwhile, user is when how uncertain story carries out, and can suspend telling about of story by " time-out " button pressed on StoryBox at any time, now " time-out " button can revert to again " starting to tell about " button and show on screen.When be again ready to story describe time, again press " starting to tell about " button and proceed story and tell about.The phonetic entry of user teaches story content, also allows user to describe story with the identity of tale characters simultaneously.
After terminating when telling a story, can be stored present story and voice by " preservation story " button on Story Box.The process of story performance and the voice of correspondence can be stored in self-defining XML file form in systems in which, and unification is recorded in story storehouse.When opening the story of preservation, read the file that comprises of story, be loaded into by narration information in system, press Story Box " broadcasting story " button, system can play animation when story is carried out and the voice relevant to story.
In sum, The present invention gives a kind of children-oriented mutual story creation method in kind and create system with this story realized, combine with traditional physics pattern of telling a story, abundant Multi-media Material is provided, excite creativity and the imagination of children, more freely create and tell about story, drastically increasing the interest of children for the activity of telling a story, cultivating the ability in oral expression of children.
Claims (9)
1. a children-oriented mutual story creation method in kind, the steps include:
1) set up the operation display environment that a material object is told a story, described operation display environment comprises the interactive tool in kind for the input of tale characters, story selection of materials and control signal, phonetic entry, output unit, computer processing unit and display; Predefined tale characters numbering, story material numbering and role are played up rale store in the rule base of computer processing unit; Each toy has a RFID label tag corresponding with tale characters; One RFID reader and a motion identification module are set in described interactive tool in kind; Wherein, described interactive tool in kind comprises a scene and story controller Story Box and role controller Story Teller; Story Box is used for scenes for plot layout, and Story Teller is for the operation information process to role during user operation toy; All there is a single-chip microcomputer Story Box and Story Teller inside, are used for carrying out Data Detection and transmission;
2) set up the communication connection of interactive tool in kind and computer processing unit, user utilizes described interactive tool in kind to carry out the selection of scene layout and role according to predefined numbering, and display on the display;
3) selected toy is placed on described interactive tool in kind by user, operates this toy;
4) described interactive tool in kind read this toy FRID label information, gather user to the operation signal of toy, and send it to computer processing unit;
5) computer processing unit controls corresponding tale characters according to the information received, plays up tale characters and store; And the voice messaging of computer processing unit to voice-input unit collection stores;
6), at the end of story, the Role Dilemma information of record and voice messaging are stored in story storehouse as a story by computer processing unit.
2. the method for claim 1, is characterized in that described role controller Story Teller comprises a wireless sensing module, for communicating with described computer processing unit; One single-chip microcomputer platform; Described motion identification module is made up of three-axis gyroscope and three axis accelerometer; The control panel of described single-chip microcomputer platform is connected with RFID reader with described motion identification module, wireless sensing module respectively.
3. method as claimed in claim 2, is characterized in that described RFID reader, wireless sensing module and described single-chip microcomputer platform carry out data transmission by SPI protocol, takies same SPI data bus; Described gyroscope and three axis accelerometer pass through I
2c agreement transfers data to described single-chip microcomputer platform.
4. the method for claim 1, it is characterized in that described scene and story controller Story Box are provided with the button and rocking bar used for selection of materials during scenes for plot layout, scene and story controller Story Box receive the electronic signal that user operates generation on button and rocking bar, are transferred to described computer processing unit by USB data line; Described scene and story controller Story Box are provided with and preserve story button, suspend story button and play story button.
5. method as claimed in claim 1 or 2, is characterized in that each instrument is provided with LED, is used to refer to current mode of operation, and is provided with the picture for instruction and explanation of mode of operation on the surface of instrument.
6. children-oriented mutual story in kind creates a system, it is characterized in that comprising the interactive tool in kind for the input of tale characters, story selection of materials and control signal, phonetic entry, output unit, computer processing unit and display; Described interactive tool in kind and described computer processing unit communicate to connect, and phonetic entry, output unit and display are connected with described computer processing unit respectively; Wherein, store predefined tale characters numbering, story material numbering and role in the rule base of computer unit and play up rule, each toy has a RFID label tag corresponding with tale characters; One RFID reader and a motion identification module are set in described interactive tool in kind; Described interactive tool in kind comprises a scene and story controller Story Box and role controller Story Teller; Story Box is used for scenes for plot layout, and Story Teller is for the operation information process to role during user operation toy; Wherein, all there is a single-chip microcomputer Story Box and Story Teller inside, are used for carrying out Data Detection and transmission.
7. system as claimed in claim 6, is characterized in that described role controller Story Teller comprises a wireless sensing module, for communicating with described computer processing unit; One single-chip microcomputer platform; Described motion identification module is made up of three-axis gyroscope and three axis accelerometer; The control panel of described single-chip microcomputer platform is connected with RFID reader with described motion identification module, wireless sensing module respectively.
8. system as claimed in claim 6, it is characterized in that described scene and story controller Story Box are provided with the button and rocking bar used for selection of materials during scenes for plot layout, scene and story controller Story Box receive the electronic signal that user operates generation on button and rocking bar, are transferred to described computer processing unit by USB data line; Described scene and story controller Story Box are provided with and preserve story button, suspend story button and play story button.
9. system as claimed in claim 7, is characterized in that described RFID reader, wireless sensing module and described single-chip microcomputer platform carry out data transmission by SPI protocol, takies same SPI data bus; Described gyroscope and three axis accelerometer pass through I
2c agreement transfers data to described single-chip microcomputer platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310012991.0A CN103093658B (en) | 2013-01-14 | 2013-01-14 | Child real object interaction story building method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310012991.0A CN103093658B (en) | 2013-01-14 | 2013-01-14 | Child real object interaction story building method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103093658A CN103093658A (en) | 2013-05-08 |
| CN103093658B true CN103093658B (en) | 2015-01-07 |
Family
ID=48206175
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310012991.0A Expired - Fee Related CN103093658B (en) | 2013-01-14 | 2013-01-14 | Child real object interaction story building method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103093658B (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104415554B (en) * | 2013-08-23 | 2017-04-26 | 朱江 | Customized role-playing method of intelligent interactive toy storyboard |
| CN104423977A (en) * | 2013-08-23 | 2015-03-18 | 朱江 | Two-dimension code based toy application update method |
| CN104064068B (en) * | 2014-06-17 | 2016-04-13 | 王岳雄 | A kind of parent-child interaction learning method and realize the device of the method |
| US20160220903A1 (en) * | 2015-02-02 | 2016-08-04 | Kuato Games (UK) Limited | Systems and Methods for Dynamically Creating Personalized Storybooks based on User Interactions within a Virtual Environment |
| CN105654005A (en) * | 2016-01-04 | 2016-06-08 | 陕西科技大学 | Parent-child type restaurant architecture and application method thereof for children entertainment |
| CN106205250A (en) * | 2016-09-06 | 2016-12-07 | 广州视源电子科技股份有限公司 | Lecture system and teaching methods |
| CN106781869A (en) * | 2017-01-22 | 2017-05-31 | 智童时刻（厦门）科技有限公司 | A kind of material object programming method of educational robot combining environmental |
| CN107596704A (en) * | 2017-09-15 | 2018-01-19 | 温州沸鼎智能科技有限公司 | A kind of RFID children early education toy apparatus |
| CN107703704A (en) * | 2017-11-10 | 2018-02-16 | 深圳市中谷联创信息服务有限公司 | A kind of shared presentation card imaging device and its implementation |
| CN108281047B (en) * | 2018-02-09 | 2020-10-30 | 深圳市小猪班克教育科技有限公司 | Interactive intelligent story machine and interaction method thereof |
| CN108479057A (en) * | 2018-03-26 | 2018-09-04 | 郑州轻工业学院 | A kind of animated stories performance system based on natural human-computer interaction |
| US20200019370A1 (en) * | 2018-07-12 | 2020-01-16 | Disney Enterprises, Inc. | Collaborative ai storytelling |
| WO2020047815A1 (en) * | 2018-09-07 | 2020-03-12 | Zheng Shi | System and method for user created object, property, method, or event with physical manipulatives |
| CN109241331B (en) * | 2018-09-25 | 2022-03-15 | 北京光年无限科技有限公司 | Intelligent robot-oriented story data processing method |
| CN109828666B (en) * | 2019-01-23 | 2022-01-25 | 山东大学 | Mixed reality interaction system and method based on tangible user interface |
| CN110110098A (en) * | 2019-04-26 | 2019-08-09 | 张成虎 | A kind of multimedia interactive Logic layout system and its application method |
| CN112289092A (en) * | 2020-11-05 | 2021-01-29 | 大连民族大学 | Children teaching aid capable of recording and playing diary in click and projection modes |
| CN113254740B (en) * | 2021-05-25 | 2023-10-17 | 南京大学 | Visual system for child story creation |
| CN117271756A (en) * | 2023-11-21 | 2023-12-22 | 安徽淘云科技股份有限公司 | Text generation method, device, electronic equipment and readable medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201518164U (en) * | 2009-04-28 | 2010-06-30 | 中国科学院软件研究所 | Children-oriented network integrated authoring system |
| CN102136208B (en) * | 2011-03-30 | 2013-01-09 | 中国科学院软件研究所 | Material object programming method and system |
| CN102707804B (en) * | 2011-05-23 | 2015-03-25 | 中国科学院软件研究所 | Acceleration transducer based character action control method |
| CN102789713B (en) * | 2012-07-19 | 2015-04-15 | 中国科学院软件研究所 | Entity programming method and system based on infrared and wireless transmission technology |
| CN102800223B (en) * | 2012-07-19 | 2014-08-20 | 中国科学院软件研究所 | Collaborative entity programming method |
-
2013
- 2013-01-14 CN CN201310012991.0A patent/CN103093658B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN103093658A (en) | 2013-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103093658B (en) | Child real object interaction story building method and system | |
| CN109863510A (en) | Redundancy tracking system | |
| CN102789313B (en) | User interaction system and method | |
| CN103369303B (en) | Analysis of operative action record and the system and method for reproduction | |
| US20090273560A1 (en) | Sensor-based distributed tangible user interface | |
| CN106878390B (en) | Electronic pet interaction control method and device and wearable equipment | |
| EP1816552B1 (en) | Storage medium storing subject selecting program and subject selecting apparatus | |
| CN104769522A (en) | Remote control with 3D pointing and gesture recognition capabilities | |
| US20120167014A1 (en) | Visual surrogate for indirect experience and apparatus and method for providing the same | |
| US9092894B2 (en) | Display control device and display control program for grouping related items based upon location | |
| CN110908504B (en) | Augmented reality museum collaborative interaction method and system | |
| CN103357177A (en) | Using a portable gaming device to record or modify a game or application in real-time running on a home gaming system | |
| CN102301312A (en) | Portable Engine For Entertainment, Education, Or Communication | |
| CN103930944A (en) | Adaptive tracking system for spatial input devices | |
| CN103064514A (en) | Method for achieving space menu in immersive virtual reality system | |
| CN102460510A (en) | Spatial, multi-modal control device for use with spatial operating system | |
| Goldsmith et al. | Augmented reality environmental monitoring using wireless sensor networks | |
| CN108027663A (en) | Mobile equipment is combined with personnel tracking and is interacted for giant display | |
| CN107122109A (en) | A kind of multi-channel adaptive operating method towards three-dimensional pen-based interaction platform | |
| CN108228153B (en) | Cooperation-oriented entity programming method and system | |
| CN106371455B (en) | A kind of intelligent interactive method and system | |
| CN205302186U (en) | Virtual reality control system based on external input | |
| CN111134974B (en) | Wheelchair robot system based on augmented reality and multi-mode biological signals | |
| CN111421517A (en) | Programming education robot that intelligent terminal strengthened | |
| CN112809709B (en) | Robot, robot operating system, robot control device, robot control method, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150107 |