WO2015188671A1 - Method and system for programming moving actions of a moving object with functional objects - Google Patents
Method and system for programming moving actions of a moving object with functional objects Download PDFInfo
- Publication number
- WO2015188671A1 WO2015188671A1 PCT/CN2015/078556 CN2015078556W WO2015188671A1 WO 2015188671 A1 WO2015188671 A1 WO 2015188671A1 CN 2015078556 W CN2015078556 W CN 2015078556W WO 2015188671 A1 WO2015188671 A1 WO 2015188671A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- moving
- moving object
- programming
- actions
- interactive surface
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/039—Accessories therefor, e.g. mouse pads
- G06F3/0393—Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04809—Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
Definitions
- the present invention relates to programming the moving actions of a moving object, and more specifically, an interactive surface that enables a user to use functional objects to create computer programs.
- Computer programming is becoming a way of thinking and doing for the broader society, beyond the narrow confines of computer programming professionals, particularly as the Internet continues to be a transformative force in driving changes in almost every aspects of modern life. People are starting to learn computer programming at an ever-younger age, a trend encouraged and reinforced by programming tools and platforms specifically developed for younger children or beginners.
- the present invention discloses a novel way of programming the moving actions of a moving object using functional objects, in conjunction with an interactive surface.
- a moving object is placed on an interactive surface, and the moving object further includes a movement module.
- a plurality of functional objects are also placed on the interactive surface. Each of the functional objects is marked with a programming symbol related to a moving action.
- the functional objects are placed next to each other or on top of each other to form a structural pattern.
- a processor that is operatively linked to the interactive surface is configured to derive a set of moving actions from the structural pattern, and direct the moving object to perform the moving actions on the interactive surface.
- the moving object and each functional object further include an identifier
- the interactive surface is configured to recognize the identifier, location and orientation of the moving object and each functional object.
- the system further includes a memory that is configured to store a database of relationships among and between identifier, programming symbol and moving action.
- the system further includes a wireless communication means, and the processor is configured to direct the moving object to perform the moving actions by sending the moving object moving instructions via the wireless means. And the processor is configured to track the movement of the moving object based on the identifier, location and orientation of the moving object periodically and throughout the movement of the moving object on the interactive surface.
- the programming symbol represents a moving action to be performed by the moving object or a function for programming a moving action to be performed by the moving object.
- the identifier may be encoded with a passive radio frequency identification chip, an active radio frequency identification chip, a pattern of capacitive tabs, or a pattern of magnetic tabs.
- the sensory accessory can be an LED light, an audio device, a video device, or a vibration generator device.
- the processor is configured to direct a sensory accessory to produce an output related to the moving actions.
- FIG. 1 is an exemplary schematic diagram illustrating the system process flow in accordance with one embodiment of the present invention.
- FIGs. 2A and 2B are exemplary schematic diagrams illustrating the design of cards each assigned with a programming symbol in accordance with various embodiments of the present invention.
- FIG. 3 is an exemplary schematic diagram of the system for programming the moving actions of a moving object using a physical sheet in accordance with one embodiment of the present invention.
- FIG. 4 is an exemplary schematic diagram for a method for creating and running a computer program flow in accordance with one embodiment of the present invention.
- the embodiments of the present invention disclose a system and method for creating and running a computer program for moving an object using functional objects, typically cards, in conjunction with the use of an interactive surface.
- FIG. 1 is an exemplary schematic diagram illustrating the system process flow in accordance with one embodiment of the present invention.
- the system includes a moving object 101 and a plurality of functional objects 102.
- the moving object 101 further includes an identifier and a movement module.
- Each functional object 102 is embedded with an identifier, and marked with a programming symbol related to a moving action for the moving object 101 to perform.
- the identifier may be encoded with a passive radio frequency identification chip, an active radio frequency identification chip, a pattern of capacitive tabs, or a pattern of magnetic tabs.
- the functional object 102 can be a card, a button, a block, an icon, a sheet, or a figurine.
- Each programming symbol can take various forms and patterns and serve different functions. In this embodiment of the present invention, it represents either moving actions or programming functions.
- the system further includes an interactive surface 103, a processor 104 that is operatively linked to the interactive surface, a memory 105, and a wireless communication means.
- the interactive surface 103 recognizes the identifier, location and orientation of the moving object 101 and the functional objects 102 placed on or near the interactive surface 103 in real time.
- the memory 105 is operatively linked to the processor 104 and stores a database of relationships among and between identifiers, programming symbols and moving actions.
- the processor 104 derives a set of moving actions based on the programming symbols embedded in the structural pattern formed by the functional objects 102 placed on the interactive surface 103 and directs the moving object 101 to perform the set of moving actions by sending the moving object 101 moving instructions via the wireless means.
- the system described in FIG. 1 further includes a sensory accessory 106 that can be an LED light, an audio device, a video device, or a vibration generator device.
- the processor 104 directs the sensory accessory 106 to produce an output related to the moving actions of the moving object 101.
- FIGs. 2A and 2B are exemplary schematic diagrams illustrating the design of cards each assigned with a programming symbol in accordance with various embodiments of the present invention.
- moving action cards are used to represent moving actions performed by the moving object in different directions. As shown in FIG. 2A, the moving object could move up, down, left or right, could jump up or down, could keep moving forward, and could turn left or right.
- the moving action to be performed by the moving object is programmed using a few programming function cards. As shown in FIG. 2B, the examples include “If” , “Else” , “While” , “Until” , and “Loop” (and the number of “Loop” ) .
- the programming function cards also include cards representing subroutine functions, which are symbolized “P1” , “P2” .
- a subroutine is a sequence of program instructions that perform a specific task, packaged as a unit, depending on the programmer’s definitions. This unit can then be used in programs wherever that particular task should be performed, which reduces a lot of workload of coding.
- FIG. 3 is an exemplary schematic diagram of the system for programming the moving actions of a moving object using a physical sheet in accordance with one embodiment of the present invention.
- the system includes a physical sheet 302 with printed elements to lay out a maze placed on the interactive surface 301, and a set of cards 303, each visually marked with a programming symbol, placed on the coding area 310 of the physical sheet 302.
- Each card 303 is related to a moving action for a moving object 304 to perform.
- the moving object 304 further includes an identifier and a movement module.
- a set of moving actions are programmed to direct the moving object 304 trapped in a maze out of the maze, based on the programming symbols embedded in the structural pattern formed by the cards 303 placed on the coding area of the physical sheet 302.
- two categories of cards 303 printed with programming symbols are placed on the interactive surface 301 to program the moving actions of the moving object 304.
- moving action cards are used to represent movement of the moving object 304 in different directions
- the programming function card “P1” which is defined as a specific sequence of cards, is used to call a subroutine to reduce the number of cards used.
- Two function buttons, namely the run button 305 and the stop button 306, are located at the bottom of the physical sheet 302 for the user to interact with.
- the physical sheet 302 with printed elements to lay out a maze is first placed on top of the interactive surface 301, and then the moving object 304 is placed on the physical sheet 302.
- the interactive surface 301 detects the ID, location and orientation of the moving object 304 and transmits such information to the processor 308 that is operatively linked to the interactive surface 301.
- the physical sheet also includes an identifier that can be detected and recognized by the interactive surface 301.
- the interactive surface 301 detects the ID, location and orientation of the cards 303 placed on the interactive surface 301, and transmits such information to the processor 308.
- the processor 308 receives the information and derives a set of moving actions for the moving object to perform, based on the programming symbols embedded in the structural pattern formed by the cards 303 and a database of relationships among and between identifiers, programming symbols and moving actions stored in the memory 309.
- the processor 308 then directs the moving object 304 to perform the set of moving actions derived above by sending the moving object moving instructions via a wireless means (not shown) .
- the processor 308 also tracks the movement of the moving object 304 based on the identifier, location and orientation of the moving object periodically and throughout the movement of the moving object on the interactive surface 301.
- the user can run the computer program that has been created by pressing the play button 305, and the output is produced via a sensory accessory (not shown) , which can be arranged to produce an output to indicate the progress of execution of the set of moving actions.
- a sensory accessory (not shown) , which can be arranged to produce an output to indicate the progress of execution of the set of moving actions.
- an LED light may be attached to each card 303, and the LED light can be lighted when the moving action associated with that particular card 303 is being executed, which enables the user to visualize the execution of the moving actions by the moving object 304, and easily track any movement of the moving object 304 that does not execute as intended.
- the sensory accessory can also be an audio device, a video device, or a vibration generator device. If the user is unsatisfied with the actions derived or would like to debug, he may simply press the stop button 306 first, and then add, remove, or change cards to re-derive a set of moving actions.
- the execution of the moving actions directs the moving object 304 trapped in a maze out of the maze.
- the sequence of the cards used in this embodiment for programming the moving actions is as follows, “Procedure 1” , “Procedure 1” , and “move forward” .
- the sequence of the cards that defines the subroutine P1 is as follows, “move forward” , “turn left” , “move forward” , “turn right” .
- the complete set of moving actions derived from the programming symbols embedded in the structural pattern formed by the cards 303 are as follows: “move forward” , “turn left” , “move forward” , “turn right” , “move forward” , “turn left” , “move forward” , “turn right” , “move forward” .
- FIG. 4 is an exemplary schematic diagram for a method for creating and running a computer program flow in accordance with one embodiment of the present invention. As shown in FIG. 4, the method includes the following steps.
- Step 401 placing a moving object on or near an interactive surface.
- the moving object consists of an identifier and a movement module.
- Step 402 placing a plurality of functional objects on or near an interactive surface to form a structural pattern.
- Each object includes an identifier and is marked with a programming symbol related to a moving action for the moving object to perform.
- Step 403 recognizing the identifier, location and orientation of the moving object and each functional object by the interactive surface.
- the interactive surface detects the identifier, location and orientation of the moving object and each functional object placed on or near the interactive surface.
- Step 404 obtaining the programming symbol based on the identifiers of the functional objects.
- a database of correlation relationships between identifiers and programming symbols is stored in a memory, and the processor obtains a programming symbol for each functional object.
- Step 405 deriving a set of moving actions based on the programming symbols embedded in the structural pattern.
- a database of correlation relationship between programming symbols and moving actions is also stored in the memory.
- the processor derives a set of moving actions based on the location and orientation of the moving object and the programming symbols embedded in the structural pattern formed by the functional objects.
- Step 406 performing the set of moving actions by the moving object, as directed by the processor.
- the user can push a Play button to initiate the moving actions by the moving object, as shown in FIG. 3.
- Step 407 directing a sensory accessory to produce an output to indicate the progress of execution of the set of moving actions of the moving object.
- the system may include a sensory accessory, such as LED lights.
- a sensory accessory such as LED lights.
- an LED light may be attached to each functional object, and the LED light can be lighted when the moving action represented by a particular functional object is being executed, which enables the user to visualize the progress of execution of the set of moving actions of the moving object.
- Step 408 stopping the action of the moving object if it does not move as intended. For example, if the moving object in FIG. 3 does not move in the intended path, the user can stop its action by pushing a stop button.
- Step 409 debugging the computer program by rearranging the functional objects forming the structural pattern. The user can easily debug the computer program as the LED light will direct him to the functional object that is causing the problem.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Toys (AREA)
Abstract
Description
Claims (16)
- A system for programming moving actions, comprising:a moving object comprising a movement module;a plurality of functional objects, each marked with a programming symbol related to a moving action;an interactive surface; anda processor operatively linked to the interactive surface;wherein, the interactive surface recognizes the location and orientation of the moving object and the functional objects placed thereon in real time, and the processor derives a set of moving actions based on the programming symbols embedded in a structural pattern formed by the functional objects placed on the interactive surface, and directs the moving object to perform the set of moving actions based on the location and orientation of the moving object on the interactive surface.
- The system of claim 1, wherein the moving object and the functional object further comprise an identifier, and the interactive surface is configured to recognize the identifier.
- The system of claim 2, wherein the identifier is encoded with a means selected from a group consisting of a passive radio frequency identification chip, an active radio frequency identification chip, a pattern of capacitive tabs, and a pattern of magnetic tabs.
- The system of claim 2, wherein the processor is configured to track the movement of the moving object based on the identifier, location and orientation of the moving object periodically and throughout the movement of the moving object on the interactive surface.
- The system of claim 1, further comprising a wireless communication means, wherein the processor is configured to direct the moving object to perform the moving actions by sending the moving object moving instructions via the wireless means.
- The system of claim 1, wherein the programming symbol represents a moving action to be performed by the moving object or a programming function for programming a moving action to be performed by the moving object.
- The system of claim 1, further comprising a memory that is configured to store a database of relationships among and between identifiers, programming symbols and moving actions.
- The system of claim 1, further comprising of a sensory accessory selected from a group consisting of an LED light, an audio device, a video device, and a vibration generator device, wherein the processor is configured to direct the sensory accessory to produce an output related to the moving actions.
- A method for programming moving actions, comprising:- recognizing, by an interactive surface, the location and orientation of a moving object and a plurality of functional objects placed thereon in real time, wherein the moving object further comprises a movement module, and each functional object is marked with a programming symbol related to a moving action;- deriving, by a processor, a set of moving actions based on the programming symbols embedded in a structural pattern formed by the functional objects placed on the interactive surface;- directing, by the processor, the moving object to perform the set of moving actions based on the location and orientation of the moving object on the interactive surface.
- The method of claim 9, wherein the moving object and the functional object further comprise an identifier, and the method further comprising recognizing the identifier of the moving object or the functional object by the interactive surface.
- The method of claim 10, wherein the identifier is encoded with a means selected from a group consisting of a passive radio frequency identification chip, an active radio frequency identification chip, a pattern of capacitive tabs, and a pattern of magnetic tabs.
- The method of claim 10, further comprising, tracking the movement of the moving object by the processor based on the identifier, location and orientation of the moving object periodically and throughout the movement of the moving object on the interactive surface.
- The method of claim 9, further comprising a wireless communication means, and the method further comprising directing the moving object to perform the moving actions by sending the moving object moving instructions via the wireless means by the processor.
- The method of claim 9, wherein the programming symbol represents a moving action to be performed by the moving object or a programming function for programming a moving action to be performed by the moving object.
- The method of claim 9, further comprising a memory that is configured to store a database of relationships among and between identifiers, programming symbols and moving actions.
- The method of claim 9, further comprising of a sensory accessory selected from a group consisting of an LED light, an audio device, a video device, and a vibration generator device, and the method further comprising directing a sensory accessory to produce an output related to the moving actions by the processor.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/119,387 US20170083294A1 (en) | 2014-06-13 | 2015-05-08 | Method and system for programming moving actions of a moving object with functional objects |
CN201580014022.6A CN106164852A (en) | 2014-06-13 | 2015-05-08 | The method and system shift action of mobile object programmed with function object |
Applications Claiming Priority (12)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNPCT/CN2014/079891 | 2014-06-13 | ||
PCT/CN2014/079891 WO2015113358A1 (en) | 2013-03-12 | 2014-06-13 | System and method for operating computer program with physical objects |
CNPCT/CN2014/081721 | 2014-07-07 | ||
PCT/CN2014/081721 WO2015113376A1 (en) | 2014-01-30 | 2014-07-07 | System and method for computer programming with physical objects on interactive surface |
PCT/CN2014/084498 WO2015113395A1 (en) | 2014-01-30 | 2014-08-15 | System and method for directing a moving object on an interactive surface |
CNPCT/CN2014/084498 | 2014-08-15 | ||
CNPCT/CN2014/085668 | 2014-09-01 | ||
PCT/CN2014/085668 WO2015113399A1 (en) | 2014-01-30 | 2014-09-01 | System and method for directing a targeted object on an interactive surface to produce a response |
PCT/CN2014/086745 WO2015113404A1 (en) | 2014-01-30 | 2014-09-17 | System and method for directing small scale object to generate sensory output to user powered by rf energy harvesting |
CNPCT/CN2014/086745 | 2014-09-17 | ||
PCT/CN2015/072626 WO2015131746A2 (en) | 2014-03-06 | 2015-02-10 | A system and method for directing an object to move on an interactive surface through a defined path |
CNPCT/CN2015/072626 | 2015-02-10 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015188671A1 true WO2015188671A1 (en) | 2015-12-17 |
Family
ID=54837423
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/078556 WO2015188671A1 (en) | 2014-06-13 | 2015-05-08 | Method and system for programming moving actions of a moving object with functional objects |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2015188671A1 (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004063883A2 (en) * | 2003-01-09 | 2004-07-29 | Evolution Robotics, Inc. | Vision- and environment-based programming of robots and/or computer systems |
US20080084271A1 (en) * | 2006-10-06 | 2008-04-10 | Denny Jaeger | Continuous variable wireless data input to RFID reader |
CN102039045A (en) * | 2009-10-12 | 2011-05-04 | 朱立圣 | Electronic chessboard type game system |
-
2015
- 2015-05-08 WO PCT/CN2015/078556 patent/WO2015188671A1/en active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004063883A2 (en) * | 2003-01-09 | 2004-07-29 | Evolution Robotics, Inc. | Vision- and environment-based programming of robots and/or computer systems |
US20080084271A1 (en) * | 2006-10-06 | 2008-04-10 | Denny Jaeger | Continuous variable wireless data input to RFID reader |
CN102039045A (en) * | 2009-10-12 | 2011-05-04 | 朱立圣 | Electronic chessboard type game system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9268535B2 (en) | System and method for computer programming with physical objects on an interactive surface | |
JP6326143B2 (en) | System and method for computer programming with physical objects in interactive surfaces | |
EP3100147A1 (en) | System and method for computer programming with physical objects on interactive surface | |
US20160151714A1 (en) | System and method for directing a moving object on an interactive surface | |
CN106164852A (en) | The method and system shift action of mobile object programmed with function object | |
JP6328793B2 (en) | Running software applications on the robot | |
WO2020047815A1 (en) | System and method for user created object, property, method, or event with physical manipulatives | |
Wang et al. | TanPro-kit: a tangible programming tool for children | |
CN104064068B (en) | A kind of parent-child interaction learning method and realize the device of the method | |
CN110251941B (en) | Game picture self-adaption method and device, electronic equipment and storage medium | |
US20160162036A1 (en) | System and accompanying method for interacting with a card on an interactive surface | |
WO2015113440A1 (en) | System and method for changing the state of user interface element marked on physical objects | |
CN111701246B (en) | Decision configuration method and device for game AI | |
KR20160105824A (en) | System and method for computer programming with physical objects on interactive surface | |
CN203950454U (en) | A kind of parent-child interaction learning device | |
CN109375768A (en) | Interactive bootstrap technique, device, equipment and storage medium | |
WO2015188671A1 (en) | Method and system for programming moving actions of a moving object with functional objects | |
US20170083294A1 (en) | Method and system for programming moving actions of a moving object with functional objects | |
Bottino et al. | GAINE–A portable framework for the development of edutainment applications based on multitouch and tangible interaction | |
CN103853463A (en) | Voice controlling method and device | |
CN103400519A (en) | Method and device for evaluating user's operation | |
Wang et al. | Evaluating a tactile approach to programming Scratch | |
CN106846954B (en) | A kind of interactive digital method and apparatus | |
Bernardes et al. | Comprehensive model and image-based recognition of hand gestures for interaction in 3D environments | |
Streeter et al. | Detecting Gestures Through a Gesture-Based Interface to Teach Introductory Programming Concepts |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15806886 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15119387 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 23/05/2017) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15806886 Country of ref document: EP Kind code of ref document: A1 |