US20060258451A1 - Interactive surface game system based on ultrasonic position determination - Google Patents

Interactive surface game system based on ultrasonic position determination Download PDF

Info

Publication number
US20060258451A1
US20060258451A1 US11/125,280 US12528005A US2006258451A1 US 20060258451 A1 US20060258451 A1 US 20060258451A1 US 12528005 A US12528005 A US 12528005A US 2006258451 A1 US2006258451 A1 US 2006258451A1
Authority
US
United States
Prior art keywords
ultrasonic
game system
unit
interactive surface
surface game
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/125,280
Inventor
Shih-Chin Yang
Original Assignee
Shih-Chin Yang
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shih-Chin Yang filed Critical Shih-Chin Yang
Priority to US11/125,280 priority Critical patent/US20060258451A1/en
Publication of US20060258451A1 publication Critical patent/US20060258451A1/en
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00Games not otherwise provided for
    • A63F9/18Question-and-answer games
    • A63F9/183Question-and-answer games electric
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00Games not otherwise provided for
    • A63F9/24Electric games; Games using electronic circuits not otherwise provided for
    • A63F2009/2401Detail of input, input devices
    • A63F2009/2402Input by manual operation
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00Games not otherwise provided for
    • A63F9/24Electric games; Games using electronic circuits not otherwise provided for
    • A63F2009/2483Other characteristics
    • A63F2009/2488Remotely playable
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F9/00Games not otherwise provided for
    • A63F9/0078Labyrinth games

Abstract

A system for users to play games on regular surface (201) such as printed material is provided. The system consists of an ultrasonic pointing unit (216), an ultrasonic base unit (213), a control unit (220) and a response unit (240), together with response data (500) and game rules (1100). The user interacts with the surface (201) by placing the ultrasonic pointing unit (216) on various areas of the surface (10). Ultrasonic wave propagates between the ultrasonic point unit (216) and ultrasonic base unit (213). By measuring multiple time-of-flight of ultrasonic wave, the location of the ultrasonic pointing unit (216) could be determined, and the device makes appropriate audio or other responses. Also, with the additions of game rules (1100), the system could ask users questions, or instruct users to tracing pictures or letters, or instruct users to walk a maze, etc. A surface (201) is thereby transformed into an interactive experience with various sound or visual effects. The sound effects or other response data (540) and game rules (1100) are stored in data storage (230) accessible by the control unit (220). Any number of different surfaces (201) can be used as long as the specific response data (540) for each different surface (201) is stored in data storage (230) accessible by the control unit (220).

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • U.S. patent application Ser. No. 10/390,271.
  • BACKGROUND
  • 1. Field of Invention
  • The present invention relates generally to the area of electronic entertainment and educational devices and, more specifically, to a device that allows a user to play games.
  • 2. Description of Prior Art
  • There are different kinds of game devices in existence for users to play games. Those devices include TV game consoles like Nitendo's GameCube, Sony's PS2, Microsoft's Xbox, or interactive learning platform like Leapfrog's leappad that allows users to play games with books, or game software for computers. Usually those devices need an input device for the game device to know the position of a user's intention. Joysticks are very common input devices for users to play games on TV game consoles and computers. Also, Leapfrog's leappad uses a RF pen to serve an input device for the interactive learning platform. Since the leappad system would need a sensory board underneath a book or a board game, the sensory board would limit the size of a book or a board game.
  • In a US patent published application, numbered 20040180316, an interactive book system based on ultrasonic position determination is described. The system responds to where a user points, but the system doesn't include any game rules found in other game devices, thus it makes the system less entertaining.
  • Ultrasonic technique has been used in different industries, robotics use the technique for obstacle avoidance by measuring the time elapsed between transmitted ultrasonic waves and received echoed ultrasonic wave. Also, there existed beacons that could track the position of robotics by triangulation of ultrasonic wave. Since those systems were not designed for game system, so game rules were not explored by those systems.
  • There are virtual reality systems or location tracking systems that use ultrasonic triangulation for position and movement measurement, like Logitech Tracker (http://www.vrealities.com/logitech.html). Since those systems serve as an input peripheral to personal computers or workstations, the system itself does not incorporate any game rule. Also, the cost of those systems are very high, due to its use of more than 2 ultrasonic receivers necessary to determine a position in a 2 dimensional space.
  • There are also computer input devices like mimio (www.mimio.com) that uses ultrasonic technique to track the position of a pen, and provide input to personal computers or workstations. But like digital tablet, those systems are used for computer input. The input device itself does not incorporate any game rules.
  • SUMMARY
  • It is an object of present invention to provide a new game device.
  • It is another object of the present invention to add game rules as new elements to interactive book system based on ultrasonic position determination;
  • It is an additional object of the present invention to provide a device that allows intuitive operation;
  • It is another object of the present invention to provide a flexible device that works with any properly designed game content software.
  • It is another object of the present invention to operate with 3D objects located on 2D surface.
  • These and other objects are accomplished by an ultrasonic position determination device, together with a surface, a control unit and a response unit, with the addition of game rules. The surface is 2 dimensional essentially. Material of the surface is not limited to particular form. The surface would have visual icons on it, the types of visual icons include but not limited to picture, text, photos, etc.
  • A typical game rule is question and answer, the control and response unit asks the user a question according to the game rule, the user has to answer it by pointing a particular visual icon on the surface. If the visual icon corresponds to the right answer, then the control and response unit could generate encouraging sound like “Excellent” or add a score to the user. There are numerous other game rules, including but not limited to tracing dots, walking mazes, etc.
  • The interactive surface game system comprises of an ultrasonic position determination device, a surface, a control unit, a response unit and game rules. The ultrasonic position determination device includes a pointing unit and a base unit. A user positions the pointing unit to select a visual icon that he or she is interested in on a surface. The pointing unit and base unit together determine the coordinate that the user selects. This coordinate is input to the control unit, then the control unit would search for the response data, e.g. sound, then present the response data to the user via a response unit, e.g. a speaker. Also, game rules such as question and answer are added to the system, so it is more entertaining. The pointing unit could be in any shape, including but not limited to pen, airplane, truck, train, car, characters, etc. Also, it could be a remote controlled unit, for example, a R/C car. Also, the pointing unit could be tethered or cordless.
  • The pointing unit has at least one ultrasonic transducer, and the base unit has at least 2 ultrasonic transducers at a known distance with respective to each other. Thus, at least 2 time-of-flight of ultrasonic wave could be measured between pointing unit and base unit. Time-of-flight could be translated to distance given sound speed. And further, by means of triangulation, 2-dimensional coordinate could be determined with 2 distances between pointing unit and base unit. And 3-dimensional coordinate could be determined with 3 distances between pointing unit and base unit.
  • The control unit could be a micro-controller or an application specific IC that could accept position of pointing device as input, and search for response data corresponding to that position, then optionally processes (e.g. decodes) the found response data (e.g. ADPCM speech or MP3 music), then output the response data through designated response unit (e.g. a speaker). Also, the control unit would be able to process the game rule, and interact with user according to the game rule. For example, when a user answers correctly for a question by pointing at the right visual icon, the control unit could output encouraging sound or add a score.
  • The response data and game rule could be stored in internal data storage, e.g. NAND flash memory, masked ROM, etc. Or it could be stored in external data storage, e.g. nonvolatile Memory card, optical disk, hard disk, etc. Data storage could be accessed by control unit through various wired or wireless channel, e.g. data bus, USB port, RS-232 port, Bluetooth, 802.11b, Ethernet, etc.
  • The response unit could include various sensible outputs, e.g. speaker, LEDs, LCD, etc. It accepts input from control unit, and presents the response data to the user.
  • Since the present invention is capable of determining a user's selected point on a surface and producing corresponding sound or other sensible outputs, with game rules, the system provides an innovative surface game on a regular surface.
  • DRAWING FIGURES
  • The objects and features of the present invention, which are believed to be novel, are set forth with particularity in the appended claims. The present invention, both as to its organization and manner of operation, together with further objects and advantages, may best be understood by reference to the following description, taken in connection with the accompanying drawings.
  • FIG. 1 shows a regular surface with visual icons
  • FIG. 2 shows the functional block diagram of present invention
  • FIG. 3 outlines the principle of ultrasonic position determination device
  • FIG. 4 illustrates one embodiment of ultrasonic position determination device based on threshold
  • FIG. 5 shows one embodiment of logical organization of response data in data storage
  • FIG. 6 shows a regular surface having a plurality of visual icons and their corresponding rectangular area
  • FIG. 7 shows one embodiment of response unit
  • FIG. 8 shows the perspective view of an interactive surface game system
  • FIG. 9 is the open view of interactive surface game system
  • FIG. 10 is the perspective view of one embodiment of ultrasonic pointing unit system
  • FIG. 11 shows one embodiment of logical organization of game rules in data storage
  • REFERENCE NUMERALS IN DRAWINGS
      • 10 Regular surface
      • 11 Surface number
      • 13 Graphic
      • 16 Text
      • 200 Functional block diagram
      • 201 Surface
      • 210 Ultrasonic position determination device
      • 213 Ultrasonic base unit
      • 216 Ultrasonic pointing unit
      • 220 Control unit
      • 230 Data storage
      • 240 Response unit
      • 270 Control unit interface with ultrasonic position determination device
      • 300 Triangulating position of ultrasonic pointing unit
      • 310.a Ultrasonic transducer of base unit
      • 310.b Ultrasonic transducer of base unit
      • 313 Distance between 310.a and 310.b
      • 320 Ultrasonic transducer of pointing unit
      • 321.a Distance between 320 and 310.a
      • 321.b Distance between 320 and 301.b
      • 323 Coordinate of ultrasonic pointing unit
      • 400 One embodiment of ultrasonic position determination device
      • 410 Micro-controller
      • 412 User trigger interrupt
      • 422 Transmit ISR
      • 424.a Receive ISR a
      • 424.b Receive ISR b
      • 426 Position calculation routine
      • 430.a, 430.b Counter
      • 433 4 MHz crystal oscillator
      • 440 40 KHz pulse generator
      • 450.a, 450.b signal amplifier
      • 453.a, 453.b signal comparator
      • 500 One embodiment of organization of response data
      • 510 Response data record
      • 520 Identifier
      • 530 Area descriptor
      • 540 Response data
      • 620 Upper-leftmost corner of rectangle
      • 623 Length of rectangle
      • 626 Width of rectangle
      • 700 One embodiment of response unit
      • 711 Audio driver software
      • 713 Audio circuit
      • 715 Speaker
      • 721 LCD driver software
      • 723 LCD driver circuit
      • 725 LCD
      • 731 LED driver software
      • 733 LEDs driver circuit
      • 735 LEDs
      • 800 Preferred embodiment of present invention
      • 841 Keypad
      • 843 Power switch
      • 850 Memory card
      • 900 Open view of preferred embodiment 800
      • 910 PCB
      • 940 Micro controller of control unit
      • 950 Micro-controller of ultrasonic position determination device
      • 953 Memory card connector
      • 961 ICs for driving speaker, LEDs, LCD
      • 1000 One embodiment of ultrasonic pointing unit
      • 1001 Tip of embodiment 1000
      • 1003 Cable of embodiment 1000
      • 1100 One embodiment of logical organization of game rules
      • 1110 Game rule record
      • 1120 Game rule ID
      • 1130 Game data
      • 1140 Action data
    DETAILED DESCRIPTION
  • This chapter explains present invention in such greater detail so any person skilled in the art would be readily able to make a product based on the outlined principle. One preferred embodiment of present invention is shown, it is obvious that various embodiments could be derived from principle of present invention.
  • “Visual icon” used herein refers to graph, text, picture, photo or any other objects that conveys meanings through vision, a visual icon could be 2 or 3 dimensional.
  • “Surface” used herein could be of any material, including but not limited to paper, wood, plastics, stone, glass, acrylic, etc. And it could be of any area, including but not limited to table, floor, wall, book, map, mat, mirror.
  • “Data storage” used herein refers to any device that could store data, such as memory cards (e.g. compact flash card, smartmedia card, secure digital card, multimedia card, etc.), optical disk (e.g. CD-ROM, DVD-ROM), magnetic media (e.g. hard drive, tape).
  • “Response data” used herein refers to data that responds to a user's input. It could be data that represents sensible output such as sound, speech, music, flashing of LEDs (Light emitting devices), picture, video or motion emulation shown on LCD (Liquid crystal display), or control of internal components such as volume control, brightness control of LCD, change of surface, etc.
  • “Game rules” used herein refer to a collection of instructions that enable a user to play games. For example, a game rule consists of a question and an answer. In the question and answer game, the system asks the user a question, and it expects the user to give a right answer. In another example, a game rule is a tracing game that instructs the user to trace a letter, or an animal. There are numerous other types of game rules, including but not limited to walking a maze, memory game, matching game, etc.
  • FIG. 1 shows a regular surface 10. On surface 10, several graphics 13 and texts 16 exist. This regular surface 10 is not interactive by nature, since it does not accept user input nor produce output. An object of present invention is to provide game activity for a regular surface 10. Another object of present invention is intuitive usage, when a user points at a visual icon like graphic 13 or text 16 or surface number 11, a response would be immediately provided by present invention. It is another object of present invention to work with a regular surface that does not require special attachment of buttons or electronics on it. Those objects collectively would make this system more easy to use, more fun to use and cheaper to produce.
  • FIG. 2 depicts the functional block diagram 200 of presentation. It is shown that present invention consists of a surface 201, an ultrasonic position determination device 210, a control unit 220, data storage 230 and a response unit 240. Ultrasonic position determination device 210 further consists of an ultrasonic base unit 213 and an ultrasonic pointing unit 216. Ultrasonic pointing unit 216 is used by a user to point at a visual icon on a regular surface with visual icons 201 that he or she would like to interact with. Once said visual icon is pointed at, ultrasonic position determination device 210 would be able to calculate the coordinate of ultrasonic pointing unit 216. Said coordinate is input to control unit via interface 273. Based on said coordinate, control unit would search for response data correspond to it in data storage 230. Said response data could be processed and destine for its output via response unit 240, or it could be used as control data for other components like volume control. Response unit 240 may include a plurality of output such as speaker for audible response data, LEDs or LCD for visual effect. It is thus the great advantage of present invention, since it provides an intuitive way for a user to point at a visual icon then get the response. It is another great advantage of present invention since it employs ultrasonic position determination device 210.
  • Unlike prior arts that generally use a sensor board placed underneath surface, present invention doesn't require said sensor board, thus make it more economical to accommodate large and thick surface.
  • FIG. 3 outlines the principle 300 of ultrasonic position determination device. Ultrasonic base unit includes a pair of ultrasonic transducers 310.a and 310.b located apart at a known distance “W” 313. Ultrasonic pointing unit includes an ultrasonic transducer 320. Given measured distance “a” 321.a between transducers 310.a and 320, as well as distance “b” 321.b between transducers 310.b and 320. Position of ultrasonic pointing unit, (X, Y) 323, could be triangulated using “W” 313, “a” 321.a and “b” 321.b. The same principle could be applied to a 3 dimensional space as well. It is a known and mature technique to measure distance using ultrasonic wave, which derive distance by measuring time-of-flight of ultrasonic wave propagating between 2 corresponding ultrasonic transducers. A common technique is to measure time-of-flight by threshold.
  • FIG. 4 illustrates one embodiment 400 of ultrasonic position determination device based on threshold. The device decides arrival of ultrasonic wave when its received signal level exceeds a threshold. The use of threshold is to avoid wrong decision if background noise exists. A 4 MHz crystal oscillator 433 clocks 2 counters 430.a and 430.b, which are initially reset to zero. When a user points at a visual icon using ultrasonic pointing unit 216, an interrupt 412 to micro-controller 410 is triggered. Transmit interrupt service routine 422 is invoked to serve the interrupt, which in turn triggers the 40 KHz pulse generator 440 to produce 20 cycles of pulse, which in turn is converted to ultrasonic wave transmitted by ultrasonic transducer 320 of ultrasonic pointing unit 216. In the mean time, counters 430.a, 430.b are triggered to run according to the clock. Said transmitted ultrasonic wave propagates then is received by ultrasonic transducers 310.a, 310.b of ultrasonic base unit 213. Said received signals are amplified by stages of 450.a, 450.b respectively, then are compared against a threshold by comparators 453.a, 453.b respectively. Once signal level exceeds said threshold, comparator 453.a, 453.b produce a pulse respectively, which stops the running of counters 430.a, 430.b respectively. Interrupts 414.a, 414.b indicates the stop of counter 430.a and 430.b respectively. Receive interrupt service routines 424.a, 424.b serve interrupts 414.a, 414.b respectively. Receive interrupt service routines 424.a, 424.b read counters 430.a, 430.b respectively.
  • Counter values are converted to time by multiplying with period of 4 MHz crystal oscillator. Thus distance “a” 312.a between transducers 320 and 310.a could be calculated by multiplying time with sound-speed, so does distance “b” 312.b between transducers 320 and 310.b. Position calculation routine 426 is invoked to calculate the position (X, Y) 323 of ultrasonic pointing unit 216.
  • Other techniques exist to determine the position of ultrasonic pointing unit 216. In principle, they base on time-of-flight of ultrasonic wave.
  • Once position (X, Y) 323 of ultrasonic pointing unit 216 is determined. (X, Y) 323 serve as input to control unit 220. Based on (X, Y) 323, control unit 216 searches for response data corresponding to (X, Y) 323 in data storage 230. In accordance with present invention, FIG. 5 shows one embodiment 500 of logical organization of response data in data storage 230. Data storage 230 contains a set of response data records 510, each response data record 510 consists of identifier 520, area descriptor 530, response data 540. Identifier 520 is used to uniquely identify a response data record. Area descriptor 530 is used to approximate an area occupied by a visual icon using a rectangle. Area descriptor is represented in a vector form (P, X′, Y′, L, W), P denotes surface number, (X′, Y′) denotes coordinate of upper-leftmost point of said rectangle. L and H are the length and width of said rectangle, respectively. Response data 540 is data that responds to user. When control unit 220 receives position (X, Y) 323 of ultrasonic pointing unit 216, control unit 220 finds a response data record 510 whose associated area descriptor 530 having said rectangle covers (X, Y) 323. If a response data record is found, then control unit 220 retrieves the corresponding response data 540. Control unit 220 processes retrieved response data 540 according to its type. For example, it could decode ADPCM speech, MP3 music before direct them to audio output in response unit 240.
  • FIG. 6 shows a regular surface 10 having a plurality of visual icons. Area of each visual icon is approximated by a rectangle describing by a surface number P 11, coordinate of upper-leftmost point (X′, Y′) 620, length L 623, width 626. Once a visual icon is pointed at using ultrasonic point unit 216, the associated rectangle could thus be identified, and its associated response data 540 could be retrieved. Thus, the use of present invention is intuitive, since it provides “What you point is what you get” capability.
  • FIG. 7 shows one embodiment 700 of response unit 240. An audio circuit 713 drives a speaker 715 for audio output. Control unit 220 implements audio driver software 711 to output audio response data to audio circuit 713. A LCD driver circuit 723 drives a LCD for visual output. Control unit 220 implements LCD driver software 721 to output visual response data to LCD driver circuit. A LED driver circuit drives an array of LEDs. Control unit 220 implements LED driver software 731 to output visual response data. With the sound produced by speaker 715, graphics or video shown on LCD 735 or flashing LEDs 735, reading becomes an entertaining activity.
  • FIG. 8 shows the perspective view of an interactive book system 800 in accordance with present invention. Interactive book system 800 includes a surface 201. Surface 201 consists of at least one regular surface 10 on which several graphics 13 and texts 16 are printed. Interactive book system further includes an ultrasonic position determination device 210 (not shown on this Figure). Ultrasonic position determination device 210 further consists of an ultrasonic base unit 213 (not shown here) and an ultrasonic pointing unit 216. Ultrasonic pointing unit 216 has the shape of a pen, thus making it natural to use. Ultrasonic base unit 213 further includes 2 ultrasonic transducers 310.a and 310.b. Ultrasonic pointing unit 216 further includes an ultrasonic transducer 320. Interactive system book 800 further includes a memory card 850 where response data 500 is stored. Memory card 850 is accessible by control unit 220 (not shown on this Figure) to retrieve response data 540. Interactive system book 800 further includes a keypad 841 for user to enter surface number 11, and a power switch 843 for turning on or off the system. Interactive system book 800 further includes a response unit 240 (not shown on this Figure) to respond to a user's input. Response unit 240 further consists of a speaker 715, LEDs 735, a LCD 725. Excluding surface 201, interactive book system 800 could be made in a 6″×3″×2″ form, and it could work with surface 201 as large as 24″×24″×1″ (e.g. a big book of maps). Unlike prior arts, it would impossible or very expensive to make a system with capabilities of present invention.
  • FIG. 9 is the open view 900 of interactive book system 800. Components are mounted on a PCB 910. Components invisible in FIG. 8 are shown in this figure. Micro controller 940 is used in control unit 220. Micro-controller 950 is used in ultrasonic position determination device. There are ICs 961 for driving speaker, LCD and LEDs. And there is a connector 953 for memory card 850. Since the number of components of present invention is relatively small, so interactive book system 800 is relatively cheap to make.
  • FIG. 10 is the perspective view of one embodiment 1000 of an ultrasonic pointing unit 216 used in interactive book system 800. Embodiment 1000 is a pen like unit with a tip 1001. Once tip 1001 is pressed, interrupt 412 would be triggered. And pulses of 40 KHz ultrasonic waves would be transmitted from ultrasonic transducer 320. Beam angle of ultrasonic transducer 320 is omni-directional, so embodiment 1000 could be used with ease without careful orientation toward ultrasonic transducers 310.a, 310.b of ultrasonic base unit 213. Embodiment 1000 further includes a cable 1003 connecting to micro-controller 410. Since embodiment 1000 is a pen like unit, so interactive book system 800 is natural and intuitive to use.
  • FIG. 11 shows one embodiment 1100 of logical organization of game rules. The games rules are a collection of game rule records 11110. Each game rule 11110 consists of game rule ID 1120, game 1130 and action 1140. A game 1130 is a question 1150 and answer 1160. In present embodiment, the system would ask user a question 1150, then expect the right answer 1160, then adding scores if the user answers correctly.
  • Operation
  • In accordance with present invention, use of preferred embodiment 800 consists of following steps
      • Turn on power of system by using power switch 843;
      • Place a surface 10;
      • Enter a surface number 11 by using keypad 841;
      • Select a visual icon by using ultrasonic pointing unit 216;
      • User would get immediate response corresponding to selected visual icon from speaker, LEDs or LCD.
      • The system asks the user a question, then expects the user to answer The user answers the questions by pointing at a visual icon
      • If the user answers correctly, the system would respond by adding a score or producing an encouraging sound.
  • The use of preferred embodiment 800 is shown to be easy, intuitive. The additional sound or visual effects provided by present invention could help engage users to interact with a surface with visual icons 201. It is particularly useful for language learning or storytelling, and make reading a more entertaining process. Also, it could make a tradition R/C toy to interact on the surface.
  • In accordance with present invention, principle of design and one preferred embodiment are shown in this chapter. It is clear that anyone skilled in the art would be readily to make different embodiments of present invention, thus the description herein should not be used to limit the scope of present invention.

Claims (49)

1. An interactive surface game system for allowing a user to play games on a surface, the interactions being determined according to visual icons depicted on the surface and the response data, with the addition of game rule. The system comprising:
an ultrasonic position determination device having an ultrasonic pointing unit and an ultrasonic base unit.
a surface, said surface contains visual icons. Some of said visual icons have response data associated with them. Said response data is stored in data storage.
a response unit.
a control unit for locating the response data corresponding to a said visual icon according to the location of said ultrasonic pointing device. Said control unit processes game rules.
Game rules to be processed by control unit in order to provide game activity to said user.
2. The interactive surface game system of claim 1, wherein said ultrasonic position determination device further includes means for determining the position of said ultrasonic pointing unit by measuring time-of-flight of ultrasonic wave propagating between said ultrasonic pointing unit and base unit.
3. The interactive surface game system of claim 1, wherein said ultrasonic position determination device further includes means for determining the position of said ultrasonic pointing unit by measuring difference of time-of-flight of ultrasonic wave propagating between said ultrasonic pointing unit and base unit.
4. The interactive surface game system of claim 1, wherein said ultrasonic base unit includes at least 2 ultrasonic transducers. Said ultrasonic transducers are located in fixed positions relative to each other.
5. The interactive surface game system of claim 1, wherein said ultrasonic pointing unit includes at least one ultrasonic transducer.
6. The interactive surface game system of claim 3, wherein said means for determining the position of said ultrasonic pointing device include measurement of at least 2 time-of-flight of ultrasonic wave propagating between said ultrasonic pointing unit and base unit.
7. The interactive surface game system of claim 3, wherein said means for determining the position of said ultrasonic pointing device further include a method of calculating the position of said ultrasonic point device by triangulating multiple time-of-flight. The method comprising:
calculating the distance between a said ultrasonic transducer of said ultrasonic pointing unit and a said ultrasonic transducer of said ultrasonic base unit by multiplying said time-of-flight with sound speed.
calculating 2 dimensional position of said ultrasonic pointing unit based on at least 2 calculated distances between ultrasonic pointing unit and transducers of ultrasonic base unit and known distance between transducers of said ultrasonic base unit. Said calculation is based on triangulation.
8. The interactive surface game system of claim 3, wherein said means for determining the position of said ultrasonic pointing device further include a method of calculating the position of said ultrasonic point device by triangulating multiple time-of-flight. The method comprising:
calculating the distance between a said ultrasonic transducer of said ultrasonic pointing unit and a said ultrasonic transducer of said ultrasonic base unit by multiplying said time-of-flight and sound speed.
calculating 3 dimensional position of said ultrasonic pointing unit based on at least 3 calculated distances between ultrasonic pointing unit and transducers of ultrasonic base unit and known distance between transducers of said ultrasonic base unit. Said calculation is based on triangulation.
9. The interactive surface game system of claim 1, wherein said surface is paper.
10. The interactive surface game system of claim 1, wherein said surface is plastic.
11. The interactive surface game system of claim 1, wherein said surface is wood.
12. The interactive surface game system of claim 1, wherein said surface has 3D objects on it.
13. The interactive surface game system of claim 1, wherein said surface can be detached from other said units.
14. The interactive surface game system of claim 1, wherein said visual icon is text.
15. The interactive surface game system of claim 1, wherein said visual icon is graphic.
16. The interactive surface game system of claim 1, wherein said visual icon is picture.
17. The interactive surface game system of claim 1, wherein said visual icon is photo.
18. The interactive surface game system of claim 1, wherein said visual icon is symbol.
19. The interactive surface game system of claim 1, wherein said response data is audible data.
20. The interactive surface game system of claim 1, wherein said response data is visual data.
21. The interactive surface game system of claim 1, wherein said response data is control data.
22. The interactive surface game system of claim 1, wherein said data storage is flash memory.
23. The interactive surface game system of claim 1, wherein said data storage is memory card.
24. The interactive surface game system of claim 1, wherein said data storage is external hard drive.
25. The interactive surface game system of claim 1, wherein said data storage is external optical drive.
26. The interactive surface game system of claim 1, wherein said response unit further includes an audio output.
27. The interactive surface game system of claim 1, wherein said response unit further includes visual output
28. The interactive surface game system of claim 1, wherein said control unit includes a micro controller and access means to said data storage.
29. The interactive surface game system of claim 37, wherein said access mean is wired connection.
30. The interactive surface game system of claim 37, wherein said access mean is wireless connection.
31. The interactive surface game system of claim 37, wherein said micro controller further includes a program to search and present said response data. The program comprises:
a routine to search for response data corresponding to said visual icon according to position of said ultrasonic pointing unit.
a routine to determine the response unit output for said response data.
a routine to present response data to said user via said output of response unit.
32. The interactive surface game system of claim 40, wherein said program further include a routine to process response data before present response data.
33. The interactive surface game system of claim 40, wherein said program further include a routine to decode response data before present response data.
34. The interactive surface game system of claim 37, wherein said micro controller further includes a program to process game rules.
35. The interactive surface game system of claim 1, wherein the user interacts with said surface by positioning said ultrasonic pointing device on a said visual icon.
36. The interactive surface game system of claim 44, wherein said user triggers the propagation of ultrasonic wave between said ultrasonic pointing unit and base unit.
37. The interactive surface game system of claim 45, wherein said time-of-flight of ultrasonic wave propagating between said ultrasonic pointing unit and base unit is measured.
38. The interactive surface game system of claim 46, wherein said position of ultrasonic pointing device is determined by said means for determining position of ultrasonic pointing device.
39. The interactive surface game system of claim 47, wherein said position of ultrasonic pointing device is input to said control unit.
40. The interactive surface game system of claim 48, wherein said control unit search for response data corresponding to said visual icon according to position of said ultrasonic pointing device.
41. The interactive surface game system of claim 49, wherein said control unit present response data to said user via said response unit.
42. The interactive surface game system of claim 1, wherein said pointing unit is a pen.
43. The interactive surface game system of claim 1, wherein said pointing unit is a toy car.
44. The interactive surface game system of claim 1, wherein said pointing unit is a toy airplane.
45. The interactive surface game system of claim 1, wherein said pointing unit is a toy characters.
46. The interactive surface game system of claim 1, wherein said pointing unit is a remote control toy.
47. The interactive surface game system of claim 1, wherein said game rules are questions and answers.
48. The interactive surface game system of claim 1, wherein said game rules are tracing letters or pictures.
49. The interactive surface game system of claim 1, wherein said game rules are walking mazes.
US11/125,280 2005-05-10 2005-05-10 Interactive surface game system based on ultrasonic position determination Abandoned US20060258451A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/125,280 US20060258451A1 (en) 2005-05-10 2005-05-10 Interactive surface game system based on ultrasonic position determination

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11/125,280 US20060258451A1 (en) 2005-05-10 2005-05-10 Interactive surface game system based on ultrasonic position determination
PCT/IB2005/052690 WO2006120508A1 (en) 2005-05-10 2005-08-15 Interactive surface game system based on ultrasonic position determination
EP20050774287 EP1885465A1 (en) 2005-05-10 2005-08-15 Interactive surface game system based on ultrasonic position determination

Publications (1)

Publication Number Publication Date
US20060258451A1 true US20060258451A1 (en) 2006-11-16

Family

ID=37396226

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/125,280 Abandoned US20060258451A1 (en) 2005-05-10 2005-05-10 Interactive surface game system based on ultrasonic position determination

Country Status (3)

Country Link
US (1) US20060258451A1 (en)
EP (1) EP1885465A1 (en)
WO (1) WO2006120508A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060287025A1 (en) * 2005-05-25 2006-12-21 French Barry J Virtual reality movement system
US20070164315A1 (en) * 2004-11-23 2007-07-19 Cree, Inc. Cap Layers Including Aluminum Nitride for Nitride-Based Transistors and Methods of Fabricating Same
US20090176544A1 (en) * 2006-05-09 2009-07-09 Koninklijke Philips Electronics N.V. Gaming system with moveable display
US20110077757A1 (en) * 2009-09-30 2011-03-31 Industrial Technology Research Institute Touchless input device
US20110077065A1 (en) * 2009-09-29 2011-03-31 Rudell Design, Llc Game set with wirelessly coupled game units
US20120135793A1 (en) * 2010-11-30 2012-05-31 Intralot International Limited Lottery game system and method of playing
WO2017111626A1 (en) 2015-12-22 2017-06-29 University Of The Philippines Diliman A wireless network of adaptable tap sensitive surfaces
US9871184B2 (en) 2013-05-06 2018-01-16 Lokdon Llc System and a method for emitting an ultrasonic signal

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2875033A1 (en) * 2014-12-17 2016-06-17 Fayez Idris Contactless tactile feedback on gaming terminal with 3d display
US9672689B2 (en) 2014-12-17 2017-06-06 Igt Canada Solutions Ulc Gaming system with movable ultrasonic transducer

Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4103895A (en) * 1976-03-19 1978-08-01 Pressman Gerald L Concealed pattern detection game
US4636996A (en) * 1984-05-25 1987-01-13 Casio Computer Co., Ltd. Ultrasonic obstacle location apparatus and method
US4814552A (en) * 1987-12-02 1989-03-21 Xerox Corporation Ultrasound position input device
US4955000A (en) * 1986-07-17 1990-09-04 Nac Engineering And Marketing, Inc. Ultrasonic personnel location identification system
US5174759A (en) * 1988-08-04 1992-12-29 Preston Frank S TV animation interactively controlled by the viewer through input above a book page
US5239464A (en) * 1988-08-04 1993-08-24 Blair Preston E Interactive video system providing repeated switching of multiple tracks of actions sequences
US5354057A (en) * 1992-09-28 1994-10-11 Pruitt Ralph T Simulated combat entertainment system
US5356296A (en) * 1992-07-08 1994-10-18 Harold D. Pierce Audio storybook
US5364108A (en) * 1992-04-10 1994-11-15 Esnouf Philip S Game apparatus
US5413486A (en) * 1993-06-18 1995-05-09 Joshua Morris Publishing, Inc. Interactive book
US5515631A (en) * 1994-10-12 1996-05-14 Nardy; Gino J. Book scroll device
US5686942A (en) * 1994-12-01 1997-11-11 National Semiconductor Corporation Remote computer input system which detects point source on operator
US5734370A (en) * 1995-02-13 1998-03-31 Skodlar; Rafael Computer control device
US5842869A (en) * 1997-10-22 1998-12-01 Mcgregor; John Method and apparatus for displaying question and answer data on plural displays
US6064855A (en) * 1998-04-27 2000-05-16 Ho; Frederick Pak Wai Voice book system
US6188388B1 (en) * 1993-12-28 2001-02-13 Hitachi, Ltd. Information presentation apparatus and information display apparatus
US6301231B1 (en) * 1998-06-02 2001-10-09 Amer A. Hassan Satellite communication system with variable rate satellite link diversity
US6353894B1 (en) * 1999-04-08 2002-03-05 Mitsumi Electric Co., Ltd. Power management system
US6668156B2 (en) * 2000-04-27 2003-12-23 Leapfrog Enterprises, Inc. Print media receiving unit including platform and print media
US6761637B2 (en) * 2000-02-22 2004-07-13 Creative Kingdoms, Llc Method of game play using RFID tracking device
US20040219501A1 (en) * 2001-05-11 2004-11-04 Shoot The Moon Products Ii, Llc Et Al. Interactive book reading system using RF scanning circuit
US6856918B2 (en) * 2001-11-26 2005-02-15 Lockheed Martin Corporation Method to characterize material using mathematical propagation models and ultrasonic signal
US6966837B1 (en) * 2001-05-10 2005-11-22 Best Robert M Linked portable and video game systems
US7085693B2 (en) * 2001-06-19 2006-08-01 International Business Machines Corporation Manipulation of electronic media using off-line media
US20060188861A1 (en) * 2003-02-10 2006-08-24 Leapfrog Enterprises, Inc. Interactive hand held apparatus with stylus

Patent Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4103895A (en) * 1976-03-19 1978-08-01 Pressman Gerald L Concealed pattern detection game
US4636996A (en) * 1984-05-25 1987-01-13 Casio Computer Co., Ltd. Ultrasonic obstacle location apparatus and method
US4955000A (en) * 1986-07-17 1990-09-04 Nac Engineering And Marketing, Inc. Ultrasonic personnel location identification system
US4814552A (en) * 1987-12-02 1989-03-21 Xerox Corporation Ultrasound position input device
US5174759A (en) * 1988-08-04 1992-12-29 Preston Frank S TV animation interactively controlled by the viewer through input above a book page
US5239464A (en) * 1988-08-04 1993-08-24 Blair Preston E Interactive video system providing repeated switching of multiple tracks of actions sequences
US5364108A (en) * 1992-04-10 1994-11-15 Esnouf Philip S Game apparatus
US5356296A (en) * 1992-07-08 1994-10-18 Harold D. Pierce Audio storybook
US5354057A (en) * 1992-09-28 1994-10-11 Pruitt Ralph T Simulated combat entertainment system
US5413486A (en) * 1993-06-18 1995-05-09 Joshua Morris Publishing, Inc. Interactive book
US6188388B1 (en) * 1993-12-28 2001-02-13 Hitachi, Ltd. Information presentation apparatus and information display apparatus
US5515631A (en) * 1994-10-12 1996-05-14 Nardy; Gino J. Book scroll device
US5686942A (en) * 1994-12-01 1997-11-11 National Semiconductor Corporation Remote computer input system which detects point source on operator
US5734370A (en) * 1995-02-13 1998-03-31 Skodlar; Rafael Computer control device
US5842869A (en) * 1997-10-22 1998-12-01 Mcgregor; John Method and apparatus for displaying question and answer data on plural displays
US6064855A (en) * 1998-04-27 2000-05-16 Ho; Frederick Pak Wai Voice book system
US6301231B1 (en) * 1998-06-02 2001-10-09 Amer A. Hassan Satellite communication system with variable rate satellite link diversity
US6353894B1 (en) * 1999-04-08 2002-03-05 Mitsumi Electric Co., Ltd. Power management system
US6761637B2 (en) * 2000-02-22 2004-07-13 Creative Kingdoms, Llc Method of game play using RFID tracking device
US6668156B2 (en) * 2000-04-27 2003-12-23 Leapfrog Enterprises, Inc. Print media receiving unit including platform and print media
US6966837B1 (en) * 2001-05-10 2005-11-22 Best Robert M Linked portable and video game systems
US20040219501A1 (en) * 2001-05-11 2004-11-04 Shoot The Moon Products Ii, Llc Et Al. Interactive book reading system using RF scanning circuit
US7085693B2 (en) * 2001-06-19 2006-08-01 International Business Machines Corporation Manipulation of electronic media using off-line media
US6856918B2 (en) * 2001-11-26 2005-02-15 Lockheed Martin Corporation Method to characterize material using mathematical propagation models and ultrasonic signal
US20060188861A1 (en) * 2003-02-10 2006-08-24 Leapfrog Enterprises, Inc. Interactive hand held apparatus with stylus

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070164315A1 (en) * 2004-11-23 2007-07-19 Cree, Inc. Cap Layers Including Aluminum Nitride for Nitride-Based Transistors and Methods of Fabricating Same
US20060287025A1 (en) * 2005-05-25 2006-12-21 French Barry J Virtual reality movement system
US7864168B2 (en) * 2005-05-25 2011-01-04 Impulse Technology Ltd. Virtual reality movement system
US20090176544A1 (en) * 2006-05-09 2009-07-09 Koninklijke Philips Electronics N.V. Gaming system with moveable display
US9511290B2 (en) * 2006-05-09 2016-12-06 Koninklijke Philips N.V. Gaming system with moveable display
US20110077065A1 (en) * 2009-09-29 2011-03-31 Rudell Design, Llc Game set with wirelessly coupled game units
US20110077757A1 (en) * 2009-09-30 2011-03-31 Industrial Technology Research Institute Touchless input device
US20120135793A1 (en) * 2010-11-30 2012-05-31 Intralot International Limited Lottery game system and method of playing
US9072963B2 (en) * 2010-11-30 2015-07-07 Intralot International Limited Lottery game system and method of playing
US9871184B2 (en) 2013-05-06 2018-01-16 Lokdon Llc System and a method for emitting an ultrasonic signal
US9945939B1 (en) 2013-05-06 2018-04-17 Lokdon Llc Method for determining a location of an emitter
WO2017111626A1 (en) 2015-12-22 2017-06-29 University Of The Philippines Diliman A wireless network of adaptable tap sensitive surfaces

Also Published As

Publication number Publication date
EP1885465A1 (en) 2008-02-13
WO2006120508A1 (en) 2006-11-16

Similar Documents

Publication Publication Date Title
KR101771896B1 (en) Localized haptic feedback
JP4762312B2 (en) Device and method for measuring the shot force applied to the movable game device
EP1438706B1 (en) Haptic feedback sensations based on audio output from computer devices
US7372450B2 (en) Analog input mapping for hand-held computing devices
US7040898B2 (en) Computer software and portable memory for an electronic educational toy
US20020036617A1 (en) Novel man machine interfaces and applications
US6766036B1 (en) Camera based man machine interfaces
US5728006A (en) Magnetic golf club swing sensor and golf simulator
US8231465B2 (en) Location-aware mixed-reality gaming platform
US8897494B2 (en) Computer interface employing a manipulated object with absolute pose detection component and a display
US9134797B2 (en) Systems and methods for providing haptic feedback to touch-sensitive input devices
US8057233B2 (en) Manipulable interactive devices
Francese et al. Wiimote and Kinect: gestural user interfaces add a natural third dimension to HCI
JP4810573B2 (en) Apparatus and method of using it for object information detection
US7394459B2 (en) Interaction between objects and a virtual environment display
US20050215323A1 (en) Recording medium storing video game program and video game device
US20170228023A1 (en) Vehicle computing system to provide a vehicle safety warning
Zanbaka et al. Comparison of path visualizations and cognitive measures relative to travel technique in a virtual environment
JP6092506B2 (en) Tactilely enhanced bi-directional bi-directional content
CN103959344B (en) Across multiple devices augmented reality representation
US5239463A (en) Method and apparatus for player interaction with animated characters and objects
US9266026B2 (en) Method and apparatus for dynamically adjusting game or other simulation difficulty
US8111239B2 (en) Man machine interfaces and applications
US20060175753A1 (en) Electronic game board
US8184100B2 (en) Inertia sensing input controller and receiver and interactive system using thereof

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION