CN100511413C - User created interactive interface - Google Patents
User created interactive interface Download PDFInfo
- Publication number
- CN100511413C CN100511413C CNB2005800004425A CN200580000442A CN100511413C CN 100511413 C CN100511413 C CN 100511413C CN B2005800004425 A CNB2005800004425 A CN B2005800004425A CN 200580000442 A CN200580000442 A CN 200580000442A CN 100511413 C CN100511413 C CN 100511413C
- Authority
- CN
- China
- Prior art keywords
- contact pilotage
- graphic element
- user
- interactive device
- selection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Electrically Operated Instructional Devices (AREA)
- Toys (AREA)
Abstract
An interactive apparatus is disclosed. The interactive apparatus includes a stylus housing, a processor coupled to the stylus housing, and a memory unit comprising (i) computer code for recognizing a plurality of graphic elements created using a stylus, (ii) computer code for recognizing the selection of at least two of the graphic elements in a user defined sequence using the stylus, and (iii) computer code for playing at least one audio output that relates to the formed graphic elements, and an audio output device.
Description
Background technology
There are many systems to allow the user behind selective printing element on the print media, to obtain some feedbacks with contact pilotage (stylus).
Such system is described in the patent (U.S.5,485,176) of Ohara etc.In this patent, the user uses selective printing element in contact pilotage and the book on platform.Described platform is connected to video monitor.Vision output corresponding with selected type element behind user's selective printing element is presented on the video monitor.
Although the system of describing in the patent of Ohara etc. is useful, can improve.For example, system mainly produces the vision output of exporting with respect to audio frequency and does not have write capability.
Another system that allows the user to obtain to feed back is called the Technology from Brighteye
TMScan-A-Page or Word
TMIn order to arrive the degree of understanding, system has used the scanning contact pilotage and has discerned the speech of printing by the optical character recognition of personal computer operation.Behind scanning and identification speech, the described speech that is identified is read loudly by synthetic video.Although this system also is useful, its interaction capabilities is limited.For example, its be limited to the scanning and printing element as speech and listen to then with as described in the relevant audio frequency of type element.
Above-mentioned recognition system has other problem.For example, said system does not allow the user to create user-defined application or user interactive system on paper or other medium.
Embodiments of the invention attempt to handle these and other problem.
Summary of the invention
Embodiment described herein allows the user to create user-defined application on paper, and/or allows the user mutual with mode and the paper before do not thought.For example, in certain embodiments, the user can usually create user-defined user interface by create pattern primitive on paper with interactive contact pilotage.Thereafter the user can be similar to the individual can be how mutual with mode and described graphic element based on the computer interactive of pen, unless do not exist based on the computing machine of pen.From user's visual angle, paper that does not have life has had life and has been function interface for the user.
An embodiment points to a kind of method, comprising: (a) create graphic element with contact pilotage; (b) after creating described graphic element, listen to the audio recitation of at least one menu item in a plurality of menu items; And (c) choice menus item from described a plurality of menu items.
Another embodiment points to a kind of interactive device, comprising: the contact pilotage shell; Processor; Storage unit, comprise that (i) is used to discern the computer code of user with the graphic element of contact pilotage establishment, (ii) be used for after the user creates graphic element, playing the computer code of the audio recitation of a plurality of at least one menu item of menu item, and (iii) be used for discerning the user from the computer code of a plurality of menu items to the selection of a menu item; And audio output device, wherein said audio output device and described storage unit are coupled to processor effectively.
Another embodiment points to a kind of method, comprising: (a) form a plurality of graphic elements with contact pilotage; (b) at least two described graphic elements of select progressively that limit with the user with described contact pilotage; And (c) listen at least one audio frequency relevant and export with the graphic element of described formation.
Another embodiment points to a kind of interactive device and comprises: the contact pilotage shell; Be coupled to the processor of described contact pilotage shell; Storage unit, comprise that (i) is used to discern the computer code of a plurality of graphic elements of creating with contact pilotage, (ii) be used to discern the order that limits with the user with described contact pilotage computer code, and (iii) be used to play the computer code that the audio frequency relevant with the graphic element of described formation exported the selection of at least two described graphic elements; And audio output device, wherein said audio output device and described storage unit are coupled to processor effectively.
These and other embodiment will be discussed in further detail below.
Description of drawings
Fig. 1 shows the synoptic diagram of the interactive system that comprises two-dimensional article and interactive device.
Fig. 2 shows the synoptic diagram of the interactive system of the interactive device that comprises two-dimensional article and comprise platform.
Fig. 3 shows the block scheme of some electronic units of interactive device according to an embodiment of the invention.
Fig. 4 shows the synoptic diagram of tree menu according to an embodiment of the invention.
Fig. 5 shows the process flow diagram of diagram method according to an embodiment of the invention.
How Fig. 6 (a)-6 (b) can be used to create graphic element and mutual so that the schematic illustration that interactive device provides list of menu and allows user's choice menus item with it if showing contact pilotage.
Fig. 7 shows the process flow diagram of diagram method according to an embodiment of the invention.
Fig. 8 shows according to one embodiment of present invention, and wherein the user can write a plurality of numerals to produce custom calculator on paper.
Fig. 9 (a)-9 (b) shows how diagram can produce translater on paper paper.
Figure 10 (a) shows and has round paper on it, and wherein circle is used to be called the recreation of " guessing the Word (wordscramble) ".
Figure 10 (b) is the paper that has mark, and it shows another translater and how dictionary can use.
Figure 11 (a) shows the paper how alarm clock function can use.
Figure 11 (b) shows the paper how the phone list function can be used.
Figure 12 shows the block diagram of communication system according to an embodiment of the invention.
Embodiment
Embodiments of the invention comprise interactive device.A kind of exemplary interactive device comprises: contact pilotage shell, the processor that is coupled to described contact pilotage shell, storage unit and audio output device.Described processor is coupled to described storage unit and described audio output device effectively.In certain embodiments, described storage unit can comprise: (i) be used to discern the computer code of user with the graphic element of contact pilotage establishment, (ii) be used for after the user creates graphic element, playing the computer code of the audio recitation of a plurality of at least one menu item of menu item, and (iii) be used for discerning the user from the computer code of a plurality of menu items to the selection of a menu item.Replacedly or additionally, described storage unit can comprise: the computer code that (i) is used to discern a plurality of graphic elements of creating with contact pilotage, (ii) be used to discern with the computer code of described contact pilotage with at least two described graphic elements of select progressively of user's qualification, and the computer code that (iii) is used to play at least one audio frequency output relevant with the graphic element of described formation.Preferably, interactive device has the form of self-contained contact pilotage, and described processor, storage unit and described audio output device are in the described contact pilotage shell.
Described interactive device can be used for teaching and learns any suitable subject.For example, interactive device can pre-programmed teaching relevant subject, as letter, numeral, mathematics (for example, add, subtract, multiplication and division, algebra etc.), social studies, phonetics, language, history etc.
In certain embodiments, described interactive device can scan the sightless substantially sign indicating number on the paper.The U.S. Patent application No.60/456 that the interactive device of this type was submitted on March 18th, 2003, the No.10/803 that on March 17th, 053 and 2004 submitted to describes in 803, and it is incorporated herein by reference to be used for any purpose.Described interactive device can comprise optical launcher and the fluorescence detector that is coupled to described processor effectively.Described interactive device can be from sightless substantially sign indicating number on the scan articles on the optics, and described article have the surface that comprises a plurality of positions.Different sign indicating numbers are respectively in described a plurality of positions, and can be relevant with the location of a plurality of positions on the described surface (for example, relatively or absolute coordinate space).The user can form graphic element such as type element and/or can have the type element of pre-printing in these positions in described position.
" graphic element " can comprise any suitable mark of being created by the user.If make a mark on paper, then described graphic element can be a type element.Replacedly, described mark can be write in medium such as the LCD can wiping.In such example, graphic element can be the virtual pattern element.The graphic element that is fit to including, but not limited to symbol, mark as letter and/or numeral, character, speech, shape, line etc.They can be regular or irregular in shape, and they are typically created with contact pilotage.
In certain embodiments, graphic element can comprise and has the letter or number of wire loop around described letter or number.Line around described letter or number can be circle, ellipse, square, polygon etc.Such graphic element looks and looks like " button " that can be selected by the user rather than common letter and number.By creating this type of graphic element, the user can visually distinguish graphic element such as icon and common letter and number.Equally, by creating this type of graphic element, described interactive device is distinctive function or menu item type graphic elements nand function or non-menu item type graphic elements better also.For example, the user can create graphic element be have circle around its letter ' M ' to create interactive mode " menu " icon.As with speech in letter ' M ' distinguish, described interactive device is programmed for overlapping circle or the square that will have letter ' M ' in it and is identified as functional graphic.Be used for discerning such functional graphic and distinguish them and the computer code of other non-functional graphic elements can reside in the storage unit of described interactive device.
Described processor can be discerned graphic element and can discern the location of these graphic elements so that described interactive device can be carried out various operations.In these embodiments, described storage unit can comprise be used to make any graphic element of producing by the user with they at the described lip-deep related computer code of locating.
In certain embodiments, described article can be the paper that has or do not have the type element of pre-printing.Described paper can have sightless substantially sign indicating number thereon.Described sign indicating number is for user's eyes " invisible substantially " and can be corresponding to the absolute or relative positioning of the type element on the page or leaf." invisible substantially " also comprises for the complete or slight sightless sign indicating number of user's eyes.For example, if be printed on the entire paper for the slight sightless point coding of user's eyes, when observing with normal sighting distance, described paper may look the shade of light ash.In some cases, after the user was with described interactive device scan code, the audio output device in described interactive device produced corresponding to the unique audio output of the graphic element that is associated with described sign indicating number (with respect to the indiscriminate audio frequency output of picture beep sound).
Preferably, described sightless substantially sign indicating number is implemented by dot pattern.The technology existence of reading the dot pattern of visible or " potential " printing also can be from commercial acquisition.The dot pattern of these printings is invisible substantially for user's eyes, so that the sign indicating number that exists in dot pattern so during normal use can't be perceiveed (unlike standard bar code) by user's eyes.Dot pattern can be implemented by the concrete combination of for example little He big point, described little and big point can represent in binary coding 1 and 0.Dot pattern can be printed with China ink, and described China ink is different from the China ink that is used to print described type element, so that described interactive device can read described dot pattern clearly.
Swedish company Anoto uses a kind of technology of using algorithm to produce pattern, makes the very big unique data space can conflict free use on big collection of document.If print fully, under the situation of any 2 square centimeters of unique identifications on any page or leaf, its pattern will cover 70,000,000,000,000 8.5 " * 11 " page or leaf.The paper that comprises specific pattern can be from the commercial acquisition of Anoto.Following patent and patented claim transfer Anoto and have described this basic fundamental and intactly be incorporated into this by reference to be used for any purpose at this: U.S. Patent No. 6,502,756, the U. S. application No.10/179 that submitted on June 26th, 2002,966, WO 01/95559, WO 01/71473, WO 01/75723, WO 01/26032, WO 01/75780, WO 01/01670, WO 01/75773, WO 01/71475, WO 01/73983 and WO 01/16691.
In certain embodiments, dot pattern can not have the data of other type, as is used for the data representation mark of data block, voice data and/or error detection data.As mentioned above, the processor in the interactive device can use look-up table to determine the location of contact pilotage, and can retrieve and audio plays based on described locating information.This has advantage.For example, compare with having the data printing paper thereon that is used for mark, audio frequency and error-detecting, embodiments of the invention need point still less, do not need to be printed on paper because be used for the data of mark, audio frequency and error-detecting.For example, by ignoring voice data from paper, on the paper more space can be rendered as mutual because actual voice data does not need to take the space on the paper.In addition, be stored in the interactive device because be used for the computer code of audio frequency in an embodiment of the present invention, the audio frequency of generation by the fold in the paper for example or tear the possibility destroying or change less.
Though described dot patterned codes especially at this, the invisible substantially sign indicating number of other type also can use in other embodiments of the invention.For example, if bar code on article with the arranged in form of array, then can use infrared bar code.Illustrative ground, a piece of paper can comprise 100 * 100 invisible substantially bar code array, different x-y location association on each yard and the paper.Relative or the absolute fix of the bar code in the described array can be stored in the storage unit of interactive device.
As noted, in a preferred embodiment, invisible substantially sign indicating number can be directly or indirectly relevant with the location of a plurality of positions on the paper and/or any type element.In certain embodiments, invisible substantially sign indicating number can be directly related with the location of a plurality of positions on the paper (or other article).In these embodiments, the location of the diverse location on the paper can be provided by the code book body.For example, can comprise the volume coordinate that is used for primary importance on the paper () sign indicating number for example, specific x-y position, and first yard of primary importance at second yard sign indicating number that can comprise the volume coordinate that is used for the second place on the paper of the second place.The type element that different graphic elements such as user produce can be in the diverse location place on the paper.These type elements can form on described sign indicating number.For example, first type element can be in the primary importance formation folded with first code weight.Second type element can be in the second place formation folded with second code weight.When the user formed first type element, scanning device identified first type element of formation and scans first yard related with first type element of described formation simultaneously basically.Processor in the interactive device can be determined the particular spatial coordinates of primary importance and described first type element is associated with described volume coordinate.When the user formed second type element, scanning device identified second type element of described formation and scans second yard basically simultaneously.Processor can be determined the volume coordinate of the described second place then and described second type element is associated with described volume coordinate.First and second type elements that the user can use interactive device to select the user to form subsequently then, and described interactive device can be carried out other operation.For example, point out that use the method, the user can create user-defined interface or functional device on paper blank as following.
Described interactive device also can be included in and make in the storage unit relatively or absolute fix and the graphic element mapping of described formation or the mechanism that is associated.Described mechanism can be the look-up table that data relevant with concrete graphic element on the article are associated with certain position on the article.This look-up table can be stored in the storage unit.Processor can use described look-up table to discern the graphic element at place, concrete location so that processor can be carried out ensuing operation.
The article that have invisible substantially sign indicating number can have any suitable form.For example, described article can be paper, notepad, loose leaf paper, placard, notice, menu, sticker, label, the packing of product, box, transactional cards, magnet (for example refrigerator magnet) etc.The article of any of these or other type all can use under the type element situation that has or do not have pre-printing.If described article are sheets, described can be any suitable size and can be made by any suitable material.For example, described can be based on paper, perhaps can be plastic foil.
In certain embodiments, described article can be the three-dimensional articles that has three-dimensional surface.Described three-dimensional surface can comprise molded profile or other profile of human body, animal (for example dinosaur), automobile, character.
As noted above, in certain embodiments, described article are sheet and the described letter or number (for example, user sheet on creating the mark that graphic element before carry out) of type element as printing that can not have pre-printing.In other embodiments, the pre-type element of printing can be on the sheet (for example, the user before creating graphic element on the sheet).The pre-type element of printing can comprise: numeral, icon, letter, circle, speech, symbol, line etc.For example, embodiments of the invention can use the form of pre-printing such as the order form or the ballot ballot paper of pre-printing.
Described interactive device can have any suitable form.In one embodiment, described interactive device is the scanning device that is fixed to contact pilotage, and pocket size preferably.Described contact pilotage comprises can be by plastics or metal contact pilotage shell.Can there be clamping zone on the contact pilotage shell.If that described interactive device has is portable, the form of self-contained contact pilotage, described interactive device can nearly weigh 4 ounces greatly, can have about 40 hours battery life, and can use processor to control (for example, comprising asic chip) function of described interactive device.Described contact pilotage can comprise optical scanner (having fluorescence detector and optical launcher) and the loudspeaker on earphone jack, FPDP, flash memory, battery and the contact pilotage point.Described contact pilotage Lower Half can be similar to pen, and the top can be widened with between the thumb and forefinger that cosily are placed on the user.
In other embodiments, described interactive device comprises contact pilotage and platform (it can be similar to clamping plate).Described contact pilotage is tied up described platform and can be comprised loudspeaker, battery and flash/cartridge connector (flash/cartridge connector).Described platform can clip on the sheet for convenience.
Though described the interactive device that has optical launcher and fluorescence detector in detail, described interactive device still can adopt other form and not need to comprise optical launcher and fluorescence detector.For example, in certain embodiments, described interactive device can have the form of the flat computer that uses contact pilotage, as dull and stereotyped PC or PDA(Personal Digital Assistant).Such device can be from commercial acquisition.Storage unit among dull and stereotyped PC or the PDA can have the computer code of any function of carrying out the application's description.Graphic element can be created in LCD, and the user can be mutual with the graphic element of mode described here and these establishments subsequently.In these embodiments, contact pilotage can or can not comprise active electronic equipment.For example can use the technology that exists among many PDA, feasible contact pilotage without any electronic equipment can be used in some embodiments of the present invention.Will explain in detail that as following those of ordinary skill in the art can be programmed into so commercial acquisition in the device with various inventive function described here.
In other embodiments, described interactive device can be the U.S. Patent application No.10/457 that submits on June 9th, 2003, the type of the exercise question of submitting on May 28th, 981 and 2004 for describing among the U.S. Patent application No.___ of " PrintMedia Apparatus Including Handwriting Recognition " (lawyer put on record no.020824-009200US), it is incorporated herein by reference.In these embodiments, described interactive device is electrographic recording (electrographic) the location positioning equipment that has platform, and described platform comprises surface, processor, a plurality of first antenna element and audio output apparatus such as loudspeaker.The contact pilotage that comprises second antenna element and writing tools can be coupled to described platform.First antenna element can be the signal transmit antenna element, and second antenna element can be signal receiving antenna element (or vice versa).Paper (not invisible substantially sign indicating number) can appear at pre-position on the platform.Described first antenna element can be launched different signals (for example, having the signal of various amplitude) in the different x-y position on described surface (and so described paper), and these different signals can be received by second antenna element in the contact pilotage.Thereby first antenna element and second antenna element can capacitively be coupled together and pass through paper.Therefore, when the user created graphic element on described paper, processor can be determined the position of the graphic element created.For what describe among the U.S. Patent application No. of " Print MediaApparatus Including Handwriting Recognition " (lawyer put on record no.020824-009200US) (it intactly is incorporated into this by reference), processor also can use commercially available character recognition software to determine what the graphic element of establishment is as the exercise question submitted on May 28th, 2004.As wherein describing, character recognition software can be from Xpert Eye, Inc.ofSammamish, WA (www.experteye.com) and Vision Object, Inc.of Paris, the commercial acquisition of France.Software as type that these enterprises sell can be used for any interactive device described here.When this software was used to use the electrographic recording location positioning equipment (or any other interactive device embodiment described here) of paper, described software can be discerned the graphic element of being created by the user on paper.As will be conspicuous from following other example, by the graphic element of determining user's establishment and the position of determining these graphic elements, many useful functions can be passed through described interactive device and carry out.
Fig. 1 shows system according to an embodiment of the invention.Described system comprises interactive device 100 and article 70.Interactive device 100 has the form of contact pilotage.
In certain embodiments, display device 40 can be physically coupled to contact pilotage shell 62.In other embodiments, display device 40 can be separated with the other parts of interactive device 100 and can be passed through wireless data transmitter structure (for example, IR or infrared signal data transmission mechanism) and communicate by letter with described other parts.Such separated display devices 40 can provide the ability of seeing any visual feedback that is produced by him or she and interactive device 100 reciprocations to the user, and is suitable for classroom environment.
Load button 38 also exists and is electrically coupled to processor 32 allowing user's input information (as beginning, stop or entering) in equipment 100, and/or opening and closing equipment 100.Power supply 34 is in the shell 62 as battery and is other assembly power supply of processor 32 and interactive device 100.
Optical launcher 44 and fluorescence detector 42 are at an end of stylus-shaped interactive apparatus 100.Optical launcher 44 and fluorescence detector 42 are coupled to processor 32.Optical launcher 44 can be for example LED (light emitting diode) or other light source, and fluorescence detector 42 can comprise for example charge-coupled image sensor.
Processor 32 can comprise any suitable electronic equipment of the function that realizes interactive device 32.For example, processor 32 can comprise the microprocessor, the amplifier circuit that is used to amplify described voice that have the sound-compound-circuit that is used to produce synthetic speech, be used to control to the circuit of any input of interactive device 100 and any output that is provided by interactive device 100 and be used for the conversion of signals that receives from fluorescence detector 42 is become the simulation of digital signal-to-digital quantizer.
The end identical that writing component 52 is in stylus-shaped interactive apparatus 100 with optical launcher 44 and fluorescence detector 42.Described writing component 52 can comprise marker, chalk, pen or pencil and can or can not be retractible.If retractible, so described writing component 52 can be coupled to gearing.The user can encourage described gearing so that writing component stretches out or withdraws the contact pilotage shell from the contact pilotage shell.When it used, the user can hold stylus-shaped interactive apparatus 100 and use it to write on sheet.User's mark also can be with 42 scannings of optical launcher 44 and fluorescence detector the writing of processor 32 soluble users.
Illustrative ground, the user can create the letter ' M ' of zone circle to create menu icon with the writing component 52 in the interactive device 100 on article 70.The letter ' M ' (not shown in figure 1) of zone circle is printed on the A position and is on the sightless substantially sign indicating number in A position.When the user selected after a while and scans described letter ' M ', optical launcher 44 produced light signal, and described light signal reflection is left the invisible substantially sign indicating number of A position and received by fluorescence detector 42.Processor 32 is determined the location of A position and audio frequency and/or the execution function of retrieving corresponding to letter ' M ' from storage unit 48 relevant with letter ' M '.For example, after interactive device 100 is used to select letter ' M ' and behind the substantially invisible sign indicating number of its scanning at position A, processor 32 can be transformed into the menu mutual pattern with interactive device 100, and the user is rollable by menu item and the optional individual event of triming vegetables for cooking thus.After each Continuous Selection to described letter ' M ', processor 32 can make audio output device 36 produce list of menu for the user.For example, with selecting for the first time of 100 pairs of letter ' M ' of interactive device to make audio output device 36 read aloud " counter ", can make audio output device 36 read aloud " translater " etc. with the selection second time of 100 pairs of letter ' M ' of interactive device.Each follow-up selection to the graphic element of described establishment can make described interactive device read aloud different menu items.
Writing component 52 is used on the concrete location of article 70 and writes.Use suitable handwriting recognition and/or optical character recognition (it can be used as computer code and is stored in the storage unit 48), writing of user can be explained by processor 32, is what and the certain position that also has user institute writing position so that processor 32 can determine that the user writes.Be further explained in detail as following, use this information, described system and described interactive device can be suitable for carrying out more complicated operations, as language translation or mathematical operation.
Fig. 2 shows another embodiment of the present invention.In this example, the element that similar numeral indication is similar and the previous description of similar components do not need to repeat again.But in this embodiment, interactive device 100 comprises contact pilotage 100 (a) and platform 100 (b).Cable 102 is coupled to contact pilotage 100 (a) with platform 100 (b).Platform 100 (b) two-dimensional article 70.In this embodiment, processor 32, power supply 34, audio output device 36, button 38 and storage unit 48 are in platform 100 (b) rather than the contact pilotage 100 (a).In other embodiments, may not have cable and between contact pilotage 100 (a) and platform 100 (b) (or other base unit), wireless link can be arranged.
In embodiment illustrated in fig. 2, in contact pilotage 100 (a), less electronic unit is arranged, make that the stylus-shaped interactive apparatus volume shown in the comparable Fig. 1 of contact pilotage 100 (a) is littler.When employed article were paper, described paper can be placed on platform 100 (b) and go up so that provide support for described paper.
Fig. 3 shows the block diagram of some electric assemblies that can be used for interactive device according to an embodiment of the invention.Described interactive device can comprise processor 101 and be coupled to the storage unit 103 of described processor 101.Processor 101 and storage unit 103 can be implemented separately or with the combination of one or more detachable memory memory storages (for example, memory stick, storage card etc.) by one or more computer chips.In certain embodiments, processor 101 can comprise special circuit, and voice operation demonstrator can be 101 related with processor (for example in described processor or be coupled to described processor).Fluorescence detector 105 and optical launcher also are coupled to processor 101 effectively.Output unit such as display device 111 (for example, LCD or LED screen) and audio output device 109 (for example, loudspeaker or earphone) also can be coupled to processor 101.About the other exemplary details of these assemblies above and below provide.
In an embodiment of the present invention, create after graphic element and user select this graphic element subsequently the user, a plurality of menu items can be presented to the user with the form of audio frequency.The user can select a menu item then from list of menu.Described menu item can comprise directory name, subdirectory name, apply names or concrete data group name.The example of catalogue and subdirectory name comprises but (for example is confined to " instrument ", for the interactive useful function that can be applicable under many varying environments), " reference " (for example, for reference material such as dictionary), " recreation " (for example, for different recreation) etc.The concrete example of using (or sub-directory) name comprises " counter ", " spelling checker " and " translater ".The object lesson of data set can comprise the lexical or textual analysis, phone list, calendar, behaviour tabulation of one group of foreign words and they etc.Other examples of menu items is shown in Figure 4.
Can be various menu items concrete audio instructions is provided.For example, after the user selects " counter " menu item, described interactive device can indicate the user on paper, draws digital 0-9 and operational symbol+,-, * ,/and=, and select numeral then with the execution mathematical computations.In another example, after the user selected " translater " menu item, described interactive device can be indicated the user to write the name of second language and it is enclosed.After the user does like this, described interactive device can further indicate the user to write in English down speech and the second language of selecting zone circle then to listen to the speech of being write that is translated into this second language.After doing like this, the audio output device in the described interactive device can be read aloud institute's predicate with second language.
Fig. 4 shows menu item tree-directory according to an embodiment of the invention.Described menu item tree-directory can be implemented from the audio menu of menu M sign-on.
From the top of Fig. 4, the first audio frequency sub-directory will be an instrument T sub-directory.Under described instrument T sub-directory, translater TR sub-directory, counter C sub-directory, spelling checker SC sub-directory, individual assistant PA sub-directory, alarm clock AL sub-directory and tutor TU function can be arranged.Under translater TR sub-directory, Spanish SP, French FR and German GE translator function will be arranged.Under individual assistant PA sub-directory, calendar C, phone list PL will be arranged and act tabulation TD function or sub-directory.
Under reference R sub-directory, dictionary TH function, dictionary D sub-directory can be arranged and help the H function.Under dictionary D sub-directory, English E function, Spanish SP function and French FR function can be arranged.
Under recreation G sub-directory, recreation can be arranged, as guessing the Word WS, strange taste potato (funkypotatoes) FP and scribble DO.Other recreation also can occur in other embodiments of the invention.
Under the S of system sub-directory, safe SE function and personalized P function can be arranged.
Details about some above-mentioned catalogues, sub-directory and function provides below.
Menu item tree-directory is shown as described, and the user can be by listening to reading aloud and selecting required menu item to go downwards to any desired path then of various menu items.Selection subsequently to required menu item can take place in any suitable manner.
For example, in certain embodiments, the user can make described interactive device scrolling pass through audio menu by " contacting " on the graphic element of creating downwards.Described " contact downwards " can use any suitable mechanism to be identified by the electronic equipment in the interactive device.For example, interactive device is programmed for identification and moves down the image modification that is associated with its graphic element towards described selection.In another example, when pressure sensitive switch can provide the end with convenient interactive device to apply pressure on the paper in interactive device, pressure switch activated.This notifies described interactive device scrolling by described audio menu.For example, after the letter ' M ' of selecting zone circle with interactive device (activating to make the pressure switch in the interactive device thus), the audio output device in the interactive device can only be read aloud " instrument ".The user can select the letter ' M ' of zone circle for the second time so that described audio output device is read aloud menu item " reference ".When passing through the audio menu item, the needs scrolling can repeat said process.In order to select the specific menu item, the user can create unique mark or provide concrete representing with scanning device on paper.For example, the user can hear speech " instrument " back in the letter ' M ' graphed alongside " number of colluding " (or other graphic element) of zone circle so that chooser catalogue " instrument ".Use as method, catalogue, sub-directory or function that the user can be scheduled in menu item tree are advanced.Graphic element that described establishment is different or different expressions can be used for making described interactive device to scroll up.Replacedly, can in described interactive device, provide button or other gearing to pass through menu with scrolling.
In other embodiments, after establishment had round letter ' M ', the user can select the letter ' M ' of zone circle.Software in the scanning device is identified as menu symbol with the letter ' M ' of zone circle and makes described scanning device sequentially and with the time interval that separates read aloud menu item " instrument ", " reference ", " recreation " and " system ", and does not need to be contacted downwards by the user.Audio instructions can offer the user.For example, described interactive device be we can say " select ' instrument ' catalogue, write letter ' T ' and with on its circle ".In order to select described menu item, user creatable letter " T " and with on its circle.This is to interactive device explicit user chooser catalogue " instrument ".Described then interactive device can be the user and reads aloud menu item under " instrument " catalogue.Thereby, may be directly to particular category, sub-directory or function in the described menu item tree by on paper, creating the graphic element represent catalogue, sub-directory or function.
Fig. 5 shows the process flow diagram of diagram method according to an embodiment of the invention.Described method comprises that the prompting user creates graphic element 400.Described prompting can be that the audio prompt that the user produced by interactive device is to write speech, character, symbol or other graphic element on paper.Described interactive device is discerned the graphic element 402 of described establishment, and described interactive device is read aloud list of menu 404 for the user.User's choice menus item and described interactive device then discerns the menu item 406 of described selection, and changes its operation 408 on the basis of the menu item of described selection.Able to programme so that these steps of described interactive device can be carried out and the computer code that is used to carry out these steps can exist in the storage unit.
Fig. 6 (a) and 6 (b) show the diagram of how to work according to the method for the process flow diagram shown in Fig. 5.At first, can point out the user to create graphic element (step 400) with the interactive device 100 of self-contained contact pilotage form.The user can create one or more graphic elements then on paper 202.In this example, graphic element 206 can comprise letter ' M ' 202, and wherein round 204 around letter ' M ' 202.This graphic element 206 is drawn with the writing component (not shown) in the interactive device 100.
After creating graphic element 206, interactive device 100 can be read aloud some menu items (step 404).For example, interactive device 100 can identify the user write have alphabetical M202 and the circle 202 graphic elements 206 around it.As noted above, interactive device 100 can have optical character recognition therein, and equipment 100 is programmed for below the identification: overlapping letter " O " and letter ' M ' (promptly at identical roughly physical location) indication user is the audio menu (step 406) in the activating interactive equipment 206.Interactive device 100 also can be programmed, so that each subdirectory name uses interactive device 100 to select graphic element 206 backs to be read aloud the user.For example, will make interactive device 100 read aloud subdirectory name " instrument ", " reference ", " recreation " and " system " respectively with interactive device 100 four times continuous " contact downwards " on graphic element 206.
In order to indicate selection to specific menu item, catalogue or sub-directory, another graphic element of user creatable or produce expression with interactive device 100.For example, if the user thinks descending " instrument " sub-directory, for example, the user can draw the number of colluding 208 then and select with indication on paper 202.After the drafting number of colluding, after each select progressively or interactive device 100 " contact downwards " were to the paper 202, institute's predicate " counter ", " spelling checker ", " individual assistant " and " tutor " can be read aloud by interactive device 100.After the user heard that speech " counter " is read aloud, " counter " function then can be selected so that the operator scheme of interactive device 100 is changed into calculator function (step 408).The user can draw another number of colluding (not shown) and select calculator function with the indication user on paper 202.
Fig. 7 shows the process flow diagram of diagram another embodiment of the present invention.In the method, interactive apparatus prompts user creates at least two graphic elements (step 500).Described interactive device is discerned selection and its order (step 502) to described graphic element by the user then.Then, described interactive device provides at least one output (step 504) relevant with the graphic element of described selection.
Described at least one output graphic element with described selection by any way is relevant.For example, at least one output can comprise the one or more sound relevant with the content of described graphic element.For example, in the calculator example below, two numerals can write on the paper as 1 and 4.The user can select them so that they are added together then.Described audio frequency output " 5 " can be provided by interactive device, and can be relevant with the graphic element 1 and 4 of described selection.In another example, guessing the Word recreation is shown as will be described below, can be related with described circle in draw circles on the paper and speech (not writing on the paper).When the user selects these bowlders with particular order, corresponding to a series of speech sounding from interactive device of the order of the circle of selecting.The sound that is provided by described interactive device is relevant with the graphic element of described selection, but does not need relevant with the content of described graphic element.
The example of implementing method shown in Figure 7 is shown in Figure 8.How Fig. 8 can create the paper counter from a plain pape if showing the user.In this example, after the user selects " counter " function as described above, scanning device prompting user write digital 0-9 and operational symbol+,-, * ,/and=(step 500).The user creates graphic element 210, comprise have annulus around numeral and be used for computing as add, subtract, multiplication and division and the mathematical operator that equals.In other embodiments, provide round around the numeral that needn't be shown in Figure 8.The position of the graphic element of the described establishment of interactive device 100 identifications and the actual graphic elements (step 502) that identification is created.The user can select at least two graphic elements to receive and the audio frequency output relevant to the selection of these at least two graphic elements then.For example, but user's select progressively graphic element " 4 " "+" " 7 " "=" is read aloud " 11 " (step 504) to listen to interactive device 100.Described paper counter can reuse afterwards because described interactive device in its storage unit storage inside the location of described graphic element.This embodiment can be useful in the school that the student does not have the physical computing device to use.
Fig. 9 (a) and 9 (b) show another embodiment of the present invention.With reference to figure 9 (a), the user can write the graphic element 302D that is centered on by circle.After interactive device 100 was read aloud speech " dictionary ", the user can create the number of colluding 304 with interactive device and select dictionary function with indication.After creating graphic element 302, interactive device 100 can further point out the user to create to comprise another graphic element 305 of the speech " French " 308 that is centered on by line 306.Interactive device 100 can point out the user to write a speech then and the user can write speech " Hello " 310 (step 500 among Fig. 7).The user can select speech " Hello " then thereby and the speech of selecting graphic element 305 to listen to then to read aloud by interactive device 100 " Bon " (step 504 among Fig. 7 and 506).
Example is shown as described above, and at least two graphic elements being created by the user can comprise: comprise first graphic element of language name and comprise second graph element with the speech of the language that is different from this language.The user can select described speech and select described language name then, and can listen at least a audio frequency output then, comprises that listening to synthetic video reads institute's predicate with described language.Described language can be the language of non-English as Spanish, French, German, Chinese, Japanese etc., and institute's predicate can be in English.English-outer dictionary can be used as computer code and is stored in the storage unit of described interactive device.
As Fig. 8 and 9 shown, embodiments of the invention have many advantages.The letter of described zone circle and symbol picture " button ", the user can be mutual with it.Therefore the user can create his or her customizing UI basically in any place at any time.This provides convenience, interesting and joyful mode to come with non-existent and complete something by user's establishment is mutual in the past.This is unlike the user interface such as the QWERTY keyboard of standard.
Though show translator button, the user can create other function button on sheet or other article.For example, other button can comprise help button, record button (if described interactive device has sound-track engraving apparatus and has the recording ability), volume button, game button etc.The also available described interactive device of user creates alphanumeric keyboard so that data typing and ensuing mutual.
In certain embodiments, but user's draw graphic elements and user can be joyful and/or educational mode is mutual with it.For example, the user can draw 1 to 5 and described interactive device each location on paper of can remembeing them on the paper.The user can draw " recreation " button and play games.For example, described interactive device is programmed for and points out the user to look for than 2 greatly also than 5 little numerals.The user then can be by selecting one of described numeral to attempt and guessing what this numeral is.Select in response to described user, can provide correct or wrong audible feedback to the user.
Figure 10 (a) shows the paper that some circles 602,604,606,608,610 are arranged on it.It can be used for the recreation as guessing the Word.For example, after creating graphic element 600 (letter of zone circle " WS " expression guessing the Word), described interactive device (not shown) can place word scramble mode.Described interactive device can ask the user " to draw 5 scrambler circles " (step 500 among Fig. 7).After the user drew 5 circles 602,604,606,608,610, audio-frequency unit (illustrating in the parenthesis of Figure 10 (a)) was assigned to them.The user is prompted to select the correct order of circle to produce sentence then.Described interactive device we can say that " the contact scrambler circles is so that beginning prepared in the arrangement sentence for example! " user can contact 5 circles 602,604,606,608,610 to produce phrase " ratfat the ate cheese " (step 502 and 504 among Fig. 7) in proper order with this.At last, it is circle 606,604,602,608,610 that the user will find out the correct order that will select circle, makes described interactive device produce sentence " The fat rat ate cheese (fertile mouse eats cheese) " (step 502 and 504 among Fig. 7).At this moment, because select the correct order of circle also can provide award output to the user.Described interactive device can ask the user whether the user thinks to play once more.Again, the graphic element created by the user of described interactive device identification and it is related with the location on the paper.
Figure 10 (b) shows the another paper that has graphic element.Another mode that it can be used for that dictionary function is described and carries out translator function.With reference to Figure 10 (b), the user is at first since a plain pape and draw the alphabetical M of zone circle as shown.Then, the user uses the also letter ' M ' of " contact " zone circle of described interactive device (not shown).After the user heard menu item " dictionary ", the user can select dictionary menu item with indication in its graphed alongside number of colluding.Described interactive device is changed into dictionary mode then.Described interactive device can point out the user " to write a speech and be used for its lexical or textual analysis " then.The user can write then as the shown speech of Figure 10 (b) " magic ".Behind the predicate writing " magic ", described interactive device can be discerned and write " magic " and we can say " magic.Its meaning is for the elemental strength of control or look magical strength." user can write any suitable speech and receive dictionary definition.
Write speech speech " magic " as described the user, the user can contact last letter (" c ") of institute's predicate, and described interactive device should produce dictionary definition to tell described interactive device user to write the speech of wanting.Replacedly, the user can wait for a moment and described interactive device in timeout mechanism can make described interactive device produce the dictionary definition of speech " magic " automatically.Solution is preferred the preceding, makes the user needn't wait for before receiving the feedback of wanting.In this solution, can in the end provide virtual box around a character.If the user selects any zone in this virtual box, this can indicate to the interactive device user and write the speech that is over and wants.For example, touch downwards on last character when the user makes contact pilotage, user notification described contact pilotage user write.In the embodiment of a contact pilotage, can provide pressure switch at the end of described contact pilotage so that downward pressure makes described writing component upwards.As noted above, contact pilotage is programmed for the described character of writing of identification.If pressure switch is activated, and the character of writing is identified in the short time once more, and then described contact pilotage can determine that described sequence has finished and can be the user feedback of wanting is provided.The method can be used for other character string such as digital sequence or symbol sebolic addressing.
This has solved some problems.At first, by selecting last character in the sequence, the user can notify described contact pilotage user to write rapidly.Selecting last character of sequence is to notify described contact pilotage user to write and wanted to receive the nature and the effective and efficient manner of feedback.Secondly, by selecting last character, described contact pilotage is known EOS and scanning electron equipment in the described contact pilotage can be closed.This has saved battery electric power.The 3rd, indicate end by last character of selecting sequence, at most in the end form a bit near the character.This has been avoided the confusion on the paper.The 4th, last character of sequence is that the user asks the natural end point fed back.The selection that its indication finishes is intuitively for the user.
Refer again to Figure 10 (b), the user can write the tee R of the zone circle that is used for translater then.After the user did like this, interactive device can be said " contact TR is to be used for your translater menu ".Each contact downwards can make described interactive device say " English is to Spanish ", " English is to French ", " English is to German " etc. continuously.If when the user heard " English is to Spanish " option, the user then can be in the number of colluding of the TR of zone circle graphed alongside.The user can write " bye " then and interactive device can be said " Bye.Adios.A-d-i-o-s. ".The user can write " friend " then and interactive device can be said " Friend.El amigo.El (pause) a-m-i-g-o. ".
How Figure 11 (a) can use alarm clock function if showing.The user can be prompted to create " AL " of zone circle or user and can know so in advance and do.This can the user write zone circle alphabetical M, listen to list of menu and by after alarm clock function is selected in the number of colluding of alphabetical M graphed alongside, taking place.The user writes alphabetical AL then and then it is enclosed.Interactive device is said " alarm clock then.Contact AL is to be used for your alarm clock options ".Each contact downwards continuously can make described interactive device function of reading aloud " interpolation quarter-bell ", " review alarm " and under " alarm clock " sub-directory " current time ".For example, in order to select " interpolation quarter-bell ", the user will be in the alphabetical AL graphed alongside number of colluding of zone circle.Described interactive device can point out the user " to write the date " then.The user writes " 5-9 " then and represents May 9.Then, described interactive device can point out the user " to write the time ".The user writes " 2:00PM " then.After writing the described time, described interactive device is said " writing message now ".The user can write " phone Jim " then and described interactive device writes down this message.Text To Speech switching software engine in the interactive device becomes described message conversion spoken text and says " phone Jim then.Quarter-bell is provided with ".In 2 pm May 9, described interactive device will be read aloud " phone Jim " automatically.
In review alarm mode, " RA " (not shown) that the user can draw zone circle is used for review alarm.Each contact in succession will make described interactive device say each alarmed message in succession.For example, contacting letter r A for 3 times continuously can make described interactive device play following three information storage unit of described interactive device (be stored in) and they time and the date with broadcast.
Figure 11 (b) shows how to use the phone list function.As shown, the user can write the alphabetical PL of zone circle after being prompted.This can the user write zone circle M, hear menu list and by after the phone list function is selected in the number of colluding of described alphabetical M graphed alongside, taking place.The available then described interactive device of user contacts described alphabetical PL.Make described interactive device read aloud function " access phone number ", " increase telephone number " and " deletion telephone number " in " phone list " sub-directory with interactive device to each Continuous Contact of alphabetical PL.The user can select " increase telephone number " and by indicating this selection in the number of colluding of described alphabetical PL graphed alongside.Described interactive device can point out the user " to write name " then and the user writes name " Joe Smith " with described interactive device.Use the Text To Speech software engine, described interactive device is read aloud name " Joe Smith ", and points out the user " to write telephone number " then.The user writes " 555-555-5555 " and described interactive device then this telephone number is read aloud to the user (using the Text To Speech software engine).
The telephone number of Joe Smith can retrieve by visiting " access phone number " function in " phone list " sub-directory and writing name " Joe Smith " then after a while." behind the Joe Smith, this will will be retrieved from the storage unit of described interactive device and will be read aloud to the user by loudspeaker the described interactive device or earphone by the telephone number of described interactive device identification and Joe Smith writing.
Figure 12 shows the computer system that can be used for new and different contents are offered interactive device.Figure 12 shows the server computer 453 that is coupled to database 455.Server computer 453 can be operated the website, and the user can be by the contact of described website to obtain new content.Database 455 can be the new content of interactive device 459 storages.Described new content can comprise the computer code that is used for audio frequency, is used for the computer code of vision output, is used for the computer code of operating system etc.Though database 455 and server computer 453 illustrate as two frames, can understand independent computing equipment or cooperative a plurality of computing equipment can be implemented them.
Communication media 451 is coupled to server computer 453 and a plurality of client computer 457 (a), 457 (b).Client computer 457 (a), 457 (b) can be common personal computers.Communication media 451 can be that any suitable communication network comprises the Internet or Intranet.Though show two client computers, in the embodiments of the invention a plurality of client computers can be arranged.
Various descriptions are provided at this to hardware and software.Can understand the various combination that the technician knows many hardware and softwares, it can be used for realizing the function of interactive device described here.
Term and expression formula are as the term of describing without limits as used herein, and not to want to use these terms and expression formula and the equivalent form of value of getting rid of shown and described feature or its part, can think and in the scope of claim of the present invention, can carry out various modifications.
And, under the situation that does not deviate from scope of the present invention, any one of any embodiment of the present invention or a plurality of feature can with any one or a plurality of further feature combination of any other embodiment of the present invention.For example, any embodiment of relevant Fig. 4-11 description is used in the arbitrary shown interactive device of Fig. 1 or 2.
In a word, this application has discloses at least a interactive device.Described interactive device comprises: the contact pilotage shell; Be coupled to the processor of described contact pilotage shell; And storage unit, comprise that (i) is used to discern the computer code of user with a plurality of graphic elements of contact pilotage establishment, (ii) be used to discern with the computer code of described contact pilotage with at least two described graphic elements of select progressively of user's qualification, and the computer code that (iii) is used to play at least one audio frequency output relevant with the graphic element of described formation; And audio output device.
Above-mentionedly all quote, patented claim and patent intactly be incorporated into this by reference to be used for any purpose.They do not admit it is prior art for the invention of current claim.
Claims (95)
1. method comprises:
Create graphic element with contact pilotage;
After creating described graphic element, listen to a plurality of menu items that described graphic element is associated in the audio recitation of at least one menu item; And
From described a plurality of menu items, select a menu item.
2. method comprises:
The identification graphic element, described graphic element is created by contact pilotage;
Behind the described graphic element of identification, generate the audio recitation of at least one menu item in a plurality of menu items; And
To from described a plurality of menu items the selection of one menu item being discerned when the follow-up excitation of described contact pilotage, described excitation is relevant with described graphic element.
3. claim 1 or 2 described methods, wherein said contact pilotage has the form of interactive device, described interactive device comprises processor, transmitter, detecting device and loudspeaker, and wherein said transmitter, detecting device and described loudspeaker are used to be coupled to described processor.
4. claim 1 or 2 described methods, wherein said graphic element is on printable surface.
5. claim 1 or 2 described methods, wherein said graphic element is a type element, and wherein said contact pilotage comprises antenna.
6. the described method of claim 4, wherein said printable surface is a paper.
7. claim 1 or 2 described methods, wherein said graphic element comprises symbol.
8. claim 1 or 2 described methods, wherein said graphic element comprise symbol and around the line of described symbol.
9. claim 1 or 2 described methods, wherein after described user selected described menu item or the selection of identification to described menu item, the voice operation demonstrator that is used for being associated with described contact pilotage was read aloud the instruction of creating other graphic element audibly.
10. claim 1 or 2 described methods, wherein said a plurality of menu items comprise the counter menu item, with reference at least one in menu item and the Game Menu item.
11. an interactive device comprises:
The contact pilotage shell;
Processor is coupled to described contact pilotage shell;
Storage unit, comprise that (i) is used to discern the computer code of user with the graphic element of described contact pilotage establishment, (ii) be used for creating the computer code of the audio recitation of at least one menu item of playing a plurality of menu items in the back by described user, and (iii) be used for discerning the user from the computer code of a plurality of menu items to the selection of a menu item at described graphic element; And
Audio output device,
Wherein said audio output device and described storage unit are used to be coupled to described processor.
12. the described interactive device of claim 11, wherein said processor, described audio output device and described storage unit are in described contact pilotage shell, and wherein said processor, described audio output device and described storer are in the platform that is coupled to described contact pilotage shell.
13. the described interactive device of claim 11, wherein said processor, described storage unit and described audio output device are all in described contact pilotage shell, and wherein said contact pilotage shell further comprises optical launcher and the fluorescence detector that is coupled to described processor.
14. the described interactive device of claim 11, wherein said graphic element comprises letter or number.
15. the described interactive device of claim 11, wherein said storage unit comprise the computer code that is used for the invisible substantially sign indicating number on the identify objects.
16. the described interactive device of claim 11, wherein said storage unit comprise the computer code that is used for the invisible substantially sign indicating number on the identify objects, and wherein said invisible substantially sign indicating number has the form of point coding.
17. the described interactive device of claim 11, wherein said storage unit comprise the computer code that is used for the invisible substantially sign indicating number on the identify objects, and wherein said invisible substantially sign indicating number has the form with the point coding of relative or absolute position encoder.
18. a system comprises:
(a) the described interactive device of claim 17; And
(b) comprise described invisible substantially yard article.
19. a system comprises:
(a) the described interactive device of claim 17; And
(b) comprise described invisible substantially yard article, wherein said article comprise paper.
20. a system comprises:
(a) the described interactive device of claim 17; And
(b) comprise described invisible substantially yard article, wherein said article comprise paper, and described paper does not have any pre-printing.
21. a system comprises:
(a) the described interactive device of claim 17; And
(b) comprise described invisible substantially yard article, wherein said article comprise paper, and described paper comprises pre-printing.
22. a system comprises:
(a) interactive device comprises: the contact pilotage shell; Be coupled to the processor of described contact pilotage shell; Voice operation demonstrator; Storage unit, comprise: (i) be used to allow the user to create the computer code of graphic element with described contact pilotage, (ii) be used for after creating described graphic element, playing the computer code of the audio recitation of a plurality of at least one menu item of menu item, (iii) be used to allow the user to select the computer code of a menu item from described a plurality of menu items, and the computer code that (iv) is used for invisible substantially sign indicating number on the identify objects, and wherein said invisible substantially sign indicating number has the form of point coding, and described point coding is with relative or absolute position encoder; And audio output device; Wherein said voice operation demonstrator, described audio output device and described storage unit are used to be coupled to described processor, and wherein said voice operation demonstrator, described audio output device, described processor and described storage unit are in described contact pilotage shell; And
(b) described article.
23. a system comprises:
(a) interactive device comprises: the contact pilotage shell; Be coupled to the processor of described contact pilotage shell; Voice operation demonstrator; Storage unit, comprise: (i) be used to allow the user to create the computer code of graphic element with described contact pilotage, (ii) be used for after creating described graphic element, the computer code that the audio recitation of at least one menu item in a plurality of menu items is play, (iii) be used for allowing the user to select the computer code of a menu item from described a plurality of menu items, and (iv) be used for the invisible substantially yard computer code of discerning on the article, and wherein said invisible substantially sign indicating number has the form of point coding, and described point coding is with relative or absolute position encoder; And audio output device; Wherein said voice operation demonstrator, described audio output device and described storage unit are used to be coupled to described processor, and wherein said voice operation demonstrator, described audio output device, described processor and described storage unit are in described contact pilotage shell.
24. claim 22 or 23 described systems, wherein said invisible substantially sign indicating number is a point coding.
25. comprising, claim 22 or 23 described systems, wherein said storage unit are used for after each follow-up selection, making described interactive device read aloud the computer code of described menu item to described graphic element.
26. claim 22 or 23 described systems, wherein said invisible substantially sign indicating number is relevant with absolute position on the described article.
27. the described system of claim 23 further comprises (b) described article, wherein said article comprise paper, and this paper does not have the type element of pre-printing.
28. the described system of claim 23 further comprises (b) described article, wherein said article comprise paper, and this paper comprises the type element of pre-printing.
29. claim 22 or 23 described systems, wherein said graphic element comprises select a kind of from group that is made of at least one mark and the combination by at least one mark and the line that defines described at least one mark.
30. a method comprises:
Form a plurality of graphic elements with contact pilotage;
With described contact pilotage at least two described graphic elements of select progressively with user's qualification; And
Listen at least one audio frequency output relevant with the graphic element of described formation.
31. a method comprises:
The graphic element of a plurality of establishments on the identified surface;
Identification is to the selection of at least one described graphic element, implemented by described contact pilotage during the described excitation that is chosen in the contact pilotage relevant with described at least one graphic element;
Visit and described at least one graphic element function associated;
Provide at least one audio frequency output according to described function.
32. claim 30 or 31 described methods
Wherein said a plurality of graphic element comprises a plurality of numerals and mathematical operator, and
Wherein select or discern described selection to comprise and select first numeral, first mathematical operator, second numeral and second mathematical operator or identification selection to first numeral, first mathematical operator, second numeral and second mathematical operator, wherein said first numeral, described first mathematical operator and described second mathematical operator form mathematical problem jointly, and at least one wherein relevant with second mathematical operator with selected first numeral, first mathematical operator audio frequency output comprises the answer of described mathematical problem.
33. claim 30 or 31 described methods, wherein said contact pilotage comprises transmitter, detecting device, processor and loudspeaker, wherein said transmitter, detecting device and described loudspeaker are coupled to described processor, and wherein said contact pilotage is coupled to the platform that the sheet that forms described graphic element is thereon supported.
34. claim 30 or 31 described methods, wherein said graphic element comprises letter.
35. claim 30 or 31 described methods, wherein said graphic element comprises: first graphic element comprises a language name; And the second graph element, comprise speech with the language that is different from described language; And wherein select or discern described selection comprise select institute's predicate or identification to the selection of institute's predicate and select described language name then or identification to the selection of described language name, and wherein at least one audio frequency output comprises the synthetic video that institute's predicate is reproduced audibly with described language.
36. the described method of claim 35, wherein said language are non-english languages and wherein said speech is the form with English.
37. claim 30 or 31 described methods, wherein said contact pilotage comprises writing component, and wherein said graphic element is the graphic element that the user creates on sheet, and is that collaborative described contact pilotage is created.
38. the described method of claim 37, wherein said comprises a plurality of invisible substantially sign indicating numbers.
39. the described method of claim 38, wherein said is not had the pre-type element of printing.
40. an interactive device comprises:
The contact pilotage shell;
Be coupled to the processor of described contact pilotage shell;
Storage unit, comprise that (i) is used to discern the computer code of a plurality of graphic elements of creating with contact pilotage, (ii) be used to discern the order that limits with the user with described contact pilotage computer code, and (iii) be used to play the computer code that at least one audio frequency relevant with the graphic element of described formation exported the selection of at least two described graphic elements; And
Audio output device,
Wherein said audio output device and described storage unit are used to be coupled to described processor.
41. the described interactive device of claim 40, wherein said contact pilotage shell comprises writing component.
42. the described interactive device of claim 40, wherein said processor, described storage unit and described audio output device are in described contact pilotage shell.
43. further comprising, the described interactive device of claim 40, wherein said storage unit be used to discern the computer code that is printed on the invisible substantially sign indicating number on the article.
Be used to discern the computer code that is printed on the invisible substantially sign indicating number on the article 44. the described interactive device of claim 40, wherein said storage unit further comprise, wherein said invisible substantially sign indicating number comprises point coding.
45. the described interactive device of claim 40, wherein said equipment further comprises platform, and wherein said storer, described processor and described audio output device are in described platform, wherein said graphic element comprises numeral, and wherein said storage unit further comprises the code that is used to calculate numeral.
46. the described interactive device of claim 40, wherein said interactive device comprises retractible writing component.
47. further comprising, the described interactive device of claim 40, wherein said storage unit be used for the computer code of teaching letter, numeral and phonetics at least a.
48. comprising, the described interactive device of claim 40, wherein said storage unit be used to make synthetic video to read aloud the computer code of a plurality of menu items.
49. a system comprises:
Interactive device comprises the contact pilotage shell; Be coupled to the processor of described contact pilotage shell; Storage unit, comprise that (i) is used to discern the computer code of a plurality of graphic elements of creating with contact pilotage, (ii) be used to discern the order that limits with the user with described contact pilotage computer code, and (iii) be used to play the computer code that at least one audio frequency relevant with the graphic element of described formation exported the selection of at least two described graphic elements; And audio output device; Wherein said audio output device and described storage unit are used to be coupled to described processor; And
Article are created described graphic element thereon.
50. the described system of claim 49, wherein said article comprise that paper and wherein said paper comprise a plurality of sightless substantially sign indicating numbers.
51. the described system of claim 50, wherein said sightless substantially sign indicating number is a point coding.
52. the described system of claim 49, wherein said article comprise that paper and wherein said paper comprise a plurality of sightless substantially sign indicating numbers, and wherein said sightless substantially sign indicating number comprises relatively or absolute location information.
53. the described system of claim 49, wherein said article comprise that paper and wherein said paper comprise a plurality of sightless substantially sign indicating numbers, and wherein said sign indicating number is a point coding, and wherein said paper does not have the type element of pre-printing substantially.
54. the described system of claim 49, wherein said processor, described audio output device and described storage unit are in described contact pilotage shell, and wherein said interactive device or device have the form of self-contained device.
55. the described system of claim 49, wherein said storage unit comprises the computer code that is used for a plurality of menu items.
56. the described system of claim 49, wherein said storage unit comprises the computer code that is used for English-outer dictionary.
57. a method that is used for the interpreting user order comprises:
Be identified in a surface and go up the graphic element of creating;
Visit and described graphic element function associated;
Provide output according to described function; And
Described function is associated with described graphic element.
58. the method for claim 57, wherein said output comprise the audio frequency output relevant with described function.
59. the method for claim 57 further comprises:
By storing the related of described function and described graphic element, enable in response to the follow-up selection of described graphic element and described function is carried out subsequent access.
60. the method for claim 57, wherein said graphic element is created on described surface by contact pilotage.
61. the method for claim 60, wherein said surface comprises paper.
62. the method for claim 57 further comprises:
By explaining one of a plurality of functions relevant with described graphic element are visited at least one excitation of described graphic element, one of described a plurality of functions are selected in wherein said at least one excitation.
63. the method for claim 62, wherein said at least one excitation comprises identification at least once rapping described graphic element.
64. the method for claim 62 further comprises:
When having selected one of described a plurality of functions, provide one of a plurality of audio frequency outputs.
65. the method for claim 62, wherein said a plurality of functions comprise menu item.
66. the method for claim 62 further comprises:
Implement functional classification; And
Provide visit via the classification of graph of a correspondence element to described functional classification.
67. the method for claim 66 further comprises:
Identification is at least one excitation of described graphic element, to select the first hierarchical level function;
The establishment of prompting second graph element;
Identification is at least one excitation of described second graph element, to select the second hierarchical level function;
The audio frequency output relevant with the described second hierarchical level function is provided; And
The described second hierarchical level function is associated with described second graph element.
68. one kind and the interactive method of contact pilotage, described method comprises:
Identification is to writing the selection of lip-deep first graphic icons, and described selection utilizes the writing tools of described contact pilotage to carry out;
In response to described selection, reproduce the tabulation of first option that is associated with described first graphic icons audibly, wherein said first option is used for being called by described contact pilotage; And
In response to selection, call the one of described of described first option to one of described first option.
69. the method for claim 68, wherein said first option comprises at least one application that will call.
70. the method for claim 68, the one of described of wherein said first option is the application program that resides on the described contact pilotage.
71. the method for claim 68, wherein said described tabulation of reproducing described first option audibly comprises: in response to by the selection of described writing tools to described first graphic icons, whenever next reproduces described first option each audibly.
72. the method for claim 71 further comprises: after reproducing described first option one of described audibly, select the part of described first graphic icons in response to described writing tools, identification is to one of the described selection of described first option.
73. the method for claim 72, the described part of wherein said first graphic icons is the check mark symbol.
74. the method for claim 72, the described part of wherein said selection comprise the expression that the identification user utilizes described contact pilotage to make.
75. the method for claim 68, wherein said first graphic icons is that user writing is described lip-deep, and described method further comprises described first graphic icons of automatic identification, and described first graphic icons of wherein said automatic identification utilizes the processor of described contact pilotage to carry out.
76. the method for claim 68, wherein said first graphic icons is printed on the described surface in advance.
77. the method for claim 68, wherein said first graphic icons are menu item and wherein said first option is the Submenu Items in the option classification that is used for being called by described contact pilotage.
78. the method for claim 68, wherein said first option comprise the option with related second graph icon, and described method further comprises:
Identification is to the described selection of writing lip-deep described second graph icon, and described selection utilizes the described writing tools of described contact pilotage to carry out;
In response to described selection, reproduce the tabulation of second option that is associated with described second graph icon audibly, wherein said second option is used for being called by described contact pilotage; And
In response to selection, call the one of described of described second option to one of described second option.
79. the method for claim 78, wherein said second option comprises the application that at least one will call.
80. the method for claim 78, wherein said second select one of described be the application program that resides on the described contact pilotage.
81. the method for claim 78, wherein said described tabulation of reproducing described second option audibly comprises: in response to by the selection of described writing tools to described second graph icon, whenever next reproduces described second option each audibly.
82. the method for claim 81 further comprises: after reproducing described second option one of described audibly, by selecting the part of described second graph icon in response to described writing tools, identification is to one of the described selection of described second option.
83. the method for claim 78, it is described lip-deep that wherein said second graph icon is that the user writes on, and described method further comprises the described second graph icon of automatic identification, and the described second graph icon of wherein said automatic identification utilizes the processor of described contact pilotage to carry out.
84. the method for claim 68, wherein said first option one of described comprise that text recognition function, wherein said contact pilotage are configured to discern the end of the speech of writing by discerning last character that described user raps institute's predicate.
85. the method for claim 68, the one of described of wherein said first option comprises text recognition function, and wherein said contact pilotage is configured to discern the end of the speech of writing.
86. the method for claim 68, one of the described catalog function, wherein said contact pilotage of comprising of wherein said first option is configured to discern speech that the user writes and reproduces the qualification relevant with speech that described user writes audibly.
87. the method for claim 68, one of the described calculator function that comprises of wherein said first option, wherein said contact pilotage is configured to discern a plurality of graphic elements that the user writes, and wherein said a plurality of graphic element comprises a plurality of numerals and mathematical operator, and wherein said contact pilotage is configured to identification to first numeral, first mathematical operator, the selection of second numeral and second mathematical operator, wherein said first numeral, described first mathematical operator and described second mathematical operator form mathematical problem jointly, and the output of described audio frequency comprises the answer of described mathematical problem.
88. the method for claim 68, wherein said first one of the described translator function of selecting that comprises, wherein said contact pilotage is configured to discern a plurality of graphic elements that the user writes, and wherein first graphic element comprises language name and the second graph element comprises the speech with the language that is different from described language, and wherein said contact pilotage is configured to discern to the selection of institute's predicate and the identification selection to described language name, and reproduces institute's predicate audibly with described language.
89. the method for claim 68, one of the described guessing the Word function that comprises of wherein said first option, wherein said contact pilotage is configured to a plurality of graphic elements that the user write that comprise the speech in the sentence are discerned, and wherein said contact pilotage is configured to discern to the follow-up selection of institute's predicate and reproduces described sentence audibly to the follow-up selection of the success of the speech in the described sentence time.
90. the method for claim 68, wherein said first one of the described alarm clock function of selecting, wherein said contact pilotage of comprising is configured to discern the quarter-bell time that the user writes and reproduces audibly and write relevant quarter-bell of quarter-bell time with described user.
91. the method for claim 78, one of the described phone list function that comprises of wherein said first option, and wherein said tabulation of reproducing described second option audibly comprises access phone number, increases telephone number or deletion telephone number, and, call described second option one of described of described phone list function in response to selection to one of described second option.
92. the method for claim 68, wherein said contact pilotage comprise the processor of communicating by letter with the remote computer system of described contact pilotage outside.
93. being server and described processor, the method for claim 92, wherein said remote computer system use radio communication and described server to carry out alternately.
94. the system of claim 22, wherein said article comprise paper, and described paper does not have the type element of pre-printing.
95. the system of claim 22, wherein said article comprise paper, and described paper comprises the type element of pre-printing.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US57737804P | 2004-06-03 | 2004-06-03 | |
| US10/861,243 | 2004-06-03 | ||
| US60/577,378 | 2004-06-03 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1879143A CN1879143A (en) | 2006-12-13 |
| CN100511413C true CN100511413C (en) | 2009-07-08 |
Family
ID=37510781
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2005800004425A Expired - Fee Related CN100511413C (en) | 2004-06-03 | 2005-05-20 | User created interactive interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100511413C (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104137026B (en) * | 2011-12-30 | 2017-05-10 | 英特尔公司 | Method, device and system for graphics identification |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4337375A (en) * | 1980-06-12 | 1982-06-29 | Texas Instruments Incorporated | Manually controllable data reading apparatus for speech synthesizers |
-
2005
- 2005-05-20 CN CNB2005800004425A patent/CN100511413C/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4337375A (en) * | 1980-06-12 | 1982-06-29 | Texas Instruments Incorporated | Manually controllable data reading apparatus for speech synthesizers |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1879143A (en) | 2006-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20060033725A1 (en) | User created interactive interface | |
| CN100578431C (en) | Method and device for associating a user writing with a user-writable element | |
| KR100815078B1 (en) | Interactive system and method of scanning thereof | |
| KR100815534B1 (en) | Providing a user interface having interactive elements on a writable surface | |
| Newton et al. | Teaching science with ICT | |
| CN100390720C (en) | Interactive device and method | |
| US20040140966A1 (en) | Interactive apparatus using print media | |
| US7916124B1 (en) | Interactive apparatus using print media | |
| CN105740314A (en) | Text display device, small-sized device, text display method and learning method | |
| CN100511413C (en) | User created interactive interface | |
| KR100805259B1 (en) | User created interactive interface | |
| CN1469294B (en) | Printing user interface system and its application | |
| CA2450295A1 (en) | Interactive apparatus using print media | |
| Rajaraman et al. | Computer primer | |
| TW498230B (en) | Data conversion method of documents, data conversion system and recording medium; retrieving method of the documents that are converted into data by the same method, retrieving system and recording medium | |
| TW200826002A (en) | System of learning Chinese characters and method thereof | |
| US20170025041A1 (en) | Apparatus and method for teaching persons | |
| CN106920430A (en) | Communication equipment and communication means | |
| JP2007087286A (en) | Exercise information management system and exercise information management method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090708 Termination date: 20100520 |