CN101149812A - Interactive information service method based on paper writing, service system and interactive reading matter - Google Patents
Interactive information service method based on paper writing, service system and interactive reading matter Download PDFInfo
- Publication number
- CN101149812A CN101149812A CNA2006101133398A CN200610113339A CN101149812A CN 101149812 A CN101149812 A CN 101149812A CN A2006101133398 A CNA2006101133398 A CN A2006101133398A CN 200610113339 A CN200610113339 A CN 200610113339A CN 101149812 A CN101149812 A CN 101149812A
- Authority
- CN
- China
- Prior art keywords
- interactive
- paper
- unit
- content
- reading matter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Electrically Operated Instructional Devices (AREA)
Abstract
The present invention discloses an interactive information service method based on paper write, and also opens corresponding interactive information service system and interactive paper books. In this method, first preset information correlated with paper code in the interactive information service system; contact with pages of interactive books through paper information capture module; obtain the location and location change information of page coding testing nib printed on page and reading page contact point, put out feedback information correlated with location or location changes and content of page on the relative position according to position change information. The present invention fully considers the habit that a large number of readers use pen for a long time, enable readers effectively acquire relevant feedback information at the same time, so as to gain more information than simply reading, especially applicable in the education field.
Description
Technical field
The present invention relates to a kind of interactive information method of servicing of realizing based on paper writing, also relate to a kind of interactive information service system that is used to realize this interactive information method of servicing, also relate to simultaneously the interactive papery reading matter that in realizing this interactive information method of servicing, plays a crucial role, belong to the multimodal human-computer interaction technical field.
Background technology
The Internet era, ubiquitous to requiring of calculating, be subjected to great challenge based on the user interface of desk-top computer.Current, because advantage at aspects such as expressive force, mobility and ease for use, calculating based on digital ink and digital pen is human-computer interaction technology one of the most breathtaking trial, and it can help the user at any time and any place, exchange with any computing equipment.By using the advanced digital ink and the computing technique of digital pen, pen can become the important interactive device of desktop computer, panel computer and palm PC.Utilize pen, people can make things convenient for enclose the gains in depth of comprehension that change, annotates and comments on, write downs oneself freely on the papery reading matter, thereby put down in writing the two-way interaction of content on realization and the paper.
Traditional papery reading matter does not possess function interactive and feedback, is therefore needing the occasion of human-computer interaction, and it is easy to use that it is nothing like electron reading.For example, many readers also wish to hear the sound relevant with the book content when reading, and particularly when learning a language, reading literal limit, limit is listened to read aloud and can be obtained good results of learning.This function is easy to realize on electron reading, but for the papery reading matter, though the aided education products such as tape that match with book content are arranged, but it still is not very convenient in the use, especially can not realize that the reader at will chooses a certain paragraph, the just corresponding recording of broadcasting this paragraph of tape.
The handheld electronic book equipment of existing interactive textbook software and band display screen, or should not carry because of system is huge, or make screen very little in order to look after portability, do not meet the reading habit that people formed based on the conventional paper face length phase.Therefore, existing electron reading is further improved still needing aspect ease of use and the human-computer interaction.
At present, occurred a class on the market and be called as the product that point (finger) is read machine, for example publication number is the Chinese utility model patent " interactive learning device " of CN2786695.This device utilizes a digiboard to vacillate on it for a digital pen, and utilizes coordinate decision circuitry check point selection tool current position and send the position signalling of representing this current position, then, control module can be switched to teaching pattern and USB pattern.Wherein, under teaching pattern, control module receiving position signal, and order about playing module and play voice files that should position signalling.Under the USB pattern, control module is by usb interface module this position signalling to be sent to usb host.Though this class device can satisfy the interactive needs of reading of reader to a certain extent, often needs metal or a plastic base also bigger than book, carries very inconvenient.When the actual current page of system's current page setting and book is inconsistent, the acoustic information of reading output will lose efficacy.In addition, book and pedestal very easily produce relative displacement, thereby cause the reading content mistake to occur.
Also has a kind of point reader that adopts the bar code locator meams, as Chinese utility model patent 02206636.5 disclosed a kind of interactive teaching device.This device is recognized the purpose that realizes interactive teaching with resources material by the optical identification mode.Wherein, comprise that one has the decoding apparatus of reading of extended function, in order to the individual optical code that is loaded with resources material of this acceptance of the bid of data registration is read in and finds out voice data corresponding to this optical code, and utilize a loudspeaker to play, also can be immediately produce action, make interest and the learning efficiency that the user can promote study with the teaching pattern of the real-time interactive of seeing the word audition by the image dynamic element.The problem person of being to use of this series products need paste or print specific bar code or some horizontal and vertical parity check code at each ad-hoc location, and is both inconvenient, influences the attractive in appearance of the books page again, and bar code also can occupy the space of a whole page of book, and quality and reading experience are read in influence.In addition, perhaps will set type again for the page of the position book of reserving bar code, therefore the publisher of book can waste a large amount of manpowers and time.
Publication number is that the Chinese invention patent application " the interactive book system of ultrasonic location and calculating ultrasonic are given directions the method for cell position " of CN1530891 discloses the interactive book system of a kind of ultrasonic location and calculated the method that ultrasonic is given directions cell position.This interaction book system is a kind of reader of allowing and printing thing, and for example book produces interactive device, and it comprises prints thing, ultrasonic locating device, control module, data storage and reaction member.The ultrasonic locating device comprises ultrasonic base unit and ultrasonic indication unit, and a reaction member.Allow the reader use ultrasonic to give directions unit zones of different on the printing page or leaf to click to produce interaction.Ultrasonic is given directions between unit and the ultrasonic base unit at ultrasonic and is propagated, and by measuring a plurality of ultrasonic flight time, ultrasonic gives directions the position of unit to determine, thus the experience that produces different audios or vision.Any printing thing can use with this system's collocation as long as relative response data is existed in the data capsule.
Though above-mentioned interactive book system based on ultrasonic locating can provide the reader man-machine interaction service in the read books process, but, the bearing accuracy that the ultrasonic locating mode is realized is very limited, and be easy to be stopped by barrier, also can be subjected to the inaccurate influence in ultrasonic locating device location during the interactive service that therefore should the interaction book system be provided, can't provide reliable and stable service for the reader.
Summary of the invention
First purpose of the present invention provides a kind of interactive information method of servicing of realizing based on paper writing.
Second purpose of the present invention provides a kind of interactive information service system that is used to realize this interactive information method of servicing.
The 3rd purpose of the present invention provides a kind of interactive papery reading matter that plays key effect in realizing this interactive information method of servicing.
For realizing above-mentioned goal of the invention, the present invention adopts following technical scheme:
A kind of interactive reading matter is characterized in that:
Have the paper coding on the page of described reading matter, described paper coding covers on the content of pages that the interactive information service can be provided.
Wherein more preferably, described paper coding and content of pages use different pigment to print respectively, and wherein, content of pages is with CMY or RGB color pigment, and paper is encoded and used carbon black pigment.
A kind of interactive information service system is used for matching so that the interactive information service to be provided with above-mentioned interactive reading matter, it is characterized in that:
Described system comprises paper information capture unit, processor unit, content memorizer, encoding and decoding speech unit, phonetic entry/output unit;
Wherein, paper information capture unit comprises the reading matter page paper image encoded sensor that is used to catch the nib contact, and this unit connects described processor unit;
Described processor unit comprises image processor and miniature central processing unit, and miniature central processing unit wherein connects described content memorizer and encoding and decoding speech unit respectively, and this encoding and decoding speech unit connects described phonetic entry/output unit.
Wherein more preferably, described system also comprises communication unit, and described communication unit is any one in bluetooth module, infrared communication module or the WLAN communication module.
Described system also comprises ciphering unit, and described ciphering unit is the read-only enciphered message storage card of outer plug-in type, and it is connected with described image processor.
Described system is positioned at a lip pencil housing that is suitable for handing.
Perhaps, described paper information capture unit, image processor and voice-input unit are positioned at first housing of lip pencil, and described miniature central processing unit, content memorizer, encoding and decoding speech unit, voice-output unit are in second housing; Be connected with wired or wireless mode between first housing and second housing.
Perhaps, shared described content memorizer of a plurality of described interactive information service systems and described encoding and decoding speech unit, described voice-output unit is an earphone.
Described imageing sensor can be infrared light transducer[sensor.
A kind of interactive information method of servicing is realized based on above-mentioned interactive reading matter and interactive information service system, it is characterized in that:
(1) in described interactive information service system, presets the information that is associated with the paper coding;
(2) contact with the page of described interactive reading matter by paper information capture unit;
(3) obtain relative with the position change information of the paper code detection nib that is printed on the page with the position of reading matter page contact point,
(4) change and feedback information that relevant position place content of pages is associated according to the information output of change in location is relative with position or position.
Wherein more preferably, distribute a unique reading matter coding in advance each described interactive reading matter, and this reading matter coded message is deposited in the ciphering unit in the described interactive information service system;
In the described step (3), described paper information capture unit obtains the described reading matter coding on the described interactive reading matter simultaneously;
Described interactive information service system compares the coded message of having preserved in the reading matter coding that obtains and the ciphering unit, if both meet predetermined matched rule, then continue to carry out described step (4), otherwise refusal is carried out subsequent step.
Wherein more preferably, described interactive information service system at first detects the content of interaction instruction icon, obtains interaction instruction, detects the paper coding at content of pages place then, and interaction mode and this place's content of pages of stipulating according to this interaction instruction carry out interaction.
Interactive information method of servicing based on paper writing provided by the present invention, service system and interactive reading matter are fully looked after the custom of the use paper pen that reading public get up to form for a long time, allow the reader when reading, effectively obtain relevant information feedback, thereby obtain the information abundanter than simple reading.The present invention is particularly suitable for promoting the use of in education sector.
Description of drawings
The present invention is further illustrated below in conjunction with the drawings and specific embodiments.
Fig. 1 is the synoptic diagram as an ordinary pages of the interactive textbook of interactive reading matter exemplary embodiments.
The synoptic diagram that Fig. 2 encodes for the paper of printing on interactive reading matter paper.
Fig. 3 encodes by special coded system for paper, is representing the synoptic diagram of special co-ordinate position information.
Fig. 4 is the composition structural representation of interactive information service system.
Fig. 5 is the synoptic diagram of first embodiment of interactive information service system.
Fig. 6 is the synoptic diagram of second embodiment of interactive information service system.
Fig. 7 utilizes ciphering unit to realize the synoptic diagram of interaction content copyright protection.
Fig. 8 clicks the schematic flow sheet of realizing information feedback by nib.
Embodiment
At first introduce interactive reading matter provided by the present invention below.It is the basis that this interactive information method of servicing is achieved.
Interactive reading matter is meant on the paper of reading matter special marking is set that the reader picks up this special marking by special picking marks instrument, thereby obtains the papery reading matter of corresponding information feedback.Because the triggering of special marking is initiatively carried out by the reader, is the embodiment of reader's subjective will, therefore the information interaction that realizes is two-way interaction.Here it is, and the inventor is called this papery reading matter that has special marking at the reason place of interactive reading matter.
Fig. 1 has shown an ordinary pages 1 as the interactive textbook of interactive reading matter exemplary embodiments.The surface of this page 1 is printed on content of pages 3.Content of pages comprises two parts, and a part of content is consistent with content in the common textbook, and the interactive information service can not be provided; A part of in addition content can realize the interactive information service by interactive information service system provided by the present invention, and this partial content is represented with 3a-3f.In addition, also have instruction area 4, Handwritten Digits Recognition district 5a-5c, handwritten input information w1-w4 on the page 1.
Referring to shown in Figure 2, on the 3a-3f of the zone of the interaction content on the page 1, be printed on the paper coding of forming by point-like mark 76.The special marking that this paper coding 6 is mentioned above being exactly, it can only be imprinted on the page area with interactive information content, also can cover full page.In Fig. 2,, only on the sub-fraction of the page, schematically demonstrate the paper coding for the purpose of clear signal.
The paper coding here is the key link that realizes the interactive information service among the present invention.The plane distribution of paper coding is not random, but has inherent strict mathematical law.Read the plane distribution information that paper is encoded by special optical reading device, just can accurately know the planimetric position at this paper coding place, thereby carry out information feedback targetedly.
The paper encoding scheme itself is a prior art.At present there have been many companies to release and related to the complete skill solution that paper is encoded among the present invention.Wherein be typically Anoto (Arnold's holder) company of Sweden and the Microsoft of the U.S..Anoto company is 01806806.5 (method and system of information combination), 01806805.7 (Method And Device Of Information Processing), 00809739.9 (information recording method), 00813523.1 (notepad), 00813597.5 (coding sheet that is used for optical reading), 00813598.3 (position is determined-calculated), 02809109.4 a series of patents and patented claims such as (methods that is used for process information) in its patent No. (number of patent application), has introduced the complete paper encoding scheme of a cover.Coding in this paper encoding scheme is a kind of position code, and this position code shows as " dot matrix " on paper." dot matrix " is by some very tiny points, according to the regularly arranged composition of particular algorithm.Per 36 points, permutation and combination becomes a dot matrix.Mean distance between 2 is 0.3mm.The size of each dot matrix is 1.8mm * 1.8mm.As shown in Figure 3, dot matrix is being represented special co-ordinate position information by special coded system, thereby offers coordinate parameters information of optical reading instrument, enables the person's handwriting that accurate recording is write.In the solution of Anoto company, the optical reading instrument is a kind of electronic pen, and it is a high-speed camera and the combination with actual writing function pen.High-speed camera be installed in the nib place directly over, can concern with person's handwriting and the position between the two-dimensional lattice on the paper that the speed acquisition of 70～100 frames in the per second is write, and handle by built-in processor, by read and discern pen the dot matrix coding of process, nib movable information on paper can be obtained, and then timestamp, the force value of each sample code can also be write down.Utilize the bluetooth/usb communication unit of this electronic pen tail end, these information can also be sent to other network information terminal such as mobile phone, portable computer etc.
Also there is the paper coding solution of oneself in MS.In application number is 200510065996.5 Chinese invention patent application, a kind of coding pattern that is used for optical device and prepared surface is disclosed for example.With lip-deep symbol pattern data are encoded.Processor can the presentation code data orderly Serial No. be divided into a plurality of continuous windows.In this continuous window each includes a part of sequence in the ordinal number word sequence.This processor further converts included partial sequence in each continuous window to a series of numerals.Symbol is configured in a plurality of surface window on surface.Each surface window is corresponding to one in this continuous window.Based on one in the series that is converted of numeral, this symbol is placed in each surface window.And coded data can be indicated in the position of the symbol in the surface window.At application number is in the Chinese invention patent application of 200510004071.X, a kind of input equipment that is used to generate the data of representing hand-written stroke is disclosed, described input equipment comprises: image-capturing unit, described image-capturing unit is used to catch the image in the zone of the object that described input equipment places, and generates the view data of catching; Processor is used to handle the view data of seizure; Storer is used for representing according to the image data storage of catching the data of hand-written stroke; And the identifier of input equipment.Relevant patent and patented claim also have a lot, here do not enumerate one by one.
In this interactive reading matter, content of pages 3 comprises the literal and the illustration content of reading matter.Different paper codings can be represented content of pages different on the paper respectively, and are associated with corresponding information feedback.By reading information encoded on the paper, just can obtain corresponding paper content information, thereby corresponding information feedback is provided targetedly.In other words, if all pages of a book are imagined as a big imaginary page, then can there be corresponding different paper coding each position on this imaginary big page.If the word content of the somewhere page is provided with massage voice reading, paper coding that then should the place also just with this massage voice reading associating information, the present invention claims this situation to be " paper is encoded related with content of pages ".
Need to prove, not all page place all needs content of pages, the blank space of the page for example, and content of pages that neither be all must be provided with corresponding interactive information, so in this interactive reading matter, the paper coding might not be all related with all content of pages.
Under paper coding and this paper are encoded the situation that the content of pages of position is associated, when the equipment of test paper face code passes through this position, this equipment can start a predetermined operation, at this moment the content of pages of this band of position can " interaction ", and people of the present invention claims that the paper coding zone related with content of pages is " interactive district ".Scheduled operation can be one of following operation: play auditory tone cues information that the massage voice reading of the page location place word content of checkout equipment nib contact, the voice content of playing the page location place of checkout equipment nib contact, auditory tone cues information that broadcast is relevant with the page location place of checkout equipment nib contact, broadcast contacts the page with the checkout equipment nib sequence of positions information is correlated with, be identified in the hand-written information on the page.Like this, this reading matter has just possessed the function of interactive exercise such as basic talking book, aural learning and selection and pairing.The reader just can realize and the reading matter interaction by the test paper face code.
Need to prove, interactive reading matter itself can not provide the reader needed information feedback, it is a media that information interaction is provided, and need match with the equipment of relevant detection paper coding and information feedback system and could realize information interaction targetedly.Therefore, will introduce interactive information service system below as information feedback system.
As shown in Figure 4, this interactive information service system comprises paper information capture unit, processor unit, content memorizer, ciphering unit, encoding and decoding speech unit, phonetic entry/output unit and power supply unit (not shown).This system contacts with the reading matter page that is printed on the paper coding, writes down the information that contact position information and contact position change, and calls corresponding voice output according to these information by predefined computer program in the system.
Wherein, paper information capture unit comprises a reading matter page paper image encoded sensor of catching the nib contact continuously.This connection processing device unit, paper information capture unit.
Processor unit comprises miniature central processing unit (MCU) and image processor, is used to realize functions such as the position is determined, system applies, Handwritten Digits Recognition.MCU wherein connects content memorizer and audio coder ﹠ decoder (codec) respectively.This audio coder ﹠ decoder (codec) connects respectively as the Mike of phonetic entry/output unit and loudspeaker.Image processor connects ciphering unit.
Content memorizer is used for storing the computer program of finishing interaction function and the acoustic information relevant with a certain reading material content.Can make same system can be fit to various types of reading matters by upgrading different program and interaction content, the user is not needed for using different interactive reading matters to repeat system's investment.
Ciphering unit comprises the read-only enciphered message storage card of plug-in type, is used for protecting reading material content illegally not used, with the interests of protection content publisher.Encrypted card can be corresponding one by one with reading matter, and a certain reading matter only just can provide corresponding interactive service behind the encrypted card that insertion matches.About this point, hereinafter also has detailed explanation.
In addition, this interactive information service system can also comprise communication unit.The communication unit here can be a kind of in bluetooth module, infrared communication module or the WLAN communication module, is used to realize and the communicating by letter of external information terminal apparatus such as computing machine etc.
This interactive information service system can have multiple specific implementation form.In first embodiment shown in Figure 5, this components of system as directed or be included in fully in the lip pencil housing that is suitable for handing.Content memorizer adopts high capacity FLASH to upgrade its content by USB interface.Thereby only need change different reading matters by the mode of downloading, the encrypted card that grafting simultaneously matches, this system just can be suitable for different reading matters, is user-friendly to.
In second embodiment shown in Figure 6, paper information capture unit, voice-input unit, image processor are positioned at first housing of lip pencil, and MCU, content memorizer, encoding and decoding speech unit, voice-output unit are in second housing.Be connected with wired or wireless mode between first housing and second housing, encrypted card is connected with inserting mode with first housing.At this moment, content memorizer can adopt the form of read-only memory driver CD-ROM, with the CD-ROM optical disc storage acoustic information relevant with reading matter.Be responsible for determining position and phonetic entry by first housing of native system, and second housing is responsible for voice output, so both can improve the voice output effect of entire system, helps again doing first housing parts littler hand-heldly to be fit to.
The 3rd embodiment is a kind of distortion of second embodiment, is adapted at collective study occasion such as classroom deploy and uses.In the interactive information service system that a plurality of students independently use separately, content memorizer in second housing and encoding and decoding speech unit are decomposed out, a shared content memorizer and encoding and decoding speech unit are realized.A part of computing function of microprocessor unit also can decompose out, is finished by the computing machine of independent setting, and encrypted card is connected with this computing machine.Voice-output unit can use earphone to realize with reference to the way in present voice classroom.Like this, in the 3rd embodiment, only use a computing machine just can greatly reduce the realization cost of this interactive information service system simultaneously for a plurality of students provide the interactive teaching service.
For interactive information service system provided by the present invention and interactive papery reading matter, realize that effective copyright protection is crucial.Above-mentioned ciphering unit is exactly the technical measures for realizing that copyright protection is taked.When printing papery interaction reading matter, distribute a unique encoding for each interactive reading matter, in order to distinguish different reading matters.This unique encoding is called as the reading matter coding, and it can be common one dimension sign indicating number, also can be two-dimension code.This reading matter coding is printed on the remarkable position of reading matter, and simultaneously it is write in the encrypted card.Like this, encrypted card and reading matter just can be realized corresponding one by one.During actual the use, at first click the reading matter coding of reading matter with pen, paper information capture unit reads this reading matter coding, and with encrypted card in the coded message of having preserved compare, if the two meets predetermined matched rule, then make the image processor in this interactive information service system be in normal operating conditions, otherwise refusal provide the interactive information service.
As shown in Figure 7, the pairing sound-content of each interactive reading matter also can be encoded with the reading matter of this reading matter and be encrypted.Like this, before needs were play the sound relevant with the reading matter content of pages, the interactive information service system will judge at first that all whether the coded message in the encrypted card mate with the encrypted code of audio files, only is complementary and just plays this sound-content.
Like this, by above-mentioned technical measures, relevant interaction content author's copyright just can be effectively protected, thereby can excite them to create the enthusiasm of how interactive works.
The interactive information method of servicing that utilizes this interactive information service system and interactive reading matter to realize is such: contact with the interactive reading matter page of a papery by the paper information capture unit that contains nib, the interactive information service system is according to the paper code detection nib that is printed on the page and the position of reading matter page contact point and the variation of position, and the related feedback information of the variation of output and position or position and relevant position place content of pages such as sound etc. and user interaction.The essence of this method is, is user's inputting interface interface, is input tool, is feedback information with the voice output with the paper information capture unit of test paper face code with the reading matter page with paper coding, realizes the interaction of user and papery reading matter.
When nib process content of pages 3b, system is encoded to index with detected paper, retrieves the recording and the broadcast of three sections dialogues at the content of pages 3d place related with content of pages 3a that stores in the system;
When writing character w1 (numeral " 1 ") at character recognition district 5c, system log (SYSLOG) paper coding also starts the character recognition function.
When at content of pages 3e zone line w3, reference position and the final position of system log (SYSLOG) stroke w3, and be encoded to indexed search with initial paper and go out the position paired data of storing in the system, the final position of judging stroke w3 is in the final position zone of this position paired data, so the similar auditory tone cues information of the information of voice suggestion " correctly ", " having answered questions " and so on or cheer, applause etc.;
When at content of pages 3e zone line w4, reference position and the final position of system log (SYSLOG) stroke w4, and be encoded to indexed search with initial paper and go out the position paired data of storing in the system, the final position of judging stroke w4 is not in the final position zone of this position paired data, so voice suggestion " is thought about it " again or other represents not provide the auditory tone cues information of correct option and so on.
With reference to shown in Figure 8, above-mentioned interaction can or be clicked the page and realize by the process of the nib in the paper information capture unit.Simultaneously, because the operation that nib is double-clicked also is the mode that the user is accustomed to, also can be used as the interactive operation mode.
Because in this interactive information method of servicing, concrete interaction mode comprises: imitation is read aloud the content of chosen page position and contrast, is dubbed, checks and confirm the information of handwriting input with the part dialog of the page location of selecting and playback, for the chosen page content---fill a vacancy etc.Fan Kui acoustic information can comprise in addition: the reading aloud of page word content, the voice content of the page, nib is selected in the page or match after prompting or to the voice suggestion of the prompting after misinterpretation, the handwriting input, next step operation etc., therefore be particularly suitable for the interaction function of implementation language study class books.
In the process of implementing this interactive information method of servicing,, special instruction area can be set in order to allow the interactive information service system fully understand reader's intention.At this moment, the interactive information service system detects the content of interaction instruction icon earlier, thereby obtains interaction instruction, detects the paper coding at content of pages place then and begins and carry out interaction according to interaction mode and this place's content of pages of this interaction instruction.
Employing is provided with the interactive approach in special instruction district, and which type of interaction mode the user will determine to take earlier, selects then which content of pages to carry out such interactive operation with.Because interaction mode and reading material content are separately, can be according to the different flexible design variations of reading matter type and content and the interaction mode of innovation.
Instruction area 4 can comprise the interaction instruction icon set and the instruction icon set is set.Be printed on interaction instruction icon a1-a4 respectively and instruction icon b1-b5 is set.The paper coding that instruction icon place is printed on can be with its at the relevant page paper coding of the physical location of each page, benefit is that paper is coded in the full page continuously, simplifies paper and is coded in the interior layout of the page; Instruction figure target paper coding also can be irrelevant with page location, and benefit is that each instruction figure indicates fixing paper coding.The instruction icon can be independent of product and exist, and for example is imprinted on the independent command card, also can be imprinted on certain page of product, even can be printed on each page or leaf, with the utilization of convenient instruction.Each instruction figure target function below is described respectively.
Interaction instruction:
The operation that all interaction instruction are carried out all is the interactive operation at content of pages, therefore needs and operation that nib is clicked the page cooperates execution.
Dialogue/playing function:
After the user clicked " dialogue " icon, system started " dialogue " function according to this instruction paper coding, waits for that the user selects to talk with object; After the user clicks content of pages 3c selection dialogue object, system retrieves conversation group according to the paper coding and judges this object and is answer side, so prompting " begins dialogue " and starts sound-recording function, the user speak (for example " Is this yourbackpack? ") after, method, system voice " No, it isn ' t.It ' s hisbackpack. " are answered in system's output.Simultaneously, the whole dialogue recording is that index stores is in system with dialog region paper coding region.
Nib is clicked " broadcast " icon, and system starts " broadcast " function according to this instruction paper coding, waits conversation group paper coded message to be read, and after the user clicked dialog region content of pages 3f, system pressed the taped conversations of paper coding retrieve stored and plays.
Dub function:
Nib is clicked " dubbing " icon, and system starts " dubbing " function according to this instruction paper coding, waits for that the user selects the content of pages that will dub.The user click behind the page system according to the paper coding retrieval can dub page area, if retrieval is less than this zone, prompting is reselected, and can dub page area and then begins recording if retrieve, and should record and dub regional paper with this and encode and store after setting up index.The content of pages of having been dubbed is dubbed through out-of-date will the broadcast by nib.
Inspection/affirmation function:
When behind character recognition district inputting characters by handwriting, click " inspection " icon, system starts " inspection " function according to this instruction paper coding, with of the form output of handwriting input recognition result with voice, point out the user " if identification error re-enters; if correct ' affirmation ' icon of clicking of identification " then, after clicking the affirmation icon, system is encoded to numeral that indexed search goes out the character of storing in the system and the hand-written character that identifies with the paper in handwriting input zone and compares and judge, if voice suggestion " correctly " is correctly then play in input, the information or the cheer of " having answered questions " and so on, applauses etc. are auditory tone cues information similarly; If input error, play then that voice suggestion " is thought about it " again or other expression does not provide the auditory tone cues information of correct option and so on.
With reading/comparing function:
After clicking " with reading " icon, system starts " with reading " function according to this instruction paper coding, waits for reading content paper coded message; After the user clicked content of pages, system retrieved the massage voice reading data of this content of pages according to page paper coding and plays, and begins recording then, and the data of will recording after the recording are set up index stores with this page area paper coding with reading voice; After clicking comparing function and clicking the page, system is by this page paper coding former sound of retrieval with reading voice and playing sequentially.
Instruction is set:
Different with interaction instruction, it is operation to system that instruction is set, only these operations are not by the button on the equipment but finish by the instruction icon that is provided with of the page, independently finish one order is set so each is provided with the instruction chart, have nothing to do with content of pages.
Instruction is set can be comprised: volume increases, volume reduces, quiet, sound repeats, system help.Thereby, user's interaction, being provided with even writing operation and all can carry out in the same mode of on reading matter, clicking and move, the user can obtain new non-traditional functions in the mode of tradition and custom.
In order to give the more operation indicating of reader, can be with voice messaging as the user interface option, be that on the papery reading matter page one instruction icon is every once clicked, system just exports the voice suggestion that will carry out a predetermined instruction, have two different instruction voice suggestions at least along with the instruction icon is clicked and output circularly at every turn, after system received a confirmation, the instruction corresponding with this confirmation last command prompt voice before was performed in above-mentioned cyclic process.
Thereby, the icon of the reading matter page becomes a kind of novel user interface, and acoustic information becomes the menu option of this user interface, the benefit of this method is to increase taking the page for the interaction function that increases the papery reading matter, book seems the still appearance of the original book of being familiar with, and its interaction mode can not be subjected to space of a whole page restriction and do not need expansion again with setting type.
Independent Handwritten Digits Recognition district can also be set on interactive reading matter, and the information that the reader writes this district can be carried out Handwritten Digits Recognition, thereby forms a kind of intelligentized interaction mode.In this interactive information method of servicing, handwriting input has the highest priority, need at first be examined.This is because user's hand-written information may correctly not discerned by system, is what just can tell whether the user imports correct after so system needs earlier and the user confirms to import, otherwise might misleads the user.Since product itself may have the many places pages adopt can handwriting input design, these pages can not, also not necessarily be necessary all to be designed to carry out the mode of handwriting recognition, so be necessary with special background character recognition district and other can handwriting input area region separately, with the puzzlement of avoiding the user to use.
In order to allow paper information capture unit effectively discern the paper coding, do not disturbed again simultaneously by the literal of paper and pattern, the coding of the paper on the reading matter page can be printed with different pigment with content of pages.For example, content of pages and instruction icon are printed with CMY or RGB color pigment, and the paper coding is printed with carbon black look pigment.Like this, the paper coding is that infrared light is discernible, and content of pages and instruction icon are that infrared light is unrecognizable, and the imageing sensor in the paper information capture unit is changed to infrared light transducer[sensor, then can be under the situation of avoiding the paper out of Memory to disturb the effective information of test paper face code.
Above the interactive information method of servicing based on paper writing of the present invention, information service system and interactive reading matter are had been described in detail.For one of ordinary skill in the art, any conspicuous change of under the prerequisite that does not deviate from connotation of the present invention it being done all will constitute to infringement of patent right of the present invention, with corresponding legal responsibilities.
Claims (12)
1. interactive reading matter is characterized in that:
Have the paper coding on the page of described reading matter, described paper coding covers on the content of pages that the interactive information service can be provided.
2. interactive reading matter as claimed in claim 1 is characterized in that:
Described paper coding and content of pages use different pigment to print respectively, and wherein, content of pages is with CMY or RGB color pigment, and paper is encoded and used carbon black pigment.
3. an interactive information service system is used for matching so that the interactive information service to be provided with the described interactive reading matter of claim 1, it is characterized in that:
Described system comprises paper information capture unit, processor unit, content memorizer, encoding and decoding speech unit, phonetic entry/output unit;
Wherein, paper information capture unit comprises the reading matter page paper image encoded sensor that is used to catch the nib contact, and this unit connects described processor unit;
Described processor unit comprises image processor and miniature central processing unit, and miniature central processing unit wherein connects described content memorizer and encoding and decoding speech unit respectively, and this encoding and decoding speech unit connects described phonetic entry/output unit.
4. interactive information service system as claimed in claim 3 is characterized in that:
Described system also comprises communication unit, and described communication unit is any one in bluetooth module, infrared communication module or the WLAN communication module.
5. interactive information service system as claimed in claim 3 is characterized in that:
Described system also comprises ciphering unit, and described ciphering unit is the read-only enciphered message storage card of outer plug-in type, and it is connected with described image processor.
6. as any described interactive information service system in the claim 3～5, it is characterized in that:
Described system is positioned at a lip pencil housing that is suitable for handing.
7. as any described interactive information service system in the claim 3～5, it is characterized in that:
Described paper information capture unit, image processor and voice-input unit are positioned at first housing of lip pencil, and described miniature central processing unit, content memorizer, encoding and decoding speech unit, voice-output unit are in second housing; Be connected with wired or wireless mode between first housing and second housing.
8. as any described interactive information service system in the claim 3～5, it is characterized in that:
Shared described content memorizer of a plurality of described interactive information service systems and described encoding and decoding speech unit, described voice-output unit is an earphone.
9. interactive information service system as claimed in claim 3 is characterized in that:
Described imageing sensor is an infrared light transducer[sensor.
10. an interactive information method of servicing is realized based on interactive reading matter as claimed in claim 1 and the described interactive information service system of claim 5, it is characterized in that:
(1) in described interactive information service system, presets the information that is associated with the paper coding;
(2) contact with the page of described interactive reading matter by paper information capture unit;
(3) obtain relative with the position change information of the paper code detection nib that is printed on the page with the position of reading matter page contact point,
(4) change and feedback information that relevant position place content of pages is associated according to the information output of change in location is relative with position or position.
11. interactive information method of servicing as claimed in claim 10 is characterized in that:
Distribute a unique reading matter coding in advance each described interactive reading matter, and this reading matter coded message is deposited in the ciphering unit in the described interactive information service system;
In the described step (3), described paper information capture unit obtains the described reading matter coding on the described interactive reading matter simultaneously;
Described interactive information service system compares the coded message of having preserved in the reading matter coding that obtains and the ciphering unit, if both meet predetermined matched rule, then continue to carry out described step (4), otherwise refusal is carried out subsequent step.
12. interactive information method of servicing as claimed in claim 10 is characterized in that:
Described interactive information service system at first detects the content of interaction instruction icon, obtains interaction instruction, detects the paper coding at content of pages place then, and interaction mode and this place's content of pages of stipulating according to this interaction instruction carry out interaction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101133398A CN101149812A (en) | 2006-09-22 | 2006-09-22 | Interactive information service method based on paper writing, service system and interactive reading matter |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006101133398A CN101149812A (en) | 2006-09-22 | 2006-09-22 | Interactive information service method based on paper writing, service system and interactive reading matter |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101149812A true CN101149812A (en) | 2008-03-26 |
Family
ID=39250326
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006101133398A Pending CN101149812A (en) | 2006-09-22 | 2006-09-22 | Interactive information service method based on paper writing, service system and interactive reading matter |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101149812A (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101600006A (en) * | 2008-06-02 | 2009-12-09 | 郑阿奇 | A kind of method with the mobile phone reading printed matter |
| CN101870216A (en) * | 2009-04-21 | 2010-10-27 | 北京华旗资讯数码科技有限公司 | Paper carrier capable of attaching micro-code information |
| CN102411458A (en) * | 2011-08-15 | 2012-04-11 | 留越 | Information processing method and system for handwriting on paper |
| CN102941742A (en) * | 2012-10-19 | 2013-02-27 | 刘瑛 | Solid book system with interaction function |
| CN102955584A (en) * | 2011-08-22 | 2013-03-06 | 幻音科技(深圳)有限公司 | Input method and input system |
| CN103930853A (en) * | 2011-09-22 | 2014-07-16 | 惠普发展公司，有限责任合伙企业 | Soft button input systems and methods |
| CN104156079A (en) * | 2013-05-14 | 2014-11-19 | 广州杰赛科技股份有限公司 | Learning path recording method and system |
| CN104158832A (en) * | 2013-05-14 | 2014-11-19 | 广州杰赛科技股份有限公司 | Information interaction system based on pen computer |
| CN105446628A (en) * | 2015-12-31 | 2016-03-30 | 田雪松 | Electronic reading method |
| CN105512597A (en) * | 2015-12-31 | 2016-04-20 | 田雪松 | Dot matrix identification method |
| CN106548680A (en) * | 2016-11-24 | 2017-03-29 | 广东小天才科技有限公司 | Writing exercise method, device and system |
| CN110349458A (en) * | 2019-07-23 | 2019-10-18 | 湖南纸云互动智能科技有限公司 | A kind of paper cloud interaction interactive system |
| CN110609641A (en) * | 2019-08-13 | 2019-12-24 | 昆山龙腾光电股份有限公司 | Touch pen, display panel, touch display device and method |
| CN110929709A (en) * | 2019-10-25 | 2020-03-27 | 北京光年无限科技有限公司 | Method and device for converting point-reading content into sketch finger-reading content based on OID |
| WO2020199318A1 (en) * | 2019-04-02 | 2020-10-08 | 麦片科技（深圳）有限公司 | Book click-to-read interaction device and control method therefor, and computer readable storage medium |
| CN112506398A (en) * | 2020-11-25 | 2021-03-16 | 飞毯信息技术有限公司 | Image-text display method, device and computer readable medium for same |
-
2006
- 2006-09-22 CN CNA2006101133398A patent/CN101149812A/en active Pending
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101600006A (en) * | 2008-06-02 | 2009-12-09 | 郑阿奇 | A kind of method with the mobile phone reading printed matter |
| CN101870216A (en) * | 2009-04-21 | 2010-10-27 | 北京华旗资讯数码科技有限公司 | Paper carrier capable of attaching micro-code information |
| CN102411458A (en) * | 2011-08-15 | 2012-04-11 | 留越 | Information processing method and system for handwriting on paper |
| CN102955584A (en) * | 2011-08-22 | 2013-03-06 | 幻音科技(深圳)有限公司 | Input method and input system |
| CN103930853A (en) * | 2011-09-22 | 2014-07-16 | 惠普发展公司，有限责任合伙企业 | Soft button input systems and methods |
| CN102941742A (en) * | 2012-10-19 | 2013-02-27 | 刘瑛 | Solid book system with interaction function |
| CN102941742B (en) * | 2012-10-19 | 2015-08-12 | 刘瑛 | A kind of physical book system with interactive function |
| CN104156079A (en) * | 2013-05-14 | 2014-11-19 | 广州杰赛科技股份有限公司 | Learning path recording method and system |
| CN104158832A (en) * | 2013-05-14 | 2014-11-19 | 广州杰赛科技股份有限公司 | Information interaction system based on pen computer |
| CN105512597A (en) * | 2015-12-31 | 2016-04-20 | 田雪松 | Dot matrix identification method |
| CN105446628A (en) * | 2015-12-31 | 2016-03-30 | 田雪松 | Electronic reading method |
| CN105446628B (en) * | 2015-12-31 | 2018-08-07 | 北京奇禄管理咨询有限公司 | A kind of reading method |
| CN106548680A (en) * | 2016-11-24 | 2017-03-29 | 广东小天才科技有限公司 | Writing exercise method, device and system |
| CN106548680B (en) * | 2016-11-24 | 2019-08-09 | 广东小天才科技有限公司 | Writing exercise method, device and system |
| WO2020199318A1 (en) * | 2019-04-02 | 2020-10-08 | 麦片科技（深圳）有限公司 | Book click-to-read interaction device and control method therefor, and computer readable storage medium |
| CN110349458A (en) * | 2019-07-23 | 2019-10-18 | 湖南纸云互动智能科技有限公司 | A kind of paper cloud interaction interactive system |
| CN110609641A (en) * | 2019-08-13 | 2019-12-24 | 昆山龙腾光电股份有限公司 | Touch pen, display panel, touch display device and method |
| CN110929709A (en) * | 2019-10-25 | 2020-03-27 | 北京光年无限科技有限公司 | Method and device for converting point-reading content into sketch finger-reading content based on OID |
| CN112506398A (en) * | 2020-11-25 | 2021-03-16 | 飞毯信息技术有限公司 | Image-text display method, device and computer readable medium for same |
| CN112506398B (en) * | 2020-11-25 | 2023-06-09 | 飞毯信息技术有限公司 | Image-text display method and device and computer readable medium for the same |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101149812A (en) | Interactive information service method based on paper writing, service system and interactive reading matter | |
| US8477095B2 (en) | Audio book for pen-based computer | |
| US20080042970A1 (en) | Associating a region on a surface with a sound or with another region | |
| KR101067360B1 (en) | Printing method of information processing device and printing control system of icon image | |
| CN102067153B (en) | Multi-modal learning system | |
| KR100815535B1 (en) | Methods and devices for retrieving information stored as a pattern | |
| JP4391572B2 (en) | GAM program, GAM terminal, GAM server, and GAM system | |
| WO2011093458A2 (en) | Input-output device, and information input-output system | |
| US20160162137A1 (en) | Interactive Digital Workbook Using Smart Pens | |
| WO2011027853A1 (en) | Information input/output apparatus, information processing apparatus, information input/output system, printing medium, and information input/output method | |
| KR101789057B1 (en) | Automatic audio book system for blind people and operation method thereof | |
| WO2023123590A1 (en) | Answering processing method based on handwriting track identification, stylus, system and terminal | |
| US20090248960A1 (en) | Methods and systems for creating and using virtual flash cards | |
| GB2428124A (en) | Digital pen correlating handwriting with speech | |
| TW201314638A (en) | Learning machine with augmented reality mechanism | |
| JP2014081950A (en) | Data processing system applying optical identification devices, method thereof, operation method thereof, and computer-readable recording medium | |
| CN104505103A (en) | Voice quality evaluation equipment, method and system | |
| CN201788597U (en) | Reading pen | |
| KR101467852B1 (en) | Controlling method for reproduction of sound from playing musical instrument by electronic pen using prints code image is printed there on and Electronic pen performing therof | |
| US9916770B2 (en) | Methods and systems for tactile code interpretation | |
| JP5489122B2 (en) | Information input / output device, information processing device, print medium, and information input / output method | |
| KR200486582Y1 (en) | System for providing dynamic reading of publication using mobile device | |
| KR20170129979A (en) | System for providing sound effect | |
| CN211319427U (en) | Point reading device capable of playing through remote equipment | |
| KR101149531B1 (en) | Pattern-Code Cognition Pen and Driving Method of the Same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20080326 |