WO2010061584A2 - 手書き入出力システム、手書き入力シート、情報入力システム、情報入力補助シート - Google Patents
手書き入出力システム、手書き入力シート、情報入力システム、情報入力補助シート Download PDFInfo
- Publication number
- WO2010061584A2 WO2010061584A2 PCT/JP2009/006332 JP2009006332W WO2010061584A2 WO 2010061584 A2 WO2010061584 A2 WO 2010061584A2 JP 2009006332 W JP2009006332 W JP 2009006332W WO 2010061584 A2 WO2010061584 A2 WO 2010061584A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- dot pattern
- handwriting input
- output system
- writing area
- Prior art date
Links
- 238000004458 analytical method Methods 0.000 claims abstract description 122
- 238000012545 processing Methods 0.000 claims abstract description 111
- 230000010365 information processing Effects 0.000 claims abstract description 103
- 238000003384 imaging method Methods 0.000 claims description 228
- 239000010410 layer Substances 0.000 claims description 108
- 238000000034 method Methods 0.000 claims description 108
- 230000008859 change Effects 0.000 claims description 64
- 230000008569 process Effects 0.000 claims description 20
- 238000004364 calculation method Methods 0.000 claims description 19
- 239000000463 material Substances 0.000 claims description 18
- 238000003860 storage Methods 0.000 claims description 18
- 206010047571 Visual impairment Diseases 0.000 claims description 12
- 239000011241 protective layer Substances 0.000 claims description 12
- 230000001678 irradiating effect Effects 0.000 claims description 11
- 230000003287 optical effect Effects 0.000 claims description 11
- 230000004913 activation Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 abstract description 46
- 230000006870 function Effects 0.000 description 42
- 230000009471 action Effects 0.000 description 30
- 238000005259 measurement Methods 0.000 description 12
- 230000005540 biological transmission Effects 0.000 description 10
- 238000004422 calculation algorithm Methods 0.000 description 10
- 238000009792 diffusion process Methods 0.000 description 10
- 210000005252 bulbus oculi Anatomy 0.000 description 7
- 239000012790 adhesive layer Substances 0.000 description 5
- 238000012937 correction Methods 0.000 description 5
- 235000002673 Dioscorea communis Nutrition 0.000 description 4
- 241000544230 Dioscorea communis Species 0.000 description 4
- 102100022193 Glutamate receptor ionotropic, delta-1 Human genes 0.000 description 4
- 101000900493 Homo sapiens Glutamate receptor ionotropic, delta-1 Proteins 0.000 description 4
- 208000035753 Periorbital contusion Diseases 0.000 description 4
- 239000013256 coordination polymer Substances 0.000 description 4
- -1 envipet Polymers 0.000 description 4
- 238000012015 optical character recognition Methods 0.000 description 4
- 230000001681 protective effect Effects 0.000 description 4
- 241000699666 Mus <mouse, genus> Species 0.000 description 3
- 241001648319 Toronia toru Species 0.000 description 3
- 238000012217 deletion Methods 0.000 description 3
- 230000037430 deletion Effects 0.000 description 3
- 230000001771 impaired effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- RIBGNAJQTOXRDK-UHFFFAOYSA-N 1,3-dichloro-5-(3-chlorophenyl)benzene Chemical compound ClC1=CC=CC(C=2C=C(Cl)C=C(Cl)C=2)=C1 RIBGNAJQTOXRDK-UHFFFAOYSA-N 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 2
- 239000004743 Polypropylene Substances 0.000 description 2
- 239000004820 Pressure-sensitive adhesive Substances 0.000 description 2
- 230000002457 bidirectional effect Effects 0.000 description 2
- 229910052799 carbon Inorganic materials 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 229920001155 polypropylene Polymers 0.000 description 2
- 239000011347 resin Substances 0.000 description 2
- 229920005989 resin Polymers 0.000 description 2
- 125000000391 vinyl group Chemical group [H]C([*])=C([H])[H] 0.000 description 2
- 229920002554 vinyl polymer Polymers 0.000 description 2
- YZANRISAORXTHU-UHFFFAOYSA-N 1,2-dichloro-4-(4-chlorophenyl)benzene Chemical compound C1=CC(Cl)=CC=C1C1=CC=C(Cl)C(Cl)=C1 YZANRISAORXTHU-UHFFFAOYSA-N 0.000 description 1
- 102100022192 Glutamate receptor ionotropic, delta-2 Human genes 0.000 description 1
- 101000900499 Homo sapiens Glutamate receptor ionotropic, delta-2 Proteins 0.000 description 1
- 241000255777 Lepidoptera Species 0.000 description 1
- 241000699670 Mus sp. Species 0.000 description 1
- 239000011358 absorbing material Substances 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 239000002989 correction material Substances 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 210000001508 eye Anatomy 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000000059 patterning Methods 0.000 description 1
- 239000012466 permeate Substances 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000009751 slip forming Methods 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
- 238000007740 vapor deposition Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
- G06F3/0321—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
Definitions
- the present invention relates to a handwriting input / output system and a handwriting input sheet for inputting handwritten information such as characters and figures into a computer system.
- the present invention relates to an information input system and an information input auxiliary sheet for assisting input to a computer system.
- a system for inputting handwritten information to a computer has been proposed as a solution to such a problem.
- Such a system includes a base and a drawing device.
- graphical information handwritten information
- the base is provided with a position encoding pattern which is a fine dot, and position information on the base is registered in this position encoding pattern.
- the drawing device reads the position coding pattern.
- the computer system records position information on the base from the drawing device as a graphical input.
- the drawn content can be input to a computer system and output to a display or stored in a memory (for example, Patent Document 1).
- the position coding pattern used in the system of Patent Document 1 has only position information registered. Therefore, the computer system can input only the graphical information drawn by the drawing device. For example, in order to input and record various information related to the graphical information such as the page number of the booklet, An area different from the above area must be provided separately. Therefore, the handwriting input / output system becomes complicated, and there is a problem that the user needs to operate in a plurality of areas.
- a reference table for inputting and recording various information related to the graphical information must be provided for all position information corresponding to the graphical information drawn by the drawing apparatus. In particular, when the drawing area is not a rectangle but an area surrounded by a polygon or a curve, a reference table for all position information in the area is required.
- the present invention has been made in view of such a problem, and an object of the present invention is to provide a handwritten input / output system capable of inputting characters, figures and the like by handwriting in a simple and inexpensive manner. It is another object of the present invention to provide a handwriting input / output system that can input not only information on characters and figures but also information related to them in a lump.
- a handwriting input / output system includes a medium including a writing area in which a dot pattern in which coordinate information and code information are repeatedly defined is formed in at least a part or a plurality of areas, and the dots in the writing area
- An imaging unit that captures and transmits a pattern, and image data of the dot pattern captured and transmitted by the imaging unit is stored, and the image data is subjected to code analysis, whereby the coordinate information and the code information are obtained.
- a dot pattern analyzing means for obtaining the locus information, and a locus recognition means for recognizing the locus information of the characters and / or figures traced on the writing area surface based on the change of the analyzed coordinate information.
- a processing command based on the recognized information and a processing command means for transmitting the trajectory information to the information processing means. And butterflies.
- the dot pattern formed on the medium defines not only the coordinate information but also the code information, so that the processing instruction means provides the locus information to the information processing unit. And processing instructions based on the trajectory information can be transmitted collectively.
- text, graphics, and photographs related to the writing area are further formed in at least a part or a plurality of areas of the medium.
- the handwriting input / output system can easily know what the user should write in the position of the writing area and the writing area.
- the medium is formed by superimposing the dot pattern together with at least the locus information drawn on the writing area surface or editing result information of the locus information and / or printing information on the medium surface. Is preferred.
- the handwriting input / output system can perform writing / editing on a medium once handwritten and input by superimposing the medium together with a new dot pattern.
- the medium has specific information and / or operation instructions (program start, command input, data input / output / search, search target) for specifying the write area with respect to a predetermined medium surface and / or the write area surface. It is preferable that an icon representing the code information is formed so as to be superimposed on the dot pattern in which the code information defining the designation is repeatedly formed.
- the handwriting input / output system it is easy for the user to see what meaning the code information has (what processing instruction is transmitted), and the user can see the icon. I can know.
- the icon is formed on the stickable sticker, sticky note paper, or other medium surface so as to overlap the dot pattern.
- the degree of freedom in layout is increased.
- the medium is a second medium in which a dot pattern in which code information for specifying the first medium surface and / or the writing area surface is repeatedly defined is formed using the medium provided with the writing area as a first medium.
- the code information formed on the second medium is read by the imaging unit, and the print information on the first medium surface and / or the trajectory information drawn on the writing area surface And / or information related to the trajectory information is preferably output.
- the handwriting input / output system prints code information for specifying a medium surface on another medium (such as a notebook) and touches it with an imaging unit, thereby handwriting input on the medium surface. Can be searched and output.
- a wide space in the writing area of the medium it is possible to take a wide space in the writing area of the medium.
- the second medium preferably has a stickable sticker, sticky note, or a card-like form.
- the handwriting input / output system further increases the flexibility of the layout of the writing area, and searches and outputs information input by handwriting in the writing area according to the convenience and preference of the user. It can be executed freely.
- the medium is a transparent medium formed with a dot pattern in which coordinate information and / or code information is repeatedly defined, ie, a grid, used by being overlaid on a monitor surface on which the writing area is displayed by the handwriting input / output system.
- a sheet is preferred.
- the handwriting input / output system can provide a touch panel with good handling.
- the medium is a transparent medium on which a dot pattern in which coordinate information and / or code information is repeatedly defined is used, that is, a grid sheet, which is used by overlapping the writing area by the handwriting input / output system. Preferably there is.
- the handwriting input / output system allows handwriting input by covering the medium surface with the grid sheet without overlapping the grid sheet on the monitor surface.
- the imaging means includes an irradiating means for irradiating the medium surface with light of a predetermined wavelength via an imaging port, an imaging element for imaging reflected light of the predetermined wavelength and transmitting the image data to the dot pattern analyzing means,
- the dot pattern analyzing means causes the irradiating means to emit light having a predetermined intensity for a first predetermined time, and the dot pattern analyzing means captures an image by the imaging device and stores the transmitted image data.
- the predetermined intensity of light can be fixed to the image sensor as an afterimage for a time longer than the analysis time required for code analysis of the image data by the dot pattern analysis means.
- a light control means for controlling the irradiating means to emit light again after elapse of a predetermined time of 2, and the first predetermined time and the second predetermined time are continuous. Masui.
- the handwriting input / output system can burn the dot pattern on the imaging element without blurring the movement of the imaging means on the medium surface when writing.
- handwriting input is possible even when the frame rate (imaging speed) of the imaging means is low.
- the light control means instructs the irradiating means to emit light without waiting for the second predetermined time after the code analysis of the image data by the dot pattern analyzing means is completed.
- the dot pattern analyzing means emits light of a predetermined intensity for a predetermined time, and the dot pattern analysis means stores image data newly imaged and transmitted by the imaging means and performs code analysis.
- the handwriting input / output system immediately receives the next code when the code analysis is completed earlier than the second predetermined time due to imaging / analysis of an ideal dot pattern or an error.
- the imaging interval is shortened and smooth trajectory information can be acquired.
- the light control means immediately instructs the irradiation means to emit light without waiting for the second predetermined time during the dot pattern analysis time by the dot pattern analysis means, and the irradiation means
- the dot pattern analysis unit emits light of the predetermined intensity for a predetermined time, and the image data newly captured and transmitted by the imaging unit is stored during the analysis time. It is preferable to code-analyze the image data immediately after completion.
- the dot pattern analysis means stores the next image data during the code analysis, and immediately moves to the code analysis of the next image data after the code analysis is completed.
- the imaging interval is further shortened and smooth trajectory information can be acquired.
- the imaging unit further includes an instruction protrusion, and when tracing a character and / or figure traced by the instruction protrusion on the writing area surface, the dot pattern on the locus in the vicinity of the instruction protrusion
- the dot pattern analysis unit stores the image data of the dot pattern transmitted by the imaging unit and performs code analysis on the dot pattern to obtain trajectory information including the coordinate information and the code information. It is preferable.
- the handwriting input / output system makes it easy to visually recognize the position of the imaging means on the writing area surface.
- the imaging means further includes at least one pen tip, and when the character and / or figure drawn with the pen tip is traced on the writing area surface, the dot pattern on the locus in the vicinity of the pen tip is picked up.
- the dot pattern analysis means stores the image data of the dot pattern imaged and transmitted by the imaging means, and performs code analysis of the dot pattern to obtain trajectory information including the coordinate information and the code information. It is preferable to obtain.
- the handwriting input / output system can leave a locus in the vicinity of the imaging means on the writing area surface.
- the pointing protrusion further includes at least one pen tip, a storage space for storing the pen tip in the pointing protrusion, and a button for controlling storage / removal of the pen tip.
- a protrusion is preferred.
- the handwriting input / output system can be selectively used depending on whether the locus near the imaging means drawn on the writing area surface is desired or not.
- the imaging means further includes an erasing means for erasing characters and / or figures drawn on the writing area surface on the instruction protrusion, and simultaneously erasing an area traced by the erasing means on the writing area surface.
- the dot pattern on the locus in the vicinity of the erasing means is imaged, and the processing instruction means transmits the processing instruction for erasing the locus information of the character and / or figure and the locus information to the information processing means. It is preferable to do.
- the handwriting input / output system can cope with not only writing information input on the writing area surface and the information processing means but also erasing the writing information.
- the trajectory recognizing unit corrects the coordinate information obtained by code analysis by the dot pattern analyzing unit so as to match or approximate the trajectory of a drawn character and / or figure by tracing the writing area surface. It is preferable to do.
- the handwriting input / output system matches the actual trajectory by correcting the trajectory information even when the trajectory information recognized by the trajectory recognition unit is different from the trajectory on the medium. Or it can be approximated to such an extent that there is no trouble in practical use.
- the locus recognizing means further includes a time measuring means, and the time measuring means measures the time when the imaging means touches the writing area surface and the time away from the writing area surface, and the imaging means is drawn by touching the writing area surface. It is preferable that the order of the trajectory and the touching time are recorded and transmitted to the information processing means.
- the handwriting input / output system grasps the time required for the handwriting input by the information processing means and compares it with the normal time, so that the character's personality, age, gender, etc. Various research is possible.
- the timing means records the time when the imaging means touches the writing area surface and the dot pattern analysis means obtains the locus information, and transmits the time to the information processing means.
- the handwriting input / output system can analyze the difficulty and difficulty of writing by grasping the moving speed of the pen, and can also estimate the psychological state and health state of the writer.
- the processing instruction means is based on the code information and / or the recognition information, and specifies specific information and / or operation instructions (program activation, command input, data input / output / search, search target It is preferable that the designation or the like can be input uniquely.
- the processing command means can give a unique instruction to the information processing means based on the code information and / or the recognition information. This is the most important function in the present invention, and it is possible to easily specify which writing area is always written or what operation instruction is given to which writing area.
- the trajectory recognition means further recognizes the trajectory information with high accuracy by referring to a character and / or graphic information pattern table classified in advance regarding the contents to be written in the writing area based on the code information.
- the handwriting input / output system refers to the character and / or graphic information pattern table previously classified based on the code information when recognizing the trajectory information. It can be recognized with accuracy.
- the trajectory recognizing means recognizes the trajectory information and, based on the change of the analyzed coordinate information, obtains semantic information of the character and / or the figure, or a phrase composed of one or more of the characters. , Referring to a predefined semantic information code table (dictionary) corresponding to the code information, and converting the semantic information code into the semantic information code, and the processing instruction means includes the semantic information code and the processing instruction based on the semantic information Are preferably transmitted to the information processing means.
- dictionary a predefined semantic information code table
- the handwriting input / output system recognizes the trajectory information with high accuracy by referring to the semantic information code table at the time of trajectory recognition, and further converts it into a semantic information code.
- a processing command can be transmitted as that meaning.
- the processing instruction means instructs the information processing means to execute a first operation for inputting a recognition result of the locus information by the locus recognition means as a document and / or a figure.
- the handwriting input / output system can write a document or draw a picture by handwriting input.
- the processing instruction means instructs the information processing means to execute a second operation for inputting a result of recognition of the trajectory information by the trajectory recognition means as a comment.
- the handwriting input / output system can input a comment document in addition to a document or a picture input by handwriting input.
- the processing command means uses the recognition result of the trajectory information by the trajectory recognition means as an edit symbol for editing a document and / or a figure and / or a comment, and based on the edit symbol, the document and / or figure, and / or Alternatively, it is preferable to instruct the information processing means to execute a third operation for editing a comment.
- the handwriting input / output system can edit documents and images (including those not using the handwriting input / output system) by handwriting input.
- the handwriting input / output system measures at least a tilt and a direction in which the imaging optical axis of the imaging means in contact with the medium surface is tilted with respect to a vertical line of the medium surface.
- an angle change recognizing means for analyzing the predetermined change, and the processing command means preferably transmits a predetermined processing command to the information processing means based on the result of the analysis.
- the handwriting input / output system can give an operation instruction by the grid tilt operation of the imaging means.
- the dot pattern arranged at a predetermined angle with respect to the direction of the writing area is formed in the writing area, and the angle measuring unit and the angle change recognizing unit are configured such that the imaging unit has the writing area. It is preferable to analyze a predetermined change in the tilted direction and / or the inclination with respect to the direction of the writing area based on the direction of the dot pattern read when contacting the surface.
- the handwriting input / output system can recognize the inclination and the change thereof with reference to the direction of the dot pattern in addition to the change of the angle.
- the angle change recognizing means recognizes that the processing instruction means is tilted in a first predetermined direction with respect to the upward direction of the imaging means or the writing area by the grid tilt operation.
- the information processing means is instructed to execute a first operation for inputting the recognition result of the trajectory information by the trajectory recognition means as a document and / or a figure.
- the handwriting input / output system according to the present invention can be switched to the first operation by the grid tilt operation.
- the angle change recognizing means recognizes that the processing instruction means is tilted in a second predetermined direction with respect to the upward direction of the imaging means or the writing area by the grid tilt operation.
- the information processing means is instructed to execute a second operation for inputting the recognition result of the trajectory information by the trajectory recognition means as a comment.
- the handwriting input / output system according to the present invention can be switched to the second operation by the grid tilt operation.
- the angle change recognizing means recognizes that the processing instruction means is tilted in a third predetermined direction with respect to the upward direction of the imaging means or the writing area by the grid tilt operation. Then, the recognition result of the trajectory information by the trajectory recognition means is used as an edit symbol for editing a document and / or comment, and execution of a third operation for editing the document and / or figure and / or comment based on the edit symbol Is preferably instructed to the information processing means.
- the handwriting input / output system according to the present invention can be switched to the third operation by the grid tilt operation.
- the angle change recognizing means recognizes that the processing instruction means is tilted in a fourth predetermined direction with respect to the upward direction of the imaging means or the writing area by the grid tilt operation.
- the information processing means is instructed to end the third operation.
- the handwriting input / output system terminates the third operation by the grid tilt operation, switches to the original first or second operation, and re-executes the third operation. Can do.
- the processing instruction means touches the medium surface only once within a predetermined time, and the dot pattern analysis means
- the imaging means touches the medium surface once, and further touches the medium surface within a predetermined time.
- the dot pattern analyzing means recognizes, it is preferable to instruct the information processing means to determine execution of the predetermined processing.
- the handwriting input / output system can instruct determination / rejection of processing only by touching the medium surface by the imaging means.
- the handwriting input / output system is configured such that the imaging optical axis of the imaging unit is substantially vertical with respect to the writing area surface, the direction of the dot pattern read when the writing area surface is touched, and the imaging A rotation angle reading means for reading a rotation angle formed by the angle of the means and an operation for rotating the imaging means on the basis of the rotation angle measured when the imaging means comes into contact with the medium surface, that is, a grid turn Rotation angle change recognizing means for analyzing a predetermined change in the rotation angle by rotating the imaging optical axis in a predetermined rotation direction by the operation, and the processing command means is a result of the analysis.
- a predetermined processing instruction is transmitted to the information processing means.
- the handwriting input / output system can give an instruction by a grid turn operation.
- the processing command unit stores the change result of the file content in the application being executed.
- the rotation angle change recognizing means recognizes that the imaging means has rotated in a second predetermined direction opposite to the first predetermined direction, the file contents in the application being executed It is preferable to instruct the information processing means to cancel the change.
- the handwriting input / output system can instruct the saving of the change result of the file content by the grid turn operation and the cancellation of the change.
- the processing command means recognizes that the imaging means is rotated in a first predetermined direction and further rotated in a second predetermined direction opposite to the first predetermined direction within a predetermined time and the rotation angle change is recognized.
- the information processing means is instructed to start the handwriting input application, the imaging means rotates in the second predetermined direction, and the first predetermined direction within a predetermined time.
- the rotation angle change recognizing means recognizes that the rotation has been rotated, the handwriting input application is preferably terminated.
- the handwriting input / output system can instruct activation / termination of a handwriting input / output application by a grid turn operation.
- the imaging means traces the writing area by the imaging means. Or by referring to a predefined voice recognition information table (dictionary) corresponding to the code information and recognizing the recorded voice and converting it into character information. It is preferable to further comprise voice recognition means for transmitting to
- the handwriting input / output system can perform voice input instead of handwriting input.
- the predetermined operation is performed by tracing or drawing a sign meaning voice input in the writing area by the imaging means.
- the handwriting input / output system can be easily switched to voice input over an extension of a series of operations during handwriting input, and a history of starting voice input is written to a writing area or a computer. Can be left on.
- the predetermined operation is performed by an action of bouncing the image pickup means against the writing area.
- the handwriting input / output system can be easily switched to voice input with a simpler operation, and uses voice input without leaving a history of starting voice input in the writing area. it can.
- the predetermined operation is performed by recording a predetermined word in the voice recording unit and recognizing the predetermined word by the voice recognition unit.
- the handwriting input / output system can perform a voice input start operation more intuitively without memorizing troublesome operations.
- voice guide instruction information is defined in advance in the code information in the medium, and the handwriting input / output system further includes voice output means for explaining the voice guide in a voice to the contents to be written in the writing area. It is preferable.
- the handwriting input sheet according to the present invention is characterized by comprising a medium having a writing area in which a dot pattern in which coordinate information and code information are repeatedly defined is formed in at least a part or a plurality of areas.
- the handwritten input sheet according to the present invention defines the coordinate information as well as the unique information or command in handwriting input by defining not only the coordinate information but also the code information in the dot pattern formed on the medium. Can be entered.
- the medium is formed by further superimposing text, graphics, and photographs related to the writing area.
- the handwriting input sheet according to the present invention allows the user to easily know the contents of the writing area in handwriting input.
- the medium defines specific information and / or operation instructions (program activation, command input, data input / output / search, designation of search target, etc.) for specifying a predetermined medium surface and / or the writing area surface. It is preferable that an icon indicating the code information is further superimposed on the dot pattern for repeatedly forming the code information.
- the handwritten input sheet allows the user to know the contents of unique information or commands input based on the code information in handwriting input.
- the icon is preferably formed together with the dot pattern on a stickable sticker, sticky note paper, or other medium surface.
- the handwriting input sheet according to the present invention can increase the flexibility of the layout of the medium, and the search and output of the information input by handwriting in the writing area can be performed according to the convenience and preference of the user. It can be executed freely.
- the handwriting input sheet further includes braille in and / or around the writing area.
- the handwritten input sheet according to the present invention contributes to maintaining the same input efficiency as that of a healthy person when a visually handicapped person performs handwriting input.
- the handwritten input sheet further includes a narrow convex guide along the outer periphery of the writing area so that the imaging means does not protrude when writing in the writing area.
- the handwriting input sheet according to the present invention is provided with a guide so that the writing area can be accurately traced or drawn by the imaging means, and the visually impaired person performs the handwriting input in the same manner as a normal person. This contributes to maintaining input efficiency.
- An information input system according to the present invention has an infrared reflection layer having a characteristic of reflecting infrared light from one side and transmitting visible light, and a characteristic of diffusing and reflecting infrared light provided on one side of the infrared reflection layer.
- a medium formed of a material having absorption characteristics an imaging means for imaging and transmitting the dot pattern
- the dot portion that is imaged with low brightness from the surroundings or the dot pattern of the grid sheet is imaged and transmitted by the imaging means
- the dot portion that is imaged with high brightness is determined by a predetermined determination method
- the image data of the dot pattern is stored in a storage element, and code analysis is performed. It comprises dot pattern analysis means for inputting the coordinate information and / or the code information.
- the information input system can avoid the eyeball phenomenon without providing a diffuse reflection layer on the grid sheet.
- captured images stored in a storage element configured by pixels of m rows and n columns start from the left end for each row (i), and pixels separated by a predetermined interval (k) in the right direction.
- the right pixel is determined as a dot when the brightness difference falls below a negative threshold.
- the dot pattern analysis means determines whether the dot pattern is provided on the medium surface or the dot pattern provided on the grid sheet by the predetermined determination method. Thus, it is preferable to analyze the code by the predetermined determination method.
- the predetermined determination method uses a determination method of a dot portion in which the brightness of a predetermined area of the captured image is measured, and if the brightness exceeds a predetermined threshold, the brightness is determined to be lower than the surrounding area. If it is below the threshold, it is preferable to use a method for determining a dot portion in which the lightness is higher than that of the periphery.
- the information input auxiliary sheet according to the present invention reflects infrared rays from one surface side and has an infrared reflecting layer having a property of transmitting visible light, and is provided on one surface side of the infrared reflecting layer, and diffusely reflects infrared rays.
- the information input auxiliary sheet according to the present invention can avoid the eyeball phenomenon without providing a diffuse reflection layer.
- the input auxiliary sheet according to the present invention reflects infrared rays incident on the respective surfaces, and has an infrared reflecting layer having a property of transmitting visible light, and provided on both surfaces of the infrared reflecting layer, and has a property of absorbing infrared rays.
- the coordinate information and / or the code information patterned on the dot patterns arranged in each of the dot pattern layers are the same or different from each other.
- the information input auxiliary sheet according to the present invention can avoid the eyeball phenomenon without providing a diffuse reflection layer.
- the writing area has an arbitrary shape.
- the medium is provided with a plurality of reference points so that the size and orientation of the block can be formed in the area of the block where the information dots are arranged, and the reference point And a plurality of virtual reference points defined by coordinate information or coordinate information and code information defined by the distance and direction from the virtual reference point.
- a dot pattern in which coordinate information or coordinate information and code information are repeatedly defined is formed in at least a part or a plurality of areas by a combination of predetermined information dot arrangement directions among combinations of information dot arrangement directions in
- the dot pattern analysis means includes a predetermined combination of information dot arrangement directions. This for processing handwriting input to determine that it is come off area is preferred.
- a predetermined information dot when performing handwriting input, a predetermined information dot can be obtained without operating a button provided separately in the handwriting input / output system or reading a dot pattern in which an operation instruction for handwriting input is defined by the imaging means.
- the combination of the arrangement directions is determined by simply analyzing the code with the dot pattern analysis means, and the writing area is determined. If it is the writing area, processing as handwritten input is performed. If it is not a writing area, information associated with code information and / or coordinate information is output and / or instruction processing is executed.
- the combination of the predetermined information dot arrangement directions is such that the information dots are vertically and horizontally on the virtual reference point and obliquely from the virtual reference point.
- a combination of arrangement directions of predetermined information dots is preferable.
- the dot pattern analysis means can accurately recognize the combination of the predetermined arrangement directions of the information dots and is the writing area? If it is a writing area, processing as handwritten input is performed. If it is not a writing area, information associated with code information and / or coordinate information is output and / or instruction processing is executed.
- a writing flag indicating a writing area is defined in the code information, and the dot pattern analysis unit determines that the writing area is based on the writing flag and processes handwriting input.
- the dot pattern analysis unit when the imaging unit reads the dot pattern formed on the medium surface, the dot pattern analysis unit immediately determines whether or not the region is the writing region based on the writing flag. If there is, processing as handwritten input is performed. If it is not a writing area, information associated with code information and / or coordinate information is output and / or instruction processing is executed.
- the dot pattern analysis unit determines that the specific information and / or the operation instruction is included. It is preferable to process handwritten input / output.
- the imaging unit when the imaging unit reads the dot pattern formed on the medium surface, it is possible to instantaneously specify which writing area is written.
- the recognition rate is remarkably improved by collation with the dictionary of the category.
- the trajectory information includes coordinate information of the imaging center of the imaging unit, or coordinate information of the position where the pointing protrusion or the pen tip provided near the imaging unit touches the writing area surface and the code information. It is preferable that the dot pattern analysis means obtains an interpolation calculation based on coordinate information defined in the dot pattern.
- the coordinate information defined in the dot pattern is necessary for accurately reproducing the trajectory information because the increment for each block in which one set of XY coordinate values is defined is one unit.
- a predetermined accuracy of less than one unit can be obtained by interpolation calculation based on the coordinate information. For example, if the size of one block is 2 mm, in order to accurately reproduce characters, the XY coordinate value is obtained with an accuracy of about 0.1 to 0.2 mm, which is 1/10 to 1/20, and the trajectory information Should be recognized.
- the present invention provides a handwriting input / output system that has various features described above and can give a user various and new added value and convenience that are completely different from those of the prior art. Can do.
- FIG. (1) explaining the dot pattern used for the handwriting input / output system concerning this invention.
- FIG. (2) explaining the dot pattern used for the handwriting input / output system concerning this invention.
- FIG. (3) explaining the dot pattern used for the handwriting input / output system concerning this invention.
- FIG. (4) explaining the dot pattern used for the handwriting input / output system concerning this invention.
- FIG. (5) explaining the dot pattern used for the handwriting input / output system concerning this invention.
- FIG. (6) explaining the dot pattern used for the handwriting input / output system concerning this invention.
- FIG. 14 It is a figure (14) explaining the function of the medium in which the writing area used for the handwriting input / output system concerning this invention was formed. It is a figure (1) explaining the method to calculate the direction and angle of the inclination of an image pick-up part used for the handwriting input / output system concerning the present invention. It is FIG. (2) explaining the method to calculate the direction and angle of the inclination of an imaging part used for the handwriting input / output system concerning this invention. It is a figure (3) explaining the method to calculate the direction and angle of the inclination of an image pick-up part used for the handwriting input / output system concerning the present invention. It is FIG.
- FIG. (3) explaining the 2nd operation in the handwriting input / output system concerning this invention.
- FIG. (1) explaining the 3rd operation in the handwriting input / output system concerning this invention.
- FIG. (2) explaining the 3rd operation in the handwriting input / output system concerning this invention.
- FIG. (3) explaining the 3rd operation in the handwriting input / output system concerning this invention.
- FIG. (4) explaining the 3rd operation in the handwriting input / output system concerning this invention.
- FIG. (5) explaining the 3rd operation in the handwriting input / output system concerning this invention.
- FIG. (6) explaining the 3rd operation in the handwriting input / output system concerning this invention.
- FIG. (2) explaining the operation switching method by the inclination operation
- FIG. (3) explaining the grid sheet which is one Example of the medium used for the handwriting input / output system concerning this invention.
- FIG. (4) explaining the grid sheet which is one Example of the medium used for the handwriting input / output system concerning this invention.
- FIG. (5) explaining the grid sheet
- FIG. 1 is an external view showing an example of a usage state of a handwriting input / output system 1 according to the present invention.
- the document as written is displayed on the display 6. This is realized when the scanner 3 captures the dot pattern on the written locus and the computer 4 analyzes it (accesses the server 5 as necessary).
- the computer 4 may be built in the scanner 3.
- FIG. 2 is a block diagram showing the configuration of the first embodiment of the handwriting input / output system 1 according to the present invention.
- the handwriting input / output system 1 includes at least a medium 2 (handwriting input sheet), an imaging unit 7 (imaging unit), a dot pattern analysis unit 8 (dot pattern analysis unit), a locus recognition unit 9 (trajectory recognition unit), and a processing command unit. 10 (processing instruction means), various instructions are given to the information processing section 11, and the various servers 5 are accessed as necessary.
- FIG. 3 is a block diagram showing the configuration of the second embodiment of the handwriting input / output system 1 according to the present invention.
- the image pickup device 12, the irradiation unit 13, and the light control unit 14 are further provided.
- the imaging device 12 and the irradiation unit 13 are integrated with the imaging unit 7, and the light control unit 14 is integrated with the dot pattern analysis unit 8.
- FIG. 4 is a block diagram showing the configuration of the third embodiment of the handwriting input / output system 1 according to the present invention.
- a timer unit 15 is further provided.
- the time measuring unit 15 is integrated with the locus recognizing unit 9.
- FIG. 5 is a block diagram showing the configuration of the fourth embodiment of the handwriting input / output system 1 according to the present invention.
- an angle measurement unit 16 and an angle change recognition unit 17 are further provided.
- the angle measurement unit 16 and the angle change recognition unit 17 are integrated with the dot pattern analysis unit 8.
- FIG. 6 is a block diagram showing the configuration of the fifth embodiment of the handwriting input / output system 1 according to the present invention.
- the fifth embodiment further includes a rotation angle reading unit 18 and a rotation angle change recognition unit 19 in addition to the configuration provided in the first embodiment.
- the rotation angle reading unit 18 and the rotation angle change recognition unit 19 are integrated with the dot pattern analysis unit 8.
- FIG. 7 is a block diagram showing the configuration of the sixth embodiment of the handwriting input / output system 1 according to the present invention.
- a voice recording unit 20 in addition to the configuration provided in the first embodiment, a voice recording unit 20, a voice recognition unit 21, and a voice output unit 22 are further provided.
- GRID1> 8 to 15 are explanatory diagrams showing GRID 1 as an example of a dot pattern formed on the medium 2 in the handwriting input / output system 1 according to the present invention.
- the key dots 102, information dots 103, reference grid point dots 104, and the like constituting the dot pattern 101 are invisible ink or carbon ink that absorbs infrared light when the scanner 3 as imaging means has infrared irradiation means. It is desirable to be printed with.
- FIG. 8 is an enlarged view showing an example of the information dot of the dot pattern 101 and the bit display of the data defined therein.
- FIGS. 9A and 9B are explanatory diagrams showing the information dots 103 arranged around the key dots 102.
- FIG. 9A and 9B are explanatory diagrams showing the information dots 103 arranged around the key dots 102.
- the information input / output method using a dot pattern includes generation of a dot pattern 101, recognition of the dot pattern 101, and means for outputting information and a program from the dot pattern 101. That is, the dot pattern 101 is captured as image data by the imaging unit 7 built in the scanner 3, first the reference grid dot 104 is extracted, and then no dot is originally placed at the position where the reference grid dot 104 is located. The key dot 102 is extracted by the above, and then the information dot 103 is extracted and digitized to extract the information area to digitize the information. From the numerical information, information and a program are output from the dot pattern 101. . For example, information such as voice or a program is output from the dot pattern 101 to an information output device, a personal computer, a PDA, a mobile phone, or the like.
- fine dots that is, key dots 102, information dots 103, and reference grid point dots 104 are arranged according to a predetermined rule in order to recognize numerical information by a dot code generation algorithm.
- a 5 ⁇ 5 reference grid point dot 104 is arranged based on the key dot 102, and the center of the dot pattern 101 is surrounded by the four reference grid point dots 104.
- Information dots 103 are arranged around the virtual grid point 5.
- Arbitrary numerical information is defined in this block.
- FIG. 8 shows a state in which four blocks (inside the bold line frame) of the dot pattern 101 are arranged in parallel. Needless to say, the dot pattern 101 is not limited to four blocks and may be repeatedly arranged in the vertical and horizontal directions.
- the image data obtained by capturing the dot pattern 101 by the imaging unit 7 corrects the distortion caused by the imaging unit 7, so a lens with a high distortion rate is attached. Even when the image data of the dot pattern 101 is captured by a popular camera, it can be accurately recognized. Further, even when the image pickup unit 7 is tilted and read with respect to the surface of the dot pattern 101, the dot pattern 101 can be accurately recognized.
- the key dot 102 is a dot in which four reference lattice point dots 104 at the corners of the four corners of the block are shifted in a certain direction.
- This key dot 102 is a representative point of the dot pattern 101 for one block representing the information dot 103.
- the reference grid dot 104 at the corners of the four corners of the block of the dot pattern 101 is 20% of the interval between the reference grid dot 104 adjacent to the upper side (0 when the interval between the reference grid dots is 0.5 mm). .1 mm).
- this numerical value is not limited to this, and can be changed according to the size of the block of the dot pattern 101.
- the information dot 103 is a dot for recognizing various information.
- This information dot 103 is arranged around the key dot 102 as a representative point, and the center surrounded by the four reference grid point dots 104 is set as the virtual grid point 5 and expressed as a vector using this as the starting point. Arranged at the end point.
- FIG. 9B is a method of defining the information dot 103 having 2 bits for each grid in the dot pattern of FIG. 3, and each 2-bit information is shifted by shifting the dots in the + direction and the x direction. Defined. As a result, 201-bit information can be originally defined, but data can be given every 32 bits by being divided according to use. A maximum of 2 16 (about 65000) dot pattern formats can be realized by combining the + direction and the X direction.
- the present invention is not limited to this, and it is possible to represent 4 bits by arranging in 16 directions, and of course, various changes can be made.
- the dot diameter of the key dot 102, the information dot 103, or the reference grid point dot 104 depends on the appearance and the paper quality. Considering the printing accuracy, the resolution of the imaging unit 7 and the optimum digitization, 6 to 16% of the interval between adjacent reference grid point dots 104 (0.03 when the reference grid point dot interval is 0.5 mm) About 0.08 mm) is desirable.
- the interval between the reference grid point dots 104 is preferably about 0.3 to 0.5 mm vertically and horizontally.
- the shift of the key dot 102 is preferably about 20 to 25% of the grid interval.
- a dot pattern is imaged at a predetermined distance away from the medium surface with a non-contact scanner, which is an imaging means (not shown), or a built-in camera of a mobile phone
- the predetermined dot pattern is captured in the imaging area.
- the arrangement size of the dot pattern of one block and the diameter of the dot are appropriately determined.
- the interval between the information dot 103 and the virtual lattice point surrounded by the four reference lattice point dots 104 is preferably about 15 to 30% of the distance between the adjacent virtual lattice points 5. This is because if the distance between the information dot 103 and the virtual grid point 5 is shorter than this distance, the dots are easily recognized as a large lump, and it becomes difficult to see the dot pattern 101. On the contrary, if the distance between the information dot 103 and the virtual grid point 5 is longer than this distance, it is difficult to identify which of the adjacent virtual grid points 5 is the information dot 103 having the vector directionality. Because it becomes.
- one dot pattern is a dot pattern composed of 4 ⁇ 4 block areas, and 2-bit information dots 103 are arranged in each block.
- An example of the dot code format of the information dot 103 is shown in FIG.
- a parity check, a code value, an X coordinate, and a Y coordinate are recorded in one dot pattern. Details of the format will be described later.
- FIG. 11 shows an example of the bit display of the information dot 103 and the data defined therein, and shows another form.
- 4 bits can be expressed by using two types of information dots 103, long and short, from the virtual lattice point 5 surrounded by the reference lattice point dots 104 and eight vector directions. At this time, it is desirable that the longer one is about 25 to 30% of the distance between adjacent virtual lattice points 5, and the shorter one is about 15 to 20%. However, it is desirable that the center interval between the long and short information dots 103 is longer than the diameter of these dots.
- the information dot 103 surrounded by the four reference grid point dots 104 is preferably one dot in consideration of appearance. However, if it is desired to ignore the appearance and increase the amount of information, one bit is assigned to each vector, and the information dot 103 is expressed by a plurality of dots, so that a large amount of information can be provided.
- the vector of concentric eight directions, an information dot 103 surrounded by four points lattice dots 4 can represent information of 2 8, and 16 pieces of information dots of one block 2 128.
- FIG. 12 is an example of information dot and bit display of data defined therein, (a) shows two dots, (b) shows four dots, and (c) shows five dots arranged. It is shown.
- FIG. 13 shows a modification of the dot pattern 101, where (a) is a six information dot placement type, (b) is a nine information dot placement type, (c) is a 12 information dot placement type, (d ) Is a schematic diagram of an arrangement type of 1036 information dots.
- the information dots 103 are not limited to being arranged in 16 blocks, but can be variously changed.
- the information dots 103 are not limited to being arranged in 16 blocks, but can be variously changed.
- six information dots 103 (2 ⁇ 3) are arranged in one block (a) and nine information dots 103 are arranged in one block according to the required amount of information or the resolution of the imaging unit 7 ( 3 ⁇ 3) arranged (b), 12 information dots 103 arranged in one block (3 ⁇ 4) (c), or 36 arranged information dots 103 in one block (d) .
- This dot pattern defines the direction of the dot pattern depending on the shape of the block.
- reference points 201a to 201e are first arranged.
- a shape indicating the direction of the block (here, a pentagon facing upward) is defined by a line connecting the reference points 201a to 201e.
- virtual reference points 201f, 201g, and 201h are arranged, and information dots 203 are arranged at vector end points having directions and lengths starting from this virtual reference point.
- the direction of the block can be defined by the way the reference points are arranged.
- the size of the entire block is also defined by the direction dot that defines the direction of the block. Of course, this block may be repeatedly arranged in the vertical and horizontal directions.
- the reference points 201a to 201e and the information dots 203 are all described as having the same shape. However, the reference points 201a to 201e may be larger than the information dots 203.
- the reference points 201a to 201e and the information dots 203 may have any shape as long as they can be identified, and may be a triangle, a quadrilateral or more polygons.
- FIG. 14B defines information depending on whether or not there is an information dot on the virtual lattice point of the block.
- FIG.14 (c) connects the block shown in Fig.14 (a) 2 each in the vertical / horizontal direction.
- the dot pattern formed on the medium 2 is not limited to GRID1, but may be anything that defines XY coordinate information and code information.
- Japanese Patent No. 3766678 GRID2
- Japanese Patent No. 3858051 GRID3
- Japanese Patent No. 3858052 GRID4
- Japanese Patent Application No. 2009-165163 stream dot pattern
- FIG. 15 is a diagram for explaining the format of the dot pattern formed on the medium 2 in the handwriting input / output system 1 according to the present invention.
- the dot pattern is a dot pattern composed of 4 ⁇ 4 block areas, and is partitioned into C 1-0 to C 31-30 within this block.
- the dot code format of each area is shown in (a) and (b).
- (A) is a format in which page code, X coordinate, and Y coordinate are registered.
- the page code means the number of pages of the medium 2 when the medium 2 is in a booklet shape, and the X coordinate and the Y coordinate mean positions (coordinate values) on the medium, respectively. Is.
- the number of pages of the medium and the coordinate position of the read portion are simultaneously recognized by one reading operation.
- the action code means an operation instruction. For example, it is defined only in the area where icons indicating operations such as “enlarge” and “reduce” provided on the page are drawn, and is mainly included in the dot pattern used for the icon area described later. ing.
- the command processing may be associated with the action code and executed.
- the command processing refers to processing for recognizing characters during handwriting input or after handwriting input, or transmitting to another information processing apparatus.
- a plurality of specific write area codes in parentheses may be provided in one medium surface, and these write areas must be defined by unique codes. This makes it possible to determine where the data is written instantaneously. Of course, it may be defined together with the page code so that it can be determined which specific write area of which page. Furthermore, when the content input by handwriting belongs to a predetermined category, the recognition rate is remarkably improved by collation with the dictionary of the category. Needless to say, the contents input by handwriting may be not only characters but also symbols and illustrations. Of course, the action code may be defined together with the specific write area code and the instruction process may be executed.
- this write area flag may be accompanied by the page code (specific write area code) and action code shown in FIGS.
- the dot pattern of the present invention can register various code information such as page code and action code and XY coordinates in one format.
- various code information such as page code and action code and XY coordinates in one format.
- ⁇ Imaging unit> 16 to 28 are diagrams for explaining the imaging unit 7 used in the handwriting input / output system 1 according to the present invention.
- the imaging unit 7 preferably has a size and shape suitable for being held by a person, and most preferably has a pen shape as shown in FIG.
- FIG. (A) of the figure shows the most basic embodiment of the imaging unit 7 having a pen shape.
- an instruction projection 23 and a transmission unit 24 are provided, and a C-MOS sensor or the like (not shown) is generally built on the axis of the pen.
- the transmission unit 24 is for the imaging unit 7 to transmit a signal to another member using a method such as infrared communication or wireless communication, and is illustrated for convenience of explanation. It is not necessary to provide it at the position.
- FIG. 5B is a diagram showing another embodiment of the imaging unit 7 having a pen shape.
- two buttons for accepting an operation by the user are provided. These two buttons are a send button 25 and a re-send button 26, and the user can instruct the user to send a signal from the imaging unit 7 to another member.
- the retransmission button 26 is used to transmit the same signal again when the transmission of the signal by the transmission button 25 cannot be transmitted to the receiving member due to the presence of a shielding object or the like.
- FIG. (C) is a diagram showing another embodiment of the imaging unit 7 having a pen shape.
- a microphone 27 for receiving voice input by the user and a voice playback button 28 are further provided.
- the microphone 27 is used for recording voice used for voice recognition described later, and the voice playback button 28 is used for playing back a voice guide described later.
- FIG. 4D is a diagram showing another embodiment of the imaging unit 7 having a pen shape.
- the pen 29 is stored in the internal space of the instruction projection 23, and the pen 29 comes out when the pen storage button 30 is pressed.
- FIG. 17 (a) is a cross-sectional view showing a tip portion of a pen-type scanner 31, which is one embodiment of the image pickup unit 7 constituting the handwriting input / output system 1 according to the present invention.
- the pen type scanner 31 has a hollow portion formed therein, a light guide 32 having an opening at the tip thereof, a lens 33 disposed at a position facing the opening of the light guide 32, and the lens 33.
- An LED 34 serving as a light source for irradiating light of a predetermined wavelength onto a medium surface on which a dot pattern is formed, and a C-MOS sensor 35 (imaging) disposed at a position retracted from the lens 33
- the device 12 is provided with a PCB 36 and a CPU (not shown) installed in the PCB 36 at a further retracted position.
- the hollow portion of the light guide 32 is formed in a tapered shape that gradually increases in diameter from the lens 33 toward the opening.
- the CPU has one or all of the roles of the dot pattern analysis unit 8, the locus recognition unit 9, the processing command unit 10, and the information processing unit 11 described above.
- the light guide 32 is made of transparent or milky white resin, and the inside functions as a light guide. Irradiation light from the LED 34 travels inside the light guide 32 and is irradiated to the medium 2 from the opening.
- the light guide 32 is made of milky white resin, the irradiation light from the LED 34 is appropriately diffused when traveling through the light guide 32, so that the light irradiating the medium 2 from the opening is made more uniform. I can do it.
- FIG. 4B is a diagram showing the light emission timing of the LED 34 for each hour.
- the LED 34 instantaneously emits light with a predetermined intensity at a predetermined timing to expose the medium 2.
- the C-MOS sensor 35 captures the reflected light from the medium 2 and transmits it to the dot pattern analysis unit 8 as image data.
- FIG. 3C shows the reaction state of the elements of the C-MOS sensor 35 over time.
- An afterimage of the medium 2 is burned onto the element of the C-MOS sensor 35 when the LED 34 emits light with a predetermined intensity and the medium 2 is exposed.
- Such an imaging method is particularly effective when a C-MOS sensor is used, but there is no problem even if a CCD camera is used instead of the above imaging method.
- FIG. 5A shows the first timing of the light emission timing of the LED 34 by the light control unit 14, the timing at which the dot pattern is imaged by the imaging element 12 and transmitted to the storage element, and the analysis timing of the image data by the dot pattern analysis unit 8. It is a time series explaining a pattern.
- the first pattern light emission f t n , imaging r t n , and analysis a t n are sequentially performed.
- the analysis a t n ends, the next light emission f t n + 1 is obtained until a predetermined time t s elapses. Is not done.
- the predetermined time t s in which the image pickup element 12 is out of the expected value of the time required for imaging, transmitting, analyzing a dot pattern and defines the maximum value as the predicted imaging, transmission and analysis time.
- FIG. 6B illustrates the second pattern of the light emission timing of the LED 34 by the light control unit 14, the dot pattern imaging / transmission timing by the image sensor 12, and the image data analysis timing by the dot pattern analysis unit 8. It is a series.
- the light control unit 14 detects the end of the analysis, and immediately performs the next light emission f t n + 1 to capture the next dot pattern r t n +. 1. Analysis a t n + 1 is performed.
- FIG. 4C illustrates the third pattern of the light emission timing of the LED 34 by the light control unit 14, the dot pattern imaging / transmission timing by the imaging device 12, and the image data analysis timing by the dot pattern analysis unit 8. It is a series.
- a dot pattern imaging r t n for the next analysis is performed simultaneously with analysis a t n ⁇ 1 , analysis a t immediately emission when n-1 is completed f t n + 1 is performed, followed by already analyzed a t n of the image data captured by the image capturing r t n is performed.
- the analysis a t n may be started simultaneously with the light emission f t n + 1, but since the light emission time of the LED 34 is extremely short, the dot pattern analysis unit 8 analyzes the image data after the LED 34 emits light. There is almost no change in the total time to finish.
- the pen-type scanner 31 is equipped with a pen 37 as a writing instrument.
- the outer periphery of the pen-type scanner 31 is formed to be tiltable up to 45 degrees because it is used in an inclined state.
- the handwriting can be analyzed more accurately by offset correction described later.
- the pen 37 as a writing instrument can be stored by various methods so as not to leave a handwriting on the medium.
- a technique used in a general pen such as a ballpoint pen can be used as it is.
- a knock type or rotary type storage method may be employed, or a cap may be put on.
- the pen can be changed like a general three-color ballpoint pen.
- the pens of different colors may be replaced, but an eraser or a correction liquid may be used instead of the pen.
- an instruction projection 23 (stylus pen) may be provided to image the vicinity of the handwriting of the instruction projection 23.
- a storage space may be provided in the instruction projection 23 and the pen 37 may be stored to be used as an instruction projection.
- the XY coordinate value defined by the dot pattern captured by the imaging unit 7 and the XY coordinate value defined by the dot pattern on the locus actually written by the pen 37 are Different. Furthermore, the XY coordinate value defined by the dot pattern on the locus needs to be converted into the xy coordinate value in the writing area on the medium surface to perform writing input and operation instruction.
- FIG. 19 shows an example of the write area.
- the writing area coordinate system is (0,0) in the lower left corner.
- the xy coordinate value of the writing area is expressed in mm.
- a coordinate position of (16, 40) indicates a position moved 16 mm to the right and 40 mm upward from the lower left corner of the writing area.
- a dot pattern block in which one set of XY coordinate values of the dot pattern coordinate system is defined is continuously formed.
- the XY coordinate value indicates the position of the center point of the block.
- it is expressed as [X, Y].
- the XY in the dot pattern coordinate system As shown in FIG. 20, a dot pattern is formed so that the lower left corner is [ ⁇ 0.5, ⁇ 0.5] in any writing area as shown in FIG.
- a unique code value is defined for the dot pattern formed in each writing area, and each writing area is specified. If there is no need to specify each other, the same code value may be defined.
- a dot pattern in which XY coordinate values are defined is formed on the entire surface of the paper, and a unique code value is defined in the writing area in addition to the XY coordinate values.
- the XY coordinate value of the lower left corner of the writing area is [Xn0, Yn0] (n is a number specifying the writing area).
- the XY coordinate values are converted to the writing area coordinate system as follows.
- the coordinates [X, Y] in the dot pattern coordinate system are the writing area coordinate system. Then (X ⁇ L + L / 2, Y ⁇ L + L / 2). As shown in FIG. 21, if the lower left corner of the writing area is the origin (0,0) of the coordinate system, and the center point of the block of the dot pattern defining [0,0] matches the origin, (X ⁇ L, Y ⁇ L).
- the coordinates [X, Y] in the dot pattern coordinate system are ((X ⁇ Xn0) ⁇ L, (Y ⁇ Yn0) ⁇ L).
- ⁇ Calculation of XY coordinate values [Xc, Yc] in the dot pattern coordinate system of the imaging center C> A method of calculating the XY coordinate values [Xc, Yc] of the imaging center C will be described with reference to FIG.
- the number u of pixels forming the interval between the block center P [Xp, Yp] closest to the imaging center C and the imaging center C is obtained.
- the direction of the CQ vector starting from the imaging center C and ending at the pen tip is the direction of the pen scanner 31.
- the angle between the direction of the dot pattern and the direction of the pen-type scanner 31 is ⁇ (left rotation is the positive direction).
- the pen body may be provided with an inclination measuring means such as an inclination sensor.
- a table that associates ⁇ BL with ⁇ may be created in advance and ⁇ may be calculated.
- FIGS. 29 to 42 are diagrams for explaining the medium 2 used in the handwriting input / output system 1 according to the present invention.
- FIG. 29 is a diagram showing the medium 2 in which a dot pattern is printed (formed) on the entire surface to be a writing area.
- This dot pattern defines XY coordinate values and page codes.
- the page code means a code for specifying a medium using code information.
- FIG. 30 is a diagram showing the medium 2 on which another dot pattern further defining an action code is printed in an area where a dot pattern defining a page code and an XY coordinate value is printed.
- the action code means a code for instructing the information processing unit 11 to perform a predetermined operation (especially an application operation) in response to a handwritten input to a specified medium using code information.
- This media consists of multiple sheets, and a different page code is assigned to each sheet.
- the page code is “01” for the first page, “02” for the second page, and “03” for the third page.
- an action code in an area printed with a text icon “start” superimposed thereon instructs the information processing unit 11 to start an application for handwriting input / output.
- the action code of the area printed with the text icon “Cancel” superimposed on it instructs the information processing unit 11 to discard (cancel) the input result by the handwriting input / output application, or the information processing unit 11
- the information processing unit 11 is instructed to stop the execution of the process.
- the action code in the area printed with the text icon “save” superimposed instructs the information processing unit to save the input result by the handwriting input / output application.
- the action code in the area printed with the text icon “End” superimposed thereon instructs the information processing unit 11 to end the handwriting input / output application.
- FIG. 31 is a diagram showing the medium 2 in which a region where a dot pattern defining XY coordinate values and page codes is printed and a region where a dot pattern defining action codes and page codes are printed are separated.
- various commands can be executed only for the page specified by the page code without selecting which page of the medium is the target. Thereby, security can be improved and an erroneous operation can be reduced.
- FIG. 32 is a diagram illustrating a first medium on which a dot pattern in which XY coordinate values and page codes are defined is printed, and a second medium that is a paper controller on which a dot pattern in which only action codes are defined is printed.
- various commands for handwritten input can be executed on any page of the medium.
- the writing area and the icon are provided separately, as shown in FIG. 32, in addition to a paper controller, the writing area and the icon may be attached to another medium as a sticker, a sticky note, or a card.
- the action code in the area printed with the text icon “text input” superimposed thereon instructs the information processing unit 11 to input characters or figures as the text in the operation by the handwriting input / output application.
- the action code of the area printed with the text icon “comment input” superimposed is used to instruct the information processing unit 11 to input a character or a figure to be a comment in the operation by the handwriting input / output application.
- the action code of the area printed with the text icon “edit” superimposed thereon instructs the information processing unit 11 to edit characters or figures in the operation by the handwriting input / output application (that is, handwriting input / output).
- the action code of the area printed with the text icon “determine” superimposed is used to execute the process on the information processing unit 11 when the information processing unit 11 determines whether to execute the predetermined process. Command to decide.
- FIG. 33 shows a first medium on which a dot pattern defining XY coordinate values and page code A is printed, and a second medium which is a paper controller on which a dot pattern defining action code and page code A is printed. It is a figure which shows what became one booklet.
- a dot pattern in which the same XY coordinates of each page are registered may be printed in the writing area.
- the writing area can be specified by using the icon of the controller area in which the action code and page code are registered. That is, it can be said that the position and page of the writing area can be changed without changing the XY coordinate values.
- various commands can be executed only for the page specified by the page code without selecting which page of the medium is the target. Thereby, security can be improved and an erroneous operation can be reduced.
- a dot pattern defining an action code for instructing the information processing unit to start an application for handwriting input / output may be printed over the entire writing area. In this case, when writing is performed on the medium surface, the handwriting input / output application is automatically activated.
- the number of write areas on the medium is not limited to one, and a plurality of write areas can be defined. (Regarding the case where multiple writing areas are provided)
- the code value can include not only the writing area but also the classification number that classifies the page number by defining multiple information.
- the page number When the page number is included, it is possible to determine which writing area of which page, and there are selection items such as information, processing instructions, and alternatives in the writing area, and when processing as a common code, the defined page number In addition, information specifying a selection item can be combined and defined as a code value.
- different code values can be defined by dividing the area in the writing area.
- the code values are n1, n2, n3, and n4. Thereby, a plurality of selection items can be set in one writing area.
- This first example has the advantage that it is easy to handle because the lower left corner of each area is always 0 (origin).
- a dot pattern in which an XY coordinate value is defined by one dot pattern coordinate system is formed on the entire surface of a predetermined area, and a code value is also defined in the writing area dot pattern along with the XY coordinate. This is the case.
- a dot pattern in which XY coordinate values are defined in one dot pattern coordinate system with the lower left corner of the predetermined area as the origin is formed on the entire surface of the predetermined area.
- the two write areas in this predetermined area are defined with XY coordinate values whose lower left corners are [Xm0, Ym0] and [Xn0, Yn0], and code values m and n for specifying the write area, respectively. ing.
- code values can be defined by dividing the area within the write area.
- the third example is a case where a write area is further inserted into the write area.
- a dot pattern defining an XY coordinate value in one dot pattern coordinate system with the origin at the lower left corner of a predetermined area and a code value L for specifying a writing area is formed on the entire predetermined area.
- Two write areas in the predetermined write area are defined by XY coordinate values whose lower left corners are [Xm0, Ym0] and [Xn0, Yn0] and code values m and n for specifying the write area, respectively. Has been.
- the writing area can be formed in the writing area in one coordinate system, the writing mode in the writing area can be ignored and the writing operation can be performed by changing the input mode. It becomes possible. For example, when writing to a writing area in the writing area, a setting that is effective only when the input mode is switched or a specific symbol is drawn may be provided.
- the code value can also be defined by dividing the area within the write area.
- one dot pattern coordinate system is defined over the entire predetermined area, and the XY coordinate value in this coordinate system and a code value for specifying the write area are defined in the write area. This is a case where a pattern is formed.
- one coordinate system with the lower left corner as the origin is defined in a predetermined area, and the lower left corner is [Xm0, Ym0] and [Xn0, Yn0] in the two writing areas in this area, respectively.
- a dot pattern in which a certain XY coordinate value and code values m and n for specifying a writing area are defined is formed.
- no dot pattern is formed in a range other than the writing area.
- the area of the writing area is automatically laid out by arranging the mask according to the coordinate system of the block of printed material. It is possible to create a dot pattern block by performing a mask process, and a dot pattern can be easily issued.
- the XY coordinate value is read to find where the writing area is laid out within the predetermined area. It becomes possible to use for.
- the dot pattern coordinate system is used for all description, but it is natural that the writing area coordinate system converted from the dot pattern coordinate system is the same.
- FIG. 39 is a diagram showing a document as a specific example in which a plurality of write areas are defined on a medium.
- (A) of the figure shows a document in which a specific code for instructing the origin of the XY coordinate values and the writing area is defined in each writing area.
- the “name” writing area has the “phonetic” writing area, the “address” writing area the “zip code” writing area, and the “neighboring map” writing area.
- Write areas for “walking (time)”, “train (use time)”, and “bus (use time)” are defined.
- the “sex” writing area is divided into “male” and “female” writing areas, and the “birth date” writing area is divided into “year”, “month”, and “day” writing areas. .
- Such a layout of the writing area is possible by assigning different specific codes to each.
- (B) of the drawing shows that in such a document, the origin of the XY coordinate values is not defined in each writing area, and only a specific code for instructing specification of the writing area is defined.
- the position of the write information on the entire medium surface can be specified.
- FIG. 40 is a diagram showing a state in which handwriting input is actually performed on the document of FIG.
- FIG. 39 is a diagram showing the document of FIG. 39 (a) in which handwriting input is actually performed.
- (B) in the figure is a diagram showing a state in which the result of processing performed by the information processing unit 11 is displayed on the display 6 or output by printing in response to the handwritten input in (a) in the figure.
- the handwriting input / output system 1 performs output as shown in FIG. 5B by recognizing handwritten input characters and figures by several methods.
- handwriting input can be performed, the information processing unit 11 can reflect the handwriting input, and handwriting input can be performed again.
- FIG. 41 (a) is a diagram showing the medium 2 printed by superimposing the locus information recognized by the locus recognition unit 9 and the dot pattern. Although not shown, a dot pattern different from the dot pattern printed on the medium 2 on which handwriting input is first performed may be newly printed on the medium 2 shown in FIG.
- FIG. 41B is a diagram showing the medium 2 on which the result of the processing performed by the information processing unit 11 is printed with a dot pattern superimposed.
- a dot pattern different from the dot pattern printed on the medium 2 on which handwriting input is first performed may be newly printed on the medium 2 shown in FIG.
- the XY coordinates are the same, and only the page code may be changed and printed.
- the medium 2 may further be provided with a bank guide 38 (a narrow convex portion) or a Braille 39.
- FIG. 42 shows a bank guide 38 provided on the outer periphery of the writing area, and a braille 39 protrusion along with a dot pattern in the writing area.
- the dot pattern analysis unit 8 obtains XY coordinate information and code information defined by the dot pattern by performing code analysis on the image data in accordance with the information input / output method using the dot pattern in GRID1 described above.
- the dot pattern analysis unit 8 sequentially performs code analysis on the trajectory written (traced) on the medium by the imaging unit 7, so that the XY coordinate information and the code information are the trajectory. (Trajectory information).
- the trajectory recognition unit 9 recognizes characters and graphics written on the medium based on changes in trajectory information.
- the trajectory recognition method is a method that considers characters and figures as graphics, and refers to the XY coordinate patterns of the characters and figures in the database, like a general OCR (optical character reader).
- the contents to be written in the writing area can be designated in advance by code information. That is, the trajectory information can be recognized with high accuracy by referring to the character and / or graphic information pattern table classified in advance. As a specific example, if it is instructed in advance to describe only Arabic numerals, the recognition rate increases because the trajectory recognition unit 9 refers only to the table of Arabic numerals. If recognition is not possible, all characters and figures in the database can be referenced as usual.
- the semantic information of a character and / or figure written in the writing area or a phrase composed of one or more characters is defined as predefined semantic information corresponding to the code information.
- the code table (dictionary)
- it can be converted into a semantic information code.
- the trajectory recognition unit 9 first performs pattern recognition one character at a time, “East”, “Kyo”, “Miyako”, “Kyo”, “Ku”.
- the semantic information code table (dictionary)
- the semantic information code defined as corresponding to “Tokyo” and the semantic information code defined as corresponding to “Bunkyo-ku” are converted.
- the information processing unit can recognize that the place names “Tokyo” and “Bunkyo-ku” have been input.
- the semantic information code table (dictionary) also assists character pattern recognition. For example, if the user has written the character “east” of “Tokyo” in a dirty manner, it is difficult for the trajectory recognition unit 9 to recognize whether the user has written “east” or “car”. If the idiom "Tokyo" is defined in the code table and the idiom "Kakkyo” is not defined (the idiom "Kakkyo" usually does not exist), the user wrote the word "east”
- the trajectory recognition unit 9 can recognize as follows.
- the handwriting input / output system 1 may further include a timer unit 15.
- the timer unit 15 has a function of detecting time information.
- the time information is (1) It is set as the order of the writing history drawn by the imaging unit 7 touching the writing area surface.
- the handwriting input / output system 1 may further include an angle measurement unit 16 and an angle change recognition unit 17.
- the angle measurement unit 16 and the angle change recognition unit 17 measure and recognize the inclination of the imaging unit 7 with respect to the medium surface.
- the above-described method for calculating the pen inclination ⁇ can be used as it is. In this case, it is possible to measure and recognize the tilt even if the imaging unit 7 does not include a pen. 43 to 47, the slope calculation method disclosed in the invention of the information output apparatus according to Japanese Patent Application No. 2005-267565 (PCT / SG2006 / 000267) can be used. However, other methods may be used.
- the recognition of the change in angle with respect to the medium surface of the imaging unit 7 that serves as a reference for measuring and recognizing the tilt is not only the angle when the imaging unit 7 is set up vertically with respect to the medium surface, The angle when touching the surface can be used as a reference.
- the handwriting input / output system 1 may further include a rotation angle reading unit 18 and a rotation angle change recognition unit 19.
- the rotation angle reading unit 18 and the rotation angle change recognizing unit 19 read and recognize the rotation angle when the imaging optical axis of the imaging unit 7 is set to be substantially vertical and rotated.
- the method for obtaining the angle between the direction of the dot pattern and the direction of the imaging unit 7 has already been described in the section of offset correction, but this method can be used for the method of reading and recognizing the rotation angle regardless of the presence or absence of a pen. it can. That is, since the direction of the dot pattern is always constant, the angle ⁇ 1 formed by the direction of the dot pattern and the direction of the image capturing unit 7 when the image capturing unit 7 is first vertically imaged with respect to the medium surface and a predetermined value is determined. The difference between the direction of the dot pattern after the elapse of time and the angle ⁇ 2 (the left rotation is the positive direction) formed by the direction of the imaging unit 7 can be read and recognized as the rotation angle.
- the dot pattern in the writing area can be captured at the moment when the imaging unit 7 touches the writing area.
- the imaging unit 7 is moved away from the writing area, the irradiation light from the LED 34 is not reflected on the medium surface, and the C-MOS sensor 35 does not detect the irradiation light from the LED 34 (reflection light from the medium surface).
- the dot pattern cannot be imaged.
- the dot pattern in the write area can be picked up at the moment when the image pickup unit 7 touches the write area.
- the operation up to this is the same as the operation of touching the writing area.
- the tip of the image pickup unit 7 is still directed to the writing area for a predetermined time, so that the irradiation light from the LED 34 is reflected on the medium surface.
- the sensor 35 temporarily captures the dot pattern on the medium surface.
- the dot pattern cannot be analyzed blurry as shown in FIG.
- the image pickup unit 7 touches the writing area to pick up a dot pattern, analyzes the image data picked up after a predetermined time (for example, 0.2 seconds) using the analyzed moment as a reference time,
- a predetermined time for example, 0.2 seconds
- the imaging unit 7 is preliminarily defined as a touch operation
- the processing command unit 10 is defined in advance to the information processing unit 11 as corresponding to the touch operation.
- Send processing instructions When the dot pattern is imaged (reflected light is detected) but the dot pattern is blurred and cannot be analyzed, the image capturing unit 7 is assumed to have bounced, and the processing command unit 10 Then, a processing command defined in advance as corresponding to the bouncing action is transmitted.
- FIG. 5E when a dot pattern can be analyzed, it is nothing but a normal handwriting input operation.
- the processing command unit 10 transmits a processing command based on the information recognized by the track recognition unit 9 to the information processing unit 11 together with the track information.
- the processing command unit 10 commands the information processing unit 11 to execute various operations in the handwriting input / output application, details of which will be described later.
- predetermined processing instructions based on the measurement / recognition result by the angle measurement unit 16 and the angle change recognition unit 17 and the read / recognition result by the rotation angle reading unit 18 and the rotation angle change recognition unit 19 are given to the information processing unit 11. Command against.
- the information processing unit 11 receives various processing instructions performed by the handwriting input / output system 1 according to the present invention and executes various processes.
- the handwriting input / output system 1 may access the server 5 in which various types of information are recorded as necessary.
- the server 5 can store information for locus recognition, for example.
- information for locus recognition for example.
- OCR optical character reader
- XY coordinate patterns are defined and stored in a plurality of characters and figures.
- meaning information code for outputting a phrase or figure consisting of one or a plurality of characters, or a combination thereof is defined and stored in the characters and figures by referring to the meaning information code table (dictionary). Has been.
- the writing area can be specified using not only the XY coordinate information but also the code information, it is easily managed even if the amount (number) of the writing area is enormous. can do. This is particularly effective when writing information is stored in a shared global server that anyone can use.
- the server 5 can store voice, document, image, video, application, and other various information in addition to the information for recognizing the trajectory.
- a handwriting input / output application can be stored. That is, when the information processing unit 11 does not have an application for handwriting input / output, it can search the server and execute the application for handwriting input / output on the server. However, the handwriting input / output application on the server may be executed with priority.
- server 5 can be implemented with various modifications other than the above embodiment.
- Such an application is a system in which writing on a medium surface is reflected on a computer by executing various operations.
- the writing on the medium surface may be performed while viewing the display 6 on which the processing result is displayed by instructing the information processing unit 11 in real time by the processing command unit 10, or writing without looking at the display 6. It is assumed that the processing instruction unit 10 may instruct the information processing unit 11 after writing.
- the writing operation is performed by writing the character or figure to be input into the writing area on the medium surface using the imaging unit 7.
- the imaging unit 7 captures a dot pattern printed in a superimposed manner at a predetermined time interval while the imaging unit 7 moves on the medium surface. The subsequent steps are as already described.
- FIG. 49 is an image diagram for explaining a first operation for inputting text characters by handwriting.
- the image pickup unit 7 When characters are written in the writing area using the image pickup unit 7 as shown in FIG. 6A, the image pickup unit 7 sequentially picks up dot patterns on the locus as shown in FIG.
- the unit 8 acquires trajectory information including XY coordinate information and code information.
- the interval between the imaging positions of the dot pattern on the locus is wide in FIG. 5B, but actually it is narrower.
- the information processing unit 11 executes the first operation and outputs the result to the display 6.
- the XY coordinate information obtained by the dot pattern analysis unit 8 may be input / output as it is without recognizing characters and figures.
- the handwriting input / output system 1 according to the present invention functions as a pen tablet.
- the second operation is an operation for inputting a comment character by handwriting.
- the comment part is surrounded by a broken line, but it is not necessary to actually write the broken line.
- the recognition method of characters or figures is the same as the first operation method.
- the character of the comment input in the second operation is recognized as a comment different from the text in the information processing unit 11 as well.
- the comment entered between the lines may be reflected as it is in the information processing unit 11 as shown in FIG. 51.
- Comments may be listed on the side of the text in the processing unit 11.
- the third operation is an operation for editing a handwritten character.
- Each editing is performed by writing, using the imaging unit 7, characters or figures that are defined in advance as editing symbols in the information processing unit 11.
- the recognition method of characters or figures is the same as the first operation method.
- FIG. 53 is a diagram for explaining editing symbols used in the editing operation which is the third operation of the present invention.
- a line forming one closed area means an edit symbol for selecting a character or figure in the area.
- the red dot means an edit symbol that specifies the cut target when cutting and pasting.
- Double line means delete (erase) edit symbol.
- “Toru” means an edit symbol for deletion (deletion).
- ⁇ Zigzag line more than 3 round trips means edit symbol for canceling edit.
- a bidirectional arrow means an edit symbol that replaces selected characters or figures.
- Letters (A), (B), (C). . . Means an edit symbol that copies (cuts) a selected character or figure with a flag and designates a paste destination at a distant position.
- FIG. 54 is a diagram showing the medium 2 before the third operation is executed.
- the medium 2 is filled with a document that has been input by hand by executing the first operation or a document that has been printed as a result of handwriting input.
- FIG. 55 is a diagram for explaining an editing state on the medium 2 in the third operation.
- the handwritten input / output application When writing a line that closes the area as shown in FIG. 5A, the handwritten input / output application recognizes the area closed by the line as one editing target.
- FIG. 56 is a diagram showing a sentence in which the result of each editing in the third operation performed on the medium 2 is reflected in the handwriting input / output application.
- FIG. 57 is a diagram for explaining an operation of canceling editing and returning to the state before editing after editing the third operation shown in FIG.
- FIG. 58 is a diagram showing a sentence in which the result of the undoing of editing in the third operation on the medium 2 is reflected in the handwriting input / output application.
- Each operation may be a parallel operation of the third operation with the first and second operations.
- the third operation may be a sub-operation subordinate to the first operation and the second operation.
- the handwriting input / output system 1 can be modified and implemented as necessary in addition to the first to third operations.
- the processing command unit 10 discards the input character and the result of the document structure by rotating the imaging unit 7 to the left by a predetermined rotation angle (eg, 10 degrees or more) while touching the medium surface.
- the information processing unit 11 is instructed to cancel (change the file contents).
- ⁇ Starting and exiting the application> As shown in FIG. 61, while the imaging unit 7 is touched on the medium surface, the imaging unit 7 is rotated to the right by a predetermined rotation angle (for example, 10 degrees or more), and the predetermined rotation angle (for example, within 1 second) is directly maintained. (Example: 10 degrees or more) By rotating counterclockwise, the processing command unit 10 instructs the information processing unit 11 to start a handwriting input / output application.
- a predetermined rotation angle for example, 10 degrees or more
- the predetermined rotation angle for example, within 1 second
- the imaging unit 7 is rotated to the left by a predetermined rotation angle (eg, 10 degrees or more), and is left as it is within a predetermined time (eg, within 1 second). (Example: 10 degrees or more)
- a predetermined rotation angle eg, 10 degrees or more
- a predetermined time eg, within 1 second.
- This method uses the angle measurement / angle change recognition method described above.
- the image pickup unit 7 stands on the medium surface, and a predetermined angle (for example, 15 degrees or more) is set on the left side of the medium surface with reference to the angle formed by the medium surface and the image pickup unit 7.
- a predetermined angle for example, 15 degrees or more
- the processing command unit 10 commands the information processing unit 11 to start the first operation for handwriting input of the text.
- the image pickup unit 7 is set up on the medium surface, and a predetermined angle (for example, 15 degrees or more) is set on the right side of the medium surface with reference to the angle formed by the medium surface and the image pickup unit 7.
- a predetermined angle for example, 15 degrees or more
- the processing command unit 10 commands the information processing unit 11 to start a second operation for inputting a comment by handwriting.
- the image pickup unit 7 is set up on the medium surface, and a predetermined angle (for example, 15 degrees or more) is set above the medium surface by using the angle formed by the medium surface and the image pickup unit 7 as a reference.
- a predetermined angle for example, 15 degrees or more
- the processing command unit 10 commands the information processing unit 11 to start a third operation for editing the text and comments.
- the image pickup unit 7 stands on the medium surface, and the lower side of the medium surface is a predetermined angle (for example, 15 degrees or more) with reference to the angle formed by the medium surface and the image pickup unit 7.
- the processing command unit 10 instructs the information processing unit 11 to end the operation currently being executed and start a preset normal operation (startup).
- FIG. 64 is a plan view seen from directly above, supplementing the explanation of the first method for switching operations.
- the operation switching may be performed by an input means such as a button provided in the imaging unit 7 body.
- the operation may be switched by an external input means such as a mouse or a keyboard.
- the operation may be switched in conjunction with the pen tip switching operation.
- the information processing unit 11 may erase characters or figures instead of writing.
- ⁇ Voice recognition> Although the present invention is a handwriting input / output system, speech recognition and voice guidance may be performed as a method for assisting handwriting input.
- the audio recording unit 20 is configured with a central processing unit (MPU) 40 as the center. That is, under the control of the central processing unit (MPU) 40, audio information input from the microphone 41 is processed by the A / D converter 43 and the compression circuit 44 via the amplifier 42, and is recorded as digital audio information.
- MPU central processing unit
- the voice recognition unit 21 converts the recorded voice information into corresponding text information, and the processing command unit 10 transmits a processing command based on the text information together with the text information to the information processing unit 11.
- the accuracy of voice recognition is improved by referring to the text information in the speech recognition information table corresponding to the classification code without referring to all the text information when searching the database and outputting the text information.
- ⁇ Trace specific symbols> As a first method of switching to the voice recording mode, there is a method of switching to the voice recording mode by writing (tracing or drawing) a specific symbol meaning switching to the voice recording mode.
- the trajectory recognition unit 9 recognizes a trajectory of a specific symbol meaning switching to the voice recording mode and transmits it to the voice recording unit 20 (or by transmitting it via the processing command unit 10), thereby recording the voice.
- the unit 20 starts audio recording.
- ⁇ Switching by voice recognition> there is a method of recording a predetermined voice in the voice recording unit 20 and switching to the voice recording mode when the voice recognition unit 21 recognizes the predetermined voice.
- the processing command unit 10 instructs the information processing unit 11 to perform voice input instead of handwriting input in the handwriting input / output application when operations by the various methods described above are performed.
- the audio output unit 22 reproduces a predetermined audio file in response to an instruction from the processing command unit 10.
- the audio file that has been digitized and stored in advance is output from the speaker 45 or the earphone 46 via the A / D converter 42 and the amplifier 42.
- voice guidance may be given to a user who performs handwriting input by using code information.
- handwriting input is started by defining a voice guide code for instructing the information processing unit 11 to play back a voice in the dot pattern printed in the writing area (the imaging unit 7 changes the dot pattern).
- the sound output unit 22 reproduces the sound file stored in association with the sound guide code in advance.
- the audio guide code and the corresponding audio file may be used for purposes other than the audio guide.
- ⁇ Grid sheet> 68 to 72 are explanatory diagrams showing examples in which the grid sheet, which is an information input auxiliary sheet, is mounted on a display and used in the handwriting input / output system 1 according to the present invention.
- This grid sheet has a dot pattern formed on a transparent sheet, and exhibits a function as a touch panel by being overlaid on a monitor surface.
- the medium can be attached to the monitor surface of the display 6 to form a touch panel.
- means other than the grid sheet may be adopted.
- the grid sheet may be used by being superimposed on the medium 2.
- a usage method is such that when a document or an image printed (described) on a medium that is not for handwriting input / output is first edited using the handwriting input / output system 1 according to the present invention, secondly, an imaging unit This is particularly effective when the user feels resistance to pressing 7 on the monitor surface.
- 68 to 69 are explanatory views showing an embodiment in which a grid sheet is mounted on the display 6 and used.
- FIG. 68 is a diagram in which a grid sheet is used in a general-purpose computer system that is an information processing apparatus.
- a grid sheet is pasted on a display screen such as a liquid crystal display (LCD) such as a personal computer or a CRT (CRT).
- the grid sheet is formed of a transparent film, and is printed with a dot pattern.
- this dot pattern is obtained by patterning XY coordinate values and / or code values with a predetermined algorithm.
- a scanner which is a dot pattern reading unit is connected to the computer main body. The user touches the grid sheet with the scanner in accordance with the instructions on the fluoroscopic screen. The scanner reads the dot pattern and transmits it to the personal computer via the USB cable.
- the central processing unit (CPU) of the personal computer analyzes the dot pattern to obtain the XY coordinate value on the grid sheet, and further, xy on the display. Conversion to coordinate values enables input in touch panel format from the coordinate value information.
- a personal computer is used as the information processing device.
- the information processing device is a personal computer, a PDA, a television receiver, a front and rear projector, a game device, a karaoke device, a portable device.
- a telephone terminal device, a POS terminal device, an ATM, a KIOSK terminal, a car navigation system, a pachinko machine, a watch, a smartphone, or the like may be used.
- a grid sheet is arranged on a display screen or a display screen as a touch panel type input device.
- FIG. 69 is a cross-sectional view showing the internal structure of the grid sheet described in FIG.
- (A) is a longitudinal sectional view showing a state where the grid sheet is touched by the scanner.
- the grid sheet has a structure in which an infrared reflection layer, a dot pattern layer, and a protective transparent sheet (protective layer) are laminated from the display device side.
- the infrared reflective layer has a configuration in which an infrared reflective material is vapor-deposited on a transparent sheet for vapor deposition made of a material that transmits visible light, such as vinyl, envipet, and polypropylene.
- the infrared reflection layer reflects the infrared ray irradiated from the infrared irradiation means of the scanner and transmitted through the protective transparent sheet to the scanner and transmits visible light. At the same time, infrared rays from the display device are blocked.
- the infrared light irradiated from the infrared irradiation means of the scanner can be used as the irradiation light, and only a bright and clear dot pattern can be photographed, and the dot code can be analyzed accurately.
- the dot pattern layer is printed with a dot pattern in which dots made of an infrared absorbing material such as carbon ink are arranged according to a predetermined rule as will be described later.
- Protective transparent sheet is made of a material that transmits visible light and infrared rays, such as vinyl, envipette, and polypropylene.
- a protective transparent sheet it is possible to prevent dot wear and dirt and to use the sheet for a long period of time.
- the scanner incorporates an IR-LED that is an infrared irradiation means, an IR filter that cuts a predetermined wavelength component of the reflected light, a C-MOS sensor that is an image sensor, and a lens.
- the scanner captures reflected light of the irradiation light irradiated on the grid sheet.
- the dot pattern is printed with ink having the characteristic of absorbing infrared rays, only the dot portion is captured black in the captured image by the C-MOS sensor.
- the reflection layer that is specularly reflected by the infrared reflection layer is photographed in a state where the reflected light is not incident on the lens and the center is black as shown in FIG. End up. Therefore, it is impossible to photograph the dot pattern without omission. Therefore, it is necessary to diffusely reflect infrared light and to enter the lens. That is, as shown in FIG. 70 (a), an infrared diffusion layer is provided between the dot pattern printing layer and the infrared reflection layer. This infrared diffusion layer is made of a transparent or translucent material. As a result, as shown in FIG. 5B, the infrared light irradiated from the IR-LED is specularly reflected by the infrared reflecting layer and diffused by the infrared diffusing layer, and the reflected light of all the imaging regions is incident on the lens.
- the grid sheet is provided with an infrared diffusing layer.
- the present invention is not limited to this, and a filter made of an infrared diffusing material may be provided at the photographing port of the scanner.
- FIG. 71 is a cross-sectional view showing various structures of the grid sheet.
- FIG. 1 is a grid sheet including an infrared reflection layer having a characteristic of reflecting infrared light and transmitting visible light, and a dot pattern layer.
- the infrared rays irradiated from the infrared irradiation means are first absorbed by the portion of the dot pattern layer where the dots are formed (hereinafter referred to as the dot portion) and transmitted through the other regions.
- the transmitted infrared ray is specularly reflected by the infrared reflection layer and passes through the dot pattern layer except for the dot portion.
- (B) of the figure is a grid sheet in which an infrared diffusion layer that transmits visible light and diffuses the infrared light is provided between the infrared reflection layer and the dot pattern layer.
- the infrared rays irradiated from the infrared irradiation means are first absorbed by the dot portions of the dot pattern layer and transmitted in other regions.
- the transmitted infrared rays are diffused by the infrared diffusion layer, then specularly reflected by the infrared reflection layer, diffused again by the infrared diffusion layer, and transmitted through the dot pattern layer except for the dot portion.
- (C) in the figure is a grid sheet in which an infrared diffusion layer that transmits visible light and diffuses infrared light is provided on one side of the dot pattern layer, that is, on the opposite side of the infrared reflection layer.
- the infrared rays irradiated from the infrared irradiation means are first diffused by the infrared diffusion layer, then absorbed by the dot portion of the dot pattern layer, and transmitted in the other regions.
- the transmitted infrared rays are specularly reflected by the infrared reflection layer, and are again transmitted through the dot pattern layer except for the dot portion and diffused by the infrared diffusion layer.
- FIG. 4D is a grid sheet composed of an infrared diffuse reflection layer having a characteristic of diffusing and reflecting infrared light from one side and transmitting visible light, and a dot pattern layer.
- the infrared rays irradiated from the infrared irradiation means are first absorbed by the dot portions of the dot pattern layer and transmitted in other regions.
- the transmitted infrared light is diffusely reflected by the infrared diffuse reflection layer, and passes through the dot pattern layer except for the dot portion.
- (E) in the figure is a grid sheet in which a protective layer having a property of transmitting infrared light and visible light is provided on the outer surface of the grid sheet shown in the figure (a) on the dot pattern layer side.
- the protective layer may be provided not only on the figure (a) but also on the outer surface of the grid sheet shown in (b) to (d) on the dot pattern layer side.
- (F) in the figure is a grid sheet having a characteristic of reflecting infrared rays from the side opposite to the dot pattern layer in the grid sheet shown in (a).
- the grid sheets shown in (b) to (e) in addition to (a) in the figure may have a characteristic of reflecting infrared rays from the side opposite to the dot pattern layer (the other side). .
- (G) in the figure is a grid sheet in which an adhesive layer is provided on the anti-dot pattern layer side of the infrared reflecting layer in the grid sheet shown in (a).
- the adhesive layer is made of a removable material.
- the pressure-sensitive adhesive layer is necessary only when the grid sheet is used by being attached to a display device or a medium, and is not necessary when it is placed on a printed material or sandwiched as described later. By providing such an adhesive layer, the grid sheet can be easily attached to a display or the like.
- the pressure-sensitive adhesive layer may be provided not only on the same figure (a) but also on the anti-dot pattern layer side of the infrared reflecting layer of the grid sheets shown in (b) to (e).
- FIG. 72 shows another embodiment of the grid sheet.
- a dot pattern layer is provided on both sides of the sheet.
- FIG. 4B is a grid sheet in which an infrared diffusion layer that transmits visible light and diffuses infrared light from each direction is provided between the infrared reflective layer and the dot pattern layer on each surface. It is.
- (C) is a grid sheet in which an infrared diffusion layer is provided on the outer surface of the infrared reflection layer and the dot pattern layer on each side.
- FIG. 4D is a grid sheet composed of an infrared diffuse reflection layer and dot pattern layers provided on both sides of the infrared diffuse reflection layer.
- the figure (e) is an information input auxiliary sheet in which a protective layer having a property of transmitting infrared light and visible light from each direction is provided on both outer surfaces of the grid sheet shown in the figure (a). is there.
- protective layer may be provided on both outer surfaces of the grid sheets shown in (b) to (d) as well as in FIG.
- the figure (f) is a grid sheet in which an adhesive layer is provided on each anti-dot pattern layer side of the infrared reflection layer, that is, both outer surfaces of the grid sheet, in the grid sheet shown in the figure (a). is there.
- the adhesive layer may be provided on both outer surfaces of the grid sheet shown in (b) to (e) as well as in FIG.
- each layer and the description of reflection in the grid sheets in FIGS. 9A to 9F are the same as those described above, and thus the description thereof is omitted here.
- different coordinate values and / or code values may be patterned in the dot pattern layer on one side and the other side of the infrared reflecting layer or infrared diffuse reflecting layer.
- ⁇ Problem solving means> Therefore, in the case of a grid sheet without a diffuse reflection layer, a method of forming a dot pattern with a diffuse reflection material (diffuse reflection ink) is used. According to this method, since the dots formed of the diffuse reflection material diffusely reflect infrared rays in all directions as shown in FIG. 73 (a), the infrared rays incident on the dots are always incident on the image sensor. . Therefore, as shown in FIG. 73 (b), the dot pattern is detected as a white dot in the black eyeball region in the photographed image.
- This algorithm is a scan line algorithm that is performed in units of lines, and calculates the brightness difference between pixels starting from the left end and separated by a predetermined interval in the right direction, and whether the difference exceeds or falls below a predetermined positive / negative threshold value.
- the negative threshold is exceeded, the right pixel is determined as a dot, and it is determined that the dot has started from that pixel.
- the positive threshold value is exceeded, it is determined that the right pixel is not a dot, and it is determined that the dot has been completed up to the previous pixel.
- the dots are determined based on the absolute threshold value, light and darkness occurs in an image captured with the scanner tilted, and the brightness of the dark part is significantly reduced, making it impossible to determine the dots in the dark part region.
- the dot can be accurately determined even in the image of the dark area by using the threshold value for determining the difference in brightness between the two points.
- the reason for using the difference between pixels separated by a predetermined interval instead of the difference in brightness between adjacent pixels is that there is little change in brightness around the contour in an image taken with blurred dot contours, etc. This is because if the pixels for which the difference is taken are too close, the difference is small and does not exceed the threshold value, making it impossible to determine the dot.
- the threshold value to be used is ⁇ ( ⁇ > 0).
- the dots can be more accurately determined by dynamically changing the threshold values of the dark part area with less light and dark and the bright part area with large light and darkness.
- ⁇ BL (i, j) is ⁇ BL (i, j) ⁇ ⁇ with respect to the threshold value ⁇ , it is determined that a dot has started from the pixel at the position of i + 4. If ⁇ BL (i, j)> ⁇ , it is determined that the dot has ended at the pixel at the position i + 3.
- a light guide is provided outside the optical path. Infrared rays are uniformly irradiated on the entire medium surface. Thereby, the infrared rays emitted from the light guide are specularly reflected on the grid sheet, and many areas of the photographed image can have black eyes. At this time, it is necessary to provide a light shielding portion at a position shown in the drawing so that excess infrared rays are specularly reflected on the grid sheet and do not enter the imaging device. Note that, due to the structure, when the scanner is tilted, the black eye area is reduced, but the shooting area is enlarged and the number of white dots to be captured is increased, so that the dot code can be analyzed without any problem.
- ⁇ Determination method of whether or not it is in contact with the medium If the scanner always reads a code on the medium surface while touching the medium surface, for example, if the user unintentionally shifts the reading position slightly, the code may differ from the user's intention. Will play different content. When it is desired to eliminate such a state, it may be set to ignore even if a code different from the first time is read. However, when tracing on the medium surface with a scanner like handwriting input, codes (coordinate values) to be read one after another must be input. Therefore, the error is ignored, and when a new coordinate value is read next time, it is always processed as a normal input.
- the scanner determines whether the scanner is in contact with the medium surface. Unless the scanner is separated from the medium surface, the same code to be read next is ignored (different codes may be ignored), and the scanner It is necessary to continue execution of contents and instructions corresponding to the code read for the first time in contact with. Of course, if the scanner is once separated from the media surface and touches the media surface again, the content or command that is being continuously executed is terminated, and the content corresponding to the newly read code (either the same code or a different code) It goes without saying that the execution of instructions is started. Note that if the code cannot be read even in contact with the medium surface, the execution is continued.
- the brightness of the central portion of the read image is simply measured, and if it is bright, the pen is in contact with the medium surface. For example, it can be performed simply by determining that the pen is not in contact with the medium surface.
- the reason for measuring only the brightness of the central part is that, even if the scanner is tilted, the decrease in brightness is small and does not affect the judgment, and the measurement area is limited to the central part to minimize the measurement time. It is because it can be suppressed.
- FIG. 76 shows a method of determining whether a scanner that can read black dots and also reads white dots is not in contact with either a normal medium surface (such as a print medium surface) or a grid sheet surface. Will be described.
- an image is acquired by the image sensor (S10).
- a white dot is searched for in the image (S30). If a white dot is detected, it is determined that it is in contact with the grid sheet (S35).
- black dot analysis (conventional algorithm) is started. If it is determined in S35 that it is in contact with the grid sheet, white dot analysis (new algorithm) is started.
- the writing area is rectangular, but when the writing area is specified using the code information as in the present invention, the shape of the writing area is, for example, a polygon as shown in FIG. , Circular, elliptical, heart-shaped, star-shaped, or when an illustration and a dot pattern are overprinted, the same analysis efficiency can be achieved regardless of the shape along the actual line of the illustration. be able to.
- the information dots are placed on the + direction line ( It is also possible to define information (second digitized information) for the combination of the information dot arrangement direction itself, which is arranged on the vertical / horizontal direction line) or on the x direction line (on the diagonal direction line). Therefore, when the information dot is arranged on the x direction line is “0” and the information dot is arranged on the + direction line is “1”, the second numerical value in the dot pattern of FIG.
- the digitized information is “1010010110100101”, and the second digitized information in the dot pattern of FIG. 80B is “0000000011111111”.
- the distance (arrangement distance) at which the information dots are arranged from the virtual reference point is set to two or more patterns so that the information dots are arranged at a distance from the virtual reference point
- the second digitized information can be defined also by the combination.
- the second digitized information may be defined by a combination of both the information dot arrangement direction and the arrangement distance.
- the second digitized information means information defined by the information dot arrangement rule itself, such as the information dot arrangement direction and arrangement distance.
- the inventor has so far proposed a dot pattern format that defines both code information and coordinate information.
- the dot pattern of such a format increases the dot pattern distribution area. Accordingly, the optical reading unit of the pen scanner needs to have a large reading area in order to read the dot pattern.
- the handwriting input / output system has the same feeling as a person who has not mastered the technique of using an existing input device such as a mouse, a keyboard, and a tablet used for operating a computer.
- the present invention has industrial applicability as an input device that can be used in a computer. Furthermore, it has industrial applicability as toys, especially educational toys, mainly for children.
- the handwriting input / output system can specify the writing area by the code information read simultaneously with the coordinate information, if the content input by handwriting belongs to a predetermined category, the dictionary of the category The recognition rate is greatly improved by collating with.
- the handwriting input / output system determines whether or not it is a writing area simply by reading the dot pattern without any special operation by the operator, and a writing instrument that everyone is familiar with is used. Intuitive handwriting input as you use it.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
- Character Discrimination (AREA)
Abstract
Description
本発明にかかる手書き入出力システムは、少なくとも一部、または複数の領域に座標情報および、コード情報が繰り返し定義されたドットパターンが形成された書き込み領域を備えた媒体と、該書き込み領域の該ドットパターンを撮像して、送信する撮像手段と、該撮像手段により撮像・送信された該ドットパターンの画像データを記憶して、該画像データをコード解析することにより、該座標情報および該コード情報からなる軌跡情報を求めるドットパターン解析手段と、解析された該座標情報の変化に基づき、該書き込み領域面においてトレースされた、文字および/または図形の該軌跡情報を認識する軌跡認識手段と、認識された認識情報に基づいた処理命令と該軌跡情報を情報処理手段に対し送信する処理命令手段とを備えたことを特徴とする。
<手書き入力シート>
本発明にかかる手書き入力シートは、少なくとも一部、または複数の領域に座標情報および、コード情報が繰り返し定義されたドットパターンが形成された書き込み領域を備えた媒体からなることを特徴とする。
<情報入力システム>
本発明にかかる情報入力システムは、一面側からの赤外線を反射すると共に、可視光を透過する特性を有する赤外線反射層と、該赤外線反射層の一面側に設けられ、赤外線を拡散反射する特性を有する材料からなる、少なくとも一部、または複数の領域に座標情報および/またはコード情報が繰り返し定義されたドットパターンのドットが配置されたドットパターン層と、該ドットパターン層の、該赤外線反射層と反対側に設けられ、赤外線および可視光を透過する特性を有する保護層とが積層されている情報入力補助シート、すなわちグリッドシートと、少なくとも媒体面の一部に、該ドットパターンのドットが赤外線を吸収する特性を有する材料で形成された媒体と、該ドットパターンを撮像して、送信する撮像手段と、該媒体面の該ドットパターンを該撮像手段により撮像・送信された該ドットパターンの画像データでは、明度が周辺とは低く撮像されるドット部、または、該グリッドシートの該ドットパターンを該撮像手段により撮像・送信された該ドットパターンの画像データでは、明度が周辺とは高く撮像されるドット部を、所定の判定方法により判定し、該ドットパターンの画像データを記憶素子に記憶して、コード解析することにより、該座標情報および/または該コード情報を入力するドットパターン解析手段とからなることを特徴とする。
<情報入力補助シート>
本発明にかかる情報入力補助シートは、一面側からの赤外線を反射すると共に、可視光を透過する特性を有する赤外線反射層と、該赤外線反射層の一面側に設けられ、赤外線を拡散反射する特性を有する材料からなる、少なくとも一部、または複数の領域に座標情報および/またはコード情報が繰り返し定義されたドットパターンのドットが配置されたドットパターン層と、該ドットパターン層の、該赤外線反射層と反対側に設けられ、赤外線および可視光を透過する特性を有する保護層と、が積層されていることを特徴する。
た前記指示用突起部または前記ペン先が前記書き込み領域面に触れる位置の座標情報と前記コード情報からなり、前記ドットパターン解析手段により、前記ドットパターンに定義された座標情報を基に補間計算して求められることが好ましい。
図1は、本発明にかかる手書き入出力システム1の使用状態の一例を示す外観図である。同図によれば、媒体2にスキャナ3を用いて書き込みをすると、書き込んだとおりの文書がディスプレイ6に表示される。これは、スキャナ3が、書き込んだ軌跡上のドットパターンを撮像して、コンピュータ4が解析する(必要に応じてサーバ5にアクセスする)ことにより、実現する。ただし、コンピュータ4がスキャナ3に内蔵されていてもよい。
以下に、本発明にかかる手書き入出力システム1において用いるドットパターンについて、図8~15を用いて説明する。
図8~図15は本発明にかかる手書き入出力システム1において媒体2に形成されるドットパターンの一例であるGRID1を示す説明図である。
なお、撮像手段であるスキャナ3を媒体面に近づけて、または触れてドットパターンを撮像する場合は、キードット102、情報ドット103または基準格子点ドット104のドットの径は、見栄えと、紙質に対する印刷の精度、撮像部7の解像度および最適なデジタル化を考慮して、隣り合う基準格子点ドット104の間隔の6~16%(基準格子点ドットの間隔が0.5mmの場合は0.03~0.08mm)程度が望ましい。ただし撮像手段であるスキャナ3の撮影口の大きさにより、撮像領域内に所定のドットパターンが撮像されるよう形成される必要があり、1ブロックのドットパターンの配置サイズおよびドットの径を適切に定めることは勿論である。さらに、撮像面積に対する必要な情報量と、各種ドット102,103,104の誤認を考慮して基準格子点ドット104の間隔は縦・横0.3~0.5mm前後が望ましい。基準格子点ドット104および情報ドット103との誤認を考慮して、キードット102のずれは格子間隔の20~25%前後が望ましい。
次に、ドットパターンの他の形態であるディレクションドットについて図14を用いて説明する。
図15は、本発明にかかる手書き入出力システム1において媒体2に形成されるドットパターンのフォーマットについて説明する図である。
<撮像部>
図16~28は、本発明にかかる手書き入出力システム1に用いる撮像部7を説明する図である。
同図(b)は時間毎のLED34の発光タイミングを示す図である。LED34は所定のタイミング毎に瞬間的に所定強度、発光して、媒体2を露光する。C-MOSセンサ35は媒体2からの反射光を撮像し、画像データとしてドットパターン解析部8へ送信する。
また、ペン型スキャナ31は、筆記具としてのペン37が装着されている。通常ペン等の筆記具で印字する際は、傾斜させた状態で用いるため、ペン型スキャナ31の外周は、45度まで傾斜可能になるように形成されている。この場合、ペン37の先端近傍の媒体面を撮像することにより、撮像中心から離れた位置のペン37の印字の際の筆跡や移動距離等を正確に解析することも可能となる。また、後述するオフセット補正により、筆跡をさらに正確に解析することが可能である。
図17(a)に示すように、ペン型スキャナ31において、撮像部7が撮像するドットパターンが定義するXY座標値と、ペン37が実際に書き込む軌跡上のドットパターンが定義するXY座標値は異なる。さらに、軌跡上のドットパターンが定義するXY座標値は、媒体面上の書き込み領域におけるxy座標値に変換して、書き込み入力や操作指示を行う必要がある。
図19に書き込み領域の一例を示す。
(X×L+L/2, Y×L+L/2)となる。
なお、図21のように、書き込み領域の左下隅を座標系の原点(0,0)とし、〔0,0〕を定義したドットパターンのブロックの中心点と原点を一致させると、
(X×L, Y×L)となる。
((X-Xn0)×L,(Y-Yn0)×L) となる。
<撮像中心Cのドットパターン座標系におけるXY座標値〔Xc,Yc〕の算出>
図23を用いて、撮像中心CのXY座標値〔Xc,Yc〕の算出方法を説明する。
撮像画像を所定の解像度のフレームバッファに一時記憶し、画像解析することにより、隣り合うブロックの中心間隔を構成するピクセル数Mを求める。ブロックの中心間隔は、ブロックの一辺の長さLに等しいので、Lに対する撮像画像の1ピクセル当たりのサイズを、ドットパターン座標系での値kとすると、
k=L/Mとなる。
CP=k×uとなる。
〔Xc,Yc〕=〔Xp-CP×sinθ', Yp+CP×cosθ'〕
が求まる。
図24のように、書き込み領域座標系における撮像中心Cの座標値を(xc,yc)、ペン先の媒体面における座標値をQ(xq,yq)とする。図25のように、点Cと点Qのx座標値、y座標値の差分を、それぞれΔxq、Δyqとすると、
Δxq =xq -xc
Δyq=yq-yc
が求まる。
Δxq およびΔyqは、
Δxq =-s×sinθ
Δyq=s×cosθ
となる。
xq =xc -s×sinθ
yq=yc+s×cosθ
となる。
図27のように、ペン型スキャナ31が紙面に対し傾いている場合、前述の撮像中心Cからペン先Qまでの距離が変化する。
xq' =xc -s'×sinθ
yq'=yc+s'×cosθ
となる。
s'=s/cosα
であるので、これを当該式に代入すると、
xq' =xc -s'×sinθ/ cosα
yq'=yc+s'×cosθ/ cosα
となる。
なお、図28のように、ペン先が格納されると、ΔLだけペン型スキャナ31が紙面に近づくがsおよびs'には影響を及ぼすものではなく、計算式は同一となる。
ペンの傾きαを検出するには、ペン本体に傾きセンサなどの傾き計測手段を設けても良い。
図29~42は、本発明にかかる手書き入出力システム1に用いる媒体2を説明する図である。
(複数の書き込み領域が設けられる場合に関して)
第1の例は、図34に示すように、複数の書き込み領域毎に、異なるドットパターン座標系によるXY座標値と書き込み領域を特定するコード値とを定義したドットパターンが形成される場合である。
第2の例は、図36に示すように、所定領域全面に1つのドットパターン座標系によるXY座標値を定義したドットパターンが形成され、書き込み領域のドットパターンにはXY座標と共にコード値も定義されている場合である。
第3の例は、図37に示すように、書き込み領域の中に、さらに書き込み領域を入れ込む場合である。
第4の例は、図38に示すように、所定領域全面に1つのドットパターン座標系を定め、書き込み領域にはこの座標系でのXY座標値と書き込み領域を特定するコード値を定義したドットパターンが形成される場合である。
本発明の手書き入出力システム1においては、手書き入力を行い、情報処理部11において手書き入力を反映させたものを印刷して、再度手書き入力を行うこともできる。
また、媒体2にはバンクガイド38(幅狭の凸部)または点字39をさらに設けてもよい。
ドットパターン解析部8は、前述のGRID1におけるドットパターンを用いた情報の入出力方法に従い、画像データをコード解析することにより、ドットパターンが定義するXY座標情報およびコード情報を求める。
軌跡認識部9は、軌跡情報の変化に基づき、媒体上に書き込まれた文字、図形を認識する。
本発明にかかる手書き入出力システム1は計時部15をさらに備えてもよい。計時部15は時間情報を検出する機能を持つ。
(1)撮像部7が書き込み領域面に触れて描かれた筆歴の順番とする。
本発明にかかる手書き入出力システム1は角度測定部16・角度変化認識部17をさらに備えてもよい。角度測定部16・角度変化認識部17は撮像部7の媒体面に対する傾きを測定・認識する。
本発明にかかる手書き入出力システム1は回転角読み取り部18・回転角変化認識部19をさらに備えてもよい。回転角読み取り部18・回転角変化認識部19は撮像部7の撮像光軸を概ね鉛直状に立て、回転させたときの回転角を読み取り・認識する。
本発明にかかる手書き入出力システム1において、撮像部7を書き込み領域にタッチする動作(タッチ動作)と、書き込み領域に触れた状態から跳ねる動作(跳ねる動作)の判別方法を図48に説明する。
処理命令部10は、軌跡認識部9が認識した情報に基づく処理命令を、軌跡情報とともに情報処理部11に対して送信する。
情報処理部11は、本発明にかかる手書き入出力システム1が行う処理命令を受けて、各種の処理を実行する。
本発明にかかる手書き入出力システム1は、必要に応じて各種の情報を記録したサーバ5にアクセスしてもよい。
サーバ5には、たとえば軌跡認識用の情報を記憶することができる。一般的なOCR(光学的文字読取装置)で採用されているように複数の文字および図形にXY座標パターンが定義づけられて記憶されている。
サーバ5には軌跡認識用の情報以外にも、音声、文書、画像、動画、アプリケーション、その他の様々な情報を記憶することができることは説明するまでもない。たとえば手書き入出力用アプリケーションを記憶することができる。すなわち、情報処理部11が手書き入出力用アプリケーションを持たないとき、サーバ内を検索して、サーバ上の手書き入出力用アプリケーションを実行することができる。ただし、サーバ上の手書き入出力用アプリケーションを優先して実行してもよい。
以下に、本発明にかかる手書き入出力システム1において実行される、手書き入出力用アプリケーションについて説明する。
以下、本発明にかかる手書き入出力システム1における、書き込み操作について説明する。
図49は本文の文字を手書き入力する第一のオペレーションを説明するイメージ図である。
図50に示すように、第二のオペレーションはコメントの文字を手書き入力するオペレーションである。なお、同図では説明の便宜を図るためにコメント部分を破線により囲んでいるが、実際に破線を書き込む必要はない。
第三のオペレーションは手書き入力した文字を編集するオペレーションである。
以下に、各オペレーションの階層関係について説明する。
図59に示すように、撮像部7を媒体面上にタッチしたまま所定回転角度(例:10度以上)、右回転させることにより、処理命令部10は入力した文字および文書構成の結果(ファイル内容の変更結果)を保存することを情報処理部11に命令する。撮像部7本体が、編集履歴を記録できる機能を有している場合は、上記文書構成の結果を情報処理部11に送信する。
図61に示すように、撮像部7を媒体面上にタッチしたまま所定回転角度(例:10度以上)、右回転させ、そのまま所定の時間内(例:1秒以内)に所定回転角度(例:10度以上)左回転させることにより、処理命令部10は情報処理部11に対して手書き入出力用アプリケーションを起動することを命令する。
以下に、図63を用いて、オペレーションの切り替えをする第一の方法を説明する。
以下に、オペレーションの切り替えをする第二の方法を説明する。
以下に、オペレーションの切り替えをする第三の方法を説明する。
情報処理部11が所定の処理を実行するか否かを決定するときにおいて、図65(a)に示すように、撮像部7を媒体面に鉛直状に立てて、一度媒体面をタッチした後、所定の時間内(例:1秒以内)にもう一度媒体面をタッチしたとき、処理命令部10は情報処理部11に対して処理の実行を決定することを命令する。
以上の構成は媒体2に書き込み履歴を残すことを前提とするものであるが、本発明にかかる手書き入出力システム1は媒体2に書き込み履歴を残すことなく、ディスプレイ6を見ながら手書き入力を行ってもよいことは先にも述べたとおりである。
本発明は手書き入出力システムであるが、手書き入力を補助する方法として音声認識および音声ガイドをすることができるものとしてもよい。
音声収録部20は、図66に示すように、中央処理装置(MPU)40を中心に構成されている。すなわち、中央処理装置(MPU)40の制御によって、マイク41から入力された音声情報は、アンプ42を介してA/Dコンバータ43、圧縮回路44によって処理され、デジタル音声情報として、記録される。
音声認識部21は、録音した音声情報を対応するテキスト情報に変換し、処理命令部10は情報処理部11に対して、テキスト情報に基づく処理命令をテキスト情報と共に送信する。
本発明に係る手書き入出力システム1が、手書き入力に代えて音声収録を行う場合、所定の操作を行なうことにより音声収録モードへの切り替えを行う必要がある。以下に、音声収録モードへの切り替え方法を説明する。
音声収録モードへ切り替える第一の方法としては、撮像部7が音声収録モードへの切り替えを意味する特定の記号を書き込む(なぞる、描く)ことにより、音声収録モードへ切り替える方法がある。軌跡認識部9が音声収録モードへの切り替えを意味する特定の記号の軌跡を認識して、音声収録部20に送信することにより(または処理命令部10を介して送信することにより)、音声収録部20は音声収録を開始する。
音声収録モードへ切り替える第二の方法としては、図67に示すように、撮像部7を媒体面の書き込み領域に触れた状態で跳ねる動作をすることにより、音声収録モードへ切り替える方法がある。
音声収録モードへ切り替える第三の方法としては、音声収録部20に所定の音声を収録し、音声認識部21が所定の音声を認識することにより、音声収録モードへ切り替える方法がある。
音声出力部22は処理命令部10からの指示に応じて所定の音声ファイルを再生する。音声ファイルは予めデジタル化されて記憶されているものがA/Dコンバータ42、アンプ42を介してスピーカ45またはイヤホン46より出力される。
本発明にかかる手書き入出力システム1においては、コード情報を利用することにより、手書き入力を行うユーザに対して音声ガイドを行ってもよい。
図68~図72は、本発明にかかる手書き入出力システム1において、情報入力補助シートであるグリッドシートをディスプレイに装着して用いる実施例について示した説明図である。このグリッドシートは、透明なシート上にドットパターンが形成されたものであって、モニタ面上に重ねて貼り付けることでタッチパネルとしての機能を発揮するものである。
なお、同図に示したグリッドシートにおいては、赤外線反射層または赤外線拡散反射層の一面側と他面側のドットパターン層では、異なる座標値および/またはコード値がパターン化されていてもよい。
前述したように、グリッドシートにおいて赤外線拡散反射層を設けないでおくと、シート表面では鏡面反射するため、撮像素子の中心周辺に赤外線反射光が入射しない領域ができてしまい、図69(b)のような黒目が中央に位置するような目玉現象が生じる。そのため、拡散反射層を設ける必要がありコスト高になってしまう。
そこで、拡散反射層を設けないグリッドシートの場合に、拡散反射素材(拡散反射インク)によってドットパターンの形成を行う方法を用いる。この方法よれば、拡散反射素材で形成されたドットは、図73(a)に示すように、赤外線をあらゆる方向に拡散反射するため、このドットに入光した赤外線は必ず撮像素子に入射される。したがって、図73(b)のように、撮影画像には、ドットパターンが黒い目玉領域内に白ドットとして検出されることになる。
通常の媒体面上に印刷された従来の黒ドットを判別することができ、かつ、拡散反射層を設けないグリッドシート状に印刷された前述の白ドットも認識することができるアルゴリズムについて説明する。
(数式)ΔBL(i、j)=BL(i+4、j)-BL(i、j)
用いる閾値をφ(φ>0)とする。なお、明度を8ビット(ブライトレベル0~255)で表現している場合、明部領域ではφ=25~50程度、暗部領域では、φ=8~16が適切である。このように、ドット部分との、明暗の少ない暗部領域と明暗の大きな明部領域の閾値をダイナミックに変更することにより、さらにドットを正確に判定できる。
ここで、ΔBL(i、j)が閾値φに対し、ΔBL(i、j)<-φであれば、i+4の位置のピクセルからドットが始まったと判断する。ΔBL(i、j)>φであれば、i+3の位置のピクセルでドットが終わったと判断する。
グリッドシートを用いて白ドットをスキャナで読み取る場合には、黒目の大きさをより大きくして、ドットパターンの検出範囲を広げなければならない。
そこで、黒目がより大きくなるようなスキャナの形状を説明する。
スキャナで媒体面に接している間、常に媒体面上のコードを読み取っていると、例えば、ユーザが意図せずに読み取り位置を微妙にずらしてしまった場合などに、ユーザの意図とは異なるコードを読み取って、異なるコンテンツを再生してしまう。このような状態を排除したい場合は、1度目と異なるコードを読み取っても無視する設定にすればよい。ただし、手書き入力のようにスキャナで媒体面上をなぞる場合は、次々に読み取られるコード(座標値)を入力しなければならない。したがって、エラーは無視して、次に新たな座標値を読み取ったときは、常に正常入力として処理すればよい。さらに、スキャナの僅かな移動による読み取りエラーが生じた場合、1度エラーが起こると、次に読み取った同一コードを1度目に読み取ったコードとして入力されるように設定されている場合、同じコンテンツを何度でもスタートしてしまう(「ハロー、ハロー、ハロー・・・」のような再生が起こってしまう)現象が起こり、適正なオペレーションができない。
<撮像素子の残像特性について>
なお、図17(c)に示した素子の電荷にあっては、同図(c)に示すほかに、所定時間tkにおける撮像素子12の残像の消え方がより緩やかとなるものでもよい。
以上説明した限りでは、書き込み領域とはいずれも矩形であったが、本発明のようにコード情報を用いて書き込み領域を特定する場合、図78に示すように書き込み領域の形状は、例えば多角形、円形、楕円形、ハート形、星形、あるいはイラストとドットパターンを重畳印刷する場合、当該イラストの実在線に沿った形状など、どのようなものであっても、同様の解析効率を発揮することができる。
自動的な操作判別を行なうもう一つの方法を説明する。
2 媒体
3 スキャナ
4 コンピュータ
5 サーバ
6 ディスプレイ
7 撮像部
8 ドットパターン解析部
9 軌跡認識部
10 処理命令部
11 情報処理部
12 撮像素子
13 照射部
14 光制御部
15 計時部
16 角度測定部
17 角度変化認識部
18 回転角読み取り部
19 回転角変化認識部
20 音声収録部
21 音声認識部
22 音声出力部
23 送信部
24 送信ボタン
25 再送信ボタン
26 マイク
27 音声再生ボタン
28 指示用突起部
29 ペン
30 ペン格納ボタン
31 ペン型スキャナ
32 ライトガイド
33 レンズ
34 LED
35 C-MOSセンサ
36 PCB
37 ペン
38 バンクガイド
39 点字
40 中央処理装置(MPU)
41 マイク
42 アンプ
43 A/Dコンバータ
44 圧縮回路
45 スピーカ
46 イヤホン
Claims (60)
- 少なくとも一部、または複数の領域に座標情報および、コード情報が繰り返し定義されたドットパターンが形成された書き込み領域を備えた媒体と、
該書き込み領域の該ドットパターンを撮像して、送信する撮像手段と、
該撮像手段により撮像・送信された該ドットパターンの画像データを記憶素子に記憶して、該画像データをコード解析することにより、該座標情報および該コード情報からなる軌跡情報を求めるドットパターン解析手段と、
解析された該座標情報の変化に基づき、該書き込み領域面においてトレースされた、文字および/または図形の該軌跡情報を認識する軌跡認識手段と、
認識された認識情報に基づいた処理命令と該軌跡情報を情報処理手段に対し送信する処理命令手段と
を備えた手書き入出力システム。 - 前記媒体は、
少なくとも一部、または複数の領域に、前記書き込み領域に関連するテキスト、グラフィック、写真がさらに形成された
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記媒体は、
少なくとも前記書き込み領域面に描かれた前記軌跡情報または該軌跡情報の編集結果情報、および/または前記媒体面上の印刷情報と共に前記ドットパターンが新たに重畳して形成された
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記媒体は、
所定の媒体面および/または前記書き込み領域面に対して、前記書き込み領域を特定する特定情報および/または操作指示(プログラムの起動、コマンドの入力、データの入出力・検索、検索対象の指定等)を定義するコード情報を繰り返し形成する前記ドットパターンには、該コード情報を意味するアイコンが重畳して形成された
ことを特徴とする請求項1記載の手書き入出力システム。 - 前記アイコンは、
貼付可能なシール、付箋紙、その他の媒体面上に前記ドットパターンと重畳して形成された
ことを特徴とする請求項4記載の手書き入出力システム。 - 前記媒体は、
前記書き込み領域を設けた該媒体を第1の媒体として、該第1の媒体面および/または前記書き込み領域面を特定するためのコード情報を繰り返し定義したドットパターンを形成した第2の媒体をさらに備え、
該第2の媒体に形成したコード情報を、前記撮像手段で読み取ることにより、前記第1の媒体面上の印刷情報および/または前記書き込み領域面に描かれた前記軌跡情報、および/または該軌跡情報に関連した情報を出力する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記第2の媒体は、
貼付可能なシール、付箋紙等、またはカード状の形態を有している
ことを特徴とする請求項6記載の手書き入出力システム。 - 前記媒体は、
前記手書き入出力システムによる、前記書き込み領域が表示されたモニタ面上に重ねて用いる、座標情報および/またはコード情報が繰り返し定義されたドットパターンが形成された透明な情報入力補助シートであるグリッドシートである
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記媒体は、
前記手書き入出力システムによる前記書き込み領域が印刷された媒体上に重ねて用いる、座標情報および/またはコード情報が繰り返し定義されたドットパターンが形成される透明な情報入力補助シートであるグリッドシートである
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記撮像手段は、
撮像口を介して所定波長の光を前記媒体面に照射する照射手段と、
該所定波長の反射光を撮像し、画像データとして前記ドットパターン解析手段に送信する撮像素子と、をさらに備え、
該ドットパターン解析手段は、
該照射手段に第1の所定時間において所定強度の光を発光させ、
該ドットパターン解析手段が該撮像素子により撮像し、送信される該画像データを記憶素子に記憶する時間以上、該画像データを該撮像素子に残像として固定できるようにさらに、該所定強度の光は、該ドットパターン解析手段が該画像データをコード解析するのに必要な、解析時間以上の第2の所定時間の経過後に再度発光し、該第1の所定時間と該第2の所定時間が連続するものとして、該照射手段を制御する光制御手段をさらに備えた
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記光制御手段は、
前記ドットパターン解析手段による前記画像データのコード解析終了後、前記第2の所定時間を待たずして直ちに前記照射手段に発光を指示し、
該照射手段は、前記第1の所定時間の間、前記所定強度の光を発光して、
該ドットパターン解析手段は、前記撮像手段により新たに撮像・送信される画像データを記憶素子に記憶して、コード解析する
ことを特徴とする請求項10に記載の手書き入出力システム。 - 前記光制御手段は、
前記ドットパターン解析手段による該ドットパターンの解析時間中に前記第2の所定時間を待たずして直ちに前記照射手段に発光を指示し、
該照射手段は、前記第1の所定時間の間、前記所定強度の光を発光して、
前記ドットパターン解析手段は、該解析時間中に、前記撮像手段により新たに撮像・送信される画像データを記憶素子に記憶して、該解析時間の終了後、直ちに該画像データをコード解析する
ことを特徴とする請求項10に記載の手書き入出力システム。 - 前記撮像手段は、
指示用突起部をさらに備え、
前記書き込み領域面に、該指示用突起部でなぞった文字および/または図形をトレースする際、該指示用突起部近傍の軌跡上の前記ドットパターンを撮像し、
前記ドットパターン解析手段は、
該撮像手段により送信された該ドットパターンの画像データを記憶素子に記憶して、該ドットパターンをコード解析して前記座標情報および前記コード情報からなる軌跡情報を求める
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記撮像手段は、
少なくとも1つのペン先をさらに備え、
前記書き込み領域面に、該ペン先で描いた文字および/または図形をトレースする際、
該ペン先近傍の軌跡上の前記ドットパターンを撮像・送信し、
前記ドットパターン解析手段は、
該撮像手段により撮像・送信される該ドットパターンの画像データを記憶素子に記憶して、該ドットパターンをコード解析して前記座標情報および前記コード情報からなる軌跡情報を求める
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記指示用突起部は、
少なくとも一つのペン先と、
該指示用突起部内に該ペン先を格納する格納スペースと、
該ペン先の格納/取出しを制御するボタンと、をさらに備えた該指示用突起部である
ことを特徴とする請求項13に記載の手書き入出力システム。 - 前記撮像手段は、
前記指示用突起部に前記書き込み領域面に描かれた文字および/または図形を消去する消去手段をさらに備え、
該書き込み領域面に、該消去手段でなぞった領域を消去すると同時に、該消去手段近傍の軌跡上のドットパターンを撮像し、
前記処理命令手段は、
該文字および/または図形の前記軌跡情報を消去する処理命令と、前記軌跡情報と、を情報処理手段に対し送信する
ことを特徴とする請求項13に記載の手書き入出力システム。 - 前記軌跡認識手段は、
前記ドットパターン解析手段がコード解析して得た前記座標情報を、
該書き込み領域面になぞるか、または描いた文字および/または図形の軌跡と、一致または近似するように補正する
ことを特徴とする請求項1にかかる手書き入出力システム。 - 前記軌跡認識手段は、
計時手段をさらに備え、
該計時手段は、前記撮像手段が前記書き込み領域面に触れた時間および離れた時間を計時し、
該撮像手段が該書き込み領域面に触れて描かれた軌跡の順番と触れている時間を記録し、前記情報処理手段に送信することを特徴とする請求項1に記載の手書き入出力システム。 - 前記計時手段は、
前記撮像手段が前記書き込み領域面に触れ、前記ドットパターン解析手段が前記軌跡情報を求めた時間を記録し、前記情報処理手段に送信することを特徴とする請求項18に記載の手書き入出力システム。 - 前記処理命令手段は、
前記コード情報および/または前記認識情報に基づき、前記書き込み領域を特定する特定情報および/または操作指示(プログラムの起動、コマンドの入力、データの入出力・検索、検索対象の指定等)を一意に入力可能であることを特徴とする請求項1に記載の手書き入出力システム。 - 前記軌跡認識手段は、
さらに前記コード情報に基づき、
前記書き込み領域に書き込む内容に関する、
予め分類された文字および/または図形情報パターンを参照し、
前記軌跡情報を高精度で認識する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記軌跡認識手段は、さらに解析された前記座標情報の変化に基づき、該文字および/または該図形、もしくは、1または複数の該文字からなる語句、の意味情報を、前記コード情報に対応する予め定義された意味情報コードテーブル(辞書)を参照し、意味情報コードに変換し、
前記処理命令手段は、
該意味情報コードと、該意味情報に基づいた前記処理命令と、を前記情報処理手段に対し送信する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記処理命令手段は、
前記軌跡認識手段による前記軌跡情報の認識結果を、
文書および/または図形として入力させる第一のオペレーションの実行を、
前記情報処理手段に命令する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記処理命令手段は、
前記軌跡認識手段による前記軌跡情報の認識結果を、
コメントとして入力させる第二のオペレーションの実行を、
前記情報処理手段に命令する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記処理命令手段は、
前記軌跡認識手段による前記軌跡情報の認識結果を、
文書および/または図形、および/またはコメントを編集する編集記号とし、
該編集記号に基づいて文書および/または図形、および/またはコメントを編集させる第三のオペレーションの実行を、
前記情報処理手段に命令する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 少なくとも前記媒体面に接触した前記撮像手段の撮像光軸が、該媒体面の鉛直線に対して倒されることにより成される傾きおよび倒される方向を測定する角度測定手段と、
該撮像手段が該媒体面に接触した際に測定された、該傾きおよび該方向を基準として、
該撮像手段を倒す動作、すなわちグリッドティルト動作による、該傾きおよび/または該方向の、所定の変化を解析する角度変化認識手段と
をさらに備え、
前記処理命令手段は、
該解析の結果に基づき、予め定められた処理命令を前記情報処理手段に対し送信する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記媒体は、前記書き込み領域の方向に対して、所定の角度で配置された前記ドットパターンが該書き込み領域に形成され、
前記角度測定手段および前記角度変化認識手段は、前記撮像手段が該書き込み領域面に接触した際に読み取られた該ドットパターンの方向を基に、該書き込み領域の方向に対して、倒される方向および/または前記傾きの、所定の変化を解析する
ことを特徴とする請求項26に記載の手書き入出力システム。 - 前記処理命令手段は、
前記撮像手段が前記グリッドティルト動作により前記撮像手段または前記書き込み領域の上向き方向に対して、第一の所定方向に倒されたものと前記角度変化認識手段が認識したときは、
前記軌跡認識手段による軌跡情報の認識結果を、
文書および/または図形として入力させる第一のオペレーションの実行を、
前記情報処理手段に対して命令する
ことを特徴とする請求項26または27に記載の手書き入出力システム。 - 前記処理命令手段は、
前記撮像手段が前記グリッドティルト動作により前記撮像手段または前記書き込み領域の上向き方向に対して、第二の所定方向に倒されたものと前記角度変化認識手段が認識したときは、
前記軌跡認識手段による軌跡情報の認識結果を、
コメントとして入力させる第二のオペレーションの実行を、
前記情報処理手段に対して命令する
ことを特徴とする請求項26または27に記載の手書き入出力システム。 - 前記処理命令手段は、
前記撮像手段が前記グリッドティルト動作により前記撮像手段または前記書き込み領域の上向き方向に対して、第三の所定方向に倒されたものと前記角度変化認識手段が認識したときは、
前記軌跡認識手段による軌跡情報の認識結果を、
文書および/またはコメントを編集する編集記号とし、
該編集記号に基づいて文書および/または図形、および/またはコメントを編集させる第三のオペレーションの実行を、
前記情報処理手段に対して命令する
ことを特徴とする請求項26または27に記載の手書き入出力システム。 - 前記処理命令手段は、
前記撮像手段が前記グリッドティルト動作により前記撮像手段または前記書き込み領域の上向き方向に対して、第四の所定方向に倒されたものと前記角度変化認識手段が認識したときは、
前記第三のオペレーションの終了を、
前記情報処理手段に対して命令する
ことを特徴とする請求項30に記載の手書き入出力システム。 - 前記処理命令手段は、
前記情報処理手段が所定の処理を実行するか否かを決定するときにおいて、
前記撮像手段が媒体面に所定時間内に一度だけタッチしたものと、前記ドットパターン解析手段が認識したときは、
該所定の処理を実行しないことの決定を該情報処理手段に対し命令し、
前記撮像手段が媒体面に対して一度タッチし、所定時間内にさらに媒体面にタッチしたものと、該ドットパターン解析手段が認識したとき、
該所定の処理の実行を決定することを該情報処理手段に対し命令する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記手書き入出力システムは、
前記書き込み領域面に対して、前記撮像手段の撮像光軸を概ね鉛直状に立て、該書き込み領域面に接触した際に読み取られた前記ドットパターンの方向と、該撮像手段のアングルとで成される回転角を読み取る回転角読み取り手段と、
該撮像手段が該媒体面に接触した際に測定された該回転角を基準として、
該撮像手段を回転する動作、すなわちグリッドターン動作による、該撮像光軸が所定の回転方向に回転されることにより、該回転角の所定の変化を解析する回転角変化認識手段と
をさらに備え、
前記処理命令手段は、
該解析の結果に基づき、予め定められた処理命令を前記情報処理手段に対し送信する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記処理命令手段は、
前記撮像手段が第一の所定方向に回転したものと前記回転角変化認識手段が認識したときは、
実行中のアプリケーションにおけるファイル内容の変更結果を保存することを前記情報処理手段に対し命令し、
該撮像手段が該第一の所定方向とは反対方向の第二の所定方向に回転したものと該回転角変化認識手段が認識したときは、
実行中のアプリケーションにおけるファイル内容の変更をキャンセルすることを該情報処理手段に対し命令する
ことを特徴とする請求項33に記載の手書き入出力システム。 - 前記処理命令手段は、
前記撮像手段が第一の所定方向に回転し、さらに所定時間内に該第一の所定方向とは反対方向の第二の所定方向に回転したものと前記回転角変化認識手段が認識したときは、
手書き入出力用アプリケーションを起動することを前記情報処理手段に対し命令し、
該撮像手段が該第二の所定方向に回転し、さらに所定時間内に該第一の所定方向に回転したものと該回転角度変化認識手段が認識したときは、
該手書き入出力用アプリケーションを終了することを該情報処理手段に対し命令する
ことを特徴とする請求項33に記載の手書き入出力システム。 - 前記手書き入出力システムは、
前記撮像手段で前記書き込み領域を撮像して前記ドットパターン解析手段により座標情報およびコード情報を求めた後に、所定の操作により該撮像手段で該書き込み領域に文字をなぞるか、または描く代わりに音声を収録する音声収録手段と、
前記コード情報に対応する予め定義された音声認識情報テーブル(辞書)を参照し、収録された音声を認識し文字情報に変換し情報処理手段に対し送信する音声認識手段と、をさらに備えた
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記所定の操作は、
前記撮像手段で前記書き込み領域に音声入力を意味する記号をなぞるか、または描くことにより行う
ことを特徴とする請求項36に記載の手書き入出力システム。 - 前記所定の操作は、
前記書き込み領域に前記撮像手段を触れて跳ねる動作により行う
ことを特徴とする請求項36に記載の手書き入出力システム。 - 前記所定の操作は、
前記音声収録手段に所定の言葉を収録し、前記音声認識手段により該所定の言葉を認識することにより行う
ことを特徴とする請求項36に記載の手書き入出力システム。 - 前記媒体は、
該媒体における前記コード情報に予め音声ガイドの指示情報が定義され、
前記手書き入出力システムは、
該書き込み領域に書き込む内容を該音声ガイドにより解説する音声出力手段をさらに備えた
ことを特徴とする請求項1に記載の手書き入出力システム。 - 少なくとも一部、または複数の領域に座標情報および、コード情報が繰り返し定義されたドットパターンが形成された書き込み領域を備えた媒体からなる
ことを特徴とする手書き入力シート。 - 前記媒体は、
前記書き込み領域に関連するテキスト、グラフィック、写真がさらに重畳して形成された
ことを特徴とする請求項41に記載の手書き入力シート。 - 前記媒体は、
所定の媒体面および/または前記書き込み領域面を特定する特定情報および/または操作指示(プログラムの起動、コマンドの入力、データの入出力・検索、検索対象の指定等)を定義するコード情報を繰り返し形成する前記ドットパターンに、該コード情報を意味するアイコンがさらに重畳して形成された
ことを特徴とする請求項41に記載の手書き入力シート。 - 前記アイコンは、
貼付可能なシール、付箋紙、その他の媒体面上に前記ドットパターンとともに形成された
ことを特徴とする請求項43に記載の手書き入力シート。 - 前記手書き入力シートは、
前記書き込み領域内および/または領域周辺に点字をさらに備えたことを特徴とする請求項41に記載の手書き入力シート。 - 前記手書き入力シートは、
前記書き込み領域に書き込む際に、前記撮像手段がはみ出さないように該書き込み領域の外周に沿って幅狭の凸部のガイドをさらに備えた
ことを特徴とする請求項41に記載の手書き入力シート。 - 一面側からの赤外線を反射すると共に、可視光を透過する特性を有する赤外線反射層と、
該赤外線反射層の一面側に設けられ、赤外線を拡散反射する特性を有する材料からなる、少なくとも一部、または複数の領域に座標情報および/またはコード情報が繰り返し定義されたドットパターンのドットが配置されたドットパターン層と、
該ドットパターン層の、該赤外線反射層と反対側に設けられ、赤外線および可視光を透過する特性を有する保護層と
が積層されている情報入力補助シート、すなわちグリッドシートと、
少なくとも媒体面の一部に、該ドットパターンのドットが赤外線を吸収する特性を有する材料で形成された媒体と、
該ドットパターンを撮像して、送信する撮像手段と、
該媒体面の該ドットパターンを該撮像手段により撮像・送信された該ドットパターンの画像データでは、明度が周辺とは低く撮像されるドット部、または、該グリッドシートの該ドットパターンを該撮像手段により撮像・送信された該ドットパターンの画像データでは、明度が周辺とは高く撮像されるドット部を、所定の判定方法により判定し、該ドットパターンの画像データを記憶素子に記憶して、コード解析することにより、該座標情報および/または該コード情報を入力するドットパターン解析手段と
からなることを特徴とする情報入力システム。 - 前記所定の判定方法は、m行n列のピクセルで構成された記憶素子に記憶された撮像画像を行毎(i)に左端からから始まり右方向に、所定間隔(k)だけ離れたピクセル同士の明度(BL(i,j))の差分(ΔBL=BL(i,j+k)-BL(i,j))を順々に求め、その差分が所定の正・負の閾値を上回るか、もしくは下回るかにより判定する方法と、
該明度が周辺とは低く撮像されるドット部の判定では、該明度の差分が負の閾値を下回った場合に右側のピクセルをドットとして判定し、そのピクセルからドットが始まったと判定し、正の閾値を上回った場合に同じく右側のピクセルがドットでないことを判定し、その手前のピクセルまででドットが終わったと判定する方法と、
該明度が周辺とは高く撮像されるドット部の判定では、該明度の差分が正の閾値を上回った場合に右側のピクセルをドットとして判定し、そのピクセルからドットが始まったと判定し、負の閾値を下回った場合に同じく右側のピクセルがドットでないことを判定し、その手前のピクセルまででドットが終わったと判定する方法と、からなる判定方法であって、
前記ドットパターン解析手段は、該所定の判定方法により、前記媒体面か、前記グリッドシートに設けられた前記ドットパターンのいずれかであるかを判定して、該所定の判定方法によりコード解析することを特徴とする、請求項47記載の情報入力システム。 - 前記所定の判定方法は、前記撮像画像の所定の領域の明度を測定して、所定の閾値を上回っていれば、前記明度が周辺とは低く撮像されるドット部の判定方法を用い、
所定の閾値を下回っていれば、前記明度が周辺とは高く撮像されるドット部の判定方法を用いることを特徴とする、請求項48記載の情報入力システム。 - 一面側からの赤外線を反射すると共に、可視光を透過する特性を有する赤外線反射層と、
該赤外線反射層の一面側に設けられ、赤外線を拡散反射する特性を有する材料からなる、少なくとも一部、または複数の領域に座標情報および/またはコード情報が繰り返し定義されたドットパターンのドットが配置されたドットパターン層と、
該ドットパターン層の、該赤外線反射層と反対側に設けられ、赤外線および可視光を透過する特性を有する保護層と、が積層されている
ことを特徴する情報入力補助シート。 - それぞれの面へ入射した赤外線を反射すると共に、可視光を透過する特性を有する赤外線反射層と、
該赤外線反射層の両面に設けられ、赤外線を吸収する特性を有する材料からなる、前記ドットパターンのドットが配置されたドットパターン層と、
前記ドットパターン層のそれぞれのさらに外側に設けられ、それぞれの方向から入射した赤外線および可視光を透過する特性を有する保護層と、が積層されており、
前記ドットパターン層のそれぞれに配置された前記ドットパターンにパターン化された座標情報および/またはコード情報は、互いに同一であるかまたは互いに異なる
ことを特徴する情報入力補助シート。 - 前記書き込み領域は、任意の形状である
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記書き込み領域は、任意の形状である
ことを特徴とする請求項41に記載の手書き入力シート。 - 前記媒体は、情報ドットを配置するブロックの領域内に、ブロックの大きさと向きを形成できるように複数の基準点を設け、該基準点から定義される複数の仮想基準点を配置し、該仮想基準点からの距離と方向とで座標情報または、座標情報およびコード情報が定義される該情報ドットが配置され、該複数の仮想基準点における情報ドットの配置方向の組み合わせの内の、所定の情報ドットの配置方向の組み合わせで、少なくとも一部、または複数の領域に座標情報または、座標情報およびコード情報が繰り返し定義されるドットパターンが形成された書き込み領域を備え、
前記ドットパターン解析手段は、該所定の情報ドットの配置方向の組み合わせによって該書き込み領域であることを判別して手書き入力を処理する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記媒体は、情報ドットを配置するブロックの領域内に、ブロックの大きさと向きを形成できるように複数の基準点を設け、該基準点から定義される複数の仮想基準点を配置し、該仮想基準点からの距離と方向とで座標情報または、座標情報およびコード情報が定義される該情報ドットが配置され、該複数の仮想基準点における情報ドットの配置方向の組み合わせの内の、所定の情報ドットの配置方向の組み合わせで、少なくとも一部、または複数の領域に座標情報または、座標情報およびコード情報が繰り返し定義されるドットパターンが形成された書き込み領域を備え、
前記ドットパターン解析手段は、該所定の情報ドットの配置方向の組み合わせによって該書き込み領域であることを判別して手書き入力を処理する
ことを特徴とする請求項41に記載の手書き入力シート。 - 前記所定の情報ドットの配置方向の組み合わせは、前記複数の仮想基準点において、前記情報ドットが該仮想基準点から上下左右方向線上および斜め方向線上のいずれかに配置される配置方向の組み合わせの内の、所定の情報ドットの配置方向の組み合わせである
ことを特徴とする請求項54に記載の手書き入出力システム。 - 前記所定の情報ドットの配置方向の組み合わせは、前記複数の仮想基準点において、前記情報ドットが該仮想基準点から上下左右方向線上および斜め方向線上のいずれかに配置される配置方向の組み合わせの内の、所定の情報ドットの配置方向の組み合わせである
ことを特徴とする請求項55に記載の手書き入力シート。 - 前記コード情報には、書き込み領域であることを示す書き込みフラグが定義され、
前記ドットパターン解析手段は、該書き込みフラグによって該書き込み領域であることを判別して手書き入力を処理する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記コード情報には、前記書き込み領域を特定する特定情報および/または書き込み処理を意味する操作指示が定義され、
前記ドットパターン解析手段は、該特定情報および/または該操作指示であることを判別して手書き入出力を処理する
ことを特徴とする請求項1に記載の手書き入出力システム。 - 前記軌跡情報は、前記撮像手段の撮像中心の座標情報、または該撮像手段付近に備えられ
た前記指示用突起部または前記ペン先が前記書き込み領域面に触れる位置の座標情報と前記コード情報からなり、
前記ドットパターン解析手段により、前記ドットパターンに定義された座標情報を基に補間計算して求められる
ことを特徴とする請求項13または14に記載の手書き入出力システム。
Priority Applications (12)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RU2011125688/08A RU2536667C2 (ru) | 2008-11-25 | 2009-11-25 | Система рукописного ввода/вывода, лист рукописного ввода, система ввода информации, и лист, обеспечивающий ввод информации |
KR1020167001788A KR101686466B1 (ko) | 2008-11-25 | 2009-11-25 | 정보 입력 시스템, 정보 입력 보조 시트 |
CN200980147150.2A CN102224484B (zh) | 2008-11-25 | 2009-11-25 | 手写输入输出系统、手写输入薄板、信息输入系统、信息输入辅助薄板 |
KR1020167018424A KR101718678B1 (ko) | 2008-11-25 | 2009-11-25 | 수기 입출력 시스템, 수기 입력 시트, 정보 입력 시스템, 정보 입력 보조 시트 |
KR1020177011017A KR101895450B1 (ko) | 2008-11-25 | 2009-11-25 | 수기 입출력 시스템, 수기 입력 시트, 정보 입력 시스템, 정보 입력 보조 시트 |
CA2781652A CA2781652C (en) | 2008-11-25 | 2009-11-25 | Handwritten input/output system, handwriting input sheet, information input system, and information input assistance sheet |
KR1020117014490A KR101731849B1 (ko) | 2008-11-25 | 2009-11-25 | 수기 입출력 시스템, 수기 입력 시트, 정보 입력 시스템, 정보 입력 보조 시트 |
JP2010540364A JP5527215B2 (ja) | 2008-11-25 | 2009-11-25 | 手書き入出力システム、手書き入力シート、情報入力システム、情報入力補助シート |
EP09828834.3A EP2369454B1 (en) | 2008-11-25 | 2009-11-25 | Handwritten input/output system, handwriting input sheet, information input system, and information input assistance sheet |
US13/131,073 US9594439B2 (en) | 2008-11-25 | 2009-11-25 | Handwriting input/output system, handwriting input sheet, information input system, and information input assistance sheet |
BRPI0921964-1A BRPI0921964B1 (pt) | 2008-11-25 | 2009-11-25 | Sistema de entrada/saída de caligrafia |
US15/426,420 US20170242494A1 (en) | 2008-11-25 | 2017-02-07 | Handwriting input/output system, handwriting input sheet, information input system, and information input assistance sheet |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008300118A JP4385169B1 (ja) | 2008-11-25 | 2008-11-25 | 手書き入出力システム、手書き入力シート、情報入力システム、情報入力補助シート |
JP2008-300118 | 2008-11-25 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/131,073 A-371-Of-International US9594439B2 (en) | 2008-11-25 | 2009-11-25 | Handwriting input/output system, handwriting input sheet, information input system, and information input assistance sheet |
US15/426,420 Division US20170242494A1 (en) | 2008-11-25 | 2017-02-07 | Handwriting input/output system, handwriting input sheet, information input system, and information input assistance sheet |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2010061584A2 true WO2010061584A2 (ja) | 2010-06-03 |
WO2010061584A3 WO2010061584A3 (ja) | 2010-07-29 |
Family
ID=41549793
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/006332 WO2010061584A2 (ja) | 2008-11-25 | 2009-11-25 | 手書き入出力システム、手書き入力シート、情報入力システム、情報入力補助シート |
Country Status (10)
Country | Link |
---|---|
US (2) | US9594439B2 (ja) |
EP (1) | EP2369454B1 (ja) |
JP (2) | JP4385169B1 (ja) |
KR (4) | KR101731849B1 (ja) |
CN (3) | CN102224484B (ja) |
BR (1) | BRPI0921964B1 (ja) |
CA (1) | CA2781652C (ja) |
MY (1) | MY155871A (ja) |
RU (2) | RU2536667C2 (ja) |
WO (1) | WO2010061584A2 (ja) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013016080A (ja) * | 2011-07-05 | 2013-01-24 | Dainippon Printing Co Ltd | コンピュータ装置及びプログラム、並びにノート |
JP2013131066A (ja) * | 2011-12-21 | 2013-07-04 | Sharp Corp | 表示システムおよび表示プログラム |
JP2013232149A (ja) * | 2012-05-01 | 2013-11-14 | Dainippon Printing Co Ltd | コンピュータ装置、プログラム及び情報処理システム |
US20130321356A1 (en) * | 2012-06-01 | 2013-12-05 | New York University | Tracking movement of a writing instrument on a general surface |
WO2014088081A1 (ja) | 2012-12-05 | 2014-06-12 | Yoshida Kenji | 施設管理システムへの制御インターフェース |
JP2014514667A (ja) * | 2011-04-25 | 2014-06-19 | インテレクチュアル ディスカバリー カンパニー リミテッド | コードの記録されたフィルム、コードの記録されたフィルムを認識するに使用されるリーダー器、及びコードの記録されたフィルムが付着されたディスプレー装置を具備する電子機器 |
US9575576B2 (en) | 2014-03-12 | 2017-02-21 | Panasonic Intellectual Property Management Co., Ltd. | Display control system |
JPWO2017010469A1 (ja) * | 2015-07-10 | 2018-07-26 | 株式会社I・Pソリューションズ | 手書き装置および音声・手書き通信システム |
Families Citing this family (70)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6189812B2 (ja) * | 2010-04-13 | 2017-08-30 | グリッドマーク株式会社 | 手書き入力ボードおよび手書き入力ボードを用いた情報処理システム |
JP5888838B2 (ja) * | 2010-04-13 | 2016-03-22 | グリッドマーク株式会社 | 手書き入力ボードを用いた手書き入力システム、手書き入力ボード、スキャナーペンおよび手書き入力ボードを用いた情報処理システム |
US10133411B2 (en) * | 2010-06-11 | 2018-11-20 | Qualcomm Incorporated | Auto-correction for mobile receiver with pointing technology |
KR101158679B1 (ko) * | 2011-09-29 | 2012-06-22 | 주식회사 인프라웨어 | 직접입력 방식의 전자문서 상의 도형입력 방법, 그리고 직접입력 방식의 전자문서 상의 도형입력 프로그램을 기록한 컴퓨터로 판독가능한 기록매체 |
CN102522007B (zh) * | 2011-12-16 | 2015-02-18 | 方正国际软件有限公司 | 具有暗纹码图的印刷物的识别方法及系统 |
CN103186235B (zh) * | 2011-12-31 | 2015-11-25 | 北大方正集团有限公司 | 一种手写输入的处理方法及装置 |
KR101317838B1 (ko) * | 2012-01-31 | 2013-10-15 | 경북대학교 산학협력단 | 휴머노이드 로봇 암을 이용한 선 드로잉 장치 및 방법 |
JP6217058B2 (ja) * | 2012-05-09 | 2017-10-25 | セイコーエプソン株式会社 | 画像表示システム |
JP5553920B2 (ja) * | 2012-06-01 | 2014-07-23 | パナソニック株式会社 | 表示パネルおよび表示装置 |
JP6064211B2 (ja) | 2012-09-04 | 2017-01-25 | パナソニックIpマネジメント株式会社 | 手書き入力システム |
JPWO2014038118A1 (ja) * | 2012-09-07 | 2016-08-08 | パナソニックIpマネジメント株式会社 | 表示装置および表示制御システム |
JP2014067154A (ja) * | 2012-09-25 | 2014-04-17 | Toshiba Corp | 文書分類支援装置、方法及びプログラム |
US9036916B2 (en) * | 2012-09-27 | 2015-05-19 | Apple Inc. | Unique part identifiers |
US9921687B2 (en) * | 2012-10-02 | 2018-03-20 | Autodesk, Inc. | Always-available input through finger instrumentation |
US9830423B2 (en) * | 2013-03-13 | 2017-11-28 | Abhishek Biswas | Virtual communication platform for healthcare |
US11694797B2 (en) * | 2012-10-30 | 2023-07-04 | Neil S. Davey | Virtual healthcare communication platform |
JP5987726B2 (ja) * | 2013-02-22 | 2016-09-07 | 富士ゼロックス株式会社 | 情報処理装置及び情報処理プログラム |
JP2014232425A (ja) * | 2013-05-29 | 2014-12-11 | 株式会社リコー | 入力装置及び電子情報ボードシステム |
US11269431B2 (en) * | 2013-06-19 | 2022-03-08 | Nokia Technologies Oy | Electronic-scribed input |
KR101512082B1 (ko) * | 2013-08-30 | 2015-04-14 | 주식회사 네오랩컨버전스 | 전자펜의 모드 전환시스템 및 방법 |
CN103576935B (zh) * | 2013-11-01 | 2017-03-29 | 北京汉神科创文化发展有限公司 | 基于书写的人机交互辅助系统及方法 |
KR101770288B1 (ko) * | 2014-01-17 | 2017-08-22 | 주식회사 쏠리드에듀 | 전자칠판 시스템 및 그의 제어 방법 |
JP5948366B2 (ja) * | 2014-05-29 | 2016-07-06 | 京セラドキュメントソリューションズ株式会社 | 原稿読取装置及び画像形成装置 |
JP6117148B2 (ja) | 2014-06-18 | 2017-04-19 | 富士フイルム株式会社 | 光学部材および光学部材を有するディスプレイ |
JP6149006B2 (ja) | 2014-06-18 | 2017-06-14 | 富士フイルム株式会社 | 反射フィルムおよび反射フィルムを有するディスプレイ |
CN105630270B (zh) * | 2014-10-30 | 2019-03-29 | 联想(北京)有限公司 | 一种信息处理方法、装置和电子设备 |
JP6271395B2 (ja) * | 2014-10-31 | 2018-01-31 | 富士フイルム株式会社 | 情報処理装置および情報入力方法 |
KR101536758B1 (ko) * | 2014-11-13 | 2015-07-15 | 주식회사 엣지아이앤디 | 터치 스크린용 터치펜 |
JP2017535902A (ja) * | 2014-11-17 | 2017-11-30 | グリッドマーク株式会社 | 光学装置及び読取装置 |
JP6301242B2 (ja) | 2014-11-28 | 2018-03-28 | 富士フイルム株式会社 | 赤外線反射パターン形成体 |
JP2016134014A (ja) * | 2015-01-20 | 2016-07-25 | 株式会社リコー | 電子情報ボード装置、情報処理方法およびプログラム |
WO2016122626A1 (en) * | 2015-01-30 | 2016-08-04 | Hewlett-Packard Development Company, L.P. | Calibration of an input device to a display using the input device |
WO2016154660A1 (en) * | 2015-03-27 | 2016-10-06 | Inkerz Pty Ltd | Improved systems and methods for sharing physical writing actions |
US11500535B2 (en) * | 2015-10-29 | 2022-11-15 | Lenovo (Singapore) Pte. Ltd. | Two stroke quick input selection |
JP2017107488A (ja) * | 2015-12-11 | 2017-06-15 | ルネサスエレクトロニクス株式会社 | スキャンシステム、スキャン画像処理装置及びスキャン方法 |
US10063727B2 (en) * | 2015-12-29 | 2018-08-28 | Kabushiki Kaisha Toshiba | Marking apparatus and decoloring apparatus |
CN105654081A (zh) * | 2015-12-31 | 2016-06-08 | 田雪松 | 一种监考方法 |
US20170285931A1 (en) | 2016-03-29 | 2017-10-05 | Microsoft Technology Licensing, Llc | Operating visual user interface controls with ink commands |
WO2017175169A1 (en) * | 2016-04-08 | 2017-10-12 | Kolarov Peter | Qualified electronic signature device in the form of stylus and method of its use |
JP6857867B2 (ja) * | 2016-07-22 | 2021-04-14 | グリッドマーク株式会社 | 手書き入力シート |
TWI607365B (zh) * | 2016-10-07 | 2017-12-01 | Handwriting interactive display device and handwriting interactive reading device | |
CN106445252B (zh) * | 2016-11-23 | 2023-10-20 | 杭州碳诺电子科技有限公司 | 能避免连笔轨迹误识别和记录粗细的手写红外采集结构 |
CN106599219B (zh) * | 2016-11-25 | 2018-02-23 | 杭州日阅通讯有限公司 | 一种数字图书交互分享系统的实现方法 |
CN108268157B (zh) * | 2016-12-30 | 2024-03-15 | 北京大学 | 一种应用于大型显示屏幕或投影屏幕的设备定位方法及装置 |
US10838551B2 (en) * | 2017-02-08 | 2020-11-17 | Hewlett-Packard Development Company, L.P. | Calibration of displays |
CN108664149A (zh) * | 2017-04-02 | 2018-10-16 | 田雪松 | 一种信息记录方法、介质和信息记录设备 |
US10469274B2 (en) * | 2017-04-15 | 2019-11-05 | Microsoft Technology Licensing, Llc | Live ink presence for real-time collaboration |
CN107392195B (zh) * | 2017-07-25 | 2020-10-23 | 深圳市迪比科电子科技有限公司 | 一种智能书写系统 |
CN107358229A (zh) * | 2017-08-25 | 2017-11-17 | 马新禹 | 一种手写智能笔 |
JP6832822B2 (ja) * | 2017-09-29 | 2021-02-24 | シャープ株式会社 | 表示制御装置及びプログラム |
KR101886010B1 (ko) | 2017-12-28 | 2018-09-10 | 주식회사 네오랩컨버전스 | 전자기기 및 전자기기의 구동방법 |
CN110827596A (zh) * | 2018-08-08 | 2020-02-21 | 深圳市鹰硕技术有限公司 | 一种基于智能笔的答题方法 |
WO2020061737A1 (zh) * | 2018-09-25 | 2020-04-02 | 深圳柔显系统技术有限公司 | 书写控制方法及手写输入装置 |
JP2020098420A (ja) * | 2018-12-17 | 2020-06-25 | ソニー株式会社 | 画像処理装置、画像処理方法及びプログラム |
KR102060818B1 (ko) * | 2019-04-12 | 2020-02-17 | 최유준 | 수기 텍스트 및 수학식의 디지털 출력 방법 |
US20220197493A1 (en) * | 2019-05-06 | 2022-06-23 | Apple Inc. | Handwriting entry on an electronic device |
JP7392302B2 (ja) * | 2019-06-25 | 2023-12-06 | 株式会社リコー | 画像処理装置、画像形成装置および画像処理方法 |
KR102313056B1 (ko) * | 2019-11-11 | 2021-10-18 | 주식회사 윤디자인그룹 | 사용자 맞춤형 폰트의 생성에 이용되는 시트, 사용자 맞춤형 폰트를 생성하는 디바이스 및 방법 |
CN110889478A (zh) * | 2019-11-12 | 2020-03-17 | 深圳市光科全息技术有限公司 | 一种红外散射膜、其制备方法、红外散射商品及识别系统 |
CN111160285B (zh) * | 2019-12-31 | 2023-07-04 | 安博思华智能科技有限责任公司 | 一种获取板书信息的方法、装置、介质和电子设备 |
CN111274836A (zh) * | 2020-01-19 | 2020-06-12 | 深圳市锦上科技有限公司 | 一种手写板套装及系统 |
CN111309163A (zh) * | 2020-01-19 | 2020-06-19 | 深圳市锦上科技有限公司 | 一种智能笔及其使用方法、手写套装系统 |
KR102392764B1 (ko) * | 2020-07-07 | 2022-05-02 | 주식회사 윤디자인그룹 | 사용자 맞춤형 폰트의 생성에 이용되는 폰트 제작 시트, 스마트 펜 및 사용자 맞춤형 폰트를 생성하는 방법 |
JPWO2022034890A1 (ja) * | 2020-08-08 | 2022-02-17 | ||
CN113641256A (zh) * | 2021-08-06 | 2021-11-12 | 深圳腾千里科技有限公司 | 可识别书写角度的书写装置与识别书写角度的方法 |
KR20230139878A (ko) | 2022-03-24 | 2023-10-06 | 삼성디스플레이 주식회사 | 전자 펜, 그 구동 방법, 및 표시 장치 |
JP2023149286A (ja) * | 2022-03-31 | 2023-10-13 | 株式会社セガトイズ | 情報処理システム及び情報処理装置 |
CN116756588B (zh) * | 2023-08-14 | 2023-10-20 | 北京点聚信息技术有限公司 | 一种同屏手写输入的智能匹配方法 |
KR102653698B1 (ko) * | 2023-10-25 | 2024-04-02 | 스마일샤크 주식회사 | 점자패드와 어플리케이션의 연동 범용성 확보 시스템 |
CN117555443B (zh) * | 2024-01-12 | 2024-04-02 | 江苏纳帝电子科技有限公司 | 一种触摸屏书写检测分析方法 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003528387A (ja) | 2000-03-21 | 2003-09-24 | アノト・アクティエボラーク | データ入力のための構成 |
JP2005267565A (ja) | 2004-03-22 | 2005-09-29 | Nec Corp | ロッカー利用荷物授受プログラム、システム、および方法 |
JP3766678B2 (ja) | 2003-12-25 | 2006-04-12 | 健治 吉田 | ドットパターンを用いた情報入出力方法 |
JP3858051B1 (ja) | 2005-04-28 | 2006-12-13 | 健治 吉田 | ドットパターンを用いた情報入出力方法 |
JP3858052B1 (ja) | 2004-12-28 | 2006-12-13 | 健治 吉田 | ドットパターンを用いた情報入出力方法 |
JP2007230776A (ja) | 2006-02-06 | 2007-09-13 | Murata Mach Ltd | 画像形成装置 |
JP2008002188A (ja) | 2006-06-23 | 2008-01-10 | Auto Network Gijutsu Kenkyusho:Kk | パワーウィンドウ制御システム |
JP2009165163A (ja) | 2009-04-09 | 2009-07-23 | Fujitsu Ltd | 移動通信システム |
Family Cites Families (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3588451A (en) * | 1968-07-08 | 1971-06-28 | Ibm | Mark read apparatus using small raster |
JPS5224422A (en) | 1975-08-20 | 1977-02-23 | Fuji Electric Co Ltd | Tv camera for reading information pattern |
JPS61133486A (ja) | 1984-12-03 | 1986-06-20 | Toko Inc | コ−ド読取方法 |
JP2685450B2 (ja) | 1987-08-06 | 1997-12-03 | 日本電信電話株式会社 | オンライン手書き文字図形入力編集方法 |
US5361310A (en) * | 1990-01-19 | 1994-11-01 | Fujitsu Limited | Handwriting entry processing system using keyboard and mouse interfaces requiring no modification of an application program |
JPH06208654A (ja) * | 1993-01-08 | 1994-07-26 | Hitachi Software Eng Co Ltd | ペン入力図形編集システム |
JP3227906B2 (ja) * | 1993-05-31 | 2001-11-12 | 富士通株式会社 | 手書き入力情報処理装置 |
CN1072126C (zh) * | 1995-12-19 | 2001-10-03 | 株式会社百乐 | 圆珠笔替换笔芯及其制造方法 |
JP3985258B2 (ja) * | 1996-02-09 | 2007-10-03 | 株式会社セガ | 画像処理システム及びそのデータ入力装置 |
JPH1040388A (ja) * | 1996-07-26 | 1998-02-13 | Pilot Corp:The | 署名入力装置および署名照合システム |
TW386203B (en) * | 1998-08-07 | 2000-04-01 | Arphic Technology Co Ltd | Dot-matrix font generating system |
JP4244423B2 (ja) | 1999-01-28 | 2009-03-25 | 株式会社デンソー | 適正単語列推定装置 |
US6556970B1 (en) | 1999-01-28 | 2003-04-29 | Denso Corporation | Apparatus for determining appropriate series of words carrying information to be recognized |
US7088459B1 (en) * | 1999-05-25 | 2006-08-08 | Silverbrook Research Pty Ltd | Method and system for providing a copy of a printed page |
JP2000347686A (ja) * | 1999-06-03 | 2000-12-15 | Toshiba Tec Corp | 音声処理装置及びこの装置を使用したサービス品質向上支援装置並びに商品販売管理装置 |
JP2002182838A (ja) | 2000-12-14 | 2002-06-28 | Ricoh Co Ltd | 座標入力装置 |
US20020107885A1 (en) * | 2001-02-01 | 2002-08-08 | Advanced Digital Systems, Inc. | System, computer program product, and method for capturing and processing form data |
KR100446610B1 (ko) * | 2001-05-04 | 2004-09-04 | 삼성전자주식회사 | 펜형 컴퓨터 입력 장치 |
US6747599B2 (en) * | 2001-10-11 | 2004-06-08 | Mcewan Technologies, Llc | Radiolocation system having writing pen application |
US6959866B2 (en) | 2002-05-30 | 2005-11-01 | Ricoh Company, Ltd. | 2-Dimensional code pattern, 2-dimensional code pattern supporting medium, 2-dimensional code pattern generating method, and 2-dimensional code reading apparatus and method |
JP4198392B2 (ja) * | 2002-05-30 | 2008-12-17 | 株式会社リコー | 2次元コード読取装置、画像入力装置、2次元コード読み取り方法、画像入力方法、そのプログラム、及びそのプログラムを記録した記録媒体 |
DE60328116D1 (de) * | 2002-09-26 | 2009-08-06 | Kenji Yoshida | Informationswiedergabe-i/o-verfahren mit punktmuster und informationswiedergabeeinrichtung |
JP4231947B2 (ja) | 2002-09-26 | 2009-03-04 | 健治 吉田 | 媒体上に形成されたアイコン |
JP2004139534A (ja) | 2002-10-21 | 2004-05-13 | Kokuyo Co Ltd | 文書作成システム、文書作成用冊子、文書作成方法 |
JP2004246433A (ja) | 2003-02-12 | 2004-09-02 | Hitachi Ltd | データ入力システム |
JP2004302608A (ja) | 2003-03-28 | 2004-10-28 | Dainippon Printing Co Ltd | 電子ペン用情報処理装置 |
US7418128B2 (en) * | 2003-07-31 | 2008-08-26 | Microsoft Corporation | Elastic distortions for automatic generation of labeled data |
RU2328030C2 (ru) * | 2003-08-21 | 2008-06-27 | Майкрософт Корпорейшн | Управление фокусом с использованием точек, соответствующих положению пера над поверхностью цифрового преобразователя |
JP2005099939A (ja) | 2003-09-22 | 2005-04-14 | Nidec Copal Corp | 刻印読取り装置 |
US20070033154A1 (en) * | 2003-10-29 | 2007-02-08 | Trainum Michael W | System and method managing documents |
DE602004019970D1 (de) * | 2003-12-15 | 2009-04-23 | Anoto Ab | Optisches system, analysesystem und modulare einheit für einen elektronischen stift |
EP1569140A3 (en) * | 2004-01-30 | 2006-10-25 | Hewlett-Packard Development Company, L.P. | Apparatus, methods and software for associating electronic and physical documents |
US7274931B2 (en) * | 2004-02-23 | 2007-09-25 | Harris Arlene J | Systems and methods for enhancing the provisioning and functionality of wireless instruments |
US7831933B2 (en) * | 2004-03-17 | 2010-11-09 | Leapfrog Enterprises, Inc. | Method and system for implementing a user interface for a device employing written graphical elements |
JP2005293239A (ja) * | 2004-03-31 | 2005-10-20 | Fujitsu Ltd | 情報共有装置及び情報共有方法 |
JP2005346415A (ja) * | 2004-06-03 | 2005-12-15 | Hitachi Ltd | 電子ペンを用いた編集システム、編集方法およびそのプログラム |
US7698640B2 (en) | 2004-08-04 | 2010-04-13 | Leapfrog Enterprises, Inc. | User interactive journal |
US20060139338A1 (en) | 2004-12-16 | 2006-06-29 | Robrecht Michael J | Transparent optical digitizer |
WO2006107103A1 (ja) | 2005-04-01 | 2006-10-12 | Kenji Yoshida | 情報再生装置及び情報入力装置 |
JP4569397B2 (ja) * | 2005-06-15 | 2010-10-27 | 富士ゼロックス株式会社 | 電子文書管理システム、画像形成装置、電子文書管理方法およびプログラム |
JP4810918B2 (ja) | 2005-08-01 | 2011-11-09 | 富士ゼロックス株式会社 | コードパターン画像生成装置及び方法、コードパターン画像読取装置及び方法、及びコードパターン画像媒体 |
CN100446548C (zh) * | 2005-09-02 | 2008-12-24 | 鸿富锦精密工业(深圳)有限公司 | 遥控器及应用该遥控器的数字信息系统 |
JP3830956B1 (ja) | 2005-09-14 | 2006-10-11 | 健治 吉田 | 情報出力装置 |
JP2007079943A (ja) * | 2005-09-14 | 2007-03-29 | Toshiba Corp | 文字読取プログラム、文字読取方法および文字読取装置 |
JP2007109118A (ja) | 2005-10-17 | 2007-04-26 | Hitachi Ltd | 入力指示処理装置および入力指示処理プログラム |
WO2007089021A1 (ja) * | 2006-01-31 | 2007-08-09 | Kenji Yoshida | 画像処理方法 |
JP3879106B1 (ja) | 2006-02-13 | 2007-02-07 | 健治 吉田 | 情報出力装置 |
RU2457532C2 (ru) | 2006-03-10 | 2012-07-27 | Кенджи Йошида | Система обработки ввода для устройства обработки информации |
CN101401059B (zh) | 2006-03-10 | 2012-08-15 | 吉田健治 | 信息处理装置的输入处理系统 |
JP4042065B1 (ja) * | 2006-03-10 | 2008-02-06 | 健治 吉田 | 情報処理装置への入力処理システム |
JP4188388B2 (ja) | 2006-06-08 | 2008-11-26 | 株式会社東芝 | 帳票処理システム、帳票処理方法、プログラム、および光学読み取り帳票 |
JP2008021168A (ja) | 2006-07-13 | 2008-01-31 | Fuji Xerox Co Ltd | 筆跡検出シートおよび手書きシステム |
JP4203517B2 (ja) | 2006-08-22 | 2009-01-07 | 健治 吉田 | 情報出力装置 |
EP2074553A4 (en) | 2006-10-17 | 2011-11-09 | Silverbrook Res Pty Ltd | USER INTERACTION FOR A CLICK FACILITATOR TO COLLECT ADVERTISING CLICKS |
CN201018625Y (zh) * | 2006-12-07 | 2008-02-06 | 康佳集团股份有限公司 | 一种具有手写板功能的手机 |
JP2008165385A (ja) * | 2006-12-27 | 2008-07-17 | Dainippon Printing Co Ltd | 赤外線反射パターン印刷透明シート |
US20080192004A1 (en) | 2007-02-08 | 2008-08-14 | Silverbrook Research Pty Ltd | System for scrolling page displayed on a display device |
EP2148238A4 (en) * | 2007-05-18 | 2012-04-25 | Sega Kk Dba Sega Corp | LIQUID CRYSTAL DISPLAY DEVICE WITH DIGITIZER FUNCTION, ELECTRONIC INFORMATION PROCESSING DEVICE AND PLAYER |
JP4821716B2 (ja) | 2007-06-27 | 2011-11-24 | 富士ゼロックス株式会社 | 電子筆記具、キャップ、コンピュータシステム |
JP4129841B1 (ja) | 2007-08-09 | 2008-08-06 | 健治 吉田 | 情報入力補助シート、情報入力補助シートを用いた情報処理システムおよび情報入力補助シートを用いた印刷関連情報出力システム |
CN100478855C (zh) * | 2007-09-07 | 2009-04-15 | 中国科学院计算技术研究所 | 一种盲文计算机点字输入系统和装置以及方法 |
JP2009187235A (ja) | 2008-02-06 | 2009-08-20 | Dainippon Printing Co Ltd | 電子ペン及びそれに用いられるプログラム |
JP4308306B2 (ja) * | 2008-05-14 | 2009-08-05 | 健治 吉田 | 印刷出力制御手段 |
US8306576B2 (en) * | 2008-06-27 | 2012-11-06 | Lg Electronics Inc. | Mobile terminal capable of providing haptic effect and method of controlling the mobile terminal |
US8452086B2 (en) * | 2009-07-10 | 2013-05-28 | Palo Alto Research Center Incorporated | System and user interface for machine-assisted human labeling of pixels in an image |
-
2008
- 2008-11-25 JP JP2008300118A patent/JP4385169B1/ja active Active
-
2009
- 2009-11-25 KR KR1020117014490A patent/KR101731849B1/ko active IP Right Grant
- 2009-11-25 CN CN200980147150.2A patent/CN102224484B/zh active Active
- 2009-11-25 JP JP2010540364A patent/JP5527215B2/ja active Active
- 2009-11-25 CA CA2781652A patent/CA2781652C/en active Active
- 2009-11-25 WO PCT/JP2009/006332 patent/WO2010061584A2/ja active Application Filing
- 2009-11-25 KR KR1020167001788A patent/KR101686466B1/ko active IP Right Grant
- 2009-11-25 EP EP09828834.3A patent/EP2369454B1/en not_active Not-in-force
- 2009-11-25 RU RU2011125688/08A patent/RU2536667C2/ru active
- 2009-11-25 CN CN201510428004.4A patent/CN105117047B/zh not_active Expired - Fee Related
- 2009-11-25 KR KR1020167018424A patent/KR101718678B1/ko active IP Right Grant
- 2009-11-25 MY MYPI2011002369A patent/MY155871A/en unknown
- 2009-11-25 US US13/131,073 patent/US9594439B2/en active Active
- 2009-11-25 BR BRPI0921964-1A patent/BRPI0921964B1/pt not_active IP Right Cessation
- 2009-11-25 KR KR1020177011017A patent/KR101895450B1/ko active IP Right Grant
- 2009-11-25 CN CN201510427902.8A patent/CN105094386A/zh active Pending
-
2014
- 2014-10-16 RU RU2014141729A patent/RU2669717C2/ru active
-
2017
- 2017-02-07 US US15/426,420 patent/US20170242494A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003528387A (ja) | 2000-03-21 | 2003-09-24 | アノト・アクティエボラーク | データ入力のための構成 |
JP3766678B2 (ja) | 2003-12-25 | 2006-04-12 | 健治 吉田 | ドットパターンを用いた情報入出力方法 |
JP2005267565A (ja) | 2004-03-22 | 2005-09-29 | Nec Corp | ロッカー利用荷物授受プログラム、システム、および方法 |
JP3858052B1 (ja) | 2004-12-28 | 2006-12-13 | 健治 吉田 | ドットパターンを用いた情報入出力方法 |
JP3858051B1 (ja) | 2005-04-28 | 2006-12-13 | 健治 吉田 | ドットパターンを用いた情報入出力方法 |
JP2007230776A (ja) | 2006-02-06 | 2007-09-13 | Murata Mach Ltd | 画像形成装置 |
JP2008002188A (ja) | 2006-06-23 | 2008-01-10 | Auto Network Gijutsu Kenkyusho:Kk | パワーウィンドウ制御システム |
JP2009165163A (ja) | 2009-04-09 | 2009-07-23 | Fujitsu Ltd | 移動通信システム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2369454A4 |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014514667A (ja) * | 2011-04-25 | 2014-06-19 | インテレクチュアル ディスカバリー カンパニー リミテッド | コードの記録されたフィルム、コードの記録されたフィルムを認識するに使用されるリーダー器、及びコードの記録されたフィルムが付着されたディスプレー装置を具備する電子機器 |
JP2013016080A (ja) * | 2011-07-05 | 2013-01-24 | Dainippon Printing Co Ltd | コンピュータ装置及びプログラム、並びにノート |
JP2013131066A (ja) * | 2011-12-21 | 2013-07-04 | Sharp Corp | 表示システムおよび表示プログラム |
JP2013232149A (ja) * | 2012-05-01 | 2013-11-14 | Dainippon Printing Co Ltd | コンピュータ装置、プログラム及び情報処理システム |
US20130321356A1 (en) * | 2012-06-01 | 2013-12-05 | New York University | Tracking movement of a writing instrument on a general surface |
US9354725B2 (en) * | 2012-06-01 | 2016-05-31 | New York University | Tracking movement of a writing instrument on a general surface |
WO2014088081A1 (ja) | 2012-12-05 | 2014-06-12 | Yoshida Kenji | 施設管理システムへの制御インターフェース |
US9575576B2 (en) | 2014-03-12 | 2017-02-21 | Panasonic Intellectual Property Management Co., Ltd. | Display control system |
JPWO2017010469A1 (ja) * | 2015-07-10 | 2018-07-26 | 株式会社I・Pソリューションズ | 手書き装置および音声・手書き通信システム |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5527215B2 (ja) | 手書き入出力システム、手書き入力シート、情報入力システム、情報入力補助シート | |
JP4243642B2 (ja) | キャリブレーション方法および情報入力補助シート | |
JP5848230B2 (ja) | 手書き入出力システム、手書き入力シート、情報入力システム、情報入力補助シート | |
JP6197290B2 (ja) | コンピュータ装置、再生システム、及びプログラム | |
WO2012008469A1 (ja) | ストリームドットを用いた情報入力補助シートおよび情報処理システム | |
JP5544609B2 (ja) | 手書き入出力システム | |
JP5358759B2 (ja) | 光学読み取り装置 | |
JP6056263B2 (ja) | 端末装置、電子ペンシステム及びプログラム | |
JP2012022418A (ja) | ストリームドットを用いた手書き入力シートおよび手書き入出力システム | |
JP6267074B2 (ja) | 手書き入出力システムおよび光学読取装置 | |
JP2014220006A (ja) | 手書き入出力システムおよび光学読取装置 | |
JP6857867B2 (ja) | 手書き入力シート | |
JP2019036324A (ja) | 手書き入力シート | |
JP2014157621A (ja) | 手書き入出力システム | |
JP6244647B2 (ja) | コンピュータ装置及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980147150.2 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09828834 Country of ref document: EP Kind code of ref document: A2 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010540364 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1093/MUMNP/2011 Country of ref document: IN |
|
REEP | Request for entry into the european phase |
Ref document number: 2009828834 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009828834 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 20117014490 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011125688 Country of ref document: RU |
|
ENP | Entry into the national phase |
Ref document number: 2781652 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13131073 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: PI0921964 Country of ref document: BR Kind code of ref document: A2 Effective date: 20110526 |