WO2011093458A2 - 入出力装置、情報入出力システム - Google Patents
入出力装置、情報入出力システム Download PDFInfo
- Publication number
- WO2011093458A2 WO2011093458A2 PCT/JP2011/051774 JP2011051774W WO2011093458A2 WO 2011093458 A2 WO2011093458 A2 WO 2011093458A2 JP 2011051774 W JP2011051774 W JP 2011051774W WO 2011093458 A2 WO2011093458 A2 WO 2011093458A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- input
- content data
- output
- code
- dot pattern
- Prior art date
Links
- 230000010365 information processing Effects 0.000 claims abstract description 261
- 238000012545 processing Methods 0.000 claims abstract description 136
- 230000006870 function Effects 0.000 claims abstract description 67
- 238000011022 operating instruction Methods 0.000 claims abstract description 3
- 238000003860 storage Methods 0.000 claims description 210
- 230000003287 optical effect Effects 0.000 claims description 163
- 238000000034 method Methods 0.000 claims description 85
- 230000008859 change Effects 0.000 claims description 15
- 238000009434 installation Methods 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 abstract description 2
- 230000001419 dependent effect Effects 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 28
- 238000010586 diagram Methods 0.000 description 28
- 230000001174 ascending effect Effects 0.000 description 13
- 239000000463 material Substances 0.000 description 13
- 230000008569 process Effects 0.000 description 13
- 238000007639 printing Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 7
- 238000003825 pressing Methods 0.000 description 7
- 238000009826 distribution Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 239000004973 liquid crystal related substance Substances 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 3
- 230000001678 irradiating effect Effects 0.000 description 3
- 235000013372 meat Nutrition 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 229920001690 polydopamine Polymers 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 239000013256 coordination polymer Substances 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 239000011347 resin Substances 0.000 description 2
- 229920005989 resin Polymers 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 235000010724 Wisteria floribunda Nutrition 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000009751 slip forming Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
- G06F3/0321—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
Definitions
- the present invention relates to an input / output device and an information input / output system using a dot pattern capable of inputting / outputting various information corresponding to the dot pattern by optically reading dot pattern information formed on a medium. Is.
- code information given in advance to the storage means and information corresponding to the XY coordinates are registered.
- a method has been proposed in which various information is output and a program is executed by searching from code information or XY coordinates read by an optical reading means.
- the reading apparatus (Patent Documents 1 and 2) related to the dot pattern technique proposed by these inventors has a function as an input device depending on the application of the information processing apparatus in a state connected to the information processing apparatus.
- the reading apparatus since it has only one of the functions of a speaking pen that reproduces sound corresponding to code information and XY coordinates, for example, it can be read in a state where it cannot be connected to the information processing apparatus.
- code information and XY coordinates are transmitted to the information processing device, and output by the information processing device having a high processing speed and independent output means (for example, high resolution) Viewing, printing, and outputting via the Internet)
- a high processing speed and independent output means for example, high resolution
- the present invention has been made in view of the above points, and is used alone in a state where it is not connected to an information processing apparatus (for example, a voice recorder or a digital camera), and in a state where it is connected to an information processing apparatus.
- An information processing apparatus for example, a voice recorder or a digital camera
- a dot pattern adapted to the situation in which an input / output device is used by transmitting code values and / or coordinate values or operation commands to an information processing device as an input device and outputting corresponding information Realizing technology is a technical issue.
- An input / output device includes a link table for associating and registering code values and / or coordinate values with content data and / or operation commands, storage means for registering the content data and / or operation commands, and a medium surface
- An optical reading means for reading the dot pattern formed on the image forming apparatus, a processing means for analyzing the dot pattern from the image information of the dot pattern read by the optical reading means, and converting it into a code value and / or a coordinate value;
- a connection means for connecting to the apparatus wirelessly or by wire; a connection recognition means for recognizing the presence or absence of connection to the information processing apparatus; and a code value converted by the processing means after the dot pattern is read by the optical reading means, and Output that reads out and outputs the content data associated with coordinate values from the storage means
- a control means for controlling the operation by the optical reading means, the processing means, the connection means, the connection recognition means, the output means, and / or the operation according to the operation command.
- the control means switches operation depending on whether or not the connection recognition means recognizes the connection between the connection means and the information processing apparatus, and the connection recognition means establishes a connection between the connection means and the information processing apparatus.
- the code value and / or coordinate value converted by the processing means or the operation command registered in association with the code value and / or coordinate value is transmitted to the information processing apparatus through the connection means.
- the connection recognition unit does not recognize the connection between the connection unit and the information processing apparatus, the content data is output from the output unit or the operation according to the operation command is controlled. And wherein the door.
- independent use enables independent input / output of information, but depends on the software of the information processing device when connected to the information processing device (including personal computers, PDAs, mobile phones, etc., the same shall apply hereinafter). It is possible to realize a highly convenient input / output device that exhibits the function as an input device.
- the information processing apparatus can further transmit control information to the input / output apparatus to control the input / output apparatus.
- a wireless communication connection such as infrared communication, BLUETOOTH (registered trademark), ZigBee, or weak radio waves.
- connection recognition means may not recognize or the input / output device and / or the information processing apparatus may When there is no connection request or when the connection is rejected, the control means does not switch the operation.
- the control means when the connection recognition means recognizes the connection between the connection means and the information processing apparatus, the code value converted by the processing means and The code value and / or the coordinate value converted by the processing means is transmitted to the information processing apparatus through the connection means according to the operation command registered in the link table in relation to the coordinate value, or 2.
- the input / output device according to claim 1, wherein the operation is switched according to whether content data is output from the output means or an operation according to the operation command is controlled.
- an I / O device with a separate button can be provided by providing data that records operation instructions for switching processing on the WEB, or distributing manual books and paper controllers for easy switching. This makes it possible to realize and provide a single input / output device capable of switching various processes without newly manufacturing and selling.
- a specific example is an input / output device that reads a web icon on the paper controller of a paper controller while listening to a voice commentary on a speaking pen (stand-alone voice playback) compatible printing medium such as teaching materials and how-to books. After switching the operation, the dot pattern superimposed and printed on the URL on the print medium surface is read, and the code value and / or coordinate value automatically converted from the dot code is transmitted to the information processing apparatus. The corresponding WEB can be accessed. Of course, a WEB icon may be provided on the print medium surface without using the paper controller.
- the dot code is information defined by the distance and direction of the information dot from the virtual reference point, that is, an enumeration of numbers expressed in binary numbers, and defines code values and / or coordinate values, parity check, etc. Assigned to.
- the dot pattern is read from the URL on the print medium surface, the switching code is associated with the converted code value and / or coordinate value, the operation of the input / output device is switched, and the converted code value and / or coordinate is converted.
- the value may be transmitted to the information processing apparatus. Then, it is not necessary to provide a switching icon.
- the end of switching may be switched to a speaking pen that is used alone by using a switching or switching end icon again, or a dot pattern corresponding to a speaking pen (sound reproduction) of a printing medium may be read and switched automatically.
- the control means when the connection recognition means recognizes the connection between the connection means and the information processing apparatus, the code value converted by the processing means and The operation is switched depending on whether the coordinate value is registered in the link table in association with the content data and / or the operation command. If the coordinate value is registered, the content data is output as the output Output from the means or control the operation according to the operation command, and if not registered, the code value and / or coordinate value converted by the processing means is transmitted to the information processing apparatus through the connection means.
- the input / output device according to claim 1.
- switching between the function as an input / output device that can be used as a stand-alone, which is a feature of the present invention, and the function as an input / output device depending on the application on the PC side is performed by various methods and conditions. This operation can be performed when the code value and the content data are not registered in the link table.
- the input / output device when connected to the information processing apparatus, if there is no need to transmit an operation command for outputting a code value and / or coordinate value or corresponding content data to the information processing apparatus, the input / output device If the code value and / or the coordinate value is not registered in the link table in association with the content data and / or the operation command, the code value and / or the coordinate value Can be transmitted to the information processing apparatus to refer to the link table in the information processing apparatus for content output, WEB access, etc., and at this time, the link table and / or content data can be transmitted from the information processing apparatus. It can also be downloaded to the storage means of the input / output device and output by the input / output device.
- the download instruction may be automatically performed, and at that time, a message indicating whether the download is possible is output from the input / output device or the information processing device, and the operation of the execution / stop button and the download button provided in the input / output device is operated.
- the execution / cancellation icon or the download icon may be read.
- the link table is not registered in the storage means of the input / output device.
- the content data itself when registered, only the table is referred to by the information processing device, and the output of the corresponding content data is input / output. It can also be done with a device.
- the output of the content data registered in the storage means of the information processing apparatus is not limited to the output means provided in the information processing apparatus or the input / output device, but may be performed using other output means connected to the information processing apparatus. Good.
- the control means relates to the code value and / or the coordinate value when the connection recognition means recognizes the connection between the connection means and the information processing apparatus.
- the operation is switched depending on whether or not the content data attached and registered in the link table is registered in the storage means.
- the content data is sent from the output means.
- the code value and / or the coordinate value converted by the processing means or the operation command for outputting the content data is sent through the connection means to the information. Transmitting to a processing device and outputting the content data registered in the storage means of the information processing device An input-output device according to claim 1.
- the input / output device when connected to the information processing device, only the input / output device is required when it is not necessary to transmit an operation command for outputting a code value and / or coordinate value or corresponding content data to the information processing device.
- content data is related and registered, but if the content data amount is large and cannot be registered in the storage means of the input / output device, or if the content of the data changes, the content
- the content may be transmitted to the information processing device and output from the information processing device. At that time, it is also possible to download the content data from the information processing device to the storage means of the input / output device and output it by the input / output device.
- the download instruction may be automatically performed, and at that time, a message indicating whether the download is possible is output from the input / output device or the information processing device, and the operation of the execution / stop button and the download button provided in the input / output device is operated.
- the execution / cancellation icon or the download icon may be read. According to the present invention, since the processing is automatically performed, it is possible to minimize the number of times of connection with the information processing apparatus, and at the same time, the storage means on the information processing apparatus side capable of registering a large amount of content data is effectively used. There is an effect that it can be used.
- the output of the content data registered in the storage means of the information processing apparatus is not limited to the output means provided in the information processing apparatus or the input / output device, but may be performed using other output means connected to the information processing apparatus. Good.
- the input / output device further includes a link button, and the control unit operates the link button to operate at least one predetermined dot pattern by the optical reading unit.
- the code value and / or coordinate value converted by the processing means is associated with the predetermined content data, and the relationship between the code value and / or coordinate value and the content data is stored in the storage means.
- the link table is referred to and the corresponding content data is read from the storage means and output by the output means.
- a new link table is created and registered so that the same content is output from a plurality of dot patterns.
- the existing link table may be overwritten and registered, and the content data may be output only from the dot pattern read immediately before.
- content data can be related to any position according to the demands of the user of the input / output device, and audio information can be used in various media including system notebooks, storytelling picture books, English conversation materials, and seal cards. Various information can be defined.
- an alarm and / or coordinate value is defined based on a code value and / or coordinate value defined in a predetermined range of dot codes. It is possible to call attention by a predetermined method such as voice, light, or character, or to process it as an error. Furthermore, it is also possible to link a plurality of content data to one code value or coordinate value, select content data to be output from the plurality of content data by a predetermined method, and output in a predetermined order.
- the “predetermined dot pattern” refers to a dot pattern for the user to associate and register content data in the link mode, and if characters or figures suggested to the user are printed in a superimposed manner It is easier to understand and can improve convenience.
- a predetermined dot pattern is displayed by the optical reading unit, and after the link button is pressed and released, the predetermined dot pattern is output by the optical reading unit. May be read, or may be read while pressing the link button.
- the control means when the control means reads the link dot pattern formed in a predetermined area on the surface of the medium by the optical reading means, the code value converted by the processing means. And / or an operation command registered in association with the coordinate value to switch the operation for associating and registering the code value and / or coordinate value corresponding to the predetermined dot pattern and the content data, and for the link
- the predetermined dot pattern is read after reading the dot pattern
- the code value and / or coordinate value converted by the processing means is associated with the predetermined content data
- the code value and / or coordinate value The content data association is registered in the link table of the storage means, and the optical reading means 2.
- the input / output device wherein when the predetermined dot pattern is read again, the link table is referred to and the corresponding content data is read from the storage means and output by the output means. It is.
- the “link dot pattern” refers to a dot pattern provided for a user to link content data to a predetermined dot pattern on the medium surface on which the dot pattern is printed and formed.
- characters, figures, symbols, and the like are visually printed in the vicinity or in a superimposed manner so that the user can easily understand.
- the code value and / or coordinate value corresponding to the link dot pattern is registered in the link table in association with an operation command for switching the input / output device to a link mode described later.
- the “predetermined dot pattern” refers to a dot pattern for the user to associate and register content data in the link mode. In many cases, characters, figures, etc. that suggest it to the user are printed in a superimposed manner. If it is done, the convenience can be improved more easily.
- the processing unit converts the read pattern.
- Switching operation for associating and registering the code value and / or coordinate value corresponding to a predetermined dot pattern and the content data by an operation instruction registered in association with the code value and / or coordinate value,
- the code value and / or coordinate value converted by the processing means and the predetermined content data are A relationship between the code value and / or the coordinate value and the content data.
- the code value and / or the coordinate value and the content data are registered in association with each other.
- the link table is referred to, and the corresponding content data is read from the storage means and output by the output means.
- multi-link start / end dot pattern means that the user can link a plurality of identical content data to a predetermined dot pattern on the medium surface on which the dot pattern is printed and formed. This is an area that is provided, and in many cases, characters, figures, symbols, etc. are visually printed in the vicinity or superimposed so that the user can easily understand.
- the code value and / or coordinate value corresponding to this multilink start / end dot pattern include an operation command for switching the input / output device to the multilink mode and an operation command for switching from the multilink mode to the normal input / output mode. It will be related and registered in the link table.
- the multi-link mode is a mode for registering the same content data in relation to a plurality of dot patterns read during the mode. During this mode, until the multi-link start / end dot pattern is read again, Even when a predetermined dot pattern associated with the content data is read, the link is continued without being output.
- the input / output device further includes input means for inputting content data, and the control means operates an input start / end button further provided in the input / output device.
- content input by the input unit is started and ended by reading the input start / end dot pattern formed in a predetermined area on the medium surface by the optical reading unit.
- control means reads the input start / end dot pattern formed in a predetermined area on the surface of the medium by the operation of the input start / end button further provided in the input / output device or the optical reading means, and performs the input.
- the start of content data input by the input means is controlled by the operation command registered in association with the code value and / or coordinate value defined in the dot pattern for the input, and the input start further provided in the input / output device is similarly provided
- the end of content data input is controlled by re-operation of the end button or by reading the input start / end dot pattern again.
- the “input start / end dot pattern” refers to a dot pattern used to start / end input by the input means. Alternatively, it is printed in the vicinity of the visible information indicating the end or superimposed on the information.
- the code value and / or coordinate value corresponding to this input start / end dot pattern is associated with an operation command for switching the input / output device to the input mode and an operation command for switching from the input mode to the normal mode. Will be registered.
- either the input start dot pattern or the input end dot pattern may be toggled so that the input start and end can be alternately operated every time one dot pattern is read.
- the input / output device of the present invention when the control unit reads the predetermined dot pattern by the optical reading unit while inputting the content data by the input unit, the input of the content data is terminated.
- the content data is registered in the storage means, the code value and / or coordinate value converted by the processing means is related to the content data, and the code value and / or coordinate value and the content data are related to the storage
- the predetermined dot pattern is read again by the optical reading means
- the corresponding content data is read from the storage means and output by the output means.
- the input / output device as a video camera, digital camera, mobile phone, recording device, etc., and associate the input video / image data or audio data with the touched dot pattern.
- the output means to output the moving image / image data and audio data registered in association with each other. Since the dot pattern is printed on the media, you can write the features of the shooting location directly with a pencil, etc., and write notes, so you can input and output video / image data and audio data while having the convenience of a paper medium.
- the input start / end button or the input start / end dot pattern is used to start input of content data, and a predetermined dot pattern touched during input is used to end input. That is, when a predetermined dot pattern is read while input by the input means is continued, the control means ends the input (performed by a program), and the code value and / or coordinates corresponding to the dot pattern
- the value and the input content data such as audio and video are related and registered in the link table.
- the predetermined dot pattern is read, the input by the input means is terminated, thereby eliminating the trouble of terminating the input of the content data, and quickly and intuitively associating the content data input by the user with the dot pattern at which position. It is possible to define information while confirming whether it has been registered.
- the control means is formed in a predetermined area on the surface of the medium by operating a division button further provided in the input / output device or by the optical reading means during the input of the content data.
- a division button further provided in the input / output device or by the optical reading means during the input of the content data.
- the input is started and then the divided dot pattern formed in a predetermined area on the surface of the medium by the operation of the division button or the optical reading means.
- Content data up to the point of time of reading is divided and registered in the storage means as first content data, and then the division button is operated at least once or more during the input of the content data.
- recording can be arbitrarily divided and registered with predetermined meanings such as the theme, time, and various objects without interruption.
- the content data can be related to the code value and / or coordinate value defined in the dot pattern and divided and registered, thereby facilitating cueing and continuous output.
- control means divides the first and the N-th content data registered in the division together with the first file name indicating each of the first to N-th content data.
- a second file name indicating the registered content data is registered in the storage means.
- the code value and / or coordinate value and the content data input in a divided manner are stored in the content file without being registered in the link table.
- the content file name that has been read can be read and used as instruction information indicating the location of the content data to be output after the desired content data is output. Therefore, even when content data is continuously output with the above configuration, at least one set of content data registered in association with the code value and / or coordinate value in the link table registered in the storage means is provided. Also good.
- the second file name indicating the content data to be registered next can be arbitrarily related separately from the division / registration. Further, in addition to the first file name indicating the content data and the second file name indicating the content data to be registered next, a third file name indicating the previously registered content data is registered in the reverse order. It is also possible to play back continuously.
- control means may be divided into code values and / or coordinate values defined in predetermined N + 1 dot patterns converted by the processing means by a predetermined method.
- the first to (N + 1) th content data are related, the code value and / or coordinate value and the divided content data are registered in the link table of the storage means, and the optical reading means
- the dot pattern of i is read, the corresponding content data from the i-th to the (N + 1) are read out from the storage means by a predetermined method and are continuously output by the output means by referring to the link table
- the input / output device 10
- the content data may be continuously reproduced from the first content data to the predetermined content data, or may be continuously reproduced in the reverse order. is there.
- the control means operates a division / link button further provided on the input / output apparatus during the input of the content data, or the surface of the medium by the optical reading means.
- the division / link button operation or the Content data up to the time when the division / link dot pattern formed in a predetermined area on the surface of the medium is read by the optical reading means is divided and registered in the storage means as first content data, and The code value and / or coordinate value defined in the first predetermined dot pattern converted by the processing means and the registered first container And the code value and / or coordinate value and the first content data are registered in the link table of the storage means, and at least once during the input of the content data.
- the division / link button is operated or the division / link dot pattern formed in a predetermined area on the surface of the medium is read by the optical reading unit, and the i-th predetermined dot pattern is read by the optical reading unit.
- N is a natural number
- i-1 The content data up to the time when the second division is operated is divided and registered in the storage means as the i-th content data, and the i-th predetermined dot pattern is the processing procedure.
- the i-th code value and / or coordinate value converted by the above-described relationship is associated with the registered i-th content data, and the i-th code value and / or coordinate value is associated with the i-th content data.
- the link table of the storage means and finally, by operating the input start / end button or reading the input start / end dot pattern formed in a predetermined area on the medium surface by the optical reading means, When the input of the content data by the input means is finished and the i-th dot pattern is read again from the optical reading means, the link table is referred to and the corresponding i-th content data is stored in the storage means.
- the input / output device according to claim 8, wherein the input / output device is read from the data and output by the output means.
- a dot pattern is touched multiple times at an arbitrary timing while using the input / output device as a voice recorder, and the input moving image / image data or audio data is linked with the touched dot pattern.
- the input moving image / image data or audio data is linked with the touched dot pattern.
- the dot patterns can be used such that the moving image / image data and audio data registered in association with each other are output by the output means.
- Conventional video cameras, such as video / image / audio input / output, etc. while having the convenience as a paper medium, because the dot pattern can be printed directly on the medium with the writing tool, so you can write important points and memorize it. Compared with digital cameras, mobile phones, recording devices, etc., it is possible to provide a more convenient input / output function.
- the control means refers to the link table and reads at least two or more corresponding content data from the storage means in a predetermined order, 2.
- the link table can be created by reading a predetermined dot pattern while inputting content data.
- the dot pattern may be associated with at least one or more other content data in addition to the first code value and / or coordinate value associated with the content data.
- N-th code value and / or coordinate value are defined, and the control means refers to the link table when the dot pattern is read by the optical reading means, and the first code value and / or The content data corresponding to the coordinate value is read from the storage means and output from the output means, and then the link table is referred to at least one of the second to Nth code values and / or coordinate values.
- the corresponding content data is read out from the storage means in a predetermined order and continuously output from the output means.
- the dot pattern (dot code) has a function as instruction information indicating other content data to be output after the desired content data is output, the content data in which the user is continuous In order to start output, it is only necessary to read one dot pattern associated with the continuous content data, and the operation of reading different dot patterns one after another becomes unnecessary.
- the dot code is not only the code value and / or coordinate value associated with the content data output by reading the dot pattern formed in each print area, but also other content data ( For example, desired content data is converted into code values and / or coordinate values indicating content data to be output after content data that is currently output, or content data that has already been output before) Is used as instruction information indicating the code value of other content data to be output. This is because the instruction information simply specifies the code value and / or coordinate value registered in association with the content data to be continuously output next. There is an effect that the order of the content data to be continuously output can be freely changed by simply changing the association in the link table.
- the user does not want to start the output from the first content data (for example, If the content up to Chapter 3 of a novel has already been listened to and the next content you want to hear is from the content of Chapter 4), even if the output of content data is started halfway By reading the dot pattern formed and defined at the beginning of Chapter 4, content data can be output continuously. Furthermore, reverse playback can be easily performed by changing the playback mode of the content data.
- a unique code value and / or coordinate value may be provided for each different print region, or a unique code value and / or coordinate value may be provided for each range by dividing the print region by a certain range. .
- the content data output after the second time is the code value and / or coordinate value indicated by the difference value with respect to the code value and / or coordinate value for indicating the relationship with the content data output first. It is desirable to relate to That is, the dot pattern in which the content data to be output first is defined is analyzed, and in addition to the code value and / or the coordinate value for indicating the association with the predetermined content data to be output first, at least one or more A code value and / or coordinate value for indicating association with other content data is represented by a difference value.
- the code value or coordinate value for indicating the relationship between the code value or coordinate value for indicating the association with the content data to be output first and the content data output for the second time or later is the code value or coordinate value for indicating the association with the predetermined content data to be output first.
- the amount of information can be saved and instruction information indicating the code value of other content data to be output after the desired content data is output can be used, for example, the range of code values that can be used can be increased. Security, XY coordinate values, etc. can be defined in the dot code.
- the storage means registers the first to Nth code values and / or coordinate values defined in the different dot patterns in association with each other in a predetermined order.
- the control means reads the i-th dot pattern from the optical reading means
- the control means stores the dot code connection table with the i-th code value and / or coordinate value converted by the processing means.
- the link table is referred to in the order of the i-th to Nth code values and / or coordinate values, and at least two or more 2.
- the control unit can store the dot code connection table and With reference to the link table, the next content data can be continuously output after the desired content data is output. Further, since it is only necessary to check the connection of the code value and / or coordinate value with reference to the dot code connection table, the content data to be continuously output is read without being limited to the information amount of one dot code. Can be output.
- the storage means uses a dot code concatenation table in which code values and / or coordinate values associated with the content data are registered in a predetermined method according to the sequential output order.
- the content data may be continuously output at least once in descending order or ascending order according to the order.
- the last or first defined code values and / or coordinate values are related. You may have the repeat function which outputs continuously from the attached content data.
- the storage unit further registers a second file name indicating different content data together with the first file name indicating the content data, and indicates the different content data.
- a file name to be chained is registered so that second file names indicating different content data are linked in a chain, and the dot pattern is indicated by the file name.
- Code values and / or coordinate values associated with the content data to be read are defined, and when the dot pattern is read by the optical reading unit, the control unit uses file names registered in a chain in the storage unit.
- the content data shown is successively read from the storage means and continuously output from the output means.
- the content file name stored in the content file is not registered in the link table by associating the code value and / or coordinate value with the content data.
- the storage means further registers a control code associated with the code value and / or coordinate value in the link table, and the control code controls an electronic device.
- the control unit refers to the link table and reads the code value and / or coordinate value.
- an optical signal for controlling an electronic device includes an infrared method
- a wireless signal includes an RF method
- communication using BLUETOOTH registered trademark
- Such electronic devices include TVs, STBs, recorders / players, recorders / players, air conditioners, and other household appliances, mobile phones, PDAs, PCs, game machines, and toys.
- the storage means further registers one or a plurality of mouse operation codes associated with the code value and / or coordinate value in the link table, and the control means
- the connection recognition unit recognizes the connection between the connection unit and the information processing apparatus, when the dot pattern in which the code value and / or coordinate value is defined is read by the optical reading unit 2.
- the mouse operation code is a code standard that predetermines mouse operation, keyboard operation, tablet operation, and the like for controlling the information processing apparatus, and can correspond to various standards as an input device such as ASCII code and HID code.
- the control means when the connection recognition means recognizes the connection between the connection means and the information processing apparatus, the code value converted by the processing means and / or Or, a normal mode in which coordinate values are transmitted to the information processing apparatus through the connection means, and a mouse mode in which mouse operation codes corresponding to the code values and / or coordinate values are transmitted to the information processing apparatus through the connection means; And can be switched by an operation command registered in association with a code value and / or a coordinate value corresponding to a dot pattern formed on a predetermined area on the surface of the medium or an operation by a button provided separately on the input / output device
- the input / output device according to claim 19, wherein:
- the normal mode is a mode in which the code value and / or coordinate value converted by the processing means is transmitted without being converted into another code, and the code value and / or coordinate value is supported by the application on the information processing apparatus side. Processing is performed. In many cases, code values and / or coordinate values are transmitted after being encrypted. In addition, the dot pattern rotation angle (axis rotation of the optical reading means) when reading the dot pattern by the optical reading means, light and dark (inclination angle with respect to the medium of the optical reading means), status codes such as error information, etc. Additional information may be transmitted.
- the storage means further registers a driver and / or content data for connecting and using the input / output device to the information processing device, and the connection recognition means
- the control means operates an installation button further provided on the input / output device or places a predetermined area on the medium surface by the optical reading means.
- the “installation dot pattern” refers to an area on the medium surface on which the dot pattern is printed and formed so that the user can install the driver and / or content data in the information processing apparatus.
- characters, figures, symbols, and the like are visually printed in the vicinity or in a superimposed manner so that the user can easily understand.
- the operation of the input / output device is switched to the installation mode by an operation command registered in association with the corresponding code value and / or coordinate value. Or content data will be installed.
- the control unit when the connection recognition unit recognizes the connection between the connection unit and the information processing device, the control unit includes a USB memory further provided in the input / output device.
- the input / output device functions as a USB memory by operating a button or reading a dot pattern for a USB memory formed in a predetermined area on the surface of the medium by the optical reading means, and the storage means or the information processing of the input / output device
- the link table that is registered in the storage means of the apparatus and registers the code value and / or coordinate value in association with the content data and / or the operation command, and the content data and / or the operation command is the input / output
- the storage unit of the apparatus and the storage unit of the information processing apparatus can be copied, moved, and deleted from each other. 1 is an input-output device according.
- the “dot pattern for USB memory” refers to an area provided on the surface of a medium on which the dot pattern is printed and formed so that the user can cause the input / output device to function as a USB memory.
- characters, figures, symbols, etc. are visually printed around or overlapping them.
- the operation of the input / output device is switched to the USB memory mode by an operation command registered in association with the corresponding code value and / or coordinate value, and the information processing device is entered.
- Mutual use of the storage means of the output device becomes possible.
- the link table and content data stored on the PC side can be copied to the input / output device, the content data input by the input means of the input / output device, and the created link table can be copied to the information processing device. Easy to do.
- removable storage means examples include a USB memory that employs a flash memory, an SD card, a memory stick, smart media, and a compact flash (registered trademark).
- the input / output device according to any one of claims 1 to 25, wherein the storage means includes an internal memory and an external memory.
- a driver, a dot code analysis program, a basic program, and the like for connecting and functioning with the information processing apparatus are registered in the built-in memory, and content data, a link table, and the like are registered in the external memory.
- the input / output device accepts a handwriting input operation by a user, and as a recognition result obtained by accepting the handwriting input operation, hiragana, katakana, kanji, alphanumeric characters, symbols, etc.
- Character recognition means for recognizing a character or character string including a plurality of character types is further provided, and the storage means associates the character or character string recognized by the character recognition means with content data and / or an operation command.
- the link table to be registered is further registered, and when the control means accepts the handwriting input operation, the control means recognizes the locus of the optical reading means from the change of the coordinate value converted by the processing means, and A character or character string corresponding to a locus is recognized by the character recognition unit, and is recognized by the character recognition unit with reference to the link table. Characters or the content data corresponding to the character string to be outputted from said output means is an input-output device according to claim 1, wherein the controlling the operation of the the manipulation instruction.
- touch input operation when the user touches a desired position on the medium with a pen-type scanner (referred to as “touch input operation” in the present invention), information corresponding to the dot pattern printed at the touched position is output.
- the user traces the dot pattern on the traced trajectory sequentially by tracing with a pen-type scanner so that the user performs handwriting on the medium with a pen (referred to as “handwriting input operation” in the present invention). It is possible to realize both operations of recognizing and outputting information corresponding to the trajectory. That is, without performing any special operation at the start, it is recognized that the handwriting input operation is started by simply touching the writing area with the pen-type scanner and tracing, and the processing is executed.
- the input / output device accepts a handwriting input operation by a user, and as a recognition result obtained by accepting the handwriting input operation, hiragana, katakana, kanji, alphanumeric characters, symbols, etc.
- Character recognition means for recognizing a character or character string including a plurality of character types is further provided, and the control means receives the handwriting input operation from the change of the coordinate value converted by the processing means.
- the input / output device accepts a handwriting input operation by a user, and when the control means accepts the handwriting input operation, a change in coordinate values converted by the processing means And recognizing the trajectory of the optical reading means, and when the connection recognizing means recognizes the connection between the connecting means and the information processing apparatus, the trajectory is transmitted to the information processing apparatus through the connection means.
- the input / output device according to claim 1.
- An input / output device includes: an input / output device according to claim 28; a storage unit for registering a link table for registering the character code or character string code in association with content data and / or an operation command;
- connection means comprising: output means for outputting the character code or character string code and / or the content data; and control means for controlling the operation by the storage means, the output means and / or the operation by the operation command.
- An information input / output system including an information processing device connected to the input / output device wirelessly or by wire, wherein the control means of the information processing device transmits a character code transmitted from the input / output device through the connection means.
- the character string code is output from the output means and / or the link table of the information processing apparatus is referred to Or the corresponding content data and code or string code is output from the output unit of the information processing apparatus, an information output system and controlling the operation of the the manipulation instruction.
- An information input / output system provides a plurality of character types such as hiragana, katakana, kanji, alphanumeric characters, and symbols as recognition results obtained by receiving the input / output device according to claim 29 and the handwriting input operation.
- Character recognition means for recognizing the included character or character string, storage means for registering a link table for registering the character or character string with content data and / or operation instructions, and converted from the character or character string
- An output means for outputting a character code or character string code and / or the content data; and a control means for controlling the operation by the character recognition means, the storage means, the output means and / or the operation command.
- An information input / output system including an information processing device connected to the input / output device wirelessly or by wire by the connection means
- the control means of the information processing apparatus recognizes a character or character string corresponding to the locus transmitted from the input / output device through the connection means by the character recognition means, and converts the character code or character string code into a character code or character string code. Converting and outputting the character code or character string code from the output means and / or referring to the link table and outputting content data corresponding to the character or character string from the output means of the information processing apparatus Or an information input / output system characterized in that the operation according to the operation command is controlled.
- the input / output device further includes a handwritten input start / end dot pattern formed in a predetermined area of the medium surface by an operation of a handwriting input start / end button or the optical reading means.
- the input / output device according to any one of claims 27 to 29, wherein reception of the handwriting input operation is started and ended by reading.
- the writing area requires coordinate values to draw a trajectory, and the coordinate values require many different dot codes. Therefore, in order to effectively use the limited dot codes, the coordinates used in different writing areas are also used. Can use the same dot code to specify the writing area by each handwritten input start / end dot pattern.
- the input / output apparatus further includes a determination unit that determines whether the user has accepted the handwriting input operation, and the determination unit includes the handwriting input at least in part of the code value.
- An operation determination code for determining acceptance of an operation is defined, and the control unit determines whether to accept the handwriting input operation based on the operation determination code every time the dot pattern is read by the optical reading unit.
- a writing area specifying code for specifying a writing area used for handwritten input by a user is defined in at least a part of the code value.
- a write area is specified based on the write area specifying code, and a locus on the write area is recognized.
- the writing area is an address field
- it is possible to easily recognize a character or a character string by comparing the written locus with an address database (dictionary). That is, by specifying the writing area, it is possible to specify a dictionary limited to the character or character string to be written, and to greatly improve the character recognition rate.
- you can read the writing area identification code just by touching so if you use a high-speed CPU, you can also recognize characters in real time while tracing the pen.
- An information input / output system is an information input / output system comprising: the input / output device according to claim 1; and an information processing device connected to the input / output device by the connection means wirelessly or by wire.
- the input / output device accepts a handwriting input operation by a user, and the information processing device has a discrimination means for discriminating the handwriting input operation accepted by the input / output device, and a recognition result obtained by accepting the handwriting input operation, Character recognition means for recognizing characters or character strings including a plurality of character types such as hiragana, katakana, kanji, alphanumeric characters and symbols, and a link for associating and registering the character or character string with content data and / or operation instructions Storage means for registering a table, output means for outputting the content data, determination means, character recognition means, storage means, output means Control means for controlling the operation and / or the operation according to the operation command, and the control means of the input / output device receives the code value and / or
- the determination means determines acceptance of handwritten input by the user based on an operation determination code defined in at least a part of the code value
- the control means of the information processing apparatus Recognizing the trajectory of the optical reading means of the input / output device by a change in value, recognizing the character or character string corresponding to the trajectory by the character recognizing means, referring to the link table, by the character recognizing means
- An information input / output system characterized in that content data corresponding to a recognized character or character string is output from the output means or the operation according to the operation command is controlled. It is.
- the dot pattern includes a step of arranging a plurality of reference dots continuously in a line according to a predetermined rule, a straight line, a broken line, and a line connecting the plurality of reference dots. And / or providing a first virtual reference line comprising a curve, and at least one or more first comprising a straight line and / or a curve defined at a predetermined position from the reference dot and / or the first virtual reference line.
- XY coordinate values are defined on the medium surface without a gap by forming a plurality of stream dot patterns with a constant reference point interval.
- characters, staffs, maps, figures, etc. are printed on the medium and the operation is performed by tracing or touching the line segment with a scanner pen, by forming a stream dot pattern only along the line segment, A dot pattern can be arranged rationally.
- a dot pattern in which XY coordinates are defined is formed as a two-dimensional code (used as an index), it is not restricted by the shape of the rectangular area, and is matched to the information area visually formed on the medium surface.
- it is possible to form a dot pattern by repeating a set of constant information in a free shape.
- the stream dot defines a second virtual reference line and / or defines the direction of the dot pattern and one XY coordinate value and / or code value.
- a reference dot serving as a reference at a predetermined position.
- the direction of the stream dot pattern and the set of constant information can be easily defined without using information dots, and the reduction of unnecessary information can be suppressed. Furthermore, the position of the virtual reference point that is the starting point of the information dot can be accurately indicated by the arrangement of the new reference point.
- a code value and / or a coordinate value or an operation command is used based on a predetermined condition in a state where it can be connected to the information processing device, and used alone when it cannot be connected to the information processing device. Can be transmitted to the information processing apparatus, and corresponding dot pattern technology that can output corresponding information can be used.
- FIG. 1 is a diagram illustrating a configuration according to an embodiment of an input / output device according to the present invention, and is a functional block diagram illustrating an input / output device using an information input / output method by camera input.
- the input / output device includes a sensor unit 8 including a camera unit 599 as an optical reading unit 33 and a main body processing unit 11 including a control unit 27 and a storage unit (memory) 10.
- the sensor unit 8 includes a camera unit 599 that captures only image data of a dot pattern portion in a printed material, and a processing unit 12 that digitizes the image data and digitizes the image data. Near this camera unit 599, an infrared light emitting means 13 for irradiating the printed matter with infrared rays is provided.
- the main body processing unit 11 includes a connection recognition unit 22 for recognizing a communication connection with a wireless or wired information processing device 1002 (a personal computer, a PDA, a mobile phone, an audio device, etc.) by a connection unit 38, a code value and / or a coordinate value.
- a connection recognition unit 22 for recognizing a communication connection with a wireless or wired information processing device 1002 (a personal computer, a PDA, a mobile phone, an audio device, etc.) by a connection unit 38, a code value and / or a coordinate value.
- the storage means 10 for registering the content data and / or the operation command, and the numerical value processed by the processing means Control means 27 (optical reading means, processing means, connection means, connection recognition means, operation by the output means and / or operation control by the operation command, which outputs the content data of the storage means (memory) 10 registered in advance. To do).
- the above dot code is a code digitized by the processing means 12, and the code value and / or coordinate value is information obtained by converting the dot code.
- the dot code may be used as it is as the code value.
- the main body processing unit 11 is connected to output means 15 such as a speaker 1007, an earphone 58, or a liquid crystal monitor 25. In addition to audio output, it is also possible to output audio to the TV monitor or the information processing apparatus 1002 via the connection means 38 (line).
- output means 15 such as a speaker 1007, an earphone 58, or a liquid crystal monitor 25.
- audio output it is also possible to output audio to the TV monitor or the information processing apparatus 1002 via the connection means 38 (line).
- content data can also be registered in the storage unit 10 by voice, a photograph, or a moving image using a microphone or a camera as the input unit 17 separately.
- the storage means 10 has a two-part configuration including, for example, a built-in flash memory in which an operation command is registered and a removable microSD card (registered trademark) in which content data and a link table are registered, and the microSD card (registered trademark). ) Is once removed, connected to the information processing apparatus, content data and / or operation commands are registered, and the usage mode of attaching them again is also conceivable.
- the storage means 10 has a two-part configuration of an internal memory and an external memory, the internal memory stores a driver, a processing program, and the like for connecting and using the input / output device to the information processing apparatus. May store content data, operation instructions, link tables, and the like.
- the link dot pattern is a dot pattern provided for the user to start a link operation to a predetermined dot pattern on the surface of the medium on which the dot pattern is printed. In many cases, the user can easily understand the dot pattern. Characters, figures, symbols, and the like are visibly printed around or superimposed on the characters.
- This link mode is a mode in which a predetermined dot pattern read during the mode and the content data registered in the storage means 10 are related and registered in the link table, and on the medium surface on which the dot pattern is printed.
- the content data can be linked to a free area / position that can be arbitrarily selected by the user.
- This predetermined dot pattern refers to a dot pattern that is registered by the user in association with content data in the link mode. In many cases, characters, figures, and the like that suggest this are printed in a superimposed manner.
- the dot pattern for linking may be formed on a paper controller (to be described later) together with a dot pattern that defines other operation commands (sound reproduction, volume adjustment, etc.), or the same as a predetermined dot pattern for linking. It may be formed on a print medium.
- the control means 27 associates a predetermined dot pattern read after that with content data such as sound and registers it in the link table of the storage means 10, and again sets the predetermined dot pattern.
- the corresponding content data is output to the output means 15. That is, when a predetermined dot pattern is read, the content data registered in association with the code value and / or coordinate value converted by the processing means 12 is selected.
- the content data to be related can be arbitrarily determined by the user, and immediately before switching to the link table, the input means 17 provided with the input / output device is provided with a microphone for inputting sound, a camera for inputting photographs / moving images, or the like.
- the link of content data that is being entered or entered will be described in detail later.
- the link of content data that has already been registered is the content data that has already been registered by the button operation and / or its index (display of file name, number, etc.) )
- the timing of the link may be during the output of the content data or within a predetermined time after the output is completed.
- the link mode can be switched and linked by reading or linking a predetermined dot pattern after operating or operating a button provided separately on the input / output device, or reading a dot pattern for linking, and then a predetermined dot pattern. Can be read and linked.
- content data can be related to any position according to the user's request of the input / output device, and audio information, photos, and videos can be stored on all media such as system notebooks, storytelling picture books, English conversation materials, and seal cards. It is possible to define various information such as the beginning.
- the relation between the content data and the arbitrary dot pattern can also be performed during the input of the content data by the input means.
- the start of input by the input means is started / stopped separately provided in the input / output device. This is performed by operating a button or reading an input start / end dot pattern formed on the medium surface.
- processing may be performed by a program so as to end the input.
- the input start / end dot pattern may also be formed on a paper controller (to be described later) together with a dot pattern that defines other operation commands (sound reproduction, volume adjustment, etc.), or a predetermined link to be linked It may be formed on the same print medium as the dot pattern.
- the input can be completed once every time or every predetermined number of times, and the link can be performed.
- the relationship between the dot patterns becomes clear to the user.
- voice input means as input means
- in conferences, presentations, Q & A it is possible to divide and record each theme, talker, and time, and play back only the target voice. Deepen understanding.
- the effect can be further enhanced by using the input means as the video input means.
- the relationship between the content data and the predetermined dot pattern can be performed by using a link dot pattern as described above, or by separately providing a link button on the input / output device. That is, when a predetermined dot pattern is read by the optical reading means 33 by operating the link button, the relationship between the predetermined dot pattern and existing content data or input content data is registered in the link table. This link button operation may be linked while being operated, or may be linked after being operated.
- control means 27 may control the content data to correspond only to the newly read dot pattern, or the content data may already be associated. It is also possible to control to correspond to both the existing dot pattern and the newly read dot pattern. For example, only one content data may be defined for one dot pattern, or the same content data may be output from two or more dot patterns.
- the button when it is desired to link while inputting the content data by the input means 17, if an input button for starting input is separately provided and the button is operated, and the button is operated again as a toggle when the input is ended, the button
- the cost can be held down by a simple design by reducing the number of
- the input when it is desired to end the input without linking the content data being input, the input can be performed by either the input button or the input end dot pattern.
- the input / output device as a video camera, digital camera, mobile phone, recording device, etc., and associate the input video / image data or audio data with the touched dot pattern.
- the output means to output the moving image / image data and audio data registered in association with each other.
- a writing area is provided next to the icon on which the dot pattern is superimposed and printed, it is possible to directly write the characteristics of the shooting location with a writing instrument, and to write notes, etc.
- Compared to general video cameras, digital cameras, mobile phones, and recording devices, such as input / output of image data and audio data it is possible to realize a convenient input / output function that enables easy cueing.
- the number of times of reading the content data and the time interval for reading the plurality of dot patterns are read. If one or more dot patterns are read while operating the link button immediately after input, the content data input from the start to the end is divided. Without linking to one or more dot patterns. If you link to the dot pattern immediately after dividing and linking, either a series of content data input from the start to the end of input or only the content data that was divided and input last.
- the input / output device may be set to be linked.
- the operation when linking the same content data to a plurality of dot patterns can be performed by a multilink start button and a multilink end button separately provided in the input / output device.
- the input / output device is switched to the multilink mode, linked to a plurality of dot patterns, and then the multilink mode is terminated with the multilink end button.
- the input / output device switched to the multi-link mode it is possible to continuously link the same content data to these dot patterns by continuously reading predetermined dot patterns. Since it is necessary to define the end of linking in this mode, it is preferable that the user himself operates the multilink end button, recognizes the operation by the control means 27, and ends the multilink mode.
- the multi-link mode can be terminated when a dot pattern associated with an operation command is read. After the end of the multilink, it is possible to output the content data by reading a predetermined dot pattern registered in association with the content data, and the same content data is obtained from the dot pattern linked during the multilink mode. Will be output.
- Multilink start / end dot patterns are provided on the medium used by the user, read by the optical reading means 33, and registered in association with the code values and / or coordinate values converted by the processing means 12. You may perform operation by.
- the content data when linking different content data to a predetermined dot pattern during the multi-link mode, the content data may be selected and linked by a button operation or the like. Further, the content data reproduced by reading the dot pattern to which the content data is already linked may be linked to one or a plurality of predetermined dot patterns. At that time, if a predetermined dot pattern with linked content data or a read-only dot pattern is read, the content can be played back and linked to only a predetermined unlinked dot pattern. If settings are made such that content reproduced by reading a pattern can be linked to a predetermined dot pattern regardless of whether content data has already been linked, an operation with high operability becomes possible.
- the reproduction / multilink of different content can be repeated any number of times during the multilink mode.
- either the multilink start dot pattern or the multilink end dot pattern may be toggled so that the start and end of the multilink can be alternately operated every time one dot pattern is read. At this time, it is needless to say that it is necessary to clearly indicate to the user by sound or light that the mode is the multilink mode.
- link button, multilink start button, and multilink end button can be made to perform their functions with the same button by giving different operations, for example, long press, double press, etc.
- a single press may be a single link mode
- a double press (or long press) may be a multilink mode
- a single press in a multilink mode may be a multilink end.
- the link button if the link button is operated (pressed) and the input / output device is linked to a predetermined dot pattern, the link button can be operated (pressed) and linked to one or more dot patterns. In this way, the number of buttons can be reduced and the cost can be reduced with a simple design.
- the content data registered in association with the code value and / or coordinate value of the predetermined dot pattern by the operation command corresponding to the dot pattern and the operation of the link button is read again and controlled.
- the data is output from the output means 15 by referring to the link table by means 27 and reading from the storage means 10.
- the input / output device has a function as a USB memory
- the input / output device is provided with a USB memory button
- the control means 27 recognizes whether or not the USB memory button is operated, and the USB memory button is operated and connected to an information processing apparatus such as a personal computer through the connection means 38.
- the input / output device functions as a USB memory, and a link table for registering the code value and / or coordinate value registered in the storage means of the personal computer in association with the content data and / or the operation command, The content data and / or operation instructions are registered in the storage means 10 of the input / output device.
- the contents registered in the storage means 10 of the input / output device and the contents registered in the storage means of the personal computer can be copied, moved, deleted, etc.
- the input / output device may function as a USB memory when the USB memory button is operated from a normal mode in which code values and / or coordinate values are transmitted.
- the control means 27 recognizes whether or not the install button is operated, and the install button is operated and connected to an information processing device such as a personal computer or another input / output device.
- the driver and / or content data registered in the storage means 10 for using the input / output device connected to a personal computer can be automatically installed in the information processing device or other input / output device. .
- the installation button is not operated at the time of connection, but the installation button is operated while the connection is recognized, the driver registered in the input / output device, etc. Can also be transmitted to the information processing apparatus.
- the control means 27 recognizes whether or not these buttons are operated, and performs corresponding processing.
- the connection recognition unit 22 recognizes the connection with the information processing apparatus through the connection unit 38
- the control unit 27 converts the code value converted by the processing unit 12 and / or The coordinate value is transmitted to the information processing apparatus through the connection means 38
- a driver for connecting and using the information input / output device to the information processing apparatus and / or The content data is automatically installed in the information processing apparatus.
- This driver and / or content data is stored in the storage means 10.
- the information input / output device functions as a USB memory, and the code registered in the storage means of the information input / output device or the storage means of the information processing device
- a link table for associating and registering values and / or coordinate values with content data and / or operation commands, and storing the content data and / or operation commands with storage means of the input / output device and storage of the information processing device Copy / move / delete each other.
- Switching between these installation buttons and USB memory button operations can also be performed using the installation dot pattern formed on the medium surface, or the code value and / or coordinate value obtained by converting the USB memory dot pattern. It is. That is, the link table registered by associating the code value and / or the coordinate value with the operation command (switching the operation) described above is registered in the storage means 10, and after the value is obtained, This is a case in which when a connection is made, an operation according to a registered operation command is performed. Of course, such an operation can be performed by reading the dot pattern while recognizing the connection.
- the feature of the present invention is to achieve both a function as an input / output device that can be used in a stand-alone manner and a function as an input / output device that is connected to the information processing device and depends on an application on the information processing device side.
- a method of switching the function not only the connection means 38 is connected to the information processing apparatus, but also an operation command associated with the code value and / or coordinate value corresponding to the read dot pattern. It can be performed directly or by providing a predetermined operation button.
- an operation command may be created so that wireless communication is automatically performed in order to connect to the information processing apparatus, and the input / output depends on the application on the information processing apparatus side. Wait while switching to the device, and send the code value and / or coordinate value corresponding to the dot pattern read so far to the information processing device when connected to the information processing device via USB cable or communication Also good. Connection by wireless communication may be performed by providing a connection button or the like on the input / output device, or by touching the dot pattern on the surface of the medium and related to the code value and / or coordinate value converted from the dot code described above. You may perform by the operation command registered in the attached link table.
- the input / output device recognizes the connection with the information processing device, content data or an operation command corresponding to the code value and / or coordinate value is not registered in the link table, or content data or
- the code value and / or coordinate value converted by the processing means 27 is transmitted to the information processing apparatus by wireless or wired communication through the connection means 38, and Content data to be output by the information processing apparatus.
- the code value converted by the processing unit 27 and The content data corresponding to the coordinate value is output or the operation according to the operation command is performed by the input / output device itself.
- the control means 27 automatically starts wireless communication for connecting to the information processing apparatus, and the code value and / or the coordinate value converted by the processing means 27 after recognizing the connection are obtained. To the information processing apparatus.
- the input / output device when connected to the information processing device, only the input / output device is required when it is not necessary to transmit an operation command for outputting a code value and / or coordinate value or corresponding content data to the information processing device. If the code value and / or coordinate value is not registered in the link table in association with the content data and / or the operation command, the code value and / or coordinate value is It is possible to perform content output, WEB access, etc. by transmitting to the information processing apparatus and referring to the link table in the information processing apparatus.
- the number of connections with the information processing apparatus can be minimized, and at the same time, the storage means on the information processing apparatus side that can register a large amount of content data can be effectively used.
- the content data and the link table can be downloaded to the storage means 10 of the input / output device.
- the output of the content data related to the transmitted code value and / or coordinate value may be performed by an input / output device or an information processing device in accordance with the nature of the content data.
- the code value and / or the coordinate value starts communication connection of related operation commands with peripheral information processing devices, and connects a large amount of data registered in the storage means of the information processing device to the input / output device, information processing device or information processing device. It is also possible to define a process to be output by the content data output device, a process of browsing the WEB by the information processing device, and downloading related content data.
- the link table is associated with the code value and / or the coordinate value converted by the processing unit according to the content of the operation command as well as whether the content data and the operation command itself are registered in the storage unit. Whether the code value and / or coordinate value converted by the processing means is transmitted to the information processing apparatus through the connection means, or the content data is output from the output means, It is possible to control the operation according to the operation command or to switch the operation.
- an I / O device with a separate button can be provided by providing data that records operation instructions for switching processing on the WEB, or distributing manual books and paper controllers for easy switching. This makes it possible to realize and provide a single input / output device capable of switching various processes without newly manufacturing and selling.
- a specific example is an input / output device that reads a web icon on the paper controller of a paper controller while listening to a voice commentary on a speaking pen (stand-alone voice playback) compatible printing medium such as teaching materials and how-to books. After switching the operation, the dot pattern superimposed and printed on the URL on the print medium surface is read, and the code value and / or the coordinate value converted from the dot code are transmitted to the information processing apparatus, and the corresponding WEB Can be accessed.
- a WEB icon may be provided on the print medium surface without using the paper controller.
- the dot pattern is read from the URL on the print medium surface, the switching code is associated with the converted code value and / or coordinate value, the operation of the input / output device is switched, and the converted code value and / or coordinate is converted.
- the value may be transmitted to the information processing apparatus. Then, it is not necessary to provide a switching icon.
- the end of switching may be switched to a speaking pen that is used alone by using a switching or switching end icon again, or a dot pattern corresponding to a speaking pen (sound reproduction) of a printing medium may be read and switched automatically.
- the information input / output device registers the voice of oneself or an acquaintance related to a printed matter such as a picture book using the microphone. After that, by reading the printed matter with the information input / output device, another person can hear the audio information corresponding to the contents of the printed matter. For example, it can be used as a “parent / child message device” or a “photo with a voice message” with a voice in the photo.
- the main body processing unit 11 of the input / output device can output or execute external content data and operation commands by connecting the communication card 16 to the connection means 38.
- the dot pattern input by the camera unit 599 is analyzed, and the code value and / or coordinate value converted from the dot code can be transmitted to the computer 23 such as a server via the communication card 16.
- the dot code defined in the dot pattern input by the camera unit 599 is transmitted to the server 23 or the like via the communication card 16, the dot code is converted into a code value and / or coordinate value, and the corresponding content data It is also possible to receive operating instructions and / or. Then, the communication card 16 is connected to register the content data and / or operation command in the storage means 10.
- the communication card 16 By using the communication card 16 in this way, content data and / or operation instructions can be easily transmitted and received. For example, it is possible to answer a questionnaire with a voice using an input / output device and transmit the voice information to a computer such as the server 23. Answering a question collection or a test with a voice and transmitting the voice information to a computer such as the server 23 enables a pronunciation test or correction.
- URL information is embedded in the dot pattern portion of other media such as printed matter, and automatically connected to that site after scanning. Alternatively, a specific operation can be performed after the connection.
- Audio information can be added (linked) to a postcard or letter printed with a dot pattern later.
- BGM background music
- SE sound effects
- etc. can be added (linked) later to these printed materials.
- the main body processing unit 11 can be provided with a GPS 24 to easily display the current position information.
- connection recognition unit 22 is operated by the control unit 27 provided in the main body processing unit 11, and the input / output device communicates wirelessly with the information processing apparatus (infrared communication, optical Recognize whether connected by communication, BLUETOOTH (registered trademark), ZigBee, weak radio wave) or wired.
- the information processing apparatus infrared communication, optical Recognize whether connected by communication, BLUETOOTH (registered trademark), ZigBee, weak radio wave) or wired.
- control means 27 When the control means 27 recognizes that the connection recognition means 22 is connected to the information processing apparatus through the connection means 38, the control means 27 uses the code value and / or coordinate value converted by the processing means 12 as the connection value. When the connection recognition unit 22 does not recognize the connection between the connection unit 38 and the information processing apparatus, the content data registered in the storage unit 10 is output from the output unit 15.
- the control means 27 refers to the corresponding link table and sends the corresponding control code to one or more optical signals or The signal is converted into a radio signal, and the one or more optical signals or radio signals are output from the output means 15.
- the optical signal include infrared communication, the wireless signal includes RF communication, and BLUETOOTH (registered trademark) communication.
- FIG. 2 is a diagram showing a relationship between a dot code and a code value and / or coordinate value
- FIG. 3 is a diagram showing a relationship between the code value and / or coordinate value and content data and / or an operation command.
- FIG. 2A shows an example of a dot pattern in which one information dot is shifted in eight directions, that is, has an information amount of 3 bits.
- FIG. 2B the definition of XY coordinate values is shown. Examples of various dot code formats are defined. For example, X coordinate values are defined for C0 to C8, Y coordinate values for C9 to C17, and Z coordinate values for C18 to C27. Is automatically converted from the dot code.
- FIG. 3 shows a link table for registering the relationship between code values and / or coordinate values, content data, and / or operation commands based on these formats.
- the audio data a is registered in association with the X coordinate value, the Y coordinate value, and the Z coordinate value converted from the dot code, and the dot pattern is read. Starts reproduction of the audio data a.
- the medium on which the dot pattern is formed is a three-dimensional map, it is possible to reproduce audio data including the altitude of the read location. For example, when reading the summit of Mt. Fuji, audio data such as “altitude 3776 m, average daily temperature minus 15 degrees or less” is reproduced.
- the voice data b is registered in association with the code value converted from the dot code, the X coordinate value, and the Y coordinate value, and when the dot pattern is read, the voice data b Start playback.
- the Z coordinate value is not defined, and it is desirable to use it when defining the surface position of a curved surface (such as a sphere) having a constant radius.
- the code value and the operation command for starting the voice input can be related, or the modification examples shown in (d) to (e) can be considered.
- the content data includes various data. For example, the image, video, audio, text data, or the dot pattern corresponding to the visible information that is printed superimposed on the read dot pattern is printed. This includes the title, author name, and page number of the printed material.
- Various commands for operating the input / output device and the information processing device can be defined in the operation command, causing the information processing device to browse the web, increasing / decreasing the volume, switching to the link mode, content data
- start / end of recording start / end of recording
- start of connection / disconnection with the information processing apparatus etc.
- control unit 27 controls whether the coordinate value is processed by the input / output device itself or transmitted to the information processing device and processed by the information processing device according to the mode of the input / output device.
- FIG. 4 shows an input / output device housed in a pen-like case 1015 as a pen-type scanner 1001.
- a battery 1010, a speaker 1007, and a PCB 1331 are provided.
- a central processing unit (CPU) and a memory are mounted on the surface.
- a microphone 1291 for inputting audio data is incorporated at the rear end (upper left in the figure) of the case 1015.
- the memory cartridge may be detachably mounted. An operation command, content data, or the like is registered in the memory cartridge and is detachable. Therefore, the memory cartridge can be replaced with a ROM cartridge, a microphone unit cartridge or the like.
- Buttons 1130a to 1130f are provided on the surface of case 1015. Reading start / end, recording start / end, audio playback / stop, volume adjustment, content data division, content data deletion, switching to link mode Etc. can be controlled.
- the above-described installation button or USB memory button may be provided in addition to or in place of the button, and the buttons 1130a to 1130f play a role according to a predetermined operation method (touch, slide, long press, etc.). It is also possible to
- the voice can be recorded with the microphone 1291 by pressing the recording button in the button.
- the recorded audio data is recorded in the memory cartridge.
- the dot pattern portion is scanned while pressing the erase button, the association of the voice with the dot pattern portion is canceled.
- the audio data may be stored in the memory cartridge.
- the tip of the case 1015 (the lower right end portion in the figure) has a C-MOS camera unit and a C-MOS camera unit along the vertical axis of the medium surface when the case 1015 is inclined about 45 degrees and abuts against the medium surface.
- a tapered nose 1125 is provided.
- a lens 1126 of the C-MOS camera unit is attached to the space inside the nose 1125 so as to face the space, and a window at the tip of the nose 1125 can be imaged.
- An IRLED 1122 is provided in the inner space of the nose 1125, and the irradiation light of the IRLED 1122 enters the diffuser 1111.
- the diffused component of the irradiated light on the wall surface of the diffuser 1111 (light component having an angle greater than 45 degrees with respect to the optical axis) passes through the wall surface of the diffuser 1111 and is radiated to the outside. Then, the linear component of the irradiation light (the light component having an angle smaller than 45 degrees with respect to the optical axis) is reflected by the wall surface of the diffuser 1111 and proceeds in the tube. In the diffuser 1111, only the component substantially parallel to the optical axis is irradiated from the tip surface to the opening of the nose 1125.
- the irradiation light passes through the crank-shaped diffuser 1111 made of a transparent resin and becomes converged light parallel to the optical axis, so that a uniform amount of light is supplied over the entire opening of the nose 1125 part. be able to.
- the reading accuracy of the dot pattern portion can be improved.
- FIG. 5 illustrates a configuration in which the pen-type scanner 1001 is provided with a liquid crystal display unit 1131 and a speaker 1007.
- the liquid crystal display unit 1131 displays content data related to the code value and / or coordinate value converted from the read dot code, and sentences and diagrams explaining the contents of the operation command. It is also possible to display time, a calendar, and an image taken by a camera provided as a separate input unit.
- the liquid crystal display unit 1131 desirably sets the level of resolution, the size of the display, and the like according to the characteristics of information to be displayed.
- FIG. 6 shows such a pen-type scanner 1001 connected to the information processing apparatus 1002.
- an information processing apparatus 1002 includes a memory card slot 1003, and a memory card 1004 in which audio data and programs are registered can be inserted.
- a microphone 1005 is connected to the information processing apparatus 1002 so that audio data can be registered in a memory in the information processing apparatus from the outside.
- the sound data can be output from the speaker 1007 of the information processing apparatus 1002 or the sound generation apparatus 1006 connected to the information processing apparatus 1002.
- the pen-type scanner 1001 and the information processing apparatus main body are connected by a cable.
- a wireless interface is built in the scanner and the information processing apparatus 1002 is connected. May communicate wirelessly.
- FIG. 7 shows a modification of the pen type scanner.
- the pen-type scanner 1001 includes a detachable battery 1010 and a speaker 1007 so that a memory card 1004 such as an SD card, a memory stick, or a smart media can be attached.
- a memory card 1004 such as an SD card, a memory stick, or a smart media can be attached.
- the battery can be charged by wireless or wired connection with the information processing apparatus.
- FIG. 8A shows the pen type scanner 1001 connected to the personal computer 1201 via a USB cable.
- the connection between the pen-type scanner 1001 and the personal computer 1201 may be a serial interface based on RS-232C, a LAN interface, an IEEE 1394 interface, or the like, in addition to using a USB interface.
- a wireless interface card 1209 may be attached to a personal computer and connected to the pen-type scanner 1001 by wireless communication.
- wireless interface BLUETOOTH (registered trademark), wireless LAN, or the like can be used.
- the pen scanner 1001 and the personal computer 1201 may be connected using an optical interface such as infrared communication in addition to the wireless interface.
- FIG. 8B is a diagram in which the pen-type scanner 1001 is connected to the PDA 1202 with a cable.
- the connection between the PDA 1202 and the pen-type scanner 1001 may be realized by a wireless connection or an optical communication connection in addition to a wired connection.
- FIG. 9A shows the connection with the personal computer 1201 when the input / output device has a function as a mouse.
- the mouse scanner 1301 is generally connected to a personal computer 1201 via a USB interface, but may be wirelessly connected.
- the mouse scanner 1301 can also function as a personal computer mouse. That is, a normal mode in which the code value and / or coordinate value when the dot pattern is read to the personal computer 1201 is transmitted and the corresponding content data is output and an operation command is executed in the information processing apparatus, and the dot pattern is read Code value is the code value and / or coordinate value, or the increment value calculated based on the coordinate value from the start point to the end point when the dot pattern is slid and read, or the coordinate information of multiple points read and slid. It is also possible to provide a switch that can be switched to a mouse mode that is converted into a mouse operation code corresponding to a coordinate value and transmitted and transmitted to function as a mouse.
- the input / output device When the input / output device has a function as a mouse in the normal mode, the input / output device transmits the code value and / or coordinate value defined in the dot pattern to the information processing device, and the code transmitted by the information processing device.
- the value and / or coordinate value is converted into a mouse operation code by referring to the link table.
- coordinate values or code values and coordinate values of a plurality of points are continuously transmitted.
- the code value and / or the coordinate value is converted into the corresponding mouse operation code registered in the link table of the storage means in the input / output device, and the converted mouse operation code is transmitted to the information processing device.
- the mouse scanner 1301 is preferably provided with a mouse button, but may be performed by a dot pattern formed on the medium for the mouse button.
- the mouse button operation is converted into a mouse operation code and transmitted to the information processing apparatus.
- the mouse operation code is a code standard that predetermines mouse operation, keyboard operation, tablet operation, and the like for controlling the information processing apparatus, and can correspond to various standards as an input device such as ASCII code and HID code.
- the normal mode and the mouse mode by an operation command registered in association with the code value and / or coordinate value. Similarly, it can be performed by operating a mouse mode switching start / end button.
- the click operation in the case of functioning as the mouse mode may be performed by any one of buttons provided separately on the mouse scanner 1301, or may be performed by a dot pattern formed on the medium.
- the input / output device can be charged by connection with the personal computer 1201.
- the normal mode is a mode in which the code value and / or coordinate value converted by the processing means is transmitted without being converted into another code, and the code value and / or coordinate value is supported by the application on the information processing apparatus side. Processing is performed. In many cases, code values and / or coordinate values are transmitted after being encrypted. In addition, the dot pattern rotation angle (axis rotation of the optical reading means) when reading the dot pattern by the optical reading means, light and dark (inclination angle with respect to the medium of the optical reading means), status codes such as error information, etc. Additional information may be transmitted.
- the input / output device is constituted by a mouse-type scanner 1301 as a general mouse shape, but it is needless to say that the above-described pen shape or other shapes may be used. .
- the mouse 40A shown in the drawing includes an IRLED 1122 as an irradiation light source for irradiating light onto a medium surface on which a dot pattern is formed, a lens 1126 for making light reflected from the dot pattern incident, and an irradiation light from the IRLED 1122.
- a mouse body 41 in which an opening 41c serving as an entrance / exit of reflected light from the medium surface X is formed, a pointer light source 42 that irradiates a reading point 42A on the medium surface in which a dot pattern is formed from the opening 41c, and an IRLED 1122
- a light guide 306 disposed in front of the irradiation direction and having an inside functioning as a light guide, and a CCD camera 44 (or a CMOS camera) are provided, and the IRLED 1122 is irradiated with pointer light from the pointer light source 42 on the medium surface. Irradiate the dot pattern to the dot pattern, and the dot pattern is reflected by the reflected light. Read the over down.
- a cap member made of a glass plate or a transparent resin plate may be attached to the opening 41c to prevent dust from entering the mouse.
- the mouse 40A Since the reading point 42A on the medium surface is irradiated by the pointer light source 42, the position of the readable dot pattern can be accurately recognized, and the mouse 40A can be appropriately operated with respect to the dot pattern to be read. It becomes.
- the mouse 40A is provided with a switch 43 for operating the reading function on the outer peripheral surface of the mouse main body 41, and can operate the reading function only when necessary. At this time, the normal mouse function can be stopped by operating the switch 43, and the reading function may be activated using either the left or right mouse button 401a or 401b as a photographing button.
- the reading function may be operated when the left and right mouse buttons (401a, 401b) are simultaneously pressed.
- FIG. 10 is a diagram showing the relationship between the printed material 5 on which the dot pattern is printed and the input / output device 816 when a plurality of content data are linked.
- the user first starts to input content data by operating an input start / end button or reading an input start / end dot pattern 871. That is, an input start / end button pattern and / or an input start / end dot pattern 871 formed in a predetermined area on the medium surface is read by the optical reading means, and the input of the content data by the input means is started. .
- the input start / end button uses one of the buttons 1130a to 1130f provided on the input / output device 816. In the case of input using a dot pattern, the input start / end dot pattern 871 formed on the medium surface is input / output.
- the data is read by the optical reading means provided in the device 816, converted into a code value and / or coordinate value by the processing means, and input is started by an operation command registered in association with the code value and / or coordinate value.
- the input content data is sequentially registered in the storage means of the input / output device 816.
- buttons 1130a to 1130f provided on the input / output device 816 or the dividing dot pattern 812 formed in a predetermined area on the medium surface by the optical reading means. Is read according to the number of times the user wants to divide.
- the control means starts the input and starts the content from when the split button is first operated.
- the data is divided and registered in the storage means as the first content data, and the content data input from the first time when the division button is operated to the second time when the division button is operated is stored in the second content data.
- Content data (i-th content data) is divided and registered in the storage means.
- the content from the time when the split button is operated for the second time to the operation of the input start / end button and the reading of the input start / end dot pattern 871 in other words, from the time when the input of the content data is completed.
- the data is divided and registered in the storage means as third content data (N + 1th content data).
- control unit of the input / output device 816 is configured to operate the division button formed on the surface of the medium by the operation of the division button further provided in the input / output device 816 or the optical reading unit during the input of the content data.
- N is a natural number
- the division button formed in a predetermined area on the medium surface by the operation of the division button or the optical reading means Content data up to the time when the dot pattern 812 is read is divided and registered in the storage means as first content data, and then the division button is input at least once during the input of the content data.
- control unit divides and registers the content data
- the content data is registered in the content file together with the first file name indicating the content data itself.
- the first to third content data registered separately as described above are respectively unique.
- the second file name indicating the content data to be subsequently divided and registered is registered in the storage means.
- the content file when the content data is continuously output, the content file is divided and associated with the code value and / or the coordinate value without being registered in the link table. Can be used as instruction information indicating the location of content data to be output after outputting desired content data. Therefore, even when content data is continuously output with the above configuration, at least one set of content data registered in association with the code value and / or coordinate value in the link table registered in the storage means is provided. Also good.
- the second file name indicating the content data to be registered next can be arbitrarily related separately from the division / registration.
- a third file name indicating the previously registered content data is registered in the reverse order. It is also possible to play back continuously.
- the user first starts the input of the content data by reading the input start / end button pattern or the input start / end dot pattern 871. To do.
- the division / link dot pattern 820 formed in a predetermined area on the surface of the medium is read by operating a division / link button further provided in the input / output device or by optical reading means.
- the first predetermined dot pattern 826 is read.
- the “first predetermined dot pattern” refers to a dot pattern that is read first when a plurality of pieces of content data that are divided and registered are linked to a plurality of dot patterns.
- the dot pattern formed in the column 1 is the first dot pattern 826.
- the user since the user links content data related to a free position, the user can link the content data regardless of the formation position on the medium surface. It is determined by the user's operation.
- the split / link button uses any of buttons 1130a to 1130f in the same manner as the input start / end button.
- different button operations long press and double press
- the normal operation that is, the code value and / or coordinate value defined by the first dot pattern 826 is set.
- the registered link table it is confirmed whether or not the content data and / or the operation command is related and registered.
- the output of the corresponding content data and the operation according to the operation command are controlled, and when not registered, processing for connecting to the information processing apparatus is started.
- the control means of the input / output device 816 is formed in a predetermined area on the surface of the medium by the operation of the division / link button or the optical reading means after starting the input.
- Content data up to the time when the division / link dot pattern 820 is read is divided and registered in the storage means as first content data, and a first predetermined dot pattern 826 converted by the processing means.
- the code value and / or the coordinate value defined in the first content data and the registered first content data, and the link of the storage means to associate the code value and / or the coordinate value with the first content data. Register in the table.
- the division / link button is operated during input of content data, or the division / link dot pattern 820 formed in a predetermined area on the surface of the medium is read by the optical reading unit, and the optical reading unit Thus, the i-th predetermined dot pattern 828 is read.
- the “i-th predetermined dot pattern” is a concept corresponding to the first predetermined dot pattern 826, and is a dot pattern that is read in order to link content data after the first predetermined dot pattern 826. It is.
- the i-th predetermined dot pattern 828 and the first predetermined dot pattern 826 are collectively referred to as the “predetermined dot pattern” described above.
- the i-th predetermined dot pattern 828 is also arbitrarily determined by the user in the same manner as the first predetermined dot pattern 826, and the second predetermined dot pattern to be read after the first predetermined dot pattern 826,
- the third predetermined dot pattern read after the second predetermined dot pattern the value of i increases in accordance with the number of division / link operations.
- the dot pattern in the first column in the printed material 5 becomes the first predetermined dot pattern 826 or the i-th predetermined dot pattern 828.
- the control means of the input / output device 816 determines the number of operations of the division / link button N times (N when the first predetermined dot pattern 826 is read) (N Is a natural number), the content data from the time when the i-1th division is operated to the time when the i-th division is operated is divided and registered in the storage means as the i-th content data, and the i-th division
- N Is a natural number the content data from the time when the i-1th division is operated to the time when the i-th division is operated is divided and registered in the storage means as the i-th content data
- the i-th division The i-th code value and / or coordinate value to which the predetermined dot pattern 828 is converted by the processing means is associated with the registered i-th content data, and the i-th code value and / or coordinate value are related to each other.
- the association of the i-th content data is registered in the link table of the storage means.
- the input data is read by the input unit by operating the input start / end button or reading the input start / end dot pattern 871 formed in a predetermined area on the medium surface by the optical reading unit.
- the link table is referred to, the corresponding i-th content data is read from the storage means, and the output means is used. Will be output.
- the content from the last division / link to the end of input is linked to the (N + 1) th predetermined dot pattern, it is formed in a predetermined area on the medium surface by the operation of the division / link button or by the optical reading means.
- the division / link dot pattern 820 may be read to read the (N + 1) th predetermined dot pattern. Thereby, when the N + 1th predetermined dot pattern 828 is read again from the optical reading means, the N + 1th content data corresponding to the N + 1th content data is read from the storage means by referring to the link table. Will be output.
- the control means of the input / output device divides the input first after the input is started.
- a code defined in the first predetermined dot pattern 826 that is registered by dividing the content data up to the time when the link button is operated into the storage means as the first content data, and is converted by the processing means
- a value and / or coordinate value is associated with the registered first content data, and the code value and / or coordinate value and the first content data are associated with each other in the link table of the storage means.
- the content data from the time when the division / link button is operated first to the time when the division / link button is operated for the second time (Nth) is used as the second (i) content data.
- Second code value and / or coordinate value that is divided and registered in the storage means, and the second (i) predetermined dot pattern 828 is converted by the processing means, and the registered second content Data is related, and the relationship between the second code value and / or coordinate value and the second content data is registered in the link table of the storage means.
- the content data is input by the input unit by operating the input start / end button or reading the input start / end dot pattern 871 formed in a predetermined area of the medium surface by the optical reading unit.
- the link table is referred to and the corresponding first and second content data are read from the storage means.
- the output is performed by the output means.
- the third content data from the time of the second division / link button operation to the end of input is related to the third (N + 1) predetermined dot pattern, immediately after the end of input
- the third (N + 1) predetermined dot pattern 828 may be read by operating the division / link button or by reading the division / link dot pattern 820 formed in a predetermined area on the medium surface.
- the link table is referred to, and the corresponding third content data is read from the storage means and output by the output means. Become.
- a dot pattern is touched multiple times at an arbitrary timing while using the input / output device as a voice recorder, and the input moving image / image data or audio data is linked with the touched dot pattern.
- the input moving image / image data or audio data is linked with the touched dot pattern.
- the dot patterns can be used such that the moving image / image data and audio data registered in association with each other are output by the output means.
- Conventional video cameras, such as video / image / audio input / output, etc. while having the convenience as a paper medium, because the dot pattern can be printed directly on the medium with the writing tool, so you can write important points and memorize it. Compared with digital cameras, mobile phones, recording devices, etc., it is possible to provide a more convenient input / output function.
- the control means converts the code values and / or coordinate values defined in predetermined N + 1 dot patterns and the divided first to (N + 1) th content data converted by the processing means by a predetermined method.
- the relationship between the code value and / or coordinate value and the divided content data is registered in the link table of the storage means, and the i-th dot pattern 828 is read by the optical reading means Referring to the link table, it is preferable that the corresponding content data from the i-th to the N + 1 are read out from the storage means by a predetermined method and are continuously output by the output means.
- the first predetermined dot pattern 826 is read, the first content data is first output from the output means, and then the i-th content data is continuously output. Output is possible.
- link table so that the second content data, the third content data, and the fourth content data are continuously output when the second predetermined dot pattern is read.
- a link table may be created so that content data is output continuously according to the reading order, or a form corresponding to characters, figures, etc. visually formed on the surface of the medium regardless of the reading order. You may create a link table so that you can output with
- the code value and / or coordinate value defined by the dot pattern and the relationship between the content data and the content data are registered in the link table, the addresses connecting the content data to each other, and the link to the dot code itself.
- the code value and / or coordinate value for outputting the attached content data are also combined. It is also possible to output content data continuously by defining the That is, two code values and / or coordinate values are converted from this dot code.
- 11 and 12 sequentially show an example of a process for forming a stream dot pattern.
- the dot pattern according to the present invention is different from the conventional dot pattern.
- step 1 corresponding to the visible information on the surface of the medium, the reference dot 4 is continuously arranged in a line at a place where information is input / output. Place multiple.
- the reference dots 4 are arranged in a curved shape, but the arrangement of the reference dots 4 is not limited to this, and is composed of a straight line and a curved line or a plurality of line segments. Various modifications can be made to form the dot pattern in a shape that matches the area where information is input and output, such as a polygonal line.
- the reference dots 4 may be arranged on the actual lines that are visually formed on the medium surface, or the reference dots 4 may be arranged according to a predetermined rule along the actual lines.
- the real line here is a concept with respect to a virtual line, and includes all the lines that actually exist. For example, a solid line, a broken line, a dotted line, a straight line, a curved line, and the like can be mentioned.
- the dot pattern may be unevenness such as printing, display display, or a hole or groove on a metal or plastic.
- the reference dots are not limited to this, and a plurality of intervals are mixed to define a set of constant information of the dot pattern, It is also possible to define both a set of constant information of a dot pattern and a direction of the dot pattern by arrangement intervals of three different reference dots in the set of fixed information.
- a first virtual reference line 6 that connects the reference dots 4 arranged in a line is provided.
- the first virtual reference line 6 is provided by a curve, but the first virtual reference line 6 is not limited to this, and for the reference dots 4 arranged in a curved shape.
- the straight first virtual reference line 6 may be provided, or the curved first virtual reference line 6 may be provided for the reference dots 4 arranged in a straight line. That is, the second virtual reference line 7, the virtual reference point 74, and the information dot 72 in Step 3 to Step 5 to be described later are arranged according to the positions where the reference dots are connected to form a first line composed of a straight line, a broken line, and / or a curve.
- One virtual reference line 6 can be freely defined.
- the first virtual reference line 6 in the case of a curve is preferably a Bezier curve.
- reference dots on the first virtual reference line are P0 and P3, and P1 and P2 are given control points.
- points P4, P5, and P6 are obtained by dividing the three line segments P0-P1, P1-P2, and P2-P3 obtained by connecting the control points in order at a one-to-one ratio.
- points P7 and P8 are obtained by dividing the two line segments P4-P5 and P5-P6 obtained by connecting these points in order at a one-to-one ratio.
- the first virtual reference line 6 may be provided using various algorithms such as a spline curve obtained by using a spline function, an nth order polynomial, an elliptic arc, and the like, not limited to a Bezier curve.
- the second virtual reference line it is possible to define a curve using the method in the same manner as the first virtual reference line.
- a second virtual reference line 7 defined at a predetermined position from the reference dots 4 and / or the first virtual reference line 6 arranged in a line is provided.
- the second virtual reference line 7 is arranged adjacent to the reference dot 4 adjacent to a predetermined position on the vertical line with respect to the tangent line of the first virtual reference line 6 at the midpoint of the adjacent reference dot 4.
- the second virtual reference line 7 is not limited to this, and a virtual reference point is provided in accordance with an area in which information is input / output by a dot pattern, as will be described later.
- it can be defined by various methods.
- the second virtual reference line 7 may be provided only on one side with respect to the first virtual reference line 6 to define the direction of the dot pattern, or may be provided on both sides to increase the amount of information. .
- a plurality of virtual reference points 74 are provided at predetermined positions on the second virtual reference line 7.
- the virtual reference point 74 is an isosceles triangle whose bottom is the intersection of the second virtual reference lines 7, that is, a straight line connecting adjacent reference dots 4, and the second virtual reference line 7 is the opposite side.
- the position of the virtual reference point 74 is not limited to this, and it is provided at the midpoint of the second virtual reference line 7 or instead of the second virtual reference line 7.
- Various modifications such as provision on the dots 4 are possible.
- the information dot 72 is arranged at the end point represented by a vector with the virtual reference point 74 as the start point.
- one information dot 72 is arranged for one virtual reference point 74 so that the vector direction from the virtual reference point 74 is eight directions and the distance from the virtual reference point 74 is equal.
- the arrangement of the information dots 72 is not limited to this, and the information dots 72 are arranged on the virtual reference point 74, arranged in 16 vector directions, or arranged in two for one virtual reference point 74. It is possible to arrange a plurality of elements in any direction and in any length.
- the stream dot pattern according to the present invention is continuous with a line including a curve unlike the reference dot formed in a two-dimensional lattice pattern in the conventional dot pattern proposed by the present inventor. Are formed based on the reference dots arranged in this manner.
- the dot pattern is not limited by the shape of the rectangular area formed as a two-dimensional code, and is a dot pattern formed by a set of free-form constant information matched to the information area visually formed on the medium surface. Can be formed.
- the virtual reference line and the virtual reference point according to the present invention are not actually printed and formed on the surface of the medium, but only when the dot pattern is arranged on the image memory of the computer or when the dot pattern is read. Is set virtually.
- a dot pattern can be formed on a curved body such as a globe, a three-dimensional structure such as a human body model, a three-dimensional map, etc., and the present invention is not limited to a planar map or picture book. It is possible to use the input / output device according to the above.
- FIG. 14 is a diagram illustrating an example of a state in which stream dot patterns are arranged in the vertical direction.
- key dots and side dots are arranged in addition to the reference dots and information dots.
- Key dots are dots arranged at both ends of a set of fixed information.
- This key dot is a representative point of the dot pattern 1 for one region representing a group of information dots.
- the side dots are dots arranged on the positive and negative extension lines of the shift of the key dot 2.
- (B) in the figure shows reference dots and stream dot patterns arranged at equal intervals.
- the stream dot pattern according to the present invention is not limited to this, and the interval between the dot patterns may be arbitrarily set as shown in FIG. Also, the interval between the reference dots can be set arbitrarily.
- the dot pattern in which the XY coordinates are defined is formed in the information area visually formed on the medium surface without being restricted by the shape of the rectangular area when used as a two-dimensional code (used as an index). It is possible to form a dot pattern by repeating a set of constant information in a combined free shape.
- FIG. 15 shows a dot code (a) converted by analyzing a dot pattern, a link table (b) in which a code value converted from the dot code and output content data are related, and the content data
- a dot code (a) converted by analyzing a dot pattern
- a link table (b) in which a code value converted from the dot code and output content data are related
- the content data An example of a stored content file (c) is shown.
- the dot pattern is analyzed by the processing means, it is digitized and converted into a dot code as shown in FIG.
- the dot code format in which the converted dot code defines a code value (560) and a parity check is shown.
- the information defined by the dot code is not limited to the code value, and a coordinate value can be defined.
- the code value (560) is a value converted from a region value (1000110000) defining a code value excluding a region value used for parity check in the converted dot code into a decimal number.
- the link table may be configured as binary numbers without being converted to decimal numbers.
- control means refers to the link table with the code value (560), and instructs the output means to output the content data associated with the code value in the link table.
- control means When outputting content data, the control means checks the file name or content file address of the content file registered in association with the code value in the link table, reads it from the storage means, and outputs it by the output means To do.
- the content data is stored in the content file together with the file name, and the content file is registered in the storage means.
- the link table it is possible to register the file names or addresses of a plurality of content files in association with one code value.
- the highest one is output by the output means. After that, among the plurality of pieces of content data associated with the one code value, the next highest data is continuously output. When this operation is repeated and all the content data associated with one code value has been output, the continuous output of the content data is terminated.
- the content data registered in the link table may be arranged in the order of the date and time of recording, or in the order of file names, for example, in the case of audio content data. Further, the arrangement can be changed even after registration in the link table by a method described later.
- FIG. 16A is an enlarged view showing a dot pattern formed in the print area.
- the grid line connecting the reference dots 4 is represented by a solid line, but this is shown for convenience, and the original dot pattern is the same as that of FIG.
- Such a solid line does not exist like the dot pattern shown in (b).
- the information dots of the dot pattern 1 can be arranged in four directions, and the amount of information possessed by the circle area represented by the dotted line including one information dot is 2 bits.
- this dot pattern 1 When this dot pattern 1 is read by the scanner, it is analyzed by the processing means and converted into dot codes from C0 to C31.
- the parity check and code value are defined for the dot code in FIG.
- the dot code may define an XY coordinate value instead of the code value, or may define an XY coordinate value together with the code value.
- the dot code in FIG. 5C is combined with a code value (572) associated with the content data that is output first after the print area where the dot pattern is formed is read by the scanner.
- Code values (583, 560) associated with other content data are defined.
- the dot pattern 1 in addition to the first code value and / or coordinate value related to the content data, at least one or more, the second to Nth code values related to other content data and / or Coordinate values are defined.
- the value of N increases or decreases according to the number of content data defined in one dot pattern.
- control means From the code value analyzed by the processing means, the control means first instructs to output the content data associated with the code value 572 with reference to the link table.
- the control means refers to the link table and reads the content data corresponding to the first code value and / or coordinate value from the storage means. And outputting the content data corresponding to at least one or more of the second to Nth code values and / or coordinate values from the storage means in a predetermined order. The data is read out and continuously output from the output means.
- the content data associated with the code values 572, 583, and 560 is output in this order.
- Data may be output, or the number of code values defined by one dot code may be 2 or 4 or more, and the number of content data to be continuously output can be increased or decreased as appropriate. is there.
- a plurality of pieces of content data related to one code value may be used. In this case, after all the content data associated with one code value is output, control is performed so that the content data associated with the next code value is output.
- Whether to output content data continuously or only output content data having an association with a predetermined code value may be switched depending on the output mode, This mode switching is performed by a button provided on the input / output device or a paper controller.
- a dot pattern having a unique code value that differs for each photograph may be formed on a print medium on which a photograph on which several dot patterns are superimposed and printed is printed with a difference.
- a range may be divided by a predetermined area, and a dot pattern having a unique code value different for each range may be formed.
- the dot code indicates a code value (572) for indicating an association with predetermined content data, and a code value (for indicating a relationship with other content data). 556, 583).
- code value (572) associated with the content data to be output at the present time is respectively output as the code value (572) associated with the content data to be output at the present time, the code value (583) associated with the content data to be output next, and the current value.
- the control unit analyzes the dot pattern by the processing unit, converts the dot code into a code value, and then refers to the link table to determine a code value (572) unique to the dot code. ) Is read from storage means such as a hard disk and output by output means.
- the central processing unit confirms the code value (583) associated with the content data to be output next by referring to the dot code format together with the instruction to output the content data, and outputs it at the present time. After the output of the content data is completed, an instruction is issued to output the content data associated with the next code value (583).
- FIG. 16D shows that, in addition to the unique code value and the next code value, the previous code value is defined by a dot code, so that the playback mode is switched and the order of the content data is reversed. It becomes easy to perform reproduction.
- the content data associated with the specific code value is the same as the above-described method of continuously outputting the normal content data.
- the previous code value may be confirmed, and the content data associated with the previous code may be output.
- the code value associated with the content data output next to the content data output first is related to the content data output first on the dot code format. It can also be represented by a difference value with respect to the code value being set.
- next code value 583 can be expressed as +11 of 572, which is a code value associated with the first output content data.
- next code value 560 can be expressed as -4.
- the dot pattern (dot code itself) has a function as instruction information indicating other content data to be output after the desired content data is output, the content data in which the user is continuous In order to start output, it is only necessary to read one dot pattern associated with the continuous content data, and it is not necessary to read different dot patterns one after another. That is, a plurality of code values are converted from the dot code at the position.
- the dot code is not only the code value and / or coordinate value associated with the content data output by reading the dot pattern formed in each print area, but also other content data ( For example, content data to be output after content data that is currently output, or content data that has already been output before), and / or a coordinate value indicating the desired content.
- the instruction information indicates the code value of other content data to be output after the data is output. This is because the instruction information simply specifies the code value and / or coordinate value registered in association with the content data to be continuously output next. There is an effect that the order of the content data to be continuously output can be freely changed by simply changing the association in the link table.
- the user does not want to start the output from the first content data (for example, If the content up to Chapter 3 of a novel has already been listened to and the next content you want to hear is from the content of Chapter 4), even if the output of content data is started halfway
- content data can be output continuously from the content of Chapter 4.
- reverse playback can be easily performed by changing the playback mode of the content data.
- the content data output after the second time is the code value and / or coordinate value indicated by the difference value with respect to the code value and / or coordinate value for indicating the relationship with the content data output first. It is desirable to relate to That is, the dot pattern in which the content data to be output first is defined is analyzed, and in addition to the code value and / or the coordinate value for indicating the association with the predetermined content data to be output first, at least one or more A code value and / or coordinate value for indicating association with other content data is represented by a difference value.
- the code value or coordinate value for indicating the relationship between the code value or coordinate value for indicating the association with the content data to be output first and the content data output for the second time or later is the code value or coordinate for indicating the association with the predetermined content data to be output first.
- the amount of information can be saved and instruction information indicating the code value of other content data to be output after the desired content data is output can be used, for example, the range of code values that can be used can be increased. Security, XY coordinate values, etc. can be defined in the dot code.
- FIG. 17 is an explanatory diagram showing an example of a dot code format and a dot code connection table.
- control means analyzes the dot pattern by the processing means and converts it into a dot code. After the dot code is converted into a code value, the control means first refers to the link table and associates it with the code value. An instruction is issued to read out and output the content data from the storage means.
- the control means when the control means reads the i-th dot pattern from the optical reading means, the control means associates the first to Nth code values and / or coordinate values defined in the plurality of dot patterns in a predetermined order.
- the dot code concatenation table to be registered is referred to, the dot code concatenation table is referred to by the i th code value and / or coordinate value converted by the processing means, and the first to N th code values and / or After retrieving the coordinate values, the link table is referred to in order of the i-th to N-th code values and / or coordinate values, and at least two or more corresponding content data are read from the storage means and output by the output means. It will be output continuously.
- the control unit refers to the dot code connection table and the link table.
- the dot code connection table is registered in the storage unit as in the above configuration and the code values defined in the dot code are registered in association with each other.
- the storage means uses a dot code concatenation table in which code values associated with the content data are registered in a predetermined method according to the sequential output order, according to the order.
- the content data may be continuously output at least once in descending order or ascending order.
- a repeat function that outputs the content data associated with the first or last defined dot code in descending or ascending order and then continuously outputs the content data associated with the last or first defined dot code. You may have.
- FIG. 18A is a diagram illustrating an example of a link table in which a code value and a file name of a content file are registered in association with each other, and a content file in which the file name and content data are stored.
- the content data is stored in the content file, and in the link table, the location of the content data to be output is clarified by associating the code value with the content file name.
- each content file also stores a content file name to be output before and a content file name to be output next.
- a second file name indicating different content data is further registered together with a first file name indicating one content data, and the second file name indicating the different content data is registered.
- chained file names are registered so that second file names indicating different content data are chained together.
- control unit sequentially reads the content data indicated by the file names registered in a chain form in the storage unit from the storage unit, and continuously from the output unit. Will be output.
- the content file name storing the content data to be output before the currently output content data can also be stored in the content file, so that the content data can be stored in the reverse playback mode. It becomes easy to output continuously.
- the file name of the other content information can be registered by number.
- the content file name stored in the content file is not registered in the link table by associating the code value and / or coordinate value with the content data.
- code values are arranged in ascending order in the link table, and the file name of the content file is registered in association with this. Further, a range (continuous output range) for continuously outputting content data is determined and registered in advance.
- the continuous output range is code values 200-203.
- the content data associated with the code value of the first read dot code is associated with the code value within the continuous output range in ascending or descending order of the code value according to a predetermined instruction. What is necessary is just to output the content data continuously.
- the content data may be output in descending order when the content data is reversely reproduced.
- code values are arranged in descending order according to a predetermined instruction, normal reproduction of content data may be performed, or when code values are arranged in ascending order, reverse reproduction of content data is performed. Also good.
- FIG. 20 shows a diagram in which code values arranged in ascending order are associated with various content data such as audio content, URL, and moving image content.
- FIG. 21 shows a content file in which content data and a file name are stored, a link table in which a code value defined by a dot code and the content file name are registered in association with each other.
- the space where the content file name or address should be registered is the registered space.
- the content data and the code value can be linked.
- FIG. 22 and 23 illustrate an application executed on a personal computer for creating the above link table.
- FIG. 22 is a diagram illustrating a state in which an application is being executed
- FIG. 23 is a diagram illustrating a link table created by executing the application.
- an icon for displaying each content data registered in advance in the computer is displayed on the left side of the screen on the display device, and the code value is displayed on the right side of the screen.
- the link table is displayed at the center of the screen. The user inserts the displayed content data or code value into the link table in the center of the screen by dragging and dropping by an operation with a pointing device.
- code value When inserting a code value into the code value field, when the code value with the smallest value is inserted at the beginning, other code values are automatically inserted in ascending order with that code value. Also good. Of course, the code value may be converted into a decimal number and displayed.
- the association between the new content and the code value is registered in the link table in the center of the screen, the inserted numerical information is displayed in the code value column, and the file name of the content is displayed in the content column. Is displayed.
- the link table can also be created on a personal computer using a dedicated application.
- the user first starts input of content data by operating an input start / end button or reading an input start / end dot pattern 871.
- the division / link dot pattern 820 formed in a predetermined area on the surface of the medium is read by operating a division / link button further provided in the input / output device or by optical reading means.
- the first predetermined dot pattern 826 is read.
- the “first predetermined dot pattern” refers to a dot pattern that is read first when a plurality of pieces of content data that are divided and registered are linked to a plurality of dot patterns.
- the dot pattern formed in the column 1 is the first dot pattern 826.
- the user since the user links content data related to a free position, the user can link the content data regardless of the formation position on the medium surface. It is determined by the user's operation.
- the split / link button uses any of buttons 1130a to 1130f in the same manner as the input start / end button.
- different button operations long press and double press
- the normal operation that is, the code value and / or coordinate value defined by the first dot pattern 826 is set.
- the registered link table it is confirmed whether or not the content data and / or the operation command is related and registered.
- the output of the corresponding content data and the operation according to the operation command are controlled, and when not registered, processing for connecting to the information processing apparatus is started.
- the control means of the input / output device 816 is formed in a predetermined area on the surface of the medium by the operation of the division / link button or the optical reading means after starting the input.
- Content data up to the time when the division / link dot pattern 820 is read is divided and registered in the storage means as first content data, and a first predetermined dot pattern 826 converted by the processing means.
- the code value and / or the coordinate value defined in the first content data and the registered first content data, and the link of the storage means to associate the code value and / or the coordinate value with the first content data. Register in the table.
- the division / link button is operated during input of content data, or the division / link dot pattern 820 formed in a predetermined area on the surface of the medium is read by the optical reading unit, and the optical reading unit Thus, the i-th predetermined dot pattern 828 is read.
- the “i-th predetermined dot pattern” is a concept corresponding to the first predetermined dot pattern 826, and is a dot pattern that is read in order to link content data after the first predetermined dot pattern 826. It is.
- the i-th predetermined dot pattern 828 and the first predetermined dot pattern 826 are collectively referred to as the “predetermined dot pattern” described above.
- the i-th predetermined dot pattern 828 is also arbitrarily determined by the user in the same manner as the first predetermined dot pattern 826, and the second predetermined dot pattern to be read after the first predetermined dot pattern 826,
- the third predetermined dot pattern read after the second predetermined dot pattern the value of i increases in accordance with the number of division / link operations.
- the dot pattern in the first column in the printed material 5 becomes the first predetermined dot pattern 826 or the i-th predetermined dot pattern 828.
- the control means of the input / output device 816 determines the number of operations of the division / link button N times (N when the first predetermined dot pattern 826 is read) (N Is a natural number), the content data from the time when the i-1th division is operated to the time when the i-th division is operated is divided and registered in the storage means as the i-th content data, and the i-th division
- N Is a natural number the content data from the time when the i-1th division is operated to the time when the i-th division is operated is divided and registered in the storage means as the i-th content data
- the i-th division The i-th code value and / or coordinate value to which the predetermined dot pattern 828 is converted by the processing means is associated with the registered i-th content data, and the i-th code value and / or coordinate value are related to each other.
- the association of the i-th content data is registered in the link table of the storage means.
- the respective code values and / or coordinates defined in the dot pattern (the first predetermined dot pattern and the i-th predetermined dot pattern) associated with the input content data For example, a code value and / or a coordinate value defined in another dot pattern may be registered in a link table in which values are registered. For example, when it is desired to output the second content data continuously as it is after the first content data is output, the code value and / or coordinate value defined in the first predetermined dot pattern and the first For example, the code value and / or the coordinate value defined in the first predetermined dot pattern are registered in the link table associated with the content data.
- a link table in which the code value and / or coordinate value converted by the processing means is associated with the first content data is referred to. Is output based on the code value and / or the coordinate value defined in the second predetermined dot pattern registered together with the link table.
- the second content data is output by referring to another link table in which the code value and / or coordinate value corresponding to the predetermined dot pattern and the second content data are registered in association with each other.
- the second method is to define a code value and / or coordinate value together with another code value and / or coordinate value. Normally, one dot code is registered with one code value and / or coordinate value and a parity check. However, when content data is continuously output, two or more code values and / or Or it is desirable to define coordinate values.
- the predetermined range of the dot code obtained by analyzing the third predetermined dot pattern by the processing means is set to the sixth predetermined data. This is used as an area for defining code values and / or coordinate values defined in the dot pattern.
- the third predetermined dot pattern When the third predetermined dot pattern is read again, processing based on the dot code converted by the processing means, that is, in the present embodiment, there is a dot code defined in the third predetermined dot pattern.
- the code value and / or coordinate value of the third predetermined dot pattern is defined in the portion, and the code value and / or coordinate value of the sixth predetermined dot pattern is defined in the other portion.
- the third content data is output by referring to the link table based on the code value and / or the coordinate value corresponding to the third predetermined dot pattern, and then corresponding to the sixth predetermined dot pattern.
- the sixth content data is output by referring to the link table based on the code value and / or the coordinate value.
- the above-mentioned sixth predetermined dot pattern is used. It is desirable to represent the defined code value and / or coordinate value as a difference value between the code value and / or coordinate value defined in the third predetermined dot pattern.
- the content data output after the second time is the code value and / or the code value indicated by the difference value with respect to the code value and / or the coordinate value for indicating the relationship with the content data output first. It will be related to the coordinate value.
- the code value or coordinate value for indicating the relationship between the code value or coordinate value for indicating the association with the content data to be output first and the content data output for the second time or later is the code value or coordinate for indicating the association with the predetermined content data to be output first.
- a third method includes using a dot code connection table that registers at least one code value defined in the first predetermined dot pattern and / or the i th predetermined dot pattern. . That is, a dot code connection table that registers at least one code value defined in the first predetermined dot pattern and / or the i th predetermined dot pattern is further registered in the storage means.
- control unit refers to the link table associated with the code value converted by the processing unit and registers the first content data or Output the i-th content data from the output means, and refer to the dot code concatenation table, further relate to the code value and link to another code value registered in the dot code concatenation table
- the first content data or the i-th content data registered in the table is continuously output from the output means.
- the control means refers to the dot code connection table and the link table and obtains desired content data. After the output, the next content data can be output continuously. Further, since it is only necessary to check the connection of code values with reference to the dot code connection table, content data to be continuously output can be read and output without being limited to the information amount of one dot code. .
- the storage means uses a dot code concatenation table in which code values associated with the content data are registered in a predetermined method in accordance with the order in which the code values are output in sequence. Accordingly, the content data may be continuously output at least once in descending order or ascending order.
- a file name indicating other content data is stored together with a file name unique to the content file in the content file including the content data and the file name of the content. That is, in the content file composed of the first content data or the i-th content data and the file name, a file name indicating at least one other content file is stored together with the file name unique to the content file, and the dot is again displayed.
- the control unit refers to the link table associated with the code value converted by the processing unit, and registers the registered first content data or i-th content data.
- the first content data or the i-th content data stored in the other content file with reference to the file name indicating the other content file stored in the content file is output from the output means.
- the output means outputs continuously.
- the content file name stored in the content file is read regardless of the code value or XY coordinate value defined by the dot code, and the desired content is read.
- Instruction information indicating the location of content data to be output after the data is output can be used. Therefore, even when content data is continuously output with the above configuration, the content data registered in association with the code value in the link table registered in the storage unit may be one.
- the input end is defined by the input start / end dot pattern described above. This is performed by an operation command registered in association with the code value and / or coordinate value, or by operating any button provided in the input / output device. That is, the input start / end button operation and / or the input start / end dot pattern formed in a predetermined area on the medium surface is read by the optical reading means, and the input of the content data by the input means is ended. become.
- the content from the last division / link to the end of input is linked to the (N + 1) th predetermined dot pattern, it is formed in a predetermined area on the medium surface by the operation of the division / link button or by the optical reading means.
- the division / link dot pattern 820 may be read to read the (N + 1) th predetermined dot pattern.
- the link table is referred to, the corresponding N + 1-th content data is read from the storage unit and output by the output unit. It will be.
- the dot pattern is read by the optical reading means.
- first content data is first output from the output means, and then at least one or more i-th content data related by the above-described method is continuously output. Is done.
- the fifth predetermined dot pattern is read, the fifth content data is output from the output means, and subsequently, for example, the sixth and seventh content data are continuously output.
- FIG. 24 shows another dot pattern example (GRID5).
- FIG. 24A shows the positional relationship among the reference point dots 73a to 73e, the virtual reference points 74a to 74d, and the information dot 72 in the dot pattern.
- the dot pattern defines the direction of the dot pattern depending on the shape of the block.
- reference point dots 73a to 73e are arranged.
- a shape (in this case, a pentagon facing upward) indicating the direction of the block is defined by a line connecting the reference point dots 73a to 73e in order.
- virtual reference points 74a to 74d are defined based on the arrangement of the reference point dots 73a to 73e.
- a vector having a direction and a length is defined starting from each of the virtual reference points 74a to 74d.
- an information dot 72 is placed at the end point of the vector.
- the direction of the block can be defined by the arrangement method of the reference point dots 73a to 73e.
- the size of the entire block is also defined.
- FIG. 24B shows an example in which information is defined depending on whether or not there is an information dot 72 on the virtual reference points 74a to 74d of the block.
- FIG. 24 (c) shows an example in which two GRID5 blocks are connected in the vertical and horizontal directions.
- the direction in which the blocks are connected and arranged is not limited to the vertical and horizontal directions, and may be arranged and connected in any direction.
- the reference point dots 73a to 73e and the information dot 72 are all shown as the same shape, but the reference point dots 73a to 73e and the information dot 72 may have different shapes.
- the dots 73a to 73e may be larger than the information dot 72.
- the reference point dots 73a to 73e and the information dot 72 may have any shape as long as they can be identified, and may be a circle, a triangle, a quadrangle, or a polygon more than that.
- FIG. 25 is an image diagram showing a handwriting input operation in the usage state of the present invention.
- the document as written is displayed on the display 303.
- the C-MOS camera built in the input / output device 816 captures the dot pattern on the written locus, and the processing means analyzes the digitized information (dot code) defined by the dot pattern, This is realized by outputting characters as information corresponding to the digitized information.
- a code value written (read) in the input / output device 816 is a first mode in which a trajectory is recognized from a code value and / or coordinate value written in the input / output device 816, and the trajectory is transmitted to the information processing apparatus 1002.
- a fourth mode of transmission is conceivable.
- the input / output device 816 is connected to the information processing device 1002 by wireless or wired, and the input / output device 816 accepts a handwriting input operation by a user and is continuously performed by an optical reading unit.
- Code values and / or coordinate values defined in the dot pattern to be read are transmitted to the information processing apparatus 1002 one after another.
- the information processing apparatus 1002 includes a discrimination unit that discriminates a handwriting input operation, a character including a plurality of character types such as hiragana, katakana, kanji, alphanumeric characters, and symbols as a recognition result obtained by receiving the handwriting input operation.
- Character recognition means for recognizing a character string
- storage means for registering a link table for registering the character or character string with content data and / or an operation command
- output means for outputting the content data
- the determination a control means for controlling an operation by the output means and / or an operation by the operation command.
- the information processing apparatus 1002 determines the acceptance of handwritten input by the user based on the operation determination code defined in at least a part of the code values transmitted one after another from the input / output device 816, and changes the coordinate values.
- the information processing apparatus 1002 determines the acceptance of handwritten input by the user based on the operation determination code defined in at least a part of the code values transmitted one after another from the input / output device 816, and changes the coordinate values.
- the information processing apparatus 1002 determines the acceptance of handwritten input by the user based on the operation determination code defined in at least a part of the code values transmitted one after another from the input / output device 816, and changes the coordinate values.
- Whether or not handwriting input is accepted is preferably determined by an operation determination code, but when a continuous dot pattern is read within a predetermined coordinate value, a handwriting input operation is performed. You may make it judge and start reception of handwritten input.
- touch input operation when the user touches a desired position on the medium with a pen-type scanner (referred to as “touch input operation” in the present invention), information corresponding to the dot pattern printed at the touched position is output.
- the user traces the dot pattern on the traced trajectory sequentially by tracing with a pen-type scanner so that the user performs handwriting on the medium with a pen (referred to as “handwriting input operation” in the present invention). It is possible to realize both operations of recognizing and outputting information corresponding to the trajectory. That is, without performing any special operation at the start, it is recognized that the handwriting input operation is started by simply touching the writing area with the pen-type scanner and tracing, and the processing is executed.
- the input / output device 816 is connected to the information processing device 1002 wirelessly or by wire, and the input / output device 816 accepts a user's handwriting input operation and is continuously read by the optical reading means.
- the locus is recognized from the change in the coordinate value defined in the dot pattern, and the locus is transmitted to the information processing apparatus 1002.
- the information processing apparatus 1002 includes a character recognition unit that recognizes a character or a character string including a plurality of character types such as hiragana, katakana, kanji, alphanumeric characters, and symbols as a recognition result obtained by receiving a handwriting input operation; Storage means for registering a link table that registers characters or character strings in association with content data and / or operation instructions, and outputs character codes or character string codes converted from the characters or character strings and / or the content data Output means, and character recognition means, storage means, control means for controlling operation by the output means and / or operation by the operation command.
- a character recognition unit that recognizes a character or a character string including a plurality of character types such as hiragana, katakana, kanji, alphanumeric characters, and symbols as a recognition result obtained by receiving a handwriting input operation
- Storage means for registering a link table that registers characters or character strings in association with content data and / or operation instructions, and outputs character
- the information processing apparatus 1002 recognizes the character or character string corresponding to the locus transmitted from the input / output device 816 by the character recognition unit, converts the character or character string into a character code or character string code, and the character code or character string code. Is output from the output means and / or content data corresponding to the character or character string is output from the output means of the information processing apparatus with reference to the link table, or the operation according to the operation command is controlled. Will do.
- the input / output device 816 receives a handwriting input operation by a user, and as a recognition result obtained by receiving the handwriting input operation, a plurality of character types such as hiragana, katakana, kanji, alphanumeric characters, symbols, and the like
- a table is further registered, the locus is recognized from the change in coordinate values defined in the dot pattern continuously read by the optical reading means, and the character or character string corresponding to the locus is recognized by the character recognition means.
- Content data corresponding to the character or character string recognized by the character recognition means with reference to the link table Whether to output from the output unit will control the operation of the the manipulation instruction.
- the input / output device 816 is connected to the information processing device 1002 wirelessly or by wire, and the input / output device 816 receives a handwriting input operation by a user and receives the handwriting input operation.
- character recognition means for recognizing characters or character strings including a plurality of character types such as hiragana, katakana, kanji, alphanumeric characters, symbols, etc., and dot patterns that are continuously read by the optical reading means
- a trajectory is recognized from the change in the coordinate values defined in the above, a character or character string corresponding to the trajectory is recognized by the character recognition means, and the recognized character or character string is converted into a character code or character string code.
- the character code or character string code is transmitted to the information processing apparatus 1002.
- the information processing apparatus 1002 causes the character code or character string code transmitted from the input / output device 816 to be output from the output unit and / or refers to the link table of the information processing apparatus, and the character code or character string code The corresponding content data is output from the output means of the information processing apparatus or the operation according to the operation command is controlled.
- FIG. 26 is a block diagram showing an example of various processes in the present invention, that is, processes performed in the above-described input / output device or information processing device.
- an optical reading unit reads a dot pattern printed on a medium surface
- a processing unit analyzes digitized information from the dot pattern
- a control unit determines an operation performed by a user based on the digitized information.
- information corresponding to the digitized information is output with reference to the table.
- the voice corresponding to the digitized information is output from the output means, or the code value and / or coordinate value is transmitted to the information processing apparatus.
- the locus is recognized from the coordinate information in the digitized information, and information corresponding to the locus is output (or the locus itself is signaled and output to the information processing apparatus, Information corresponding to the trajectory is output in the information output device).
- FIG. 27 is a diagram illustrating a format using at least a part of a code value as an operation determination code among the dot pattern formats.
- the operation determination code is a code for the determination means to automatically determine whether the operation performed by the user is a touch input operation or a handwriting input operation. Although not shown, the operation determination code is converted from a dot code. When the operation determination code is “0”, the determination unit performs a determination such as a touch input operation, and when the operation determination code is “1”, a handwriting input operation.
- the operation determination code may be 2 bits or more so that more than one operation can be automatically determined.
- the input / output device further includes a determination unit that determines whether the user has accepted the handwriting input operation. Based on such an operation determination code, the control unit accepts the handwriting input operation by the optical reading unit. Each time a dot pattern is read, it is determined by the determining means.
- the operation determination code can be read just by touching without being traced with the scanner pen, and the acceptance of the handwriting input operation can be started more accurately and quickly.
- the handwriting input operation can be prevented from being immediately accepted by the operation determination code. Normally, it takes time to calculate whether the read code value and / or coordinate value is registered in the link table, and the handwriting input is accepted only after tracing the pen in the unregistered state. To do so, a high-speed CPU is required.
- Information is defined by arranging information dots with distance and direction from the reference position (first digitized information)
- information dots are arranged on the + direction line (up, down, left and right direction lines) Can be defined on the reference direction of the information dot itself (second digitized information), whether it is placed on the x direction line (on the diagonal direction line), so that the information dot is placed on the x direction line
- the second digitized information in the dot pattern of FIG. 28B is “1010010110100101”.
- the second numerical information in the dot pattern of 29 (b) is “0000000011111111”.
- the second numerical information is associated with the touch input operation or the handwriting input operation, it is possible to automatically determine the operation performed by the user.
- the input / output device may be provided with a handwriting input start / end button, and the operation may be switched by operating the button.
- the input / output device automatically determines the operation based on the dot pattern format. Even if it has a function, there is no need to change the mold, so that it is most preferable in terms of manufacturing cost.
- the already provided button may be switched to the handwriting input start / end button according to the operation mode, or may be used as the handwriting input start / end button depending on the operation method. It may have a function.
- a handwritten input start / end dot pattern formed in an area other than the area to be written may be read, and the handwriting input operation and the touch input operation may be switched by an operation command defined in the dot pattern.
- the same area can be used as a writing area when content data and / or operation commands are associated with code values and / or coordinate values.
- the writing area requires coordinate values to draw a trajectory, and the coordinate values require many different dot codes. Therefore, in order to effectively use the limited dot codes, the coordinates used in different writing areas are also used. Can use the same dot code to specify the writing area by each handwritten input start / end dot pattern.
- FIG. 30 shows a format in which 2 bits are used as a write area specifying code among the code values converted from the dot code defined in the dot pattern.
- the writing area specifying code is a code for the control means to specify the writing area when the user performs a handwriting input operation.
- the dot pattern defines at least coordinate information, but it is necessary to search the entire coordinate system where the optical reading means has read the medium surface only with the coordinate information. Therefore, it takes time for the processing in the control means.
- FIG. 31 is an image diagram showing a case where the write area specifying code is used
- FIG. 32 is an image diagram showing a case where the write area specifying code is not used.
- the writing area specifying code As shown in FIG. 31, by using the writing area specifying code, it is possible to search only in the specified writing area and specify the coordinates of the optical reading means, but the writing area specifying code as shown in FIG. When is not used, it is necessary to specify the coordinates of the optical reading means from the entire coordinates.
- the search range is one-fourth that of FIG. 32, so the coordinate search speed is up to 4 times.
- the writing area specifying code when used, what is the shape of the writing area (for example, when the illustration is superimposed and printed, the shape along the actual line constituting the illustration). However, the same analysis efficiency can be exhibited.
- the writing area identification code As described above, by using the writing area identification code, you can read the writing area identification code just by touching and start accepting handwriting input operations more accurately and quickly, without tracing with a scanner pen. Since it is possible to specify whether writing is performed in the writing area, for example, if the writing area is an address field, it is possible to easily recognize a character or a character string by comparing the written locus with an address database (dictionary). That is, by specifying the writing area, it is possible to specify a dictionary limited to the character or character string to be written, and to greatly improve the character recognition rate. Of course, you can read the writing area identification code just by touching, so if you use a high-speed CPU, you can also recognize characters in real time while tracing the pen.
- dictionary address database
- a writing area specifying code that improves the analysis efficiency is used, for example, when performing a handwriting input operation on different writing areas A and B formed on the medium surface and performing character recognition, writing to A is started first, After that, when writing to B is started, and then the rest is written to A and then written to B again, the order of writing is stored and linked, and the writing area A or B is accurately written. Writing recognition and character recognition are possible.
- FIG. 33 is a cross-sectional view showing the tip of an input / output device used for handwriting input.
- Such an input / output device includes a light guide 306 having a hollow portion formed therein and having an opening at the tip thereof, a lens 1126 disposed at a position facing the opening of the light guide 306, and the same surface as the lens 1126.
- An IRLED 1122 serving as a light source for irradiating the medium surface on which the dot pattern is formed with a predetermined wavelength, a C-MOS sensor 309 disposed at a position retracted from the lens 1126, and a PCB 1331 at a further retracted position.
- a CPU (not shown) installed therein.
- the hollow portion of the light guide 306 is formed in a tapered shape that gradually increases in diameter from the lens 1126 toward the opening.
- the input / output device is equipped with a pen 311 as a writing instrument.
- a writing tool such as a normal pen
- the outer periphery of the input / output device is formed to be tiltable up to 45 degrees because it is used in a tilted state.
- by picking up an image of the medium surface near the tip of the pen 311 it is possible to accurately analyze the handwriting, the moving distance, and the like when printing the pen 311 at a position away from the image pickup center.
- the pen 311 as a writing instrument can be stored by various methods so that no handwriting is left on the medium.
- a technique used in a general pen such as a ballpoint pen can be used as it is.
- a knock type or rotary type storage method may be employed, or a cap may be put on.
- the pen can be changed like a general three-color ballpoint pen.
- the pens of different colors may be replaced, but an eraser or a correction liquid may be used instead of the pen.
- an instruction protrusion (stylus pen) may be provided to image the vicinity of the handwriting of the instruction protrusion.
- a pen 311 may be stored by providing a storage space in the instruction protrusion and used as the instruction protrusion.
- a storage space may be provided in the input / output device body.
- the XY coordinate value defined by the dot pattern captured by the imaging means and the XY coordinate value defined by the dot pattern on the locus actually written by the pen 311 are different. Furthermore, the XY coordinate value defined by the dot pattern on the locus needs to be converted into the xy coordinate value in the writing area on the medium surface to perform writing input and operation instruction.
- the XY coordinate value of the dot pattern imaged by the input / output device is corrected using the method of correcting the dot pattern on the locus actually written by the pen 311 and the writing area coordinate system from the XY coordinate value of the dot pattern coordinate system.
- a method of converting to xy coordinate values will be described.
- the writing area coordinate system is (0,0) in the lower left corner.
- the xy coordinate value of the writing area is expressed in mm.
- the coordinate position of (16, 40) indicates a position moved 16 mm to the right and 40 mm upward from the lower left corner of the writing area.
- a dot pattern block in which one set of XY coordinate values of the dot pattern coordinate system is defined is continuously formed.
- the XY coordinate value indicates the position of the center point of the block.
- it is expressed as [X, Y].
- a dot pattern in which XY coordinate values are defined is formed on the entire surface of the paper, and a unique code value is defined in the writing area in addition to the XY coordinate values.
- the XY coordinate value of the lower left corner of the writing area is [Xn0, Yn0] (n is a number specifying the writing area).
- the XY coordinate values are converted into the writing area coordinate system as follows.
- the number u of pixels constituting an interval between the block center P [Xp, Yp] closest to the imaging center C and the imaging center C is obtained.
- FIG. 39 is a diagram for explaining a method for obtaining an imaging center when a dot pattern is imaged by a camera.
- the dot pattern is captured as image data by the camera, after calculating the XY coordinate value at the center position of the block, the direction of the dot pattern obtained from the key dot and the increment value of the XY coordinate value at the adjacent block center position are used. Then, the x and y coordinate values of the imaging center are calculated by interpolating the coordinate values from the distances ⁇ x and ⁇ y from the center position where the XY coordinate values are calculated to the imaging center position.
- the configuration of the input / output device includes a link table for associating and registering code values and / or coordinate values with content data and / or operation commands, and storage means for registering the content data and / or operation commands. And an optical reading means for reading the dot pattern formed on the medium surface, and a processing means for analyzing the dot pattern from the image information of the dot pattern read by the optical reading means and converting it into a code value and / or coordinate value
- the configuration of the apparatus includes a link table in which the code value and / or coordinate value transmitted from the input / output device through the connection means and the content data and / or operation instruction are registered in association with each other, and the content data and / or operation instruction.
- the information processing device may include an output unit, or information processing A separate output device may be connected to the device, and content data may be output by the output device.
- the corresponding content data may be output by the input / output device.
- An information input / output system including the input / output device and the information processing device as described above, wherein the control means of the input / output device recognizes whether or not the connection recognition means recognizes the connection between the connection means and the information processing device.
- the connection recognition unit recognizes the connection between the connection unit and the information processing apparatus, the code value and / or the coordinate value converted by the processing unit or the code value and / or the coordinate
- the operation command registered in association with the value is transmitted to the information processing apparatus through the connection means, and the code value and / or the coordinate value or the code value and / or the coordinate value is related in the information processing apparatus.
- the connection recognition unit does not recognize the connection between the connection unit and the information processing apparatus, the content data is stored. Whether to output from the output means, to control the operation by the manipulation instruction.
- the function as an input device depending on the software of the information processing apparatus is enabled when connected to an information processing apparatus (including a personal computer, the same shall apply hereinafter) while allowing independent input / output of information when used alone. It is possible to realize an information processing system using an input / output device having high convenience.
- FIG. 40 is a diagram for explaining another embodiment of the input / output device according to the present invention.
- This illustrated example (a) shows an outline when the input / output device is a speaking pen, and in the illustrated example (b).
- the configuration of the speaking pen is represented by a block diagram.
- the speaking pen includes a volume control button, a seesaw button (upper side), a seesaw button (lower side), a push button, a pen tip switch, a microphone, a speaker, an LED, a CMOS sensor, a flash ROM, a firmware, and an MPU. It is comprised by.
- the input / output device in the present embodiment is a speaking pen capable of reproducing and recording audio, and the main functions are audio reproduction and recording and linking.
- the reproduction function when the speaking pen reads the dot pattern, the voice related (linked) by the above-described method is reproduced by the built-in speaker.
- the recording function saves the voice recorded with the built-in microphone and links it with the code value defined in the dot pattern.
- the recorded voice can be reproduced by the reproduction function.
- the pen tip is equipped with a pen tip switch, and the dot pattern is analyzed only when the printed matter is read, thus saving power.
- the present speaking pen reads the dot pattern and reproduces the audio associated with the code value and / or coordinate value defined in the dot pattern. If no audio is linked to the link table, nothing is done.
- the present speaking pen plays the currently selected audio (active file) when the push button is pressed.
- the index number 1 of the audio file is selected when the power is turned on. It is desirable to set so that the active file does not change no matter how many times the push button is pressed.
- the active file refers to the file that was played back immediately before, or, as will be described later, the first file that was cued immediately after pressing and holding the seesaw button, or the file that was just recorded.
- dot pattern If the dot pattern is read during music playback, playback stops and the corresponding audio file is played back. When the dot pattern is read, if there is no corresponding audio file or analysis fails, playback is not stopped.
- the speaking pen stops recording.
- the recorded audio file is saved at the end of the index. As described above, this file is an active file.
- the seesaw button provided on the speaking pen.
- the seesaw button (down) is pressed, the audio file with the index number next to the active file is played.
- the active file is also changed after one. If the seesaw button (lower side) is pressed when the last audio file (index number last) is an active file, the process returns to the first audio file (index number 1).
- the audio file with the index number before the active file is played.
- the active file is also changed one before.
- the seesaw button (upper side) is pressed when the first audio file (index number is 1) is an active file, the process returns to the last audio file (index number last).
- the active file is returned to index number 1 and the corresponding audio file is played.
- FIG. 41 is a diagram for explaining the outline of the paper controller.
- dot patterns used to implement the functions such as recording, playback, stop, link start / end, previous playback, next playback, head / playback, tail / playback, the paper controller described above.
- dot patterns used for fast-forwarding, pausing, releasing links, and erasing audio files are printed, and in addition, visible information corresponding to these dot patterns is printed.
- an operation corresponding to the read dot pattern is performed by an operation command related to the code value and / or coordinate value defined in the dot pattern.
- the extended function is executed by reading a specific dot pattern. That is, a function expansion paper controller is prepared separately, and the mode change of the following functions can be performed by the controller.
- multiple audio files can be linked to one read dot pattern.
- different audio files can be linked and reproduced for each code value obtained by converting the dot code defined in the dot pattern and for each reading angle.
- the range of corresponding angles is (1) 2 types “271 to 90 degrees, 91 to 270 degrees”, (2) 4 types “316 to 45 degrees, 46 to 135 degrees, 136 to 225” Degrees, 226 degrees to 315 degrees ", (3) 8 types" 33 degrees to 22 degrees, 23 degrees to 67 degrees, 68 degrees to 112 degrees, 113 degrees to 157 degrees, 158 degrees to 202 degrees, 203 degrees to 247 degrees 248 ° to 292 °, 293 ° to 337 ° ”, in the case of (3), even when the same dot pattern is read, the audio file A is played when the reading angle is 0 ° and the audio file B is read at 45 °. Can be played.
- the link in this angle correspondence mode is performed by the paper controller and can be selected for each angle range.
- one voice file can be linked to the code value of the read dot pattern, and another voice file can be linked to the coordinate value and played back.
- Priority can be selected with the paper controller, such as whether to link to the code value or coordinate value defined in the dot pattern, or to link to the code value + coordinate value.
- multilingual mode multiple audio files can be linked to the read dot pattern and played back.
- the mode in which the speaking pen is moved is determined by touching the paper controller.
- the speaking pen has both a function as an input / output device that depends on the information processing device and a function as an input / output device that can be used in a stand-alone manner depending on whether the information processing device such as a PC is connected. Can be realized.
- the function as an input / output device depending on the information processing device is realized when connected without operating any of the above buttons.
- the functions as an input / output device depending on the information processing device include a normal mode and a mouse mode, and these two functions can be switched by operating a seesaw button (upper side).
- the power is turned on and off by long-pressing the push button, and the other buttons and operations other than long-pressing the push button are entrusted to the function of the application on the information processing apparatus side.
- Recommended usages are: (1) Determine the push button, start playing the active content, end the currently playing content, pause, and (2) the menu active item on the seesaw button (upper) Return to the previous page, return to the UNDO function, answer no, cancel, (3) move the menu active item forward to the seesaw button (lower), advance the UNDO function, answer yes, exit, etc.
- a method is conceivable.
- a driver or GAM described later can be automatically installed in the information processing apparatus.
- the speaking pen is recognized as a USB memory by the information processing device, and link files and audio files can be moved and copied. At this time, when a plurality of files are registered on the speaking pen side, the last registered file becomes the active file.
- FIGS. 42 and 43 show one embodiment in which a scanner according to the present invention, an index table, a server management table, and the like are applied, in the form of a distribution document as a technical introduction.
- Grid put (trade name).
- GAM Grid Application Manager
- PC personal computer
- (1) to (5) and (7) show actual operation examples. That is, as shown in (1) of FIG. 42, the user accesses the CD-ROM or the Internet distribution server and executes the downloaded installation program on the personal computer (PC), and executes GAM on the OS (operating system). And register the driver program as a resident program.
- the application program bundled in the GAM and content data such as images and moving images are also installed in the hard disk device (HD).
- the photographed image (dot pattern) is read into a personal computer (PC) via a USB cable and developed in a video memory (VRAM).
- the GAM read into the central processing unit (CPU) decodes the captured image (dot pattern) into a dot code.
- a screen prompting the user to input personal information corresponding to the tag is displayed on the display device (DISP) of the personal computer (PC).
- DISP display device
- PC personal computer
- Register personal information such as address, credit card number, etc.
- the personal information input in this way is registered in the management server table and used for subsequent authentication.
- the tag is scanned by the scanner to perform authentication at the management server.
- the GAM is started up.
- the paper medium or paper controller on which the dot pattern is printed is scanned (read) by the scanner, the dot pattern is photographed, and the photographed image data is input to the personal computer.
- the code (code number) is decoded.
- the GAM dot code management table (index table) is referenced based on this dot code (code number).
- the dot code code number
- the content data is already installed in the personal computer (PC)
- the content data is read out. Played. If the content data is a moving image or an image, the movie or image is displayed on the display device (DISP) by a moving image reproduction application program or an image display program corresponding to the content data.
- the Internet It refers to the dot code management server above.
- a dot code (code number) is registered in the management server table of the dot code management server, according to the instruction (command) for the dot code (code number), the specified web server (1 ) Download content, specifically download content from server A, (2) Stream video distribution, specifically data distribution from server B as streaming distribution server, (3) Web browsing, specific Download of the Web file designated by the address (URL) of the server C is automatically started.
- the server A, B or C on the Internet is not accessed again, and the dot code management table (index table) including newly added data is stored. Based on this, the content data downloaded in the hard disk device (HD) of the personal computer is reproduced.
- the map in this embodiment is visibly provided with various lines representing traffic information including a contour line indicating the width of the road, a center line indicating the road, characters and character strings, and the like.
- a center line indicating the center is virtually defined.
- a plurality of reference dots are continuously arranged on the lines at a predetermined interval, and first virtual reference lines connecting the reference dots arranged in a line are respectively shown in the example shown in FIG. It is defined on various lines representing traffic information such as the contour line indicating the width of the visible road, the center line indicating the road, the character and the character string, or the virtual center line indicating the center of the road. Yes.
- the reference dot is not arranged on the center line indicating the road consisting of the dotted line, but a linear reference dot is provided along the center line, and the first virtual reference line is set. And a second virtual reference line and a virtual reference point may be defined on the center line.
- the optimum dot spacing, number and size are determined in advance from the length of roads indicated by straight lines, broken lines, curves, solid lines, various dotted lines, thick lines, double lines, etc., and stream dot patterns are formed. It becomes possible to do.
- 44 (a) and 44 (d) are diagrams showing examples in which stream dot patterns are formed on character strings “Chuo-dori” and “Mansei of Meat”, respectively. It is a figure which shows the example in which a stream dot pattern is formed on the character ".”
- a stream dot pattern is formed on the character string “Meat of the Meat”. Therefore, when the user touches an arbitrary position of the character string, the store guidance and the parking space are free. Information related to the character string, such as information and service information, can be output.
- FIG. 44 (c) is a diagram showing an example of a dot pattern formed along a real line indicating JR Akihabara Station composed of a plurality of line segments.
- FIG. 44 (f) is a diagram showing an example in which a stream dot pattern is formed on a real line representing a curved line
- FIG. 44 (h) is a stream dot pattern formed on a road outline consisting of a broken line. It is a figure which shows an example.
- FIG. 44 (i) shows an example in which a stream dot pattern is formed on two visible contour lines representing a road and a virtual center line indicating the center of the road defined at the center of the contour line.
- the road width When the road width is narrow, it is sufficient to form a stream dot pattern along the outline only to input and output information. However, when the road width is wide, the stream dot pattern is at the center as shown in this example. It is desirable that the information can be read by touching either the left or right contour line or the center with a scanner.
- the two visible contour lines representing the road and the dot pattern on the virtual center line indicating the center of the road defined at the center of the contour line may be the same.
- the dot pattern may be different in order to define different information on the left side, the right side, and the center of the road supplement.
- FIG. 44 (g) is a diagram showing an example in which a stream dot pattern is formed on a real line representing a road composed of thick lines.
- a grid map with excellent convenience By defining a road name in the code information converted from the dot code defined in the stream dot pattern as described above, or by associating related information, a grid map with excellent convenience (maps using dot patterns) Provisional name) can be provided. Further, if a stream dot pattern is formed at a predetermined position along characters and character strings indicating various map information such as place names, facilities, and intersections, and related information is related, detailed information on the map can be easily acquired. Furthermore, since detailed information can be acquired, it is possible to provide an easy-to-see map by expressing or deleting characters and character strings indicating map information as concisely as possible.
- the icon part is printed at the bottom of the map, and "up”, “right”, “down”, and “left” are used to move the electronic map displayed on the display connected to the input / output device. It is also possible to provide a function as each icon of “enlarge”, “standard”, and “reduce” to change the size of the “return” icon and the electronic map.
- map section not only information on roads but also symbols for displaying other tourist facilities may be printed.
- a dot pattern representing XY coordinates corresponding to the location of the tourist facility is printed, and in addition to the XY coordinates corresponding to the location of the facility, etc., information on the facility is encoded in the symbol.
- a dot pattern is overprinted.
- the information input medium is a drawing including CAD
- the drawing is picked up by a pen-type scanner (optical reading means)
- the picked-up image data is transmitted to the information processing apparatus
- the display device displays electronic data installed in the information processing device, and corresponding characters, graphics, sounds, moving images, and the like.
- electronic data, voice, or the like is not stored in the information processing apparatus, it can be downloaded from a server or another information processing apparatus and displayed on the display.
- FIG. 45 shows an example of an information input / output method using the information input drawing according to the present invention.
- icon parts printed with design information on machinery, architecture, building equipment, electrical systems, etc. and icons for instructing operations for various displays on the display device are formed at other positions on the medium. ing.
- a dot pattern indicating a code corresponding to an operation instruction is printed in the area of each icon in the icon portion, but the dot pattern printed here is not limited to the above-described stream dot pattern.
- Conventionally used rectangular dot patterns for example, a plurality of reference points that define the size and orientation of the block are provided in a block area where information dots are arranged, and a plurality of virtual points defined from the reference points are provided.
- a reference point may be arranged, and an information dot in which information is defined by a distance and a direction from the virtual reference point may be arranged.
- Streams on a virtual real line that shows the center of the object such as a visible real line that constitutes various design information, such as a contour line, an instruction line, a leader line, a dimension line, or a character and a character string
- a virtual real line that shows the center of the object, such as a visible real line that constitutes various design information, such as a contour line, an instruction line, a leader line, a dimension line, or a character and a character string
- a dot pattern is printed.
- the stream dot pattern (a) is on the line constituting the block describing the entrance floor
- the stream dot pattern (b) is on the instruction line indicating the entrance
- the outline of the 6-tatami Japanese-style room Stream dot pattern (c) on the real line representing the stream dot pattern (d) on the virtual center line indicating the center of the bathtub
- stream dot pattern (e) on the character string indicating the bathroom
- the stream dot pattern (f) is on the actual line representing the door
- the stream dot pattern (g) is on the character “4500” indicating the length of the dimension line
- the dimension line indicating the horizontal width of the 9 mm LDK is on the dimension line.
- Each stream dot pattern (h) is printed.
- a stream dot pattern may be formed on characters such as “LDK 9.5 mm”, “washing surface”, and “push-in” described in the illustrated example, or on a character string.
- a plurality of reference dots are continuously arranged in a line at a location where information on the surface of the medium is to be input / output.
- the first virtual reference line that connects the reference dots placed on the contour line, the instruction line, the leader line, the dimension line, the character and the character string, the virtual center line that indicates the center of the object, etc. It is provided so as to overlap.
- the reference dots may be provided near the various lines, and only the first virtual reference line may be defined on the lines, or the reference dots and the first virtual reference line may be provided on both sides of the various lines. Two virtual reference lines and a fourth virtual reference line may be provided on these lines.
- the icon part is printed on the left side of the drawing, and the size of the electronic data for each icon of "Up”, “Right”, “Down”, “Left” and “Back” to scroll the electronic data. "Enlarge”, “Standard”, and “Reduce” icons are printed for changing.
- any optical reading means can be used. Coordinate information and / or code information can be read at any position. Furthermore, if information (vector information) for drawing a real line in a stream dot pattern along the real line is defined, drawing / display / editing with CAD based on the read coordinate information and / or code information, and again Drawings can be output.
- a stream dot pattern is formed along the actual line indicating the object to be designed and / or characters and character strings written on the drawing, and the object type, product number, specification, color, pattern, material , Materials, mounting parts, processing methods, construction methods, work schedules, and other related information such as grid drawing (contains a drawing using a dot pattern). Provisional name) can be provided.
- the stream dot pattern is formed on a virtual center line defined near various real lines that can be visually recognized by the user, and the input / output device does not define the XY information by printing the dot pattern on the entire drawing.
- the relationship between the captured visual information and the output information becomes clear.
- the drawing (medium) in the present invention is used in conjunction with an electronic device such as a personal computer and a pen-type scanner (imaging means). That is, a pen-type scanner is connected to a computer by wire such as a USB cable, wireless communication such as infrared communication or BLUETOOTH (registered trademark).
- a pen-type scanner is connected to a computer by wire such as a USB cable, wireless communication such as infrared communication or BLUETOOTH (registered trademark).
- the CAD data address is registered in the icon printed in the vicinity of the drawing.
- the electronic data registered in the hard disk device or server of the personal computer is read out. Output on the display.
- the scanner is connected to the computer.
- the present invention is not limited to this, and the scanner may be used in conjunction with other communication devices such as a mobile phone and a PDA (Personal Data Assistant). .
- the personal computer includes a central processing unit (CPU), a main memory (MM), a hard disk device (HD) connected by a bus, a display device (DISP) as output means, and a keyboard as input means. (KBD).
- CPU central processing unit
- MM main memory
- HD hard disk device
- DISP display device
- KD keyboard as input means.
- USB I / F USB interface
- a printer In addition to the display device (DISP), a printer, a speaker, or the like may be connected as an output device.
- DISP display device
- a printer In addition to the display device (DISP), a printer, a speaker, or the like may be connected as an output device.
- the bus (BUS) is connected to a general-purpose network (NW) such as the Internet via a network interface (NW I / F), and includes electronic drawing data, character information, image information, audio information, video information, and a program. Etc. can be downloaded from a server (not shown).
- NW general-purpose network
- Etc. can be downloaded from a server (not shown).
- HD hard disk
- OS operating system
- application programs such as a dot pattern analysis program used in this embodiment, electronic CAD data, character information, image information, audio information, moving image information, various tables, etc. Is registered.
- the central processing unit sequentially reads and executes application programs in the hard disk via the bus (BUS) and the main memory (MM), reads out the data, and outputs and displays it on the display device (DISP).
- the functions described in this embodiment are realized.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- Toxicology (AREA)
- General Health & Medical Sciences (AREA)
- Electromagnetism (AREA)
- Position Input By Displaying (AREA)
- Computer And Data Communications (AREA)
Abstract
Description
(X×L+L/2,Y×L+L/2)となる。
なお、図36のように、書き込み領域の左下隅を座標系の原点(0,0)とし、〔0,0〕を定義したドットパターンのブロックの中心点と原点を一致させると、
(X×L,Y×L)となる。
((X-Xn0)×L,(Y-Yn0)×L) となる。
4 基準ドット
5 印刷物
6 第一の仮想基準線
7 第二の仮想基準線
8 センサ部
10 記憶手段
11 本体処理部
12 処理手段
13 赤外線発光手段
15 出力手段
16 通信カード
17 入力手段
22 接続認識手段
23 サーバ
24 GPS
25 液晶モニタ
27 制御手段
33 光学読取手段
38 接続手段
40A マウス
41 マウス本体
41C 開口部
42 ポインタ光源
42A 読取点
43 スイッチ
44 CCDカメラ
58 イヤホン
72 情報ドット
73 基準点ドット
74 仮想基準点
302 印刷媒体
303 ディスプレイ
306 ライトガイド
309 C-MOSセンサ
311 ペン
599 カメラユニット
812 分割用ドットパターン
816 入出力装置
820 分割・リンク用ドットパターン
826 第一の所定のドットパターン
828 第iの所定のドットパターン
871 入力開始・終了用ドットパターン
1001 ペン型スキャナ
1002 情報処理装置
1003 メモリーカードスロット
1004 メモリーカード
1005 マイクロホン
1006 音声発生装置
1007 スピーカ
1010 バッテリー
1015 ケース
1105 スキャナ部
1111 ディフューザー
1122 IRLED
1125 ノーズ
1126 レンズ
1130 ボタン
1131 液晶表示部
1201 パソコン
1202 PDA
1209 無線インターフェースカード
1291 マイク
1301 マウス型スキャナ
1302 ガラス部材
1331 PCB
Claims (37)
- コード値および/または座標値とコンテンツデータおよび/または操作命令を関係付けて登録するリンクテーブルと、該コンテンツデータおよび/または操作命令を登録する記憶手段と、
媒体表面に形成されたドットパターンを読み取る光学読取手段と、
該光学読取手段により読み取られたドットパターンの画像情報からドットパターンを解析して、コード値および/または座標値に変換する処理手段と、
情報処理装置と無線又は有線により接続する接続手段と、
情報処理装置との接続の有無を認識する接続認識手段と、
該光学読取手段でドットパターンを読み取った後に、該処理手段により変換されたコード値および/または座標値と関係付けられた該コンテンツデータを該記憶手段から読み出して出力する出力手段と、
該光学読取手段、該処理手段、該接続手段、該接続認識手段、該出力手段による動作、および/または該操作命令による動作を制御する制御手段と、を備えた入出力装置であって、
該制御手段は、
該接続認識手段による該接続手段と該情報処理装置の接続の認識の有無により動作の切り替えを行い、
該接続認識手段が該接続手段と該情報処理装置との接続を認識したときには、該処理手段で変換されたコード値および/または座標値もしくは該コード値および/または座標値と関係付けて登録された該操作命令を、該接続手段を通じて該情報処理装置に送信し、
該接続認識手段が該接続手段と該情報処理装置との接続を認識していないときには、該コンテンツデータを該出力手段から出力させるか、該操作命令による動作を制御する
ことを特徴とする入出力装置。 - 前記制御手段は、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
前記処理手段で変換されたコード値および/または座標値と関係付けて前記リンクテーブルに登録された前記操作命令により、
該処理手段で変換されたコード値および/または座標値を、前記接続手段を通じて該情報処理装置に送信するか、
前記コンテンツデータを前記出力手段から出力させるか、該操作命令による動作を制御するか、
の動作の切り替えを行う
ことを特徴とする請求項1記載の入出力装置。 - 前記制御手段は、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
前記処理手段で変換されたコード値および/または座標値が、前記コンテンツデータおよび/または前記操作命令と関係付けて前記リンクテーブルに登録されているか否かにより動作の切り替えを行い、
登録されている場合には、該コンテンツデータを前記出力手段から出力するか、該操作命令による動作を制御し、
登録されていない場合には、該処理手段で変換されたコード値および/または座標値を、該接続手段を通じて該情報処理装置に送信する
ことを特徴とする請求項1記載の入出力装置。 - 前記制御手段は、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
前記コード値および/または座標値が関係付けられて前記リンクテーブルに登録されているコンテンツデータが前記記憶手段に登録されているか否かにより動作の切り替えを行い、
該コンテンツデータが登録されている場合には、前記出力手段から該コンテンツデータを出力し、
該コンテンツデータが登録されていない場合には、前記処理手段で変換されたコード値および/または座標値もしくは該コンテンツデータを出力するための前記操作命令を、該接続手段を通じて該情報処理装置に送信し、該情報処理装置の記憶手段に登録された該コンテンツデータを出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記入出力装置は、
リンクボタンをさらに備えており、
前記制御手段は、
前記リンクボタンを操作して前記光学読取手段により少なくとも1以上の所定のドットパターンを読み取ったときは、前記処理手段により変換されるコード値および/または座標値と所定の前記コンテンツデータを関係付け、
該コード値および/または座標値と該コンテンツデータの関係付けを前記記憶手段の前記リンクテーブルに登録し、
該光学読取手段により該所定のドットパターンを再度読み取ったときは、該リンクテーブルを参照し、対応する該コンテンツデータを該記憶手段から読み出して前記出力手段により出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記制御手段は、
前記光学読取手段により媒体表面の所定の領域に形成されたリンク用ドットパターンを読み取ったときは、前記処理手段で変換されたコード値および/または座標値と関係付けて登録された操作命令により、所定のドットパターンに対応するコード値および/または座標値と前記コンテンツデータを関連付けて登録するための動作の切り替えを行い、
該リンク用ドットパターンを読み取った後に該所定のドットパターンを読み取った時は、
前記処理手段により変換されるコード値および/または座標値と所定の前記コンテンツデータを関係付け、
該コード値および/または座標値と該コンテンツデータの関係付けを前記記憶手段の前記リンクテーブルに登録し、
該光学読取手段により該所定のドットパターンを再度読み取ったときは、該リンクテーブルを参照し、対応する該コンテンツデータを該記憶手段から読み出して前記出力手段により出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記制御手段は、
前記光学読取手段により媒体表面の所定の領域に形成されたマルチリンク開始・終了用ドットパターンを読み取ったときは、前記処理手段で変換されたコード値および/または座標値と関係付けて登録された操作命令により、所定のドットパターンに対応するコード値および/または座標値と前記コンテンツデータを関連付けて登録するための動作の切り替えを行い、
該マルチリンク開始・終了用ドットパターンを読み取った後に該所定のドットパターンを2以上連続して読み取った時は、
前記処理手段により変換されるコード値および/または座標値と所定の前記コンテンツデータを関係付け、
該コード値および/または座標値と該コンテンツデータの関係付けを前記記憶手段の前記リンクテーブルに登録し、
該光学読取手段により媒体表面の所定の領域に形成されたマルチリンク開始・終了用ドットパターンを読み取ったときは、コード値および/または座標値と前記コンテンツデータを関連付けて登録するための動作を終了し、
該光学読取手段により該所定のドットパターンを再度読み取ったときは、該リンクテーブルを参照し、対応する該コンテンツデータを該記憶手段から読み出して前記出力手段により出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記入出力装置は、
コンテンツデータを入力する入力手段をさらに備えており、
前記制御手段は、
該入出力装置にさらに備えられた入力開始・終了ボタンの操作または前記光学読取手段により媒体表面の所定の領域に形成された入力開始・終了用ドットパターンの読み取りにより、該入力手段による該コンテンツデータの入力を開始・終了し、
該入力手段により入力されたコンテンツデータを前記記憶手段に登録する
ことを特徴とする請求項1記載の入出力装置。 - 前記制御手段は、
前記入力手段によりコンテンツデータを入力しながら、前記光学読取手段により所定のドットパターンを読み取ったときは、
該コンテンツデータの入力を終了し、該コンテンツデータを記憶手段に登録し、
前記処理手段により変換されるコード値および/または座標値と該コンテンツデータを関係付け、
該コード値および/または座標値と該コンテンツデータの関係付けを前記記憶手段の前記リンクテーブルに登録し、
該光学読取手段により該所定のドットパターンを再度読み取ったときは、該リンクテーブルを参照し、対応する該コンテンツデータを該記憶手段から読み出して前記出力手段により出力させる
ことを特徴とする請求項8記載の入出力装置。 - 前記制御手段は、
前記コンテンツデータの入力中に、前記入出力装置にさらに設けられた分割ボタンの操作または前記光学読取手段により媒体表面の所定の領域に形成された分割用ドットパターンの読み取りがN回行われたときは、
入力を開始してから、該分割ボタンの操作または該光学読取手段により媒体表面の所定の領域に形成された該分割用ドットパターンの読み取りが行われた時点までのコンテンツデータを第1のコンテンツデータとして前記記憶手段に分割して登録し、
続けて、該コンテンツデータの入力中に、少なくとも1回以上、該分割ボタンを操作または該光学読取手段により媒体表面の所定の領域に形成された該分割用ドットパターンを読み取ったときは、
i-1回目の分割を操作した時点からi回目の分割を操作した時点までのコンテンツデータを第iのコンテンツデータとして該記憶手段に分割して登録し、
最後に、前記入力開始・終了ボタンの操作または該光学読取手段により媒体表面の所定の領域に形成された前記入力開始・終了用ドットパターンの読み取りにより、該入力手段による該コンテンツデータの入力を終了し、
N回目の分割を操作した時点から該コンテンツデータの入力を終了した時点までのコンテンツデータを第N+1のコンテンツデータとして該記憶手段に分割して登録する
ことを特徴とする請求項8記載の入出力装置。 - 前記制御手段は、
前記分割して登録される少なくとも第1から第Nのコンテンツデータのそれぞれを示す第1のファイル名と併せて、次に続けて分割して登録されるコンテンツデータを示す第2のファイル名を前記記憶手段に登録する
ことを特徴とする請求項10記載の入出力装置。 - 前記制御手段は、
所定の方法によって、前記処理手段により変換される、所定のN+1個のドットパターンに定義されたコード値および/または座標値と前記分割された第1から第N+1のコンテンツデータを関係付け、
該コード値および/または座標値と該分割されたコンテンツデータの関係付けを前記記憶手段の前記リンクテーブルに登録し、
前記光学読取手段より前記第iのドットパターンを読み取ったときは、該リンクテーブルを参照し、対応する該第iから該N+1までのコンテンツデータを所定の方法で該記憶手段から読み出して前記出力手段により連続して出力させる
ことを特徴とする請求項10記載の入出力装置。 - 前記制御手段は、
前記コンテンツデータの入力中に、前記入出力装置にさらに設けられた分割・リンクボタンを操作して、または前記光学読取手段により媒体表面の所定の領域に形成された分割・リンク用ドットパターンを読み取って、該光学読取手段により第1の所定のドットパターンを読み取ったときは、
入力を開始してから該分割・リンクボタンの操作または該光学読取手段により媒体表面の所定の領域に形成された該分割・リンク用ドットパターンの読み取りが行われた時点までのコンテンツデータを第1のコンテンツデータとして前記記憶手段に分割して登録し、
前記処理手段により変換される第1の所定のドットパターンに定義されたコード値および/または座標値と登録された該第1のコンテンツデータを関係付け、
該コード値および/または座標値と該第1のコンテンツデータの関係付けを該記憶手段の前記リンクテーブルに登録し、
続けて、該コンテンツデータの入力中に、少なくとも1回以上、該分割・リンクボタンを操作して、または該光学読取手段により媒体表面の所定の領域に形成された分割・リンク用ドットパターンを読み取って、該光学読取手段により第iの所定のドットパターンを読み取ったときは、
該分割・リンクボタンの操作回数を第1の所定のドットパターンを読み取ったときを含めてN回(Nは自然数)とすると、
i-1回目の分割を操作した時点からi回目の分割を操作した時点までのコンテンツデータを第iのコンテンツデータとして該記憶手段に分割して登録し、
該第iの所定のドットパターンが該処理手段により変換される第iのコード値および/または座標値と、登録された該第iのコンテンツデータを関係付け、
該第iのコード値および/または座標値と該第iのコンテンツデータの関係付けを該記憶手段のリンクテーブルに登録し、
最後に、前記入力開始・終了ボタンの操作または該光学読取手段により媒体表面の所定の領域に形成された前記入力開始・終了用ドットパターンの読み取りにより、前記入力手段による該コンテンツデータの入力を終了し、
該光学読取手段より該第iのドットパターンを再度読み取ったときは、該リンクテーブルを参照し、対応する該第iのコンテンツデータを該記憶手段から読み出して該出力手段により出力させる
ことを特徴とする請求項8記載の入出力装置。 - 前記ドットパターンに定義されたコード値および/または座標値には、
少なくとも2以上のコンテンツデータを関係付け、該関係付けを前記記憶手段の前記リンクテーブルにさらに登録され、
前記制御手段は、前記光学読取手段により該ドットパターンを再度読み取ったときは、該リンクテーブルを参照し、対応する少なくとも2以上のコンテンツデータを該記憶手段から所定の順番で読み出して、前記出力手段から連続して出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記ドットパターンには、
前記コンテンツデータと関係付けられる第1のコード値および/または座標値に加え、
少なくとも1以上、他のコンテンツデータと関係付けられる第2から第Nのコード値および/または座標値が定義され、
前記制御手段は、前記光学読取手段により該ドットパターンを読み取ったときは、前記リンクテーブルを参照し、該第1のコード値および/または座標値に対応するコンテンツデータを該記憶手段から読み出して前記出力手段から出力し、
続けて、該リンクテーブルを参照し、少なくとも1以上の該第2から第Nのコード値および/または座標値に対応するコンテンツデータを該記憶手段から所定の順番で読み出して前記出力手段から連続して出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記記憶手段は、
異なる前記ドットパターンに定義された第1から第Nのコード値および/または座標値を所定の順番で関係付けて登録するドットコード連結テーブルをさらに登録し、
前記制御手段は、
前記光学読取手段より第iのドットパターンを読み取ったときは、前記処理手段により変換される第iのコード値および/または座標値で該ドットコード連結テーブルを参照し、該第1から第Nのコード値および/または座標値を検索した後、該第iから第Nのコード値および/または座標値の順番で前記リンクテーブルを参照し、少なくとも2以上の対応するコンテンツデータを該記憶手段から読み出して前記出力手段により連続して出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記記憶手段は、
前記コンテンツデータを示す第1のファイル名と併せて、異なるコンテンツデータを示す第2のファイル名をさらに登録し、該異なるコンテンツデータを示す該第2のファイル名を第1のファイル名として、さらに異なるコンテンツデータを示す第2のファイル名を連鎖状に繋ぐよう、連鎖するファイル名を登録し、
前記ドットパターンは、
該ファイル名で示されるコンテンツデータと関係付けられるコード値および/または座標値が定義され、
前記制御手段は、
前記光学読取手段により該ドットパターンを読み取ったときは、該記憶手段に連鎖状に登録されたファイル名で示されるコンテンツデータを該記憶手段から、次々と読み出して前記出力手段から連続して出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記記憶手段は、
前記コード値および/または座標値と関係付けられた制御コードを前記リンクテーブルにさらに登録しており、
該制御コードは電子機器を制御するコードであって、
前記制御手段は、
前記光学読取手段により該コード値および/または座標値が定義されたドットパターンを読み取ったときは、該リンクテーブルを参照し、該コード値および/または座標値に対応する制御コードを1または複数の光信号または無線信号に変換し、該1または複数の光信号または無線信号を前記出力手段から出力させる
ことを特徴とする請求項1記載の入出力装置。 - 前記記憶手段は、
前記コード値および/または座標値と関係付けられた1または複数のマウス操作コードを、前記リンクテーブルにさらに登録しており、
前記制御手段は、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
前記光学読取手段により該コード値および/または座標値が定義された前記ドットパターンを読み取ったときは、該リンクテーブルを参照し、該コード値および/または座標値に対応するマウス操作コードを、該接続手段を通じて該情報処理装置に送信する
ことを特徴とする請求項1記載の入出力装置。 - 前記制御手段は、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
前記処理手段で変換されたコード値および/または座標値を、該接続手段を通じて該情報処理装置に送信する通常モードと、前記コード値および/または座標値に対応するマウス操作コードを、該接続手段を通じて該情報処理装置に送信するマウスモードとを備え、
前記入出力装置に別途設けられたボタンによる操作または媒体表面の所定の領域に形成されたドットパターンに対応するコード値および/または座標値と関係付けて登録された操作命令により切り替え可能である
ことを特徴とする請求項19記載の入出力装置。 - 前記記憶手段は、
該入出力装置を前記情報処理装置に接続して使用するためのドライバおよび/またはコンテンツデータをさらに登録しており、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
前記制御手段は、
前記入出力装置にさらに設けられたインストールボタンの操作または前記光学読取手段により媒体表面の所定の領域に形成されたインストール用ドットパターンの読み取りにより、該ドライバおよび/または該コンテンツデータが該情報処理装置に自動的にインストールされる
ことを特徴とする請求項1の記載の入出力装置。 - 前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
前記制御手段は、
前記入出力装置にさらに設けられたUSBメモリボタンの操作または前記光学読取手段により媒体表面の所定の領域に形成されたUSBメモリ用ドットパターンの読み取りにより、前記入出力装置はUSBメモリとして機能し、
該入出力装置の記憶手段または該情報処理装置の記憶手段に登録されている、コード値および/または座標値とコンテンツデータおよび/または操作命令を関係付けて登録する前記リンクテーブルと、該コンテンツデータおよび/または該操作命令は、
該入出力装置の記憶手段と該情報処理装置の記憶手段の相互にコピー・移動・削除が可能である
ことを特徴とする請求項1記載の入出力装置。 - 前記コンテンツデータは、
音声データである
ことを特徴とする請求項1~22いずれか記載の入出力装置。 - 前記入力手段は、
音声入力手段である
ことを特徴とする請求項8~13いずれか記載の入出力装置。 - 前記記憶手段は、
前記入出力装置に対して脱着可能である
ことを特徴とする請求項1~24いずれか記載の入出力装置。 - 前記記憶手段は、
内蔵メモリと外部メモリとで構成される
ことを特徴とする請求項1~25いずれか記載の入出力装置。 - 前記入出力装置は、
ユーザによる手書き入力操作を受け付け、該手書き入力操作を受け付けることにより得られる認識結果として、ひらがな、カタカナ、漢字、英数字、記号等の複数の字種を含む文字または文字列を認識する文字認識手段をさらに備えており、
前記記憶手段は、
該文字認識手段により認識された文字または文字列とコンテンツデータおよび/または操作命令を関係付けて登録するリンクテーブルをさらに登録しており、
前記制御手段は、
該手書き入力操作を受け付けたときは、
前記処理手段により変換される座標値の変化から前記光学読取手段の軌跡を認識し、該軌跡と対応する文字または文字列を該文字認識手段により認識し、
該リンクテーブルを参照して、該文字認識手段により認識された文字または文字列に対応するコンテンツデータを前記出力手段から出力させるか、該操作命令による動作を制御する
ことを特徴とする請求項1記載の入出力装置。 - 前記入出力装置は、
ユーザによる手書き入力操作を受け付け、該手書き入力操作を受け付けることにより得られる認識結果として、ひらがな、カタカナ、漢字、英数字、記号等の複数の字種を含む文字または文字列を認識する文字認識手段をさらに備えており、
前記制御手段は、
該手書き入力操作を受け付けたときは、
前記処理手段により変換される座標値の変化から前記光学読取手段の軌跡を認識し、該軌跡と対応する文字または文字列を該文字認識手段により認識し、該認識された文字または文字列を文字コードまたは文字列コードに変換し、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
該接続手段を通じて、該文字コードまたは文字列コードを該情報処理装置に送信する
ことを特徴とする請求項1記載の入出力装置。 - 前記入出力装置は、
ユーザによる手書き入力操作を受け付け、
前記制御手段は、
該手書き入力操作を受け付けたときは、
前記処理手段により変換される座標値の変化から前記光学読取手段の軌跡を認識し、
前記接続認識手段が前記接続手段と前記情報処理装置との接続を認識している場合において、
該接続手段を通じて、該軌跡を情報処理装置に送信する
ことを特徴とする請求項1記載の入出力装置。 - 請求項28記載の入出力装置と、
前記文字コードまたは文字列コードとコンテンツデータおよび/または操作命令を関係付けて登録するリンクテーブルを登録する記憶手段と、該文字コードまたは文字列コード、および/または該コンテンツデータを出力する出力手段と、該記憶手段、出力手段による動作および/または該操作命令による動作を制御する制御手段と、を備える前記接続手段により該入出力装置と無線又は有線により接続する情報処理装置と、
を含む情報入出力システムであって、
該情報処理装置の該制御手段は、
該入出力装置から該接続手段を通じて送信された文字コードまたは文字列コードを該出力手段から出力させるか、
および/または該情報処理装置のリンクテーブルを参照し、該文字コードまたは文字列コードと対応するコンテンツデータを該情報処理装置の該出力手段から出力させるか、該操作命令による動作を制御する
ことを特徴とする情報入出力システム。 - 請求項29記載の入出力装置と、
前記手書き入力操作を受け付けることにより得られる認識結果として、ひらがな、カタカナ、漢字、英数字、記号等の複数の字種を含む文字または文字列を認識する文字認識手段と、該文字または文字列とコンテンツデータおよび/または操作命令を関係付けて登録するリンクテーブルを登録する記憶手段と、該文字または文字列から変換された文字コードまたは文字列コードおよび/または該コンテンツデータを出力する出力手段と、該文字認識手段、該記憶手段、該出力手段による動作および/または該操作命令による動作を制御する制御手段と、を備える前記接続手段により該入出力装置と無線又は有線により接続する情報処理装置と、
を含む情報入出力システムであって、
該情報処理装置の該制御手段は、
該入出力装置から該接続手段を通じて送信される前記軌跡と対応する文字または文字列を該文字認識手段により認識し、文字コードまたは文字列コードに変換し、該文字コードまたは文字列コードを該出力手段から出力させるか、
および/または該リンクテーブルを参照して、該文字または文字列に対応するコンテンツデータを該情報処理装置の出力手段から出力させるか、該操作命令による動作を制御する
ことを特徴とする情報入出力システム。 - 前記入出力装置は、
さらに備えられた手書き入力開始・終了ボタンの操作または前記光学読取手段により媒体表面の所定の領域に形成された手書き入力開始・終了用ドットパターンの読み取りにより、前記手書き入力操作の受け付けを開始・終了する
ことを特徴とする請求項27~29いずれか記載の入出力装置。 - 前記入出力装置は、
ユーザによる前記手書き入力操作の受け付けを判別する判別手段をさらに備えており、
前記コード値の少なくとも一部には、前記判別手段が前記手書き入力操作の受付を判別するための操作判別コードが定義されており、
前記制御手段は、
該操作判別コードに基づいて該手書き入力操作の受付を前記光学読取手段によるドットパターンの読取り毎に該判別手段により判別する
ことを特徴とする請求項27~29いずれか記載の入出力装置。 - 前記コード値の少なくとも1部には、ユーザによる手書き入力の際に用いられる書き込み領域を特定させるための書き込み領域特定コードが定義されており、
前記制御手段は、
該書き込み領域特定コードに基づいて書き込み領域を特定し、該書き込み領域上の軌跡を認識する
ことを特徴とする請求項27~29いずれか記載の入出力装置。 - 請求項1記載の入出力装置と、
前記接続手段により該入出力装置と無線又は有線により接続する情報処理装置と、を含む情報入出力システムであって、
該入出力装置は、
ユーザによる手書き入力操作を受け付け、
該情報処理装置は、
該入出力装置が受け付けた手書き入力操作を判別する判別手段と、
該手書き入力操作を受け付けることにより得られる認識結果として、ひらがな、カタカナ、漢字、英数字、記号等の複数の字種を含む文字または文字列を認識する文字認識手段と、
該文字または文字列とコンテンツデータおよび/または操作命令を関係付けて登録するリンクテーブルを登録する記憶手段と、
該コンテンツデータを出力する出力手段と、
該判別手段、該文字認識手段、該記憶手段、該出力手段による動作および/または該操作命令による動作を制御する制御手段と、を備えており、
該入出力装置の制御手段は、
前記処理手段により変換されるコード値および/または座標値を、該接続手段を通じて該情報処理装置に送信し、
該判別手段は、
該コード値の少なくとも一部に定義された操作判別コードによりユーザによる手書き入力の受付を判別し、
該情報処理装置の制御手段は、
該座標値の変化により該入出力装置の前記光学読取手段の軌跡を認識し、該軌跡と対応する文字または文字列を該文字認識手段により認識し、該リンクテーブルを参照して、該文字認識手段により認識された文字または文字列に対応するコンテンツデータを前記出力手段から出力するか、該操作命令による動作を制御する
ことを特徴とする情報入出力システム。 - 前記ドットパターンは、所定の規則にしたがって線状に連続して複数の基準ドットを配置する工程と、該複数の基準ドットを結ぶ、直線、折れ線および/または曲線からなる第一の仮想基準線を設ける工程と、該基準ドットおよび/または該第一の仮想基準線から所定の位置に定義される、直線および/または曲線からなる少なくとも1以上の第二の仮想基準線を設ける工程と、該第二の仮想基準線上の所定の位置に複数の仮想基準点を設ける工程と、該仮想基準点を始点としてベクトルにより表現した終点に、該仮想基準点からの距離と方向とでXY座標値および/またはコード値が定義される情報ドットを配置する工程に従って配列した、ストリームドットパターンを1または複数並べて形成される請求項1~29、32~34のいずれかに記載の入出力装置または請求項30,31,35のいずれかに記載の入出力システム。
- 前記ストリームドットは、
第二の仮想基準線を定義するために、および/または前記ドットパターンの方向と1つのXY座標値および/またはコード値を定義するために、さらに基準となる基準ドットを所定の位置に設けた
ことを特徴とする請求項36記載の入出力装置または入出力システム。
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA2788634A CA2788634A1 (en) | 2010-01-28 | 2011-01-28 | Input-output device, and information input-output system |
KR1020127022541A KR101804759B1 (ko) | 2010-01-28 | 2011-01-28 | 입출력 장치, 정보 입출력 시스템 |
AU2011211240A AU2011211240B2 (en) | 2010-01-28 | 2011-01-28 | Input-output device, and information input-output system |
EP11737168.2A EP2530563A4 (en) | 2010-01-28 | 2011-01-28 | INPUT AND OUTPUT DEVICE AND INFORMATION INPUT AND OUTPUT SYSTEM |
CN201180007685.7A CN102792248B (zh) | 2010-01-28 | 2011-01-28 | 输入输出装置、信息输入输出系统 |
US13/575,344 US9176605B2 (en) | 2010-01-28 | 2011-01-28 | Input-output device and information input-output system |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010017459 | 2010-01-28 | ||
JP2010159160A JP5489118B2 (ja) | 2010-01-28 | 2010-07-13 | 入出力装置、情報入出力システム |
JP2010-159160 | 2010-07-13 | ||
JP2010-017459 | 2010-07-16 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2011093458A2 true WO2011093458A2 (ja) | 2011-08-04 |
WO2011093458A3 WO2011093458A3 (ja) | 2011-09-22 |
Family
ID=44319932
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/051774 WO2011093458A2 (ja) | 2010-01-28 | 2011-01-28 | 入出力装置、情報入出力システム |
Country Status (9)
Country | Link |
---|---|
US (1) | US9176605B2 (ja) |
EP (1) | EP2530563A4 (ja) |
JP (1) | JP5489118B2 (ja) |
KR (1) | KR101804759B1 (ja) |
CN (1) | CN102792248B (ja) |
AU (1) | AU2011211240B2 (ja) |
CA (1) | CA2788634A1 (ja) |
MY (1) | MY168389A (ja) |
WO (1) | WO2011093458A2 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013045441A (ja) * | 2011-08-24 | 2013-03-04 | Hotoku Technology Co Ltd | 無線記憶機能と無線転送機能を有するスタイラスの無線送受信方法及びそのシステム |
CN104778863A (zh) * | 2015-04-09 | 2015-07-15 | 广东小天才科技有限公司 | 点读装置及其控制方法 |
JPWO2019065345A1 (ja) * | 2017-09-28 | 2020-11-19 | 日本電気株式会社 | 録音装置、録音制御プログラムおよび録画装置 |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5095021B2 (ja) * | 2011-04-04 | 2012-12-12 | シャープ株式会社 | 表示装置、情報処理システム、プログラム及びテレビジョン受信機 |
WO2013005854A1 (en) | 2011-07-04 | 2013-01-10 | Yazaki Corporation | Flat cable waterproofing connector and waterproofing connector structure for flat cable |
JP5170715B2 (ja) * | 2011-12-27 | 2013-03-27 | 任天堂株式会社 | 情報処理プログラム、情報処理装置、情報処理システム、および指示判別方法 |
JP2013219482A (ja) * | 2012-04-06 | 2013-10-24 | Nec Saitama Ltd | 携帯端末およびその制御方法 |
JP6019716B2 (ja) * | 2012-05-01 | 2016-11-02 | 大日本印刷株式会社 | コンピュータ装置、プログラム及び情報処理システム |
CN108287651B (zh) | 2012-05-09 | 2021-04-13 | 苹果公司 | 用于针对在用户界面中执行的操作提供触觉反馈的方法和装置 |
CN109298789B (zh) * | 2012-05-09 | 2021-12-31 | 苹果公司 | 用于针对激活状态提供反馈的设备、方法和图形用户界面 |
EP2904556A2 (en) * | 2012-10-05 | 2015-08-12 | Google, Inc. | Systems, methods, and computer program products for managing remote financial transactions |
JP6138274B2 (ja) | 2012-12-29 | 2017-05-31 | アップル インコーポレイテッド | ユーザインタフェース階層をナビゲートするためのデバイス、方法、及びグラフィカルユーザインタフェース |
JP2014137777A (ja) * | 2013-01-18 | 2014-07-28 | Gt Telecom Co Ltd | 携帯端末機用タッチペン |
KR102012923B1 (ko) * | 2013-02-20 | 2019-08-22 | 삼성전자주식회사 | 단말기의 보안 관리장치 및 방법 |
JP6061426B2 (ja) * | 2013-11-27 | 2017-01-18 | アルプス電気株式会社 | 入力装置及びその情報入力方法 |
JP5928930B2 (ja) * | 2014-05-07 | 2016-06-01 | アクセラス株式会社 | 音声ガイド支援システム及びそのプログラム |
US9355291B1 (en) * | 2014-11-13 | 2016-05-31 | The Code Corporation | Barcode reader and accessory for the barcode reader |
WO2016103285A1 (en) * | 2014-12-24 | 2016-06-30 | Datalogic Ip Tech S.R.L. | System and method for reading direct part marking (dpm) codes on objects |
US10095396B2 (en) | 2015-03-08 | 2018-10-09 | Apple Inc. | Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object |
US9710157B2 (en) | 2015-03-12 | 2017-07-18 | Lenovo (Singapore) Pte. Ltd. | Removing connective strokes |
US9460359B1 (en) * | 2015-03-12 | 2016-10-04 | Lenovo (Singapore) Pte. Ltd. | Predicting a target logogram |
CN107589678A (zh) * | 2016-07-07 | 2018-01-16 | 佛山市顺德区美的电热电器制造有限公司 | 烹饪电器及其状态切换控制方法 |
US10490943B2 (en) * | 2017-08-09 | 2019-11-26 | Micron Technology, Inc. | Securing a memory card |
CN107393354A (zh) * | 2017-08-11 | 2017-11-24 | 安徽状元郎电子科技有限公司 | 一种多功能智能点读笔 |
JP7069631B2 (ja) * | 2017-10-16 | 2022-05-18 | 富士フイルムビジネスイノベーション株式会社 | 情報処理装置及び情報処理プログラム |
US10803291B2 (en) * | 2017-11-17 | 2020-10-13 | Pixart Imaging Inc. | Encoding and decoding method and information recognition device using the same |
CN109032376A (zh) * | 2018-07-09 | 2018-12-18 | 江苏沁恒股份有限公司 | 一种利用一套键盘鼠标同时控制多台电脑的装置及方法 |
CN109086840A (zh) * | 2018-07-10 | 2018-12-25 | 深圳闳宸科技有限公司 | 读写一体装置及系统 |
CN109087541A (zh) * | 2018-09-25 | 2018-12-25 | 台州圣言电子科技有限公司 | 点读笔使用方法 |
CN109118862A (zh) * | 2018-10-31 | 2019-01-01 | 深圳市童心教育科技有限公司 | 一种点读验证装置以及点读答题验证评分方法 |
CN110070766A (zh) * | 2018-10-31 | 2019-07-30 | 深圳市童心教育科技有限公司 | 一种点读答题器以及答案选项oid码编码方法 |
KR102270856B1 (ko) * | 2020-06-12 | 2021-06-29 | 주식회사 알로하아이디어스 | 북코드 스티커를 이용한 음원 기록 및 재생 시스템 |
CN112001416B (zh) * | 2020-07-17 | 2021-09-07 | 北京邮电大学 | 一种自适应答题纸序列纠正方法 |
CN112365402B (zh) * | 2020-11-09 | 2023-11-10 | 深圳市壹箭教育科技有限公司 | 智能组卷方法、装置、存储介质及电子设备 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004029871A1 (ja) | 2002-09-26 | 2004-04-08 | Kenji Yoshida | ドットパターンを用いた情報再生・入出力方法、情報再生装置、携帯情報入出力装置および電子玩具 |
WO2004084125A1 (ja) | 2003-03-17 | 2004-09-30 | Kenji Yoshida | ドットパターンを用いた情報入出力方法 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040206821A1 (en) * | 1994-03-04 | 2004-10-21 | Andrew Longacre | Autodiscriminating bar code reading apparatus having solid state image sensor |
US6561428B2 (en) * | 1997-10-17 | 2003-05-13 | Hand Held Products, Inc. | Imaging device having indicia-controlled image parsing mode |
JP2006190270A (ja) * | 2002-09-26 | 2006-07-20 | Kenji Yoshida | 媒体上に形成されたアイコン |
US7133031B2 (en) * | 2002-10-31 | 2006-11-07 | Microsoft Corporation | Optical system design for a universal computing device |
CN101167090A (zh) * | 2005-04-15 | 2008-04-23 | 吉田健治 | 使用了点图形的信息输入输出方法 |
CA2606135C (en) * | 2005-04-28 | 2015-06-30 | Kenji Yoshida | Information input/output method using dot pattern |
CN101263445A (zh) * | 2005-08-03 | 2008-09-10 | 格瑞德网络传输私人有限公司 | 信息输出装置、媒体及信息输入/输出装置 |
US20090091530A1 (en) | 2006-03-10 | 2009-04-09 | Kenji Yoshida | System for input to information processing device |
JP4042066B1 (ja) * | 2006-03-10 | 2008-02-06 | 健治 吉田 | 情報処理装置への入力処理システム |
JP4154700B1 (ja) * | 2007-06-21 | 2008-09-24 | 健治 吉田 | カード面の読取・命令実行方法 |
JP2009181182A (ja) * | 2008-01-29 | 2009-08-13 | Anoto Ab | デジタルペン及びデジタルペンシステム |
-
2010
- 2010-07-13 JP JP2010159160A patent/JP5489118B2/ja active Active
-
2011
- 2011-01-28 US US13/575,344 patent/US9176605B2/en not_active Expired - Fee Related
- 2011-01-28 AU AU2011211240A patent/AU2011211240B2/en not_active Ceased
- 2011-01-28 KR KR1020127022541A patent/KR101804759B1/ko active IP Right Grant
- 2011-01-28 WO PCT/JP2011/051774 patent/WO2011093458A2/ja active Application Filing
- 2011-01-28 MY MYPI2012003859A patent/MY168389A/en unknown
- 2011-01-28 EP EP11737168.2A patent/EP2530563A4/en not_active Withdrawn
- 2011-01-28 CN CN201180007685.7A patent/CN102792248B/zh active Active
- 2011-01-28 CA CA2788634A patent/CA2788634A1/en not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2004029871A1 (ja) | 2002-09-26 | 2004-04-08 | Kenji Yoshida | ドットパターンを用いた情報再生・入出力方法、情報再生装置、携帯情報入出力装置および電子玩具 |
WO2004084125A1 (ja) | 2003-03-17 | 2004-09-30 | Kenji Yoshida | ドットパターンを用いた情報入出力方法 |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013045441A (ja) * | 2011-08-24 | 2013-03-04 | Hotoku Technology Co Ltd | 無線記憶機能と無線転送機能を有するスタイラスの無線送受信方法及びそのシステム |
CN104778863A (zh) * | 2015-04-09 | 2015-07-15 | 广东小天才科技有限公司 | 点读装置及其控制方法 |
JPWO2019065345A1 (ja) * | 2017-09-28 | 2020-11-19 | 日本電気株式会社 | 録音装置、録音制御プログラムおよび録画装置 |
JP7095703B2 (ja) | 2017-09-28 | 2022-07-05 | 日本電気株式会社 | 録音装置、録音制御プログラムおよび録画装置 |
Also Published As
Publication number | Publication date |
---|---|
AU2011211240B2 (en) | 2016-12-08 |
CN102792248B (zh) | 2016-08-17 |
JP5489118B2 (ja) | 2014-05-14 |
CA2788634A1 (en) | 2011-08-04 |
EP2530563A2 (en) | 2012-12-05 |
WO2011093458A3 (ja) | 2011-09-22 |
US9176605B2 (en) | 2015-11-03 |
MY168389A (en) | 2018-10-31 |
KR20130054938A (ko) | 2013-05-27 |
US20130011065A1 (en) | 2013-01-10 |
CN102792248A (zh) | 2012-11-21 |
JP2011175614A (ja) | 2011-09-08 |
EP2530563A4 (en) | 2014-08-13 |
KR101804759B1 (ko) | 2018-01-10 |
AU2011211240A1 (en) | 2012-09-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5489118B2 (ja) | 入出力装置、情報入出力システム | |
US8427344B2 (en) | System and method for recalling media | |
JP4042065B1 (ja) | 情報処理装置への入力処理システム | |
RU2457532C2 (ru) | Система обработки ввода для устройства обработки информации | |
JP2010154089A (ja) | 会議システム | |
WO2012008469A1 (ja) | ストリームドットを用いた情報入力補助シートおよび情報処理システム | |
JP4042066B1 (ja) | 情報処理装置への入力処理システム | |
KR101886010B1 (ko) | 전자기기 및 전자기기의 구동방법 | |
JP5489122B2 (ja) | 情報入出力装置、情報処理装置、印刷媒体および情報入出力方法 | |
JP2012022418A (ja) | ストリームドットを用いた手書き入力シートおよび手書き入出力システム | |
JP2012022423A (ja) | ストリームドットを用いた入力処理システム、入出力処理システムおよび印刷制御システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180007685.7 Country of ref document: CN |
|
ENP | Entry into the national phase |
Ref document number: 2788634 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12012501567 Country of ref document: PH |
|
WWE | Wipo information: entry into national phase |
Ref document number: 7391/DELNP/2012 Country of ref document: IN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011737168 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 20127022541 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011211240 Country of ref document: AU |
|
ENP | Entry into the national phase |
Ref document number: 2011211240 Country of ref document: AU Date of ref document: 20110128 Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13575344 Country of ref document: US |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11737168 Country of ref document: EP Kind code of ref document: A2 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1201003819 Country of ref document: TH |