JP2012022423A - Input processing system, input/output processing system and printing control system using stream dot - Google Patents

Abstract

PROBLEM TO BE SOLVED: To propose a keyboard, a mouse, and new input systems replacing hardware devices such as a tablet, that is, a paper icon, a paper controller, a paper keyboard, and a mouse pad, capable of inputting characters and the like and performing operations for a computer by easy manipulations.SOLUTION: A stream dot pattern formed on a medium surface is scanned with a scanner connected to an information processing device to be converted to a code value and/or coordinate values defined by the stream dot pattern. An icon formed on the medium for outputting audio, an image, video, characters or a program, and access information to the Web corresponding to the code value and/or the coordinate values stored in the information processing device is provided, so that start-up of information such as audio, an image, video, and characters, and a program which are prepared beforehand, access to the Web, and the like are enabled without using a keyboard, a mouse, and the like.

Description

  The present invention relates to an input system of an information processing apparatus using a dot pattern formed (printed) on a medium surface such as a paper surface.

  Computers are being used in every aspect of life. In addition to conventional uses such as creating documents and performing calculations, the computer functions and uses such as accessing the Internet web page (WEB Page) to obtain necessary information and purchasing products Has increased dramatically.

  Conventionally, in performing these actions, it has been necessary to perform operations such as inputting characters using a keyboard and a mouse.

  However, inputting characters with a keyboard involves many complicated operations and takes time to learn. In particular, there is a problem that the operation is difficult for a person who has difficulty in operating the device, such as an elderly person or a disabled person. In addition, the “digital divide” that creates a disparity in information and opportunities between those who can operate the keyboard and mouse and who can master the computer, and those who cannot operate the computer due to their operation, has become a problem. Yes.

  In order to solve such a problem, information can be input to a computer using a code pattern printed on a medium surface such as a barcode or QR code (hereinafter collectively referred to as “barcode”). Information processing devices and service providing systems have been proposed. In other words, barcodes are listed on catalogs and homepages provided by vendors, and when a user (operator) reads a barcode using a barcode reader connected to a computer, he obtains desired information or displays a product. It can be purchased (see, for example, Patent Document 1).

JP 2005-4574 A

  However, since barcodes require a predetermined area on the medium surface to display the barcode, there are limits to the number of codes that can be displayed on the medium surface, and there are more characters and symbols than the keyboard. It was difficult to enter the corresponding code. Moreover, the barcode has been a factor that impairs the aesthetics of the medium surface.

  The present invention has been made in view of the above points, and it is possible to input characters and the like to a computer with a simple operation, and a new input that replaces hardware devices such as a keyboard, mouse, and tablet that can be operated. A system, namely a paper icon, a paper controller, a paper keyboard and a mouse pad, is proposed.

  In order to solve the above problems, the present invention employs the following means.

  (1) An input system according to the present invention is an input processing system for an information processing device comprising an optical reading device connected to the information processing device and a medium on which a dot pattern is printed, and the optical reading device Includes an imaging unit that images the dot pattern, an analysis unit that analyzes a coordinate value and / or a code value defined in the dot pattern read by the imaging unit, a coordinate value defined in the dot pattern, and / or And a control means for decoding and transmitting the operation value or data corresponding to the code value or the coordinate value and / or the code value, and the dot pattern formed on the medium surface is linear according to a predetermined rule A step of arranging a plurality of reference dots in succession, and a straight line, a broken line and / or a curve connecting the plurality of reference dots. Providing one virtual reference line, and at least one or more second virtual reference lines comprising straight lines and / or curves defined at predetermined positions from the reference dots and / or the first virtual reference line A step of providing a plurality of virtual reference points at predetermined positions on the second virtual reference line, and a distance and direction from the virtual reference point at an end point represented by a vector starting from the virtual reference point. Is a dot pattern formed by arranging one or more stream dot patterns arranged in accordance with the step of arranging information dots in which XY coordinate values and / or code values are defined. Characters, graphics printed on the medium surface, Touching and / or running the dot pattern formed on at least a part or all of a photograph or icon with the optical reading device. And, wherein the inputting and processing in the information processing apparatus.

  According to this, by forming a plurality of stream dot patterns with a fixed reference point interval, XY coordinate values are defined without gaps in the medium, and trajectory information can be generated. In addition, when characters, staffs, maps, figures, etc. are printed on the medium and the operation is performed by tracing or touching the line segment with a scanner pen, by forming a stream dot pattern only along the line segment, A dot pattern can be arranged rationally. In addition, when a dot pattern in which XY coordinates are defined is formed as a two-dimensional code (used as an index), it is not restricted by the shape of the rectangular area, and is matched to the information area visually formed on the medium surface. In addition, it is possible to form a dot pattern by repeating a set of constant information in a free shape.

  (2) Further, the stream dot pattern is a reference for defining the second virtual reference line and / or for defining the direction of the dot pattern and one XY coordinate value and / or code value. A reference dot is provided at a predetermined position.

  According to this, by setting a new reference point, it is possible to easily define the direction of the stream dot pattern and a set of constant information without using information dots, thereby suppressing unnecessary information reduction. It is done. Furthermore, the position of the virtual reference point that is the starting point of the information dot can be accurately indicated by the arrangement of the new reference point.

  (3) Further, the icon is characterized in that it is printed as text, a photograph, or a graphic on a printable medium including a paper keyboard, a paper controller, a card, a sticker, and a sticky note.

  (4) Further, the operation instruction is a code value of an interrupt key of a keyboard, and causes the information processing apparatus to generate a key input interrupt process.

(5) Further, the optical reading device reads the dot pattern, and indicates that the optical reading device is tilted with respect to the medium surface or another medium surface, and a difference in brightness of a captured image of the optical reading device and The analysis means analyzes the tilt / direction and / or operation of the optical reading device according to the change in the difference in brightness and / or the direction in which the optical reading device is inclined with respect to the direction of the dot pattern, and the control The means generates a key input interruption process defined according to the tilt and / or operation of the optical reader.

  (6) Further, the key input interruption process is performed by pressing a button provided in the optical reading device.

  (7) Further, the key input interruption process is a change of an input character type, an instruction for character conversion, and a cursor movement.

  (8) Further, the key input interruption processing is performed when the optical reading device is used to scan an icon on which a dot pattern is formed on the medium surface, and when the word of only a vowel is input, When inputting a word consisting of consonants and vowels by reading the dot pattern on the icon by contacting the tip of the image pickup means of the reading device with an icon whose code value corresponding to the vowel is defined as a dot pattern, A code value corresponding to a subsequent vowel after the reading unit at the tip of the imaging means stops reading an icon in which a code value corresponding to the consonant is defined as a dot pattern and reads the dot pattern corresponding to the consonant Slide the imaging means on the medium surface until the icon is defined as a dot pattern, and temporarily stop at the icon corresponding to the vowel. After reading the pattern, by separating the image pickup means from the medium surface by the unrecognizable dot pattern, a single character or a series of words, and performs input clause.

  In this way, by performing contact / separation operation on the icon on which the dot pattern is printed with the scanner, it is possible to realize a completely new input method that cannot be realized with a hardware keyboard when inputting characters.

  (9) Further, the GUI operation on the screen is performed according to the tilt / direction and / or operation of the optical reader.

  (10) Further, the GUI operation on the screen is a mouse operation operation such as screen scrolling, cursor movement, designation of an icon on the screen, drag and drop operation, menu selection, character position input operation, etc. It is characterized by being.

  (11) Further, the icon is printed on the surface of the medium together with the uneven portion of the Braille character in the dot pattern.

  (12) Furthermore, braille-shaped convex portions are arranged at predetermined intervals or banks are provided so as to surround the dot pattern printed on the medium surface with an elliptical arc, a polygon, or a curve. Features.

  (13) Further, the information processing apparatus is a program broadcast receiver, tuner, recording / playback device, playback device or network access device, photo frame or broadcast reception / network access set-top box, video playback of a personal computer, etc. The optical reader is a device for viewing / recording reservation or accessing a site based on program information and site information printed on the medium surface and / or the video playback device. The dot pattern formed by superimposing the remote control on each area of program information, site information, and / or an icon representing the control button printed on the medium surface Imaging means for optically reading the dot pattern and dot pattern read by the imaging means Analysis means for analyzing the coordinate value and / or code value defined in the above, control means for decoding the operation instruction or data corresponding to the coordinate value and / or code value, and the decoded code Is transmitted to the video reproduction apparatus.

  (14) Further, the remote control is characterized in that the imaging means, the analysis means, the control means, and the transmission means are integrally provided in a remote control body.

  (15) Further, the remote control includes the imaging unit and the analysis unit in a remote control body, and the control unit and the transmission unit are incorporated into the coordinate value and / or code value read by the remote control body. The code is transmitted to the cradle by wire or wireless, and the code decoded by the cradle is transmitted to the video reproduction device by wire or wireless.

  (16) An information input / output system according to the present invention includes a projection board on which the dot pattern is formed instead of the medium on which the dot pattern is superimposed and printed on the projection board. An input / output processing system including a projecting unit that projects a moving image or an image and the information processing apparatus connected to the projecting unit, wherein one surface of the projection board has a moving image or an image The projection means to be projected, and the optical reading device touch and / or scan the dot pattern formed in the moving image or image area with the optical reading device, and image the dot pattern, Analyzing means for analyzing coordinate values and / or code values defined in the dot pattern read by the imaging means; and defined in the dot pattern Control means for decoding and transmitting coordinate values and / or code values, or operation instructions or data corresponding to the coordinate values and / or code values, the coordinate values and / or code values, or the coordinate values and / or Transmitting means for transmitting an operation instruction corresponding to a code value or a control signal corresponding to data to the information processing apparatus, and the information processing apparatus outputs a moving image or an image corresponding to the control signal to the projection means It is characterized by making it.

  (17) Further, one surface of the projection board includes a video display area on which a moving image or an image is projected, and a controller area on which an icon image for controlling the moving image or the image projected on the video display area is displayed. The projection means projects a moving image or an image on at least a video display area, touches and / or scans the dot pattern formed in the icon image area displayed in the controller area with the optical reading device, and An information processing apparatus causes the projection unit to output a moving image or an image corresponding to the control signal.

  (18) Further, the projection board has a transparent sheet attached to the surface of a white board via an adhesive layer, and the dot pattern is formed on the transparent sheet on the adhesive layer side. .

  (19) Further, the projection board is affixed to the surface of a board such as a whiteboard or a blackboard in which a whiteboard magnet sheet is formed of a magnetic material, and the whiteboard magnet sheet includes a magnet layer and a white sheet. And the transparent protective sheet are adhered to each other, and the dot pattern is formed on the white sheet on the transparent protective sheet side or on the transparent protective sheet on the white sheet side.

  (20) Furthermore, on the projection board, the projection unit connected to the information processing apparatus projects at least an icon image that signifies activation of the program, and the dot pattern formed in the icon image area Is touched and / or scanned by the optical reading device, and the information processing device starts a program corresponding to the icon image and outputs a corresponding moving image or image.

  (21) Further, the projection board is a rear projector board, the projection means is arranged as a rear projector with respect to the projection board, and the dot pattern is formed on a plane different from the projection plane. And

  (21) Further, the projection board is a rear projector board, the projection means is arranged as a rear projector with respect to the projection board, and the dot pattern is formed on a plane different from the projection plane. And

  (22) Further, the dot pattern formed on the projection board is made of an infrared absorbing material, and an infrared cut filter is provided on at least the surface of the projection means.

  (23) The print control system according to the present invention may superimpose and print the dot pattern corresponding to the icon image displayed on the display means instead of the medium on which the dot pattern is superimposed and printed. A print controller for generating a paper controller, wherein the display unit generates and displays the icon image, and the icon image displayed on the display unit relates to a predefined coordinate value and / or code value. In addition, print control means for instructing superposition printing of the icon image and the dot pattern, and printing for superimposing and printing the icon image and the dot pattern on a predetermined medium surface based on an instruction from the print control means And means.

  (24) Furthermore, the display means is an information processing apparatus, and a desktop screen is superimposed and printed on a medium together with the dot pattern, and the coordinates on the desktop screen and the coordinate values defined in the dot pattern are superimposed and printed. Alternatively, the printing unit is instructed to superimpose the desktop screen and the dot pattern in association with the coordinate value and the code value.

  (25) Further, the code value specifies the desktop screen.

  (26) Further, the dot pattern is formed of an infrared absorbing material, and a coordinate value and a code value are defined in one format.

  According to the present invention, a new input system that replaces hardware devices such as a keyboard, a mouse, and a tablet that can input characters and perform operations on a computer with an easy operation, that is, a paper icon, a paper controller, and the like. A paper keyboard and mouse pad can be realized.

FIG. 1 is a block diagram showing a system configuration of a scanner and a computer. FIG. 2 is an explanatory diagram (1) showing a dot pattern of stream dots. FIG. 3 is an explanatory diagram (2) showing a dot pattern of stream dots. FIG. 4 is an explanatory diagram (3) showing a dot pattern of stream dots. FIG. 5 is an explanatory diagram (4) showing a dot pattern of stream dots. FIG. 6 is an explanatory diagram (5) showing a dot pattern of stream dots. FIG. 7 is an explanatory diagram (6) showing a dot pattern of stream dots. FIG. 8 is an explanatory diagram showing a usage state of the paper keyboard according to the embodiment of the present invention. FIG. 9 is a diagram showing a spread page of the paper keyboard. FIG. 10 is a diagram showing a spread page of the paper keyboard. FIG. 11 is an explanatory diagram illustrating a paper controller that is an embodiment of the present invention. FIG. 12 shows another embodiment of the paper controller, which is a paper controller for registering an Internet URL as a bookmark. FIG. 13 is an explanatory diagram illustrating a usage state of the paper controller. FIG. 14 is an explanatory diagram showing a usage state of the paper controller. FIG. 15 is a diagram showing a screen displayed on the monitor when an operation is performed using the paper controller. FIG. 16 is a diagram showing a screen displayed on the monitor when an operation is performed using the paper controller. FIG. 17 is a diagram for explaining a table used in this embodiment, where (a) is an index table provided in the personal computer, and (b) is a diagram showing a management server table provided in the management server. It is. FIG. 18 is a diagram illustrating another embodiment of the paper controller, and is a diagram illustrating a paper controller provided with a guide bank. FIG. 19 is a cross-sectional view of the paper controller shown in FIG. FIG. 20 is an explanatory diagram illustrating a state in which the paper controller and the guide bank are separated. FIG. 21 is a diagram showing another embodiment of the paper controller, and is a diagram showing a dot controller provided with a Braille protrusion. FIG. 22 is a diagram showing another embodiment of the paper controller, and is a diagram showing a dot controller provided with a Braille protrusion. 23A and 23B are diagrams for explaining the operation of the paper keyboard by operating the scanner. FIG. 23A is a diagram for explaining a grid scratching operation, FIG. 23B is a grid tapping operation, and FIG. 23C is a diagram for explaining a grid sliding operation. . 24A and 24B are diagrams for explaining the operation of the paper keyboard by operating the scanner. FIG. 24A is a diagram for explaining grid grind light, and FIG. 24B is a diagram for explaining grid grind left. FIG. 25 is an explanatory diagram showing a use state of the mouse pad according to the embodiment of the present invention. FIG. 26 is a diagram for explaining a mouse pad. (A) and (b) are diagrams showing a circular mouse pad, and (c) and (d) are diagrams showing a square mouse pad. FIG. 27 is a diagram illustrating a specific example of a mouse pad. FIG. 28 is a diagram for explaining the scroll operation of the web page of the browser program by the operation of the scanner using the mouse pad. FIG. 29 is a diagram for explaining the scroll operation of the web page of the browser program by the operation of the scanner using the mouse pad. FIG. 30 is a diagram for explaining another embodiment of the mouse pad, and is a diagram showing an example in which an annular groove is provided. FIG. 31 is a diagram for explaining another embodiment of the mouse pad, and is a diagram showing what is provided with radial grooves. FIG. 32 is a diagram showing another embodiment of the paper keyboard, and is a diagram for explaining what is input by a touch-and-release operation. FIG. 33 is a diagram illustrating a specific example of character input using the paper keyboard shown in FIG. FIG. 34 is a diagram showing a scanner integrated with an infrared remote controller. FIG. 35 is a diagram illustrating an operation of transmitting an infrared signal to a television using a remote controller having a structure in which a scanner can be placed on a cradle. FIG. 36 is a diagram illustrating an operation of transmitting an infrared signal to the set top box using a remote controller having a structure in which the scanner can be placed on the cradle. FIG. 37 is a diagram for explaining a paper controller having a television remote control function and a set-top box control function. FIG. 38 is a diagram for explaining a paper controller having a TV remote control function and a set-top box control function. FIG. 39 is a diagram illustrating a paper controller for providing various services at a hotel. FIG. 40 is a diagram illustrating a paper controller for controlling a music or video player. FIG. 41 is a diagram illustrating a paper controller for controlling a music or video player. FIG. 42 is a diagram illustrating a whiteboard on which a dot pattern is printed, and is a diagram illustrating a state in which a controller and an image are displayed using a projector. FIG. 43 is an enlarged longitudinal sectional view showing a sectional structure of the whiteboard. FIG. 44 is a diagram illustrating a whiteboard magnet sheet on which a dot pattern is printed. FIG. 45 is a diagram illustrating a whiteboard on which a dot pattern is printed, and is a diagram illustrating a state in which icons are displayed using a projector. FIG. 46 is a diagram illustrating an acrylic board on which a dot pattern is printed, and is a diagram illustrating a state in which an initial screen of icons is displayed using a rear projector. FIG. 47 is an enlarged longitudinal sectional view showing a sectional structure of the acrylic board. FIGS. 48A and 48B are diagrams for explaining a function of creating a paper keyboard by the user. FIG. 48A is a diagram showing an image displayed on the display device, and FIG. 48B is a diagram showing a state printed out on paper. FIG. 49 is a diagram illustrating a restaurant menu ordering system according to an embodiment of the present invention. FIG. 50 is a diagram illustrating a restaurant menu ordering system according to an embodiment of the present invention. FIG. 51 is a diagram for explaining the orientation of the camera built in the scanner and the tilt of the scanner. FIG. 52 is a diagram (1) for explaining a method of measuring the tilted direction and angle when the key input interrupt process or the GUI operation is performed according to the tilt of the scanner. FIG. 53 is a diagram (2) for explaining a method of measuring the tilted direction and angle when the key input interrupt process or the GUI operation is performed according to the tilt of the scanner. FIG. 54 is a diagram for explaining a method of measuring a tilted direction when a key input interrupt process or a GUI operation is performed according to the tilt of the scanner. FIG. 55 is a diagram for explaining a paper keyboard using XY coordinate values as a mouse pad. FIG. 56 is a diagram for explaining a whiteboard on which matrix sections are formed. FIG. 57 is a diagram for explaining the format of the dot pattern used in the whiteboard shown in FIG. FIG. 58 is a diagram showing a correspondence table of dot pattern code values and commands used in the whiteboard shown in FIG. FIG. 59 is a diagram for explaining a function of printing a desktop screen on a display and creating a paper keyboard. FIG. 60 is a diagram showing a correspondence table of code values and activation programs generated when a desktop screen on a display is printed and a paper keyboard is created. FIG. 61 is a diagram for explaining the format of a dot pattern generated when a desktop screen on a display is printed and a paper keyboard is created.

  FIG. 1 is a hardware block diagram showing the configuration of a personal computer and a scanner.

  As shown in the figure, a personal computer has a central processing unit (CPU) as a center, a main memory (MM), a hard disk device (HD) connected by a bus (BUS), and a display device (DISP) as output means. And a keyboard (KBD) as input means.

  A scanner (SCN) as a photographing unit is connected via a USB interface (USB I / F).

  Although the illustration of the internal configuration of this scanner (SCN) is omitted, it incorporates an infrared irradiation means (LED), a filter that cuts the predetermined wavelength component of the reflected light, and an image sensor (CCD or CMOS) that captures the image. The reflected light from an ID tag, a paper keyboard or a paper controller, which will be described later, can be imaged, and a dot pattern printed on the medium surface can be processed as image data.

  A right click button and a left click button are provided on the side surface of the scanner (SCN), and a right click function and a left click function of the mouse can be realized, respectively. In the figure, the right click button is arranged upward and the left click button is arranged downward with the reading unit facing down, but the arrangement is not limited to this.

  Although not shown, a printer, a speaker, or the like may be connected as an output device in addition to the display device (DISP).

  The bus (BUS) is connected to a general-purpose network (NW) such as the Internet via a network interface (NW I / F), and includes electronic map data, character information, image information, audio information, video information, and a program. Etc. can be downloaded from a server (not shown).

  In the hard disk (HD), together with an operating system (OS), application programs such as a dot pattern analysis program used in the present embodiment, electronic map data, character information, image information, audio information, video information, various tables, etc. Is registered.

  When the central processing unit (CPU) receives, via the USB interface, an input signal obtained by converting the image data of the dot pattern on the medium surface from the scanner (SCN) into a reading code or a coordinate value, an electronic map corresponding to the input signal. Data, character information, image information, audio information, moving image information, programs, and the like are read from a hard disk (HD) and output from an output device such as a display device (DISP) or a speaker (not shown).

  The code and coordinate values read by the scanner (SCN) will be described in detail later.

  Although not shown in detail, the scanner includes an infrared irradiation means (red LED), an IR filter, and an optical image sensor such as a CMOS sensor or a CCD sensor, and photographs the reflected light of the irradiation light irradiated on the medium surface. It has a function to do. Here, the dot pattern on the medium surface is printed with carbon ink, and images and character portions other than the dot pattern are printed with non-carbon ink.

  Since the carbon ink has a characteristic of absorbing infrared light, only the dot portion is photographed black in the image captured by the optical image sensor.

  In this way, since only the dot pattern is printed with carbon ink, the dot pattern can be overprinted with normal printing without visually affecting images or characters printed with other carbon inks. it can.

  In addition, although carbon ink was illustrated as an ink which has the characteristic which absorbs infrared light, printing of a dot pattern will not be limited to carbon ink if it is an ink which reacts to a specific wavelength.

  The captured image of the dot pattern read in this way is analyzed by a central processing unit (CPU) in the scanner and converted into a coordinate value or code value, via a USB cable and a USB interface (USB I / O). Sent to a personal computer.

  The central processing unit (CPU) of the personal computer refers to the table indicating the received coordinate values or code values, and displays electronic map data, character information, image information, audio information, and moving image information corresponding to these on the display device (DISP). ) And a speaker (not shown).

<Description of dot pattern Stream dots>
Next, an example of a method for forming a stream dot, which is a dot pattern used in the present invention, will be described with reference to FIGS.

  2 and 3 sequentially show an example of a process for forming a stream dot pattern.

  The dot pattern according to the present invention is different from the conventional dot pattern. First, in step 1, corresponding to the visible information on the surface of the medium, the reference dot 4 is continuously arranged in a line at a place where information is input / output. Place multiple.

  In FIG. 2A, the reference dots 4 are arranged in a curved shape, but the arrangement of the reference dots 4 is not limited to this, and is composed of a straight line and a curved line or a plurality of line segments. Various modifications can be made to form the dot pattern in a shape that matches the area where information is input and output, such as a polygonal line.

  Further, the reference dot 4 may be arranged on the actual line formed visually on the medium surface, or the reference dot 4 may be arranged according to a predetermined rule along the actual line. The real line here is a concept with respect to a virtual line, and includes all the lines that actually exist. For example, a solid line, a broken line, a dotted line, a straight line, a curved line, and the like can be given. Absent. In addition, the dot pattern may be unevenness such as printing, display display, or a hole or groove on a metal or plastic.

  In addition, it is desirable to arrange the reference dots at equal intervals from the viewpoint of improving reading accuracy, but the reference dots are not limited to this, and a plurality of intervals are mixed to define a set of constant information of the dot pattern, It is also possible to define both a set of constant information of a dot pattern and a direction of the dot pattern by arrangement intervals of three different reference dots in the set of fixed information.

  Next, as step 2, a first virtual reference line 6 that connects the reference dots 4 arranged linearly is provided. In FIG. 2B, the first virtual reference line 6 is provided by a curved line. However, the first virtual reference line 6 is not limited to this, and for the reference dots 4 arranged in a curved shape. The straight first virtual reference line 6 may be provided, or the curved first virtual reference line 6 may be provided for the reference dots 4 arranged in a straight line. In other words, depending on where the second virtual reference line 7, the virtual reference point 74, and the information dot 72 in Step 3 to Step 5 described later are arranged, a first line composed of a straight line, a broken line, and / or a curve connecting the reference dots. One virtual reference line 6 can be freely defined.

  As shown in FIG. 4, the first virtual reference line 6 in the case of a curve is preferably a Bezier curve.

  That is, first, the reference dots 7 on the first virtual reference line 8 are P0 and P3, and P1 and P2 are given control points. Next, points P4, P5, and P6 are obtained by dividing the three line segments P0-P1, P1-P2, and P2-P3 obtained by connecting the control points in order at a one-to-one ratio. Then, points P7 and P8 are obtained by dividing the two line segments P4-P5 and P5-P6 obtained by connecting these points in order at a one-to-one ratio.

  Finally, a point P9 that further divides the line segment connecting the two points, P7-P8, at a ratio of 1: 1 is obtained, and this point becomes a point on the Bezier curve.

  By repeating this procedure, a Bezier curve having control points P0, P1, P2, and P3 is obtained.

  Note that the first virtual reference line 8 may be provided using various algorithms such as a spline curve obtained using a spline function, an nth order polynomial, an elliptic arc, and the like, not limited to a Bezier curve.

  Also, in the second virtual reference line 9, it is possible to define a curve using this method as with the first virtual reference line 8.

  Next, as step 3, a second virtual reference line 7 defined at a predetermined position from the reference dots 4 and / or the first virtual reference line 6 arranged in a line is provided. In FIG. 2C, the second virtual reference line 7 is placed adjacent to the reference dot 4 adjacent to a predetermined position on the vertical line with respect to the tangent line of the first virtual reference line 6 at the midpoint between the adjacent reference dots 4. However, the second virtual reference line 7 is not limited to this, and a virtual reference point is provided in accordance with an area in which information is input / output by a dot pattern, as will be described later. In addition, it can be defined by various methods.

  Also, the second virtual reference line 7 may be provided only on one side with respect to the first virtual reference line 6 to define the direction of the dot pattern, or may be provided on both sides to increase the amount of information. .

  Next, as step 4, a plurality of virtual reference points 74 are provided at predetermined positions on the second virtual reference line 7. In FIG. 3 (a), the virtual reference point 74 is an isosceles triangle whose bottom is the intersection of the second virtual reference lines 7, that is, the straight line connecting the adjacent reference dots 4, and the second virtual reference line 7 is the opposite side. However, the position of the virtual reference point 74 is not limited to this, and it is provided at the midpoint of the second virtual reference line 7 or instead of the second virtual reference line 7. Various modifications such as provision on the dots 4 are possible.

  In step 5, the information dot 72 is arranged at the end point expressed by a vector with the virtual reference point 74 as the start point. In FIG. 3B, one information dot 72 is arranged for one virtual reference point 74 so that the vector direction from the virtual reference point 74 is eight directions and the distance from the virtual reference point 74 is equal. However, the arrangement of the information dots 72 is not limited to this, and the information dots 72 are arranged on the virtual reference point 74, arranged in 16 vector directions, or arranged in two for one virtual reference point 74. It is possible to arrange a plurality of elements in any direction and in any length.

  FIG. 5 is an enlarged view showing an example of information dots of the dot pattern and bit display of the data defined therein.

  The information dot 3 is a dot for recognizing various information. This information dot 3 is arranged at the end point represented by a vector with the virtual reference point 5 as the start point. For example, as shown in FIG. 5, the information dot 3 is rotated by 45 degrees clockwise because the dot 0.1 mm away from the virtual reference point 5 has a direction and length expressed by a vector. These are arranged in 8 directions to represent 3 bits.

  In the illustrated example, 3 bits are expressed by arranging in 8 directions, but the present invention is not limited to this, and 4 bits can be expressed by arranging in 16 directions. Of course, it can be arranged in length.

  Further, in FIG. 3B, in all the virtual reference points 5, the information dot 3 is arranged at the end point position with the virtual reference point 5 as a starting point. However, the dot is not limited to this and is not limited to this. Information may be defined depending on whether or not is arranged. For example, information can be defined as “1” if a dot is arranged on a virtual reference point, and “0” if no dot is arranged.

  FIG. 6 is an example of the information dot and the bit display of the data defined therein, and shows another form.

  Further, regarding the information dot 3, if two types of short (upper part in FIG. 6) and long (lower part in FIG. 6) are used from the virtual reference point 5 derived from the reference dot 4, and the vector direction is 8 directions, then 4 bits. Can be expressed. At this time, it is desirable that the longer one is about 25-30% of the distance between the adjacent virtual reference points 5, and the shorter one is about 15-20%. However, it is desirable that the center interval between the long and short information dots 3 is longer than the diameter of these dots.

The information dot 3 is preferably one dot in consideration of its appearance. However, if the appearance is ignored and the amount of information is to be increased, a large amount of information can be obtained by assigning 1 bit to each vector and expressing the information dot 3 with a plurality of dots. For example, the vector of concentric eight directions, an information dot 3 defined from the reference dots 4 can represent information of 2 ^8, and 2 ⁶⁴ in chunks of the information dot eight constant information 1.

  As described above, the stream dot pattern according to the present invention is continuous with a line including a curve unlike the reference dot formed in a two-dimensional lattice pattern in the conventional dot pattern proposed by the present inventor. Are formed based on the reference dots arranged in this manner.

  FIG. 7 is a diagram illustrating an example of a state in which stream dot patterns are arranged in the vertical direction.

  In the figure, in addition to the reference dots and information dots, key dots and side dots are arranged. Key dots are dots arranged at both ends of a set of fixed information. This key dot is a representative point of the dot pattern 1 for one region representing a group of information dots. The side dots are dots arranged on the positive and negative extension lines of the shift of the key dot 2.

  In FIG. 6B, reference dots and stream dot patterns are arranged at equal intervals. As described above, by forming a plurality of stream dot patterns having a constant reference point interval, the XY coordinate values are defined without a gap. However, the stream dot pattern according to the present invention is not limited to this, and the interval between the dot patterns may be arbitrarily set as shown in FIG. Also, the interval between the reference dots can be set arbitrarily.

  As a result, the dot pattern in which the XY coordinates are defined is formed in the information area visually formed on the medium surface without being restricted by the shape of the rectangular area when used as a two-dimensional code (used as an index). It is possible to form a dot pattern by repeating a set of constant information in a combined free shape.

  Note that the virtual reference line and the virtual reference point according to the present invention are not actually printed and formed on the surface of the medium, but only when the dot pattern is arranged on the image memory of the computer or when the dot pattern is read. Is set virtually.

  By using this stream dot pattern, it is possible to form a dot pattern on a curved surface body such as a globe, a three-dimensional structure such as a human body model, a three-dimensional map, etc., and the present invention is not limited to a planar map or picture book. It is possible to use the input / output device according to the above.

(Paper keyboard)
8 to 10 are diagrams illustrating a paper keyboard that is an embodiment of the present invention.

  FIG. 8 is an explanatory diagram showing a paper keyboard in which a scanner (SCN) reads a dot pattern printed on one side (medium side) of a paper keyboard as a medium and performs various input operations of the personal computer. is there. This paper keyboard has a booklet shape with one long side bound, and a keyboard (key top) pattern is printed on each page surface of the booklet.

  Specifically, as shown in FIG. 9, a single hiragana or English character (“A”, “I”, “A”, “B”, etc.) or a plurality of characters imitating the key top of a personal computer. A plurality of square image areas printed with the following words (“send”, “yes”, etc.) are provided.

  In each rectangular image area, the code value of the interrupt key corresponding to each character (in the case of a single-character square image area) is registered as a dot pattern. It matches the code value defined at the key top of each character of the hardware keyboard.

  That is, when the scanner (SCN) reads the dot pattern of the square image area on which the English letter “A” is printed, the code value of the interrupt key generated when the “A” key of the hardware keyboard is pressed. Is input to a personal computer (information processing apparatus).

  In addition, as a function that does not exist on the hardware keyboard, words such as greetings "Nice to meet you", "Hisashiri", "Thank you", etc. are printed as square image areas, and these areas correspond to each wording The character string code value string is printed as a dot pattern. In addition to the case where the character string is printed as it is as a dot pattern of code values assigned to the key tops, an input command code value of a predetermined number of digits is printed as a dot pattern, which will be described later with reference to FIG. Character input information corresponding to the index table to be stored may be held in advance.

  In FIG. 9, a square image area on which words such as “view home page” and “send e-mail” are printed in addition to these words, the former is a browser program, and the latter is a mailer program. The start command code value is printed as a dot pattern.

  In FIG. 9, the keyboards are arranged in alphabetical order and alphabetical order. However, the arrangement is not limited to this and may be the same as an actual JIS layout keyboard.

  On the paper keyboard shown in FIG. 9, in addition to the code values described above as dot patterns, the above-described coordinate values are registered in each square image area.

  Here, when the dot pattern on the paper keyboard surface (medium surface) is imaged, in addition to replacing keyboard input using code values, it is also possible to replace mouse or tablet input using coordinate values. Is possible. As described above, whether to use a code value or a coordinate value is determined by providing a square image area on which a character “code / coordinate switching” is displayed on a paper keyboard and adopting the code value in this area. A code value for switching whether to adopt the coordinate value may be printed as a dot pattern, and the input of the code value and the coordinate value may be switched each time this square image area is scanned.

  Furthermore, the dot-patterned code value printed in the square image region can be used as a code value having a different meaning from the code value depending on the reading procedure.

  For example, when the dot pattern of the square image area “A” is read continuously within a predetermined time (the scanner is tapped on the square image area “A”), that is, the tip of the scanner is continuously applied to the medium surface. The coordinate image reading image has changed, such as when the up / down movement is repeated so that it touches or separates, or when the scanner is scratched, that is, when the scanner is rubbed back and forth or left and right on the key top image. In this case, the same state as when the shift key of the hardware keyboard is pressed may be used.

  Specifically, when a lowercase “a” is photographed by a scanner (SCN), the code value of the interrupt key corresponding to “A” is input to the personal computer, and then the tapping operation is performed, the personal computer The central processing unit (CPU) detects a change in the captured image of the scanner based on the program, and converts the interrupt code value corresponding to the lowercase “a” into the interrupt code value corresponding to the uppercase “A”. And hand it over to an application program such as a word processor.

  In the case of tapping operation, the dot pattern is read only once, and then only the intensity of light recognized by the scanner (SCN) CMOS sensor is detected to detect that the tapping operation is being performed. May be.

  In addition to such a tapping operation, uppercase “A” is used when the scanner is stopped on the square image area for a predetermined time or longer to read a dot pattern, and lowercase letters are used for a predetermined time or less. It may be determined as “a” and each code value may be transferred to the application program.

  Furthermore, when the coordinate value changes while reading the same code value on the square image area (scratch operation of the scanner), when the scanner tilt is detected by the change in the light intensity distribution within the captured image range, etc. It is also possible to switch between uppercase and lowercase input and pass each code value to the application program.

  FIG. 23B illustrates the grid tapping operation.

  That is, the grid tapping operation of the scanner (SCN) is an operation in which the scanner is set up vertically on the map, and the scanner is moved up and down to hit the icon on the medium surface (here, the key top image of the letter “A”). It is.

  FIGS. 23A and 23C are explanatory views showing the grid scratch operation of the scanner (SCN).

  The grid scratch operation refers to an operation of moving the scanner a plurality of times so as to be scratched on the map. The user (operator) performs a grid scratch operation on the icon on the medium surface (here, the key top image of the letter “A”). As a result, the input characters to the application program can be switched between the uppercase “A” and lowercase “a” interrupt codes.

  FIG. 24 is an explanatory diagram showing the grid grinding operation of the scanner (SCN).

  The grid grind operation is an operation of rotating the rear end (upward in the drawing) of the scanner while capturing the same icon (here, the key top image of the letter “A” in English). Grid grinding to the right (clockwise) with respect to the paper surface may be referred to as “grid grinding right”, and grid grinding to the left (counterclockwise) may be referred to as “grid grinding left”.

  As shown in FIG. 51, when the brightness of the captured image of the scanner is recognized, and the brightness area changes with respect to the imaging center, the central processing unit recognizes that the scanner is operated as shown in FIG. it can. Keyboard operations such as keyboard shift, control, and conversion of input characters may be performed by such scanner operations.

  Another example of the operation of changing the brightness of the image captured by the scanner is a grid pump operation (not shown). The grid pump operation is an operation of repeatedly tilting the scanner forward or backward.

  FIG. 51 is a diagram for explaining the relationship between the inclination and the angle of the scanner.

The dot pattern on the key top image is superimposed and printed in the same direction as the vertical direction of the paper. As shown in (a), an angle formed by the direction of the dot pattern and the direction of the camera in the scanner is α. Further, as shown in (b), when the user tilts the scanner, an angle formed between the tilt of the scanner and the direction of the camera is β. In this case, an angle γ formed by the direction of the dot pattern and the inclination of the scanner is an angle obtained by inclining the scanner with respect to the key top image. That is, the angle γ is
γ = α + β
It becomes.

  FIG. 52 to FIG. 54 are diagrams illustrating a method for calculating the brightness and the inclination direction of the image captured by the scanner in the above-described scanner operation.

  As shown in FIG. 51B, the inclination of the scanner (imaging means) with respect to the vertical direction of the medium surface (key top image) can be recognized by the difference in brightness in the imaging field of view of the scanner.

  The inclination direction of the scanner refers to an angle formed by the scanner and the map. Which direction the user tilts the scanner can be obtained by the following method.

  First, calibration is performed. The scanner is set up vertically with respect to the map, and the brightness of the cells 1 to 48 shown in FIG. 52 is measured. FIG. 52 shows an area around the scanner. The brightness at this time is assumed to be BL0 (i). i is the value of the measured cell. For example, the brightness of the cell No. 24 is displayed as BL0 (24).

  Two LEDs are installed inside the scanner. Therefore, even if the scanner is set up vertically with respect to the map, the brightness differs between cells near the LED and cells located away from the LED. Therefore, calibration is performed.

Next, the brightness when the scanner is tilted is measured. When the scanner is tilted in a certain direction, the brightness from cell 1 to cell 48 is measured, and the brightness in cell i is defined as BL (i). Then, the difference between BL (i) and BL0 (i) in each cell is calculated. And
Max (BL0 (i) -BL (i))
Calculate

  When the scanner is tilted, the direction opposite to the tilted direction becomes dark. This is because the LED also tilts in the direction in which the scanner is tilted, so that the distance from the LED is longer in the direction opposite to the tilted direction. Therefore, as shown in FIG. 53, the position opposite to the cell where the difference is the maximum is the position where the scanner is tilted.

  As a result, the direction in which the scanner is tilted is determined.

  Next, another method for determining the inclination direction and the angle by performing calibration will be described with reference to FIGS. 52 to 53.

  First calibrate. First, the scanner is set up vertically with respect to the map, the brightness of the cells 1 to 48 shown in FIG. 52 is measured, and the brightness in the cell i is set to BL0 (i).

  Next, the scanner is tilted 45 ° and made a round around the pen tip. In this case, the brightness when the scanner comes to the position of cell i is BL45 (i). BL45 (i) from cell 1 to cell 48 is obtained. Calibration is completed by the above operation.

を求める。 Next, when the user tilts the scanner, the brightness from cell 1 to cell 48 is measured, and the brightness in cell i is set to BL (i), i = 1, n (= 48). And

Ask for.

は最大値となる。上述した如く、スキャナを傾けた方向と逆の方向が最も暗くなるため、この場合のセルｉの逆方向が、スキャナを傾けた方向となる。 Since BL0 (i) -BL45 (i) is constant, when the value of BL0 (i) -BL (i) is the largest, that is, when BL (i) is the smallest.

Is the maximum value. As described above, since the direction opposite to the direction in which the scanner is tilted becomes darkest, the reverse direction of the cell i in this case is the direction in which the scanner is tilted.

となる。 The angle at which the scanner is tilted is

It becomes.

となる。 In addition, although the above-described equation assumes that the angle θ is linear with respect to the brightness, strictly speaking, approximation can be further improved by approximating as follows using a trigonometric function or the like. This way the angle is

It becomes.

  Further, as shown in FIG. 54, eight cells 1 to 8 are used as measuring points, and the brightness of each cell is measured.

  Furthermore, as described with reference to FIG. 51 above, when the dot pattern on the medium surface is read using the scanner, the fact that the scanner is tilted with respect to the medium surface is recognized by the difference in brightness of the captured image of the scanner. By doing so, it is possible to operate the GUI on the screen in accordance with the inclination direction of the scanner with respect to the medium surface.

  As shown in FIG. 51, when the central processing unit (CPU) recognizes the brightness of the captured image of the scanner and the brightness area moves to the opposite side with respect to the imaging center, the scanner is tilted with respect to the medium surface. Can be determined.

  On the other hand, when the brightness of the captured image changes so as to rotate with respect to the imaging center, the central processing unit (CPU) determines that the grid grinding operation has been performed by the scanner (see FIG. 24).

  In addition, when the brightness of the captured image changes repeatedly in the forward or backward direction with respect to the imaging center, the central processing unit confirms that the scanner has been repeatedly tilted forward or backward (grid pump operation). Can be judged. Along with such operation operation of the scanner, GUI operations such as movement of the cursor displayed on the display screen and scrolling of the screen may be performed.

  GUI operations on the screen are specifically operations such as scrolling the screen, moving the cursor, designating icons on the screen, dragging and dropping operations, menu selection, and mouse operation operations such as character position input operation. is there.

(Paper controller)
11 to 22 are diagrams illustrating a paper controller that is an embodiment of the present invention.

  On one side (medium side) of the paper controller, as shown in FIG. 11, an instruction to instruct a browser program (such as Microsoft Internet Explorer (trademark)) for accessing the Internet is provided on the surface of the paper medium. Is printed as an icon area. On the paper controller, as shown in the figure, a “user (operator) registration” instruction, a cursor movement instruction during web browsing, a URL copy / link instruction, a registration / display displayed on the display device, An icon area indicating an operation instruction on the editing panel, an instruction to open / close the registration / editing panel, a URL of the registration / editing panel, and an instruction to delete the link is printed. In these icon areas, dot patterns representing respective instruction codes are printed. For example, an interrupt code for moving the screen displayed in the browser program upward is registered in the “upward △” area of the scroll icon area for web browsing, and the browser is displayed in the “downward ▽” area. An interrupt code that moves the screen displayed in the program downward is registered.

  FIG. 12 shows a paper controller for registering an Internet URL as a bookmark. A rectangular area (icon area) in which an English letter G is designed is provided for 9 rows × 11 columns, and dot patterns having different code values are registered in these 99 icon areas. On the right side, an icon region indicating a category is provided in 9 rows × 2 columns.

  FIG. 13 illustrates a state in which various operations of the personal computer are performed by the scanner (SCN) reading the dot pattern printed on one surface (medium surface) of the paper controller described in FIGS. 11 and 12. It is explanatory drawing.

  The paper controller main body is made of sheet-like paper or synthetic resin, and a printing surface including a dot pattern is formed on the upper surface, and a transparent protective sheet is laminated on the printing surface. It has a laminate structure. Of course, such a protective sheet is not necessarily essential, and the printed surface may be exposed.

  FIG. 14 shows the paper controller described in FIG. 12 with a peelable seal structure, which is attached to a system notebook or the like, and is associated with voice, music data, or the like.

  FIG. 17A shows a local index table provided in the hard disk device (HD) of the personal computer.

  In the local index table, as shown in FIG. 5A, a code number meaning a dot code and an instruction are associated with each other. Specifically, the contents of the index table include an area (first area: “ID (in the figure) for an ID (for a member)” that registers an instruction to be executed when the dot pattern ID registered in the tag is read. (For members) ”, an area that associates the code number converted by reading the dot pattern of the paper controller and the access destination (second area:“ paper controller ”in the figure), and code The area can be divided into an area (a third area: an area indicated as “medium” in the drawing) in which the number and the registration destination of the content are associated.

  For example, as an example of using the first area, if the first digit of the code number is 1 in the reading result of the dot pattern of the tag, the central processing unit (CPU), based on the analysis program, By referring to this index table, it is recognized that the information is from the tag. In this case, the dot code management server is accessed to access the dot code management server index table (the management server table shown in FIG. 17B).

  As an example of using the second area, when the code number is 00001 to 00004 or later in the read result of the dot pattern of the paper controller, the file associated with each is accessed.

  For example, as shown in the figure, as an access destination, a drive name, a startup file, and parameters are registered as a set. More specifically, when the dot pattern read from the paper controller is code number 00001, an e-mail application program is associated with this, and a command meaning creation of a new mail is set as a parameter. Yes. As a result, the e-mail program is started, and a new e-mail can be created.

  For example, in the case of code number 00002, activation of the movie player is designated, and player software registered in the personal computer is activated.

  Furthermore, a character string can be directly input from a paper controller in the same manner as a physical keyboard. For example, when a code number 00003 is read, an English letter “A” or “B” is displayed in a specific application. These character codes are input and passed to the application.

  Furthermore, as an example of using the third area, when a dot pattern printed on a mail order catalog (medium) or the like is read and the code number is 00100, access to a URL associated with the code number (Web browsing), program execution, and movie file activation (playback) are performed.

  If the scanner reads the code number and converts it into a code number, and the code number does not exist in the index table, the central processing unit (CPU) accesses the management server via the network.

  The management server is provided with a user database for managing personal information and an index table on the server side (see FIG. 17B). Personal information corresponding to the code number read from the tag is registered in the server-side personal information management table (not shown). For the code number in which 1 is added to the first digit described above, When the personal information is not registered, the central processing unit (CPU) of the management server causes the personal computer to download an initial registration program according to the program. In this initial registration program, the user's own personal information, such as an address, a name, and a telephone number, are input. Based on the personal information input in this way, a user database of the management server is generated.

  That is, by registering personal information associated with a tag in the user database of the management server, authentication processing such as network access and payment can be easily performed.

  A table similar to the local index table described with reference to FIG. 17A is also generated in the management server table of the management server.

  This management server table is a table that complements the code number registered in the local index table. When the code number of the result read by the scanner does not exist in the local index table, the management server table is accessed. .

  For example, when the reading result by the scanner is the code number 00100 that did not exist in the local index table, the central processing unit (CPU) of the personal computer accesses the management server via the network according to the program. Refer to the management server table.

  In the management server table, the code number 00190 defines a predetermined URL access (Web browsing), so the personal computer executes an access to the URL (Web browsing).

  If the code number is, for example, 00201, meaning streaming distribution, the distribution server is accessed to download streaming data.

  In this case, the contents of the management server table are downloaded to the index table of the personal computer along with the streaming data.

  Therefore, after that, even if the reading result from the scanner is the code number 00201, the personal computer can process only the local index table without accessing the management server table.

  18 to 22 are diagrams illustrating another embodiment of the paper controller.

  The paper controllers shown in these drawings are substantially the same as the paper controllers described in FIGS. 11 to 13 except that a guide bank is provided for each predetermined icon area.

  As shown in FIG. 19, the guide bank is further provided with a plastic plate on the upper layer of the paper controller main body, and is a rib-shaped bank guide in which a part of the plastic plate protrudes in the exposed surface direction.

  When this bank guide is slid on the upper sheet surface with the tip of the scanner (lower end in the figure) (translated along the sheet surface), the operator who holds the scanner will see a slight obstacle to the sliding direction. It is preferable that the height is as high as it feels, and it is also possible to get over it intentionally and continue to slide.

  By providing such a bank guide, the operator can place the scanner on the intended icon area even if the operator does not rely on visual observation, if the positional relationship between the bank guide and the icon area on the paper controller body is remembered to some extent. Is possible. For example, in FIG. 25, a maximum of four icon areas (for example, “URL”, “link”, “all URLs”, “all URLs in the middle of the left column in FIG. 18) are surrounded by a rectangular bank guide. Link ”), but the user (operator) can print on the paper controller at hand by sliding the scanner in the upper left, upper right, lower left, and lower right directions (to the four corners of the guide bank). Even if the surface is not watched, the scanner can be stopped accurately on each icon area and each code value can be read.

  The guide portion may be provided with a protrusion on the card itself by embossing the card itself. Further, as shown in FIG. 20, the guide may be formed of a separate plastic, and only the card may be interchangeable with respect to the guide.

  21 and 22 show a braille protrusion with a dot pattern in an area surrounded by the bank guide of this paper controller. By providing Braille and dot patterns in the same area in this way, the same input efficiency as that of a healthy person can be maintained even when a visually impaired user (operator) uses the scanner.

  In particular, in FIG. 22, a dot pattern is printed above a predetermined square area of a medium (for example, paper or a synthetic resin plate), and braille is provided below, and this square area is surrounded by a wall (bank). Therefore, even a visually impaired user can grasp sensuously that different areas are scanned when the tip of the scanner crosses the bank.

  In this embodiment, the area where the dot pattern is printed and the area where the braille is printed are provided separately. However, the present invention is not limited to this, and the dot pattern and the braille are printed in the same area. Of course, it may be.

(Mouse pad)
25 to 31 are diagrams illustrating a mouse pad according to an embodiment of the present invention.

  FIG. 25 is an explanatory diagram showing a mouse pad system that performs various operations of a personal computer by a scanner (SCN) reading a dot pattern printed on one surface (medium surface) of a mouse pad as a medium. .

  This mouse pad is made of sheet-like paper or synthetic resin, similar to the paper controller and paper keyboard described above, and has a printing surface including a dot pattern on its upper surface. It has a laminated structure in which a transparent protective sheet is laminated on top. Of course, such a protective sheet is not necessarily essential, and the printed surface may be exposed.

  As shown in FIG. 26A, the printing surface is composed of an inner peripheral area and an annular outer peripheral area.

  Coordinate values and code A are printed as dot patterns in the inner peripheral area. In the outer peripheral area, the coordinate value and the code B are printed as a dot pattern. When the mouse pad is used for coordinate input, it is possible to input coordinates like a tablet using all the areas in a circle.

  In FIG. 5B, an image area in which alphabetic code values are registered is provided in the outer peripheral area.

  Such a mouse pad does not necessarily have a circular shape, and may have a rectangular shape as shown in FIGS.

  In FIG. 27, an input instruction area of a personal computer is arranged in an annular outer peripheral area. In each input instruction area, code values for computer operation are printed in a dot pattern. It also functions as a mouse pad and the paper controller described above.

In the figure, the functions in the respective functional areas (areas indicated by circled numbers in the figure) are as follows. In this detailed description, the numbers with circles are shown as numbers with parentheses.
(1) Touch the range selection icon (function area), move the cursor by the operation of the scanner in the inner frame, release when the start point is determined, touch again to move the cursor, determine the end point and release Then, the text in between is displayed in blue and becomes active.
(2) When a copy icon (function area) is touched, the range-selected text is stored in the memory. In the memory list, the copied text is listed first.
(3) When the cut icon (functional area) is touched, the range selected text is deleted, and the text is stored in the memory. In the memory list, the cut text is listed first.
(4) If the insertion cursor is not in the input mode, etc., touch the icon (function area) and move the cursor using the cursor keys → ← ・ ↑ ↓, or use the scanner operation in the inner frame. The insertion position is determined by moving and releasing the cursor.
(5) When the pasting icon (functional area) is touched, the text stored in the memory and activated is inserted from the position of the cursor in the input mode.
(6) When the erase icon (functional area) is touched, the text selected in the previous range is erased. If the range is not selected immediately before, one character after the cursor position in the input mode is deleted. Press and hold for more than 2 seconds to erase characters continuously until released.
(7) Back Space
When the icon (function area) is touched, one character is deleted from the text before the cursor position in the input mode. Press and hold for more than 2 seconds to erase characters continuously until released.
(8) When a line change icon (function area) is touched, the position of the cursor that has been changed to the input mode moves to the beginning of the line change.
(9) Touching the release icon (function area), after clicking the icon (function area) of (1), (4), (15), if no operation is performed, the mode is released and the standby It becomes a state.
(10) UNDO
When the icon (function area) is touched, the operation performed immediately before is canceled and the previous state is restored. You can go back again and again.
(11) Cursor →
(12) Cursor ←
(13) Cursor ↑
(14) Cursor ↓
When the icon (function area) is touched, the position of the cursor in the input mode is moved by one character in that direction. Press and hold for 2 seconds or more to continuously move the cursor position in that direction. If the pull-down menu is displayed, touching the icon (functional area) of (13) and (14) moves the active item of the displayed item up and down.
(15) When the memory display icon is clicked, a list of texts that have been selected or copied or cut out is displayed from the top in the new order. By touching the icons (functional areas) of (11) and (12), the active item can be moved up and down. All text is preserved unless (6) the active item is deleted.
(16) ENTER
When the position of the cursor is moved to a predetermined position and there is an instruction at that position, when the icon (functional area) is touched, the instruction is executed. Kana-Kanji conversion can also be determined. Has the same function as a general ENTER key.

  FIGS. 28A to 28D and FIGS. 29A to 29B show the scroll operation of the web page of the Internet browser program by the operation of the scanner using such a mouse pad.

  FIG. 30A is a plan view of a three-dimensional mouse pad, and FIG. 30B is a cross-sectional view thereof.

  The mouse pad is provided with an annular groove so that an operator who grasps the difference in the area can experience it through the scanner.

Such a groove may have a radial shape as shown in FIG. 31 in addition to the annular shape shown in FIG.
(Other paper controllers)
FIG. 32 proposes a new keyboard provided with this input reading means.

  Regarding the keyboard layout, the images of the key tops are arranged in a fan shape centering around “H”, “double”, “Y” and “conversion”, “Enter”, and the images of the key tops are arranged in a fan shape in the center direction. The key top images are arranged at positions shifted so as not to be arranged in a straight line.

  Each key top image is centered on “H”, “double”, “Y” and “conversion” “Enter”, with vowels (“A” “I” “U” “E” “O”) inside, Consonants (“K”, “S”, “T”, “N”, “M”, “Y”, “R”, and “W”) are arranged on the outside thereof.

  On these key top images, a dot pattern in which the code value and the XY coordinates are registered in the same format is superimposed and printed.

  The XY coordinates may be defined independently for each icon, or the XY coordinates may be defined over the entire medium surface.

  By using this keyboard, it is possible to input characters by touching and releasing the medium surface with a scanner (SCN). For example, to input “umbrella”, first, the key top image portion of “K” is read by the scanner. Then, the scanner (SCN) is traced (slid) on the paper keyboard in the order of “A” → “S” → “A”. Such an operation between the key tops can be recognized by a change in the coordinate value of the dot pattern superimposed and printed on the medium. Thereafter, the scanner is released (lifted up) from the key top image of the last “A”. The central processing unit (CPU) of the personal computer recognizes the input of “KASA” for Roman characters input by the recognition program and the “conversion instruction” by the release operation, and the application program (Japanese input program for the personal computer). ). As a result, “umbrella” is displayed in Chinese characters at the cursor position on the display device. In addition, if it is desired to convert input characters into Japanese, “conversion” may be read by a scanner.

If the user wants to input “patent” (see FIGS. 42 (1) to (5)), first read the key top image portion of “T” with a scanner and slide it as it is to “O” → “K”. ”→“ Double ”→“ Y ”→“ O ”, and release (pull up) the scanner from the key top image of the last“ O ”or slide to“ Convert ”. Here, “double” is an area read by the scanner when the previous character is input twice in succession.
The central processing unit (CPU) of the personal computer recognizes that it is a “conversion command” by input of “TOK (double) YO” in Roman characters, release operation, or subsequent reading of “conversion” by a recognition program. To an application program (Japanese input program) such as a personal computer. As a result, “patent” is displayed in Chinese characters at the cursor position on the display device.

  34 to 38 show an example in which a paper keyboard is used as input means of the infrared remote controller.

  In these, the scanner is integrated with the remote control. FIG. 34 (a) shows the structure in which the scanner is provided at the tip of the remote control, and FIG. 34 (b) shows the surface on the side opposite to the operation panel of the remote control. The structure provided with the scanner is shown.

  A user (operator) scans a radio / television column such as a newspaper using a scanner of a remote controller. In the newspaper TV column, channels and broadcast stations are displayed in the XY direction, and the program name, performers, and contents are printed in text information. In such a radio / TV column, a viewing / recording reservation code is printed as a dot pattern. By scanning this dot pattern with a scanner, the reservation code assigned to each program is read by a remote controller and set top The transmission is made toward the box (STB) or the infrared receiver of the television main body.

  FIG. 35 shows a remote controller having a structure in which a scanner can be placed on a cradle (base). The cradle analyzes a read signal from the scanner and generates an infrared signal, a central processing unit (CPU), a power source (BAT), and the like. Is built-in.

  FIG. 36 is an explanatory diagram in the case where program reservation / recording is performed for a set-top box for CS broadcasting or Internet broadcasting using the scanner (SCN) and cradle of FIG.

  The scanner (SCN) and the cradle may be connected wirelessly in addition to the wires shown in FIGS.

  FIG. 37 shows an example of a paper controller used in the remote controller shown in FIGS. 35 and 36, and FIG. 38 shows an example of a paper controller used in a remote controller that controls a set top box.

  For example, when the “power” area printed on the cover of FIG. 37 is read with a scanner, the dot pattern printed on the area is read and converted into a code value, and the power-on signal is sent to the TV or set-top box. Sent to.

  FIG. 39 is an implementation of the paper controller of the present embodiment as a medium for controlling a set top box provided in a guest room in a hotel.

  On this paper controller, symbols are printed for English, Chinese, Korean, and Japanese, and a dot pattern is printed on each symbol. A control signal is output from the remote control as radio or optical communication so that the set-top box performs an operation that each symbol means.

  40 and 41 are examples of a paper controller (paper keyboard) in the case of controlling music or a video player. Although detailed explanation of the music / video player is omitted, video and audio can be recorded and reproduced using the scanner (SCN) and these paper controllers (paper keyboard) in the operation of the music / video player. It is. A dot pattern is also input to each command area of these paper controllers (paper keyboard). Further, as shown in FIG. 41, a paper controller (paper keyboard) capable of inputting characters may be prepared.

  42 to 45 show a case where a white board is used as the medium surface, and a dot pattern is also printed on the white board. It is assumed that the dot pattern on the whiteboard is printed with a dot code (see FIG. 7) that means coordinate values.

  As shown in FIG. 45, a predetermined image is projected and displayed by a projector on a whiteboard on which a dot pattern representing coordinate values is printed. The projector is connected to a personal computer (not shown). When the scanner of the present invention (see FIG. 1) connected to the personal computer is used to operate an arbitrary position on the whiteboard, the dot pattern at that position is changed to the scanner (SCN). ) And converted into coordinate values in the personal computer. In the hard disk device in the personal computer, an index table (see FIG. 17) in which coordinate values and instructions or addresses are associated with each other is referred to, and information display and instruction execution specified for the corresponding addresses are performed. It has become.

  In this whiteboard, as shown in FIG. 43, an adhesive layer is provided on the surface of the whiteboard, and a transparent sheet on which a dot pattern is printed is pasted with the dot pattern as the adhesive layer side. ing.

  Therefore, since the dot pattern itself is protected by the transparent sheet, the dot pattern itself does not deteriorate even if the tip of the scanner comes into contact with the pen tip for the whiteboard.

  FIG. 44 explains another embodiment of the projection board.

  In this embodiment, the projection board is formed as a thin whiteboard magnet sheet. The whiteboard magnet sheet is formed of a transparent protective sheet, a dot pattern, a white sheet, and a magnet layer. In this case, the dot pattern may be formed on the white sheet on the transparent protective sheet side as shown in FIG. 5A, and on the white sheet side transparent protective sheet as shown in FIG. It may be formed. Such a projection board is used by being attached to the surface of a board such as a white board or a blackboard formed of a magnetic material.

  Thereby, it is possible to provide a projection board that is convenient to carry and highly convenient.

  In the example of FIG. 45, when the dot pattern on the area where the icon is displayed on the whiteboard is read by the scanner, the dot pattern is converted into a coordinate value on the personal computer and registered in advance corresponding to the coordinate value. The application program that is being started is started.

  Further, as shown in FIG. 42, an image of the remote controller may be projected on the left side of the whiteboard, and a moving image controlled by the remote controller may be played on the right side.

  In this case, when the portion corresponding to the projected image of each button of the remote control is read by the scanner, the coordinate value is read into the personal computer and the operation corresponding to the coordinate value, for example, playback, fast forward, rewind, pause Etc., and the projection moving image (image) can be controlled.

  FIG. 46 shows an example in which a board is a translucent acrylic board (screen board) instead of a white board, and a desktop screen or a moving image (image) of a personal computer is projected from the rear by a rear projector. .

  As shown in FIG. 47, in this screen board, an infrared cut filter sheet is affixed to the rear projector side of the acrylic board via an adhesive layer, and the opposite surface is transparent via an adhesive layer. A sheet is affixed. And the dot pattern which means a coordinate value is printed on the adhesive layer side of the transparent sheet. The infrared cut filter may be arranged on the dot forming side of the transparent sheet.

In this way, since the infrared cut filter sheet is attached to the rear projector side of the screen board, the infrared component in the irradiation light from the rear projector is cut, so the infrared component from the rear projector is placed on the scanner side. The noise light does not reach. Therefore, it is possible to maintain high dot pattern reading accuracy.
In FIG. 46, when the icon portion of the browser program is photographed by the scanner, the coordinate value is a correspondence table in which coordinates and processing instructions are paired by the central processing unit (CPU) of the personal computer (not shown). ), It is recognized that the position is the icon placement position of the browser program, and a processing command (in this case, activation of the browser program) corresponding to the coordinates is executed.

  In FIG. 48, in order for the user (operator) himself to create the paper keyboard described above, the image information of the paper keyboard is edited on the screen. This is an example for creating a paper keyboard that can be used by a user (operator) by freely arranging dot pattern codes on a mask.

  Prepare a program that allows you to delete, add, and arrange function icons yourself with the application on the screen, and print the image of the screen with the dot pattern or print it on the paper on which the dot pattern is printed. As a result, the execution instructions for the functions of application programs such as a word processor and spreadsheet software can be realized by a paper keyboard that is customized and printed for its own use.

  As a result, the arrangement of function buttons on the screen can be reduced, and the screen interface of the word processor, spreadsheet, and application program can be made extremely simple.

  49 and 50 illustrate an example in which the paper controller is used in an order system of a restaurant such as a restaurant.

  As shown in the figure, each table of a restaurant has a menu in which a dot pattern with a different code number is printed for each menu item, and a computer terminal having a display device (DISP) at one end of the table Is installed.

  The scanner incorporates a short-range wireless communication system such as Bluetooth, and the code number read from the menu and the number information can be transmitted to and from the computer terminal.

  The code number and the number information corresponding to the menu item read from the scanner are transmitted to the computer terminal. A central processing unit (CPU) in the computer terminal generates an order signal in which a table number is added to the code number and the number information of the menu item, and transmits the order signal to the order server.

  The order server extracts the table number, the code number of the menu item, and the number information from the order signal, and sets the order for the kitchen. Specifically, menu items corresponding to the table number and code number and the number thereof are displayed on the display device displayed in the kitchen so that the person in charge of the kitchen can prepare for cooking.

  The table number is added in the computer terminal when generating the order signal. However, a sticker or the like on which the dot pattern indicating the table number is printed on the surface of the stand of the computer terminal or the surface of the table in advance. When the scanner is distributed on the table, the table number and the computer terminal are related by reading the surface of the seal with the scanner.

  Therefore, a plurality of scanners may be distributed on the table so that orders from a plurality of people can be received simultaneously.

  FIG. 55 is an example of a paper keyboard using XY coordinate values as a mouse pad.

  FIG. 55A shows a mouse pad area provided in part of a paper keyboard.

  In this embodiment, only the code value is registered in the dot pattern printed on the key top image, and the code value and the XY coordinate value are registered in the dot pattern printed on the mouse pad area. When the user slides the scanner upward in the mouse pad area, the screen is scrolled upward. Similarly, when the scanner is slid downward, the screen is scrolled downward. The same applies to the right direction and the left direction.

  FIG. 55B uses the entire paper keyboard as a mouse pad area.

  In this embodiment, both the code value corresponding to the contents of the key top and the coordinate value are registered in all the key top images. When the user taps the scanner twice or more at an arbitrary position on the paper keyboard and then slides the scanner upward, the screen is scrolled upward. Similarly, when the scanner is slid downward after tapping the scanner twice or more, the screen is scrolled downward. The same applies to the right direction and the left direction.

  In FIG. 56, in the dot pattern formed on the projection board, the coordinate value and the code value are defined in one dot pattern format, and a predetermined matrix section is formed on the board. In the matrix section, the same code value is given regardless of the change of the coordinate value.

  In this embodiment, the icon image is arranged over one or a plurality of matrix sections, and the dot pattern of the icon image is read by the reading means, thereby controlling the video corresponding to the icon image or starting the program. Is instructed.

  FIG. 57 shows the relationship between the dot pattern code value and the XY coordinate values in each matrix of the whiteboard.

FIG. 57A shows the values defined in 32 bits from C _{0 to} C ₃₁ of this dot pattern in a table. As shown in the figure, C _{0 to} C ₇ mean Y coordinate, C _{8 to} C ₁₅ mean X coordinate, C _{16 to} C ₂₉ mean code value, and C _{30 to} C ₃₁ mean parity.

  These numerical values are arranged in the lattice region shown in (b), and (c) shows a specific dot pattern.

  FIG. 58 shows a code value / command correspondence table provided in a hard disk device (HD) of a personal computer. For example, when the dot code corresponding to the dot pattern read by the scanner is 11 or 12, the reproduction of the video is stopped. If the dot code is 13, playback is paused.

  59 to 61 are diagrams for describing a technique for creating a paper keyboard on which icons of a desktop screen are printed by capturing and printing the desktop screen.

  In this embodiment, when a desktop screen is captured by pressing a “print screen” button (prt sc) on a keyboard (KBD), an icon is printed on a paper surface together with a dot pattern. A program to be output as is prepared.

  FIG. 59A shows a desktop screen of a display (display means). For example, a word processor, the Internet and a spreadsheet icon image and a start button are displayed on the desktop screen.

  When the desktop screen is captured, the hard disk device (HD) of the personal computer recognizes where the icon is displayed on the desktop screen and calculates the coordinate value of the position where the icon is displayed. Then, the XY coordinates of the desktop and the XY coordinates of the printing paper are made to correspond to generate a dot pattern corresponding to the icon. In this dot pattern, a dot pattern that represents coordinate values on the screen and a code value that represents the function of an icon are included in one format. Then, a superimposition printing process of the desktop screen image and the generated dot pattern is performed. FIG. 59B is a diagram showing a paper keyboard on which a desktop screen and a dot pattern are printed.

  FIG. 60 is a diagram illustrating a table indicating the correspondence between code values and activation programs. When the dot pattern is generated by the above-described processing, a table in which the code value of the dot pattern is associated with the activation program (icon function) meaning the icon is generated in the hard disk device (HD). For example, when a dot pattern corresponding to an icon indicating a word processor is generated and a code value 0001 is assigned, the code value 0001 and the activation program Warpro. A table corresponding to exe is generated. The same applies to icons indicating the Internet and spreadsheets. By creating such a table, for example, when the user clicks on the picture of the graph of the paper keyboard shown in FIG. 88B with the scanner, the spreadsheet program is started.

  FIG. 61 shows the dot pattern format described above. Since the dot pattern format is the same as that described above, a description thereof will be omitted.

  In this way, the icons can be easily specified by printing the icons on the desktop screen in advance. For example, even if the icons on the desktop are hidden from the screen due to the activation of multiple programs, the program can be easily started by clicking the icon image with a scanner on the printed paper keyboard. It is possible to raise.

  The present invention can be used for an input system of information processing equipment such as a personal computer, a television, and a music player.

1 Reference dot 2 First virtual reference line 3 Second virtual reference line 4 Virtual reference point 5 Information dot CPU Central processing unit MM Main memory USB I / F USB interface HD Hard disk device DISP Display device (display means)
KBD Keyboard NW I / F Network interface SCN Scanner

Claims (26)

An optical reader connected to the information processing device;
An input processing system to an information processing apparatus comprising a medium on which a dot pattern is printed,
The optical reading device includes an imaging unit that images the dot pattern;
Analyzing means for analyzing coordinate values and / or code values defined in the dot pattern read by the imaging means;
Control means for decoding and transmitting a coordinate value and / or code value defined in the dot pattern, or an operation instruction or data corresponding to the coordinate value and / or code value,
The dot pattern formed on the medium surface includes a step of arranging a plurality of reference dots continuously in a line according to a predetermined rule, and a first pattern comprising a straight line, a broken line and / or a curve connecting the plurality of reference dots. Providing one virtual reference line, and at least one or more second virtual reference lines comprising straight lines and / or curves defined at predetermined positions from the reference dots and / or the first virtual reference line A step of providing a plurality of virtual reference points at predetermined positions on the second virtual reference line, and a distance and direction from the virtual reference point at an end point represented by a vector starting from the virtual reference point. A dot pattern formed by arranging one or more stream dot patterns arranged according to the step of arranging information dots in which XY coordinate values and / or code values are defined in Ri,
Touching and / or scanning the dot pattern formed on at least a part or all of characters, graphics, photographs, and icons printed on the medium surface with the optical reading device, and inputs the information to the information processing device. Input processing system to be processed. In order to define the second virtual reference line and / or to define the direction of the dot pattern and one XY coordinate value and / or code value, the stream dot pattern has a reference dot serving as a reference. The input processing system according to claim 1, wherein the input processing system is provided at a predetermined position. 3. The input process according to claim 1, wherein the icon is printed in a printable medium including a paper keyboard, a paper controller, a card, a sticker, and a sticky note as text, a photograph, or a graphic. system. The input processing system according to claim 1, wherein the operation instruction is a code value of an interrupt key of a keyboard, and causes the information processing apparatus to generate a key input interrupt process. The optical reading device reads the dot pattern, and indicates that the optical reading device is tilted with respect to the medium surface or another medium surface. The analysis means analyzes the tilt / direction and / or operation of the optical reading device according to the change in the angle and / or the direction in which the optical reading device is inclined with respect to the direction of the dot pattern, and the control means reads the optical reading device. 3. The input processing system according to claim 1, wherein a key input interruption process defined according to the inclination and / or operation of the apparatus is generated. 6. The input processing system according to claim 5, wherein the key input interruption processing is performed by pressing a button provided in the optical reading device. 6. The input processing system according to claim 5, wherein the key input interrupt processing includes changing a character type to be input, instructing character conversion, and moving a cursor. The key input interrupt process is
When scanning an icon on which a dot pattern is formed on the medium surface using the optical reading device,
When inputting a vowel-only word, the dot pattern on the icon is read by bringing the tip of the imaging means of the optical reader into contact with an icon whose code value corresponding to the vowel is defined as a dot pattern,
When inputting a word consisting of a consonant and a vowel, the reading unit at the tip of the imaging means is stopped by touching an icon whose code value corresponding to the consonant is defined as a dot pattern, and corresponding to the consonant. After the pattern is read, the imaging means is slid on the medium surface until the icon whose code value corresponding to the following vowel is defined as a dot pattern, and is temporarily stopped at the icon corresponding to the vowel. 6. A single character, a series of words, or a phrase is input by moving the imaging unit away from the medium surface after reading so that the dot pattern cannot be recognized. Input processing system. 6. The input processing system according to claim 5, wherein a GUI operation on a screen is performed according to the tilt / direction and / or operation of the optical reader. The GUI operation on the screen is a mouse operation operation such as screen scrolling, cursor movement, designation of an icon on the screen, drag and drop operation, menu selection, character position input operation, etc. An input processing system for an information processing apparatus according to claim 9.   The input processing system according to claim 1, wherein the icon is printed on the medium surface along with a concave and convex portion in which the dot pattern is braille. The Braille-shaped convex portions are arranged at predetermined intervals or banks are provided so as to surround the dot pattern printed on the medium surface with an elliptical arc, a polygon, or a curve. The input processing system according to 1 or 2. The information processing apparatus is a program playback receiver, tuner, recording / playback device, playback device or network access device, photo frame or broadcast reception / network access set-top box, video playback device such as a personal computer,
The optical reading device performs viewing / recording reservation or site access and / or control of the video playback device based on program information and site information printed on the medium surface with respect to the video playback device. A remote control,
The remote controller is an image pickup means for optically reading the dot pattern formed superimposed on the program information printed on the medium surface, each site information area, and / or an icon representing the control button;
Analysis means for analyzing coordinate values and / or code values defined in the dot pattern read by the imaging means;
Control means for decoding operation instructions or data corresponding to the coordinate values and / or code values into codes meaning data;
The input processing system according to claim 1, further comprising transmission means for transmitting the decoded code to the video reproduction apparatus. 14. The input processing system according to claim 13, wherein the remote controller is integrally provided with the imaging unit, the analyzing unit, the control unit, and the transmitting unit in a remote control body. The remote controller is provided with the imaging means and the analysis means in a remote control body, and the coordinate value and / or code value read by the remote control body is wired or wirelessly connected to a cradle incorporating the control means and the transmission means. Send in
14. The input processing system according to claim 13, wherein the code decoded by the cradle is transmitted to the video reproduction device by wire or wirelessly. The projection board on which the dot pattern is formed instead of the medium on which the dot pattern is superimposed and printed according to claim 1 or 2,
Further, a projection means for projecting a moving image or an image on the projection board,
An input / output processing system for inputting / outputting and processing the information processing apparatus connected to the projection means,
One side of the projection board has the projection means on which a moving image or an image is projected,
The optical reading device touches and / or scans the dot pattern formed in the moving image or image region with the optical reading device, and images the dot pattern;
Analyzing means for analyzing coordinate values and / or code values defined in the dot pattern read by the imaging means;
Control means for decoding and transmitting the coordinate value and / or code value defined in the dot pattern, or the operation instruction or data corresponding to the coordinate value and / or code value;
Transmitting means for transmitting the control value corresponding to the coordinate value and / or code value or the operation instruction or data corresponding to the coordinate value and / or code value to the information processing apparatus,
An input / output processing system in which the information processing apparatus causes the projection unit to output a moving image or an image corresponding to the control signal. One surface of the projection board includes a video display area on which a moving image or an image is projected, and a controller area on which an icon image for controlling the moving image or image projected on the video display area is displayed. Project at least a video or image onto the video display area,
Touching and / or scanning the dot pattern formed in the icon image area displayed in the controller area with the optical reading device,
17. The input / output processing system according to claim 16, wherein the information processing apparatus causes the projection unit to output a moving image or an image corresponding to the control signal. 18. The projection board has a transparent sheet attached to the surface of a white board through an adhesive layer, and the dot pattern is formed on the transparent sheet on the adhesive layer side. The described input / output processing system. The projection board is affixed to the surface of a board such as a white board or blackboard in which a white board magnet sheet is formed of a magnetic material,
The whiteboard magnet sheet has a magnet layer, a white sheet and a transparent protective sheet bonded together,
18. The input / output processing system according to claim 16, wherein the dot pattern is formed on the white sheet on the transparent protective sheet side or on the transparent protective sheet on the white sheet side. On the projection board, the projection means connected to the information processing apparatus projects at least an icon image that means activation of a program, and the dot pattern formed in the icon image area is projected to the optical reading apparatus. Touch and / or scan with
18. The input / output processing system according to claim 16, wherein the information processing apparatus starts a program corresponding to the icon image and outputs a corresponding moving image or image. The projection board is a rear projector board, and the projection means is arranged as a rear projector with respect to the projection board,
21. The input / output processing system according to claim 16, 17 or 20, wherein the dot pattern is formed on a surface different from a projection surface. 23. The input / output processing system according to claim 21, wherein the dot pattern formed on the projection board is made of an infrared absorbing material, and an infrared cut filter is provided at least on the surface on the projection means side. 3. A print control system according to claim 1, wherein the dot controller corresponding to the icon image displayed on the display means is superimposed and printed to generate a paper controller instead of the medium on which the dot pattern is superimposed and printed. And
The display means for generating and displaying the icon image;
A print control means for associating the icon image displayed on the display means with a predefined coordinate value and / or code value and instructing superposition printing of the icon image and the dot pattern;
A printing control system comprising: a printing unit that superimposes and prints the icon image and the dot pattern on a predetermined medium surface based on an instruction from the printing control unit. The display means is an information processing apparatus, and a desktop screen is printed on the medium together with the dot pattern,
Instructing the printing means to superimpose and print the desktop screen and the dot pattern in relation to the coordinates on the desktop screen and the coordinate value defined in the dot pattern or the coordinate value and the code value. The print control system according to claim 23.   The print control system according to claim 24, wherein the code value specifies the desktop screen.   The input processing system according to any one of claims 1 to 15, wherein the dot pattern is formed of an infrared absorbing material, and a coordinate value and a code value are defined in one format, or The input / output processing system according to any one of claims 16 to 22, or the print control system according to any one of claims 22 to 25.

Images