RU2349956C2 - Method of information playback, method of information input/output, device for information playback, portable device of information input/output and electronic toy in with dot raster - Google Patents

Abstract

FIELD: information technologies.

SUBSTANCE: perform data carrier scanning, for example, a printing material, on which the site with a dot raster by the ordered placing, according to the set rule, of the points which generation is carried out by algorithm of generation of a dot code so that to provide recognition of various kinds of the multimedia information as the data about the image with scanning means. Then carry out transformation of the data about the image in the code data. From the storage unit carry out reading of the multimedia information corresponding to the data of the code, for its reproduction.

EFFECT: provision of a dot raster, where the information on a code and the information on co-ordinates x and y can be set.

8 cl, 133 dwg

Description

BACKGROUND OF THE INVENTION

FIELD OF THE INVENTION

The present invention relates to a method for optical scanning information in the form of a dot pattern formed on a printed material, and reproducing a variety of information corresponding to the above information in the form of a dot pattern.

DESCRIPTION OF THE PRIOR ART

A talking toy has already been proposed that reads a barcode printed on a picture book or on a card for a game using an optical sensor and emits a specific voice signal. Such a talking toy makes it possible to read from the storage device a variety of speech information corresponding to the read bar code for reproducing this speech information.

However, this method using a barcode requires a special area on the paper reserved for printing a barcode, and the barcode is intended only for reading by the information processing system, and the reader of a book, including a book with pictures, is not able to visually understand the description of the barcode. Since the bar code is printed on the limited space of a sheet of paper, the reader perceives it as being unpleasant for him, and the presence of a bar code can sometimes lead to a decrease in the value of the book as a product, including picture books.

In addition, since, as mentioned above, the barcode cannot be printed on top of letters, graphics, or symbols printed on a paper sheet, in the case when these letters, graphics, symbols, and the like. used to reproduce speech signals, a bar code must be printed near them, which is difficult, since it is difficult for the reader to intuitively recognize speech or similar information added to letters or similar characters.

With regard to this issue, the disclosed Japanese Patent Publication No. 10-261059 discloses a “dot code” method, which proposes a method for scanning information printed in a dot raster in the code to reproduce information.

In the prior art, data is defined by arranging a dot pattern in the form of a block field, and a marker serving as a synchronization signal is defined by a dot pattern different from a dot pattern of data. According to this method, a dot pattern created by printing dots in a two-dimensional region on a sheet of paper is read in accordance with a predetermined rule by a pen-type scanning device, and the information processing device analyzes the scanning speed and scanning direction of this scanning device, thereby ensuring reproduction of information, including voice information that is previously set in accordance with it.

However, since such a method using a point code is based on the assumption that the scanning device performs dynamic scanning of points, although the reproduction of speech information in it can be carried out by letters printed on a sheet of paper, it is not an adequate way to reproduce information in static mode, performed only by bringing the scanning device close to the book with pictures or to a similar object on which letters and similar signs are located and in full annas in any form. In other words, since in this method using a point code in order to obtain essential information about the code, it is necessary to scan along a distance greater than the predetermined scan distance along the x and y coordinates, it is impossible to match the point code with the area with the minimum area and print this area.

SUMMARY OF THE INVENTION

The present invention provides a point raster that allows you to specify information about the code or the x and y coordinates even if the point raster occupies a minimum area, as well as a method for reproducing information and an information reproducing device based on a point raster.

The first object of the present invention is a method comprising the following operations:

scanning means (602) scan the information carrier, for example, printed material (606), on which a dot pattern portion (607) is formed as image data, and the aforementioned dot pattern portion is formed by ordered placement, in accordance with a predetermined rule, points (605), the generation of which is carried out by the algorithm for generating a point code in such a way as to ensure recognition of various types of multimedia information; converting image data of the aforementioned bitmap portion (607) into code data; and reading multimedia information corresponding to the above code data from the storage means for reproducing the above multimedia information.

Here, multimedia information can be any of the following types of information: voice information, graphic information, video information and visible, audible and readable information, for example, a letter and a symbol. In addition, the multimedia information may be digital data for another personal computer, television system, or radio station serving to reproduce graphic / video information, text information, and the like.

Here, in the dot-raster portion (607), information contained in the code corresponding to the voice information recorded in the storage medium can be determined, or the x and y coordinates can be determined. In addition, both types of information can be determined: the information contained in the code, and the x and y coordinates. A flag may be registered in the header of the dot-raster plot (607), which serves to determine whether the dot-raster plot displays information contained in the code, or the x and y coordinates.

The storage medium may be a picture book or photograph. A dot pattern portion (607) for recognizing speech information corresponding to an image (606b) from a picture book or similar image can be printed on top of the image (606b).

The dot pattern portion (607) can be printed on the element as a sticker.

A dot pattern region (607) can be formed on a transparent film (611). In this case, a transparent film can be placed on top of a sheet of paper, or a transparent film (611) can be attached to the means (613) for displaying information of the electronic device in the form of a touch panel. Then, the information display means (613) is used to display the command information so that the user can work with the scanning means.

Between the touch panel (612) and the storage medium, for example, a sheet of paper or means (613) for displaying information, there may be a filter (614) that cuts off infrared radiation.

In addition to the embodiment in which the touch panel is attached to the aforementioned information displaying means (613), the touch panel can be attached to a book, for example, a picture book, a figure, and the like.

Here, the scanning means (602) can be made in the form of a separate device with respect to the electronic device, which is, inter alia, a personal computer (608), a personal information device and a portable telephone, and data transmission between them can be carried out by a wired communication method , radio or optical communications. However, the scanning means (602) can be integrated into the electronic device, forming a single unit with it. In this case, the electronic device may be made having a case in the form of a fountain pen or a case in the form of a mouse-type manipulator, being an addition to these electronic devices.

The second object of the present invention is a method of input / output of information when entering data through a camera, comprising the following operations: on one of the surfaces of the printed material (5), a portion (6) is printed with a dot pattern formed by an ordered arrangement in accordance with a predetermined rule, points, the generation of which is carried out by the algorithm for generating a point code in such a way as to ensure recognition of various types of multimedia information, and section (7) with the transmitted information, Having gained text, illustrations, etc., are recognized as the related content; by means of the camera unit (2), image data of only the dotted image portion (6) is recorded on the aforementioned printing material (5), and the aforementioned image data is converted to digital form to obtain numerical values; and based on the aforementioned numerical values, information and programs corresponding to the aforementioned bitmap portion (6) are outputted from the data storage unit (10), and the aforementioned information and the aforementioned program are reproduced.

The dotted dot plot (6) and the transmitted information portion (7) containing text or illustrations or similar objects can be printed on one surface in such a way that they are superimposed on each other.

A point-raster plot (6) can be specified using information about the x and y coordinates, and this x and y coordinate information can be associated with the contents of the plot (7) with the transmitted information.

The dot pattern region (6) can be defined by the information on the numerical code, and this information on the numerical code can be brought into correspondence with the contents of the region (7) with the transmitted information.

A dot raster plot (6) containing information about the x and y coordinates, and a dot raster plot (6) containing information about the numerical code are printed on a flat surface of the printing material (5).

The dotted dot plot (6) can be printed with infrared absorbing ink, carbon based ink, or transparent ink.

In the case where the camera assembly (2) is used to record image data of the dot pattern (6), the dot pattern portion (6) can be irradiated with ultraviolet radiation.

The output information may be numerical data containing a voice information code, image data, video information and text.

The configuration can be implemented in such a way that in addition to the output of information in the form of numerical data provides the output of the program.

The area (7) with the transmitted information, the printing of which is carried out on the same surface together with the area (6) with a dot pattern, can be a text or illustration.

The camera assembly (2) can be an image capture device, for example, a CMOS camera (a camera based on a complementary metal-oxide-semiconductor structure) or a CCD camera (a camera based on a charge-coupled device). In the description below, a device referred to as a “camera assembly” may comprise any image registration means having such a configuration.

In addition, the camera unit (2) can be made as a separate unit with respect to the image processing unit (12), the data storage unit (10), the processing unit (9) and the output unit (15), transmitting data through the interface unit. At the same time, using abstract terminology, the interface unit may contain both functionalities: a functional means containing a central processor (CPU) formed as a single node, and a storage device that is a source of audio information, and other functional means, for example, a connecting device, serving for the exchange of data.

The camera unit (2) and the image processing unit (12) are made as a separate unit with respect to the data storage unit (10), the processing unit (9) and the output unit (15), transmitting and receiving data through the interface unit. Communication with the interface unit can be implemented by a wired communication method, a radio communication method, including using a wireless local area network and Bluetooth technology, or an optical communication method, for example, infrared communication.

The printing material (5) on which the dotted dot plot (6) is printed can be attached to various storage media by means of an adhesive.

In addition to information containing text, images and video information, the data storage unit (10) can provide program storage.

This information and the program can be stored in the data storage unit (10) by the input unit (17). Therefore, during use, any voice information can be stored in such a way that it is pre-associated with a given area (6) with a dot pattern.

This input unit (17) may be a microphone or an input line interface.

In addition, the device can be configured in such a way that it contains a communication board (16) installed therein. In this embodiment, the numerical data obtained by digitizing the dot pattern (1), which was scanned by the camera unit (2), can be transferred to a computer (23), for example, a server, through a communication board (16).

This configuration can provide the ability to store a huge amount of multimedia information in the server and play various types of multimedia information through communication. In particular, on a dot pattern (1), a network address is specified (URL: unified information resource indicator), a communication board (16) is used to establish communication with the communication network based on the transmission control protocol / Internet protocol (TCP / IP) (with called the Internet) and, thus, voice information stored at the network address can be loaded into the data storage unit (10) for playback.

Here, in addition to the communication board (16), a receiver (24) of the global positioning system (GPS) can be provided. This allows you to play multimedia information based on location information along with information content obtained from the dot pattern (1) by scanning it.

A third aspect of the present invention is an information input / output device using a portable telephone camera, comprising: a camera assembly (102) for scanning image data of only a dot pattern (6) with a dot pattern printed on printed material (5), a portion ( 6) with a dot pattern, formed by ordered placement, in accordance with a given rule, of points generated by the point code generation algorithm, so as to ensure recognition of various ide information and a portion (7) with the transmitted information containing text, graphic, etc., which recognize both the information content printed on the same surface of the printed material; an image processing unit (112) for converting the above image data into digital form to obtain numerical values; an interface unit (119) for transmitting digitally converted digital information so as to enable its output from a portable telephone (110) and reproduction of information and programs that correspond to the aforementioned dot pattern (6).

Since such a portable telephone equipped with a camera is used, the configuration of the information reproducing apparatus can be easily set.

Such a portable telephone equipped with a camera may be a portable telephone with an integrated information processing device, for example, an i-mode phone manufactured by NTT Docomo Inc, a Japanese company. This information processing device comprises a central processor, a storage device (memory), a liquid crystal display screen, and the like. A program, voice information, video information and text data can be stored in a storage device (s). The operating system (OS) installed in the portable telephone may be the Toron, Symbian, Windows CE operating system manufactured by Microsoft Corporation, LINUX, PALM-OS or the like.

Such a portable telephone equipped with a camera may have a configuration such that it is possible to install a memory card in this portable telephone, for example, a digital memory card with a memory card (SD card), a memory stick such as a memory stick, a memory card with single-row pin arrangement (SIMM), and furthermore, information content intended for reproduction is recorded in the aforementioned memory card.

A fourth aspect of the present invention is a portable electronic toy, comprising: a voice information storage unit (804) for storing voice information corresponding to a dot pattern portion (803) formed on the information medium (802), which is, inter alia, a book , a card for the game, a small object and a toy, a plot (803) with a dot pattern on which numerical data or information about a numerical code is recorded, which serves to recognize various speech information; a camera (810) for recording image data of the aforementioned dot pattern (803); a processing unit (806) for processing the aforementioned image data recorded by the aforementioned camera (810), and for reading speech information corresponding to the numerical data from the aforementioned unit for storing speech information, for outputting the speech information using a speaker (805) ); and a main body (808) serving to house the aforementioned block (804) for storing voice information, the aforementioned loudspeaker (805) and the aforementioned processing unit (806).

This main body (808) can be designed in such a way that it has the size of a notebook. In addition, the main body (808) may be provided with a liquid crystal display (812).

In addition, a dot pattern portion (803) can be printed on a card for comparison. Or, a dot pattern portion (803) can be formed on a miniature figure (hereinafter referred to as a “mini figure”) of a cartoon character sold in convenience stores and the like, for example, on a toy in the form of a candy, or to such a mini - the figure can be affixed with a sticker printed on it with a portion (803) with a dot pattern.

In addition, to enable communication between a plurality of portable electronic toys (821), the main body (823) may be provided with a connector for a connecting cable. In this case, the connector can be a universal serial bus connector or any connector that complies with IEEE 1394. In addition, Bluetooth communications equipment, a wireless local area network, or infrared spectrum communications can be used.

The fifth object of the present invention is the proposed device with the function of outputting information when entering data through the camera, located in the figure (218) of a given shape, the aforementioned device comprising: a camera (202), which serves to scan image data of only a portion (6 ) with a dot pattern printed on printed material (5), a portion (6) with a dot pattern, formed by ordered placement, in accordance with a given rule, of points generated by the generator algorithm tion dot code so as to provide recognition information and a portion (7) with the transmitted information containing text, graphic, etc., which recognize both the information content printed on the same surface of the aforementioned printed matter; an image processing unit (212) for converting the aforementioned image data into digital form to obtain numerical values; and a processing unit (209) and an output unit (215) serving for outputting and reproducing information and programs contained in the data storage unit (210) that correspond to the aforementioned dot pattern region (6) based on the above numerical values, the processing of which implemented by the aforementioned image processing unit (212).

In addition, the output unit (215) may be provided with a loudspeaker (214) serving to output voice information.

In addition, the data storage unit (210) can be designed in such a way that it provides for memorizing information and programs coming from outside by means of a microphone (217).

In addition, the figure (218) can be made in such a way that it is a soft toy (231) made by stuffing the outer shell of a predetermined shape with an elastic material.

Moreover, the device with the function of outputting information when entering data through the camera, located in the figure (218), may contain: the node (A) of the camera, made in such a way that it contains a camera (202), which serves to record image data only the area (6) with a dot pattern printed on printed material (5), a portion (6) with a dot pattern, formed by ordered placement, in accordance with a predetermined rule, of points generated by the point code generation algorithm, so that to write information recognition, and a section (7) with transmitted information containing text, an illustration, and the like, which is recognized as information content printed on the same surface of the aforementioned printed material, and a main processor (209) that converts the aforementioned data about the image in digital form with obtaining numerical values; an output unit (B) comprising a processing unit (9) and an output unit (15) for outputting and reproducing information and programs contained in the data storage unit (10) that correspond to the aforementioned dot pattern portion (6) based on the aforementioned numerical values, the processing of which is carried out by the aforementioned image processing unit (12) in the aforementioned camera unit (A); and an interface unit serving as an intermediate device for providing communication between the aforementioned camera unit (A) and the aforementioned output unit (B).

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are flowcharts, each of which shows a configuration of a method for reproducing information using a dot pattern according to the present invention, and, in particular, an explanatory drawing of a dot code is shown in FIG. 1A, and FIG. .1B a dot pattern recognition procedure is shown.

Figure 2 in front view shows an example of a dot pattern.

Figure 3 shows a functional block diagram used to explain the position of the picture book and the method of reproducing information.

Fig. 4A and Fig. 4B show flow charts, each of which shows another variant of the method of reproducing information using a dot pattern, and, in particular, in the explanatory drawing of Fig. 4A shows the procedure for generating the dot code, and in the explanatory drawing of Fig. .4B shows a dot pattern recognition procedure.

Figure 5 in front view shows another example of a dot pattern.

Figure 6 in front view shows another example of a dot pattern.

Figure 7 in front view shows another example of a dot pattern.

On Fig in front view shows another example of a dot pattern.

Fig. 9 is a front view showing an example of a picture book on which a drawing and narrative text are printed.

Figure 10 in front view shows another example of a book with pictures, which printed drawings and narrative texts.

Figure 11 in front view shows another example of a book with pictures, which printed drawings and narrative texts.

In the explanatory drawing of Fig. 12, a perspective view shows a touch panel on which a dot pattern portion is formed.

In the explanatory drawing of FIG. 13, this touch panel on which a dot pattern portion is formed is shown in a side view with a spatial separation of the parts.

FIG. 14 is a cross-sectional view showing another embodiment of the present invention comprising a mouse pad for which a dot pattern is formed, and a camera in the form of a mouse pad.

On Fig shows a camera in the form of a manipulator type "mouse" in a top view.

In each of the drawings of Fig. 16A and Fig. 16B, another embodiment of the camera is shown in the form of a mouse-type manipulator, and, in particular, in Fig. 16A, it is shown in a plan view, and in Fig. 16B, it is shown in side view.

In each of the drawings of FIG. 17A and FIG. 17B, another embodiment of the camera is shown in the form of a mouse-type manipulator, and, in particular, in FIG. 17A, it is shown in a plan view, and in FIG. 17B it is shown in a side view .

Fig. 18 is a cross-sectional view illustrating another embodiment of the present invention in which a printing surface is used as a tablet on which a dot pattern area is formed.

Fig. 19 is a cross-sectional view illustrating another embodiment of the present invention in which a camera is mounted at the end of a fountain pen element.

FIG. 20 is a cross-sectional view showing yet another embodiment of the present invention in which a camera is mounted at the end of a fountain pen element.

On figa and figb depicts a flowchart, each of which shows the configuration of the method of input / output of information when entering data through the camera according to the present invention, and, in particular, in the explanatory drawing of figa shows the procedure for generating the point code, and FIG. 21B shows a dot pattern recognition procedure.

On Fig in front view shows an example of a dot pattern.

In the explanatory drawing of Fig.23 shows a point raster formed from information about the coordinates x and y.

On the explanatory drawing Fig.24 shows a method for recognizing and processing a dot pattern generated from information about the coordinates x and y.

On the explanatory drawing Fig.25 shows a dot pattern generated from information about the numerical code.

FIG. 26 illustrates a method for recognizing and processing a dot pattern generated from information about a numerical code.

The explanatory drawing of Fig. 27 shows how the camera scans image data of only a dot-pattern area printed with carbon-based printing ink, separately from a transmission area containing text and drawings printed with color printing ink that does not contain carbon due to irradiation of the printed material with infrared radiation.

FIG. 28 is a functional block diagram for explaining an embodiment of a portable information input / output device that uses an information input / output method for inputting data via a camera.

FIG. 29 is a functional block diagram for explaining an embodiment of a portable information input / output device that uses an information input / output method for inputting data via a camera.

FIG. 30 is a perspective view showing a portable information input / output device housed in a compact housing.

In each of the drawings of FIG. 31A to FIG. 31G, a portable input / output device is shown housed in a compact housing of a different shape, and in particular, FIG. 31A shows the entire housing as a whole in perspective view; FIG. 31B is shown in a top view, in FIG. 31B is a side view, and in FIG. 31D is a front view.

Fig. 32 is a functional block diagram for explaining an embodiment of the present invention, in which the camera unit and the output unit are made as separate elements.

33 is a functional block diagram for explaining an embodiment of the present invention, in which the camera unit and the output unit are made as separate elements.

On Fig in perspective view shows a device in which the camera assembly and the main body of the output node are made in the form of separate elements.

On each of the drawings from Fig. 35A to Fig. 35G, a perspective view shows variants of a camera assembly of various types, and, in particular, Fig. 35A shows a pen-type camera assembly, Fig. 35B shows a pen-type camera assembly, .35B shows a camera assembly in the form of a mouse-type manipulator, and Fig. 35G shows a camera assembly in the form of a stethoscope.

36 is a functional block diagram for explaining an embodiment of an information input apparatus for a portable telephone using a camera.

37 is a functional block diagram for explaining an embodiment of an information input apparatus using a camera.

In the explanatory drawing Fig. 38 shows an input device for a portable telephone using a camera.

In the explanatory drawing Fig. 39 shows an information input device for a portable telephone using a camera.

In the explanatory drawing Fig. 40 shows a portable telephone with a built-in information input device.

FIG. 41 is a functional block diagram of a portable electronic device according to an embodiment of the present invention in which a dot pattern portion is used.

42 is a front view illustrating an embodiment of a portable electronic device using a dot pattern portion.

On Fig shows a portable electronic toy in a side view on the right side.

On Fig shows a portable electronic toy in side view from the left side.

On Fig shows a portable electronic toy in bottom view.

On Fig in perspective view shows an embodiment of a portable electronic toy that emits a speech signal, mainly corresponding to a mini-figure.

On Fig in perspective view shows a lot of talking toys connected to the controller unit.

Fig. 48 is a functional block diagram of a portable electronic toy according to an embodiment of the present invention.

On Fig depicts a functional block diagram of an embodiment of a portable electronic toy that uses optical character recognition (OCR).

On Fig depicts a functional block diagram of a portable electronic toy, which shows an embodiment using a magnetic element.

On Fig shows a functional block diagram of a portable electronic toy, which shows an embodiment using a pen for shooting, equipped with a camera, or a similar device.

On Fig depicted a functional block diagram showing a device in the form of a figure having a function of outputting information when entering data through the camera, in which the camera node and the output node are made as separate elements.

Fig. 53 is a functional block diagram for explaining a modified embodiment of the invention, which is given as an example.

On Fig shows a functional block diagram of a device in the form of a figure having a function of outputting information when entering data through a camera, in which the camera node and the output node are made as separate elements.

Fig. 55 is a functional block diagram for explaining a modified embodiment of the invention, which is given as an example.

In each of the drawings of FIG. 56A to FIG. 56 D, a perspective view shows figures provided with a camera assembly, and in particular, FIG. 56A shows a doll-like figure, FIG. 56B shows a soccer ball-shaped figure, Fig. 56B shows a figure in the form of a bicycle, and Fig. 56 D shows a figure of an animal.

On Fig in perspective view shows a device in the form of figures placed on the central platform of the battlefield of a new simulation board game.

On the explanatory drawing Fig.58 in a sectional view shows another embodiment of the present invention, in which the camera node and the output node are placed in a soft toy, which is one of the varieties of the figure.

In the explanatory drawing of Fig. 59 in a sectional view another embodiment of the present invention is shown in which the camera assembly and the output assembly are placed in a soft toy, which is one of the varieties of the figure.

In the explanatory drawing of Fig. 60 in a sectional view shows another embodiment of the present invention, in which the camera node and the output node are placed in a soft toy, which is one of the varieties of the figure.

On Fig shows a camera in a sectional view.

On the explanatory drawing Fig.62 shows the area of the image recorded by the camera.

On Fig in a perspective view shows the information points of the four blocks.

On the explanatory drawing Fig.64 shows the position of the center of the image recorded by the camera, and the input procedure of the subunit.

On the explanatory drawing Fig.65 shows the position of the center of the image recorded by the camera, and the input procedure of the subunit.

On the explanatory drawing Fig.66 shows the position of the center of the image recorded by the camera, and the input procedure of the subunit.

On the explanatory drawing Fig.67 shows the position of the center of the image recorded by the camera, and the input procedure of the subunit.

On the explanatory drawing Fig.68 shows the design of a pen scanning device.

On Fig shows an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

71 shows an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

FIG. 73 shows an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of using an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig shows an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig shows an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of using an embodiment of the present invention.

On Fig shows an example of the use of an embodiment of the present invention.

FIG. 90 shows an example of the use of an embodiment of the present invention.

On Fig shows an example of the use of an embodiment of the present invention.

92 illustrates an example of the use of an embodiment of the present invention.

FIG. 93 shows an example of the use of an embodiment of the present invention.

On Fig shows an example of the use of an embodiment of the present invention.

95 illustrates an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

On Fig depicts an example of the use of an embodiment of the present invention.

99 shows an example of the use of an embodiment of the present invention.

100 illustrates an example of the use of an embodiment of the present invention.

101 illustrates an example of the use of an embodiment of the present invention.

102 shows an example of the use of an embodiment of the present invention.

In the explanatory drawing Fig. 103 shows a first variant (1) of the characteristics of a dot pattern according to one embodiment of the present invention.

The explanatory drawing Fig. 104 shows a second variant (2) of the characteristics of a dot pattern according to an embodiment of the present invention.

In the explanatory drawing Fig. 105 shows a third variant (3) of the characteristics of a dot pattern according to an embodiment of the present invention.

The explanatory drawing Fig. 106 shows a fourth variant (4) of the characteristics of a dot pattern according to an embodiment of the present invention.

In the explanatory drawing Fig. 107 shows a first embodiment (1) of a structural embodiment of a device constituting means for scanning a dot raster portion according to an embodiment of the present invention.

On the explanatory drawing Fig.108 depicts a second embodiment (2) of a structural embodiment of the device, which is a means of scanning a plot with a dot pattern, according to a variant implementation of the present invention.

In the explanatory drawing Fig. 109 shows a third embodiment (3) of a structural embodiment of a device constituting means for scanning a dot raster portion according to an embodiment of the present invention.

The explanatory drawing Fig. 110 shows a fourth embodiment (4) of the design of the device, which is a means of scanning a plot with a dot pattern, according to a variant implementation of the present invention.

In the explanatory drawing Fig. 111 shows a fifth embodiment (5) of a structural embodiment of a device constituting means for scanning a dot raster portion according to an embodiment of the present invention.

In the explanatory drawing Fig. 112 shows a sixth embodiment (6) of a structural embodiment of a device constituting means for scanning a dot raster portion according to an embodiment of the present invention.

In the explanatory drawing Fig. 113 shows a seventh embodiment (7) of a structural embodiment of the device, which is a means of scanning a plot with a dot pattern, according to a variant implementation of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

FIGS. 1A and 1B are flowcharts, each of which shows a configuration of a method for reproducing information using a dot pattern according to the present invention, and, in particular, an explanatory drawing of a dot code is shown in FIG. 1A, and FIG. .1B a dot pattern recognition procedure is shown. Figure 2 shows an example of a dot pattern in front view, and Figure 3 shows a functional block diagram used to explain the position of the picture book and the method of reproducing information.

The method of reproducing information using a dot pattern according to the present invention comprises the following operations: generating a dot pattern 601, recognizing the aforementioned dot pattern 601, and reproducing voice information corresponding to the aforementioned dot pattern 601. In particular, scanning image data of a dot pattern 601 by cameras 602, which is a scanning means, carry out the correction of the distortion coefficient from the nets, they convert the image into numerical values that are digitized, the digitized numerical values are divided into the first direction 603 and the second direction 604, their position is read, and then the voice information corresponding to the dot pattern 601 is reproduced in a personal computer 608 (which is lower referred to as a "PC"), in a personal information device (PDA), in a portable telephone or similar device.

The camera 602 of FIG. 3 is a pen scanner, and the camera has an integrated image recording device, for example, a charge coupled device (CCD) or a CMOS device. However, as described below, the camera can be implemented in the form of a digital camera or a camera installed in a mobile terminal, including a portable telephone.

The generation of the dot pattern 601 according to the present invention is carried out as follows: for the recognition of voice information, the small points 605 are ordered in order by the point code generation algorithm along the first direction line 603 in accordance with a predetermined rule, and they are arranged along the second direction line 604, which is perpendicular to the aforementioned first direction line 603, in accordance with a predetermined rule. Then, a correspondence table is also generated in the storage device available in the PC 608, or in the storage device that the camera 602 is equipped with. However, this line 603 of the first direction and this line 604 of the second direction are not limited to the embodiment in which they are perpendicular to each other, they can be crossed, forming, for example, an angle of 60 degrees.

The dot raster recognition operation 601 includes a distortion coefficient correction operation caused by the camera lens 602, a distortion correction caused by tilting the camera 602, a numerical information reproducing operation in a first direction 603, and a numerical information reproducing operation in a second direction 604. Recording image data of a dot raster 601 carried out using a camera 602 equipped with an image recording device, which is, for example, a CMOS camera and a CCD camera. Instead of a pen scanner, a portable telephone equipped with a camera or a camera connected to a portable telephone may be used. In the case of using such portable telephones for reproducing voice information, control programs in the Java language (JAVA) and the like are used, loaded into the storage device of the portable telephone, in the form in which they exist. The image data recorded by the camera 602 is processed using an image processing algorithm to extract points 605 that undergo distortion coefficient correction operations caused by the camera lens 602 using the distortion correction algorithm. Or, they correct the distortion caused by tilting the camera 602 with respect to the dot pattern 601.

The processing of image data recorded by the camera 602 to extract points 605 is performed by the CPU (central processing unit) of the PC 608 using a predetermined image processing algorithm. Since the distortion caused by the camera 602 itself is corrected by the distortion correction algorithm, therefore, accurate recognition is possible even when the image data of the dot pattern 601 is recorded by a conventional camera 602 equipped with a lens having a high distortion coefficient. Accurate registration of the dot pattern 601 can also be ensured even when the camera 602 scans the dot pattern 601, which is tilted relative to the screen.

The reproduction of numerical information in the first direction 603 is performed as follows: two lines of the first direction 603 are selected, information on the points between the two lines of the first direction 603 is converted into digital form, a pattern of their location is recognized by the pattern recognition algorithm, and numerical information is reproduced in the first direction 603 using the correspondence table. If during playback the exact reading of the lines cannot be performed due to the presence of spots or noise, then the next line is selected and the same processing procedure is performed. Information about it is recorded as correction numerical information, which is used to adjust when reproducing numerical information.

The reproduction of numerical information in the second direction 604 is performed as follows: two lines of the second direction 604 are selected, the point information between the lines 604 of the second direction is converted into digital form, the pattern of their location is recognized by the pattern recognition algorithm, and the numerical information is reproduced in the second direction 604 using the correspondence table. If during playback the exact scanning of lines cannot be performed due to the presence of spots or noise, then the next line is selected and the same processing procedure is performed. Information about it is recorded as correction numerical information, which is used to adjust when reproducing numerical information.

The aforementioned dot pattern 601 is made in the form of a dot pattern portion 607 printed on printed material 606, for example, a picture book or textbook. Through the camera 602, an image of this dot pattern portion 607 is recognized, the corresponding speech information is read from the storage device based on the numerical data extracted from the image data, and the corresponding speech information and music are reproduced by an output means, for example, a personal loudspeaker 9 of the PC 608, personal information device or portable phone.

Fig. 4A and Fig. 4B show flow charts, each of which shows another variant of the method of reproducing information using a dot pattern, and, in particular, in the explanatory drawing of Fig. 4A shows the procedure for generating the dot code, and in the explanatory drawing of Fig. .4B shows a dot pattern recognition procedure. In each of the drawings of FIG. 5 to FIG. 8, another example of a dot pattern is shown in front view.

As mentioned above, the image data recorded by the camera 602 is processed by an image processing algorithm to extract points 5. Since the distortion caused by the camera 602 and the distortion due to the tilt of the camera 602 by the distortion correction algorithm are corrected, it is possible to provide accurate recognition when registering a raster 601.

When recognizing a dot pattern, a line formed by successive equally spaced points 5 is first selected and it is determined whether the selected line is correct. If the line is incorrect, then select another line.

Then, it is assumed that one selected line is a horizontal line. This horizontal line is used as a basis for selecting a line protruding vertically from a horizontal line. The vertical line starts from a point that is part of the horizontal line, and the vertical direction is recognized based on the fact that the next point or third point is not on the line.

Finally, the information area is extracted and the information contained therein is converted to numerical values to reproduce this digital information.

Figure 9 in front view shows an example of printing drawings in a book with pictures and text narration.

On such a page, the icon 606a located on the upper left side of the page is scanned by the camera 602, and the switch is turned on. Then, the scanning part 606c of the printed narrative text corresponding to Figure 6b is scanned by the camera 602. Since the dot pattern areas 607 are printed on the pictogram 606a and the text part 606c, these dot pattern sections 607 are used to recognize in which area and on which page of the book with pictures contains information, and in order to ensure the reproduction of appropriately memorized speech accompaniment of the narration by means of PC 608. For example, points 5 of section 607 with a dotted raster anes ink based on carbon, and the other portion is printed colored ink not containing carbon, to carry out scanning exposure by infrared radiation.

Figure 10 in front view shows another example of a book with pictures, which printed drawings and narrative texts.

Figure 11 in front view shows another example of a book with pictures, which printed drawings and narrative texts.

The method of reproducing information using a dot pattern according to the invention is not limited to a book with pictures based on the narrative and can be applied in educational material for teaching mathematics in an easily understandable way, shown in FIG. 10. In addition, as shown in FIG. 11, the method of reproducing information according to the invention can be applied in educational material for teaching music in an easily understood manner.

The storage device of a personal computer (PC) 608, personal information device or portable telephone stores information content that can be used as a book with pictures, making musical sounds and colloquial speech of the main characters, etc., as well as in accordance with the drawings books with pictures. Information content that can be used as educational material that produces speech signals in combination with a toy, for example, in the form of assembled blocks, and information content for storage of which a computer dictionary program can be used for translation can also be stored scanning words and text in a foreign language.

In addition, the method of reproducing information using a dot pattern according to the present invention can be used as follows.

"Book-toy with rising pictures, emitting speech signals"

Using the distinguishing feature that the camera 602 should only scan a dotted dot pattern 607 or should be brought close only to it, the information reproducing method according to the present invention can be combined with a “climbing toy toy” that provides the appearance of three-dimensional objects when opening the page. After the page is opened, the dotted dot portion 607 is attached to the inside of a three-dimensional object or applied to it by printing. When this dot raster portion 607 is found and the end of the camera 602 is brought close to the dot raster portion 607, various speech signals are output, thereby creating a “toy book with rising pictures emitting speech signals”. For example, when you open the page, the picture "house of horrors" rises. When the camera 602 passes through a dot-raster portion 607 located in a window, a speech signal is reproduced, which is a female scream, for example, “oh!” ("yipe"). When the camera 602 passes through a dot-raster portion 607 located in the hall, the sound of ominous steps is reproduced, for example, “tap tap”.

"A book with pictures that provides an opportunity for creativity (a book that provides an opportunity for creativity)"

The dot pattern portion 607 can be attached to a desired portion of the picture book, which is printed material 606. Since there is a dot pattern portion 607 attached so that the user can create content, it can be used as a “book with pictures that provide an opportunity for creativity (a book that provides an opportunity for creativity) ", which is capable of providing a change of theme in any place. For example, a user can create an initial narrative by attaching a dot raster section 607 to a picture book 606 corresponding to a collection of a picture book, a collection of voice information, a list of sound effects, source sound data, and a similar dot raster 607 containing a user’s speech information or music.

Then, a sticker is made with a list of sound effects sources or a sticker with a pictogram containing a dot pattern portion 607 formed on it, the user draws a picture on a picture book on which nothing was drawn in advance, and then the user attaches a sticker to this picture book, creating the original story. With this configuration, the user himself can create a book with pictures that carries out the output of speech information.

"Training material providing the output of speech information"

The invention can be used as "educational material that provides the output of voice information", intended for children, adults, the elderly of any generation. For example, the end of the camera 602 is brought close to the dot pattern portion 607 on the printed material 606, and the dot pattern portion 607 is scanned in order to reproduce the speech information. With this configuration, the present invention can be used for teaching languages, for example, English colloquial speech, for teaching children, for example, for intellectual development and music education, and as a teaching aid, for example, for exercises.

Since the present invention can be used as input means of interaction printed on printed material 606 or on a similar object, it is possible to produce means of interaction suitable for each information content. In addition, it is designed in such a way that it allows you to download the dot pattern data to the PC 608 via a universal network, for example, via the Internet, in the case when the user freely composes the dot pattern data and prints a dot pattern on a piece of paper using the universal printer, therefore, as mentioned above, the user can create such a "book with pictures, providing the output of the picture".

In addition, in the dot pattern portion 607 that is provided with the printed material 606 or other storage medium, information about a uniform information resource indicator (URL) can be specified. When the information about the unified index of the information resource (URL) is extracted from the image data obtained by registering a snapshot of the dot pattern 607 by the camera 602, the navigation and browsing program (browser) installed in the PC 608 accesses the aforementioned unified index of the information resource (URL) to perform a predefined operation.

In the explanatory drawing of Fig. 12, a perspective view shows a touch panel with a dot pattern portion 607 formed thereon. In the explanatory drawing of FIG. 13, this touch panel with a dot pattern portion 607 formed thereon is shown in a side view with a spatial separation of the parts.

The usual touch panel is made on the screen of a video monitoring device, for example, an LCD display (liquid crystal display) or a CRT (cathode ray tube) in such a way that the position data is entered into the touch panel by pressing from above with a finger, pen or similar means, following commands on the screen that is visible through it. This conventional touch panel has two sheet electrodes: an upper sheet electrode and a lower sheet electrode having transparent electrodes of indium and tin oxides or similar, located opposite each other on a transparent film, for example, with a spacer that serves as a dielectric between the electrodes . Then, a transparent support plate made of resin is attached to the lower surface of the bottom sheet of the electrode by a layer of transparent glue. However, this option has disadvantages in terms of high cost and complexity of use due to surface twisting arising from prolonged use.

Therefore, in order to avoid high cost, only such a touch panel 612 is used, which contains a transparent film 611 with a dot-printed portion 607 printed thereon, and an affordable camera 602 (pen scanner).

This touch panel 612 is located on the screen of a video monitoring device 613, for example, an LCD (liquid crystal display) or CRT (cathode ray tube) PC 608 or similar device. Then, the camera 602 conducts along a certain path, following the command displayed on the screen, thereby entering position data. Thus, the camera 602 is directed to the touch panel 612 attached to the screen of the video monitoring device to register image data of the dotted dot pattern 607. On the screen of the video monitoring device PC 608, information corresponding to the dot pattern 607 is recognized and, accordingly, various speech or similar information stored in the PC is reproduced.

The points 5 of the dotted raster portion 607 have such characteristics that it readily absorbs light radiation when their main component is carbon. If the light beam from the screen of the video monitoring device is not cut off, then the image data of the dot-raster portion 607 cannot be accurately recorded by the camera 602. Therefore, a film 614 is cut off between the screen of the video monitoring device and the touch panel 612, which cuts off the infrared radiation, by which the infrared radiation is cut off emitted by the screen of a video monitoring device. With such a structure, the irradiating light radiation is only infrared radiation emitted from the inside of the camera, and the light radiation reflected from points 5 is easily recognizable, thereby facilitating the recognition of a dot pattern portion 607, and such a design can be used in as the touch panel of the PC 607.

Such a touch panel 612 allows the camera 602 to be used as a pointing device. In addition, due to the sequential recognition of points, it can be used as a device for recording. For example, if this touchpad 612 is located with the working side up, then it can be used as a regular writing desk.

In the explanation given here, the aforementioned touch panel is described in such a way that it is installed on the screen of the PC 608 video monitoring device, however, it can be used on the display of a personal information device, on the screen of the device for selling photographic stickers, on the screen of an ATM belonging to a bank, etc. .

Fig. 14 is a sectional view showing another embodiment of the present invention, comprising a camera in the form of a mouse-type manipulator and a mouse pad for a mouse-type manipulator, on which a dot pattern portion 607 is formed. 15, a camera in the form of a mouse-type manipulator is shown in a plan view.

According to this embodiment of the present invention, the camera 602 is integrated into the housing 615 in the form of a mouse-type manipulator and combined with a mouse pad 616. A translucent mirror element 617 is installed inside the mouse-shaped housing 615, which serves to make it possible to recognize the surface of the mouse-shaped mat 616 through the lower surface 615a of the mouse-shaped housing 615, and tracking the dot-raster portion 607 containing the coordinate information printed on the mouse pad 616 is carried out through an open window 618 mounted on the upper surface 615b of the housing 615. Near the window 618 there are keys 615c.

In the case when the mouse pad 616 is recognized, the camera 602 in the housing 615, which is in the form of a mouse type manipulator, can be used as a data input device instead of a conventional mouse type manipulator. In particular, a conventional mouse-type manipulator can only be used to enter relative coordinates, while camera 602 provides the additional ability to enter absolute coordinates.

On figa and figb shows another embodiment of the housing in the form of a mouse-type manipulator with an integrated camera. In particular, in FIG. 16A, it is shown in a plan view, and in FIG. 16B, it is shown in side view. On figa and figb shows another embodiment of the housing in the form of a manipulator type mouse with an integrated camera. In particular, in FIG. 17A, it is shown in a plan view, and in FIG. 17B, it is shown in side view.

According to this embodiment of the present invention shown in FIGS. 16A and 16B, a camera 602 is integrated in the protruding end 615d of a mouse-shaped housing 615. Since the protruding end 615d is formed in a mouse-shaped housing 615 in a similar manner, this mouse-shaped housing 615 can be easily placed in a predetermined location of the mouse-shaped mouse pad 616 and pressed a button switch 615e and thus recognize the surface of the mouse pad 616 through the lower surface 615a of the housing 615 having the shape of a mouse pad.

This option may also be equipped with a push button switch 615f located on the lower surface 615a of the housing 615, which is in the form of a mouse-type manipulator. The button switch 615f can only be turned on if the case 615 having the shape of a mouse manipulator is placed in a predetermined position on the mouse pad 616 and the case 615 having the shape of a manipulator mouse type, pressed to the surface of the mouse pad.

FIG. 18 is a cross-sectional view illustrating another embodiment of the present invention, in which a printing surface is used as a tablet on which a dot pattern portion 607 is formed.

According to this embodiment of the present invention, a fountain pen element 619 comprising a camera 602 is used in conjunction with a table 620 (or a copy table), which is used as a tablet, on the printed surface of which a dot pattern portion 607 is formed. A paper sheet 621 is laid on the table 620, on which a dot-raster portion 607 (printed surface) 621 is printed, with this pen-like element 619, draw and spell and turn on the switch 622a, thereby ensuring data recording and transfer to a PC 608 or to a personal information device. In addition, the end of the pressure sensitive switch 622b protrudes from the end of the pen element 619.

This fountain pen element 619 is used to write letters or to draw a drawing on a piece of paper on hand in the usual way. In this case, the written letters and the drawn picture can be entered into the PC 608 or into a personal information device without looking at the display screen, since the camera 602 recognizes the speech and other information contained in them. Therefore, this fountain pen element 619 can be used for illustrations, drawings, and also notes. Previously, it was usually necessary to look at the display screen when moving a mouse-type manipulator along a path. However, this need has been eliminated, making data entry easier. In addition, you can easily perform an operation, which can usually be realized only using a coordinate input device called a tablet.

Fig. 19 is a cross-sectional view illustrating another embodiment of the present invention in which a camera is mounted at the end of a fountain pen element. FIG. 20 is a cross-sectional view showing yet another embodiment of the present invention in which a camera is mounted at the end of a fountain pen element.

A camera 602 mounted at the end of the pen-like element 619 can be mounted on it in such a way that it is rotatable, as shown in FIG. Since the camera 602 has such a rotary structure, the camera 602 can always be positioned vertically with respect to the surface of the dotted pattern 607 on which the print is made, and there is no need to take into account the distortion caused by tilting the camera 602 (element 619 in the form fountain pens).

On Fig in a sectional view shows another embodiment of an element in the form of a fountain pen equipped with a switch that responds to pressure, which is installed at its end. The switch 622 does not have to be installed on the element 619 in the form of a fountain pen. As shown in FIG. 20, a switch 622 may be mounted in a chamber 602 having a rotatable structure. With this design, to turn on the push button switch 622, you just need to press the switch 622 of the camera 602 to the surface of the printed dot pattern 607.

Therefore, the invention allows you to control the PC 608 in a similar way instead of using the keyboard or mouse-type mouse that the PC is usually equipped with, and anyone can easily control the PC 608 just by pressing. Therefore, the present invention serves as a means of interacting with a computer, which is very close to humans. In addition, the invention can be made having a simple design and low cost compared to a keyboard for data entry.

However, the present invention is not limited to the embodiments described above. In the case where the invention is made in such a way that it recognizes a dot pattern portion 607 on a printed material 606 or on a transparent film 611 (on a touch panel 612) and reproduces predetermined information and speech signals, thereby providing the possibility of various options for its use , the present invention is not limited to the embodiments described above. In addition, modified versions of the present invention may be implemented without departing from the scope of the patent claims of the present invention.

On figa and figb depicts a flowchart, each of which shows a method of input / output of information when entering data through the camera according to the present invention, and, in particular, on the explanatory drawing of figa shows the procedure for generating the point code, and 21B shows a dot pattern recognition procedure. On Fig in front view shows an example of a dot pattern.

The method of inputting / outputting information when entering data through a camera according to the present invention comprises the following operations: generating a dot pattern 1, recognizing a dot pattern 1, and outputting information and programs corresponding to the dot pattern 1. In other words, the camera assembly 2 is used to scan data about the image of the dot pattern 1. First, the key points 3 are extracted, and then the information points 4 are extracted. The extracted points are digitized for extraction in ormatsionnoy area and thereby carrying out conversion into numerical values. Based on this numerical information, information and programs that correspond to the dot pattern 1 are output.

The generation of the dot pattern 1 according to the present invention is carried out in such a way as to ensure an orderly arrangement of small points (key point (CT) 3a, grid points (TC) 3b and information points 4) in accordance with a predetermined rule by means of a point code generation algorithm for recognizing information . The recognition operation of the dot pattern 1 contains the following operations: carry out the correction of the distortion coefficient caused by the lens of the camera unit 2, carry out the correction of the distortion resulting from the tilt of the camera unit 2, and reproduce the numerical information of the key point 3a (CT) and information points 4. Data is recorded about the image of the dot pattern 1 by the camera assembly 2, which contains an image recording device, for example, a CMOS camera or a CCD camera.

The above described dot pattern 1 consists of a dot pattern portion 6 created by a printing method on a variety of printing materials 5. In particular, as shown in FIG. 23, in the present invention, the dot pattern portion 6 is printed on the same surface of the printing material 5 together with section 7 with transmitted information displayed by letters, illustrations, etc., by which people are usually able to visually recognize information content. In a preferred embodiment, the transmitted information portion 7 is printed using carbon-free ink. In contrast, the dots of the dotted dot plot 6 are preferably printed with carbon based ink.

In the information input / output method according to the present invention, first, when the camera assembly 2 is used for recording image data of the dot pattern 6, the dot pattern 6 is irradiated with infrared light and thus only accurately scans the dot 6 of the dot pattern which is printed with carbon-based printing ink, separate from portion 7 of the transmitted information, printed with carbon-free color printing ink. In other words, since the printed material, on which the section 7 with the transmitted information expressed in letters or numbers, and the section 6 with a dot pattern are printed so that they are superimposed on the same surface, the information data of only the section 6 with a dot raster, then information can be extracted only from section 6 with a dot raster.

In the explanatory drawing of Fig.23 shows a dot pattern composed of information about the coordinates x and y. On the explanatory drawing Fig.24 shows a method of recognition and processing of a dot pattern, composed of information about the coordinates x and y.

The dot pattern portion 6 of the present invention is created from x and y coordinates information, and the x and y coordinates information and the information content of the portion 7 with the transmitted information can be related to each other. As for the plot 6 with a dot pattern, the image data of the plot 6 with a dot pattern is recorded using the camera unit 2 as described above and the graphic information is converted into digital form to obtain numerical values. The numerical values are expressed by information on the x and y coordinates, which is then associated with any location of the sections with the transmitted information, indicated by a circular section A, a square section B and a triangular section C. At this point in time, the x and y coordinates are associated with each of the sections 7 with transmitted information using look-up table 1 of Fig.24. In other words, a correspondence is established between the interval of x and y coordinates and any contents of sections 7 with the transmitted information. After that, refer to reference table 2 of Fig.24 to display information or programs corresponding to the area 6 with a dot pattern.

For some information content, the interval of x and y coordinates with information and a voice guidance program or similar information can be mapped to section 6 with a dot pattern created from information about x and y coordinates only if printed material 5 on which the dot pattern 1 is pre-printed, and the portion 7 with the transmitted information is printed so as to be superimposed on the printed material 5. In other words, since there is no need to create 6 with a new portion for the dot pattern portion 7 with the contents of transmitted information, its versatility becomes extremely high.

On the explanatory drawing Fig.25 shows a dot pattern generated from information about the numerical code. On the explanatory drawing Fig.26 shows the procedure for recognizing and processing a dot pattern generated from information about the numerical code.

The dot pattern region 6 according to the present invention makes it possible to create information on the numerical code instead of the above x and y coordinates and to put this information on the numerical code in accordance with the contents of the region 7 with the transmitted information. For example, a dot pattern section 6 is printed that contains information on a numerical code corresponding to the contents of any of the following sections: section 7 with information transmitted in the form of round section A, section 7 with transmitted information in the form of square section B and section 7 with transmitted information in the form of a triangular section C. Section 6 with a dot pattern also contains data in the form of an image that is recorded by the camera unit 2 in the manner described above and this image information is converted into digital form with the receipt of numerical values (information about the numerical code). Then, by accessing the lookup table from Fig. 26, information and programs are output corresponding to the dotted dot plot 6.

According to a dot raster section 6 containing information about a numerical code, the code number and the contents of the transmitted information section 7 are in direct correspondence with each other. Therefore, as shown in FIG. 26, it is sufficient to create only one lookup table. In addition, since there is a need to create only one lookup table, it is possible to reduce the processing time of information.

It goes without saying that in this embodiment, a dot pattern portion 6 containing x and y coordinate information and a dot pattern portion 6 containing numeric code information can be printed on the same surface.

In the explanatory drawing of Fig. 27, a state is explained in which the image data of only a dot pattern plot printed with carbon-based ink is recorded by the camera separately from the transmitted information portion containing letters, numbers, and the like, printed in color typography carbon free paint.

As shown in FIG. 27, on the printing material 5, which is white paper, a portion 7 of transmitted information is formed, printed with printing ink that is transparent in the infrared wavelength region but produces color at wavelengths in the visible region of the spectrum, for example, carbon-free printing ink (dye-based printing ink). Then, on this printing material 5, a dot pattern portion 6 is formed that is printed with a printing ink creating a color in the infrared region of the wavelengths, for example, a carbon based printing ink, for example, a toner, a printing ink visible in infrared light, a transparent printing ink, etc. .P. These sections: section 7 with the transmitted information and section 6 with a dot pattern, are superimposed on each other in order to print them on the same surface, and then they are photographed by the camera unit 2. At this point in time, the infrared filter 2a cuts off the light of the visible region of the wavelength spectrum and transmits only the infrared wavelengths. The camera can only receive information about the dot pattern 1. On the other hand, it is also possible to first print the dot pattern portion 6 before the portion 7 with the transmitted information is printed.

This unit 2 of the camera recognizes in these areas with a dot pattern those points that are printed in accordance with a given rule, convert these points to digital form with obtaining numerical values. Then, the reading of numerical information is carried out and recognition of that area of information or program on the printed material 5, which corresponds to the area 6 with a dot pattern. After that, the output and playback of various information and various programs are carried out, respectively stored in the storage device. For example, the information and the program corresponding to the dotted dot plot 6 can be output in the form of text and image or in the form of speech information.

A method of irradiating a portion 6 with a dot pattern with infrared radiation can be applied to ensure that the node 2 of the camera registers image data of only the portion 6 with a dot pattern on the printed material 5.

According to the method described above from the present invention, it is possible to output and perform operations with voice information of various types by means of an information medium that is a printed material 5. The invention can be applied to various printed materials 5, for example, for a picture book, for a toy book with drawings rising when it is opened, directly for the photograph itself, for questions, for text, for a notebook, magazine, newspaper, card, membership card, photo stand, for drawing with adhesive coating, to explain the exhibit in the museum, for playing with cards, a board game, an advertising brochure, a catalog of goods ordered by mail, etc. Thus, it is possible to recognize both types of information: visual information from section 7 with transmitted information, including letters and illustrations on printed material 5, and voice information from section 6 with a dot pattern.

FIG. 28 is a functional block diagram for explaining a first embodiment of a portable information input / output device that uses an information input / output method for inputting data via a camera.

The portable information input / output device comprises: a sensor unit 8, which includes a camera unit 2, and a processing unit 11 located in the main body, comprising a processing unit 9 and a data storage unit 10 (storage device). This sensor unit 8 comprises a camera unit 2, which records image data of only a dotted dot portion 6 on the printed matter 5, and an information processing unit 12 for converting image data into digital form to obtain numerical values. Near this unit 2 of the camera is a block 13 for generating infrared radiation, which serves to irradiate the printed material 5 with infrared radiation.

The processing unit 11 located in the main body contains a processing unit 9 for outputting and reproducing information and programs stored in advance in the data storage unit 10 (in the storage device), which correspond to the dot-raster portion 6, based on the numerical values obtained during processing images in block 12 image processing. This processing unit 11, located in the main body, contains an output unit 15, for example, a loudspeaker 14, headphones or an LCD monitor 25. In addition to voice information, an output speech signal (linear), this output unit 15 can output images supplied to a television monitor or on a PC.

The data storage unit 10 can store information and programs not only in advance, but it can also store them subsequently. For example, the data storage unit 10 may provide for storing information and programs from speech signals received by the microphone 17a serving as the input unit 17. In addition to a microphone 17a for storing information and a program, this input unit 17 can be connected to a voice input terminal, an image input terminal, a PC, and the like.

Thus, since the speech signals can be inputted later using, for example, a microphone 17a, the portable information input / output device is capable of storing the voices of the user or his acquaintances related to the printed material 5, for example, to a picture book remembered by means of a microphone 17, and later, the printing of material 5 can be scanned with a portable information input / output device so that other people can hear the speech information corresponding to erzhimomu printed material. For example, this can be used as a "family messaging device" or as a "glue-coated voice message drawing."

Located in the main body, the processing unit 11, equipped with a communication board 16, can output or reproduce information and programs that are received from the outside. For example, the dot pattern 1, which was scanned by the camera unit 2, is converted to numerical values, and this data can then be transmitted to a computer 23, for example, to a server via a communication board 16. In addition, the dot pattern 1, which was scanned by the camera unit 2, is converted into numerical values, and this data can then be transmitted to a computer 23, for example, to a server via a communication board 16 before the processing unit 11 located in the main body can to receive information and programs corresponding to these data. The processing unit 11 located in the main body can enter data in the form of numerical values into which the point raster 1 is converted, the scanning of which is carried out by the camera unit 2, and the reception of the corresponding speech signals. To ensure the storage of information and the program in the data storage unit 10 in the processing unit 11 located in the main body, a communication board 16 is installed.

Thus, since the communication board 16 is used, it becomes easier to transmit and receive information and programs. For example, a portable information input / output device is used to answer questionnaires in voice form, and then the voice information is transmitted to a computer 23, for example, to a server. Or information about the answers to questions or the test, carried out in speech form, can be transmitted to the computer 23, for example, to the server in order to perform pronunciation verification or to receive corrected answers to questions or to the test.

In addition, information about the unified information resource index (URL) is embedded in the dot-plot section 6 of the printed material 5 or other information medium so that when scanning information about the unified information resource index (URL), it automatically establishes a connection with the party to which this information corresponds information about the unified index of the information resource (URL). Or it can be specified that when a connection is established, a specific action is performed.

Or a printed sound material may be created. Voice information can be entered in a post card or in a letter later. For example, musical background (MF), sound effect (MZ), and the like may later be added to this printed material 5.

In addition, the processing unit 11 located in the main body is provided with a global positioning system (GPS) receiver 24 in order to easily display information about the current location.

FIG. 29 is a functional block diagram for explaining an embodiment of a portable information input / output device that uses an information input / output method for inputting data via a camera.

Since according to the portable information input / output device of this embodiment of the present invention, the sensor unit 8 contains only the camera unit 2, the sensor unit 8 can be compact.

However, the present invention is not limited to the embodiment shown in the drawing. The invention can be applied to any configuration that provides the possibility of various ways of using it by recognizing only a dot 6 portion with a dot pattern on the printed material 5 for reproducing given information and speech. Modified variants may be implemented without departing from the scope of the patent claims of the present invention.

FIG. 30 is a perspective view showing a portable information input / output device housed in a compact housing. In each of the drawings of FIG. 31A to FIG. 31G, a portable input / output device is shown housed in a compact package of a different shape, and, in particular, in FIG. 31A, the entire device is shown in perspective; in FIG. 31B, it is shown. in a top view, in FIG. 31B is a side view, and in FIG. 31D is a front view.

The portable information input / output device according to the present invention is made in a housing 18, which can be held in a hand, and contains, as mentioned above, a processing unit 11 located in the main body, a camera unit 2 located in the lower part of the housing 18, and a loudspeaker 14 or a headphone jack 19 located on the side. A push button switch 20 is provided on the upper side of the housing 18, and a universal serial bus (USB) connector 21 and a memory card slot 22 serving as a data storage unit 10 are provided on its front side.

In addition, the portable information input / output device of the present invention is provided with an LCD monitor 25, a headphone jack 19, an output terminal 26 for connecting a television monitor, and the like. In addition, the housing 18 is equipped with a microphone 17a, a shooting button 27, a recording button 28, a program selection button 29, an indication lamp 30, a global positioning system (GPS) receiver 24, a voice input terminal 31, a universal serial bus (USB) connector 21 and a slot 22 for a memory card of the data storage unit 10.

The housing 18 is made in a fully rounded shape, as shown in FIG. 31, so that the housing 18 can be held in a hand. Due to this design, it becomes easy to register image data of the area 6 with a dot pattern on the printed material 5.

The shape of the housing 18 is not limited to the shape shown in the drawings. Modified variants may be implemented without departing from the scope of the patent claims of the present invention.

FIG. 32 and FIG. 33 are functional block diagrams, each of which serves to explain an embodiment in which the camera and the output unit are made as separate elements.

In this embodiment of the present invention, the camera unit 2 can be configured to be a separate unit with respect to the aforementioned image processing unit 12, the data storage unit 10, the processing unit 9, and to the output unit 15 and allows transmission through the interface unit. Transmission through this interface unit can be performed by a wired or radio communication method. Transmission by radio can be performed by the block 32 of the radio transmitter and the block 33 of the radio receiver, which are part of the interface unit shown in the drawings.

The sensor unit 8 shown in FIG. 33 contains only the camera unit 2. Due to this design, the sensor unit 8 can be compact.

On Fig in perspective view shows a device in which the camera assembly and the main body of the output device are made in the form of separate elements.

In the example shown in Fig. 34, the camera unit assembly and the main body of the output unit are made as separate elements and are connected by a cable 34 from the wires. Since they are made in the form of individual elements in this way, the camera assembly 2 can be easily brought close to the printed material 5, which allows the use of a portable information input / output device on the table. This node 2 of the camera is made in such a way that it is equipped with an annular switch 35 located around the camera. In this embodiment, the switch can be set to the “on” position only if the camera assembly 2 is pressed against the printed material 5, which provides convenience and ease of use with one hand.

In each of the drawings of FIG. 35A to FIG. 35 D, a perspective view shows various embodiments of a camera assembly, and in particular, FIG. 35A shows a pen-type camera assembly, FIG. 35B shows a pen-type camera assembly, FIG. .35B shows a camera assembly in the form of a mouse-type manipulator, and Fig. 35G shows a camera assembly in the form of a stethoscope.

The pen-type camera assembly 2 shown in FIG. 35A is movably connected to the end of the pen 36 via a bayonet connection 37. It is also provided with a push-button switch 38 located on the axis of the pen. The pen-type camera assembly 2 shown in FIG. 35B is movably connected to the end of the pen 36 via a bayonet connection 37 and is further provided with an annular switch 39 located around the camera. With this design, the switch is turned on only by pressing the camera assembly 2 to the printed material 5. The camera assembly 2 in the form of a mouse-type manipulator, shown in Fig. 35B, is located in the main body 40 in the form of a mouse-type manipulator ", having the form of a mouse-type manipulator. It is equipped with a push button switch 38 located on the upper surface of the housing 40 in the form of a mouse-type manipulator. Since the camera assembly 2 in the form of a mouse-type manipulator has a size that allows it to be held in the hand, it can be used on printed material 5 as a mouse-type manipulator for a PC. The stethoscope-shaped camera assembly 2 shown in FIG. 35G is located in the main body 41, which can be held with fingers, such as a stethoscope. It is also equipped with a push button switch 38 so that you can work with the camera unit 2 by grabbing the camera unit 2 with your fingers.

36 is a functional block diagram for explaining an information input apparatus for a portable telephone using a camera.

The information input device 118 comprises a sensor unit 108, which comprises a camera unit 102 and a processing unit 111 located in the main body, comprising a processing unit 109. This sensor unit 108 comprises a camera unit 102 for recording image data of only a dot pattern portion 6 (see FIG. 27) on the printed matter 5, and an image processing unit 112 for converting image data into digital form with obtaining numerical values. Near this camera assembly 102, an infrared generation unit 113 is arranged for irradiating the printed material 5 with infrared radiation.

The processing unit 111, located in the main body, comprises a processing unit 109 for outputting and reproducing information and programs stored in advance in the data storage unit (in the storage device) of the portable telephone 10, which correspond to the dot pattern area 6, based on numerical values obtained by image processing in block 112 image processing. In addition, this processing unit 111, located in the main body, is provided with a global positioning system (GPS) receiver 24, which serves to easily display information about the current location.

The data storage unit (memory) of the portable telephone 110 can store information and programs not only in advance, but also later. For example, the portable telephone data storage unit 111 may be configured to store information and programs as voice information, images, and text information using a microphone, camera (not shown) or a similar device.

37 is a functional block diagram for explaining an embodiment of an information input apparatus using a camera.

An information output device according to this embodiment of the present invention comprises a sensor unit 108. Since the sensor unit 108 contains only the camera unit 102, it can be compact.

In the explanatory drawing Fig. 38 shows an input device for a portable telephone using a camera.

The above information input device 118 can be used in such a way that it is installed on the portable telephone 110. Thus, since the information input device 118 is installed on the portable telephone 110, the portable telephone 110 can output and reproduce information and programs that correspond to section 6 with a dot pattern registered by the camera node 102.

In the explanatory drawing Fig. 39 shows an information input device for a portable telephone using a camera.

The above information input device 118 may be used in such a way that it is installed on the portable telephone 110 through the interface unit 19. Thus, since the information input device 118 is installed in the portable telephone 110 through the interface unit 19, only the information input device 118 can move freely.

This information input device 118 installed on the portable telephone 110 is used as follows. Namely, it is possible to recognize the speech information corresponding to the dotted dot plot 6, along with the visual information from the transmitted information portion 7 created from letters or illustrations on the printed material 5. In this case, in addition to the speech information, on the portable telephone 110 you can simultaneously display images, text, etc. Printed material 5, educational material, text, questions, magazine, newspaper, photography itself, card, membership card, photo stand, glue-coated drawing, museum exhibit explanation, card game, board game, brochure, product catalog, ordered by mail, etc.

Here, the installation means of the information input device 118 on the portable telephone 110 is not limited to those variants shown in the drawings, and it goes without saying that its modified versions can be implemented without going beyond the scope of the patent claims of the present invention.

On the explanatory drawing Fig.40 shows a portable telephone containing a built-in device for inputting information.

The information input device 118 of the present invention can be integrated into the portable telephone 110. In this case, a more compact information input / output device can be created by combining the portable telephone 110 and the information input device 118.

The portable telephone 110 can store information and programs coming from outside in the data storage unit using its communication function and transmit the stored information and program. This configuration makes it easy to transfer information and programs.

For example, a dot raster 1 inputted by the camera assembly 102 is converted to numerical values that can be transmitted to a computer 123 using the communication function of the portable telephone 110. In addition, image data of a dot raster 1 scanned by the node 102 is converted cameras, into the numerical values that can be transferred to the computer 123 using the communication function available in the portable telephone 110, and then the portable telephone 110 can receive information Applications and programs matching these data. The numerical data of the dotted dot plot 1 introduced by the camera unit 102 is inputted and the corresponding speech signals, text and image are inputted. In this embodiment, using a dot pattern, it is possible to output and reproduce the huge amount of information content that is usually provided for portable phones.

Furthermore, since the communication function of the portable telephone 110 is used in a similar manner, it is easy to transmit and receive information and programs. This embodiment can be used to transmit voice information in the form of answers to a questionnaire, which are given in speech form, to a computer 123, for example, to a server. Or, the answers to questions or to the test, which are given in verbal form, can be transmitted to computer 123, for example, to a server, to check pronunciation and correct the answer.

In addition, the portable telephone 110 is equipped with a Global Positioning System (GPS) receiver in order to easily display the current location information.

FIG. 41 is a functional block diagram of a portable electronic toy according to an embodiment using the dot pattern portion of the present invention. 42, a portable electronic toy according to this embodiment of the present invention is shown in front view. In Fig. 43, a portable electronic toy according to this embodiment of the present invention is shown in a side view on the right side. In Fig. 44, a portable electronic toy according to this embodiment of the present invention is shown in a side view on the left side, and in Fig. 45 a portable electronic toy according to this embodiment of the present invention is shown in a bottom view.

The portable electronic toy 801 according to this embodiment is a toy for outputting various speech signals and music corresponding to a book, a card for a game, a small item, a toy, and the like, which is an information carrier 802. This portable electronic toy 801 comprises a dot pattern portion 803 for recognizing the written contents of a book or similar object and related speech information, a speech information storage unit 804 for storing various voice information, a processing unit 806 (central processor) serving for controlling the loudspeaker 805 in such a way that it reproduces voice information, and a large integrated circuit (LSI) 807 providing reproduction of voice information, which They are housed in the main body 808. This main body 808 is connected by a cable 809 to a pen-type camera 810, which is used to record image data of a dot pattern portion 803.

The voice information storage unit 804, housed in the main body 808 of the portable electronic toy 801, stores the voice information, which is reproduced on the basis of information from the dot-raster section 803, which is used to recognize the written contents of the book and the associated speech information. This voice information storage unit 804 can be used not only as an internal storage device, but can also be used to collect the latest information content through the use of an external storage device. For example, the content of voice information can be updated by downloading the program from the outside, which makes it possible to reuse the same portable electronic toy 801. The camera 810 is configured to register image data of a dot pattern portion 803 attached to a book, to a card for a game, to a small object or to a toy, or image data of a dot pattern portion 803 containing a number, letter or similar symbol that serves as an identification Signal printed directly on the book or on a similar object. Since the image data of the dot pattern portion 803 recorded by the camera 810 is processed using the image processing algorithm to extract points, and then the distortion caused by the camera 810 is corrected using the distortion correction algorithm, accurate recognition can be achieved even there the case where the image data of the dotted dot pattern portion 803 is recorded by an affordable camera 810 having a higher distortion coefficient.

This camera 810 recognizes the information contained in the dot-raster portion 803 and reproduces the corresponding voice information and music by means of a large integrated circuit (LSI) 807 that reproduces the voice information by outputting it through the loudspeaker 805.

The main body 808 of the portable electronic toy 801 according to the present invention is portable and has a “personal diary” of 13 cm in height and 18 cm in width. Therefore, the portable electronic toy 801 can be held in a hand and carried in a bag.

In addition, the LCD assembly 812, which is provided with the main body 808, is used to simultaneously display other information than voice information. The display of information on this liquid crystal display 812 is implemented by means of a large integrated circuit (LSI) 813 that provides image reproduction. Since other information than music can also be obtained at the same time, the portable electronic toy 801 according to the present invention provides the possibility of its diverse application. In this portable electronic toy 801, when the switch 814 located on the side surface of the main body 808 is in the “on” state, the indicator lamp 815 lights up.

In block 804 storage of voice information can be used in a storage medium 816, which is including flash memory, compact flash memory type "compact flash", intelligent storage device type "smart media", storage device type memory stick, etc. .p., due to which facilitate the change of stored speech information. The voice information storage unit 804 provides for storing, for example, information content suitable for use as educational material for teaching pronunciation in a foreign language in speech form (voice data, image data, moving image data, character code data in the form of letters, characters, etc.). In addition, the block 804 storage of voice information provides the storage of information content suitable for use as a picture book to create music or an orchestra with figures, information content serving as educational material that emits speech signals, in combination with toys, for example, in the form of assembled blocks, information content suitable for use as a book with pictures for playing music and colloquial speech of the main character, etc., as well as drawings from the book igi with pictures in the form of a "sound book with pictures", and information content suitable for use as a computer program for a dictionary for translation from a foreign language, carried out by scanning a word or text, in the form of a "sound dictionary".

In addition, the present invention can be used as a computer program for comparison games or for role-playing games in combination with cards for comparison games, as a handout used to verbally explain the properties of a product and a company profile as a “incentive ", or as an electronic device that serves to explain in verbal form exhibits in museums and similar institutions or attractions in the tour area.

The camera 810 can be placed on the side surface of the main body 808 so that after using the camera, the portable electronic toy 801 can be taken with you.

A light source (not shown) is located near the camera 810, and it provides illumination of the dot pattern raster 803, thereby achieving high recognition accuracy of the dot raster region 803 even in the dark.

When using the portable electronic toy 801 according to the present invention by combining the dot-raster portion 803 with the information medium 802, which is including a book, a game card, a small object and a toy, it can be implemented in various ways described below.

<Sound training material>

The portable electronic toy 801 according to the present invention can be used as educational material in the form of a miniature book that can be placed on the bottom of the main body 808. The present invention takes advantage of excellent portability to present “sound educational material” that can be used for teaching anywhere and anytime for users of any generation, from children to adults or the elderly. For example, tracking letters in a book to reproduce speech. Using this embodiment, the portable electronic toy 801 according to the present invention can be used as additional educational material for teaching languages, for example, speaking English, for teaching children, including for intellectual development and music education, for exercises etc.

<Card comparison game>

The portable electronic toy 801 according to the present invention can be used as a “card comparison game". It is designed in such a way that when a “collection of special stickers and data” is created corresponding to the aforementioned card comparison game and a dot pattern corresponding to each card is attached 803, the card character can start to speak “live” from the loudspeaker 805 portable electronic toy 801. In addition, since explanations are given by the character’s voice or if tricks are introduced, the present invention can be used as an element that extends the functionality of cards glasses.

Or, if a “collection of special stickers and data” is created corresponding to a card with a known film, the configuration is set up in such a way as to output speech or music from the film by attaching a dot pattern portion 803 corresponding to the card. Or, if a “collection of special stickers and data” is created, corresponding to an idol card, which shows an idol that has regular admirers, then the configuration is set up so that the idol’s speech can be output by attaching a dot pattern 803 with a dot pattern corresponding to each card. Here it can be used to ensure related development, in which each card is the source of one song phrase, and the entire song is played back if all the cards are collected.

By attaching a dot pattern portion 803 to various nearby materials in such a manner as to produce sound, the use of the portable electronic toy 801 according to the present invention can be enjoyed. A "collection of special stickers and data" is created for pranks. In this case, if the dot pattern portion 803 is attached to a nearby material and the dot pattern portion 803 is detected by the camera 810, then it may make a sound. For example, for boys, the invention is combined with their favorite sets of mini-car models and create a “collection of special stickers and data” that form a road that makes sounds. A dot pattern section 803 is attached to a mini-car road constructor kit containing intersections and buildings so that when the vehicle is approaching an intersection, it makes a ringing sound, for example, “kan kan kan” , or so that when the car gets off the road, it creates a "and-and-and! watch carefully!" ("kikee! Look!"), that is, the sound of a car sliding due to sudden braking, thereby providing a stronger presence effect.

A new way of using the portable electronic toy 801 according to the present invention can be proposed, in which a T-shirt is created with a plurality of dot-printed sections 803 printed thereon in order to enjoy wearing it.

The portable electronic toy 801 according to the present invention is suitable for use as a “fortune-telling device”. The user can have fun with a portable electronic toy, and this portable electronic toy can be used for entertainment at a party, for example, at a party arranged to meet newcomers, or at a New Year's party. For example, when the camera 810 sequentially spells the letters written on a "special plate with a slot for mail" (in section 803 with a dot pattern), an interesting comment is selected that is randomly selected. By entering a name using a mail slot, the toy can be used as a “fortune teller by name”. A comment is made, for example, "fate for today." For example, a prediction for the next week can be made: "your future in love, your future in work and your future health will be terrible, but great prospects will only be in relations with animals. If you go out, you can fall in love with a walking dog . "

<Treasure hunt game>

The portable electronic toy 801 according to the present invention can be used as a “treasure hunt game”.

The portable electronic toys 801 according to the present invention are prepared, the number of which corresponds to the number of participants, and the dot pattern sections 803 are imperceptibly attached to various places in the game zone in advance. After that, the participants all together start the game at the starting point (for example, at the entrance), look for hidden sections 803 with a dot pattern, following the commands to go to the next place, for example, “look in the corridor”. Then, the one who first found the dotted dot plot 803 at the destination will win the game.

<Translator from a foreign language>

Portable electronic toy 801 according to the present invention can be used as a "translator from a foreign language."

When a user encounters an unfamiliar word while reading an English newspaper or a foreign magazine, he sweeps the camera 810 on the word (dot 803 section), and then the toy translates this word into Japanese and reads it out loud.

The main body 808 may be provided with a universal serial bus (USB) connector (not shown) that serves to enable multiple portable electronic toys 801 to be connected in a network. The cables to the connectors for the universal serial bus are connected to each other, as well as to a PC, etc., forming a network.

On Fig in perspective view shows an embodiment of a portable electronic toy that generates speech signals, mainly corresponding to a mini-figure. On Fig in perspective view shows a lot of talking toys connected to the controller unit.

Portable electronic toy 821 is a toy that generates speech signals corresponding mainly to a mini-figure. This portable electronic toy 821 contains a dot pattern portion 803 in which code information is recorded for generating speech signals corresponding to the character of the mini figure 822, a speech information storage unit 804 located in the main body 823 in which the voice information is stored, camera 810, processing unit 806 (central processor), used to control the loudspeaker 805 so that it carries out the output of voice information, and a large integrated circuit (LSI) 807, providing speech reproduction th information.

The dot raster portion 803 is made in the form of a circular sheet element that can be attached to the pad 824 on which the mini figure 822 is located, or to the inner upper surface of the bottle cap, and one of the surfaces of the dot raster portion is coated with an adhesive, and on the other surface of the sheet element, a dot pattern portion 803 is visible. However, instead of using the sheet element, the dot pattern portion 803 can be printed on the mini figure 822 itself.

The voice information storage unit 804, housed in the main body 823 of the portable electronic toy 821, can be used not only as an internal storage device, but it can also be used to collect the latest information content by using an external storage device. For example, to update the content of voice information, the program or data is input from the outside or downloaded via the network, which makes it possible to reuse the same portable electronic toy 801.

In a preferred embodiment, near the camera 810, in the center of the main body 823 there is a light source serving as a lighting means. In this embodiment, the dot-dot pattern portion 803 is illuminated and thereby provides the ability to accurately recognize image data of the dot-pattern portion 803 even in the dark.

Fig. 48 is a functional block diagram of a portable electronic toy according to this embodiment of the present invention.

Each main body 823 is provided with a universal serial bus connector (not shown in the drawing), so that a plurality of portable electronic toys 821 can be connected in accordance with a network environment. A cable connected to a universal serial bus connector is connected to a PC or similar device so as to form a network.

On Fig depicts a functional block diagram of an embodiment of a portable electronic toy according to the present invention, which uses optical character recognition (OCR).

In this embodiment of the present invention, instead of a camera 810 and a dot pattern (recognizable sticker) portion 803 from the above embodiment, an optical character recognition (OCR) stylus 831 and a speech recognition portion 832 are used. In other words, through the use of optical character recognition, portable electronic toy 801 is a toy that emits various speech signals and music related to a book, game card, small item, toy, and the like, which is an information carrier 802. This portable electronic toy 801 contains a speech recognition signal portion 832 for recognizing the written contents of a book or similar object and related speech information, a speech information storage unit 804 for storing various voice information, a processing unit 806 (central processing unit) serving to control the loudspeaker 805 so that it reproduces voice information, and a large integrated circuit (LSI) 807 that provides voice information and those that are housed in the main body 808. With this main body 808, a feather of the optical character recognition sensor 831 is connected via a cable 809.

The pen 831 of the optical character recognition sensor is a pen used to scan an icon sticker (portion 832 of a speech recognition signal) attached to a book, card for a game, a small item, a toy, or the like, or portion 832 of a speech recognition signal, which directly prints a number, letters, etc., serving as a book recognition signal, etc. In other words, the pen 831 of the optical character recognition sensor recognizes a number, a simple character, and the like added to the speech recognition signal portion 832, and by means of a large integrated circuit (LSI) 807 for reproducing voice information, corresponding voice information and music are reproduced. which output through the loudspeaker 805.

On Fig depicts a functional block diagram of a portable electronic toy, which shows an embodiment using a magnetic element.

In this embodiment of the present invention, instead of a camera 810 and a dot pattern portion (recognizable sticker) 803, a pen 841 with a sensor for electromagnetic scanning and a magnetic recording portion 842 are used. In other words, in this portable electronic toy 801, a magnetic recording portion 842 is used for recognizing voice information corresponding to a storage medium or the like, a voice information storage unit 804 for storing voice information corresponding to the magnetic recording portion 842, and a pen 841 with a sensor for electromagnetic scanning, used to scan section 842 with magnetic recording. This pen 841 with a sensor for electromagnetic scanning is used to scan section 842 with magnetic recording, and a large integrated circuit (LSI) 807, providing the reproduction of voice information, reads the corresponding speech information from the block 804 storage of voice information, to play voice information through a speaker 805 .

In this embodiment of the present invention, in addition to reproducing voice information and music corresponding to the information medium 802, it is easy to change the data recorded in the magnetic recording section 842 attached to the information medium 802. In this embodiment, the user is given the opportunity to change the speech information to the speech information delivered by his favorite voice.

On Fig shows a functional block diagram showing an embodiment using a pen for shooting, equipped with a camera, or a similar device.

In this embodiment of the present invention, instead of the dot pattern portion (recognizable sticker) 803 of the embodiment described above, a sticker for speech recognition is used. In other words, the portable electronic toy of this embodiment of the invention comprises a voice information storage unit 804 for storing voice information corresponding to each shape or color printed on the information medium 802, a shooting pen 851, for example, a CCD camera for shooting a form or the like printed on the information medium 802, and a processing unit 806 for reading from the voice information storage unit 804 that speech information that matches the color or shape registered by Epher 851 for shooting, and an image associated with the aforementioned color, for outputting voice information through a speaker 805.

According to this embodiment of the present invention, voice information and music that matches the shape and color printed on the information medium 802 can be reproduced without using a dot pattern portion 803, a speech recognition signal portion 832 (recognizable sticker), or magnetic recording portion 842 (magnetic sheet). In addition, in this embodiment, a light source (not shown) is provided that is located close to pen 851 for recording, for example, a CCD camera. In this embodiment, the information carrier 802 is illuminated, thereby providing an accurate capture of its shape even in the dark.

In addition, the presence of a pen 851 for shooting, for example, a CCD camera, allows for the generation of various speech signals and music corresponding to the storage medium 802 using a sticker 852 for speech recognition. For example, this embodiment includes a speech recognition sticker 852 that can be attached to the information medium 802, and recognizes voice information corresponding to the information medium 802 or the like, a speech information storage unit 804 for storing voice information corresponding to the sticker 852 for speech recognition, a pen 851 for shooting, used to take stickers 852 for speech recognition, and a processing unit 806 for reading from the speech storage unit 804 information of that speech information that corresponds to a number, letter, or similar sign that serves as an identification signal for a speech recognition sticker 852, which was shot with a shooting pen 851 to output speech information from a speaker 805.

However, the present invention is not limited to the embodiments described above. The configuration proposed in the invention should only provide recognition of the information medium 802, for example, the book itself, and reproduce predetermined speech information by means of a large integrated circuit (LSI) 807 capable of reproducing voice information through speakers 805, and is not limited to the shape of the main body 808 shown in the drawings. In addition, it goes without saying that various modified variations of the present invention can be implemented without departing from the scope of the patent claims of the present invention.

Fig. 52 and Fig. 53 are functional block diagrams of an embodiment of a device in the form of a figure having a function of outputting information during data input by a camera in which the camera and the output unit are formed as a single unit.

The figure-shaped device according to this embodiment comprises a sensor unit 208, which includes a camera 202, and an image processing unit 212, a processing unit 211 located in the main body, and which includes a processing unit 209 and a data storage unit 210 (memory) . The camera 202 from the sensor unit 208 registers image data of only a dot pattern portion 803 on the printed matter, and the image processing unit 212 converts this image data into digital form to obtain numerical values. Near this camera 202 is located the infrared radiation generating unit 213, which serves to irradiate the printed material 5 with infrared radiation.

The processing unit 209, which is part of the processing unit 211 located in the main body, serves to output and reproduce information and programs stored in advance in the data storage unit 210 (in the storage device), which correspond to the dot pattern area 803, based on the numerical values obtained by image processing in block 212 image processing. This processing unit 211, located in the main body, comprises an output unit 215, for example, a speaker 214.

The data storage unit 210 can store information and programs not only in advance, but also subsequently. For example, the data storage unit 210 is capable of storing information and programs entered later through the microphone 217.

On Fig shows a modified embodiment of the invention from Fig, in which the sensor unit 208 contains only the camera 202. Due to this design, you can create a compact sensor unit 208.

Fig. 54 and Fig. 55 are functional block diagrams of an embodiment of a device in the form of a figure having a function of outputting information during data input by a camera, in which the camera unit and the output unit are made as separate elements.

The figure device of this embodiment of the present invention comprises a camera unit A and an output unit B. The camera assembly A includes: a sensor unit 208, which includes a camera 202, and an image processing unit 212; and a radio transmitter unit 221, which is part of the interface. The camera 202 from the sensor unit 208 registers image data of only a dot pattern portion 803 on the printed material 5, and the image processing unit 212 converts the image data into digital form to obtain numerical values. Near the camera 202 is a block 213 generating infrared radiation, which is used to irradiate the printed material 5 with infrared radiation.

The output node B comprises: a radio receiver unit 222; a processing unit 211 located in the main body, which includes a processing unit 209 and a data storage unit 210 (storage device); and an output unit 215, for example, a loudspeaker 214. The processing unit 209, which is part of the processing unit 211 located in the main body, serves to output and reproduce information and programs stored in advance in the data storage unit 210 (in the storage device), corresponding to the section A dot pattern 803 based on numerical values obtained by image processing by the image processing unit 212. The radio transmitter unit 221 and the radio receiver unit 222, which are parts of the interface, communicate using infrared radiation. As this output node B, the PC itself can be used directly.

On Fig shows a modified embodiment of the invention from Fig, in which the block 208 of the sensor contains only the camera 202. Due to this design, you can create a compact block 208 of the sensor.

On each of the drawings of FIG. 56A to FIG. 56G, a perspective view shows a figure equipped with a camera assembly. In particular, FIG. 56A shows an example of a figure in the form of a doll, FIG. 56B shows an example of a figure in the form of a soccer ball, FIG. 56B shows an example of a figure in the form of a car, and FIG. 56 D shows an example of an animal figure.

Each of the examples shown in the drawings is a figure-shaped device containing the camera assembly A of figure 218 with camera 202. When this figure 218 is placed on the printed material 5 and image data is recorded on the dot-dot pattern 803, this portion 803 with a dot pattern, they are irradiated with infrared radiation, due to which only a portion 803 of a dot pattern printed with carbon-based printing ink is scanned separately from the portion 7 of the transmitted information, the color printed carbon-free ink. Moreover, the shape of figure 218 is not limited to those of the forms shown in the drawings, and various modified variants can be realized without going beyond the scope of patent claims of the present invention.

In the above-described device in the form of a figure according to the present invention, the output and reproduction of various types of speech information can be carried out by means of an information medium, for example, printed material 5. The following is a description of examples of the use of the device in the form of a figure.

<Use as a figure for playing "sugoroku" or "board game">

Figure 218 of the present invention can be used as a figure for playing "sugoroku" or "board game." When a figure 218 is placed on a board for playing a “sugoroku” or a “board game”, the camera 202 provided with the figure 218 is used to output specific speech information corresponding to the dot pattern 803 on the printed material 5, in order to to issue instructions in verbal form. Therefore, there is the possibility of expanding the variety of ways of playing the “sugoroku” and the “board game”.

<Use as a chess piece for playing "Japanese military chess" (in military chess "shogi" ("shogi"))>

Figure 218 of the present invention can be used as a chess piece for playing Japanese military chess. When this figure 218 is placed on a chessboard (on printed material 5) for "Japanese military chess", the camera 202, which is equipped with a figure 218, is used to scan the area 803 with a dot pattern on the field (on printed material 5) for a board game, providing thereby the output of the specified speech information. Since instructions can be announced in verbal form, this game can be improved as a game that never existed before and which has a new look. For example, a processing program located in the main body is used to compare chess pieces (figures 218) with the conjugation of features and with the time axis. Such added virtues contribute as essential factors to the realistic reproduction of the “battlefield” and to the creation of new strategies that never existed before in conventional Japanese military chess, and therefore people may like to play this game.

On Fig in perspective view shows a device in the form of a figure from the present invention, placed on the central platform of the battlefield of a new simulation board game.

<Use as a figure for the "new simulation board game">

The device in the form of a figure from the present invention can be used as a figure for a “board game”. When the playing field (printed material 5) and the figure 218 are installed, the figure can be placed on the field (on the printed material 5) in order to play the game. In the competition, the figures 218 are placed facing each other on the central platform of the battlefield (printed material 5). A plot 803 with a dot pattern and a plot 7 with transmitted information was printed on the site. Scan this dotted dot pattern region 6 by means of a scanning device 202, which is equipped with figure 218, and based on the internal processing program can be created a complex game for comparison.

Thus, since the device in the form of a figure from the present invention can be used as an input interface printed on printed material 5 or on a similar medium, an interface suitable for each information content can be manufactured. In addition, if the paper interface is downloaded as a PDF file or a similar format and output via a printer, and the corresponding program is loaded in such a way that it is installed on a PC or similar device, this interface can be delivered via the network.

On the explanatory drawing Fig.58 in a sectional view shows another embodiment of the present invention, in which the camera node and the output node are embedded in a soft toy, which is one of the varieties of the figure.

The camera assembly A and the withdrawal assembly B of the present invention can be embedded in a soft toy 231, which is one of the variations of figure 218 described above, and is created by filling the outer shell of a predetermined shape with an elastic material, such as cotton or a sponge. For example, the lens assembly of the camera assemblies A is located in the eye areas 232 of the soft toy 231, and the output assembly B is located in the housing 233 of the soft toy 231 so that the output assembly B can be freely inserted and removed. Due to this design, the favorite soft toy 231 itself can be used as a device for reproducing given information and speech.

In the explanatory drawings of Fig. 59 and Fig. 60, a sectional view shows other embodiments of a soft toy, which is one of the varieties of a figure in which a camera assembly and an output assembly are integrated.

As for the camera assembly A located in the soft toy 231, it is not always necessary to place the camera assemblies A in the eye area 232 of the soft toy 231. For example, as shown in FIG. 59, the camera assemblies A can be placed in the hands of 34 soft toys 231, and not in areas 232 of the eyes of soft toy 231. Undoubtedly, the camera assembly A can be located in another desired location, for example, in the lower part, in the chest or legs. The location of the node And the camera is determined depending on the type of soft toy 231, its size or how to use the soft toy.

However, the present invention is not limited to the embodiments described above. Any configuration can be used in the present invention, enabling various methods of its use by recognizing only a dot pattern 6 on printed material 5 to reproduce desired information and speech. Modified embodiments of the present invention may be implemented without departing from the scope of the patent claims of the present invention.

The following is a description of the characteristics of a dot pattern according to the present invention with reference to the drawings of Figures 103-106.

As shown in FIG. 105, the dot pattern 601 is made in the form of a structure of points located on a grid. The grid lines in the vertical and horizontal directions are shown only to explain the position of the dots, and, in reality, they do not exist on the printed material.

A grid region with a size of 4x4 element below is called a data block or grid block; in each of the four corners of this grid block there is a grid point (TS) (the intersection point of grid lines). The distance between two grid points (TS) takes values in the range from 0.35 to 1.0 mm, in the preferred embodiment, it is approximately 0.5 mm. In addition, the diameter of the point in the preferred embodiment is from 8 to 10% of the distance between the points of the grid.

There is a key point (CT) indicating which block and to which data block is located.

CT is located with an offset relative to the vehicle. In other words, the grid point is essentially located in the grid node, while the CT is located with an offset relative to the vehicle. Here, the offset of the CT relative to the mesh node is preferably about 20%.

The area surrounded by the key points (CT), or the area in the center of which the CT is, forms one data element.

As shown in FIG. 104, data is placed sequentially, starting from the upper left corner, in a downward direction.

As shown in FIG. 103, data can be specified by setting the offset distance of the point 605 relative to the center point in the grid block. As shown in FIG. 103, eight points are set that have the same offset relative to the center at an angle of 45 degrees, and therefore, eight kinds of data or, in other words, 3 bits of data can be displayed in one grid block. In addition, to set another eight points, the distance from the center point is changed. Therefore, since there are sixteen points in total, four data bits can be displayed.

The dot pattern of the present invention has the distinguishing feature that the grid contained in one data block can be set arbitrarily. That is, since, as mentioned above, a CT determines the extent of a data region, when changing the location of key points (CT), a group of grid blocks of any variable length can be regarded as a data storage area.

In addition, according to the present invention, when changing the offset of the CT regions with a dot pattern can have different meanings, even if they are in the same place. In other words, if the CT is offset relative to the lattice assembly, then the CT functions as a CT. If the displacement method is changed in such a way that the key points (CT) are equally offset by 45 degrees relative to the lattice node, eight options for the location of the CT can be specified.

In this embodiment, when shooting a plot with a dot pattern, a survey means, for example, a CMOS camera, the data obtained as a result of recording is recorded in the frame buffer of the survey means. If the shooting tool is located in such a way that it rotates around the vertical axis (shooting axis) on paper, or if the position (offset position) is rotated around the shooting axis, then the offset value (camera angle) around the shooting tool’s axis is visible from the relative positions of the points grids and CT obtained in the image. The principle that the angle is presented as a parameter of another measurement is applied even if the camera shoots the same area. Therefore, other information can be output through the corner even when scanning the same area in the same place.

Thus, the angular parameter allows you to place information in one area in the form of a hierarchical structure.

Examples of the application of this principle are shown in Figs. 74, 76 and 78. In Fig. 74, a mini-figure 1101 is shown provided with a scanning device assembly 1105 located at the bottom, and this mini-figure 1101 is rotated 45 degrees on the stand. In this embodiment, information can be obtained at various angles, as well as information obtained by scanning the area with a point raster, due to which eight types of voice information can be output.

In the present invention, a dummy point (FT) can be defined. This FT is defined as a point located directly in the center of four grid points (TS) (see Fig. 106A). Such a FT is suitable for a book with pictures or for a similar object in which a border is set in each area of the stencil. As shown in Fig. 106B, the FT is located at the boundary between the stencil 1 and the stencil 2. This arrangement of the FT region in the stencil area prevents the simultaneous scanning of the code information specified in the stencil areas. On Figg shows the layout of fictitious points (FT).

Preferably, an empty dot is located in the background of the picture or similar image, which is the missing point in the center of the grid points. Since the number of blank points is small compared to the number of ordinary data points on which information is recorded, they can be printed as points that are indistinguishable from the rest. In addition, since the presence of successive blank dots prevents the formation of patterns, they are suitable for creating a full-color background.

In addition, according to the present invention, it is necessary to analyze the data of one unit containing the center of the survey. However, grid data (information data) in several blocks near the center of the survey can be determined as scan data. In this case, if in one source block there is a lack of data corresponding to the information data, then they are read from another neighboring block, which can be supplemented with the original data block to complete the input.

As for the raster with the data by which the x and y coordinates are specified, then to read the information points that specify the corresponding x and y coordinates, use a different block than the block located in the center of the survey, which is then subjected to correction to obtain the x and y coordinates in shooting center.

The invention has a distinctive feature, namely, that the shooting conditions do not have a strong effect, since, as described above, a dot pattern using grid points is applied. In other words, when the entire dot pattern is distorted due to the shooting conditions (distortion of the camera lens, distortion due to the tilt of the camera when shooting, distortion due to a change in the shape of the paper), the position shift of the structure formed from four grid points and from information points is done equal, the position relative to the grid points is not changed, and if the calculations during the correction are performed on the basis of these grid points, then you can find out the real position of each of the information points and key points.

That is, a dot pattern using grid points of the present invention is distortion resistant.

In the drawings Fig. 61 - Fig. 67 illustrates a method of scanning a point raster by a camera corresponding to one block consisting of subunits using the preferred embodiment of a point raster input method using the camera of the present invention proposed in the present invention.

As shown in Fig. 61, the camera comprises: an LED used to irradiate the object with light; a filter for the LED made of acrylic, which serves to filter the light radiation coming out of the LED; and a visible light filter (a filter transparent to infrared radiation), which serves to filter the light reflected from the object. The tube in which the chamber is placed has a length of approximately 10 mm in the longitudinal direction. If, when scanning one block of a point raster (from I ₁ to I ₁₆ ) with a size of 4 mm × 4 mm, the diameter of the region in which the image of a point raster is formed is 10 mm, then the maximum required region of image formation is 2r = 2 × 4√2 = 11.28 mm (see Fig. 62). To solve this problem, the scanning of sixteen information points located around the key point of one block is not carried out sequentially, and they are scanned separately by four information points ("1/4 block" (sub-block)), which contain information independent of other information points . In this embodiment, instead of information points in block 1/4 of the area in which the image is formed, input the corresponding information points (block 1/4) from another block in the area in which the image is formed, thereby providing the ability to enter information from one block within the region in which the image is formed having a diameter of 10 mm

If an error occurs in any block 1/4, the input of which is carried out as described above, enter the corresponding information points from another block (block 1/4) to correct the error.

In Fig. 64, the center of the image generated by the camera is element I ₈ in block B1, and the elements [I ₁ through I ₁₆ ] are input from block B1, which are closest to the center of the camera.

In Fig. 65, the center of the image formed by the camera is I ₅ in block B1, and input the elements [I ₁ , I ₂ , I ₃ , I ₄ ] and [I ₅ , I ₆ , I ₇ , I ₈ ] from block B1 and the elements [I ₉ , I ₁₀ , I ₁₁ , I ₁₂ ] and [I ₁₃ , I ₁₄ , I ₁₅ , I ₁₆ ] from block B2, which are closest to the center of the camera.

On Fig, the center of the image formed by the camera is element I ₆ in block B1, and elements [I ₅ , I ₆ , I ₇ , I ₈ ] are input from block B1, elements [I ₉ , I ₁₀ , I ₁₁ , I ₁₂ ] from block B2, elements [I ₁₃ , I ₁₄ , I5 ₁₅ , I ₁₆ ] from block B3 and elements [I ₁ , I ₂ , I ₃ , I ₄ ] from block B4, which are closest to the center of the camera.

In Fig. 67, the center of the image formed by the camera is element I ₇ in block B1, and elements [I ₅ , I ₆ , I ₇ , I ₈ ] and [I ₉ , I ₁₀ , I ₁₁ , I ₁₂ ] are input from block B1 and the elements [I ₁ , I ₂ , I ₃ , I ₄ ] and [I ₁₃ , I ₁₄ , I5 ₁₅ , I ₁₆ ] from block B4, which are closest to the center of the camera.

As shown in FIGS. 64 to 67, in the event of an error in the input point raster, there are a maximum of eight points in the block of 1/4 point rasters that can be entered as an alternative.

The dot pattern described above according to the present invention is printed on a printed material, for example, on a picture book, on text, etc., the dot pattern is recorded by the camera in the form of image data, and these image data are converted to digital form to obtain numerical values , thus ensuring the output of information and programs that correspond to these numerical values through a PC, an information output device, a personal information device, a portable telephone or ana logical device.

Below is a description of the principle of scanning points and the design intended for this device with reference to Fig 107 - Fig.

The process of light reflection contains the processes of specular reflection and diffuse reflection, which occur in a predetermined ratio on the surface of the object in accordance with the characteristics of the surface. As shown in the right drawing of FIG. 110, specular reflection is the reflection of light incident on a flat and smooth surface of an object, such that the angle of incidence and the angle of reflection are the same. In particular, when the surface is smooth, the coefficient of specular reflection increases, the reflection of light becomes strong and light flare occurs.

Diffuse reflection occurs as shown in the left drawing of Fig. 110, while the light incident on a very rough surface is scattered in any direction and is reflected. With this diffuse reflection, light is absorbed at a specific wavelength, which is determined by the characteristics of the surface of the object. Therefore, when the surface of the paper is roughened, such as for fine paper or matte paper, the carbon based ink contained in the printed dot 605 absorbs incident light from the LED 2022, and the light is not reflected. Then point 605 is recorded by the CMOS camera 202 (see the left drawing in FIG. 111). However, when the dots are printed on paper having a flat and smooth surface, for example, coated paper or coated art paper, film, plastic or similar, or when the surface of the printed dots is coated or protected by a transparent film , there is a mirror image. In this case, the carbon-based ink does not absorb light from the LED 2022 and becomes a light flare, and therefore, the CMOS camera 202 does not form an image of a point 605 (see the right drawing in FIG. 111). To prevent this, as shown in Fig. 107, the LED 2022 is located in a place where there is no direct reflected light from the LED 2022 in the CMOS camera 202, that is, it is located next to the CMOS camera, and the light from the LED 2022 is reflected from the inner wall 2021 without creating light flares.

In addition, as shown in FIG. 108, light from the LED 2022 is passed through a filter 2023, for example, through an acrylic filter, to uniformly diffuse light scattering onto the paper, thereby preventing the occurrence of light glare. In addition, as shown in FIG. 109, an acrylic filter 2023 can be mounted around the LED 2022 to cover it.

On each of the explanatory drawings, Figures 112 and 113 show the internal configuration of the end portion of the pen scanning device, which implements such a theoretical layout of the CMOS camera and LED 1122.

On Fig shows the nose 1125 with a long conical end connected to the housing 1124 in the form of a tube. The nose is movable in the axial direction, and the movement of the nose with biasing force is provided by an elastic element 1121, for example, a spring or rubber, which is provided with the protruding part of the wall on the inner surface of the nose 1125. The protruding part of the wall is equipped with a CMOS camera, lens 1126, mounted in the center of the CMOS camera, positioned in such a way as to allow observation through the opening of the end of the bow so that the camera can form an image in reflected light transmitted through the hole. On the side of the lens 1126 is an LED 1123 (2022) equipped with a filter 2023 shown in FIG. This LED 1123 is located behind the front surface of the lens 1126 in the housing 1124 in the form of a tube so that the light from the LED 1123 does not enter directly into the front surface of the lens.

The protruding part of the wall is equipped with a switch 1123, which serves to conduct electric current into the electrical circuit when pressed. When moving the nose 1125 towards the body 1124 in the form of a tube against the biasing force of the elastic element 1121, the base of the nose 1125 pushes the switch 1123, actuating the device.

When the switch 1123 is turned on, the LED 1123 is switched to the lighting generation state, thereby starting the data processing by the CMOS camera by scanning.

Since the end of the pen scanner has the structure shown in Fig. 112, the assembly is completed only by inserting the nose 1123 into the housing 1124 in the form of a tube, thereby providing increased productivity during assembly.

In addition, FIG. 113 shows another embodiment of the end of a pen scanner. In the embodiment shown in FIG. 113, the nose 1125 is attached via a rubber element (resilient element) 1132 with glue. In addition, there is a switch 1123 located in a predetermined place inside the rubber element 1132 so that the base of the nose 1125, displaced by movement in the opposite direction of the elastic force, depressed the switch 1123.

In addition, next to the lens 1125 of the CMOS camera, LEDs 1131 are placed behind the corresponding acrylic filters 1133. When the switches 1123 are actuated, light radiation is output from the LEDs 1131, which passed through the acrylic filters 1133, out through the hole in the bow 1125.

In the drawings of FIG. 68 to FIG. 111, other modified embodiments of the present invention are shown.

On Fig shows a camera placed in the housing 1015 in the form of a fountain pen (which is the main body of the device), serving as a pen scanner 1001.

The housing 1015 includes a battery 1016, a speaker 1007, and a circuit board 1017 that are installed therein. The central processing unit (CPU) and the storage device located on the circuit board 1017 are implemented in such a way that all their surfaces are firmly attached to the board. There may be a built-in microphone (not shown in the drawing). In addition, a removable storage cartridge 1014 is located in the rear end portion of the housing 1015 (in the upper right portion of the drawing). This storage cartridge 1014 is configured to store programs, existing voice data, and similar information. The cartridge 1014 of the storage device is removable; it can be replaced by a cartridge of read-only memory (ROM), a micro-device cartridge, or a similar cartridge.

On the surface of the housing 1015 there are buttons 1130a through 1130c for controlling the start of the scanning procedure, the start of the recording procedure, the procedure for reproducing voice information, and the like.

Among these buttons there is a record button, when pressed, a microphone (not shown) can be used to record speech signals. The recorded voice data is stored in the cartridge 1014 of the storage device. In this case, when scanning a region with a dot pattern with a simultaneously pressed recording button, the recorded speech data is assigned to this region with a dot pattern. When the erase button is pressed at the same time while scanning a dot pattern area, the speech data assignment to this dot pattern area can be canceled. Then the speech data can be left for storage in the cartridge 1014 of the storage device.

As shown in the drawing, since the housing 1015 is brought close to the surface of the information carrier in an inclined position at an angle of approximately 45 degrees, the CMOS camera assembly, spring 1121 and the conical nose 1125, which are provided with the end of the housing 1015 (in the lower left part of the drawing), oriented along the vertical axis relative to the surface of the information carrier. When the housing 1015 is pressed in the direction of the surface of the information medium, the nose 1125 moves backward against the biasing force of the spring 1121, and then presses the switch 1123.

A lens 1126 of the CMOS camera assembly is mounted inside the nose 1125, and the inner part of the nose 1125 is controlled so that the lens 1126 can form an image of the window at the end of the nose.

An illuminating tube 1127 is located inside the bow 1125, which has two elbow-shaped parts bent at 45 degrees.

The lighting tube 1127 is made in the form of a cylindrical element made of a transparent polymer, and its front surface faces the LED 1122 in such a way as to allow the input of the light beam emitted by the LED 1122 into the lighting tube. Inside the illuminating tube, the diffuse component of the emitted light beam (component of optical radiation whose angle relative to the optical axis is greater than 45 degrees) passes through the inner surface of the illuminating tube and exits from the outside. In contrast, the rectilinearly transmitted component of the emitted light (component of optical radiation whose angle relative to the optical axis is less than 45 degrees) is reflected from the inner surface of the illuminating tube and passes through the tube. From the end surface in the direction of the hole in the bow 1125 only the component of the emitted light that is approximately parallel to the optical axis of the illuminating tube comes out.

Since the emitted light passes through a knee-shaped illuminating tube made of a transparent polymer, becoming focused light parallel to the optical axis, it is possible to provide an even amount of light over the entire region of the opening of the bow 1125. Therefore, according to this embodiment of the present invention in the case of diffuse illumination does not occur darkening on the periphery, which improves the accuracy of scanning of the plot 607 with a dot pattern.

69, such a pen-type scanning device is shown connected to the main body 1002 of the device. As shown in FIG. 69, the device main body 1002 includes a memory card slot 1003. A memory board 1004 may be inserted into this memory card slot 1003, in which voice data and / or a program are stored. The main body 1002 of the device is also connected to a microphone 1005 so that voice data coming from outside can be recorded in a storage device located in the main body of the device. Voice data can be output from a speaker 1007 installed in the main body 1002 of the device, or from a speaker 1006 connected to the main body 1002 of the device.

In FIG. 69, the pen scanner 1001 and the main body of the device are connected by cable. However, a radio communication interface is integrated into the pen scanner, enabling the pen scanner to be connected to the main body 1002 of the device by a radio communication method.

On Fig shows a modified version of a pen scanner. As shown in FIG. 71, the pen scanner 1001a comprises a battery 1010 and a speaker 1007, and is also configured such that a memory card 1004, which is including a memory card with a memory protection (SD), can be inserted into it, a memory stick type board and a smart media type board.

On Fig shows an embodiment of the application of the present invention for a board game. The mini-figure 1101 serving as a game figure is moved along the circles 1103 marked on the game board 1102, and the number of circles that the mini-figure 1001 runs through is determined using a dice or a speaker 1104. At the base of the mini-figure 1101, a scanning device, for example, a CCD camera or a CMOS camera. A dot pattern area is formed on each of the circles of the game board 1102. When the mini-figure 1101 is placed on a circle, voice information corresponding to the circle can be output from the loudspeaker 1104 connected via a cable. This allows you to display information necessary for the course of the game, for example, teams move to the next round.

On Fig shows a mini-figure 1101 and the main body 1102 of the device, made in the form of individual elements. The scanning device assembly 1105 mounted on the bottom surface of the mini-figure 1101 is used to scan a dot raster portion, and the signal corresponding to the dot raster portion is transmitted to the main body 1102 of the device by a radio communication method. The main body 1102 of the device contains a loudspeaker 1007, which serves to output voice information corresponding to a signal read from the memory card 1004.

In this embodiment, to reduce the flow of information exchange, the mini-figure 1101 is equipped with a decoding device, and image data obtained as a result of scanning a dot pattern is decoded to convert them to code information consisting of several digits. Then, as a signal obtained as a result of scanning, only information about the code is transmitted to the main body 1102 of the device.

On Fig shows a modified version in which the node 1105 of the scanning device located at the bottom of the mini-figure 1101, is used to scan the area with a dot pattern formed on the surface of the stand 1110. According to this variant implementation of the present invention, the scanning area can be changed depending from the position of the scanning device assembly 1105 relative to the dot pattern. For example, if the mini-figure 1101 deviates from the vertical axis of the mini-figure 1101 by a predetermined angle relative to the dot pattern, the signal obtained as a result of scanning can be changed so that the output speech data can be changed depending on the orientation direction of the mini-figure. A description of the method for changing speech data by changing the angle of the mini-figure relative to the area with a dot pattern was given above and is omitted here.

On Fig shows another example of the construction of the mini-figure 1101. In this embodiment, in addition to the node 1105 of the scanning device, the mini-figure 1101 contains a battery 1010 and a speaker 1007. In addition, a memory board 1004 can be inserted into the mini-figure. The program or speech data is changed by replacing the memory boards 1004 so that the game or mini-figure 1101 can be changed to a completely different game or to a completely different character.

A description of the mini-figure 1101 shown in the drawing is given using a doll-shaped figure, which is simple to display in the drawings. However, it goes without saying that the mini-figure can be any cartoon character, a small animal, for example, a pet, a fictional animal, a human figure.

On Fig shows a plot 1122 with a dot pattern formed on the card 1121. It is a toy in which, when the card 1121 is placed horizontally and rotated at a predetermined angle on the stand 1123, in which a scanning device for scanning is installed a dot pattern portion 1122, voice data or visually displayed data is used to output the invoice.

On Fig shows an example of a pen scanner 1001, which is used to solve the crossword puzzle 1132, printed in a magazine or in a similar print edition. The dot pattern portion 1122 of the present invention is formed in blank fields 1133 of a crossword puzzle 1132 printed on paper. When the end of the pen scanner 1001 is brought close to a particular blank field 1133, a tip for the word vertically or for the word horizontally is displayed on the liquid crystal display 1131 of the pen scanner 1001.

In this case, when the end of the pen scanner 1001 is brought close to the unfilled field for which it is desirable to obtain a hint, a dot pattern generated in this unfilled field is scanned and a word hint can be displayed on the liquid crystal display 1131. Moreover, if the scanning device is brought close to one empty field, then a hint for a word located vertically, a hint for a word located horizontally, or a hint for a word located diagonally, depending on the angle at which the pen a scanning device 1001. Since, as described above, the camera tilt (the shift in the direction of rotation of the image recording device with the vertical axis of the paper as the center) can be calculated at Under the condition that the central processor calculates the offset relative to the mesh node of the key point relative to the mesh node, the vertical, horizontal and inclined crossword puzzle direction can be recognized depending on the tilt of the camera. Therefore, a corresponding prompt may be read, which is displayed on the display screen and / or output from the speaker 1007.

Moreover, when the pen-type scanning device 1001 is moved two cells in the vertical direction (down), in the horizontal (transverse) direction, or in the diagonal direction, then movement along the x and y coordinates is detected (the detection method is described above), thus ensuring displaying prompts for the word located in the proper direction on the display screen 1131 and / or its output in the form of speech information from the speaker 1007.

On Fig shows the node 1005 of the scanning device mounted on the stomach of a self-propelled soft toy 1141 in the form of a cat. When the soft toy 1141 comes across a dot pattern area 1122 formed on a floor in a house or on a sticker board or the like, an image of the dot pattern area 1122 is recorded, thereby transmitting a registered signal to the main body 1102 of the device .

On Fig shows the node 1105 of the scanning device mounted on the bottom surface of a self-propelled or radio-controlled toy 1151 in the form of a car. The scanning device assembly 1105 performs registration of a dot pattern portion 1122 formed on a board or on the floor by means of a sticker or the like, sending a signal from the scanning to the main body of the device. Thus, the main body 1102 of the device can output voice information corresponding to the area 1122 with a dot pattern from the speaker 1007.

For example, a sheet is made on which city roads are printed. When the toy car travels along the sheet, stickers on which dotted dot patterns 1122 are formed are attached at places located in front of street intersections and railway crossings depicted on the sheet. When the toy car is approaching a street intersection or a railway crossing, voice information may be output from the speaker 1007 installed in the device main body 1102, causing the car to stop.

On the explanatory drawing Fig.82 shows an embodiment of the invention for playing cards comparison.

As shown in FIG. 82, the main body 1102 of the device is provided with two card slots, when two player cards 1121, 1121 are inserted into the card slot with one card in each slot, then the superiority between the parameters set on the cards 1121, 1121 is judged. Each of the cards 1121, 1122 is provided with a dot pattern portion located on its surface, as explained in FIG. 77, and when scanning this dot pattern portion 1122 with a scanning device assembly 1105 located in the apparatus main body 1102, then the memory boards 1004 read a parameter corresponding to the dot pattern portion 1122, thus making a decision as to who is the winner. In this embodiment, the liquid crystal display screen may be installed in the main body 1102 of the device so that the winning result can be displayed. On Fig shows an example of the main body of the device into which only one card 1102 can be inserted.

84 shows an embodiment of the present invention in which the main body 1102 of the device is a simple card reader and the main body 1102 of the device is connected to a personal computer. On Fig shows an example of the main body 1102 of the device, which is used for sequential scanning of sheets 1161 having the size of a postcard, on which are formed areas with a dot pattern. For example, the main body of the device is designed in such a way that it is suitable for scanning returnable postcards from users on which areas with a dot pattern are formed.

On Fig shows an example of the main body 1102 of the device, which can be used in a cash register terminal or in a similar device. The scanning device assembly 1105, located under the outer surface 1171 of glass, is used to scan a dot pattern raster 1122 attached to the product, which is carried out on the outer surface 1171 of glass, thereby providing the ability to control goods, control sales, etc. , in exactly the same way as when using the barcode. In this case, since, according to the present invention, a dot-raster portion can be formed on the outer surface of the wrapping paper or packaging box for printing so that the dot-raster portion is superimposed on the outer surface with the printed information, the inconvenience can be avoided, associated with the placement of a bar code on the surface of the product, taking place in the system using a bar code.

On Fig shows an example of the main body of the device, consisting of a stand 1102, combined with a mini-figure 1101. According to this variant implementation of the present invention on the upper surface of the stand 1102 is a glass plate 1171, and under the glass plate 1171 there is a node 1105 of the scanning device. In this embodiment, when the mini-figure 1101, on the lower surface of which a dot-raster portion 1122 is formed, is placed on the stand 1102, then the dot-raster portion 1122 is scanned by the scanning device assembly 1105, and thus, speech data corresponding to the code is read out. a number read from the dot pattern portion 1122 from the memory board 1004 that is output from the speaker 1007.

On Fig shows an example of the main body 1102 of the device connected to the television monitor 1171. The output image signal and the speech signal from the main body 1102 of the device to the television monitor 1171 is carried out through the contact connector. The speech signal and the image signal are stored in the memory board 1004 or in the built-in storage device in the main body 1102 of the device. The moving image data corresponding to the dot pattern portion 1122 registered by the pen scanner 1001 is divided into voice data and image data that is input to the television monitor 1171 for output from the screen and from the loudspeaker of the television monitor 1171.

In FIG. 89 shows the main body 1102 of the device in the form of a stand for photographs. A dot pattern portion 1122 is formed on the rear side of the photograph 1181. The back surface of the base assembly of the apparatus main body 1102 is provided with a scanning apparatus assembly (not shown). From the storage device integrated in the device main body 1102 or from the memory board, voice information corresponding to the code number of the scanned dot pattern 1122 that is output from the speaker 1007 is read out. According to this embodiment, since the speech information corresponding to the dot 1122 raster, can be stored in the built-in memory or in the memory card 1004 in advance for each photograph 1181, then from the loudspeaker 1007 can be played back mentary, made at the time of taking a photo, or can be reproduced voice message, such as "Happy Birthday".

In addition to the loudspeaker 1007, a microphone 1005 is installed. Voice data is recorded in the built-in memory or in the memory card 1004, and they can be mapped to a dot pattern 1122 attached in advance to the rear surface of the photograph 1181.

In addition, the case 1102 of the device in the form of a stand for photographs, shown in Fig, is equipped with a liquid crystal display 1131. Section 1122 with a dot pattern matched data, for example, date of recording, message text, etc., and this data, which are displayed on the liquid crystal display 1131 are also mapped to photograph 1181.

On Fig shows a pen scanner 1001 connected to the PC 1201 cable universal serial bus. In addition to the universal serial bus (USB) interface, the connection between the pen scanner 1001 and PC 1201 can be implemented using an RS-232C serial interface, a local area network (LAN) interface, an IEEE1394 standard interface, or a similar interface.

In addition, a radio interface card 1209 is installed in the PC, and communication between the pen scanner 1001 and the PC can be implemented by the radio communication method. The radio interface may be a Bluetooth radio interface, a wireless LAN, or the like. In addition, in addition to the radio interface, communication between the pen scanner 1001 and the PC 1201 can be implemented using an optical communication interface, for example, transmitting data in the infrared region of the spectrum.

FIG. 91 shows a pen-type scanning device 1001 connected by a cable to a personal information device 1202. The communication between the personal information device 1202 and the pen-scanning device 1001 can be implemented by a wired connection, a radio communication, or an optical communication method.

92 shows a mouse-type manipulator 1301 with an integrated scanning device connected to a PC 1201. A mouse-type manipulator 1301 is typically connected to a PC 1201 by a cable. However, the connection may be realized by a radio communication method or by an optical communication method.

On Fig and Fig shows a mouse type 1301, having the function of a digital Converter. In this mouse-type manipulator, a scanning device assembly 1105 is mounted, and the mouse-type manipulator 1301 is provided with a transparent window made in the form of a glass part 1302, which is located at its end. Through this window, you can see the target, which is a dot raster portion 1122, which is scanned by the scanning device assembly 1105.

On Fig shows a variant of the design of the node 1105 of the scanning device, which is equipped with the main body of the personal information device 1202, and Fig. 96 shows a variant of the design of the node 1105 of the scanning device, which is equipped with the main body of the PC 1201. As shown in Fig. 95, when the scanning device assembly 1105 is installed in the main body of the personal information device 1202, the scanning device assembly 1105 located in the main body of the personal information device 1202, holding m over portion 1122 dot pattern formed on paper or a similar material, and may be carried scanning portion 1122 dot pattern. In contrast, when the scanning device assembly 1105 is located in the main body of the PC 1201, as shown in FIG. 96, the dot pattern portion 1122 formed on the business card or on the card 1121 (see FIG. 77) is held above the assembly 1105 a scanning device, thereby scanning the dot-raster portion 1105. As shown in Fig and Fig, node 1105 of the scanning device can be installed in the main body of the portable telephone 1401 or in the main body of the gaming device (not shown).

On Fig shows a pen scanner 1001 connected to the connector of a portable telephone 98. In this embodiment, the scan signal obtained by scanning with a pen scanner 1001, which corresponds to the area with a dot pattern, can be processed by a program downloaded in advance to the portable a telephone 1401 is displayed on a display screen of a portable telephone or is displayed as a speech signal. In addition, the portable telephone 1401 can receive the resulting data from the server to which the program has accessed and which have been processed in the server by transmitting a scan signal.

FIG. 100 shows an embodiment of a pen scanner 1001 provided with an LCD (liquid crystal) display 1131 and a speaker 1007. The pen scanner 1001 according to this embodiment of the invention comprises a writing unit 1601, for example, a ballpoint pen mounted at its end, and a scanning device assembly 1105 located around the writing assembly.

As an example of the use of such a pen scanner 1001, the following example can be given: a dot pattern section 1122 is formed in a restaurant or similar institution menu, and when a client arrives at a restaurant, he is presented with a menu and a pen scanner 1001.

The client selects a dish from the menu and makes a mark in the square box corresponding to the selected dish, writing node 1601. At this point, scan section 1122 with a dot pattern corresponding to the selected dish node 1105 of the scanning device. Thus, the information processing performed by the central processor in the pen scanner 1001 allows reading information in the form of letters corresponding to the selected dish from the storage device that is displayed on the screen of the liquid crystal display 1131. As shown in FIG. 100, the liquid crystal display 1131 displays the name of the dish chosen by the client: "Japanese chops with a side dish," its calorie content is "864 calories" and its price is "1250 yen."

Thus, since the client himself selects the dish from the menu and confirms his choice with the pen scanner 1001, the staff can complete the order processing by simply taking the pen scanner 1001 from him.

FIG. 101 shows an embodiment of a pen scanner 1001 provided with a microphone 1005 and a speaker 1007. In this embodiment of the present invention, a dot pattern formed on the surface of photograph 1181 is scanned by a scanning device assembly 1105 after scanning completed, use the microphone 1005 to input voice information corresponding to the dot pattern area 1122. The entered speech data is stored in a storage device (not shown) that is available in the pen scanner 1001. In this embodiment, the voice information contains a description and a greeting informing that the picture 1181 was taken. Moreover, if the dot-scattered plot 1122 is formed on the entire surface of the photograph, which occurs in the case of a group photograph, then the description of each person from the group photograph can be remembered.

Then, the end (scanning device assembly 1105) of the pen scanning device 1001 is brought close to that portion on the surface of the photograph 1181, the explanation of which is desired to be obtained. Then, voice data can be reproduced from the speaker 1007.

In addition to photograph 1181, a dot pattern 1122 is formed on each sticker. In this case, for inputting voice data, the pen scanner 1001 is brought close to the surface of the sticker.

The drawing Fig. 102 shows an example of a joint notebook-diary 1701 and a pen scanner 1001.

As shown in FIG. 102, a dot pattern portion 1122 is formed in advance in the calendar planning section 1702 of the daily notebook 1701. In the event that, when compiling the daily routine in the calendar planning section 1702, the person on the way is not able to record letters in writing, he brings the end (node 1105 of the scanning device) of the pen scanner 1001 close to the calendar planning section 1702 with the date on which he wants to enter the daily routine, and enters information about the order of the day, scheduled on this date, in the form of speech through a microphone (not shown).

When checking the schedule in the notebook-diary 1701, the pen scanner 1001 (scanning device assembly 1105) is brought close to the scheduling section 1702 with a verified date by scanning the dot pattern raster 1122. In this way, the daily routine entered in the speech form corresponding to this date is reproduced from the loudspeaker 1007.

In this embodiment, the pen scanner 1001 is configured such that it can be connected to a PC 1201 via a universal serial bus interface or similar means, and establishes a similarity of data (is synchronized) with the scheduling system available in the PC 1201 (which, for example, computer program "Outlook" of the company "Microsoft Corporation", "Lotus Notes", etc.). Then, when the pen-type scanning device 1001 is used to scan the dot-dot plot 1122 in the "date" section (in the scheduling section 1702), the display mode of the daily routine corresponding to this date is set on the liquid crystal display 1131 with data in the form of text, as shown in Fig. 102.

When the pen scanner 1001 can be connected to the PC 1201, the dot pattern portion formed on the surface of the daily notebook 1701, an identity card, a driver’s license, or a similar document can provide data entry control to the PC 1201. Such control of the PC 1201 is called "paper pictogram", the pictogram on the screen of PC 1201 can be replaced by an external storage medium on which there is a dot pattern section 1122 (a sticker attached to the notebook-diary 1701, acc. personality assurance).

In other words, the pen-type scanning device 1001 is used to scan the dot-raster section 1122 on the information medium and access to the PC 1201 is only allowed if the code information obtained by scanning the dot-raster section 1122 matches the code information stored on PC 1201.

A dot pattern plot 1122 can be printed on a paper pictogram sticker that is attached to the surface of a daily notebook 1701, an identity card, or a driver’s license. Or, the user can print it using a printer connected to the PC 1201 and keep a printed sticker on him.

In this embodiment, a paper icon on which a dot pattern area is formed is used to control access to PC 1201. However, it can be used to enter an identifier or password when starting a specific application program or to access a specific Internet site.

Management of work with such a paper pictogram can be carried out by an application program for paper pictograms installed in the PC operating system,

In particular, the management consists of the following three operations: “registration of the icon in the PC”, “registration of the paper icon” and “deleting the icon”.

<Register regular icon>

The application program for paper pictograms in a PC contains an editing program that provides the creation and definition of a paper pictogram on the screen.

When the icon intended for performing a predetermined function in the PC is registered in the editing program in the icon editing program, the icon highlighting mode (SELECTION) is first turned on. Then, the desired icon is indicated on the PC screen by a mouse-type manipulator and the icon is registered in the editing program.

The icon registered in this way in the editing program is set to its initial state, in which the visual display mode is turned on and the executable (active) state is turned on.

When the visual display mode is turned off in the editing program in this state, the icon is removed from the display screen. When the executable (active) state is turned off, it is forbidden to assign and execute icons on the PC and perform keyboard input operations.

<Register paper icon>

While in the editing program, the paper icon highlighting mode (SELECTION) is turned on. Then, an icon on the display screen is turned on in order to scan the carrier of the paper icon that it is desired to register with a pen scanner or similar device.

Through the above operation, the dot-raster code is registered for the scanned paper pictogram in the selected (highlighted) pictogram.

In the initial state of the paper, the icons include an executable state (activation), and a password can be entered. Then enter the password, carry out the encoding of the password by the editing program and its registration.

In this state, when the executable (active) state is turned off, the function specified in the icon cannot be performed even if the paper icon was scanned with a pen scanner.

<Delete icon>

When the delete flag (DELETE) is turned on, the executable (active) state is simultaneously turned off. Then, in this state, the image flag of the icon is indicated, the icon is deleted and is no longer restored.

<Delete paper icon>

When deleting a paper icon, when the delete flag is (DELETE), the executable (active) state is also turned off simultaneously. Then in this state indicate the code number assigned to the paper icon, and you must enter the password. After entering the password, the connection with the paper icon in the editing program is deleted and is no longer restored.

In addition to the information medium in the form of a picture book described in an embodiment of the present invention, the dot pattern portion 1122 can be contained in a regular book, in a greeting card, a newspaper, a catalog of items ordered by mail, a handout, a paper product, an origami figure and recipe.

For example, an area with a dot pattern is formed in the catalog of goods ordered by mail. In this case, they scan the area with a dot pattern by the node of the scanning device to display a description of the goods or to run the checkout program stored in the storage device on a PC.

In addition, a dot pattern portion is formed on a paper product or on an origami figure. In this case, a dot scan site is scanned by a scanning device assembly to explain a method of manufacturing a paper product and origami through a speaker.

In addition, a dot pattern portion is formed on a culinary or similar recipe, and the recipe can be output in speech form.

In addition, the dot pattern portion of the present invention is used to create a picture book for coloring. In particular, the areas (stencil areas) shown in Fig. 106B and Fig. 106B can be painted in different colors with colored pencil, felt-tip pen, watercolor paint, etc. In this embodiment, scanning of a dot pattern area can be carried out even when a carbon-free watercolor ink, colored pencil, felt-tip pen and the like are used to stain paper on which the dot pattern region is formed, since the infrared light radiation is able to pass through a colored layer.

In addition, when printing, a dot pattern area and a readable bar code can be superimposed on each other. In this case, the printing of the bar code is carried out on a carrier such as high ash paper, carbon-free ink, and on the printed bar code, a dot-dot plot of carbon-based ink is printed. A conventional barcode reader is capable of accurately reading a barcode even when there is a small dot on the barcode. Then use the pen scanner according to the present invention to enter data about the read information code only from the area with a dot pattern.

In addition, the bar code is printed with a printing ink absorbing "(A) visible light + infrared light or ultraviolet light at wavelengths close to visible light", or "(B) infrared light or ultraviolet light at wavelengths, close to visible light ", while the dots are printed with ink absorbing" (C) infrared light or ultraviolet light at other wavelengths than those of infrared light and and ultraviolet light, which have been used in a bar code. "

In this case, a filter is installed on the CMOS camera to cut off visible light, there is a first LED emitting light for reading a bar code, designed in such a way that it emits light with the same wavelength as in the above options (A) or ( B) Then there is a second LED emitting light for reading only the dot-raster portion and entering the information code, designed in such a way that it emits light with the same wavelength as in the above embodiment (C). Thus, since the information from the dot-raster section is placed on the bar code, information in the form of a convolution (the bar code and the code from the dot-raster section) can be obtained.

Industrial use

The dot pattern portion of the present invention is convenient to use when it is formed on print media, including a book and a picture book, a sticker with a pattern, on a data input sticker with a dot pattern formed on a pattern sticker , on the board for the game, on goods in the form of characters, which are including a figure and a soft toy, and on the touch panel of the monitor screen of a personal computer, TV, etc.

The system for reading a dotted dot plot can be used as a data input system in the field of computer toys for children and general purpose computers.

In addition, the system is housed in a housing that can be used as a stand-alone scanning device in an electronic device, in a voice information recording device, and the like.

Claims (8)

1. A method of reproducing information using a dot pattern, containing the following operations:
display information in the form of instructions on the visual display on which the touch panel is located;
scanning data on the image of a dot raster portion formed on a transparent film of the touch panel, the aforementioned dot raster portion being formed by orderly arranging, in accordance with a predetermined rule, the points generated by the dot code generation algorithm in such a way as to provide recognition of various types of multimedia information, while scanning is carried out by a scanning tool following the information in the form of instructions, display oh on the visual display tool;
converting image data of a dot raster plot into code data;
reading multimedia information corresponding to the code data from the storage means; and
reproduce multimedia information. 2. The method of reproducing information using the dot pattern according to claim 1, in which the area with a dot pattern is formed in such a way that provides recognition of speech information. 3. The method of reproducing information using the dot pattern according to claim 1 or 2, wherein the dot pattern portion contains a plurality of regions printed separately depending on the image on the transparent film. 4. A device for reproducing information using a dot raster, comprising:
a touch panel containing a transparent film on which a dot raster portion is formed, formed by ordered placement, in accordance with a predetermined rule, of points generated by the dot code generation algorithm, so as to enable recognition of various types of multimedia information;
wherein the touch panel is located on the visual display means of the electronic device;
scanning means for scanning image data of a dot pattern formed on the touch panel following information in the form of instructions displayed on the visual display means; and
an electronic device for converting image data into digital form to obtain numerical values, for reading from the storage medium multimedia information corresponding to the area with a dot pattern based on the numerical values and for reproducing multimedia information. 5. The device for reproducing information using the dot pattern according to claim 4, in which between the touch panel and the visual display means there is a filter that cuts off infrared light radiation. 6. The device for reproducing information using a dot pattern according to claim 4 or 5, in which the electronic device is a personal computer. 7. The information reproducing apparatus using the dot pattern according to claim 4 or 5, wherein the electronic device is a personal information device (PDA). 8. The information reproducing apparatus using the dot pattern according to claim 4 or 5, wherein the electronic device is a portable telephone.

Images