JP3073422B2 - Information processing device with sound information addition function - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus having a sound information adding function, and more particularly, to a word processor, a personal computer, a communication terminal, a POS terminal, a cash register, and the like, and document information recorded on a printable medium. The present invention relates to an information processing apparatus with a sound information adding function for recording sound information converted into a two-dimensional barcode in association with image information, graphic information, and the like, and reproducing and transmitting sound information to the associated specific information.

[0002]

2. Description of the Related Art Conventionally, exchange and transmission of document information and image information are often performed using printing paper, a floppy disk or the like as a medium. That is, in an information processing apparatus such as a word processor or a personal computer, document information, image information, and the like are printed on printing paper, recorded on a floppy disk, and transmitted using a facsimile apparatus, a telephone line, or the like. It is common to copy from a floppy disk.

Further, with the development of OCR technology, document information manually input on printing paper is optically read and converted into character fonts (printed characters), and is widely used for electronic translation, information exchange, and transmission. However, many problems remain, such as the character recognition rate. These problems are greatly reduced by converting to encoded information. A bar code is known as a representative example of such encoded information (see Japanese Patent Application Laid-Open No. 5-1288). JP-A-5-1
According to the information processing apparatus described in Japanese Patent No. 2288, document information is converted into encoded information such as JIS code, a barcode is created, and the barcode is printed on recording paper. If necessary, the recording paper is read and inversely converted so that it can be returned to the document information and used. In addition, even when a recording sheet is copied or transmitted by a facsimile machine, the quality of encoded information is hardly degraded, and the necessity of information and the occurrence of errors can be reduced. However, since the amount of information in barcode notation that can be recorded on printing paper or the like is small, it is limited depending on the application. For example, it is not suitable for encoded information of sound information.

Conventionally, sound information is generally recorded on a recording medium such as a magnetic tape or a CD, but instead, a printing paper recorded with a two-dimensional code having a mesh pattern has been considered (Japanese Unexamined Patent Publication (Kokai) No. Heisei 3-3-1). Reference No. 11482). JP Hei 3
According to the audio recording method and apparatus and the audio reproducing method and apparatus disclosed in JP-A-114482, audio is digitized to generate digital data, and the generated digital data is printed as an image of a net pattern on a print medium. Conversely, a print medium on which an image of a net pattern having audio information is printed is read by an image reader, digitized, and converted into an analog signal, thereby reproducing audio. If audio information is recorded on such a printing sheet using a two-dimensional code of a mesh pattern, the amount of recorded audio information is smaller than when a magnetic tape is used.However, for example, the facsimile apparatus is used for exchanging and transmitting audio information. It can be used and distribution costs can be reduced. In addition, since the sound information cannot be deciphered directly, it is also useful for maintaining confidentiality.

[0005]

However, in Japanese Patent Application Laid-Open No. Hei 3-11482, for example, the characteristics of the recording medium of the paper itself are utilized by replacing the magnetic tape, which is the recording medium of the sound information, with paper. It is merely a recording / reproduction, and no further use is described. For example, it is needless to say that added value is created by associating sound information with other information, reproducing the sound information as needed, and calling and editing the information in accordance with the sound information, rather than printing the sound information alone. .

The present invention has been made in view of the above circumstances, and prints sound information as a two-dimensional bar code using a print sheet as a recording medium, and outputs the sound information, document information, image information, and graphic information. An information processing device with an information addition function that automatically corrects relative related information in response to editing such as moving, copying, etc. of sound information corresponding to related information by printing relative related information for associating each information with the related information. To provide.

[0007]

FIG. 1 is a block diagram showing the basic configuration of the present invention. In FIG. 1, a first invention of the present application is an information processing means 101 for inputting / outputting an information source composed of document information, image information, graphic information, and the like, and a sound information input for inputting sound information to be added to the information source. Means 102
And bar code encoding means 103 for encoding the input sound information into a two-dimensional bar code; relative related information and sound information having coordinate information for associating the encoded sound information with the information of the information source. Information / relative related information storage means 104 for storing sound information and sound information / relative related information storage means 1
Calling means 10 for calling the sound information and the relative related information from the terminal 04
5 and reproduction means 106 for reproducing the called sound information
And a display means 107 for displaying the information of the information source and the encoded sound information on the screen in a mixed manner, or a printing means 108 for printing on a print sheet. Coordinate designation means 109 for designating the coordinates of the designated sound information, area designation means 110 for designating an area in which the designated sound information is to be moved, area movement means 111 for moving the sound information to the designated area, A sound information adding function for correcting coordinate information of the relative information stored in the sound information / relative information storage means as the information area moves. Attached information processing device.

In the present invention, the information processing means 10
1, bar code converting means 103, sound information / relative related information storing means 104, calling means 105, reproducing means 106, area moving means 111, relative related information correcting means 112, CPU, RAM, ROM, I / O port It is preferable to be constituted by a microcomputer comprising In particular, the sound information / relative related information storage means 104 is constituted by a RAM therein. Further, it is preferable that the reproducing unit 104 includes a barcode restoration circuit for restoring a two-dimensional barcode digital signal, a D / A converter, and a speaker.

Preferably, the sound information input means 102 comprises a microphone and an A / D converter. An LCD (liquid crystal display) device, a CR
It is preferable to include a T display device, an EL display device, and the like. It is preferable that the printing unit 108 is constituted by a thermal printer, an ink jet printer, a laser printer, or the like.

[0010] Coordinate designating means 109, area designating means 110
It is preferable that the input device is constituted by an input device such as a keyboard, a mouse, and a pen. Here, the two-dimensional barcode is, for example, a matrix-like cell corresponding to bit information is virtually set on a flat recording surface (paper surface), and optically readable cells are provided in each cell. This is digital information to which a pattern (for example, white or black) is added, and the digital information is obtained by reading the pattern of the grid by a reading device such as a scanner. The relative related information is information having coordinate information and page information for associating the sound information represented by the two-dimensional barcode with the information of the information source, and is used for information search.

The relative related information correcting means further comprises a page number adding means for adding a page number to the relative related information, and the sound information represented by the two-dimensional bar code is associated with the information described on a plurality of pages. In such a case, it is preferable that a page number is added to the relative related information and the coordinate information of the page is combined for correction.

Further, the apparatus further comprises an area copying means for copying the sound information designated by the area designating means, wherein the relative related information correcting means adds the relative related information and copies the coordinate information thereof in accordance with the area copying of the sound information. Preferably, it is configured to correct. The apparatus further includes an enlargement / reduction means for enlarging / reducing the dot size of the sound information designated by the area designating means, wherein the relative related information correcting means includes coordinate information of the relative related information as the sound information is enlarged / reduced. Is preferably modified.

As shown in FIG. 1, according to the second aspect of the present invention, an information processing means 101 for input / output processing of an information source composed of document information, image information, graphic information and the like, and is added to the information source. Sound information input means 102 for inputting sound information;
Bar code encoding means 103 for encoding the input sound information into a two-dimensional bar code; and storing relative related information and sound information having coordinate information for associating the encoded sound information with the information of the information source. Sound information / relative related information storage means 104 and sound information / relative related information storage means 104
Calling means 105 for calling sound information and relative related information from
A reproducing unit 106 for reproducing the called sound information;
An information processing apparatus comprising: a display unit 107 that displays the information of the information source and the encoded sound information together on a screen; or a printing unit 108 that prints the information on a print sheet.
Area designating means 1 for designating an area where sound information is additionally inserted
10, additional insertion means 113 for additionally inserting sound information represented by a two-dimensional bar code between a plurality of sound information represented by a two-dimensional bar code in the information of the information source, and addition of the sound information. Area moving means 111 for moving sound information with insertion, alignment means 114 for rearranging additionally inserted relative related information, and storage in said sound information / relative related information storage means 104 with additional insertion of sound information. Relative related information correcting means 1 for correcting the coordinate information of the relative related information
And an information processing apparatus with a sound information adding function.

As shown in FIG. 1, according to the third aspect of the present invention, an information processing means 101 for input / output processing of an information source composed of document information, image information, graphic information and the like, and is added to the information source. Sound information input means 102 for inputting sound information;
Bar code encoding means 103 for encoding the input sound information into a two-dimensional bar code; and storing relative related information and sound information having coordinate information for associating the encoded sound information with the information of the information source. Sound information / relative related information storage means 104 and sound information / relative related information storage means 104
Calling means 105 for calling sound information and relative related information from
A reproducing unit 106 for reproducing the called sound information;
An information processing apparatus comprising: a display unit 107 that displays the information of the information source and the encoded sound information together on a screen; or a printing unit 108 that prints the information on a print sheet.
An information source composed of document information, image information, graphic information, and the like described on a plurality of pages, a reading unit 114 for optically reading sound information represented by a two-dimensional barcode, and all information for storing all read information Storage means 116, search instructing means 116 for instructing that only sound information is searched out of all stored information, and sound information searching means 11 for searching for whole sound information based on the relative related information and outputting it to printing means 108
And the printing unit 108 arranges the searched sound information and prints it on a print sheet. In the above configuration, the sound information selecting means for selecting the sound information, and the calling means may further include a function of calling related information on a display screen from relative relative information corresponding to the selected sound information. Is preferred.

Further, sound information selection means and search instruction means 11
Reference numeral 7 includes an input device such as a keyboard, a mouse, and a pen. The reading unit 115 includes an image scanner, a print sheet feed mechanism, and the like. Page number adding means, area copying means, enlargement / reduction means, additional insertion means 113, alignment means 114, all information storage means 11
6. As the sound information search means 117, a CPU, a RAM,
It is preferable that the microcomputer be composed of a ROM and an I / O port. In particular, the RAM therein is used as the entire information storage means.

[0016]

According to the first aspect of the present invention, sound information represented by a two-dimensional barcode is associated with information of an information source including document information, image information, graphic information, and the like, thereby coping with related information. The sound information can be reproduced, displayed, and printed as needed, which is achieved by the relative information having coordinate information for associating the sound information with the information of the information source. Is performed. For example, when the area information is moved by the area moving means on the sound information displayed on the display screen, the coordinate information of the relative related information is corrected in conjunction with the area movement by the coordinate correcting means. Saves the trouble of setting.

If the relative related information correcting means further includes a page number adding means for adding a page number to the relative related information, the sound information represented by a two-dimensional bar code is described on a plurality of pages. When it is associated, the page information is corrected by adding a page number to the relative related information and combining the coordinate information of the page, so that sound information of a plurality of pages can be managed.

According to the structure further provided with the area copying means, the area to which the sound information is to be copied is designated, and when the area information is copied, the relative related information correcting means additionally corrects the relative related information. This eliminates the need to set the coordinates of the relative related information. With the configuration further including the enlargement / reduction means, the dot size of the two-dimensional barcode can be set in accordance with the resolution level of the reading device.

According to the second aspect of the present invention, the sound information represented by a two-dimensional bar code is additionally inserted between a plurality of sound information represented by a two-dimensional bar code in the information of the information source. At the time of additional insertion, the aligning means rearranges the relative related information stored in the sound information / relative related information storage means with the additional insertion of the sound information. Since the coordinate information of the information is corrected, the information can be easily searched.

According to the third aspect of the present invention, an information source composed of document information, image information, graphic information and the like described on a plurality of pages and a reading means for optically reading sound information represented by a two-dimensional bar code All information storage means for storing all read information, search instruction means for instructing to search for all sound information, and sound information for searching for all sound information based on the relative information and outputting to the printing means And a search unit. The print unit arranges the searched sound information and prints it on a print sheet. Therefore, only the sound information is picked up from information described on a plurality of pages and stored on the print sheet. It becomes possible. Therefore, it is possible to save the trouble of searching for sound information when a plurality of pages are displayed. In addition, the efficiency of information retrieval is improved by picking up sound information and enabling calling of information related to the sound information. Further, when a plurality of pages are displayed, the related information search of the sound information is simplified.

[0021]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below in detail with reference to the embodiments shown in the drawings. The present invention is not limited by this. The information processing apparatus with sound information addition function of the present invention is particularly applied to a word processor, a personal computer, a communication terminal, a POS terminal, a cash register, and the like, and two-dimensionally converts document information, image information, graphic information, and the like recorded on a print sheet. Record / associate sound information converted to barcode
Can be played.

FIG. 2 is a block diagram showing the overall configuration of one embodiment of the present invention. In FIG. 2, reference numeral 1 denotes a pen (coordinate indicating means) for indicating the coordinates of a two-dimensional barcode from the display screen, 2-1 a tablet for detecting a point on the display screen specified by the pen, and 2-2 an LCD device. The display device 3 includes a coordinate detection circuit that detects position coordinates specified by the pen 1. Reference numeral 4 denotes a barcode data output control circuit for controlling two-dimensional barcode data to be displayed on the screen of the display device. 5 is a keyboard (search instructing means, sound information selecting means), 6 is a cursor position control circuit, 7 is a search for a positional relationship between a reproduced (sound) area in the document information, image information and graphic information and the cursor. Is a specified area search circuit (area specifying means).

8 is a bar coding circuit (bar coding means) for converting the digitized sound information into a two-dimensional bar code;
Reference numeral 9 denotes a bar code restoring circuit (a part of the reproducing means) for converting the read two-dimensional bar code sound information into digital sound information.
C, sound information input means), 10-2 a speaker (SP, reproduction means) for outputting sound information, 11 a signal switching control circuit for switching and controlling an input signal from a microphone or an output signal to a speaker, 12-1 Is an A / D converter for converting an analog signal of input sound information to a digital signal, and 12-2 is a D / A converter for converting digitized sound information to an analog signal.

Reference numeral 13 denotes a printing sheet feeding device for feeding a printing sheet on which various information is printed to a scanner 14, reference numeral 14 denotes a scanner (reading means) for reading various information on the printing sheet, and reference numeral 15 denotes a feeding device for controlling the printing sheet feeding device. It is a control circuit. A bar code data discrimination circuit 16 detects a range of information of a two-dimensional bar code printed on a print sheet. Reference numeral 17 denotes an input / output information control circuit (information processing means, calling means) for controlling input / output data to / from the RAM;
Reference numeral 8 denotes a RAM (sound information / relative related information storage means, all information storage means) for storing relative related information, sound information, and the like. 19 is a printing device such as a thermal printer, 19a
Is the printed data.

An area moving function circuit (area moving means) 20 for moving an area, an automatic coordinate system correcting circuit (relative related information correcting means) 21 for correcting coordinates of relative related information, 22
Is an insertion function circuit (additional insertion means) for additionally inserting sound information between pieces of information, 23 is an automatic alignment function circuit (alignment means) for aligning relative related information based on coordinates, and 24 is an area copy function circuit (area copy means). ), 25 are enlargement / reduction function circuits (enlargement / reduction means) for enlarging / reducing the dot size of sound information, and 26 is a microcomputer comprising a CPU, a RAM, a ROM, and an I / O port. Main control device for controlling each means).
In M, a program for controlling each circuit (each means) is stored. The main controller 26 also functions as a page number adding unit and a sound information searching unit.

FIG. 3 is an explanatory diagram showing the function of moving the sound information area according to the present invention. The function shown in FIG. 3 shows a process of editing the relative related information with respect to the movement of the area of the sound information represented by the two-dimensional barcode. In FIG. 3, a is relative related information, b
Is document information, and e is sound information represented by a two-dimensional bar code. Here, the relative related information a is information related to the sound information e represented by a two-dimensional bar code, out of information of an information source including document information b, image information (image information) c, and graphic information d. Position information (sound information management information) indicating the coordinates of the regions b to d, the regions, and the like. Information source b
To d and the sound information e are associated with each other, and the area of the relative related information a contains a plurality of pieces of relative related information.
Now, b1 and e1, b2 and e2 are associated with each other,
Let the relative related information be a1 and a2. Further, all of the symbols a to e described later are common to the above.

FIG. 4 is a flowchart showing the processing contents of the first embodiment of the present invention. With reference to the flowchart of FIG. 4 and the explanatory diagram of FIG. 3, the editing process (correction process) of the relative related information with respect to the area movement of the sound information represented by the two-dimensional barcode will be described. In the flowchart of FIG. 4, a scanner reads a print sheet on which relative related information a, document information b, and sound information e described in a two-dimensional barcode are described (step S101), and displays the screen (step S102). . The sound information to be moved is selected (step S103), and the destination of the sound information is specified (step S104). Performing or canceling the area shift of the sound information by the area shift function (step S10)
5). In the case of cancellation, the display returns to the original display screen in step S102, and in the case of execution, the sound information is moved to the designated area (step S106). The contents of the relative related information are corrected with the movement of the sound information area (step S10).
7).

The step S107 will be further described. As shown in FIG. 3, for example, when the area of the sound information e2 is moved to the designated dotted area, the coordinate e2 (xe2, ye2) of the relative related information is obtained by the interlocking correction function. , (Xe2
1, ye21) at the destination coordinates (xe22, ye2).
2) Corrected in conjunction with (xe23, ye23). Therefore, according to the first embodiment, when the sound information displayed by the two-dimensional barcode on the display screen is moved to the area, the relative related information is automatically and automatically corrected in association with the sound information. The area can be easily moved by eliminating the trouble of correcting the data.

FIG. 5 is an explanatory diagram showing the sound information insertion function of the present invention. The function shown in FIG. 5 shows a process of editing relative related information with respect to additional insertion of sound information represented by a two-dimensional barcode. Now, b1, c1, d1 and e1, b2, c
2, d2 and e2 are associated with each other, and their relative related information is a1 and a2. FIG. 6 is a flowchart showing the processing content of the second embodiment of the present invention. With reference to the flowchart of FIG. 6 and the explanatory diagram of FIG. 5, a description will be given of a process of editing relative relative information when sound information is further inserted between document information to which a plurality of pieces of sound information have already been added.

In FIG. 6, a scanner reads a print sheet on which relative related information a, document information b, image information c, graphic information d, sound information e expressed by a two-dimensional bar code, and the like have already been written (step S201). ) And display the screen (step S202). The insertion or insertion of sound information is operated or canceled by the insertion function (step S203). In the case of cancellation, the original screen display of step S202 is displayed. In the case of execution, sound information is inserted (step S204), and the coordinates of the relative information of the inserted sound information and related information are added (step S205). Further, a plurality of pieces of relative related information are arranged by the arrangement function in an area closer to the origin of the print sheet (screen) (step S206).

Steps S204 to S206 will be further described. For example, as shown in FIG.
And a2, b1 and b2, c1 and c2, d1 and d2, and sound information e3 between the sound information e1 and e2, if there is information to be added, a3, b3, c3, d3, e
A3, b3, c3,
When d3 and e3 are closer to the origin of the coordinate system than b2 related information, the alignment function is automatically performed in the relative related information and edited so that the relative related information a2 is after the relative related information a3. Will be fixed. Therefore, according to the second embodiment, when sound information to be further described in a two-dimensional barcode is inserted between a plurality of sound information described in a two-dimensional barcode in the document information, the relative relation information is automatically generated. By re-associating, the information is arranged and the information can be easily searched.

FIG. 7 is an explanatory diagram showing a function of adding page information of relative relation information according to the present invention. The function illustrated in FIG. 7 illustrates an editing process of adding page information to relative related information when sound information represented by a two-dimensional barcode and information related to the sound information are described over a plurality of pages. As shown in FIG. 7, for example, the first page is relative information a and document information b, the second page is image information c,
When the third page becomes the sound information e, page information is further added to the relative related information a.

FIG. 8 is a flowchart showing the processing content of the third embodiment of the present invention. Using the flowchart of FIG. 8 and the explanatory diagram of FIG. 7, editing processing of relative related information when each related information is created on a plurality of pages in a description sheet of sound information represented by a two-dimensional bar code Will be described. In FIG. 8, as shown in FIG. 7, when relative information a and document information b are created on the first page, image information c is created on the second page, and sound information e is created on the third page (step S301). Page No. at the top of the page
Is added (step S302), each page No. and the coordinate information of the page are combined, added to the relative information, and stored in the RAM so as to be described at the beginning of the first page (step S303). Therefore, according to the third embodiment, the sound information described on a plurality of pages and the related information can be managed, so that the use range of the sound information of the two-dimensional barcode is expanded.

FIG. 9 is an explanatory diagram showing the sound information storage function of the present invention. The function illustrated in FIG. 9 illustrates an editing process in which, when sound information represented by a two-dimensional barcode is described on a plurality of pages, only the sound information is picked up and stored on another sheet. As shown in FIG. 9, for example, when the sound information e1 and e2 are described on the first page and the sound information e3 and e4 are described on the second page, these sound information e1 to e4 are provided.
Are picked up in order from the beginning of the sentence and stored on the sheet.

FIG. 10 is a flowchart showing the processing content of the fourth embodiment of the present invention. With reference to the flowchart of FIG. 10 and the explanatory diagram of FIG. 9, an editing process of picking up only sound information and storing it in a sheet when sound information associated with a plurality of sheets is mixed will be described. In FIG. 10, a scanner reads a print sheet in which each information and sound information represented by a two-dimensional barcode are described on a plurality of pages (step S401), and executes or cancels the sound information pickup function (step S402). . In the case of canceling, the standby state is kept on the original screen of step 401, and if executed, only the sound information is sequentially picked up from those whose page numbers and the coordinate system are close to the origin, and are arranged and displayed on a new page (step S403). Then, it is printed and stored on a print sheet (step S404). Therefore, according to the fourth embodiment, only the sound information represented by the two-dimensional barcode can be picked up from the information sources mixedly described on a plurality of print sheets, printed on another print sheet, and stored. .

FIG. 11 is an explanatory diagram showing a function of calling out sound information and information related to the sound information according to the present invention. FIG.
The function shown in FIG. 9 shows an editing process in which the sound information stored in FIG. 9 can be picked up and the related information can be called by the relative related information. As shown in FIG. 11, by picking up the sound information e1 to e4 printed on another sheet, the related information can be arranged and called from the relative related information. FIG. 12 is a flowchart showing the processing content of the fifth embodiment of the present invention. Using the flowchart of FIG. 12 and the explanatory diagram of FIG. 11, an explanation will be given of an editing process in which sound information over a plurality of pages is collected on a separate sheet, and by selecting sound information, information related to the sound information can be called. I do.

In FIG. 12, the sound information arranged in FIG. 9 is selected (step S501). Performing or canceling the sound information (reproduction) (step S50)
2). In the case of cancellation, related information such as document information, image information, and graphic information is called out without reproducing the sound information, and is displayed below the sound information (step S503). In the case of execution, the sound information is reproduced, and thereafter, related information such as document information, image information, and graphic information is called and displayed below the sound information (step S504). Therefore, according to the fifth embodiment, the efficiency of information retrieval is improved by allowing sound information to be called by picking sound information. Further, when a plurality of pages are displayed, the related information search of the sound information is simplified.

FIG. 13 is an explanatory diagram showing a sound information area copying function of the present invention. The function shown in FIG. 13 shows a process of editing relative related information for area copying of sound information represented by a two-dimensional barcode. FIG. 14 is a flowchart showing the processing content of the sixth embodiment of the present invention. With reference to the flowchart of FIG. 14 and the explanatory diagram of FIG. 13, the editing process (correction process) of the relative related information with respect to the copying of the sound information represented by the two-dimensional barcode will be described.

In the flowchart of FIG. 14, a scanner reads a print sheet on which relative related information a, document information b, and sound information e described in a two-dimensional barcode are described (step S601) and displays the screen (step S601). Step S602). The sound information to be copied is selected (step S603), and the copy destination of the sound information is specified (step S603).
604). A region copy of sound information is executed or canceled by the region copy function (step S605). In the case of cancellation, the display returns to the original display screen in step S602, and in the case of execution, the sound information is copied to the designated area (step S606). The content of the relative related information is added with the area copying of the sound information (step S607).

Here, steps S606 to S6
07 will be further described, as shown in FIG.
In the sound information e1 managed on the underline below the document information b1 (A), the same document or another document b2
If the same sound information is required under (B), the sound information e1 to be copied is selected, and the copy destination is designated.
Is copied, and the Y direction of the sound information line is yb2-A = y
In the e2 and X directions, xb2 = xe2, and e1-1
Is added to the relative information. Therefore,
According to the sixth embodiment, when the area to which the sound information is copied is designated and the relative related information is copied by the area copying function, the relative related information is additionally corrected in conjunction therewith, so that it is not necessary to correct the relative related information again.

FIG. 15 is an explanatory diagram showing the sound information enlargement / reduction function of the present invention. The function shown in FIG. 15 shows a process of setting a dot level to be encoded into a two-dimensional barcode in accordance with the resolution of a reading device (scanner). FIG. 16 is a flowchart showing the processing content of the sixth embodiment of the present invention. The enlargement / reduction of the dot level of the sound information represented by the two-dimensional barcode will be described with reference to the flowchart of FIG. 16 and the explanatory diagram of FIG.

In FIG. 16, a print sheet on which relative related information a, document information b, sound information e described in a two-dimensional bar code and the like are described is read by a scanner and displayed on a screen (step S701). The sound information to be enlarged or reduced is selected (step S702), and enlargement or reduction is set (S703). The user operates or cancels the sound information enlargement / reduction function (step S704). In the case of cancellation, the display returns to the original display screen in step S701, and in the case of execution, the selected sound information is enlarged / reduced (step S701).
705). The content of the relative related information is corrected with the enlargement / reduction of the sound information (step S707). As shown in FIG. 15, enlargement / reduction can be set according to the resolution of a reading device (scanner) for 200 dpi or 400 dpi. Therefore, according to the seventh embodiment, by providing the enlargement / reduction function, the dot size of the two-dimensional barcode can be set in accordance with the resolution level of the reading device.

[0043]

According to the present invention, the following effects can be obtained. When performing information editing processing by associating sound information represented by a two-dimensional bar code with information of an information source including document information, image information, graphic information, and the like by relative related information having coordinate information, for example, a display screen When the sound information is moved in the area, the coordinate information of the relative related information is automatically and automatically corrected, so that the editing can be speedily and efficiently performed. Therefore, it is not necessary to set the coordinates of the relative related information again. Also, when sound information represented by a two-dimensional bar code is associated with information described on a plurality of pages, a page number is added to the relative related information and the coordinate information of the page is combined to correct the information. It becomes possible to manage the sound information of the page. Further, when the sound information is copied by the area copying function, the relative related information is additionally corrected in conjunction therewith, so that it is not necessary to set the coordinates of the relative related information again. Further, by providing the enlargement / reduction function, the dot size of the two-dimensional barcode can be set in accordance with the resolution level on the reading device side.

Further, when additionally inserting sound information represented by a two-dimensional bar code between a plurality of sound information represented by a two-dimensional bar code in the information of the information source, the additional insertion of the sound information is performed. Accordingly, the relative information stored in the sound information / relative information storage unit is rearranged, and the coordinate information of the relative information is corrected, so that the information can be easily searched. Further, by picking up only the sound information from the information described on a plurality of pages, editing the information on a print sheet and storing the edited information, it is possible to quickly search for the sound information described on the plurality of pages. In addition, the efficiency of information retrieval is improved by picking up sound information and enabling calling of information related to the sound information. Further, when a plurality of pages are displayed, the related information search of the sound information is simplified.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a basic configuration of the present invention.

FIG. 2 is a block diagram showing an overall configuration according to an embodiment of the present invention.

FIG. 3 is an explanatory diagram showing a sound information area moving function of the present invention.

FIG. 4 is a flowchart illustrating processing contents according to the first embodiment of the present invention.

FIG. 5 is an explanatory diagram showing a sound information insertion function of the present invention.

FIG. 6 is a flowchart showing processing contents according to a second embodiment of the present invention.

FIG. 7 is an explanatory diagram showing a function of adding page information of relative relation information according to the present invention.

FIG. 8 is a flowchart illustrating processing contents according to a third embodiment of the present invention.

FIG. 9 is an explanatory diagram showing a sound information storage function of the present invention.

FIG. 10 is a flowchart showing processing contents of Embodiment 4 of the present invention.

FIG. 11 is an explanatory diagram showing a function of calling out sound information and information related to the sound information according to the present invention.

FIG. 12 is a flowchart showing processing contents of Embodiment 5 of the present invention.

FIG. 13 is an explanatory diagram showing a sound information area copying function of the present invention.

FIG. 14 is a flowchart showing the processing content of Embodiment 6 of the present invention.

FIG. 15 is an explanatory diagram showing a function of enlarging / reducing sound information according to the present invention.

FIG. 16 is a flowchart showing the processing content of Embodiment 6 of the present invention.

[Explanation of symbols]

 Reference Signs List 1 pen 2-1 tablet 2-2 display device 3 coordinate detection circuit 4 barcode data output control circuit 5 keyboard 6 cursor position control circuit 7 designated area search circuit 8 barcode conversion circuit 9 barcode restoration circuit 10 signal switching control circuit 11 -1 Microphone (MC) 11-2 Speaker (SP) 12-1 A / D converter 12-2 D / A converter 13 Print sheet feeder 14 Scanner 15 Feeder control circuit 16 Barcode data range determination circuit 17 Input / output information Control circuit 18 RAM 19 printing device 19a print data 20 area moving function circuit 21 relative related information coordinate system automatic correction circuit 22 insertion function circuit 23 relative related information automatic alignment function circuit 24 area copying function circuit 25 enlargement / reduction function circuit 26 main control apparatus

────────────────────────────────────────────────── ─── Continued on the front page (58) Fields investigated (Int. Cl. ⁷ , DB name) G06T 11/80 G06F 3/16 340 G10L 13/00 G06K 19/06 JICST file (JOIS) Patent file (PATOLIS)

Claims (7)

(57) [Claims] 1. An information processing means for inputting / outputting an information source composed of document information, image information, graphic information, and the like; a sound information inputting means for inputting sound information to be added to the information source; Encoding means for encoding the sound information into the two-dimensional bar code; relative information having coordinate information for associating the encoded sound information with the information of the information source; and sound information / relative information storing the sound information. Information storage means;
Calling means for calling sound information and relative related information from sound information / relative related information storage means, reproducing means for reproducing the called sound information, and information of the information source and encoded sound information mixed together In an information processing apparatus having display means for displaying on a screen or printing means for printing on a print sheet, coordinate indicating means for indicating coordinates of sound information represented by a two-dimensional bar code, and moving the specified sound information Area specifying means for specifying an area to be moved; area moving means for moving sound information to a specified area; and relative related information stored in the sound information / relative related information storage means with the movement of the sound information area. An information processing apparatus with a sound information adding function, comprising: a relative relation information correcting means for correcting the coordinate information of the information. 2. The relative related information correcting means further comprises a page number adding means for adding a page number to the relative related information, wherein sound information represented by a two-dimensional bar code is associated with information described on a plurality of pages. 2. The method according to claim 1, further comprising: adding a page number to the relative related information and correcting the relative information by combining the coordinate information of the page.
Information processing device with sound information addition function described. 3. The apparatus according to claim 1, further comprising an area copying unit for copying the sound information designated by the area designating unit, wherein the relative related information correcting unit adds the relative related information and copies the coordinate information thereof in accordance with the area copying of the sound information. 2. The information processing apparatus according to claim 1, wherein the information is corrected. 4. An apparatus according to claim 1, further comprising: an enlargement / reduction means for enlarging / reducing the dot size of the sound information designated by said area designating means, wherein said relative relation information correcting means includes a relative relation information associated with the enlargement / reduction of the sound information. 2. The information processing apparatus according to claim 1, wherein the coordinate information is corrected. 5. An information processing means for inputting and outputting an information source composed of document information, image information, graphic information, and the like; a sound information inputting means for inputting sound information to be added to said information source; Encoding means for encoding the sound information into the two-dimensional bar code; relative information having coordinate information for associating the encoded sound information with the information of the information source; and sound information / relative information storing the sound information. Information storage means;
Calling means for calling sound information and relative related information from sound information / relative related information storage means, reproducing means for reproducing the called sound information, and information of the information source and encoded sound information mixed together In an information processing apparatus provided with a display unit for displaying on a screen or a printing unit for printing on a print sheet, an area designating unit for designating an area into which sound information is additionally inserted, and a two-dimensional barcode in the information of the information source. Additional insertion means for additionally inserting sound information described by a two-dimensional bar code between a plurality of written sound information; area moving means for moving sound information in accordance with the additional insertion of the sound information; Aligning means for rearranging the relative related information, and relative information correcting means for correcting coordinate information of the relative related information stored in the sound information / relative related information storage means with the additional insertion of the sound information. An information processing apparatus with a sound information adding function, comprising: a corrector. 6. An information processing means for inputting and outputting an information source composed of document information, image information, graphic information, and the like; a sound information inputting means for inputting sound information to be added to the information source; Encoding means for encoding the sound information into the two-dimensional bar code; relative information having coordinate information for associating the encoded sound information with the information of the information source; and sound information / relative information storing the sound information. Information storage means;
Calling means for calling sound information and relative related information from sound information / relative related information storage means, reproducing means for reproducing the called sound information, and information of the information source and encoded sound information mixed together In an information processing apparatus having display means for displaying on a screen or printing means for printing on a print sheet, an information source consisting of document information, image information, graphic information, etc. described on a plurality of pages is represented by a two-dimensional barcode. Reading means for optically reading the read sound information; all information storage means for storing all the read information; search instruction means for instructing to search only the sound information among all the stored information; Sound information searching means for searching the whole sound information based on the information and outputting the sound information to a printing means, wherein the printing means arranges the searched sound information and prints it on a print sheet. Information processing device with information addition function. 7. A sound information selecting means for selecting said sound information, and said calling means further comprises a function of calling related information on a display screen from relative relative information corresponding to the selected sound information. The information processing apparatus with a sound information adding function according to claim 6.