JP2012008952A - Information processing device, information processing system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To specify the position on an electronic document corresponding to a postscript position on a recording medium even if the layout of the electronic document is changed when forming an image of the electronic document on the recording medium and the postscript is added on the recording medium.SOLUTION: On a paper document DA, an image of the electronic document indicated by document data D and code images of plural rows and plural columns in each of which the corresponding coordinate on the paper is encoded are formed. A pen-type device 30 scans a code image and passes the document ID of the document formed on the paper, information indicating the route of a postscript, and the page number of the paper document DA on which the postscript is added to a postscript application P3. The postscript application P3 specifies the layout when the image of the page in the electronic document is formed on the paper and specifies the page on which the postscript is to be added in the electronic document. Then, the postscript application P3 converts the coordinates of the postscript route on the paper document DA to the coordinates on the electronic document.

Description

  The present invention relates to an information processing apparatus, an information processing system, and a program.

Patent Document 1 discloses a technique for printing electronic data of a document on paper and reflecting characters added to the printed document in the original electronic data. Specifically, the document management system according to Patent Document 1 prints optically readable code symbols on a print medium such as paper in a matrix and prints a document represented by electronic data on the print medium. The code symbol is encoded with identification information unique to the print medium and the surface on which the code symbol is printed, and information indicating the coordinates of the code symbol on the print medium.
The pen-type coordinate input device that performs writing on the print medium obtains the identification information of the print medium and the coordinates of the tip of the print medium by reading and decoding the code symbols on the print medium, and the obtained coordinates are used as the writing trajectory. Store as data. When the information processing apparatus acquires the identification information read by the pen-type coordinate input device, the information processing apparatus displays a document specified by the acquired identification information on the display. Further, when the information processing apparatus acquires the coordinate information read by the pen-type coordinate input device, the information processing apparatus displays a figure drawn based on the coordinate information superimposed on the displayed document, and displays the coordinate information as a figure file. save.
As a technique for forming a code pattern image representing information in a document, for example, there is a technique disclosed in Patent Document 2.

Japanese Patent No. 4224228 JP 2007-179111 A

  The present invention changes the layout of a document when an image of an electronic document is formed on a recording medium, and can specify which position in the electronic document the added position is added to the recording medium. For the purpose.

  An information processing apparatus according to claim 1 of the present invention includes setting information storage means for storing setting information representing a layout of an image of the electronic document when the image of the electronic document is formed on a recording medium, and formation of the image of the electronic document. Output means for instructing an image forming apparatus to form regularly arranged code images including coordinates on the recording medium, and outputting an image of the electronic document and data indicating the code image to the image forming apparatus And information acquisition means for acquiring coordinates representing a path of additional writing made on the recording medium from a writing device that has added information to the recording medium, setting information reading means for reading the setting information from the setting information storage means, A page to be additionally recorded in the electronic document is specified, and the coordinates acquired by the information acquisition unit are displayed on the electronic document based on the setting information read by the setting information reading unit. And a coordinate conversion means for converting coordinates.

  An information processing apparatus according to a second aspect of the present invention is the information processing apparatus according to the first aspect, wherein the setting information storage unit stores a document identifier for identifying the document data and the setting information in association with each other, and The output unit further instructs the image forming apparatus to form the code image including the document identifier and the page number of the recording medium, and the information acquisition unit includes the page number and the additional recording of the recording medium on which the additional recording has been performed. The document identifier of the document formed on the recorded medium is acquired from the writing device additionally recorded on the recording medium, and the setting information reading unit corresponds to the document identifier acquired by the information acquiring unit. The attached setting information is read from the setting information storage unit, and the coordinate conversion unit reads a page to be additionally written in the electronic document. The electronic document is identified based on the setting information read by the information acquisition means and the page number acquired by the information acquisition means, and the coordinates acquired by the information acquisition means are determined based on the setting information read by the setting information reading means. Convert to the above coordinates.

An information processing apparatus according to a third aspect of the present invention is obtained by connecting the coordinates after the conversion by the coordinate conversion means in the page specified by the coordinate conversion means in the configuration according to the first or second aspect. Additional writing means for adding additional lines to the electronic document.
An information processing apparatus according to a fourth aspect of the present invention is the information processing apparatus according to the third aspect, wherein the appending means adds a page to the electronic document when the page specified by the coordinate conversion means does not exist in the electronic document. It has a configuration of adding and adding a line to the added page.
The information processing apparatus according to claim 5 of the present invention is the information processing apparatus according to claim 3 or claim 4, wherein the additional recording means has a range of coordinates taken by the electronic document after the coordinates converted by the coordinate conversion means. If it is outside, a page is added to the electronic document, and a line is added to the added page.

  According to a sixth aspect of the present invention, there is provided an information processing apparatus comprising: forming an image of an electronic document; setting information representing a layout of the image when the electronic document image is formed on a recording medium; and coordinates on the recording medium. Including an output unit that instructs the image forming apparatus to form a regularly arranged code image, and outputs the image of the electronic document and data indicating the code image to the image forming apparatus, and the recording medium Information acquisition means for acquiring coordinates indicating the path of additional writing and the setting information from a writing device that has additionally written to the recording medium, and a page to be additionally written in the electronic document are identified and acquired by the information acquisition means Coordinate conversion means for converting coordinates into coordinates on the electronic document based on the setting information acquired by the information acquisition means.

  An information processing system according to a seventh aspect of the present invention includes a setting information storage unit that stores setting information representing a layout of an image of the electronic document when the image of the electronic document is formed on a recording medium, and formation of the image of the electronic document. Output means for instructing an image forming apparatus to form regularly arranged code images including coordinates on the recording medium, and outputting an image of the electronic document and data indicating the code image to the image forming apparatus And information acquisition means for acquiring coordinates representing a path of additional writing made on the recording medium from a writing device that has added information to the recording medium, setting information reading means for reading the setting information from the setting information storage means, A page to be additionally written in the electronic document is specified, and the coordinates acquired by the information acquisition unit are determined based on the setting information read by the setting information reading unit. An information processing apparatus having coordinate conversion means for converting to upper coordinates, additional recording means for performing additional recording on the recording medium, image acquisition means for acquiring the code image formed on the recording medium, and image acquisition A decoding means for decoding the code image obtained by the means and obtaining coordinates on the recording medium, and a memory for storing the coordinates obtained by the decoding means between the start and end of additional writing by the additional writing means And a writing device having sending means for sending the coordinates stored in the storage means to the information acquisition means.

  According to an eighth aspect of the present invention, there is provided a program for setting information storage means for storing setting information representing a layout of an image when an image of the electronic document is formed on a recording medium, and formation of the image of the electronic document. And an instruction to form a regularly arranged code image including coordinates on the recording medium, and to output an image of the electronic document and data indicating the code image to the image forming apparatus Means, information acquisition means for acquiring coordinates representing the path of additional recording made on the recording medium from a writing device that has additionally written to the recording medium, and setting information reading means for reading the setting information from the setting information storage means The page to be additionally written in the electronic document is specified, and the coordinates acquired by the information acquisition unit are based on the setting information read by the setting information reading unit. Is a program for functioning as a coordinate conversion means for converting the coordinates on serial electronic document.

According to the configuration of the first, second, sixth, and eighth aspects of the present invention, even when an image of an electronic document is formed on a recording medium and the layout of the document is changed and the additional recording is made on the recording medium, the additional writing is performed. It is possible to specify the position in the electronic document.
According to the configuration of the third aspect of the present invention, the line added to the recording medium can be added to the electronic document.
According to the configuration described in claim 4 of the present invention, it is possible to add a line added to the recording medium to the electronic document even if the position added to the recording medium does not exist in the electronic document.
According to the configuration described in claim 5 of the present invention, it is possible to add a line added to the recording medium to the electronic document even if the position of the additional writing on the recording medium is outside the range of coordinates taken by the electronic document.

The figure which showed the whole structure of the system which concerns on one Embodiment of this invention. The figure which showed the hardware constitutions of the information processing apparatus 10. The block diagram of the function implement | achieved by executing an application program. The figure which showed the menu screen displayed on the display part. The figure which showed the content of the setting information table. The figure which showed the layout pattern of the page when there are multiple pages on one sheet of paper. The figure which showed the hardware constitutions of the pen-type apparatus. The figure which showed the setting information memorize | stored in the memory | storage part. The figure for demonstrating operation | movement of the information processing apparatus. The figure which showed the document of document data. The figure which showed the paper document in which the image was formed. The figure which showed the line added by the pen type apparatus. The figure which showed the content of the stroke information. The figure for demonstrating operation | movement of the information processing apparatus. The figure which showed the position added by the pen type apparatus. The figure which showed the state by which the line was added in the document of document data. The figure which showed the layout pattern of the page when there are a plurality of pages on one sheet of paper.

[Embodiment]
(overall structure)
FIG. 1 is a diagram showing an apparatus constituting an information processing system according to an embodiment of the present invention.
In this embodiment, the information processing apparatus 10 is a personal computer, and stores a program for realizing an operating system and an application program. The information processing apparatus 10 communicates with the image forming apparatuses 20A and 20B via a network 40 such as a LAN (Local Area Network). Further, the information processing apparatus 10 has a connector conforming to the USB (Universal Serial Bus) standard, and acquires information from the pen-type apparatus 30 connected to the connector.
The image forming apparatuses 20A and 20B are apparatuses that form an image on a recording medium such as paper by an electrophotographic method. In the present embodiment, the image forming apparatus 20A and the image forming apparatus 20B are different models. The image forming apparatuses 20 and 20 </ b> B communicate with the information processing apparatus 10 via the network 40 and form an image on paper based on information sent from the information processing apparatus 10. In the present embodiment, the image forming apparatuses 20A and 20B form an image on paper by an electrophotographic method, but the method of forming an image is not limited to the electrophotographic method, and is another method. Also good.
The pen-type device 30 is a writing device for additionally writing characters, figures, and the like with ink on the paper on which the image is formed in the image forming apparatuses 20A and 20B. The pen-type device 30 has a function of communicating with the information processing device 10, a function of reading information recorded on paper, storing the read information, a function of transmitting the stored information to the information processing device 10, and the like. Yes.

(Configuration of information processing apparatus 10)
FIG. 2 is a block diagram illustrating a hardware configuration of the information processing apparatus 10. As illustrated in FIG. 2, each unit of the information processing apparatus 10 is connected to the bus 101, and information is exchanged between the units via the bus 101.

In the present embodiment, the display unit 107 includes a liquid crystal display as a display device that displays an image, and displays a menu screen, various messages, images, and the like for operating the information processing apparatus 10. The display device is not limited to a liquid crystal display, and may be another display device such as a display using CRT (Cathode Ray Tube) or EL (electroluminescence).
The operation unit 106 includes a keyboard and a mouse for operating the information processing apparatus 10. When the user operates the keyboard and mouse, various instructions and information are input to the information processing apparatus 10 and various settings are performed.
The communication unit 108 is connected to the network 40 and functions as a communication interface that communicates with other devices connected to the network 40.
In this embodiment, the information acquisition unit 109 includes a connector conforming to the USB standard, and the pen-type device 30 is connected thereto. The information acquisition unit 109 communicates with the pen device 30 according to the USB standard, and acquires information stored in the pen device 30.

In this embodiment, the storage unit 105 includes a hard disk device, a program that causes the information processing apparatus 10 to realize the function of the operating system, and an application program P1 that realizes the function of the word processor (hereinafter abbreviated as word processor application P1). The document data representing the electronic document created by the function of the word processor is stored.
In addition, the storage unit 105 is an application program (hereinafter referred to as an image forming application P2) that realizes a function of causing the image forming apparatuses 20A and 20B to perform image formation of an electronic document, and content added to paper by the pen-type device 30. Is stored in an application program (hereinafter, referred to as a postscript application P3) that realizes a function of adding to the electronic document based on information acquired from the pen-type device 30.
A ROM (Read Only Memory) 103 stores an IPL (Initial Program Loader), and a CPU (Central Processing Unit) 102 reads and executes the IPL stored in the ROM 103. When the IPL is executed, a program for realizing the function of the operating system is read from the storage unit 105 and executed. Further, when a program for realizing the function of the operating system is executed, it becomes possible to execute the word processor application P1, the image forming application P2, the additional recording application P3, and the like.

FIG. 3 is a block diagram showing a configuration of functions realized by the CPU 102 executing various application programs.
When the word processor application P1 is executed and an electronic document is created, document data D representing the electronic document is generated and stored in the storage unit 105. The document data D generated by the word processor application P1 includes a document identifier (hereinafter, document ID) that uniquely identifies the electronic document.

  Further, when an operation for instructing image formation of an electronic document is performed in the word processor application P1, the image formation application P2 is executed, and the output unit P21, the setting information storage unit P22, and the setting information acquisition unit P23 are realized, and image formation is performed. Is transferred from the word processor application P1 to the output unit P21.

  The output unit P21 instructs the image forming apparatuses 20A and 20B to form an image of an electronic document. The output unit P21 displays a menu screen that allows the user to specify an image forming apparatus that forms an image of an electronic document. FIG. 4 is a diagram illustrating this menu screen. The list box B1 is a user interface for designating an image forming apparatus. The user operates the operation unit 106 to operate the list box B1, and designates an image forming apparatus that forms an image of the electronic document. For example, in this embodiment, when designating the image forming apparatus 20A, the user selects the apparatus name “Dev1” from the list box B1, and when designating the image forming apparatus 20B, the user selects the apparatus from the list box B1. Select the name “Dev2”.

When the operation of clicking the “OK” button B2 on the menu screen of FIG. 4 is performed, the output unit P21, the device name selected in the list box B1, and the document ID of the document data D passed from the word processor application P1. To the setting information storage unit P22.
The output unit P21 generates a code image to be formed on paper when setting information (setting information will be described later) is passed from the setting information storage unit P22. The code image according to the present embodiment is an image of a code pattern disclosed in, for example, Japanese Patent Laid-Open No. 2008-9833, and is an image formed in a plurality of rows and a plurality of columns on the entire surface of paper. One code image is composed of a plurality of dots arranged two-dimensionally, and indicates the page number of the paper document on which the code image is arranged, the document ID, and the coordinates on the paper surface on which the code image is arranged. The location information is encoded. Note that the code image is not limited to that disclosed in Japanese Patent Application Laid-Open No. 2008-9833 as long as a plurality of dots are arranged two-dimensionally. For example, Data Matrix, Code One, Maxi Code, Other code images such as QR code may be used. Further, the arrangement of the code image may be other than the matrix form of a plurality of rows and a plurality of columns as long as it is regularly arranged on the entire surface of the paper.
The output unit P21 superimposes the code image on the image represented by the document data in a plurality of rows and multiple columns, and generates image data representing the image on which the code image is superimposed. When the generation of the image data is completed, the output unit P21 sends the generated image data and the setting information passed from the setting information storage unit P22 to the image forming apparatus 20.

  The setting information storage unit P22 has a paper size (horizontal size: PX, vertical size: PY) on which an electronic document image is formed, an image enlargement / reduction ratio (p) when the electronic document image is formed, an electronic document The number of pages (u) of an electronic document per sheet when a plurality of pages of a document are formed on a single sheet of paper, and the electronic when forming a plurality of pages of a document on a single sheet of paper Information representing the layout at the time of image formation such as the layout pattern (t) of each page of the document (hereinafter referred to as setting information) is stored. The setting information storage unit P22 passes the device name passed from the output unit P21 to the setting information acquisition unit P23, and associates the setting information returned from the setting information acquisition unit P23 with the document ID passed from the output unit P21. Store in the storage unit 105. The setting information storage unit P22 passes the stored setting information to the output unit P21.

The setting information acquisition unit P23 has a setting information table in which device names that uniquely identify the image forming apparatuses 20A and 20B are associated with setting information set for the image forming apparatuses 20A and 20B. Upon receiving the device name from the setting information storage unit P22, the setting information acquisition unit P23 passes the setting information associated with the received device name to the setting information storage unit P22.
FIG. 5 is a diagram showing an example of the setting information table. For the device name “Dev1” of the image forming apparatus 20A, the paper size is “A4 (210, 297)”, the image enlargement / reduction ratio is “100%”, and the number of pages per sheet is “2”. ”,“ 1 ”is associated with the layout pattern of the page on one sheet of paper. For the device name “Dev2” of the image forming apparatus 20B, the paper size is “A4 (210, 297)”, the image enlargement / reduction ratio is “100%”, and the number of pages per sheet is as follows. “1” is associated with “-” as a page layout pattern on one sheet of paper.

In the present embodiment, when the number of pages per sheet is “2”, as shown in FIG. 6A, the layout pattern in which the page with the smaller page number is on the left side is “1”. As shown in FIG. 6B, the layout pattern in which the page with the smaller page number is on the right side is “2”. In addition, when forming an image for one page on one sheet, there is no layout pattern as in the case of laying out a plurality of pages into one sheet, so the number of pages per sheet is “1”. Is associated with “-” indicating that there is no layout pattern in the setting information table.
When the number of pages per sheet is “2”, the lower left corner of the paper is the origin of the coordinates of the code image as shown in FIG. 6A, the upper direction from the origin is the x axis, and the origin is Coordinates are determined with the right direction as the y-axis. If the number of pages per sheet is “1”, as shown in FIG. 6C, the upper left corner of the paper is the origin of the coordinates of the code image, the right direction from the origin is the x axis, the origin The coordinates are determined with the downward direction from the y-axis.

Next, functions realized when the postscript application P3 is executed will be described. When the additional recording application P3 is executed, a pen information acquisition unit P31, an additional recording unit P32, a coordinate conversion unit P33, and a setting information reading unit P34 are realized.
The pen information acquisition unit P31 acquires information stored in the pen type device 30. The pen information acquisition unit P31 passes the information acquired via the information acquisition unit 109 to the additional recording unit P32. The information acquired from the pen-type device 30 includes the document ID of the paper document DA on which the image is formed by the image forming devices 20A and 20B and additionally written by the pen-type device 30, and the post-write by the pen-type device 30 in the paper document DA. The page number of the marked page, the coordinate information indicating the line written from when the pen-type device 30 contacts the paper surface until it leaves, and the like are included.
The additional recording unit P32 adds a line added to the paper document DA by the pen-type device 30 to the electronic document of the document data D based on the information passed from the pen information acquisition unit P31.
The coordinate conversion unit P33 converts the coordinates represented by the position information included in the information passed from the additional recording unit P32 into coordinates on the electronic document, and passes the converted coordinates to the additional recording unit P32.
The setting information reading unit P34 receives the document ID passed from the additional writing unit P32, reads the setting information associated with the document ID from the storage unit 105, and passes the read setting information to the additional writing unit P32.

(Configuration of pen-type device 30)
FIG. 7 is a diagram illustrating a hardware configuration of the pen-type device 30.
The control unit 301 includes a microcomputer including a CPU, a ROM, and a RAM, and controls each unit of the pen-type device 30. The core 309 is an example of an additional recording unit that performs additional recording on paper. The core 309 has ink, and supplies ink to the paper from the tip. The pressure sensor 310 is disposed so as to contact the end of the core 309. When the lead 309 contacts the paper document, a force is applied to the pressure sensor 310 from the end of the lead 309. When the pressure sensor 310 detects that a force has been applied, the pressure sensor 310 outputs a signal indicating that the force has been applied to the control unit 301.

In this embodiment, the light emitting unit 302 has a light emitting diode that emits infrared light, and irradiates the surface of the paper document with infrared light. The light emitting unit 302 is connected to the control unit 301, and infrared irradiation / non-irradiation is controlled by the control unit 301.
In the present embodiment, the image acquisition unit 303 includes a CMOS (Complementary Metal Oxide Semiconductor Image Sensor) image sensor and a lens that guides the light emitted from the light emitting unit 302 and reflected from the surface of the paper document to the CMOS image sensor. ing. The CMOS image sensor converts infrared light reflected near the tip of the core 309 and guided by the lens into an electric signal, and outputs a signal representing an image on the surface of the paper document DA to the image processing unit 304.
The image processing unit 304 performs image processing on the image represented by the signal output from the image acquisition unit 303, and detects a code image from the image subjected to the image processing. Further, the image processing unit 304 outputs digital data representing the detected code image to the data processing unit 305.
Here, since the image acquisition unit 303 and the image processing unit 304 acquire the code image from the recording medium, the image acquisition unit 303 and the image processing unit 304 acquire the code image formed on the recording medium. It can be called means.

The data processing unit 305 is an example of a decoding unit that decodes a code image. The data processing unit 305 performs a decoding process on the code image represented by the digital data output from the image processing unit 304, and acquires the document ID, page number, and position information included in the code image. The data processing unit 305 is connected to the control unit 301 and outputs the acquired document ID, page number, and position information to the control unit 301.
The communication unit 306 includes a connector conforming to the USB standard, and is connected to the control unit 301. This connector is connected to the connector of the information acquisition unit 109 of the information processing apparatus 10. The communication unit 306 communicates with the information processing apparatus 10 via a connector in accordance with the USB standard, and sends information output from the control unit 301 to the information processing apparatus 10. That is, the communication unit 306 is an example of a sending unit that sends information to the information processing apparatus 10.
The nonvolatile memory 307 is connected to the control unit 301 and is accessed from the control unit 301. The nonvolatile memory 307 stores the document ID, page number, and position information sent from the control unit 301.
The power supply unit 308 includes a secondary battery and supplies power to each unit of the pen-type device 30.

(Operation of the embodiment)
Next, the operation of this embodiment will be described. In the following description, the operation when the image of the document data D and the code image are formed on the paper will be described first, and then the paper document DA on which the image of the document data D is formed with the pen-type device 30. After describing the operation when additional writing is performed, the operation when adding the content added to the paper document DA to the electronic document will be described.

(Operation when forming an image on paper)
When an operation for instructing the execution of the word processor application P1 is performed on the operation unit 106, the CPU 102 executes the word processor application P1 so that an electronic document can be created. Here, the user operates the operation unit 106 to create a vertically placed electronic document having a paper size of, for example, A4 size by the function of the word processor. When the user performs an operation to save the created electronic document, document data D representing the created electronic document is generated and stored in the storage unit 105. Here, the document data D has a document ID that uniquely identifies the electronic document.

Next, when an operation for instructing image formation of the electronic document created by the user is performed on the operation unit 106, the image formation application P2 is executed, and the document data D of the electronic document instructed to form the image is output from the word processor application P1. To part P21. 4 is displayed on the display unit 107 by the output unit P21. Here, when the operation unit 106 is clicked on the “OK” button B2 while “Dev1” is selected as the device name, the selected device name and the document ID of the document data D are set. The information is transferred to the information storage unit P22 (FIG. 9: Step S1).
The setting information storage unit P22 passes the device name passed from the output unit P21 to the setting information acquisition unit P23 (step S2). Upon receiving the device name from the setting information storage unit P22, the setting information acquisition unit P23 passes the setting information associated with the received device name to the setting information storage unit P22. If the device name is “Dev1”, the setting information (size “A4”, enlargement / reduction ratio “100%”, number of pages per sheet of paper) associated with the device name “Dev1” in FIG. “2”, page layout pattern “1”) is transferred to the setting information storage unit P22 (step S3).

  Upon receiving the setting information from the setting information acquisition unit P23, the setting information storage unit P22 associates the document ID of the document data D with the received setting information and stores them in the storage unit 105 as shown in FIG. Step S4). The setting information storage unit P22 passes the stored setting information to the output unit P21 (step S5). Further, when the setting information is transferred from the setting information storage unit P22, the output unit P21 generates a code image to be formed on the paper. The output unit P21 superimposes the code image on the entire image represented by the document data D so that the plurality of code images are arranged in a plurality of rows and a plurality of columns, and represents an image on which the code image is superimposed. Data is generated (step S6). When the generation of the image data is completed, the output unit P21 sends the generated image data and the setting information passed from the setting information storage unit P22 to the image forming apparatus 20A (Step S7).

  When receiving the image data and the setting information, the image forming apparatus 20 forms an image on the paper based on the received image data and the setting information (step S8). Here, in the electronic document of the document data D, when the first to fourth pages have the contents shown in FIG. 10, the setting information is the size “A4”, the enlargement / reduction ratio “100%”, and one sheet of paper. Since the number of pages per page is “2” and the page layout pattern is “1”, the images of the first and second pages of the electronic document are formed on the first page of the paper document as shown in FIG. Images of the third and fourth pages of the electronic document are formed on the second page of the document. Although not shown in FIG. 11, the code image is formed with black toner on the entire surface of the paper document DA. Also, “1” is encoded as the page number in the code image of the first page of the paper document DA, and “2” is encoded as the page number of the code image of the second page of the paper document DA.

(Operation when adding a paper document with the pen-type device 30)
Next, an operation when the user performs additional writing on the paper document DA with the pen-type device 30 will be described. The user performs additional writing with the pen-type device 30 on the paper document DA on which the code image and the image of the electronic document are formed. Specifically, when the user brings the leading end of the lead 309 into contact with the paper document DA, a force is applied to the pressure sensor 310 from the end of the lead 309, and a signal indicating that the force has been applied is sent from the pressure sensor 310 to the control unit 301. Is output. When this signal is input, the control unit 301 turns on the light emitting diode of the light emitting unit 302. The light from the light emitting unit 302 is reflected by the surface of the paper document DA and enters the image acquisition unit 303. In the image acquisition unit 303, the light reflected by the paper document DA is guided to the CMOS image sensor by the lens, and a code image near the tip of the core 309 in the paper document DA is formed on the CMOS image sensor. The CMOS image sensor converts the formed image into an electrical signal at a predetermined cycle, and outputs a signal representing the formed image to the image processing unit 304.

The image processing unit 304 performs image processing on the image represented by the signal output from the image acquisition unit 303 to detect a code image. Further, the image processing unit 304 outputs digital data representing the detected code image to the data processing unit 305. The data processing unit 305 performs decoding processing on the image represented by the digital data output from the image processing unit 304, and decodes the document ID (12345), page number, and position information included in the image.
For example, when the leading end of the core 309 is located at the position shown in FIG. 12A in the paper document DA, the position information of the coordinates (x1, y1) of the code image near this position is decoded. Further, since the position where the tip of the pen-type device 30 is located is the first page of the paper document, “1” is decoded as the page number. The document ID, page number, and position information decoded by the data processing unit 305 are sent to the control unit 301 and stored in the RAM.
Thereafter, when the user moves the pen-type device 30 while keeping the tip of the lead 309 in contact with the paper, the ink is added to the paper document DA by the ink of the lead 309. Further, the code image formed on the CMOS image sensor during the movement is decoded, the position information and the page number included in the code image are acquired, and the position information and the page number are sequentially stored in the RAM. That is, when the pen-type device 30 moves on the paper surface and its coordinates change as (x2, y2), (x3, y3), (x4, y4) as shown in FIG. Position information indicating the coordinates is sequentially stored in the RAM.

Next, when the user moves the leading end of the lead 309 away from the paper document DA, no force is applied to the pressure sensor 310 from the end of the lead 309, and no signal is output from the pressure sensor 310 to the control unit 301. When no signal is input from the pressure sensor 310, the control unit 301 turns off the light emitting diode of the light emitting unit 302. The control unit 301 stores position information (information indicating a path of additional writing) ((x1, y1) to (x4, y4)) stored in the RAM from when input of a signal from the pressure sensor 310 is started until it is ended. The document ID (12345) and the page number (1) are stored in the nonvolatile memory 307 as information (hereinafter referred to as stroke information) indicating a line added by the pen-type device 30.
FIG. 13 is a diagram illustrating the content of stroke information stored by one stroke operation of the pen-type device 30. The stroke information is text data, and a document ID is described between the <documentID> tag and the </ documentID> tag. In addition, between the <pageNum> tag and the </ pageNum> tag, the page number of the added paper document is described. Further, between the <position> tag and the </ position> tag, the position information stored in the RAM is described in the order stored in the RAM.

  The user repeats the operation of moving the lead 309 by contacting the paper document DA again when performing additional writing on the paper. In the pen-type device 30, stroke information is stored in the non-volatile memory 307 every time a stroke operation is completed.

(Operation when adding contents added to paper document to document data)
Next, an operation when the contents written on the paper document DA by the pen-type device 30 are added to the electronic document will be described.
When the user finishes appending to the paper document DA, the user connects the connector of the communication unit 306 to the connector of the information acquisition unit 109. Next, when the user performs an operation to instruct execution of the additional recording application P3 on the operation unit 106, the CPU 102 executes the additional recording application P3, and reads the pen information acquisition unit P31, the additional recording unit P32, the coordinate conversion unit P33, and the setting information reading. Part P34 is realized.

The pen information acquisition unit P31 requests stroke information from the pen type device 30 (FIG. 14: step S11). When the pen-type device 30 is requested for the stroke information, the control unit 301 reads the stroke information stored in the nonvolatile memory 307 and transmits it to the information acquisition unit 109 (step S12). The pen information acquisition unit P31 receives the stroke information transmitted from the pen-type device 30, and passes the received stroke information to the additional recording unit P32 (step S13).
The appending part P32 extracts the document ID included in the stroke information, and passes the extracted document ID to the setting information reading part P34 (step S14). The setting information reading unit P34 reads the setting information stored in association with the transferred document ID from the storage unit 105, and passes the read setting information to the additional writing unit P32 (step S15). For example, if the document ID passed from the appending part P32 to the setting information reading part P34 is “12345”, the setting information (size “A4” associated with the document ID “12345” as shown in FIG. (210, 297) ”, the enlargement / reduction ratio“ 100% ”, the number of pages per sheet“ 2 ”, and the page layout pattern“ 1 ”) are passed to the additional recording section P32.

  Next, the additional recording part P32 passes the setting information and the stroke information to the coordinate conversion part P33. If there is a plurality of stroke information, the stroke information is sequentially transferred to the coordinate conversion unit P33 (step S16). The coordinate conversion unit P33 converts the position information included in the passed stroke information into coordinates on the electronic document of the document data D (step S17). Specifically, the position information included in the stroke information is converted into coordinates on the electronic document based on the following calculation formula. In the following description, X is the horizontal coordinate after conversion, Y is the vertical coordinate, n is the page number of the added paper document, and N is the page number to be added in the document data D. Yes.

  For example, if u = 1 in the setting information, N = n. Further, X = x * 100 / p and Y = y * 100 / p. That is, when the number of pages per sheet (u) is one page and the enlargement / reduction ratio (p) is 100%, when additional writing is performed at the position shown in FIG. 15, p = 100%. , (X1, y1) is obtained by converting the coordinates (X1, Y1), X1 = x1 * 100/100 = x1, and Y1 = y1 * 100/100 = y1. Further, (x2, y2) is X2 = x2 * 100/100 = x2, and Y2 = y2 * 100/100 = y2.

For example, when u = 2 and t = 1 and y is PY / 2 or less, X = y * 1.4142, Y = (PX−x) * 1.4142, N = (n−1) * When u + 1 and y exceeds PY / 2, X = (y−PY / 1.4142) * 1.4142, Y = (PX−x) * 1.4142, N = (n−1) * u + 2 To do.
For example, when u = 2 and t = 2 and y is PY / 2 or less, X = y * 1.4142, Y = (PX−x) * 1.4142, N = (n−1) * When u + 2 and y exceeds PY / 2, X = (y−PY / 1.4142) * 1.4142, Y = (PX−x) * 1.4142, N = (n−1) * u + 1 To do. When the enlargement / reduction ratio is other than 100%, the converted coordinates are multiplied by 100 / p.

For example, from the stroke information shown in FIG. 13, the order of (x1, y1), (x2, y2) (x3, y3) (x4, y4), that is, the pen-type device 30 has moved on the paper document DA. Sometimes the position information is extracted in the order of the decoded position information. Also, the setting information when the paper document of FIG. 11 is output is PX = 210, PY = 297, p = 100%, u = 2, and t = 1.
For this reason, for the (x1, y1) where the y coordinate of the extracted position information is PY / 2 or less, the coordinate X1 after conversion is calculated as X1 = y1 * 1.4142. Further, the coordinate Y1 after conversion is calculated by Y1 = (PX−x1) * 1.4142. Further, the page to be additionally written based on the coordinates (X1, Y1) is calculated by N = (n−1) * u + 1, and n = 1 and u = 2, so N = 1.

  When the coordinate conversion is completed for the position information (x1, y1) to (x4, y4) extracted from the stroke information, the coordinate conversion unit P33 adds the coordinates (X1, Y1) to (X4, Y4) after conversion. The page number N = 1 is transferred to the additional recording part P32 (step S18). When the postscript part P32 receives the coordinates after conversion and the page number to be postscripted, the postscript part P32 sets the received coordinates in the order of (X1, Y1), (X2, Y2), (X3, Y3), (X4, Y4). An image of the line connected to is generated (step S19). Then, since the page number N passed from the coordinate conversion unit P33, that is, the page number to which the image of this line is added is 1, the generated image is added to the first page of the electronic document (step S20). As a result, a line added by the user to the paper document DA is added to the electronic document of the document data D as shown in FIG.

  As described above, according to the present embodiment, when an image of an electronic document is formed on paper, the layout is changed, and when the pen type device 30 is added to the paper, the page with the line added is identified and added. Since the added line is added to the specified page, the contents of the additional writing can be reflected in the document data.

[Modification]
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. For example, the present invention may be implemented by modifying the above-described embodiment as follows. In addition, you may combine each of embodiment mentioned above and the following modifications.

  In the embodiment described above, the information processing apparatus 10 and the pen-type apparatus 30 communicate according to the USB standard. However, information is exchanged between the information processing apparatus 10 and the pen-type apparatus 30 by wireless communication. It may be. In addition, as long as information can be exchanged, the communication is not limited to the USB standard, and may be performed via a cable according to another standard.

  In the above-described embodiment, the image forming application P2 and the postscript application P3 are separate application programs. However, the output unit P21, the setting information storage unit P22, and the setting information are set by one application program having both functions. You may make it implement | achieve the acquisition part P23, the pen information acquisition part P31, the additional recording part P32, the coordinate transformation part P33, and the setting information reading part P34.

In the embodiment described above, an example in which an image for two pages is formed on one sheet of paper has been described, but an image for four pages may be formed on one sheet of paper. FIG. 17 is a diagram illustrating a layout pattern when images for four pages are formed on one sheet of paper.
In the setting information, when u = 4 and t = 1, x is PX / 2 or less and y is PY / 2 or less, the coordinate conversion unit P33 has X = x * 2, Y = y * 2, N = ( n-1) * u + 1. When u = 4, t = 1, x exceeds PX / 2 and y is equal to or less than PY / 2, the coordinate conversion unit P33 determines that X = (x−PX / 2) * 2, Y = y. * 2, N = (n-1) * u + 2. When u = 4, t = 1, x is less than or equal to PX / 2, and y exceeds PY / 2, the coordinate conversion unit P33 determines that X = x * 2, Y = (y−PY / 2). ) * 2, N = (n-1) * u + 3. When u = 4, t = 1, x exceeds PX / 2, and y exceeds PY / 2, the coordinate conversion unit P33 determines that X = (x−PX / 2) * 2, Y = (Y−PY / 2) * 2 and N = (n−1) * u + 4.

  When u = 4 and t = 2 in the setting information, x is PX / 2 or less and y is PY / 2 or less, the coordinate conversion unit P33 determines that X = x * 2, Y = y * 2, N = (N-1) * u + 1. When u = 4, t = 2, x exceeds PX / 2, and y is equal to or less than PY / 2, the coordinate conversion unit P33 determines that X = (x−PX / 2) * 2, Y = y. * 2, N = (n-1) * u + 3. When u = 4, t = 2, x is less than or equal to PX / 2, and y is greater than PY / 2, the coordinate conversion unit P33 determines that X = x * 2, y = (y−PY / 2). ) * 2, N = (n-1) * u + 2. When u = 4, t = 2, x exceeds PX / 2, and y exceeds PY / 2, the coordinate conversion unit P33 determines that X = (x−PX / 2) * 2, y = (Y−PY / 2) * 2 and N = (n−1) * u + 4.

  When u = 4 and t = 3 in the setting information, x is PX / 2 or less and y is PY / 2 or less, the coordinate conversion unit P33 determines that X = x * 2, y = y * 2, N = (N-1) * u + 2. If u = 4, t = 3, x exceeds PX / 2 and y is PY / 2 or less, the coordinate conversion unit P33 determines that X = (x−PX / 2) * 2, y = y. * 2, N = (n-1) * u + 1. If u = 4, t = 3, x is less than or equal to PX / 2 and y exceeds PY / 2, the coordinate conversion unit P33 determines that X = x * 2, y = (y−PY / 2). ) * 2, N = (n-1) * u + 4. When u = 4 and t = 3, x exceeds PX / 2 and y exceeds PY / 2, the coordinate conversion unit P33 determines that X = (x−PX / 2) * 2, y = (Y−PY / 2) * 2 and N = (n−1) * u + 3.

  Further, in the setting information, when u = 4 and t = 4, x is PX / 2 or less and y is PY / 2 or less, the coordinate conversion unit P33 determines that X = x * 2, y = y * 2, N = (N-1) * u + 3. In the setting information, when u = 4 and t = 4, x exceeds PX / 2 and y is equal to or less than PY / 2, the coordinate conversion unit P33 determines that X = (x−PX / 2) * 2, It is assumed that y = y * 2 and N = (n−1) * u + 1. In the setting information, when u = 4 and t = 4, x is less than or equal to PX / 2 and y is greater than PY / 2, the coordinate conversion unit P33 determines that X = x * 2, y = (y− PY / 2) * 2, N = (n-1) * u + 4. If u = 4 and t = 4 in the setting information, x exceeds PX / 2 and y exceeds PY / 2, the coordinate conversion unit P33 determines that X = (x−PX / 2) *. 2, y = (y−PY / 2) * 2 and N = (n−1) * u + 2.

In the embodiment described above, the setting information is stored in the storage unit 105, but the setting information when the image of the document data D is formed may be encoded into a code image.
In this configuration, the data processing unit 305 performs a decoding process on the code image represented by the digital data output from the image processing unit 304, and decodes the setting information included in the code image. Further, the pen-type device 30 includes the decoded setting information in the stroke information and sends it to the information processing device 10. According to this configuration, it is not necessary to store setting information in the storage unit 105.

  In the above-described embodiment, the document ID and the setting information are stored in association with each other. However, if an electronic document formed with an image is specified, only the document ID is stored in association with the setting information. Is not to be done. For example, the path of the document data D may be stored in association with the setting information as a document identifier for uniquely identifying the electronic document, and the path of the document data D may be encoded in the code image.

In the above-described embodiment, the electronic document is created on the assumption that the image is formed with the paper placed vertically, but the electronic document may be formed with the paper placed horizontally. In this case, the coordinates of the position information are converted by appropriately changing the calculation formula described above.
In the embodiment described above, when the image is reduced and position designation such as left justification, right justification, and centering is performed on the reduced image, information representing this position may be included in the setting information. Further, in this case, the coordinates of the position information are converted by appropriately changing the above-described calculation formula in accordance with the position designation content.
Further, when the image is reduced and formed on the paper, the pen-type device 30 may additionally write the margin portion. In this case, the coordinates converted by the coordinate conversion unit P33 are outside the range of the coordinates of the electronic document of the document data D and cannot be reflected in the electronic document.
In this way, additional writing that falls outside the coordinate range of the electronic document may not be reflected in the electronic document. Further, a new page may be added to the electronic document, and additional writing outside the coordinate range of the electronic document may be reflected on the added page.

When forming an image of two pages of an electronic document on one sheet of paper, for example, when forming an image of a three-page electronic document, the first and second pages of the electronic document are printed on the first page of the paper document. An image of the eye is formed, an image of the third page of the electronic document is formed on the second page of the paper document, and half of the second page of the paper document is blank.
Here, when the pen-type device 30 is added to a blank part on the second page of the paper document, the fourth page is generated in the electronic document, and the contents added to the blank part are added. You may make it reflect in the 4th page of an electronic document. Note that if the pen-type device 30 is added to the blank part of the second page of the paper document, the added content is not reflected in the electronic document without adding the fourth page to the electronic document. It may be.

  In the embodiment described above, when there are a plurality of layout patterns, the setting information is stored including the layout pattern. However, when the number of layout patterns is limited to one, the layout pattern may not be stored.

  The above-described application program includes a magnetic recording medium (magnetic tape, magnetic disk (HDD (Hard Disk Drive), FD (Flexible Disk)), etc.), optical recording medium (optical disc (CD (Compact Disc), DVD (Digital Versatile Disk)). Or the like), and may be provided in a state of being stored in a computer-readable recording medium such as a magneto-optical recording medium or a semiconductor memory and installed in the information processing apparatus 10. Further, the application program may be downloaded and installed via the network 40.

In the embodiment described above, the coordinate conversion unit P33 converts the coordinates of the position information included in the code image into the coordinates on the electronic document, and the line image obtained by connecting the converted coordinates is converted into the electronic document. In addition, the method of adding a line added to the paper document by the user to the electronic document is not limited to the method of the above-described embodiment.
For example, the postscript application P3 generates an image of a line added by the user by sequentially connecting the coordinates of the position information extracted from the stroke information. Next, the postscript application P3 performs affine transformation on the generated image based on the setting information, enlarges / reduces and moves the generated image, and adds the image after the affine transformation to the electronic document. Even in such a method, the content added by the user to the paper document can be added to the electronic document.

  In the embodiment described above, the document ID is included in the code image, but the document ID may not be included in the code image. In this case, when the document ID is printed on a paper document and setting information corresponding to the document ID is read, the user operates the operation unit 106 to input the document ID, and stores the document ID in association with the input document ID. The set information may be read out. As for the page number, if an image is formed on a single sheet of paper when an image of an electronic document is formed, the page number may not be included in the code image.

DESCRIPTION OF SYMBOLS 10 ... Information processing apparatus, 20A, 20B ... Image forming apparatus, 30 ... Pen type apparatus, 40 ... Network, 101 ... Bus, 102 ... CPU, 103 ... ROM, 104 ... RAM, 105 ... Storage part, 106 ... Operation part, DESCRIPTION OF SYMBOLS 107 ... Display part, 108 ... Communication part, 109 ... Information acquisition part, P1 ... Word processor application, P2 ... Image formation application, P3 ... Additional writing application, P21 ... Output part, P22 ... Setting information storage part, P23 ... Setting information acquisition part P31 ... Pen information acquisition unit, P32 ... Additional writing unit, P33 ... Coordinate conversion unit, P34 ... Setting information reading unit, 301 ... Control unit, 302 ... Light emitting unit, 303 ... Image acquisition unit, 304 ... Image processing unit, 305 ... Data processing unit, 306 ... communication unit, 307 ... nonvolatile memory, 308 ... power supply unit, 309 ... core

Claims (8)

Setting information storage means for storing setting information representing the layout of the image when the image of the electronic document is formed on the recording medium;
The image forming apparatus is instructed to form an image of the electronic document and a regularly arranged code image including coordinates on the recording medium, and the image of the electronic document and the data indicating the code image are Output means for outputting to the image forming apparatus;
Information acquisition means for acquiring coordinates representing a path of additional recording made on the recording medium from a writing device that has additionally written on the recording medium;
Setting information reading means for reading the setting information from the setting information storage means;
A coordinate conversion unit that identifies a page to be additionally recorded in the electronic document and converts the coordinates acquired by the information acquisition unit into coordinates on the electronic document based on the setting information read by the setting information reading unit; An information processing apparatus. The setting information storage means stores a document identifier for identifying the document data in association with the setting information;
The output means further instructs an image forming apparatus to form the code image including the document identifier and a page number of the recording medium,
The information acquisition means acquires the page number of the recording medium to which the information has been added and the document identifier of the document formed on the recording medium to which the information has been added from the writing device that has added information to the recording medium. ,
The setting information reading unit reads the setting information associated with the document identifier acquired by the information acquiring unit from the setting information storage unit;
The coordinate conversion unit specifies a page to be added to the electronic document based on the setting information read by the setting information reading unit and the page number acquired by the information acquisition unit, and the information acquisition unit acquires the page. The information processing apparatus according to claim 1, wherein the coordinate information is converted into a coordinate on the electronic document based on the setting information read by the setting information reading unit. 3. The recording apparatus according to claim 1, further comprising: an appending unit that appends a line obtained by connecting coordinates after conversion by the coordinate conversion unit to the electronic document on the page specified by the coordinate conversion unit. The information processing apparatus described. The said additional recording means adds a page to the said electronic document, and adds a line to the added page, when the page specified by the said coordinate conversion means does not exist in the said electronic document. Information processing device. The additional recording means adds a page to the electronic document and adds a line to the added page when the coordinate converted by the coordinate conversion means is outside the range of coordinates taken by the electronic document. The information processing apparatus according to claim 3 or 4. Formation of an image of an electronic document, and formation of a regularly arranged code image including setting information indicating a layout of the image when the image of the electronic document is formed on a recording medium and coordinates on the recording medium An output means for instructing the image forming apparatus and outputting data indicating the image of the electronic document and the code image to the image forming apparatus;
Information acquisition means for acquiring coordinates indicating the path of additional recording made on the recording medium and the setting information from a writing device that has additionally recorded the recording medium;
A coordinate conversion unit that identifies a page to be additionally recorded in the electronic document and converts the coordinates acquired by the information acquisition unit into coordinates on the electronic document based on the setting information acquired by the information acquisition unit; Information processing apparatus. Setting information storage means for storing setting information representing the layout of the image when the image of the electronic document is formed on the recording medium;
The image forming apparatus is instructed to form an image of the electronic document and a regularly arranged code image including coordinates on the recording medium, and the image of the electronic document and the data indicating the code image are Output means for outputting to the image forming apparatus;
Information acquisition means for acquiring coordinates representing a path of additional recording made on the recording medium from a writing device that has additionally written on the recording medium;
Setting information reading means for reading the setting information from the setting information storage means;
A coordinate conversion unit that identifies a page to be additionally recorded in the electronic document and converts the coordinates acquired by the information acquisition unit into coordinates on the electronic document based on the setting information read by the setting information reading unit; An information processing apparatus having
Additional recording means for performing additional recording on the recording medium;
Image acquisition means for acquiring the code image formed on the recording medium;
Decoding the code image acquired by the image acquisition means, and acquiring the coordinates on the recording medium;
Storage means for storing the coordinates acquired by the decoding means between the start and end of additional writing by the additional writing means;
Sending means for sending the coordinates stored in the storage means to the information obtaining means;
An information processing system having a writing device. Computer
Setting information storage means for storing setting information representing the layout of the image when the image of the electronic document is formed on the recording medium;
The image forming apparatus is instructed to form an image of the electronic document and a regularly arranged code image including coordinates on the recording medium, and the image of the electronic document and the data indicating the code image are Output means for outputting to the image forming apparatus;
Information acquisition means for acquiring coordinates representing a path of additional recording made on the recording medium from a writing device that has additionally written on the recording medium;
Setting information reading means for reading the setting information from the setting information storage means;
A coordinate conversion unit that identifies a page to be added in the electronic document and converts the coordinates acquired by the information acquisition unit into coordinates on the electronic document based on the setting information read by the setting information reading unit. A program to make it work.

Images