JP2009026121A - Document-processing program, document-processing device, and document-processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide: a document-processing program which can omit a registering operation which correlates written data and recorded data with document identification information and restrains the quantity of sound or video data to be recorded; a document-processing device; and a document-processing system. <P>SOLUTION: In the document-processing system 1, electronic pens 5A-5C which input data written on a document 4 through a writing operation and a voice-inputting device 2 which records voice data are connected to a document-processing server 3 which stores and accumulates document data. Then, the document-processing server 3 functions as: a written data acquisition means which acquires the written data and document identification information from the electronic pens 5A-5C; a recorded data acquisition means which acquires the voice data, which is recorded in synchronization with the writing operation, from among the recorded data inputted from the voice-inputting device 2; a registration means which registers the written data and the voice data in association with the document identification information when it acquires the written data, the document identification information and the voice data; and the like. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a document processing program, a document processing apparatus, and a document processing system.

  2. Description of the Related Art Conventionally, there is known a system that captures voice or the like related to a user's memo as capture information (see, for example, Patent Document 1).

  This system is composed of an information capture device, a memo acquisition device, and a data processing device. The information capture device is composed of a microphone, a camera, and the like, and captures information related to sound and images at the time of presentation. The memo acquisition device acquires the memo written by the user during the presentation together with the time information indicating the time when the memo was written. Then, the data processing device can extract the capture information corresponding to the time when the memo was written by the user from the capture information acquired by the information capture device, and associate the memo by the user with the extracted capture information. .

JP 2004-240968 A

  An object of the present invention is to provide a document processing program, a document processing apparatus, and a document processing system that can omit a registration operation for associating written data and recorded data with document identification information and suppress the amount of recorded or recorded data.

  In order to achieve the above object, an aspect of the present invention provides the following document processing program, document processing apparatus, and document processing system.

[1] Writing data entered on a document by writing operation and writing data acquisition means for acquiring document identification information for identifying the document, recording data for acquiring recording data recorded or recorded in synchronization with the writing operation As acquisition means, and registration means for registering the writing data and the recording data in association with the document identification information of the document when the writing data, the document identification information of the document, and the recording data are acquired. A document processing program for making a computer function.

[2] The document processing program according to [1], wherein the recording data acquisition unit acquires recording data corresponding to a predetermined period before or after the period during which the writing operation is performed.

[3] When the recording data acquisition means receives a predetermined number of start signals indicating the start of the writing operation, starts the recording or recording, and receives a predetermined number of end signals indicating the end of the writing operation; The document processing program according to [1], wherein the recording or the recording is ended.

[4] Written data acquisition means for acquiring written data entered on a document by writing operation and document identification information for identifying the document, and recording for acquiring recorded data recorded or recorded in synchronization with the writing operation Data acquisition means; and registration means for registering the writing data and the recording data in association with the document identification information of the document when the writing data, the document identification information of the document, and the recording data are acquired. A document processing apparatus.

[5] Furthermore, when the recording or recording starts in synchronization with the writing operation, and a primary storage unit that stores the recording data recorded or recorded for a predetermined period before the writing operation is performed, A secondary storage unit that stores the recording data stored in the primary storage unit and stores the recording data until the recording or recording is completed following the stored recording data, and the writing The document processing apparatus according to [4], wherein the data acquisition unit reads and acquires the recording data from the secondary storage unit.

[6] Written data input means for inputting written data entered on a document by a writing operation and document identification information for identifying the document; recording data input means for recording data by recording or recording; Writing data acquisition means for acquiring the writing data and the document identification information from the writing data input means, and recorded data recorded or recorded in synchronization with the writing operation among the recording data input from the recording data input means. Recording data acquisition means to acquire, and when the writing data, the document identification information of the document, and the recording data are acquired, the writing data and the recording data are registered in association with the document identification information of the document A document processing system comprising a document processing apparatus having registration means for performing registration.

  According to the document processing program of the first aspect, the registration operation for associating the writing data and the recording data with the document identification information can be omitted, and the amount of data recorded or recorded can be suppressed.

  According to the document processing program of the second aspect, it is possible to reduce recording data recording or omission of recording.

  According to the document processing program of the third aspect, it is possible to record useful recording data.

  According to the document processing apparatus of the fourth aspect, the registration operation for associating the writing data and the recording data with the document identification information can be omitted, and the amount of data recorded or recorded can be suppressed.

  According to the document processing apparatus of the fifth aspect, it is possible to reduce recording data recording or omission of recording, and to simplify the configuration of the document processing apparatus.

  According to the document processing system of the sixth aspect, the registration operation for associating the writing data and the recording data with the document identification information can be omitted, and the amount of data recorded or recorded can be suppressed.

  FIG. 1 is an overall view showing a schematic configuration example of a document processing system according to an embodiment of the present invention. In this document processing system 1, a voice input device (recording data input means) 2 for recording and inputting voice data (recording data) is connected to a document processing server 3 for storing and storing document data, and further by a writing operation. Electronic pens (writing data input means) 5 </ b> A to 5 </ b> C for inputting writing data entered on the document 4 are connected via a network 10 by wireless communication 11. In FIG. 1, there are three electronic pens 5 </ b> A to 5 </ b> C, but one or two electronic pens may be used, or four or more electronic pens may be used.

  The network 10 is a local area network such as a wired LAN or a wireless LAN. The network 10 may be a network connected to the Internet.

  The voice input device 2 includes a microphone that converts a voice uttered by a speaker into an electrical signal, and a communication circuit that transmits the electrical signal converted by the microphone to the document processing server 3 as voice data. Note that the audio input device 2 may include an imaging circuit that records image data such as a still image or a moving image in addition to the audio data. The voice input device 2 may transmit voice data to the document processing server 3 via the network 10.

(documents)
The document 4 includes a code layer 41 that provides position information on the document 4, a document ID (document identification information) for identifying the document 4 to the electronic pens 5 </ b> A to 5 </ b> C, and ink from the pen tip 510 of the electronic pens 5 </ b> A to 5 </ b> C. And a handwritten layer 40 that can be written by, and has a structure in which the handwritten layer 40 is laminated on the code layer 41.

  The handwriting layer 40 also serves as a protective layer, and is formed of a transparent or translucent resin material that transmits visible light and infrared light, for example, a polyethylene terephthalate (PET) film. Further, document data stored as digital data in the document processing server 3 is printed on the handwriting layer 40 as an image at a predetermined position. Note that the content of the document 4 may be arbitrary, and the document includes, for example, a contract, a specification, a drawing, a table, an illustration, a photograph, and the like.

  The code layer 41 has a pattern in which a plurality of code images, which will be described later, are arranged in a matrix, the pattern portion is formed of a color material that absorbs infrared light, and the portions other than the pattern are infrared light and It is formed from a resin material that transmits visible light, for example, a polyethylene terephthalate (PET) film.

(Electronic pen)
The electronic pens 5 </ b> A to 5 </ b> C include a case main body 500 having substantially the same external shape as a general pen, and a writing pen unit housed in the case main body 500 so that the pen tip 510 is exposed from the tip of the case main body 500. 51, the function of capturing the code image provided in the document 4, the function of reading the code from the code image, the writing data as handwriting by the pen tip 510 from the read code, and the document of the document 4 on which the writing operation has been performed A function of acquiring an ID, a function of transmitting the acquired writing data and the document ID to the document processing server 3 through the wireless communication 11, and the like. These functions will be described later.

  The pen unit 51 has a pen point 510 at the tip, and includes an ink tank on the rear side and a writing pressure detection unit to be described later that detects the writing pressure applied to the pen point 510. The ink can be written on the handwritten layer 40 of the document 4 and can be erased by the erasing member 520. The ink material reflects visible light and transmits infrared light, for example, B manufactured by Tokai Optical Co., Ltd. Type can be used.

(Configuration of document processing server)
FIG. 2 is a block diagram illustrating a schematic configuration example of the document processing server 3. The document processing server 3 includes a storage unit 30 including a ROM, RAM, HDD, and the like that store programs such as the document processing program 300 and various data, and an arithmetic unit including, for example, a CPU that controls each unit of the document processing server 3. 31, a communication unit 32 including a network interface card (NIC) that receives writing data and document ID from the electronic pens 5 </ b> A to 5 </ b> C via the network 10, and a keyboard, a mouse, and the like that receive data input and operation instructions. An operation input unit 33 and a display unit 34 including an LCD (Liquid Crystal Display) or the like for displaying various screens such as processing results obtained by the calculation unit 31 are provided. Such a document processing server 3 can be constituted by, for example, a personal computer (PC), a workstation (WS) or the like in addition to the server.

  The storage unit 30 includes a primary audio buffer (primary storage unit) 301 that stores audio data input from the audio input device 2, and a secondary audio buffer (secondary storage unit) 302. A document database 303 in which voice data and writing data are registered in association with each other is stored. Details of the document database 303 will be described later.

  The primary voice buffer 301 stores the voice data recorded by the voice input device 2 for a predetermined period before the writing operation is performed by the electronic pens 5A to 5C, discards the old voice data, and updates the latest voice at any time. I remember the data.

  The secondary audio buffer 302 stores the audio data stored in the primary audio buffer 301 when the arithmetic unit 31 starts recording audio data in synchronization with the writing operation of the electronic pens 5A to 5C. Following the audio data, the recorded audio data is stored until the calculation unit 31 finishes recording.

  The calculation unit 31 functions as a writing data acquisition unit 310, a recording data acquisition unit 311, a registration unit 312 and the like by operating according to the document processing program 300.

  The writing data acquisition unit 310 specifies the writing data and document ID acquired by the electronic pens 5A to 5C, the writing data ID for specifying the writing data, and the user who uses the electronic pens 5A to 5C. Obtain a user ID. The writing data ID may be issued by the writing data acquisition unit 310 when the writing data is acquired. The writing data acquisition unit 310 receives a writing start signal (start signal) and a writing end signal (end signal) transmitted from the electronic pens 5 </ b> A to 5 </ b> C and sends them to the recording data acquisition unit 311.

  When the recording data acquisition unit 311 receives a predetermined number of writing start signals from the writing data acquisition unit 310, the recording data acquisition unit 311 starts recording audio data and copies the audio data stored in the primary audio buffer 301 to the secondary audio buffer 302. Alternatively, the data is transferred and the subsequent sound is recorded continuously in the secondary sound buffer 302. When the recording data acquisition unit 311 receives a predetermined number of writing end signals from the writing data acquisition unit 310, the recording data acquisition unit 311 ends the recording of the audio data, and reads out and acquires the audio data from the secondary audio buffer 302.

  The recording of the voice data may be terminated when the voice from the voice input device 2 is interrupted for a predetermined time or when a predetermined time has elapsed after receiving a predetermined number of end signals. However, it is not limited to them.

  When the registration unit 312 acquires the writing data and the document ID by the writing data acquisition unit 310 and acquires the voice data by the recording data acquisition unit 311, the registration unit 312 associates the writing data and the voice data with the document ID, and the document database 303. Register with. Regardless of the timing and order of registration, the registration unit 312 may register the written data and the voice data recorded in synchronization with the written data in association with the document ID. For example, the registration unit 312 may register the writing data, the document ID, and the voice data when the writing data, the document ID, and the voice data are acquired. When the writing data and the document ID are acquired, the registration unit 312 registers them first, and then acquires the voice data. Sometimes, the audio data may be registered in association with the previously acquired document ID.

  Here, FIG. 3 shows a configuration example of a document database. The document database 303 stores a plurality of document data, writing data, and voice data, and associates them based on the tables 303a to 303e shown in FIG.

  The document table 303a shown in FIG. 3A stores the document name of the document 4 and document data corresponding to the document name as attributes using the document ID as a key.

  The user table 303b shown in FIG. 3B stores the user name as an attribute using the user ID as a key.

  The writing data table 303c shown in FIG. 3C stores the document ID, the position information of the writing data in the document 4, the user ID, and the writing data as attributes using the writing data ID as a key. That is, the writing data table 303c stores the writing data written by the user indicated by the user ID at the position of the document 4 indicated by the position information in association with the document data indicated by the document ID. Here, “P1, 520-600” in the position information of the record on the first line indicates the position where the number of characters on the first page of the document 4 is between the 520th character and the 600th character. The position information may indicate the position by XY coordinates with the upper left corner of the document 4 as the origin, and is not limited thereto.

  The audio data table 303d shown in FIG. 3D stores the document ID and audio data as attributes using the audio data ID as a key. That is, the audio data table 303d stores the audio data in association with the document data indicated by the document ID.

  The data relationship table 303e shown in FIG. 3E stores the voice data ID and the writing data ID as attributes, and associates the voice data ID with the writing data ID. For example, in the records in the first and second lines in FIG. 3E, the writing data with the writing data IDs “A1” and “A2” are associated with the voice data with the voice data ID “VA1”, respectively. It is shown that

(Document structure)
4A to 4C show detailed examples of the code layer 41 provided in the document 4. In the document 4, as shown in FIG. 4A, a large number of invisible and large infrared light absorption coefficient code images 42 of 2 × 2 mm, for example, are printed in a matrix on the entire code layer 41.

  FIG. 4B is an enlarged view of the code image 42. The code image 42 includes a rotation code portion 42a disposed on the upper left, an X coordinate code portion 42b disposed below the rotation code portion 42a, and a Y coordinate code portion disposed on the right of the rotation code portion 42a. 42c, and an identification code part 42d arranged at the lower right of the rotation code part 42a.

  Information indicating the area of its own code image 42 is encoded in the rotation code part 42a, and a document ID for identifying the document 4 is encoded as an identification code in the identification code part 42d. Regardless of the position of the code image 42, the same code is recorded in the rotation code part 42a and the identification code part 42d.

  In the X coordinate code part 42b and the Y coordinate code part 42c, the X coordinate and the Y coordinate on the document 4 of the own code image 42 are encoded. The X coordinate code part 42b encodes the same X coordinate in the vertical direction, and the Y coordinate code part 42c encodes the same Y coordinate in the horizontal direction.

  As shown in the enlarged view of FIG. 4C, each of the code portions 42a to 42d is composed of a combination of a hatched pattern 420a made of a slash “/” and a hatched pattern 420b made of a backslash “\”. Yes. Each oblique line pattern 420a, 420b is formed with a pitch of 0.2 mm, for example, and one oblique line pattern 420a, 420b represents 1-bit information (0 or 1).

  The pattern in the code image 42 is not limited to the hatched patterns 420a and 420b, but may be a known QR code, a two-dimensional code such as PDF417, Data Matrix, Maxi Code, or a one-dimensional code such as a barcode or a unique code. But you can. A plurality of types of codes may be combined according to the purpose.

(Configuration of electronic pen)
FIG. 5 is a cross-sectional view of the main part showing an example of the internal structure of the electronic pen 5. As described above, the electronic pen 5 includes the pen-shaped case body 500 and the pen unit 51, and an infrared LED (Light Emitting Diode) lamp 52 as an infrared light source for irradiating the document 4 with infrared light; An imaging unit 53 that captures the code image 42 printed on the code layer 41. The pen unit 51, the infrared LED lamp 52, and the imaging unit 53 are accommodated in the case main body 500. Note that the electronic pens 5 </ b> A to 5 </ b> C shown in FIG. 1 are equivalent to the electronic pen 5.

  The infrared LED lamp 52 irradiates near infrared light having a wavelength of 800 nm to 1000 nm. Note that a laser, a halogen lamp, or the like may be used as the infrared light source.

  The imaging unit 53 irradiates the document 4 with infrared light, removes visible light from the light reflected by the document 4, and transmits the visible light removal filter 530 that transmits infrared light and the visible light removal filter 530. And an infrared CCD (Charge Coupled Device) 531 as an imaging device for imaging the infrared light.

  The infrared CCD 531 photoelectrically converts received light into an electrical signal corresponding to its intensity, and uses a sensor having sensitivity from the visible region to the near infrared region or a device having sensitivity in the near infrared region. Can do. Note that a CMOS (Complementary Metal Oxide Semiconductor) may be used as the image sensor instead of the CCD.

  FIG. 6 is a block diagram illustrating a schematic configuration example of the electronic pen 5. As described above, the electronic pen 5 includes the infrared LED lamp 52, the infrared CCD 531, and the writing pressure detection unit 511, the signal processing unit 54 that processes a signal from the infrared CCD 531, and the signal processing unit 54. A decoding unit 55 for decoding the received signal, a memory 56 for storing writing data calculated from the code decoded by the decoding unit 55, a lamp driving unit 57 for driving the infrared LED lamp 52, and the electronic pen 5. A control unit 58 that controls each unit; a wireless communication unit 59 that transmits and receives information to and from the document processing server 3; and a battery 540 such as a nickel-cadmium storage battery or a lithium ion battery that supplies power to each unit of the electronic pen 5. Is provided.

  The pen pressure detection unit 511, the signal processing unit 54, the decoding unit 55, the memory 56, the lamp driving unit 57, the control unit 58, the wireless communication unit 59, and the battery 540 are housed in the case body 500. Note that the document processing server 3 may have some or all of the writing data calculation functions of the signal processing unit 54, the decoding unit 55, and the control unit 58 from the electronic pen 5.

  The signal processing unit 54 converts an analog electric signal from the infrared CCD 531 into a digital signal and performs various processes such as inclination correction, gamma correction, and noise removal.

  When the writing pressure detection unit 511 detects a writing pressure equal to or higher than a predetermined writing pressure, the control unit 58 sends a writing start signal to notify the start of writing to the document processing server 3. Then, while the writing pressure detection unit 511 detects a writing pressure equal to or higher than a predetermined writing pressure, the control unit 58 uses the X coordinate code and the Y coordinate code indicating the coordinates of the nib 510 decoded by the decoding unit 55 as a pen. The locus of the tip 510 is calculated and stored in the memory 56 as written data. Further, the control unit 58 sends the writing data stored in the memory 56 together with the writing end signal notifying the end of writing via the wireless communication unit 59 when the writing pressure equal to or higher than the predetermined writing pressure is not detected. It is sent to the document processing server 3.

  The lamp driving unit 57 drives the infrared LED lamp 52 so as to continuously generate infrared light. However, the infrared LED lamp 52 is instantaneously lit or pulsed when handwriting data is acquired (code reading). May be.

  The wireless communication unit 59 includes a circuit that performs wireless communication 11 such as a wireless LAN or Bluetooth (registered trademark), and is connected to the network 10.

  The decoding unit 55 reads the rotation code from the rotation code unit 42a of the code image 42, the X coordinate code from the X coordinate code unit 42b, the Y coordinate code from the Y coordinate code unit 42c, and the identification code from the identification code unit 42d. This will be described with reference to the drawings.

  FIG. 7 is a diagram for explaining an example of code reading by the decoding unit 55. On the code layer 41, as shown in FIG. 7A, a code image 42 including a rotation code portion 42a, an X coordinate code portion 42b, a Y coordinate code portion 42c, and an identification code portion 42d is arranged two-dimensionally. ing. In FIG. 7A, a region surrounded by a one-dot chain line indicates a captured image 6 by the infrared CCD 531, that is, a reading region. FIG. 7B shows details of the captured image 6.

  The captured image 6 of the infrared CCD 531 is larger than the code image 42. If the size of the code image 42 is 2 × 2 mm as described above, the size of the captured image 6 is, for example, 3 × 3 mm. As shown in FIG. 7B, the decoding unit 55 combines each of the image units 60a, 60b, 61a, 61b, 62a, 62b, 62c, and 62d of the captured image 6 to obtain each X coordinate code, Y coordinate code, and identification. The code is being restored. The actual captured image 6 is often tilted with respect to the code image 42, but each code can be restored by combining the parts as shown in FIGS. 7 (a) and 7 (b). it can.

(Operation of the embodiment)
Next, an example of the operation of the document processing system according to the embodiment of the present invention will be described with reference to FIG. 8 and the flowchart of FIG. Here, the speaker explains the document 4, and the three users A to C have the document 4 and the electronic pens 5A to 5C for writing notes on the document 4, respectively. The operation at that time will be described below assuming that the user is listening to the voice.

(1) Recording start of writing data by user A First, when user A, one of the three users, writes a memo in document 4 using electronic pen 5A based on the voice of the speaker, The writing pressure detection unit 511 of the electronic pen 5A detects a writing pressure equal to or higher than a predetermined writing pressure, and notifies the control unit 58 that a writing pressure equal to or higher than the predetermined writing pressure has been detected.

  Next, the control unit 58 monitors whether or not the writing operation by the user A has been started (S101), and determines that the writing operation has been started when the writing pressure detection notification is received from the writing pressure detection unit 511. (S101: Yes).

  Next, the control unit 58 issues a new writing data ID (S102). And the control part 58 sends a writing start signal to the document processing server 3 via the network 10 by the wireless communication part 59 (S103).

  Next, when the writing data acquisition unit 310 of the document processing server 3 receives the writing start signal transmitted from the control unit 58 via the communication unit 32 (S201), the writing data acquisition unit 310 transmits a writing start signal to the recording data acquisition unit 311. When receiving the writing start signal, the recording data acquisition unit 311 increments (adds) the writing counter (S202).

  Here, FIG. 8 is a timing chart showing the relationship between the writing operation signals from the electronic pens 5A to 5C and the writing counter. Assuming that the writing counter is zero in the initial state, the recording data acquisition unit 311 that has received the writing start signal as the writing operation signal changes the writing counter to “1”.

  Next, the recording data acquisition unit 311 determines whether or not the writing counter exceeds a specified value (S202). Here, if the specified value is “2”, the recording data obtaining unit 311 determines that the writing counter does not exceed the specified value “2” (S203: No), and returns to Step 102. Then, the writing data acquisition unit 310 stands by until a writing start signal is input from the other electronic pens 5B and 5C (S102). The specified value may be “1” or “3”, and is not limited thereto.

  On the other hand, when receiving the writing pressure detection notification from the writing pressure detection unit 511, the control unit 58 of the electronic pen 5A starts recording the handwriting written on the document 4 by the user A (S104). That is, the control unit 58 drives the lamp driving unit 57 to continuously generate infrared light by the infrared LED lamp 52. The infrared light generated from the infrared LED lamp 52 irradiates the code layer 41, and the infrared light reflected by the code image 42 is removed from the visible light by the visible light removal filter 530 and then applied to the infrared CCD 531. Incident.

  Next, the infrared CCD 531 converts the incident infrared light into an electrical signal. The signal processing unit 54 converts an analog electric signal from the infrared CCD 531 into a digital signal and performs various processes such as inclination correction, gamma correction, and noise removal. The decoding unit 55 decodes the signal processed by the signal processing unit 54 into a rotation code, an X coordinate code, a Y coordinate code, and an identification code.

  Next, the control unit 58 determines whether or not the writing operation has been completed based on the writing pressure detected by the writing pressure detection unit 511 (S105). Next, the control unit 58 determines that the writing operation by the user A is continued while the writing pressure detection unit 511 detects a writing pressure equal to or higher than a predetermined writing pressure (S105: No), and decodes the decoding operation. Of the codes acquired by the unit 55, the locus of the pen tip 510 is calculated based on the X coordinate code and the Y coordinate code indicating the coordinate of the pen tip 510, and is stored as writing data together with the writing data ID issued in step S102. 56. The control unit 58 also stores the document ID acquired from the identification code in the memory 56.

(2) Recording start of writing data and voice data by user B When user B writes a memo in document 4 using electronic pen 5B, writing pressure equal to or higher than a predetermined writing pressure is applied, similar to electronic pen 5A. The detected writing pressure detection unit 511 sends a writing pressure detection notification to the control unit 58, and the control unit 58 detects that the writing operation by the user B is started by the writing pressure detection notification (S101: Yes).

  Next, the control unit 58 of the electronic pen 5B issues a writing data ID (S102) and transmits a writing start signal (S103).

  Next, when the writing data acquisition unit 310 of the document processing server 3 receives a writing start signal from the electronic pen 5B (S201), it sends a writing start signal to the recording data acquisition unit 311. Then, the recording data acquisition unit 311 increments the writing counter (S202). Here, since the writing counter is “1” as shown in FIG. 8, the writing data acquisition unit 310 changes the writing counter to “2”.

  Next, the recording data acquisition unit 311 determines whether or not the writing counter exceeds the specified value (S202), and determines that the writing counter exceeds the specified value “2” (S203: Yes).

  Next, the recording data acquisition unit 311 issues a new audio data ID (S204), and copies the audio data stored in the primary audio buffer 301 of the storage unit 30 to the secondary audio buffer 302 (S205). . Note that the primary audio buffer 301 stores audio data for a predetermined time before the writing operation by the user B is performed, as shown in FIG.

Next, the recording data acquisition unit 311 starts recording the audio input from the audio input device 2 in the secondary audio buffer 302 (S206). That is, the current audio data is recorded in the secondary audio buffer 302 after the audio data copied from the primary audio buffer 301, as shown in FIG.
(3) Acquisition of written data by user A

  After that, when the user A finishes writing the memo to the document 4, the control unit 58 of the electronic pen 5A determines that the writing operation of the user A is finished in step S105 (S105: Yes), and the control is performed. The unit 58 finishes recording the writing data in the memory 56 (S106).

  Next, the control unit 58 sends a writing end signal via the network 10 by the wireless communication unit 59 and also writes the writing data, the writing data ID, the document ID, and the user ID stored in the memory 56 to the document processing server 3. (S107).

  Next, when the writing data acquisition unit 310 of the document processing server 3 receives a writing end signal or the like sent from the control unit 58 via the communication unit 32 (S211), the received writing data, writing data ID, and document ID are received. And the user ID are sent to the registration means 312 and the fact that the writing end signal has been received is notified. Next, when receiving the notification from the writing data acquisition unit 310, the registration unit 312 registers the received writing data, writing data ID, document ID, and user ID in the writing data table 303c of the document database 303 (S212).

  Next, the writing data acquisition unit 310 sends a writing end signal to the recording data acquisition unit 311. When the recording data acquisition means 311 receives the writing end signal, it decrements (subtracts) the writing counter (S213). Here, as shown in FIG. 8, since the writing counter is “2”, the recording data acquisition unit 311 that has received the writing end signal as the writing operation signal changes the writing counter to “1”.

Next, the recording data acquisition means 311 determines the end of recording of the audio data depending on whether or not the writing counter is “0” (S214). Here, since the writing counter is “1”, it is determined that the recording of the voice data is not finished (S214: No), and the process returns to step 211. Note that the end of recording of audio data is not limited to the case where the writing counter is “0”, and may be “1” or more.
(4) Acquisition of written data by user B

  Thereafter, when the user B finishes writing the memo to the document 4 and the control unit 58 of the electronic pen 5B determines that the writing operation of the user B is ended in the same manner as described above (S105: Yes), the control is performed. The unit 58 finishes storing the writing data in the memory 56 (S106), sends a writing start signal, and sends the writing data, the writing data ID, the document ID, and the user ID to the document processing server 3 (S107).

  Next, when the writing data acquisition unit 310 of the document processing server 3 receives the writing end signal or the like sent from the control unit 58 (S211), it sends them to the registration unit 312. Then, the registration unit 312 registers the writing data received from the writing data acquisition unit 310, various IDs, and the like in the writing data table 303c of the document database 303 (S212).

(5) Acquisition of voice data Next, the writing data acquisition means 310 sends a writing end signal to the recording data acquisition means 311. Upon receipt of the writing end signal, the recording data acquisition means 311 decrements the writing counter ( S213). Here, as shown in FIG. 8, since the writing counter is “1”, the recording data acquisition unit 311 changes the writing counter to “0”.

  Next, in step S214, the recording data acquisition unit 311 determines that the writing counter is “0” (S214: Yes), and ends recording of the audio data in the secondary audio buffer 302 (S215). Audio data 20 is acquired as data.

  Next, the recording data acquisition unit 311 notifies the registration unit 312 that acquisition of the audio data 20 has been completed. Upon receiving the notification from the recording data acquisition unit 311, the registration unit 312 registers the audio data 20 acquired by the recording data acquisition unit 311 in the audio data table 303 d of the document database 303 (S 216).

  Then, the registration unit 312 registers a record that associates the voice data with the writing data of the user A and the user B in the data relation table 303e of the document database 303 (S217).

(6) Use of Document Database Through the above operation, the document database 303 in which writing data and voice data are registered is accessed by a terminal (not shown). The terminal includes a CPU that controls each unit of the terminal, a storage unit that stores programs executed by the CPU and various data, and a communication unit (for example, a network interface card) that is connected to the network 10 and can access the document database 303. ), An input unit composed of a keyboard, a mouse and the like, a display unit composed of an LCD (liquid crystal display) for displaying a screen and the like, and a sound output unit for reproducing sound data and outputting sound. Such a terminal is, for example, a personal computer (PC), a personal digital assistant (PDA), or the like, and a plurality of terminals may be connected to the document processing system 1.

  When the user uses this terminal to request display of a screen for selecting document data, the CPU of the terminal accesses the document database 303 via the network 10, for example, a list screen of the document table 303a shown in FIG. Is displayed on the display.

  Next, it is assumed that the user selects document data with a document ID “Doc1” on the displayed list screen by using the input unit. Note that the user may be the users A to C who have performed the writing operation, or may be other users. Further, the user may select document data by specifying a search keyword such as a keyword, date, and user name.

  Next, the CPU of the terminal transmits to the document processing server 3 transmission of document data corresponding to the document ID “Doc1” selected by the user and transmission of writing data and audio data associated with the document ID “Doc1”. Request.

  Next, when the calculation unit 31 of the document processing server 3 receives the request via the communication unit 32, the writing data and voice data associated with the document ID “Doc1” are transmitted to the terminal together with the requested document data. Send. For example, when various data and tables are registered in the document database 303 as shown in FIG. 3, the calculation unit 31 refers to the writing data table 303c and is associated with the document ID “Doc1”. The writing data corresponding to the writing data IDs “A1” and “A2” is transmitted, and the voice data ID “VA1” associated with the writing data “A1” and “A2” is extracted from the data relation table 303e, The voice data registered in the voice data ID “VA1” in the voice data table 303d is transmitted.

  Next, when receiving the document data “Doc1”, the writing data “A1”, “A2”, and the voice data “VA1” from the document processing server 3, the CPU of the terminal displays the received document data on the display unit. .

  Here, FIG. 10 shows an example of document data displayed on the display unit of the terminal. On the screen that displays the document data 43, a functional specification that is the content of the document data 43 is displayed. On the functional specification, written data “A1” and “A2” indicate their position information. Each position is displayed. That is, the writing data “A1” 44A by User1 is displayed between the 520th character and the 600th character of the first page of the functional specification, and the writing data “A2” 44B by User2 is similarly displayed from the 610th character to 650th character. Displayed between characters.

  Then, when the user moves the cursor 45 onto the writing data “A1” 44A by User1, for example, using the input unit, the CPU of the terminal reproduces the audio data “VA1” and outputs the audio from the audio output unit. To do. Similarly, when the cursor 45 is moved on the writing data “A2” 44B by User2, the CPU of the terminal reproduces the voice data “VA1”.

[Other embodiments]
The present invention is not limited to the above embodiment, and various modifications can be made without departing from the spirit of the present invention. For example, in the above embodiment, the writing data acquisition unit 310, the recording data acquisition unit 311 and the registration unit 312 of the document processing server 3 are realized by the calculation unit 31 and the document processing program 300. May be realized by hardware such as an application specific integrated circuit (ASIC).

  The document processing program used in the above embodiment may be read from a recording medium such as a CD-ROM into a storage unit in the apparatus, or from a server or the like connected to a network such as the Internet. You may download it.

  Moreover, in the said embodiment, although writing data was acquired by electronic pen 5A-5C, you may use a portable terminal, for example, PDA (Personal Digital Assistant), a smart phone, etc. instead of electronic pen 5A-5C.

  In the above embodiment, the primary audio buffer 301 and the secondary audio buffer 302 are provided in the document processing server 3 to record the audio data. However, the primary audio buffer and the secondary audio are recorded in the audio input device 2. Audio data may be recorded by providing a buffer.

  In the above embodiment, the voice data is recorded by the voice input device 2. However, the voice data may be recorded by the electronic pen 5 by providing the electronic pen 5 with a voice recording function.

FIG. 1 is an overall view showing a schematic configuration example of a document processing system according to an embodiment of the present invention. FIG. 2 is a block diagram showing a schematic configuration example of the document processing server according to the embodiment of the present invention. FIG. 3 shows a configuration example of the document database according to the embodiment of the present invention. 4A is a plan view of an example of a code layer of a document, FIG. 4B is an overall view of an example of a code image, and FIG. 4C is a diagram illustrating a detailed configuration example of a code image. FIG. 5 is a cross-sectional view of the main part showing an example of the internal structure of the electronic pen according to the embodiment of the present invention. FIG. 6 is a block diagram showing a schematic configuration example of the electronic pen according to the embodiment of the present invention. FIG. 7 is a diagram for explaining an example of code reading by the decoding unit. FIG. 8 is a timing chart showing an example of a relationship between a writing operation signal of the electronic pen, a writing counter, and recording of voice data. FIG. 9 is a flowchart showing an example of the operation of the document processing system according to the embodiment of the present invention. FIG. 10 is a diagram showing an example of document data and the like displayed on the display unit of the terminal according to the embodiment of the present invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Document processing system 2 Voice input device 3 Document processing server 4 Document 5, 5A-5C Electronic pen 6 Imaged image 10 Network 11 Wireless communication 20 Voice data 30 Storage part 31 Calculation part 32 Communication part 33 Operation input part 34 Display part 40 Handwriting Layer 41 Code layer 42 Code image 42a Rotation code part 42b X coordinate code part 42c Y coordinate code part 42d Identification code part 43 Document data 44A, 44B Writing data 45 Cursor 51 Pen part 52 Infrared LED lamp 53 Imaging part 54 Signal processing Unit 55 decoding unit 56 memory 57 lamp driving unit 58 control unit 59 wireless communication unit 60a, 60b, 61a, 61b, 62a, 62b, 62c, 62d image unit 300 document processing program 301 primary audio buffer 302 secondary audio buffer 303 document The database 03a Document table 303b User table 303c Writing data table 303d Audio data table 303e Data relation table 310 Writing data acquisition means 311 Recording data acquisition means 312 Registration means 420a, 420b Diagonal line pattern 500 Case body 510 Pen tip 511 Writing pressure detection unit 520 Erasing member 530 Visible light removal filter 540 Battery

Claims (6)

Writing data acquisition means for acquiring writing data entered on a document by a writing operation and document identification information for identifying the document;
Recording data acquisition means for acquiring recording data recorded or recorded in synchronization with the writing operation,
And, when the writing data, the document identification information of the document, and the recording data are acquired, the computer is used as a registration unit that registers the writing data and the recording data in association with the document identification information of the document. Document processing program to make it function. The recorded data acquisition means
The document processing program according to claim 1, wherein recording data corresponding to a predetermined period before or after the period during which the writing operation is performed is acquired. The recorded data acquisition means
The recording or recording is started when a predetermined number of start signals indicating the start of the writing operation are received, and the recording or recording is ended when a predetermined number of end signals indicating the end of the writing operation are received. Document processing program described in 1. Writing data acquisition means for acquiring writing data entered on a document by writing operation and document identification information for identifying the document;
Recording data acquisition means for acquiring recording data recorded or recorded in synchronization with the writing operation;
Document processing comprising: registration means for registering the writing data and the recording data in association with the document identification information of the document when the writing data, the document identification information of the document, and the recording data are acquired apparatus. Furthermore, a primary storage unit that stores the recording data recorded for a predetermined period before the writing operation is performed,
When the recording or recording is started in synchronization with the writing operation, the recording data stored in the primary storage unit is stored, and the recording or recording is ended after the stored recording data. A secondary storage unit for storing the recording data,
The document processing apparatus according to claim 4, wherein the writing data acquisition unit reads and acquires the recording data from the secondary storage unit. Writing data input means for inputting writing data entered on a document by writing operation and document identification information for identifying the document;
Recording data input means for recording or recording to input recording data;
Recording data recorded or recorded in synchronization with the writing operation among writing data acquiring means for acquiring the writing data and the document identification information from the writing data input means and recording data input from the recording data input means Recording data acquisition means for acquiring the writing data, the document identification information of the document, and the recording data, the writing data and the recording data are associated with the document identification information of the document. A document processing system comprising: a document processing apparatus having registration means for registering.

Images