JP2017017755A - Information processing apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To append to original image data a difference image additionally handwritten to a recording medium with the original image data printed thereon.SOLUTION: An information processing apparatus 100 comprises: an imaging unit 8 for acquiring image data by photographing a recording medium; acquisition means 1 and 8 for acquiring original image data being an original of the image data acquired by the imaging unit 8; comparison means 1 for acquiring difference image data by comparing the image data acquired by the imaging unit 8 with the original image data; and appending means 1 for appending to the original image data the difference image data acquired by the comparison means 1.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing apparatus and a program.

2. Description of the Related Art Conventionally, a handwritten document added by handwriting to materials distributed at a meeting or the like is converted into image data by a scanner and stored. For example, difference image data obtained by comparing image data obtained by scanning a document data print with handwriting with a scanner device and image data of document data that is the source of the image data, and difference image An information processing apparatus that stores character data obtained by performing character recognition processing on data in association with document data is disclosed (Patent Document 1).
According to this apparatus, document data and image data of a handwritten portion can be stored in association with each other.

JP 2010-262584 A

  However, in the apparatus as described above, it is necessary to move to a place where the scanning device is installed to convert the data to be converted into image data, and the procedure is complicated. Had.

  SUMMARY OF THE INVENTION An object of the present invention is to enable a user to add a difference image handwritten by a user to a recording medium in which original image data is recorded when the recording medium is turned by a user.

  An information processing apparatus according to the present invention includes an imaging unit that captures a recording medium to acquire image data, an acquisition unit that acquires original image data that is a source of the image data acquired by the imaging unit, and the image data. Comparing means for acquiring difference image data by comparing with the original image data, and additional recording means for adding the difference image data acquired by the comparing means to the original image data, the acquiring means being the imaging means A first storage means for storing the original image data acquired by the imaging means; a second storage means for sequentially updating and storing the image data continuously acquired by the imaging means; A first determination unit that calculates a difference between the preceding and subsequent image data acquired continuously from the imaging unit and determines whether the difference value exceeds a handwriting detection determination value; and the first determination. A storage control unit that stores, in the second storage unit, subsequent image data of the preceding and succeeding image data when the difference value is determined not to exceed the handwriting detection determination value by the stage; and the difference value Second determination means for determining whether or not the difference value exceeds a turning detection determination value larger than the handwriting detection determination value when it is determined that the difference exceeds the handwriting detection determination value, and the comparison means When the second determination means determines that the difference value exceeds the turning detection determination value, the original image data stored in the first storage means and the image data stored in the second storage means To obtain the difference image data.

  ADVANTAGE OF THE INVENTION According to this invention, when a recording medium is turned by the user, the difference image handwritten by the user on the recording medium which recorded the original image data can be added to original image data.

It is an appearance perspective view of an information processor concerning this embodiment. It is a figure which shows the 1st cover of information processing apparatus. It is a block diagram which shows the internal structure of information processing apparatus. It is a figure which shows the open / closed state of the cover in information processing apparatus. (A) is a figure which shows the state which the 1st cover and 2nd cover of information processing apparatus opened, (B) is a figure which shows the state in which a 2nd cover overlaps on a 1st cover. It is. It is a figure which shows the flow of the 1st handwritten document imaging | photography preservation | save process performed by the information processing apparatus which concerns on this embodiment. It is the figure which showed typically the relationship between the difference value of image data, and time after the 1st handwritten document imaging | photography preservation | save process start. It is a figure which shows the operation | movement which has added the character etc. to the recording medium which the user printed document data. It is a figure which shows the operation | movement which is turning the recording medium which the user added. It is a figure which shows the data structure of the document data managed by the image management program memorize | stored in the memory | storage part. It is a figure which shows the flow of the 2nd handwritten document imaging | photography storage process performed with the information processing apparatus which concerns on this embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is an external perspective view of an information processing apparatus 100 according to the present embodiment.

The information processing apparatus 100 is, for example, a tablet terminal device having an A5 size, and includes a main body 12 and a binder 13 as a housing.
The main body unit 12 is provided with a touch display unit 5 for screen display and touch input, an imaging unit 8 as an imaging unit, and the like. The imaging unit 8 is disposed in the central part of the frame on the long side farther from the rotation axis by the hinge part 13c (the left central part on the front side in FIG. 1) of the outer part of the touch display part 5. .

  The binder 13 as a housing is configured by connecting a first cover 13a as a first housing and a second cover 13b as a second housing so that the hinge portion 13c can be opened and closed. ing. The recording medium 15 is disposed on the first cover 13a, and the main body 12 is provided on the second cover 13b. The main body 12 and the recording medium 15 are detachably attached to the binder 13 by fasteners, hooks, and the like.

  In the present embodiment, the recording medium 15 indicates a medium on which information to be photographed is recorded. For example, a sheet on which information is recorded by printing document data, information is printed. Paper, books, etc. However, the recording medium 15 may be a medium on which information to be imaged is recorded, and the material is not limited to paper. The recording medium 15 may be a sheet of paper, or may be bound in a booklet form. The recording medium 15 also includes electronic paper that can display information electronically.

  The 1st cover 13a and the 2nd cover 13b are comprised by flat rectangular shape, and can be opened and closed by the hinge part 13c so that a book and a notebook may be opened and closed. FIG. 1 illustrates a state where the angle formed by the first cover 13a and the second cover 13b is 180 ° (a state where the cover is opened 180 °). The user refers to the screen displayed on the touch display unit 5 in a state of being opened 180 ° or in a state of a predetermined angle and performs touch input, and enters characters, diagrams, and the like on the recording medium 15.

  The hinge part 13c is provided with an opening / closing angle sensor 14 for detecting an angle formed by the first cover 13a and the second cover 13b. The opening / closing angle sensor 14 includes a rotary encoder that detects the rotation of the shaft of the hinge portion 13c and a magnetic sensor that detects the opening / closing state using a hall element or the like. Here, the opening / closing angle sensor 14 functions as a detecting means.

  FIG. 2 is a diagram illustrating the first cover 13 a of the information processing apparatus 100. The recording medium 15 is disposed on the first cover 13a, and marks M1 to M6 are provided on the edge that is outside the portion where the recording medium 15 is disposed. The marks M1 to M3 are provided on the edge of the first cover 13a close to the hinge portion 13c. The marks M4 to M6 are provided on the edge of the first cover 13a far from the hinge 13c. The shapes of the marks M1 to M6 in the present embodiment are shapes in which two quadrangles are in contact with the corners, but may be any shape as long as the position can be identified, and may be, for example, a cross shape. These marks M <b> 1 to M <b> 6 are photographed by the imaging unit 8 together with the recording medium 15.

  FIG. 3 is a block diagram illustrating an internal configuration of the information processing apparatus 100. The information processing apparatus 100 includes a CPU (Central Processing Unit) 1 that performs overall control of the device, an operation unit 6 that includes operation keys, and a RAM (Random Access Memory) 3 that provides a working memory space to the CPU 1. A touch display unit 5 having a structure in which a touch panel 5b is stacked on the display panel 5a, a storage unit 4 storing a control program executed by the CPU 1, control data, and the like, a wireless communication unit 7, and an optical image of the subject An imaging unit 8, a camera controller 9 for controlling the imaging unit 8, a timekeeping unit 10 for measuring the current date and time, an opening / closing angle sensor 14 for detecting an angle formed by the first cover 13a and the second cover 13b, etc. It has. The CPU 1, the operation unit 6, the RAM 3, the touch display unit 5, the storage unit 4, the wireless communication unit 7, the camera controller 9, the time measuring unit 10, and the open / close angle sensor 14 are connected via a bus 11.

  The CPU 1 comprehensively controls the processing operation of each unit of the information processing apparatus 100 according to an operation signal input from the operation unit 6 or the touch panel 5b. Specifically, the CPU 1 reads a system program stored in the storage unit 4, develops it in the work area of the RAM 3, and controls each unit according to the system program. In addition, the CPU 1 reads out the processing program 4a stored in the storage unit 4, develops it in the work area, and executes a first handwritten document photographing / storing process to be described later. Functions as determination means, storage control means, and keystone correction means. Further, the CPU 1 functions as an imaging control unit, an acquisition unit, a comparison unit, an addition unit, and a trapezoid correction unit by executing a second handwritten document shooting and saving process described later.

  The RAM 3 as the first storage means and the second storage means is a volatile memory. The RAM 3 has a work area for storing various programs to be executed and data related to these various programs.

  A power supply unit (secondary battery) 2 supplies power to each unit.

  The storage unit 4 includes, for example, an HDD (Hard Disk Drive) having a magnetic recording medium, a rewritable ROM (Read Only Memory), a flash memory, and the like. The storage unit 4 is provided with a program storage unit 41. The storage unit 4 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). The state may include a storage area on a predetermined server device side.

The program storage unit 41 stores a system program executed by the CPU 1, a processing program 4a, and the like. The processing program 4a includes a program for executing various processes including a first handwritten document photographing / storing process and a second handwritten document photographing / storing process. Further, an image data management program for managing document data and the like, and an OCR (Optical Character Recognition) program are included. The OCR program is a program that recognizes an input image into binarized image data by image processing, specifies characters and codes by collating with a previously stored pattern, and outputs character / code data. Here, the CPU 1 functions as a character recognition unit that recognizes image data by executing an OCR program.
These programs are stored in the program storage unit 41 in the form of computer readable program codes. The CPU 1 sequentially executes operations according to the program code.

  The touch display unit 5 has a structure in which a touch panel 5b is stacked on a display panel 5a. The display panel 5a is a high-definition liquid crystal display having screens having different aspect ratios (for example, horizontal 4: vertical 3). 5b constitutes a touch screen that detects the position touched by the photographer's finger and inputs the coordinate data. For example, a capacitance method or a resistance film method is adopted. This method may be used.

  Although not shown, the operation unit 6 includes a push button type key such as a power key for turning on / off the power, and the CPU 1 responds to an input operation signal output from the operation unit 6 corresponding to the operation key. Process.

  The wireless communication unit 7 is a wireless communication module capable of high-speed and large-capacity communication. For example, the wireless communication unit 7 can be connected to the Internet via a nearby wireless LAN (Local Area Network) router (not shown). Here, the wireless communication unit 7 functions as an acquisition unit.

  The imaging unit 8 captures an optical image of a subject and is a camera module that captures the subject by imaging the subject image from the optical lens on an image sensor (CCD, CMOS, etc.) although not shown. For example, a focusing drive unit, an image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal-oxide Semiconductor), a timing generator, a driver, etc. Convert to signal. For example, the imaging unit 8 can perform continuous shooting (high-speed image) with a frame rate of 15 frames per second (15 fps). Here, the imaging unit 8 functions as an imaging unit. The imaging unit 8 functions as an acquisition unit.

  The camera controller 9 controls the imaging unit 8. An operation control signal for the operation of the imaging unit 8 is output from the camera controller 9 and controls image acquisition start, image acquisition position, and autofocus. Image data output from the imaging unit 8 is received by the camera controller 9 and transferred to the RAM 3 using the DNA function of the CPU 1. Here, the CPU 1 and the camera controller 9 function as imaging control means.

  The timer unit 10 counts signals input from an oscillation circuit unit (not shown) to obtain internal time and the like. Then, the internal time is output to the CPU 1. Here, the internal time refers to the current date and time measured by the time measuring unit 9.

  Next, the operation of the information processing apparatus 100 according to the present embodiment will be described. FIG. 4 is a diagram illustrating an open / close state of the binder 13 in the information processing apparatus 100. 4A shows a state in which the first cover 13a and the second cover 13b of the information processing apparatus 100 are opened, and FIG. 4B shows a second state on the first cover 13a. It is a figure which shows the state in which the cover 13b overlaps.

  For example, the user can use the information processing apparatus 100 in a state where the binder 13 is opened, or can write a chart or the like on the recording medium 15. Further, when the information processing 100 and the recording medium 15 are not used, the first cover 13a and the second cover 13b can be closed to close the binder 13 (the angle is 0 degree).

  FIG. 5 is a diagram illustrating a flow of the first handwritten document shooting and saving process executed by the information processing apparatus 100 according to the present embodiment. Hereinafter, the first handwritten document photographing / storing process by the information processing apparatus 100 will be described with reference to FIG. These processes are executed in cooperation with the CPU 1 and the processing program stored in the storage unit 4.

  As a premise that the first handwritten document photographing / storing process is started, for example, a recording medium 15 on which document data is printed in a state where the information processing apparatus 100 is activated is installed on the first cover 13a. To do. In the first handwritten document shooting and saving process, for example, approximately 110 degrees is set as an angle suitable for shooting. In addition, shooting conditions such as focus and exposure are set in accordance with an angle suitable for shooting (approximately 110 degrees). Note that the angle suitable for shooting is not limited to 110 degrees, and an angle such as approximately 70 degrees can be selected in accordance with the angle of view of the imaging unit 8 or the like. Further, it is assumed that the original document data is acquired by the wireless communication unit 7 and stored in the storage unit 4. Further, an external storage medium such as a USB memory (not shown) is connected by an I / F unit configured by a USB controller or the like, and original document data is acquired by the I / F unit and stored in the storage unit 4. It may be.

  In step S <b> 1, the CPU 1 determines the mode as the first handwritten document photographing / storing process mode based on the operation by the user operation unit 6.

  In step S <b> 2, the CPU 1 activates the imaging unit 8.

  In step S3, the CPU 1 captures the recording medium 15 on which the document data is printed by the imaging unit 8 as initial image data, and stores it in the initial image data storage area of the RAM 3 as the first storage unit. Here, in the first handwritten document shooting and saving process, the initial image data is the original image data. In the first handwritten document photographing / storing process, the document data is also original image data. Thereafter, the user starts adding characters and the like to the recording medium 15 on which the document data is printed. The CPU 1 stores the initial image data in the image data storage area of the RAM 3 as the second storage unit.

  In step S4, the CPU 1 determines whether or not the first handwritten document photographing / storing process has been completed. Specifically, the process ends when an image obtained in step S13, which will be described later, is stored in the RAM 3, or when a predetermined time has elapsed after the start of the first handwritten document photographing storage process, or when a manual end instruction is issued. Judge that If it is determined that the process has been completed, the process branches to “YES” and the present process is terminated. If it is determined that the process has not been completed, the process branches to “NO” and proceeds to step S4.

  In step S <b> 5, the CPU 1 transfers image data from the imaging unit 8 and stores it in the RAM 3.

  In step S6, the CPU 1 obtains difference image data by comparing the image data captured last time with the image data captured in the current step S5, and calculates the difference value of the difference image data. Here, the previously captured image data is initial image data of the recording medium 15 on which the document data is printed in step S3. In addition, after returning to step S4 through the processing of step S7 or step S8, the previously captured image data is the image data captured in the previous step S5.

  FIG. 6 is a diagram schematically showing the relationship between the difference value of the image data and the time after the start of the first handwritten document shooting and saving process. FIG. 7 is a diagram showing an operation in which the user adds characters or the like to the recording medium 15 on which the document data is printed. As shown in FIG. 7, the user intermittently adds characters and the like to the recording medium 15 on which the document data is printed. During the additional recording, the motion of the hand is photographed while being superimposed on the additional recording of characters or the like, so that the difference value of the image data increases. When the additional recording is finished and the hand position is out of the field angle range of the imaging unit 8, the difference value of the image data becomes small. The handwriting detection determination value is a threshold value set in advance for detecting such a handwriting operation.

  In step S7, the CPU 1 determines whether or not the difference value calculated in step S6 has exceeded the handwriting detection determination value. If it is determined that the difference value of the image data exceeds the handwriting detection determination value, the process branches to “YES”, and the process proceeds to step S9. If it is determined that the difference value of the image data does not exceed the handwriting detection determination value, the process branches to “NO” and the process proceeds to step S8.

  In step S8, the CPU 1 stores the image data transferred in step S5 in the RAM 3 as the second storage unit, and proceeds to step S4.

In step S9, the CPU 1 determines whether or not the difference value calculated in step S6 has exceeded the turning detection determination value.
FIG. 8 is a diagram illustrating an operation in which the user turns the recording medium 15 that has been added. As shown in FIG. 8, when the user turns the recording medium 15 on which the document data is printed and moves to the next page or removes the recording medium 15 on which the document data is printed from the information processing apparatus 100, the image data The difference value of increases. The turning detection determination value is a threshold set in advance for detecting such a turning operation.
If it is determined that the difference value of the image data exceeds the turning detection determination value, the process branches to “YES”, and the process proceeds to step S10. If it is determined that the difference value of the image data does not exceed the turning detection determination value, the process branches to “NO” and proceeds to step S4.

  In step S10, the CPU 1 prohibits overwriting image data in the RAM 3 as the second storage unit.

  That is, in step S4 to step S8, when it is determined that the difference value of the image data does not exceed the handwriting detection determination value, the CPU 1 stores the latest image data in the RAM 3 as the second storage unit, and the process proceeds to step S9. If it is determined that the difference value of the image data exceeds the page turning detection determination value, overwriting of the image data in the RAM 3 as the second storage unit is prohibited in step S10.

  In step S11, the CPU 1 performs keystone correction processing and brightness adjustment on the initial image data stored in the RAM 3 serving as the first storage unit and the image data stored in the RAM 3 serving as the second storage unit. The trapezoidal correction process can be performed by a known method with reference to the images of the marks M1 to M6. Here, since the imaging unit 8 is provided on the second cover 13b side, for example, on the opposite sides of the image of the rectangular recording medium, on the mark M1 to M3 side provided on the edge near the hinge unit 13c. The opposite side of the image is enlarged compared to the opposite side of the image on the mark M4 to M6 side provided at the edge far from the hinge 13c. Therefore, in order not to lower the resolution, it is more preferable to correct the trapezoid by enlarging the image on the opposite side of the two opposite sides on the mark M4 to M6 side. In the brightness adjustment, the brightness value of the image data is adjusted by, for example, automatic gain control.

In step S <b> 12, the CPU 1 acquires difference image data between the trapezoidally corrected initial image data and the image data. This difference image data corresponds to the portion of the image data additionally recorded.
Note that the keystone correction processing / brightness adjustment may be performed after obtaining the difference data without performing the keystone correction processing / brightness adjustment in step S11.

  In step S13, the CPU 1 adds the difference image data to the original document data. That is, the difference image data is added to the document data as the original image data.

  Here, the CPU 1 can add (append) to the document data after character recognition of the difference image data by an OCR (Optical Character Recognition) program.

In step S <b> 14, the CPU 1 stores “the latest image data stored in the RAM 3 as the second storage unit”, the difference image data, and the document data to which the difference image data is added in the storage unit 4. At that time, the CPU 1 associates “the latest image data stored in the RAM 3 as the second storage unit”, the difference image data, and the document data to which the difference image data is added in association with the original document data. Store in the storage unit 4.
The document data to which the difference image data is added may be displayed on the touch display unit 5 so that the user can confirm that the difference image data has been added to the original document data.
FIG. 9 is a diagram illustrating a data structure of document data managed by the image management program stored in the storage unit 4. An ID and an image name are registered for each piece of document data. The ID of “latest image data stored in the RAM 3 as the second storage unit” is index 1 and the difference image data is index 2 The ID of the document data to which the difference image data is added to 3 can be registered. The CPU 1 stores the “latest image data stored in the RAM 3 as the second storage unit”, the difference image data, and the document data to which the difference image data is added, with an ID, by using a document management program. At the same time, the IDs are stored as indexes in the data structure of the original document data.
Further, the original image data (initial image data) may be stored in the storage unit 4 in association with the document data.
Further, in step S13, when the CPU 1 recognizes the difference image data by the OCR program and adds it to the document data, in step S14, the difference image data recognized by the character is added to the document data. Things may be stored.
Then, the process ends through step S4.

As described above, according to the information processing apparatus 100 according to the present embodiment, the imaging unit 8 captures the recording medium 15 to acquire image data, and the CPU 1 uses the source of the image data acquired by the imaging unit 8. The CPU 1 obtains the difference image data by comparing the image data obtained by the imaging unit 8 with the original image data, and adds the obtained difference image data to the original image data. .
Thereby, after the contents of a document, a figure, etc. are handwritten on the recording medium, the difference information corresponding to the handwritten part is acquired by photographing the added contents, and the acquired difference image is converted into the original image data. Can be added to.

In the information processing apparatus 100, the original image is acquired by the imaging unit 8, and the RAM 3 as the first storage unit that stores the original image data acquired by the imaging unit 8 and the imaging unit 8 continuously. RAM 3 as second storage means for sequentially updating and storing the image data acquired in this manner, and the CPU 1 calculates the difference between the previous and subsequent image data acquired continuously from the imaging unit 8 and calculates the difference value. The CPU 1 determines whether or not the handwriting detection determination value has been exceeded, and the CPU 1 stores the subsequent image data of the preceding and succeeding image data only when it is determined that the difference value does not exceed the handwriting detection determination value. The CPU 1 calculates the difference between the image data before and after continuously acquired from the imaging unit 8 and determines whether or not the difference value exceeds the turning detection determination value. difference If it is determined that the value has exceeded the page turning detection determination value, the difference between the original image data stored in the RAM 3 as the first storage means and the image data stored in the RAM 3 as the second storage means Get image data.
Thereby, it is possible to appropriately store the image data when the handwriting is added to the recording medium by detecting the user's handwriting operation and the page turning operation, and the image data and the original image data of the additionally recorded recording medium can be stored. Difference image data corresponding to the added part can be acquired by comparison.

In the information processing apparatus 100, the CPU 1 performs trapezoidal correction on the image data, and the CPU 1 stores the original image data stored in the RAM 3 as the first storage unit and the RAM 3 as the second storage unit. After the latest image data has been trapezoidally corrected, the image data is compared to obtain difference image data.
Thereby, since these image data are keystone-corrected, the difference image data by which the keystone correction was carried out can be obtained.

In the information processing apparatus 100, the CPU 1 recognizes the difference image data as characters.
Thereby, the difference data by which character recognition was carried out is obtained.

  Next, another operation in the information processing apparatus 100 according to the present embodiment will be described using the flowchart shown in FIG.

  FIG. 10 is a diagram illustrating a flow of the second handwritten document shooting and saving process executed by the information processing apparatus 100 according to the present embodiment. Hereinafter, the second handwritten document photographing / storing process by the information processing apparatus 100 will be described with reference to FIG. These processes are executed in cooperation with the CPU 1 and the processing program stored in the storage unit 4.

  As a premise that the second handwritten document shooting and saving process is started, for example, the user adds characters and the like to the recording medium 15 on which the document data is printed in a state where the information processing apparatus 100 is activated, and then adds the characters. It is assumed that an operation of closing the binder 13 of the information processing apparatus 100 is performed. In the second handwritten document shooting and saving process, for example, approximately 110 degrees is set as an angle suitable for shooting. Specifically, the CPU 1 generates the image by the imaging unit 8 when the opening / closing angle sensor 14 detects approximately 110 degrees as the angle between the first cover 13a and the second cover 13b (an optimum angle for imaging). The acquired image will be acquired. In addition, imaging conditions such as focus and exposure are set in accordance with an angle (approximately 110 degrees) optimum for imaging. Note that the angle suitable for shooting is not limited to 110 degrees, and an angle such as approximately 70 degrees can be selected in accordance with the angle of view of the imaging unit 8 or the like. Further, it is assumed that document data as original image data is acquired by the wireless communication unit 7 and stored in the storage unit 4. Further, an external storage medium such as a USB memory (not shown) may be connected by an I / F unit configured with a USB controller or the like, and document data as original image data may be acquired and stored in the storage unit 4. .

  In step S <b> 21, the CPU 1 determines the shooting mode as the second handwritten document shooting / storing process based on an operation by the user operation unit 6.

  In step S <b> 22, the CPU 1 activates the imaging unit 8.

  In step S <b> 23, the CPU 1 acquires a signal from the opening / closing angle sensor 14.

In step S24, the CPU 1 falls within a predetermined angle range in which the angle formed by the first cover 13a and the second cover 13b is equal to or less than a preset angle (for example, approximately 110 degrees) based on a signal from the opening / closing angle sensor 14. Judge whether or not. This step is a step of determining whether the first cover 13a and the second cover 13b are in a predetermined angle range and are in a photographing state by the closing operation of the user.
If it is determined that the angle is within the predetermined angle range, the process branches to “YES” and proceeds to step S25. If it is determined that the angle is not within the predetermined angle range, the process branches to “NO” and proceeds to step S23.

  In step S25, the CPU 1 controls the image capturing unit 8 to photograph the recording medium 15, acquires the image data photographed by the image capturing unit 8, transfers it to the RAM 3, and stores it.

  In step S <b> 26, the CPU 1 performs keystone correction processing and brightness adjustment on the image data stored on the RAM 3. The trapezoidal correction process can be performed by a known method with reference to the images of the marks M1 to M6. Here, since the imaging unit 8 is provided on the second cover 13b side, for example, on the opposite sides of the image of the rectangular recording medium, on the mark M1 to M3 side provided on the edge near the hinge unit 13c. The opposite side of the image is enlarged compared to the opposite side of the image on the mark M4 to M6 side provided at the edge far from the hinge 13c. Therefore, in order not to lower the resolution, it is more preferable to correct the trapezoid by enlarging the image on the opposite side of the two opposite sides on the mark M4 to M6 side.

  In step S <b> 27, the CPU 1 acquires a difference image between the trapezoidally corrected image data and the document data as original image data acquired by the wireless communication unit 7 as an acquisition unit and stored in the storage unit 4. This is the image data of the part where the difference image is additionally written.

In step S28, the CPU 1 adds the difference image data to the document data. That is, the difference image data is added to the document data as the original image data.
Here, the CPU 1 can also add the image data subjected to the keystone correction process to the document data after performing the character recognition by an OCR (Optical Character Recognition) program.

In step S29, the CPU 1 stores the trapezoidally corrected image data, the difference image data, and the document data to which the difference image data is added in the storage unit 4. At that time, the CPU 1 stores it in the storage unit 4 in association with the original document data.
The method of storing in association is the same as step S13 in the first handwritten document shooting and saving process.

As described above, according to the information processing apparatus 100, the first cover 13a, which is the first housing in which the recording medium 15 is disposed, and the first cover 13a are connected to the first cover 13a by the hinge portion 13c so as to be opened and closed. A second cover 13b, which is a second casing provided with the main body 12, and an opening / closing angle sensor 14 for detecting that the first cover 13a and the second cover 13b are closed to a predetermined state; The CPU 1 performs trapezoidal correction on the image data, and the imaging unit 8 is provided at a position facing the first cover 13a of the main body unit 12, and the first cover 13a is detected by the opening / closing angle sensor 14. And the second cover 13b are acquired at a timing at which it is detected that the second cover 13b is closed to a predetermined state, and the CPU 1 compares the original image data with the image data after the keystone correction to obtain a difference. To acquire the image data.
As a result, it is possible to automatically obtain the image data added to the recorded document at the timing when it is detected that the binder 13 is closed, and to obtain the difference image data corresponding to the added portion. .

Although the embodiment of the present invention has been described, the scope of the present invention is not limited to the above-described embodiment, and is included in the invention described in the claims and the equivalent scope thereof. Hereinafter, the invention described in the scope of claims of the present application will be appended.
[Appendix]
<Claim 1>
Imaging means for capturing a recording medium and acquiring image data;
Acquisition means for acquiring original image data that is the source of the image data acquired by the imaging means;
Comparing means for comparing the image data with the original image data to obtain difference image data;
Additional recording means for adding the difference image data acquired by the comparison means to the original image data;
An information processing apparatus comprising:
<Claim 2>
The acquisition means is the imaging means,
First storage means for storing the original image data acquired by the photographing means;
Second storage means for sequentially updating and storing the image data continuously acquired by the photographing means;
A determination unit that calculates a difference between the image data before and after continuously acquired by the imaging unit and determines whether the difference value exceeds a handwriting detection determination value;
Storage control means for storing the subsequent image data of the previous and subsequent image data in the second storage means only when the determination means determines that the difference value does not exceed the handwriting detection determination value. Prepared,
The determination means determines whether or not the difference value exceeds a turning detection determination value when it is determined that the difference value exceeds a handwriting detection determination value;
The comparing means, when the determining means determines that the difference value exceeds the page turning detection determination value, the original image data stored in the first storage means and the image stored in the second storage means The information processing apparatus according to claim 1, wherein the difference image data is acquired by comparing with data.
<Claim 3>
Keystone correction means for performing keystone correction on the image data,
The comparison means includes the original image data stored in the first storage means and the latest image data stored in the second storage means by the storage control means after the keystone correction is performed by the trapezoid correction means. The information processing apparatus according to claim 2, wherein difference image data is obtained by comparing the image data of the two.
<Claim 4>
A first housing in which the recording medium is disposed;
A second housing connected to the first housing so as to be openable and closable and provided with a main body;
Detecting means for detecting that the first casing and the second casing are closed to a predetermined angle;
Trapezoid correction means for performing keystone correction on the image data;
With
The imaging means is provided at a position of the main body portion facing the first casing, and the first casing and the second casing are set at the predetermined angle by the detecting means. The image data is acquired at the timing when it is detected that
The information processing apparatus according to claim 1, wherein the comparison unit acquires difference image data by comparing the original image data with the image data after the keystone correction.
<Claim 5>
The information processing apparatus according to claim 1, further comprising a character recognition unit that recognizes the difference image data.
<Claim 6>
Computer
An imaging control unit that controls an imaging unit that captures a recording medium and acquires image data;
Acquisition means for acquiring original image data that is the source of the image data acquired by the imaging means;
Comparison means for comparing the image data and the original image data to obtain difference image data;
Additional recording means for additionally writing the difference image data acquired by the comparison means to the original image data;
Program to function as.

100 Information processing apparatus 1 CPU (acquisition means, comparison means, additional recording means, addition means, determination means, storage control means, trapezoid correction means, imaging control means, character recognition means)
2 Power supply unit 3 RAM (first storage means, second storage means)
4 storage unit 41 program storage unit 4a processing program 5 touch display unit 5a display panel 5b touch panel 6 operation unit 7 wireless communication unit (acquisition means)
8 Imaging unit (imaging means)
9 Camera controller (Imaging control means)
DESCRIPTION OF SYMBOLS 10 Timekeeping part 11 Bus | bath 12 Information processing apparatus main-body part 13 Binder 13a 1st cover (1st housing | casing)
13b Second cover (second housing)
13c Hinge part 14 Opening / closing angle sensor (detection means)
15 Recording media

An object of the present invention is to be able to efficiently store a differential image of a plurality of images picked up in plural .

Claim 1 is an information processing apparatus for processing an image picked up by an image pickup means, and when a subject is picked up continuously by the image pickup means , the first image and the second image picked up continuously acquisition means for acquiring a difference value by comparing the said to determine specific difference value acquired is whether Yue Etaka not the first determination value obtaining means, determine by the not help Yue the first determination value that If it is, a first control means for controlling so as to update and store the second image as the latest image, e Yue the second determination value difference value obtained is big than the first determination value by the acquisition unit Taka whether was determine by, in which case the second determination value is determine by it was Yue example obtains a difference image of the subject image stored in advance the subject as compared to the most recent image of the update memory, Control is performed to store the obtained difference image in association with the subject image. Characterized by comprising a control means.
According to a fourth aspect of the present invention, there is provided an information processing apparatus for processing an image picked up by the image pickup unit. When the subject is picked up at a plurality of timings by the image pickup unit, the first image picked up at the first timing; An acquisition unit that acquires a difference value between the first image and the second image by comparing the second image captured at a second timing after one timing, and a difference acquired by the acquisition unit If the value does not exceed the predetermined determination value, the first control means for controlling to update and store the second image captured at the second timing as the latest image, and the difference value acquired by the acquisition means is the predetermined determination value. When the value is exceeded, control is performed to acquire a difference image between the subject image of the subject stored in advance and the latest image in the update storage, and store the acquired difference image in association with the subject image. First Characterized by comprising a control means.

According to the present invention, it is possible to efficiently store a differential image of a plurality of images captured in a plurality of parts .

Claims (6)

Imaging means for capturing a recording medium and acquiring image data;
Acquisition means for acquiring original image data that is the source of the image data acquired by the imaging means;
Comparing means for comparing the image data with the original image data to obtain difference image data;
Additional recording means for adding the difference image data acquired by the comparison means to the original image data;
With
The acquisition means is the imaging means,
First storage means for storing the original image data acquired by the imaging means;
Second storage means for sequentially updating and storing the image data continuously acquired by the imaging means;
A first determination unit that calculates a difference between the image data before and after successively acquired from the imaging unit and determines whether the difference value exceeds a handwriting detection determination value;
A storage control unit for storing, in the second storage unit, subsequent image data of the previous and subsequent image data when the first determination unit determines that the difference value does not exceed the handwriting detection determination value; ,
Second determination means for determining whether or not the difference value exceeds a turning detection determination value greater than the handwriting detection determination value when it is determined that the difference value exceeds the handwriting detection determination value;
With
The comparison means stores the original image data stored in the first storage means and the second storage means when the second determination means determines that the difference value exceeds the turning detection determination value. The information processing apparatus is characterized in that the difference image data is obtained by comparing with the obtained image data. First storage for starting image pickup means for acquiring image data by continuously shooting a recording medium, and storing image data first picked up by the image pickup means after the start-up in the initial image storage means as initial image data of the recording medium Control means;
Calculation means for calculating a difference value between image data photographed at a first timing after activation of the imaging means and image data photographed at a second timing continuous with the first timing;
When the difference value calculated by the calculation means is determined in advance and does not exceed the repeated detection determination value, the image data captured at the second timing is additionally recorded as additional image data added to the recording medium. Second storage control means for storing the
When the difference value calculated by the calculation means exceeds the turning detection determination value, the initial image data stored in the initial image storage means is compared with the additional image data stored in the additional image storage means. Comparing means for acquiring difference image data,
Additional recording means for adding the difference image data acquired by the comparison means to the initial image data stored in the initial image storage means;
An information processing apparatus comprising: Keystone correction means for performing keystone correction on the image data,
The comparison means includes the original image data stored in the first storage means and the latest image data stored in the second storage means by the storage control means after the keystone correction is performed by the trapezoid correction means. The information processing apparatus according to claim 1, wherein the difference image data is obtained by comparing the image data of the two.   The information processing apparatus according to claim 1, further comprising character recognition means for recognizing the difference image data. Computer
An imaging control unit that controls an imaging unit that captures a recording medium and acquires image data;
Acquisition means for acquiring original image data that is the source of the image data acquired by the imaging means;
Comparison means for comparing the image data and the original image data to obtain difference image data;
Additional recording means for additionally writing the difference image data acquired by the comparison means to the original image data;
Is a program for functioning as
The acquisition means is the imaging means,
First storage means for storing the original image data acquired by the imaging means;
Second storage means for sequentially updating and storing the image data continuously acquired by the imaging means;
A first determination unit that calculates a difference between the image data before and after successively acquired by the imaging unit and determines whether the difference value exceeds a handwriting detection determination value;
A storage control unit for storing, in the second storage unit, subsequent image data of the previous and subsequent image data when the first determination unit determines that the difference value does not exceed the handwriting detection determination value;
Second determination means for determining whether or not the difference value exceeds a turning detection determination value greater than the handwriting detection determination value when it is determined that the difference value exceeds the handwriting detection determination value;
Function as
The comparison means stores the original image data stored in the first storage means and the second storage means when the second determination means determines that the difference value exceeds the turning detection determination value. The difference image data is obtained by comparing with the obtained image data. Computer
First storage for starting image pickup means for acquiring image data by continuously shooting a recording medium, and storing image data first picked up by the image pickup means after the start-up in the initial image storage means as initial image data of the recording medium Control means,
Calculation means for calculating a difference value between image data photographed at a first timing after activation of the imaging means and image data photographed at a second timing subsequent to the first timing;
When the difference value calculated by the calculation means is determined in advance and does not exceed the repeated detection determination value, the image data captured at the second timing is additionally recorded as additional image data added to the recording medium. Second storage control means for storing in
When the difference value calculated by the calculation means exceeds the turning detection determination value, the initial image data stored in the initial image storage means is compared with the additional image data stored in the additional image storage means. Comparison means for acquiring difference image data
Additional recording means for adding the difference image data acquired by the comparison means to the initial image data stored in the initial image storage means;
Program to function as.

Images