JP6094660B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program.

In recent years, with the advancement of information equipment, the creation and storage of electronic documents and the management of schedules have progressed. An electronic document is characterized by ease of management, organization, searchability, and storage, compared to a handwritten document using a paper medium.
However, handwritten documents are superior to electronic documents in terms of convenience, speed, and the like, and are not expected to disappear in the future. Therefore, how to organize and use handwritten documents is an issue.
On the other hand, an apparatus is disclosed in which a memo information on a paper medium in which a memo is written by a meeting attendee during a meeting is associated with a meeting material image displayed during the meeting and registered in a predetermined storage unit ( Patent Document 1). According to this apparatus, it is possible to associate a specific display image of a conference material image displayed during a meeting with a differential image of memo information written on a paper medium while the specific image is displayed. it can.

JP 2010-176603 A

  However, in the above-described apparatus, in order to associate event information such as a conference registered in a scheduler for performing schedule management with a handwritten document handwritten by the event, it is possible to associate them manually. Although there was a problem, it was complicated.

An object of the present invention to such an image information captured easily associated with the predetermined information.

Claim 1 is an information processing apparatus for processing an image captured by the imaging means, and selection means to arbitrarily select one of the predetermined information among a plurality of predetermined information prepared in advance When the information processing apparatus is changed to a specific state, a determination unit that determines whether any of the plurality of pieces of predetermined information has been arbitrarily selected in advance, and the determination unit If the Kano prescribed information has been previously selected, the image captured by the imaging means, and control to store in the storage means in association with the predetermined information selected by said selection means, one of predetermined information If there is predetermined information that can be specified by the current date and time among the plurality of predetermined information, control is performed so as to store the image captured by the imaging means in association with the predetermined information. Storage control means And wherein the door.
A second aspect of the present invention is an information processing apparatus for processing an image picked up by an image pickup means, and a selection means for arbitrarily selecting any predetermined information from a plurality of predetermined information prepared in advance, When an image is picked up by the image pickup means, a determination means for determining whether any of the plurality of predetermined information has been arbitrarily selected in advance, and any of the predetermined information is determined by the determination means. If it has been selected in advance, control is performed so that the image captured by the imaging unit is stored in the storage unit in association with the predetermined information selected by the selection unit, and any of the predetermined information is selected in advance. If there is no predetermined information that can be specified by the current date and time among the plurality of predetermined information, a storage control unit that controls to store the image captured by the imaging unit in association with the predetermined information; It was equipped with To.

According to the present invention, it is possible to associate image information captured easily and the predetermined information.

It is an appearance perspective view of an information processor concerning this embodiment. It is a block diagram which shows the internal structure of the information processing apparatus which concerns on this embodiment. It is a figure which shows the open / closed state of the cover in information processing apparatus. (A) is a figure which shows the state which the 1st cover and 2nd cover of information processing apparatus opened, (B) is a figure which shows the state in which a 2nd cover overlaps on a 1st cover. It is. It is a figure which shows the display screen of a scheduler. (A) is a calendar display diagram, and (B) is a diagram displaying individual schedules. It is a figure which shows the data structure memorize | stored in the memory | storage part in the scheduler. It is a figure which shows the data structure of the memo image managed by the image management program. It is a figure which shows the flow of the link process performed by information processing apparatus. It is a figure which shows an example of a handwritten memo. It is a figure which shows the handwritten memo display screen by an image management program, (A) is a figure which shows a list display, (B) is a figure which shows a handwritten memo 1 page display. It is a figure showing the state where the information processor concerning a modification was leaned against a binder.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is an external perspective view of an information processing apparatus 100 according to the present embodiment. FIG. 2 is a block diagram showing an internal configuration of the information processing apparatus 100 according to the present embodiment.

The information processing apparatus 100 is, for example, a tablet terminal device having an A5 size, and includes a main body 12 and a binder 13 as a housing.
The main body unit 12 is provided with a touch display unit 5 for screen display and touch input, an imaging unit 8 as an imaging unit, and the like. The imaging unit 8 is disposed in the central part of the frame on the long side farther from the rotation axis by the hinge part 13c (the left central part on the front side in FIG. 1) of the outer part of the touch display part 5. .

  The binder 13 as a housing is configured by connecting a first cover 13a as a first housing and a second cover 13b as a second housing so that the hinge portion 13c can be opened and closed. ing. The recording medium 15 is disposed on the first cover 13a, and the main body 12 is provided on the second cover 13b. The main body 12 and the recording medium 15 are detachably attached to the binder 13 by fasteners, hooks, and the like.

  In the present embodiment, the recording medium 15 indicates a medium on which information to be imaged is recorded, and means a subject on which information is recorded. The recording medium 15 is a notebook or report sheet used when a user takes notes, a sheet on which a document is printed, a book, or the like. However, the recording medium 15 may be a medium on which information to be imaged is recorded, and the material is not limited to paper. The recording medium 15 may be a sheet of paper, or may be bound in a booklet form. The recording medium 15 also includes electronic paper that can display information electronically.

  The 1st cover 13a and the 2nd cover 13b are comprised by flat rectangular shape, and can be opened and closed by the hinge part 13c so that a book and a notebook may be opened and closed. FIG. 1 illustrates a state in which the angle formed by the first cover 13a and the second cover 13b is 180 ° (open state). In this state, the user refers to the screen displayed on the touch display unit 5 and performs touch input, and enters characters, diagrams, and the like on the recording medium 15.

  The hinge part 13c is provided with an opening / closing angle sensor 14 for detecting an angle formed by the first cover 13a and the second cover 13b. The opening / closing angle sensor 14 includes a rotary encoder that detects the rotation of the shaft of the hinge portion 13c and a magnetic sensor that detects the opening / closing state using a hall element or the like. Here, the opening / closing angle sensor 14 functions as a detecting means.

  As shown in FIG. 2, the information processing apparatus 100 includes a CPU (Central Processing Unit) 1 that performs overall control of the device, an operation unit 6 that includes operation keys, and a RAM that provides the CPU 1 with a working memory space. (Random Access Memory) 3, a touch display unit 5 having a structure in which a touch panel 5b is stacked on a display panel 5a, a storage unit 4 storing a control program executed by the CPU 1, control data, and the like, and a wireless communication unit 7 An image pickup unit 8 that picks up an optical image of the subject, a timer unit 9 that measures the current date and time, an opening / closing angle sensor 14 that detects an angle formed by the first cover 13a and the second cover 13b, and the like are provided. The CPU 1, the operation unit 6, the RAM 3, the touch display unit 5, the storage unit 4, the wireless communication unit 7, the imaging unit 8, the time measuring unit 9 as a time measuring unit, and the opening / closing angle sensor 14 are connected via a bus 10.

  The CPU 1 comprehensively controls the processing operation of each unit of the information processing apparatus 100 according to an operation signal input from the operation unit 6 or the touch panel 5 b or an instruction signal received by the wireless communication unit 7. Specifically, the CPU 1 reads out various processing programs stored in the storage unit 4, develops them in the RAM 3, and performs various processes in cooperation with the programs.

  A power supply unit (secondary battery) 2 supplies power to each unit.

  The storage unit 4 includes, for example, a rewritable ROM (Read Only Memory), a flash memory, and the like, and stores various data and various programs in a readable and writable manner. The storage unit 4 stores a scheduler program 41, an OCR (Optical Character Recognition) program 42, an image management program 43, and a tagging program 44. The storage unit 4 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). The state may include a storage area on a predetermined server device side.

  The touch display unit 5 has a structure in which a touch panel 5b is stacked on a display panel 5a, and the display panel 5a as a display means has a high-definition liquid crystal display having screens with different aspect ratios (for example, horizontal 4: vertical 3). The touch panel 5b constitutes a touch screen that detects the position touched by the photographer's finger and inputs coordinate data. For example, the touch panel 5b employs a capacitance method or a resistance film method. However, other methods may be used. Here, the touch panel 5b functions as an operation means.

  Although not shown, the operation unit 6 includes a push button type key such as a power key for turning on / off the power, and the CPU 1 responds to an input operation signal output from the operation unit 6 corresponding to the operation key. Process. Here, the operation unit 6 functions as an operation means.

  The wireless communication unit 7 is a wireless communication module capable of high-speed and large-capacity communication. For example, the wireless communication unit 7 can be connected to the Internet via a nearby wireless LAN (Local Area Network) router (not shown).

  Although the imaging unit 8 captures an optical image of a subject and is not shown, the subject image from the optical lens is imaged on an image sensor (CCD, CMOS, etc.), so that the subject can be captured with high definition. In a digital camera unit, for example, a zoom lens and an accompanying zoom driving unit, a focusing driving unit, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), a timing generator, a driver, etc. And converting the captured optical image into a two-dimensional image signal. During operation of the image reading function, for example, continuous imaging (high-speed image) with a frame rate of 15 frames per second (15 fps) is possible. Here, the CPU 1 and the imaging unit 8 function as imaging means.

  The timer unit 9 counts signals input from an oscillation circuit unit (not shown) to obtain internal time and the like. Then, the internal time is output to the CPU 1. Here, the internal time refers to the current date and time measured by the time measuring unit 9.

The scheduler program 41 is a program for managing time and schedule. This program can input, edit, and display a schedule, start / end times of the schedule, attendees, and the like.
Here, information including an event as a schedule and a date and / or attendance associated with the event is referred to as event information.
Here, the CPU 1, the scheduler program 41, and the storage unit 4 function as a scheduler (management means).

  FIG. 4 is a diagram showing a scheduler display screen by the schedulers 1, 4 and 41. FIG. 4A shows a calendar display screen 411, and FIG. 4B shows an individual event (schedule) display screen 412. An imaging icon 51 and a registration icon 52 are displayed on the screen of FIG. The user can register individual events in the storage unit 4 from the event (schedule) display screen shown in FIG.

  FIG. 5 is a diagram showing a data structure stored in the storage unit 4 in the schedulers 1, 4 and 41 as management means. For each individual event, an ID, event name, date and time (start date and time, end date and time), attendees, and the like are registered.

The OCR program 42 is a program that recognizes an input image into binarized image data by image processing, specifies characters and codes by collation with a previously stored pattern, and outputs character / code data.
Here, the CPU 1 and the OCR program 42 function as recognition means for recognizing the date and time from the image data.

The image management program 43 is a program for displaying / managing image data of a memo image captured by the imaging unit 6.
FIG. 6 is a diagram showing the data structure of the memo image managed by the image management program 43. For each individual memo image, an ID, an image name, an associated date and time, and the like are registered in the storage unit 4.

  The tagging program 44 is a program for tagging image data of a memo image captured by the imaging unit 6.

  Next, the operation of the information processing apparatus 100 according to the present embodiment will be described. FIG. 3 is a diagram illustrating an open / closed state of the binder 13 in the information processing apparatus 100. FIG. 3A is a diagram illustrating a state in which the first cover 13a and the second cover 13b of the information processing apparatus 100 are opened, and FIG. 3B is a diagram illustrating the second cover on the first cover 13a. It is a figure which shows the state in which the cover 13b overlaps.

  For example, the user can use the information processing apparatus 100 in a state where the binder 13 is opened 180 degrees, or can write a chart or the like on the recording medium 15. When the information processing 100 and the recording medium 15 are not used, the first cover 13a and the second cover 13b can be closed to completely close the binder 13 (opening / closing angle is 0 degree).

  FIG. 7 is a diagram illustrating a flow of link processing between a handwritten memo and an event executed by the information processing apparatus 20. Hereinafter, a link process between a handwritten memo and an event by the information processing apparatus 20 will be described with reference to FIG. These processes are executed in cooperation with the CPU 1 and various programs stored in the storage unit 4.

  As a premise that the link process between the handwritten memo and the event is started, for example, the handwritten memo is recorded on the recording medium 15 in a state where the information processing apparatus 100 is activated, and after the recording, the binder 13 of the information processing apparatus 100 is recorded. It is assumed that a closing operation is performed. In the link process between the handwritten memo and the event, an opening / closing angle of approximately 70 degrees is set as the optimum angle for imaging. Specifically, the CPU 1 generates the image by the imaging unit 8 when the opening / closing angle sensor 14 detects approximately 70 degrees as the angle between the first cover 13a and the second cover 13b (an optimum angle for imaging). The acquired memo image is acquired. In addition, imaging conditions such as focus and exposure are set in accordance with an angle (approximately 70 degrees) optimum for imaging.

  In step S <b> 1, the CPU 1 determines whether the camera has been activated from the schedulers 1, 4, and 41. Specifically, in a state where the schedulers 1, 4, and 41 are activated, the imaging icon 51 displayed on the scheduler screen 411 illustrated in FIG. 4A is selected, and the imaging unit 8 enters the imaging mode. It is determined whether or not. If the imaging icon 51 displayed on the scheduler screen 411 is selected and the imaging unit 8 is in the imaging mode, the process branches to “YES” and proceeds to step S2. Otherwise, it branches to “NO” and proceeds to step S3.

  In step S2, when the user manually selects a corresponding event from the event list (calendar display screen 411), the CPU 1 stores the ID of the selected event in the RAM 3. Here, the ID is an ID for identifying an event registered in the scheduler 1, 4, 41.

  In step S <b> 3, the CPU 1 detects an operation of closing the binder 13 by the user, controls the imaging unit 8 to capture a handwritten memo recorded on the recording medium 15, and captures the memo image generated by the imaging unit 8. Store in the RAM 3.

  In step S <b> 4, the CPU 1 determines whether the schedule ID is stored in the RAM 3. The case where the schedule ID is stored on the RAM 3 is the case where the schedule ID designated by the user in step S2 is stored on the RAM 3, in which case the process branches to “YES” and the step The process proceeds to S11. If the schedule ID is not stored in the RAM 3, the process branches to "NO" and proceeds to step S5.

  In step S <b> 5, the CPU 1 determines whether the date / time is recorded in the captured memo image 151.

  FIG. 8 is a diagram showing a handwritten memo 151 to be imaged. Specifically, the CPU 1 executes the OCR program 42 on the image data of the captured memo image 151 shown in FIG. 8 to detect a predetermined mark. As the predetermined mark, for example, a square-shaped at mark (@) and a square-shaped # mark shown in FIG. 8 are defined. Such a mark should not be easily confused with other marks. If it is recognized that the date and time is recorded beside or near the predetermined mark, the CPU 1 causes the OCR program 42 to recognize the date and time. In the example of FIG. 8, the date and time “2012.4.20” recorded on the right side of the at-sign (@) enclosed in the square is recognized. In this way, the CPU 1 determines whether the date and time is recorded in the memo image. If it is determined that the date and time is recorded in the memo image, the CPU 1 branches to “YES” and proceeds to step S7. If it is determined that the date and time are not recorded in the memo image, the process branches to "NO" and proceeds to step S6.

Returning to FIG. 7, in step S <b> 6, the CPU 1 acquires the current date and time from the time measuring unit 9. The current date and time is the date and time when the CPU 1 is executing step S6, and is the date and time when the handwritten memo is substantially captured and the memo image is acquired.
Here, the date and time recorded in the memo image or the date and time when the handwritten memo is captured and the memo image is acquired (current date and time) is referred to as an associated date and time. Further, the CPU 1 functions as an associated date acquisition unit.

  In step S7, the CPU 1 reads and acquires the date and time recorded in the memo image. Specifically, as shown in FIG. 8, the CPU 1 reads and acquires the date and time “2012.4.20” recorded on the right side of the square-shaped at sign (@).

  In step S8, the CPU 1 determines whether there is an event related to the acquired current date and time or the date and time recorded in the memo image.

Specifically, the CPU 1 refers to the data structure in the schedulers 1, 4, and 41 as shown in FIG.
The related event is the current date or time acquired or the date and time recorded in the memo image is included in the registered event registration time (specified by the event start date and time) An event. However, the current date and time or the date and time recorded in the memo image may not match the schedule registration time, taking into account the occurrence of circumstances such as the meeting time extending beyond the scheduled time of the schedule or starting earlier. Allow some delay or advance. For example, if there is a schedule registered at a registration time slightly later than the current date and time or the date and time recorded in the memo image, the schedule is determined to be a related schedule.

  If it is determined that there is a schedule related to the acquired current date and time or the date and time recorded in the memo image, the process branches to “YES” and proceeds to step S9. If it is determined that there is no related schedule, the process branches to "NO" and proceeds to step S10.

  In step S9, the CPU 1 stores in the RAM 3 the ID of the related schedule retrieved in step S8.

  In step S10, the CPU 1 displays a list of events (calendar display screen 411) on the display panel 5a. When the user designates an event, the CPU 1 selects the event and stores the ID in the RAM 3.

  In step S11, the CPU 1 links the memo image with the event searched in step S8 or selected by the user in step S10. Specifically, the CPU 1 stores the event ID stored in the RAM 3 as an index in the data structure of the memo image shown in FIG. And it ends.

  Next, the display operation of the memo image by the CPU 1 and the image management program 43 will be described.

9A and 9B are diagrams showing a memo image display screen by the image management program. FIG. 9A shows a memo image list display screen 431 and FIG. 9B shows a memo image 1-page display screen 432. FIG. In FIG. 9A, the date and time (date) is displayed on the left, the tag is displayed in the center, and the memo image with the selected tag is displayed on the right. In FIG. 9A, three memo images are displayed. The tag at the center in the diagram showing the list display in FIG. 9A is a tag attached to the memo image captured by the imaging unit 6 by the tagging program 44. Tagging is automatically performed by a schedule title or the like that matches the date and time information. Further, the user is manually tagged by a new tagging icon 53. When a tag and date are specified, the corresponding memo image is displayed on the right side.
When the lower memo is selected from the three memo images shown in FIG. 9A, the screen shifts to a one-page display of the memo image shown in FIG. 9B.

Next, a description will be given of an operation when reading a memo image and an event associated with each other by a link process between a handwritten memo and a schedule.
By associating the event ID registered in the scheduler 1, 4, 41 with the ID of the memo image, the memo image is read by designating the schedule, or the schedule at that time is designated by designating the memo image. It is possible to call information to each other like reading. This will be specifically described below.

Assume that a predetermined event display 412 registered in the schedulers 1, 4, 41 is displayed on the display panel 5 a of the touch display unit 5 as shown in FIG. On the screen of the event display 412, a memo image icon 412i indicating that there is a memo image related to the event when the above-described index is detected by the schedulers 1, 4, and 41 is displayed.
When the memo image icon 412i is touched as an operation instruction from the touch panel 5b of the user in such a state, the CPU 1 determines that the operation instruction has been input, and the CPU 1 stores the storage unit 4 via the image management program 43. 9 reads out a memo image (image data) associated with schedule information (event information) displayed on the display panel 5a, and an image based on the read memo image (image data) is shown in FIG. Are displayed on the display panel 5a.
Here, the CPU 1 functions as display control means for controlling such display.

On the other hand, it is assumed that a memo image based on the image data stored in the storage unit 4 is displayed on the display panel 5a of the touch display unit 5 as shown in FIG. When the schedule shift button 54 is touched as an operation instruction for switching the display on the touch panel 5b of the user in such a state, the CPU 1 determines that the operation instruction has been input, and the CPU 1 passes through the scheduler program 41. The event information associated with the image data of the memo image displayed on the display panel 5 a of the touch display unit 5 is read, and the read event information is displayed on the display panel 5 a of the touch display unit 5 as the event display 412.
Here, the CPU 1 functions as display control means for controlling such display.

  In this way, the user goes back to the past schedule by the schedulers 1, 4, and 41, searches for when this meeting was held, what the last month's regular meeting was, and reads the memo image at that time it can.

[Modification]
Next, an information processing apparatus 100A according to a modification of the present embodiment will be described. In the following description, the same components as those of the information processing apparatus 100 according to the present embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  FIG. 10 is a diagram illustrating a state in which the information processing apparatus 100A according to the modification is leaned against the binder 13A. It is a figure which shows the state by which the recording medium 15 was placed in front of information processing apparatus 100A. In the modification, the recording medium 15 is configured as a booklet composed of a plurality of pages, and the handwritten memo of the recording medium 15 is imaged by the imaging unit 8 at the timing of turning the page of the recording medium 15. When the recording medium 15 is placed so that the upper and lower ends of the information processing apparatus 100 </ b> A are aligned with the upper end of the recording medium 15, the angle of view and the focus of the imaging unit 8 are set in advance so as to match the recording medium 15.

  The information processing apparatus 100A is different from the information processing apparatus 100 shown in the first embodiment in that the opening / closing angle sensor 20 is unnecessary, but the other configuration is the same as that of the information processing apparatus 100. Therefore, FIG. 1 is used and description is abbreviate | omitted. Hereinafter, a configuration and operation characteristic of the modification will be described.

  In the information processing apparatus 100 </ b> A according to the modification, the CPU 1 captures a plurality of pages of the recording medium 15, and acquires the current date and time at that time from the time measuring unit 9 when the acquisition is completed. Alternatively, a predetermined mark and date information recorded on the first page of the recording medium 15 are recognized by the OCR program 42 and acquired. In addition, it is good also as the time of acquiring the time when the first imaging was performed instead of when imaging was completed. Further, the predetermined mark may be recorded in the middle or the last page of a plurality of pages.

First, when an instruction to start the imaging mode is given by the user's operation from the touch panel 5b, the CPU 1 continuously captures moving image data by the imaging unit 8, and analyzes the moving image data. A page turning operation of the imaged recording medium 15 is detected. While the image data output from the imaging unit 8 is changing, it is estimated that each page of the recording medium 15, the user's finger, and the like are moving. The CPU 1 continues to capture the moving image data picked up by the image pickup unit 8 and determines that the page turning operation has been performed when the image is still.
The CPU 1 causes the imaging unit 8 to perform imaging at the timing when the page turning operation of the recording medium 15 is detected. The CPU 11 controls the imaging unit 8 to image a handwritten memo recorded in the recording medium 15 and stores the memo image (still image) generated by the imaging unit 8 in the RAM 3.

Next, the CPU 1 determines whether or not there is an instruction to end the imaging mode by an operation from the touch panel 5b of the user. When there is no instruction to end the imaging mode, the CPU 1 continues the detection process of the page turning operation of the recording medium 15 being imaged. When the turning operation is detected, the CPU 1 captures the handwritten memo recorded in the recording medium 15 and stores the image data of the memo image in the RAM 3.
On the other hand, when there is an instruction to end the shooting mode, the recording medium imaging process ends.

  The method of associating a plurality of memo images and schedule information (event information) and storing them in the storage means in the modification is the same as the link process between the handwritten memo and the schedule in the embodiment.

  As described above, according to the information processing apparatus 100 according to the present embodiment, the imaging unit 8 that captures an image of the recording medium 15 and acquires image data (memo image), and event information including the date and time related to the event are registered. And scheduler 1, 4, 41 as management means for performing schedule management, and CPU 1 as association date and time acquisition means for acquiring association date and time for associating image data with event information in the scheduler 1, 4, 41. And CPU 1 as storage control means for storing the image data in the storage unit 4 in association with event information including the date and time corresponding to the association date and time acquired by the CPU 1 as the association date and time acquisition means. Thereby, when a handwritten memo is imaged, the memo image can be linked to related events (schedules) in the schedulers 1, 4, 41.

  In addition, the information processing apparatus 100 is connected to a first cover 13a as a first housing in which the recording medium 15 is arranged, and the first cover 13a by a hinge part 13c so as to be openable and closable. And a second cover 13b as a second housing, and an opening / closing angle sensor 14 for detecting that the first cover 13a and the second cover 13b are closed to a predetermined state. The part 8 is provided at a position facing the first cover 13a of the main body part 12, and the first cover 13a and the second cover 13b are closed to a predetermined state by the opening / closing angle sensor 14. Image data is acquired at the detected timing. Thereby, it is not necessary for the user to perform an operation for registering the handwritten memo in the schedulers 1, 4, 41, and the memo image by the handwritten memo is automatically linked to the related schedule by the operation of closing the binder 13. Can do.

  In addition, the information processing apparatus 100 includes a timing unit 9 that counts the date and time, and the CPU 1 as the associated date and time acquisition unit acquires the date and time when the image data was acquired from the timing unit 9 as the associated date and time. Thereby, using the current date and time when the handwritten memo is imaged, the handwritten memo and the schedule can be linked by matching the current date and time with the registered date and time of the schedule in the schedulers 1, 4, and 41.

  The information processing apparatus 100 includes recognition means 1 and 42 for recognizing the date and time from the image data (memo image), and the associated date and time acquisition means 1 uses the date and time recognized by the recognition means 1 and 42 as the associated date and time. get. Thereby, the memo image and the schedule can be linked by matching the date and time recorded in the handwritten memo with the schedule registration date and time in the schedulers 1, 4, and 41.

The information processing apparatus 100 also displays the display panel 5a, the touch panel 5b that receives an operation instruction from the user, and the event information registered in the schedulers 1, 4, and 41 from the touch panel 5b in a state where the event information is displayed on the display panel 5a. When an operation instruction for switching the display is input, image data associated with the event information displayed on the display panel 5a is read from the storage unit 4, and an image based on the read image data is displayed on the display panel 5a. When an operation instruction for switching display is input from the touch panel 5b in a state where an image based on the image data stored in the storage unit 4 is displayed on the display panel 5a, the schedulers 1, 4, 41 are displayed. Event associated with the image data of the image displayed on the display panel 5a It reads the broadcast, and a CPU1 as a display control means for displaying the read event information to the display panel 5a, a.
Thereby, it is possible to search and display a corresponding memo image directly from a predetermined event displayed by the schedulers 1, 4 and 41, and to display corresponding event information directly from the displayed memo image. .

  The present invention is not limited to the above-described embodiment, and various modifications can be made. For example, if a handwritten memo has a plurality of blocks, and each block has, for example, a square at sign (@) and a date recorded therein, the date and time is recognized for each block, and the schedule matches the date and time separately. You can also link to

  It is also possible to manually link the two by manually picking up a handwritten memo and then selecting the corresponding schedule by handwriting.

Although the embodiment of the present invention has been described, the scope of the present invention is not limited to the above-described embodiment, and is included in the invention described in the claims and the equivalent scope thereof. Hereinafter, the invention described in the scope of claims of the present application will be appended.
[Appendix]
<Claim 1>
Imaging means for capturing a recording medium and acquiring image data;
Management means for registering event information including date and time related to the event and managing the schedule,
Association date and time acquisition means for acquiring an association date and time for associating the image data with event information of the management means;
Storage control means for storing the image data in association with event information including date and time corresponding to the association date and time acquired by the association date and time acquisition means;
An information processing apparatus comprising:
<Claim 2>
A first housing in which the recording medium is disposed;
A second housing which is connected to the first housing by a hinge portion so as to be openable and closable and provided with a main body portion;
Detecting means for detecting that the first casing and the second casing are closed to a predetermined state;
With
The imaging means is provided at a position of the main body portion facing the first casing, and the first casing and the second casing are closed to the predetermined state by the detecting means. The information processing apparatus according to claim 1, wherein the image data is acquired at a timing when it is detected.
<Claim 3>
It has a timekeeping means to keep time
3. The information processing apparatus according to claim 1, wherein the associated date and time acquisition unit acquires the date and time when the image data was acquired from the timing unit as the associated date and time.
<Claim 4>
Recognizing means for recognizing the date and time from the image data,
The information processing apparatus according to claim 1 or 2, wherein the association date acquisition unit acquires the date recognized by the recognition unit as the association date.
<Claim 5>
Display means;
An operation means for receiving an operation instruction by a user;
When the operation information for switching the display is input from the operation unit while the event information registered in the management unit is displayed on the display unit, the display unit displays the event information registered on the display unit from the storage unit. Image data associated with the event information is read out, an image based on the read image data is displayed on the display means, and an image based on the image data stored in the storage means is displayed on the display means. Event information associated with image data of an image displayed on the display means is read from the management means when an operation instruction for switching the display is input from the operation means in the state, and the read event information Display control means for displaying on the display means;
The information processing apparatus according to any one of claims 1 to 4, further comprising:
<Claim 6>
Computer
Imaging means for capturing a recording medium and acquiring image data;
Management means for registering event information including date and time related to the event and managing the schedule,
Association date and time acquisition means for acquiring an association date and time for associating the image data with event information of the management means;
Storage control means for storing the image data in association with event information including date and time corresponding to the association date and time acquired by the association date and time acquisition means;
Program to function as.

100, 100A Information processing apparatus 1 CPU (imaging means, management means, associated date acquisition means, storage control means, recognition means, display control means)
2 Power supply 3 RAM
4 Storage unit (storage means, management means)
5 Touch display part 5a Display panel (display means)
5b Touch panel (operating means)
6 Operation part (operation means)
7 Wireless communication unit 8 Imaging unit (imaging means)
9 Timekeeping section (timekeeping means)
DESCRIPTION OF SYMBOLS 10 Bus 12 Information processing apparatus main body 13 Binder 13a 1st cover 13b 2nd cover 13c Hinge part 14 Opening / closing angle sensor (detection means)
15 Recording medium 41 Scheduler program (management means)
42 OCR program (recognition means)
43 Image management program 44 Tagging program 51 Imaging icon 52 Registration icon 53 New tagging icon 411 Calendar display 412 Event (schedule) display 412i Memo image icon 431 Memo image list display screen 432 Memo image 1 page display screen

Claims (5)

An information processing apparatus for processing an image captured by the imaging means,
A selection means for arbitrarily selecting any one of a plurality of predetermined information prepared in advance;
When changing the information processing apparatus to a specific state, and determination means for determining whether any given information of the plurality of predetermined information have been previously arbitrarily selected,
If any of the predetermined information is selected in advance by the determination unit, control is performed so that the image captured by the imaging unit is stored in the storage unit in association with the predetermined information selected by the selection unit , If any of the predetermined information is not selected in advance, if there is predetermined information that can be specified by the current date and time among the plurality of predetermined information, an image captured by the imaging unit is associated with the predetermined information. Storage control means for controlling to store;
Information processing apparatus characterized by comprising a. An information processing apparatus for processing an image captured by the imaging means,
A selection means for arbitrarily selecting any one of a plurality of predetermined information prepared in advance;
A discriminating unit that discriminates whether or not any predetermined information is arbitrarily selected in advance among the plurality of predetermined information when an image is captured by the imaging unit;
If any of the predetermined information is selected in advance by the determination unit, control is performed so that the image captured by the imaging unit is stored in the storage unit in association with the predetermined information selected by the selection unit , If any of the predetermined information is not selected in advance, if there is predetermined information that can be specified by the current date and time among the plurality of predetermined information, an image captured by the imaging unit is associated with the predetermined information. Storage control means for controlling to store;
Information processing apparatus characterized by comprising a. Event storage means for storing a plurality of event information;
Further comprising
The selecting means arbitrarily selects any event information from a plurality of event information stored in the event storage means,
The storage control unit controls to store the image captured by the imaging unit in association with the event information selected by the selection unit;
Information processing apparatus according to claim 1 or 2, characterized in that. A program for controlling a computer of an information processing apparatus that processes an image captured by an imaging means,
The computer,
A selection means for arbitrarily selecting any predetermined information from a plurality of predetermined information prepared in advance;
A discriminating means for discriminating whether or not any predetermined information among the plurality of predetermined information has been arbitrarily selected in advance when the information processing apparatus is changed to a specific state;
If any of the predetermined information is selected in advance by the determination unit, control is performed so that the image captured by the imaging unit is stored in the storage unit in association with the predetermined information selected by the selection unit , If any of the predetermined information is not selected in advance, if there is predetermined information that can be specified by the current date and time among the plurality of predetermined information, an image captured by the imaging unit is associated with the predetermined information. Storage control means for controlling to store,
A program designed to function as A program for controlling a computer of an information processing apparatus that processes an image captured by an imaging means,
The computer,
A selection means for arbitrarily selecting any predetermined information from a plurality of predetermined information prepared in advance;
Wherein when the captured images by the imaging means, determining means for determining whether any given information of the plurality of predetermined information have been previously arbitrarily selected,
If any of the predetermined information is selected in advance by the determination unit, control is performed so that the image captured by the imaging unit is stored in the storage unit in association with the predetermined information selected by the selection unit, If any of the predetermined information is not selected in advance, if there is predetermined information that can be specified by the current date and time among the plurality of predetermined information, an image captured by the imaging unit is associated with the predetermined information. Storage control means for controlling to store,
A program designed to function as

Images