JP2016099833A - Information processor and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor and a program capable of handling plural objects of plural categories as the objects of the information processing in an information processing using an image data of the object including characters.SOLUTION: An information processor 1 includes: a data acquisition part 102 that acquires an image data document 4 including characters; a category storage unit 104 that stores a piece of category information which represents image data corresponding to plural categories each of which represents the type of a document 4; and a category classification section 105 that classifies the image data into any of plural categories by collating the image data and the category information with each other.SELECTED DRAWING: Figure 1

Description

  The present invention generally relates to an information processing device and a program, and more particularly to an information processing device and a program using image data of an object on which characters are written.

  Conventionally, there is an electronic household account book in which image information of a receipt is read by an image scanner, character-recognized information is classified from the image information, and the classified information is edited into a household account book format (see, for example, Patent Document 1).

JP-A-4-256165

  However, in the above-described prior art of Patent Document 1, only receipts are subject to information processing, and objects other than receipts (for example, guarantees, New Year's cards, etc.) cannot be subject to information processing.

  The present invention has been made in view of the above-described reasons, and the object thereof is information that can target a plurality of categories of objects in information processing using image data of the objects on which characters are written. To provide a processing device and a program.

  An information processing apparatus according to the present invention includes a data acquisition unit that acquires image data of an object on which characters are written, and one of a receipt, a schedule, a warranty, and a New Year's card as a plurality of categories indicating the type of the object. A category storage unit that stores category information indicating characteristics of image data corresponding to each of a plurality of categories including the above, the image data and the category information are collated, and the image is stored in any of the plurality of categories. And a category classification unit for classifying data.

  The program according to the present invention causes a computer to function as an information processing apparatus.

  As described above, the information processing apparatus and the program according to the present invention can target a plurality of categories of objects in information processing using image data of the object on which characters are described. effective.

1 is a block diagram illustrating a configuration of an information processing system according to a first embodiment. 3 is a flowchart illustrating classification processing according to the first embodiment. FIG. 4 is a diagram illustrating format data of a category “New Year's card” in the first embodiment. It is a figure which shows an example of the classification | category setting value of the attribute "foodstuff" of Embodiment 1. FIG. 6 is a diagram illustrating an example of a classification setting value of an attribute “consumable” according to the first embodiment. FIG. It is a figure which shows the example of classification | category of the character information of the category "receipt" of Embodiment 1. It is a block diagram which shows the structure of the information processing system of Embodiment 2.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 shows the configuration of the information processing system of this embodiment.

  The information processing system includes an information processing device 1 and an information terminal 2 as main components.

  The information processing apparatus 1 includes a scan unit 101, a data acquisition unit 102, an image storage unit 103, a category storage unit 104, a category classification unit 105, an attribute storage unit 106, an attribute classification unit 107, an extracted data storage unit 108, a processing unit 109, A communication unit 110 is provided. This information processing apparatus 1 is provided in a home.

  Hereinafter, the operation of the information processing apparatus 1 will be described with reference to the flowchart of FIG.

  The scanning unit 101 optically reads an image of the document 4 (object) on which characters are written by using a scan function, and generates image data (S1). The scanning unit 101 can sequentially generate image data of a plurality of documents 4 by sequentially supplying a plurality of documents 4 sequentially by an auto sheet feeder. Alternatively, instead of the scan unit 101, a captured image obtained by capturing the document 4 using a camera, a smartphone with a camera function, or the like may be used as the image data.

  The data acquisition unit 102 acquires the image data generated by the scan unit 101 and stores it in the image storage unit 103 (S2). The image data is formed by image data, for example.

  Here, the category indicating the type of the document 4 in which the characters are written includes “receipt”, “guarantee”, “schedule” (for example, handwritten note, invitation, etc.) in which a person's action schedule is described, There are "New Year's cards", "Address books", "Contracts", etc. The category classification unit 105 classifies the category of the image data of the read document 4 (S3).

  First, the document 4 has unique characteristics for each category. For example, the document 4 may contain characters or character strings (hereinafter referred to as character information) unique to the category to which the document belongs. The document 4 may have a character information arrangement form specific to the category to which the document belongs. Further, the document 4 may have a symbol unique to the category to which the document belongs. Further, the document 4 may include a color unique to the category to which the document belongs. That is, the feature of the document 4 is represented by at least one of character information, character information layout, symbols, and colors.

  Therefore, the category storage unit 104 stores category information indicating features unique to each of the plurality of categories.

  As the “receipt” category information, format data (image data) of each of a plurality of receipts and character information generally used in receipts are stored. Receipts are generally created in a format that includes items such as “article name”, “purchase date”, “purchase price”, etc. The format data of various receipts is classified into the “receipt” category. Used as information. In addition, character information relating to “article name”, “purchase date”, “purchase amount” and the like generally used in receipts is also used as “receipt” category information. The receipt includes a receipt.

  Further, as the category information of the “guarantee”, character information generally used in the guarantee is stored. For example, character information such as “Warranty” and “Warranty Expiration Date” generally used in a warranty is used as category information of “Warranty”.

  In addition, character information generally used in a schedule is stored as category information of “schedule”. For example, character information relating to “held”, “collection”, “date and time” and the like that are generally used in a schedule is used as category information of “schedule”.

  As the category information for “New Year's card”, format data for the New Year's card shown in FIG. 3 is stored. The New Year's card has a destination address area and a sender address area. In general, in a destination description area, a destination zip code 201, a destination address 202, and a destination name 203 are described. In the sender description area, the sender's postal code 211, sender address 212, and sender name 213 are described. The format data of such New Year's cards is used as category information of “New Year's cards”. In addition, the format data includes information on symbols unique to New Year's cards (for example, New Year's cards, New Year's card numbers, etc.). Symbol information unique to these New Year's cards is also included in the category information of “New Year's cards”. Used as Further, the format data includes information on the color unique to the New Year's card (for example, vermilion), and the color information on the New Year's card is also used as category information of “New Year's card”.

  In addition, as address information category information, format data of a plurality of address books is stored. The address book is generally created in a tabular format that includes items such as “address”, “name”, “phone number”, “email address”, etc. Format data of various address books created in this tabular format Is used as the category information of the “address book”.

  In addition, as the category information of the “contract”, character information generally used in the contract is stored. For example, character information such as “contract”, “conclude”, “former”, and “secondary” that is generally used in contracts is used as category information of “contracts”.

  Specific category information is not limited to the above-described category information.

  Specifically, the category classification unit 105 reads the image data of the document 4 from the image storage unit 103 and extracts the above-described features from the image data. Then, the category classification unit 105 sequentially reads out the category information of each category from the category storage unit 104, collates the feature extracted from the image data with the category information, and classifies the image data into one of a plurality of categories. .

  The category classification unit 105 adds classification information indicating the classified category to the image data that has been classified, and re-stores (overwrites) it in the image storage unit 103 (S4).

  Next, the attribute classification unit 107 classifies the attributes of the character information written on the document 4 based on the image data after the category classification (S5).

  Specifically, the attribute classification unit 107 reads image data for which category classification has been completed from the image storage unit 103. The attribute classification unit 107 recognizes the character information written on the document 4 based on the read image data. Then, the attribute classification unit 107 reads attribute information corresponding to the category of the read image data from the attribute storage unit 106.

  Here, in the document 4, character information having attributes unique to each category is described. For example, in the case of the category “receipt”, there are “article name”, “purchase date”, “purchase amount”, and the like as attributes of the character information. Furthermore, the attribute “article name” is subdivided hierarchically, and if the attribute “article name” of the category “receipt” is the upper attribute, “food” and “consumables” are subordinate to “article name”. And so on. When a plurality of character information having different attributes are associated with each other, character information (for example, “article name” − “purchase date” − “purchase amount”) is associated with each other. As an example, when the image data of the receipt of cabbage purchased for 200 yen on November 20 is read, each character information of “cabbage” — “November 20” — “200 yen” is associated with each other.

  In the case of the category “schedule”, there are “action content”, “scheduled action date”, and the like as attributes of the character information. When a plurality of pieces of character information having different attributes are associated with each other, character information (for example, “action content” − “planned action date”) is associated with each other. As an example, when image data of an invitation that there is a friend's wedding on December 2 is read, each character information of “friend's wedding” − “December 2” is associated with each other.

  In the case of the category “Warranty”, there are “guarantee expiration date”, “dealer”, “guarantee object” and the like as attributes of the character information. When a plurality of pieces of character information having different attributes are associated with each other, character information (for example, “guarantee expiration date” — “sales shop” — “guarantee object”) is associated with each other. As an example, when image data of a warranty card of a television set purchased at a store A and whose warranty period is May 20, 2017 is read, “May 20, 2017” — “Store A” — “TV” Are associated with each other.

  If the category is "New Year's card", the attributes of the text information include "Destination ZIP Code", "Destination Address", "Destination Name", "Sender Postal Code", "Sender Address", "Sender Name". And so on. When a plurality of character information having different attributes are associated with each other, the character information (for example, “destination zip code” − “destination address” − “destination name” − “sender zip code” − “sender address” "-" Sender's name ") are associated with each other. That is, “destination zip code”, “destination address”, “destination name”, “sender zip code”, “sender address”, and “sender name” of the same New Year's card are associated with each other.

  The attribute classification unit 107 extracts character information of an attribute corresponding to the category of the image data from the character information recognized from the image data after the category classification. In the attribute storage unit 106, specific character information of each attribute is stored in advance as a classification setting value, and the attribute classification unit 107 extracts character information that matches the classification setting value of each attribute from the recognized character information. Extract.

  FIG. 4 shows a classification setting value of the attribute “food”, and illustrates “article name” — “food” such as “cabbage”, “spinach”, “lettuce”, and the like. Even if the character information is different, such as “spinach” and “spinach”, the same food is treated as the same food.

  FIG. 5 shows classification setting values of the attributes “article name” − “consumables”, and illustrates “article names” such as “toilet paper” and “tissue”. Even if the character information is different, such as “toilet paper” and “toilet paper”, the same consumable item is treated as the same consumable item. “Tissue” and “tissue paper” are also treated as the same consumable.

  In addition, a product name may be used as the article name, and a product name can be set as the classification setting value.

  Moreover, the attribute classification | category part 107 may extract the character information with a high matching degree with respect to the specific character information of each attribute (a matching degree exceeds a threshold value) from the recognized character information.

  Then, the attribute classification unit 107 associates the extracted character information with the category and the attribute (corresponds to them) and stores them in the extracted data storage unit 108 (S6). That is, in the extracted data storage unit 108, the character information of the document 4 is classified for each category, and the character information of the document 4 is classified for each attribute in each category. FIG. 6 shows a classification example of character information of the category “Receipt”. In FIG. 6, “article name”, “purchase amount”, and “classification item” arranged in the same row are associated with each other, and “classification item” indicates a lower attribute of “article name”.

  The processing unit 109 has a function of performing information processing using character information of each category stored in the extracted data storage unit 108.

  The communication unit 110 has a function of performing wireless or wired communication with the router 3 and can perform network communication via the router 3.

  The information terminal 2 includes a mobile phone, a smartphone, a tablet terminal, a personal computer, a dedicated terminal, etc., an operation unit 21 such as a touch panel, a keyboard, and a mouse, a display unit 22 such as a liquid crystal screen, and a communication unit. 23 and a control unit 24.

  The communication unit 23 has a function of performing wireless or wired communication with the router 3 and can perform network communication via the router 3. That is, the communication unit 23 can communicate with the communication unit 110 of the information processing apparatus 1 by network communication via the router 3.

  The control unit 24 can acquire the notification data from the information processing apparatus 1 by executing the application software, and can display the result of the information processing by the processing unit 109 on the display unit 22.

  For example, household account book software is available as application software corresponding to the category “receipt”. When the control unit 24 executes the household account book software, a menu screen of the household account book software is displayed on the display unit 22, and a notification request for household account book data is transmitted to the information processing apparatus 1 by the operation of the operation unit 21. In the information processing apparatus 1, when the communication unit 110 receives this notification request, the processing unit 109 extracts character information classified in the category “receipt” from the character information stored in the extracted data storage unit 108. To do. Then, the processing unit 109 creates household account book information obtained by converting the extracted character information into data in the household account book format, and generates notification data (household account book notification data) including the created household account book information. Then, the processing unit 109 transmits the generated household account book notification data from the communication unit 110 to the information terminal 2. The processing unit 109 generates information on the household account book for the month designated by the notification request as household account book notification data.

  In the information terminal 2, when the communication unit 23 receives the household account book notification data, the control unit 24 executing the household account book software displays the household account book notification data on the display unit 22.

  Another process by the household account book software will be described. When the control unit 24 executes the household account book software, a menu screen of the household account book software is displayed on the display unit 22, and a notification request for purchase timing of consumables is transmitted to the information processing apparatus 1 by the operation of the operation unit 21. In the information processing apparatus 1, when the communication unit 110 receives this notification request, the processing unit 109 determines the category “receipt”, the attribute “article” − “consumable” from the character information stored in the extracted data storage unit 108. ”Is extracted. The processing unit 109 also extracts character information of the attribute “purchase date” associated with the character information of “consumable” from the character information stored in the extracted data storage unit 108. Then, when the consumables of the same item are purchased on different days, the processing unit 109 calculates the average value of the purchase cycle (purchase date difference) and adds the average value of the purchase cycle to the previous purchase date. The next purchase date (purchase date plan information) is obtained. The processing unit 109 generates notification data for notifying the next purchase date as the purchase timing of the consumables. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2.

  In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 executing the household account book software displays notification data for notifying the next purchase date on the display unit 22.

  Alternatively, each time the character information classified into the category “receipt” and the attribute “article” − “consumable” is newly stored in the extracted data storage unit 108, the processing unit 109 plans to purchase the consumable next time. You may perform the above-mentioned process which calculates a day. In this case, if the character information indicating the purchase of the consumable item is not newly stored in the extracted data storage unit 108 even after the next scheduled purchase date has elapsed, the processing unit 109 displays a message prompting the purchase of the consumable item. Generate notification data to be notified. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2. In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 activates the household account book software and displays notification data for notifying a message prompting the purchase of consumables on the display unit 22.

  Another process by the household account book software will be described. When the control unit 24 executes the household account book software, a menu screen of the household account book software is displayed on the display unit 22, and a budget for a predetermined period (for example, November) is set by the operation of the operation unit 21. The notification request to which the budget information is added is transmitted to the information processing apparatus 1. Here, it is assumed that the budget information for November is set. In the information processing apparatus 1, when the communication unit 110 receives this notification request, the processing unit 109 is classified into the category “receipt” and the attribute “purchase amount” from the character information stored in the extracted data storage unit 108. In addition, character information whose related attribute “purchase date” is November is extracted. In other words, the processing unit 109 can extract character information related to the November purchase amount, and calculates the sum of the November purchase amount. Then, the processing unit 109 compares the November purchase amount with the November budget information, and determines whether or not the November purchase amount sum exceeds the November budget. In other words, the determination result becomes information on the household budget, and the processing unit 109 generates notification data that notifies the determination result. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2.

  In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 executing the household account book software displays notification data for notifying the determination result on the display unit 22.

  Or the process part 109 performs the above-mentioned determination process regularly, and produces | generates the notification data which notifies a warning, when the sum total of the purchase amount of November exceeds the budget of November. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2. In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 activates the household account book software and displays notification data for notifying the warning on the display unit 22.

  In addition, there is cooking software as application software corresponding to the category “receipt”. When the control unit 24 executes the cooking software, a menu screen of the cooking software is displayed on the display unit 22, and a cooking recipe notification request is transmitted to the information processing apparatus 1 by the operation of the operation unit 21. In the information processing apparatus 1, when the communication unit 110 receives the notification request, the processing unit 109 is classified into the category “receipt” and the attribute “food” from the character information stored in the extracted data storage unit 108. In addition, character information whose related attribute “purchase date” is one week before the current date is extracted. That is, the processing unit 109 can grasp the food purchased within one week. The processing unit 109 stores recipe data of various dishes in advance, and reads out recipes (recipe information) of the dishes that can be made from the food purchased within one week from the recipe data. The processing unit 109 generates notification data for notifying the read cooking recipe. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2.

  In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 executing the cooking software displays notification data for notifying the cooking recipe on the display unit 22.

  Moreover, there is schedule management software as application software corresponding to the category “schedule”. When the control unit 24 executes the schedule management software, the schedule management software menu screen is displayed on the display unit 22, and a schedule notification request is transmitted to the information processing apparatus 1 by the operation of the operation unit 21. In the information processing apparatus 1, when the communication unit 110 receives this notification request, the processing unit 109 extracts character information classified into the category “schedule” from the character information stored in the extracted data storage unit 108. Then, the processing unit 109 can create a schedule table (schedule information) from each attribute “action content”, “scheduled action date”, and the like of the extracted character information. The processing unit 109 generates notification data for notifying this schedule table. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2.

  In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 executing the schedule management software displays notification data for notifying the schedule table on the display unit 22.

  As application software corresponding to the category “Warranty”, there is warranty management software. When the control unit 24 executes the warranty card management software, the menu screen of the warranty card management software is displayed on the display unit 22, and a warranty expiration notification request is transmitted to the information processing apparatus 1 by the operation of the operation unit 21. In the information processing apparatus 1, when the communication unit 110 receives this notification request, the processing unit 109 is classified into the category “guarantee” and the attribute “guarantee expiration” from the character information stored in the extracted data storage unit 108. Extract character information. Then, the processing unit 109 can identify the attribute “guarantee object” associated with the extracted character information of the attribute “guarantee expiration date”, and thus can determine the warranty object whose warranty period has passed. That is, the determination result becomes information regarding the warranty expiration date. Based on the determination result, the processing unit 109 generates notification data for notifying a guarantee object whose warranty term has expired. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2.

  In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 executing the warranty management software displays notification data for notifying the warranty object whose warranty expiration date has passed on the display unit 22.

  Alternatively, the processing unit 109 periodically executes a process for determining a warranty object whose warranty period has expired, and notifies that the warranty has become invalid when a warranty object whose warranty period has expired occurs. Generate data. Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2. In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 activates the warranty management software and displays notification data for notifying that the warranty is invalidated on the display unit 22.

  In addition, there is mail management software as application software corresponding to the category “New Year's card”. When the control unit 24 executes the mail management software, a menu screen of the mail management software is displayed on the display unit 22, and a notification request for confirming the transmission / reception status of New Year's cards is transmitted to the information processing apparatus 1 by the operation of the operation unit 21. The In the information processing apparatus 1, when the communication unit 110 receives this notification request, the processing unit 109 extracts character information classified into the category “New Year's card” from the character information stored in the extracted data storage unit 108. Here, the processing unit 109 stores user name information and address information in advance. Then, the processing unit 109 displays the character information of the attributes “destination zip code”, “destination address”, and “destination name” (each attribute related to receipt of the same New Year's card) associated with each other as user name information and address information. If it matches, this New Year's card is judged to have been received. Further, the processing unit 109 uses the character information of the attributes “sender's zip code”, “sender address”, and “sender name” (each attribute related to the transmission of the same New Year's card) associated with each other as the user name information and address information. If it matches, this New Year's card is judged to have been sent. That is, the determination result by the processing unit 109 becomes the transmission / reception management information for the New Year's card.

  The processing unit 109 generates notification data for notifying the transmission / reception management information of the New Year's cards (received New Year's cards, sent New Year's card information). Then, the processing unit 109 transmits the generated notification data from the communication unit 110 to the information terminal 2. In the information terminal 2, when the communication unit 23 receives the notification data, the control unit 24 executing the mail management software sends notification data for notifying information on the received new year card and the sent new year card to the display unit 22. indicate. Note that the processing unit 109 may have a function of managing only one of the received New Year card and the sent New Year card.

  In addition to the “New Year's card”, the postal matter management software can also handle each category of postal items such as “summer greeting” and “postcard”.

  Further, the communication form between the information processing apparatus 1 and the information terminal 2 may be communication using a dedicated line in addition to network communication (LAN communication) via the router 3.

  The router 3 is connected to a wide area network 6 including the Internet. The management server 5 is communicably connected to the wide area network 6, and the communication unit 110 of the information processing apparatus 1 and the communication unit 23 of the information terminal 2 communicate with the management server 5 through the wide area network 6. It can be performed.

  Therefore, the information processing apparatus 1 transmits the image data stored in the image storage unit 103 and the character information stored in the extracted data storage unit 108 (character information extracted by the attribute classification unit 107) to the management server 5. May be. The management server 5 can store the image data and character information transmitted from the information processing apparatus 1 and back up the data. In this case, the information processing apparatus 1 periodically transmits image data and character information to the management server 5, whereby the image data and character information stored in the information processing apparatus 1 and the management server 5 are stored. Image data and character information can be synchronized. Note that the image data and character information transmitted from the information processing apparatus 1 to the management server 5 are data relating to changes from the previous transmission or all data currently stored in the information processing apparatus 1.

  In addition, the information processing apparatus 1 is configured integrally with the scanner apparatus, but may be configured separately.

  Further, the information processing apparatus 1 may have a printer function and a shredder function.

  Moreover, the target object from which the image data is acquired may be a sheet-like target with characters on the surface, and may be other than the document 4.

  As described above, the information processing apparatus 1 includes the data acquisition unit 102, the category storage unit 104, and the category classification unit 105. The data acquisition unit 102 acquires image data of an object (document 4) on which characters are written. The category storage unit 104 stores category information indicating the characteristics of image data corresponding to each of a plurality of categories including one or more of a receipt, a schedule, a guarantee, and a New Year's card as a plurality of categories indicating types of objects. doing. The category classification unit 105 collates the image data with the category information and classifies the image data into one of a plurality of categories.

  Therefore, the information processing apparatus 1 can target a plurality of categories of objects in information processing using the image data of the objects on which characters are written.

  The information processing apparatus 1 preferably includes an attribute storage unit 106 and an attribute classification unit 107. The attribute storage unit 106 stores, for each category, attribute information for identifying an attribute of a unique character or character string recorded on each object of a plurality of categories. The attribute classification unit 107 recognizes a character or a character string written on the object based on the image data. And the attribute classification | category part 107 extracts the character or character string of the attribute corresponding to the category classified from the recognized character or character string using the attribute information corresponding to the category classified by the category classification | category part 105, Classify the extracted characters by attribute.

  Therefore, since the information processing apparatus 1 stores attribute information for each category, it is possible to classify characters or character strings written on the object into attributes corresponding to the category to which the object belongs.

  Further, the information processing apparatus 1 creates information according to the attributes of the characters or character strings based on the characters or character strings classified by the attribute classification unit 107 for each attribute, and sends information to the user based on the created information. It is preferable to include a processing unit 109 that generates notification data to be notified.

  Therefore, the information processing apparatus 1 can perform information processing corresponding to each category using characters or character strings classified for each attribute.

  Moreover, it is preferable that one of the plurality of categories is a receipt. In the attribute storage unit 106, an article name and a purchase date are set as attribute information corresponding to the receipt. It is assumed that the category classified by the category classification unit 105 is a receipt. In this case, the attribute classification unit 107 extracts the character or character string of the attribute corresponding to the receipt from the recognized character or character string using the attribute information corresponding to the receipt, and attributes the extracted character or character string to the attribute. Sort by each. The processing unit 109 derives a purchase cycle of the same article based on the characters or character strings classified by the attribute classification unit 107 for each attribute, and notifies the user of the purchase timing of the article based on the purchase cycle. Generate data.

  Therefore, the information processing apparatus 1 can prompt the user to confirm whether or not he / she has forgotten to purchase the article from the fragmentary information of each of the plurality of receipts. Can be improved.

  In addition, if one of a plurality of categories is a receipt, it is preferable that a purchase date and a purchase price are set in the attribute storage unit 106 as attribute information corresponding to the receipt. It is assumed that the category classified by the category classification unit 105 is a receipt. In this case, the attribute classification unit 107 extracts the character or character string of the attribute corresponding to the receipt from the recognized character or character string using the attribute information corresponding to the receipt, and attributes the extracted character or character string to the attribute. Sort by each. Based on the character or character string classified by the attribute classification unit 107 for each attribute, the processing unit 109 generates notification data for notifying the user when the sum of the purchase amount in the predetermined period exceeds the threshold.

  Therefore, the information processing apparatus 1 can warn the user of over-buying that exceeds the budget from each piece of piece of information of the plurality of receipts, thereby improving the convenience for the user.

  In addition, if one of a plurality of categories is a receipt, it is also preferable that a food name and a purchase date are set in the attribute storage unit 106 as attribute information corresponding to the receipt. It is assumed that the category classified by the category classification unit 105 is a receipt. In this case, the attribute classification unit 107 extracts the character or character string of the attribute corresponding to the receipt from the recognized character or character string using the attribute information corresponding to the receipt, and attributes the extracted character or character string to the attribute. Sort by each. The processing unit 109 creates recipe information using the food purchased within a predetermined period based on the characters or character strings classified by the attribute classification unit 107 for each attribute, and notifies the created recipe information to the user. Generate notification data.

  Therefore, the information processing apparatus 1 can provide the user with a recipe for cooking using the purchased food from the fragmentary information of each of the plurality of receipts, thereby improving user convenience. be able to.

  Moreover, it is preferable that one of the plurality of categories is a schedule in which a person's action schedule is written. In the attribute storage unit 106, action content and scheduled action date are set as attribute information corresponding to the schedule. A category classified by the category classification unit 105 is a schedule. In this case, the attribute classification unit 107 extracts the character or character string of the attribute corresponding to the schedule from the recognized character or character string using the attribute information corresponding to the schedule, and extracts the extracted character or character string for each attribute. Classify. The processing unit 109 creates schedule information for managing a person's action schedule based on the characters or character strings classified by the attribute classification unit 107 for each attribute, and generates notification data for notifying the created schedule information to the user. To do.

  Therefore, the information processing apparatus 1 can provide schedule information to the user from fragmentary information such as a memo written with a schedule, an invitation, and the like, so that convenience for the user can be improved. .

  Moreover, it is preferable that one of the plurality of categories is a guarantee. In the attribute storage unit 106, a warranty expiration date is set as attribute information corresponding to the warranty. It is assumed that the category classified by the category classification unit 105 is a guarantee. In this case, the attribute classification unit 107 extracts the character or character string of the attribute corresponding to the warranty from the recognized character or character string using the attribute information corresponding to the warranty, and extracts the extracted character or character string for each attribute. Classify. The processing unit 109 creates information related to the warranty expiration date based on the characters or character strings classified by the attribute classification unit 107 for each attribute, and generates notification data for notifying the user of the information related to the created warranty expiration date.

  Therefore, the information processing apparatus 1 can provide warranty expiration information to the user from each piece of pieces of information of the plurality of warranty cards, and thus the convenience of the user can be improved.

  Moreover, it is preferable that one of the plurality of categories is a New Year's card. In the attribute storage unit 106, at least one of a destination and a sender is set as attribute information corresponding to the New Year's card. The category classified by the category classification unit 105 is assumed to be a New Year's card. In this case, the attribute classification unit 107 extracts the character or character string of the attribute corresponding to the New Year's card from the recognized character or character string using the attribute information corresponding to the New Year's card, and extracts the extracted character or character string for each attribute. Classify. The processing unit 109 creates management information for managing at least one of the sending status and receiving status of the New Year's card based on the characters or character strings classified by the attribute classification unit 107 for each attribute, and the created management information Notification data to be notified to the user is generated.

  Accordingly, the information processing apparatus 1 can provide the user with the New Year's card transmission / reception information (or any one of the transmission information and the reception information) from each piece of information of the plurality of New Year's cards. User convenience can be improved.

(Embodiment 2)
FIG. 7 shows a configuration of an information processing system using the information processing system of the present embodiment, and the information processing apparatus 1A is provided in the management server 5A.

  A scanning device 7 is provided in the house, and the scanning device 7 includes a scanning unit 71 and a communication unit 72. The scanning unit 71 optically reads an image of the document 4 (object) on which characters are written, and generates image data. The communication unit 72 has a function of performing wireless or wired communication with the router 3 and can perform network communication via the router 3.

  The information processing apparatus 1A provided in the management server 5A includes a data acquisition unit 122, an image storage unit 123, a category storage unit 124, a category classification unit 125, an attribute storage unit 126, an attribute classification unit 127, an extracted data storage unit 128, and a process. Unit 129 and communication unit 130.

  The communication unit 130 is connected to the wide area network 6 and can perform network communication with the scanning device 7. The data acquisition unit 122 acquires the image data of the document 4 generated by the scanning unit 71 through the wide area network 6 and stores it in the image storage unit 123. The category storage unit 124 shows characteristics unique to each of a plurality of categories of the document 4 (“receipt”, “guarantee”, “schedule”, “new year card”, “address book”, “contract”, etc.). Stores category information. The category classification unit 125 classifies the category of the read image data of the document 4 using the category information.

  In the attribute storage unit 126, specific character information belonging to each attribute for each category is stored in advance as a classification setting value. The attribute classification unit 127 reads the image data for which the category classification has been completed from the image storage unit 123, and recognizes the character information described in the document 4 based on the read image data. The attribute classification unit 127 extracts character information that matches the classification setting value of the attribute corresponding to the category from the recognized character information. The attribute classification unit 127 stores the extracted character information in the extracted data storage unit 128 in association with (corresponding to) the category and the attribute. That is, in the extracted data storage unit 128, the character information of the document 4 is classified for each category, and the character information of the document 4 is classified for each attribute in each category.

  The processing unit 129 has a function of performing information processing using character information of each category stored in the extracted data storage unit 128. Also in the present embodiment, the processing unit 129 generates each notification data and transmits it to the information terminal 2 in the same manner as the processing unit 109 of the first embodiment.

  In other words, each element denoted by reference numerals 122 to 130 included in the information processing apparatus 1A of the present embodiment has the same function as each element denoted by reference numerals 102 to 110 included in the information processing apparatus 1 of the embodiment. Thus, the information processing apparatus 1A provided in the management server 5A has the same information processing function as the information processing apparatus 1 of the first embodiment.

  In addition, the same code | symbol is attached | subjected to the structure similar to Embodiment 1, and description is abbreviate | omitted.

  In this embodiment, since an information processing system is configured using a server, an information processing service can be provided for a plurality of buildings as management targets using, for example, the technology of cloud computing. Therefore, the environment on the user side can be simplified and a large-scale system can be constructed.

  In each of the above-described embodiments, the information processing apparatuses 1 and 1A are equipped with a computer configured with a microcomputer or the like, and the functions of the information processing apparatuses 1 and 1A are realized by the computer executing a program. Has been. The computer constituting the information processing apparatuses 1 and 1A includes a processor and an interface that operate according to a program as main hardware configurations. Such processors include a DSP (Digital Signal Processor), a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), and the like. And if a processor can implement | achieve the function of the above-mentioned information processing apparatus 1 and 1A by running a program, the kind will not ask | require.

  As a program providing form, a computer-readable ROM (Read Only Memory), a form stored in advance in a recording medium such as an optical disc, or the like is supplied to the recording medium via a wide area communication network including the Internet. There are forms.

  In other words, the program causes the computer to function as the information processing apparatus 1 or 1A.

  Therefore, a program that causes a computer to function as the information processing apparatus 1 or 1A can also achieve the same effect as described above. That is, this program can target a plurality of categories of objects in information processing using the image data of the objects on which characters are written.

  The above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and various modifications can be made depending on the design and the like as long as the technical idea according to the present invention is not deviated from this embodiment. Of course, it is possible to change.

1 (1A) Information processing apparatus 102 (122) Data acquisition unit 104 (124) Category storage unit 105 (125) Category classification unit 106 (126) Attribute storage unit 107 (127) Attribute classification unit 109 (129) Processing unit

Claims (10)

A data acquisition unit for acquiring image data of an object on which characters are written;
A category storage unit storing category information indicating the characteristics of image data corresponding to each of a plurality of categories including one or more of a receipt, a schedule, a guarantee, and a New Year's card as a plurality of categories indicating the type of the object; ,
An information processing apparatus comprising: a category classification unit that collates the image data with the category information and classifies the image data into any of the plurality of categories. An attribute storage unit that stores, for each category, attribute information for identifying an attribute of a unique character or character string written on each object of the plurality of categories;
Based on the image data, the character or character string written on the object is recognized, and the attribute information corresponding to the category classified by the category classification unit is used to classify the character or character string from the recognized character or character string. The information processing apparatus according to claim 1, further comprising: an attribute classification unit that extracts characters or character strings having attributes corresponding to the categories and classifies the extracted characters for each attribute.   A process of creating information according to the attribute of the character or character string based on the character or character string classified for each attribute by the attribute classification unit, and generating notification data to be notified to the user based on the created information The information processing apparatus according to claim 2, further comprising a unit. One of the plurality of categories is a receipt;
In the attribute storage unit, as attribute information corresponding to the receipt, an article name, a purchase date are set,
When the category classified by the category classifying unit is the receipt, the attribute classifying unit uses the attribute information corresponding to the receipt, and the attribute corresponding to the receipt from the recognized character or character string. Character or character string, and classify the extracted character or character string by attribute,
The processing unit derives a purchase cycle of the same article based on the characters or character strings classified for each attribute by the attribute classification unit, and notifies the user of the purchase timing of the article based on the purchase cycle The information processing apparatus according to claim 3, wherein data is generated. One of the plurality of categories is a receipt;
In the attribute storage unit, a purchase date and a purchase amount are set as attribute information corresponding to the receipt.
When the category classified by the category classifying unit is the receipt, the attribute classifying unit uses the attribute information corresponding to the receipt, and the attribute corresponding to the receipt from the recognized character or character string. Character or character string, and classify the extracted character or character string by attribute,
The processing unit generates notification data for alerting a user when the sum of purchase amounts in a predetermined period exceeds a threshold based on characters or character strings classified by the attribute by the attribute classification unit. The information processing apparatus according to claim 3. One of the plurality of categories is a receipt;
In the attribute storage unit, as the attribute information corresponding to the receipt, a food name and a purchase date are set,
When the category classified by the category classifying unit is the receipt, the attribute classifying unit uses the attribute information corresponding to the receipt, and the attribute corresponding to the receipt from the recognized character or character string. Character or character string, and classify the extracted character or character string by attribute,
The processing unit creates recipe information using food purchased within a predetermined period based on the characters or character strings classified by the attribute classification unit for each attribute, and notifies the user of the created recipe information. The information processing apparatus according to claim 3, wherein notification data is generated. One of the plurality of categories is a schedule in which a person's action schedule is recorded,
In the attribute storage unit, action content and scheduled action date are set as attribute information corresponding to the schedule,
When the category classified by the category classifying unit is the schedule, the attribute classifying unit uses the attribute information corresponding to the schedule, the attribute character corresponding to the schedule from the recognized character or character string, or Extract a character string, classify the extracted character or character string for each attribute,
The processing unit creates schedule information for managing a person's action schedule based on the characters or character strings classified for each attribute by the attribute classification unit, and generates notification data for notifying the created schedule information to the user The information processing apparatus according to claim 3, wherein the information processing apparatus is an information processing apparatus. One of the plurality of categories is a warranty;
In the attribute storage unit, a warranty expiration date is set as attribute information corresponding to the warranty,
When the category classified by the category classification unit is the warranty card, the attribute classification unit uses the attribute information corresponding to the warranty card, the attribute character corresponding to the warranty card or the attribute character corresponding to the warranty card, or Extract a character string, classify the extracted character or character string for each attribute,
The processing unit creates information related to a warranty expiration date based on the character or character string classified by the attribute classification unit for each attribute, and generates notification data for notifying the user of the information related to the created warranty expiration date. The information processing apparatus according to claim 3, wherein the information processing apparatus is an information processing apparatus. One of the plurality of categories is a New Year's card,
In the attribute storage unit, at least one of a destination and a sender is set as attribute information corresponding to the New Year's card,
When the category classified by the category classifying unit is the New Year's card, the attribute classifying unit uses the attribute information corresponding to the New Year's card and uses the attribute character corresponding to the New Year's card from the recognized character or character string. Extract a character string, classify the extracted character or character string for each attribute,
The processing unit creates management information for managing at least one of the sending status or receiving status of the New Year's card based on the characters or character strings classified by the attribute classification unit for each attribute, and the created management information The information processing apparatus according to claim 3, wherein notification data for notifying a user is generated. A program for causing a computer to function as the information processing apparatus according to claim 1.

Images