JPH09305685A - Information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To save labor and to easily and simply deal with various kinds of image information by reading the image of paper or photograph such as ordinary receipt or postcard through a scanner, automatically sorting the images according to external forms and simultaneously displaying the images for each type in the case of management of various kind of image information. SOLUTION: The receipt or postcard is inputted from a scanner part 3. A storage part 4 calls the date inputted from a clock part 7 and stores the date information corresponding to the image. A form recognizing part 5 calculates the longitudinal and lateral lengths of data from the scanner part 3 and the storage part 4 and recognizes them as the form data of the images. The images are displayed while being sorted by months corresponding to the date information. Besides, based on the information from a storage part 6, the form recognizing part 5 sorts the images in the same or similar form and displays them by items. Further, the scene to be really usually used is estimated and the form recognition with flexibility is performed. The user selects the desired image to be precisely watched through a select key and displays it.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing device having an improved user interface.

[0002]

2. Description of the Related Art An information processing apparatus of this type which processes image information read by a conventional scanner has a user classifying the image information read by the scanner into files according to the contents and organizing the files. Or store it according to purpose,
It was necessary to launch an independent application such as an address book or a household account book (for example, Japanese Patent Laid-Open No. 1-74671).
Issue). In addition, as a device that recognizes and edits and aggregates characters and numbers of image information read by a scanner, the target to be read such as a business card reading device, a handwritten character recognition device, and a receipt reading device is limited, and the content of the limited object is read. A dedicated device has been devised.

[0003]

However, although information processing devices such as personal computers have become widespread in homes, in the case of daily use at home such as housekeeping, individual content recognition devices must be purchased. I can't go. There are various usage opportunities such as household management and address book, and there are various image information that you want to save and manage, such as postcards for changing addresses, receipts and receipts such as utility bills. Also, at home, there is no need to automatically convert image information read by a scanner as text information or a large-scale item such as a receipt reading device, just sort and organize, store and call it anytime. There is a strong need. For example, in household management, monthly bank withdrawal receipts are sorted according to each party, such as electricity, gas, and telephone charges, and stored so that they can be viewed at any time or throughout the year. There is a need to be able to see fluctuations.
Also, read the postcards and receipts for changing the address with a scanner for the time being, store the postcards together with the postcards,
I want you to be able to see it immediately when necessary and write it down in an address book at a time when you have time. The task of classifying and organizing the various image information read by such a scanner is troublesome, and it is very troublesome for a user who is unfamiliar with handling information devices.

[0004]

In order to solve the above problems, the present invention provides an image display unit for displaying a document and image information,
A scanner unit capable of inputting image information such as receipts, receipts, postcards, business cards, and photographs presented by the user, a storage unit for storing and accumulating information from the scanner unit, and paper input from the scanner unit. It comprises a shape recognition unit for recognizing the size and shape of the outer shape of the photograph, and an image classification unit for automatically classifying the image information input based on the information from the shape recognition unit by shape and displaying it on the image display unit. .

The image information to be read and managed by a scanner at home is a receipt, a receipt of utility bills, a postcard, a photograph, etc., and the shape such as the size and shape of each paper is unique to the content. The image information input by the user with the scanner is accumulated in the storage unit, and the classification unit automatically recognizes the size and shape of the image information read from the storage unit,
Since it is sorted and displayed according to the contents, it is convenient and easy to use without the trouble of sorting and sorting, such as saving the files according to the contents each time the scanner is input and distributing them to the application to be handled. Since the information is sorted and displayed, you can quickly find the information you need, which makes managing image information extremely convenient.

[0006]

BEST MODE FOR CARRYING OUT THE INVENTION The present invention recognizes a shape of an image based on a scanner section for inputting image information, a storage section for storing and accumulating information from the scanner section, and image information from the storage section or the scanner section. The shape recognizing unit, and the image classifying unit for classifying the shape into a plurality of types based on the information recognized by the shape recognizing unit and storing the image in the storage unit.

Further, the image display unit has an image display unit for displaying documents and image information, and an image classification unit for classifying the shapes recognized by the shape recognition unit into a plurality of types according to the shape and displaying the classified images on the image display unit. .

Further, the shape recognition unit recognizes the lateral length of the outline of the image information input from the scanner unit, and the image classification unit recognizes the lateral length of the outline of the image recognized by the shape recognition unit. The image is classified according to shape.

Further, the shape recognition unit recognizes the horizontal and vertical lengths of the outer shape of the image information input from the scanner unit, and the image classification unit recognizes the horizontal direction and the outer shape of the image recognized by the shape recognition unit. The image is classified according to the shape according to the length in the vertical direction.

Further, a pattern recognition section for recognizing the image pattern of the image information from the scanner section or the storage section is provided, and the image classification section classifies the image according to the pattern based on the information from the pattern recognition section.

Further, the pattern recognition section recognizes the color of the image from the scanner section or the storage section, and the image classification section classifies the image by color based on the information recognized by the pattern recognition section.

Then, since the input image information is automatically classified and displayed according to a pattern such as a unique size, outer dimension, shape or format style, illustration, logo, color, etc., the input image data is classified. It saves the time and effort of organizing and makes it convenient to use data.

An image type storage unit for storing in advance the shape or image pattern of image information to be classified,
The image classifying unit includes an image classifying unit that classifies the input image by matching the information from the shape recognizing unit or the pattern recognizing unit with the information from the image type storing unit.

The shapes and characteristic image patterns of the paper or the like to be classified and sorted are stored in advance, and the information and the shape or image pattern of the newly input image information are compared for classification. Since the accuracy is improved and the user can instruct the type of classification in advance, the intended classification can be performed.

Further, a plurality of application programs are provided, an application program corresponding to the type of data is selected based on the information from the shape recognition section or the pattern recognition section, the data is automatically sorted, and the program image information is set to the corresponding application. Is provided with a classification unit for transmitting.

Further, an application manipulating unit for automatically manipulating an application program corresponding to the image information classified by the image classifying unit is provided.

When there are a plurality of application programs that handle the images input from the scanner section and perform work, it is not necessary to separately start each application and then input the images from the scanner. Will be started automatically.

Further, there is provided a visual matching structure for integrally combining the display surface of the image display means and the input surface of the image input means so as to visually match with each other when viewed from the user.

Then, the scanner unit and the image display unit are integrally combined, and the input image is displayed on the image display unit at the position where the image is placed when the scanner is read.
It is a compact information processing device that can input an image at a desired position, is simple and easy for a person who is unfamiliar with handling information equipment, and does not take up much space.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. (Embodiment 1) FIG. 1 is a configuration diagram of an information processing apparatus according to Embodiment 1 of the present invention. In FIG. 1, the information processing device 1 is a document,
An image display unit 2 that displays image information, a scanner unit 3 that can input image information such as receipts, receipts, postcards, business cards, and photographs presented by the user, and a memory that stores and stores information from the scanner unit 3. Part 4, a shape recognition part 5 for recognizing the size and shape of the input paper or photograph, and image information classified into a plurality of types according to size and shape based on information from the shape recognition part 5 and classified in the image display part 2. An image classification unit 6 to be displayed, a time counting unit 7 for counting the date and time, and an input unit 8 for performing an information management operation. Further, a liquid crystal display 9 is used as the image display unit 2, and a pen input device is used as the input unit 8 to perform an input operation by pointing a transparent touch panel 8b provided on the front surface of the liquid crystal display 9 with a pen 8a. The input unit 8 may be a touch panel type, a mouse input or a keyboard input and does not restrict the present invention.

A specific operation will be described. The user inputs a plurality of types of receipts, receipts, postcards, etc., which the user wants to classify and sort from the scanner unit 3. The storage unit 4 calls the date information when the image is input from the clock unit 7, and stores the date information in association with the image information. The shape recognition unit 5 calculates the length in the vertical direction and the length in the horizontal direction of the image data from the scanner unit 3 or the storage unit 4, and recognizes it as the shape data of each image. The image information that has been input and stored now corresponds to the date information that is input as shown in FIG.
It is categorized and displayed using the Clapbook metaphor. When this is displayed for each classification for each shape and for each image type, the "classification" of the classification selection key 10 is touched with the pen 8a to change to classification classification display. The shape recognition unit 5 calls the image information from the storage unit 4 to recognize the shape, and the image classification unit 6 uses the information from the shape recognition unit 5 to
They are classified into those of the same or similar shape, and are displayed for each item of the scrapbook as shown in FIG. Even if information such as a receipt from a supermarket, which has a short width and a variable length, can be recognized as a receipt size, if the x-direction is less than or equal to a predetermined width, it is regarded as a receipt and the width of the receipt for each store. If is different, it is also classified and displayed according to the width.
The shape recognition unit 5 assumes a scene that is actually used on a daily basis,
It acts to provide flexible shape recognition. The user selects and displays an image of the type he or she wants to see in detail using the image type selection key 11.

Incidentally, as shown in FIG. 4, a method of collecting and displaying the same shape from the list on the screen may be adopted. If the group of images to be viewed is surrounded by the pen 8a, details of the selected type of image are displayed.

When reading and managing a wide variety of image information in this way, files can be automatically classified and displayed by simply capturing images with a scanner, such as papers and photographs such as receipts and postcards. This is a simple and easy-to-use interface information processing device that does not require any troublesome work such as creating, classifying and storing. Also, when you need it, you can instantly sort and display it by type, so you can quickly find the information you want to see and it is convenient.

(Second Embodiment) FIG. 5 is a block diagram of an information processing apparatus according to a second embodiment of the present invention. In this embodiment, the scanner unit 3
Alternatively, the present embodiment is different from the first embodiment in that the pattern recognition unit 12 that recognizes the image pattern of the image information from the storage unit is provided, and the image classification unit 6 also classifies the information regarding the image pattern of the image from the pattern recognition unit 12 together. What is a pattern image? The pattern, color, logo, mark, and
Refers to a bar code.

The external shapes of monthly receipts that you want to save on a daily basis are similar in shape to each other, but the contents have their own unique formats or logos or marks of their respective companies. It is characterized by different paper colors. According to this embodiment, the pattern recognition unit 1
2 recognizes these characteristic patterns such as patterns, colors and marks of the input image information, and the image classifying unit 6 classifies by the characteristic pattern in addition to the shape information, so that more detailed and highly accurate classification can be performed. A highly practical information processing device with improved usability can be provided.

(Third Embodiment) FIG. 6 is a block diagram of an information processing apparatus according to a third embodiment of the present invention. In FIG. 6, the image type storage unit 13 can previously store the shape or image pattern of image information such as receipts and postcards input from the scanner unit as typical image information. The image classification unit 6 compares the image information from the scanner unit 3 or the storage unit 4 with the image information from the image type storage unit 13 based on the information about the shape of the image or the image pattern from the pattern recognition unit 12 to obtain a common image. The images are classified into shapes or image patterns, and the images are displayed in the image display unit 2.

A specific operation will be described by taking an example of using it for household budget management. Need to keep a receipt for monthly payments such as utility bills and telephone bills so that monthly changes and yearly totals can be collected, and they can be viewed immediately when inquiries are needed. Is strong. Therefore,
A plurality of types of receipts, which are to be classified and arranged in advance and to be recorded, are input as images from the scanner unit 3 for each type and stored. These receipts are uniquely shaped sheets, and the numbers of the sheets such as the fixed shapes, patterns, logos, etc. are different, so just read the receipts that come apart every month from the scanner unit 3, and the image will be displayed. The classification unit 6 retrieves the types of receipts stored in the image type storage unit 13 in advance, compares them with the images input from the scanner unit 3, and classifies and displays the images. Since the method of displaying the classification is almost the same as that of the first embodiment, the description thereof is omitted here.
In this way, since the same type of information is collected and classified by comparison with the reference image information, the accuracy of the image information classification is improved. Further, the user can instruct the type to be classified in advance, and the user can set the classification method, so that the classification corresponding to the unique classification needs can be automatically performed.

(Fourth Embodiment) FIG. 7 is a block diagram of an information processing apparatus according to a fourth embodiment of the present invention. In FIG. 7, the information processing apparatus 1 selects a plurality of application programs 14 and an application program corresponding to the classified image type, and automatically distributes and transmits data as image information that can be handled by the selected application. The image classifying unit 6 is provided.

The specific operation will be described by taking the case of using the applications of the address book 14a, the household account book 14b, and the album 14c as an example. First, the user inputs a plurality of types of typical paper or photo paper to be classified in advance from the scanner unit 3 and designates an application for which each image is to be managed. For example, for postcards and business cards, address book 14a (address change notifications and seasonal greetings are often posted on postcards), receipts, household account book 14b for receipts, album 14c for photos, etc. Specify the application. The image type storage unit 13 stores the external shape or image pattern of the input image as a typical classification and what is the application corresponding to each image. The image data newly input from the scanner unit 3 is recognized by the shape recognizing unit 5 or the pattern recognizing unit 12 as to what shape or type the image is, and is sent to the image classifying unit 6, and the image classifying unit 6 recognizes the image type. Based on the data stored in the storage unit 13, the data is classified by type, the corresponding application is selected, and the image information is transmitted to the selected application. The user only has to scan the scanner each time a postcard or receipt arrives, and the input image information is automatically distributed to the corresponding application. When you open an application such as recording, the automatically sorted image information is displayed, and you can use it immediately.

In the present embodiment, the type to be classified and the corresponding application are stored in the storage unit 4 in advance, and the method of recognizing whether the type is the same type or not is sorted. A method of automatically recognizing what category or content it is from the pattern information, automatically selecting the corresponding application, and transmitting the image information may be used.

As described above, according to this embodiment, when an image is input, an appropriate application software that automatically responds is automatically selected based on the shape, pattern, color, etc. of the image, the input information is sorted, and the corresponding application is assigned. Send as information that can be handled immediately by software. Even if information is taken in, it is often impossible to utilize it because the work of sorting and sorting is troublesome, but according to the present embodiment, since the trouble of sorting and sorting is saved, it is a convenient and easy-to-use interface information processing device.

(Fifth Embodiment) FIG. 8 is a block diagram of an information processing apparatus according to a fifth embodiment of the present invention. Information processing apparatus 1 of this embodiment
Has a configuration similar to that of the fourth embodiment, but as shown in FIG. 8, when an image is input from the scanner unit 3, the image classification unit 6
Selects an appropriate application program corresponding to the application program and automatically starts the selected application program.
It is different in that it is equipped with.

A specific operation will be described by taking an example of inputting a receipt from the scanner unit 3. For example, when a receipt is input, the application activation unit 15 receives information from the image classification unit 6 that the information corresponding to the household account book 14b has been input, and automatically activates the application software of the household account book 14b.

As described above, the user simply inputs the image information desired to be handled by the information processing apparatus 1 through the scanner unit 3, and an appropriate application program corresponding to the type of the image is automatically started to input the input image. Is sent to the application, so you can work immediately and it is convenient.

(Embodiment 6) This embodiment has substantially the same configuration as that of the first embodiment, except that the scanner unit 3 and the image display unit 2 are constructed by an integrated visual structure 16. different. In FIG. 9, the input surface of the scanner unit 3 is arranged so as to face the display surface of the image display unit 2 and the coordinate system coincides with the front surface of the display surface.

A specific operation will be described. When the user inputs a sheet 17 having a different shape from the category A and wants to add it to the category A, the sheet 17 is pressed against the scanner unit 3 on the position of the image display unit 2 to be displayed, and the image is read through the scanner unit 3. Enter. The input image is reversely displayed on the image display unit 2 on the same coordinate axis as the position where the paper 17 is placed when the scanner is read.

In the other embodiments, the classification and display are automatically performed according to the shapes and patterns. However, according to the present embodiment, it is possible to specially display papers and photographs having different shapes in a certain kind of classification. , If you want to memorize it, just look at the classified images and put the paper at the position you want to input and scan it with the scanner, it will be input and displayed, so it is intuitive and very easy to use information It is a processing device. Further, since the scanner unit 3 and the image display unit 2 are integrated, the installation space is reduced.

[0038]

As is apparent from the above description, according to the information processing apparatus of the present invention, the following effects can be obtained.

When managing various image information, by simply scanning an image of a paper or photograph such as a daily receipt or a postcard with a scanner, it is automatically classified according to the shape of the outer shape and summarized for each classification. Since it is displayed as a file, it is possible to provide an information processing device that is easy and easy to handle, saving the trouble of dividing files according to the contents, sorting and organizing and saving. In addition, it is convenient because you can quickly find the information you want because it is sorted and displayed according to the content.

Further, since the outer shape of the image inputted by the scanner is classified according to the lateral length, it is convenient for classifying and storing receipts having different widths and different lengths for each store.

Further, since the input images are classified and displayed according to the combination of the vertical and horizontal lengths of the external shape of the image input by the scanner, it is very useful for classifying and storing the images of a plurality of types of fixed-size paper. It is convenient.

Further, since image patterns such as patterns, marks, logos, colors and bar codes of the input image are recognized and the image information is classified into the same type, the classification can be performed in consideration of the characteristics of the image. It enables detailed and accurate automatic classification.

Further, an image such as a paper or a photograph which the user wants to classify is inputted by a scanner in advance and stored therein, and it is automatically classified by recognizing whether or not it is the same kind as these.
Since it is displayed, it can be accurately and responded to the needs of each user who want to classify, and the usability is improved.

Further, if image data to be processed by a plurality of different applications is input by a scanner, the corresponding application is automatically selected according to the external dimensions or the image pattern so that work can be performed on the selected application. , Since it automatically sends data, you can save time and effort after opening each application separately and assigning input image data to each application, providing an information processing device that can be easily and easily handled it can.

Further, since the type of the image input by the scanner is recognized and the corresponding appropriate application program is automatically started, the operation is easy and the work can be performed immediately, which is convenient.

Further, a visual matching structure is provided for integrally combining the display surface of the image display unit and the image input surface of the scanner unit so as to visually match with the user.

Then, the scanner section and the image display section are integrally combined, and the input image is inverted as it is,
Input in the same image display area as the coordinate axes on the scanner at the time of input,
Since it is displayed, an image can be input at a desired position, and even a person who is unfamiliar with the handling of information equipment can intuitively perform the input operation.

[Brief description of drawings]

FIG. 1 is a configuration diagram of an information processing apparatus according to a first embodiment of the present invention.

FIG. 2 is an operation explanatory diagram of the information processing apparatus.

FIG. 3 is an operation explanatory diagram of the information processing apparatus.

FIG. 4 is an operation explanatory diagram of the information processing apparatus.

FIG. 5 is a configuration diagram of an information processing apparatus according to a second embodiment of the present invention.

FIG. 6 is a configuration diagram of an information processing device according to a third embodiment of the present invention.

FIG. 7 is a configuration diagram of an information processing apparatus according to a fourth embodiment of the present invention.

FIG. 8 is a configuration diagram of an information processing apparatus according to a fifth embodiment of the present invention.

FIG. 9 is an operation explanatory diagram of the information processing apparatus according to the sixth embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Information processing apparatus 2 Image display section 3 Scanner section 4 Storage section 5 Shape recognition section 6 Image classification section 12 Pattern recognition section 13 Image type storage section 14 Application program 15 Application program startup section 16 Visual matching structure

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁶ Identification number Internal reference number FI Technical display location G06F 15/403 310C 15/62 325R (72) Inventor Yoshihiro Ishizaki 1006 Kadoma, Kadoma, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (12)

[Claims] 1. A scanner section for inputting image information, a storage section for storing and accumulating information from the scanner section, and a shape recognition section for recognizing the shape of an image based on the image information from the storage section or the scanner section. And an image classifying unit for classifying each shape based on the information recognized by the shape recognizing unit and storing in the storage unit. 2. An image display unit for displaying an image, and an image classification unit for classifying the shapes recognized by the shape recognition unit into shapes and displaying the classified images on the image display unit.
An information processing apparatus according to claim 1. 3. The shape recognition section recognizes the lateral length of the outer shape of the image information input from the scanner section, and the image classification section follows the lateral length of the outer shape of the image recognized by the shape recognition section. The information processing apparatus according to claim 1, wherein the images are classified according to shapes. 4. The shape recognition unit recognizes the horizontal and vertical lengths of the outline of the image information from the scanner unit or the storage unit,
3. The information processing apparatus according to claim 1, wherein the image classification unit classifies the images according to shapes according to the horizontal and vertical lengths of the outer shape of the image recognized by the shape recognition unit. 5. A scanner section for inputting image information, a storage section for storing and accumulating information from the scanner section, and a pattern recognition section for recognizing an image pattern of an image based on the image information from the storage section or the scanner section. And an image classifying unit that classifies the image patterns according to the information recognized by the shape recognition unit and stores the classified image patterns in the storage unit. 6. The information processing apparatus according to claim 5, comprising an image display unit and an image classification unit that classifies the image patterns recognized by the pattern recognition unit into image patterns and displays the classified image patterns on the image display unit. . 7. A pattern recognition section for recognizing an image pattern of image information from a storage section or a scanner section, and an image classification section for classifying the image pattern recognized by the pattern recognition section. 4. The information processing device according to any one of 4 above. 8. The pattern recognition unit recognizes a color of image information,
8. The information processing apparatus according to claim 5, wherein the image classification unit classifies the images according to colors based on the image pattern information recognized by the pattern recognition unit. 9. An image type storage unit for storing in advance a shape of an outer shape of a specific image or an image pattern of the image, and information recognized by the shape recognition unit or the pattern recognition unit and a shape called from the image type storage unit or The information processing apparatus according to any one of claims 1 to 8, further comprising an image classifying unit that classifies images by matching with pattern information. 10. An image classification section comprising a plurality of application programs, wherein an application corresponding to the image information input to the scanner section is selected, and an image classification section for automatically classifying the image information on the selected application is provided. The information processing apparatus according to any one of claims 1 to 9. 11. The information processing apparatus according to claim 10, further comprising an application launching unit that automatically launches application software corresponding to the image information sorted by the image sorting unit. 12. A visual matching structure for integrally combining the display surface of the image display means and the input surface of the scanner unit so that they are visually matched to the user. The information processing apparatus according to any one of claims 6 to 11.