JP2005031912A - Image input device and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image input device which rapidly and accurately inputs contents marking the attributes of an image to be inputted. <P>SOLUTION: An object 20 and an attribute information marking object 19 marking the attribute information of the object 20 are simultaneously picked up by using an image-pickup device 15 having an optical system and an image-pickup element, and then the image of the object 20 and the attribute information of the object 20 are inputted to the image input device 70. An attribute data generation means, which generates the attribute data relating to the image of the object 20 thus picked up based on the attribute information which the attribute information marking object 19 marks; and an image input means, which correlates the image of the object 20 thus picked up with the image data of the image of the object 20 and inputs them; are provided. By this, the image and the information on the image are correlated and stored in the image input device 70. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image input apparatus, and more particularly to an image input apparatus that captures a photographed image together with subject attribute information.
[0002]
[Prior art]
Information recording media such as paper, which has been used for a long time, is easy to handle due to the fact that it is possible to perform familiar operations such as rewriting with an actual pen, and because it has excellent listability, etc. There are also merits. However, in consideration of searchability and space occupied by paper materials, utilization efficiency is further improved by positioning the paper based on a database of electronic data and using the paper for backup.
[0003]
For this reason, when creating a paper document database, it is very effective to add a tag called attribute information to the paper document. Conventionally, in the work of creating a database of captured images as digital image data, each image is given as attribute information such as acquisition date, file name, and classification identification information in order to facilitate searching and classification of the digital image data. I came.
[0004]
Up to now, attribute information has been assigned as a means for assigning attribute information based on a method in which an operator inputs the contents of the image using a keyboard or the like, or file information such as image data file storage destination information or file creation date and time. (For example, see Patent Document 1), a method of processing a captured image, automatically creating attribute information and embedding it in digital image data (for example, see Patent Document 2).
[0005]
[Patent Document 1]
JP 2001-84266 A
[0006]
[Patent Document 2]
JP 2001-92838 A
[0007]
[Problems to be solved by the invention]
However, the method in which attribute information is manually input by an operator causes erroneous input and requires time for input. In the method in which attribute information is added based on file information of an image data file, an image can be identified. There was a problem that information about data contents could not be identified. Further, the method of processing photographed images, automatically creating attribute information and embedding the attribute information in digital image data has a problem that the load applied to the data processing apparatus is large when digital image data is created.
[0008]
The present invention has been made in view of the above problems, and an object of the present invention is to input accurately the contents indicating the attribute of an input image without taking time.
[0009]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the invention according to claim 1, by using an imaging device having an optical system and an imaging device, simultaneously photographing an object and an attribute information sign indicating the attribute information of the object, An image input device for inputting an image of a subject and attribute information of the subject, wherein the attribute data creating means creates attribute data relating to the image of the photographed subject based on the attribute information indicated by the attribute information indicator. And an image input means for inputting the image of the photographed subject and the image data of the image in association with each other.
[0010]
According to the first aspect of the present invention, the contents corresponding to the input image can be accurately input without taking time.
[0011]
Furthermore, the invention according to claim 2 is characterized in that the attribute information is displayed in the display device in which the attribute information is displayed on a display device provided in the image input device, or in an area that is not shielded by the subject. The attribute information is marked on a subject mounting board marked with or a storage member accommodated in the image input device marked with the attribute information.
[0012]
According to the second aspect of the present invention, since the display device, the underlay, and the storable member can be used as the indication object of the attribute information, the contents of the attribute information can be changed with an easy operation.
[0013]
Furthermore, the invention described in claim 3 is the image input device according to claim 1, further comprising a projection unit that optically projects the attribute information, and the projection unit displays the attribute information in a photographing region. It is characterized by.
[0014]
According to the invention described in claim 3, more variety of attribute information can be given in an easy-to-update form.
[0015]
Furthermore, the invention according to claim 4 is the image input device according to any one of claims 1 to 3, wherein the attribute information is arbitrarily updated to new attribute information.
[0016]
According to the fourth aspect of the present invention, since the attribute information once indicated is held, the work is reduced when the same attribute information is given, and the attribute information can be stored even if there is no attribute information indicator in the imaging region. Is granted.
[0017]
Furthermore, the invention described in claim 5 uses an image pickup apparatus having an optical system and an image pickup device to simultaneously photograph a subject and an attribute information sign indicating the attribute information of the subject, and the subject image and the subject An image input method for inputting the attribute information of the subject, wherein a creation procedure for creating attribute data related to the image of the photographed subject based on the attribute information indicated by the attribute information sign, and an image of the photographed subject And an image input procedure for inputting image data of the image in association with each other.
[0018]
According to the fifth aspect of the present invention, the attribute information can be easily given to the image data without embedding special attribute information on the subject.
[0019]
Furthermore, in the invention described in claim 6, as an input method of the attribute information of the subject, a subject mounting board in which the attribute information is marked in an area not covered by the subject, or attribute information in which the attribute information is marked It is input using a labeling sheet, a terminal having a display device on which the attribute information is labeled, or a three-dimensional shape in which the attribute information is labeled by a combination of color and shape.
[0020]
According to the sixth aspect of the present invention, since an underlay, a sheet, a portable terminal, and a three-dimensional object can be used as a sign for attribute information, the contents of the attribute information can be changed with an easy operation.
[0021]
Furthermore, the invention according to claim 7 is the image input method according to claim 5 or 6, wherein the attribute information is arbitrarily updated to new attribute information.
[0022]
According to the seventh aspect of the present invention, since the attribute information once indicated is held, the work is reduced when the same attribute information is given, and the attribute information can be stored even if there is no attribute information indicator in the imaging region. Is granted.
[0023]
Furthermore, the invention according to claim 8 is an image of the subject based on the image of the subject and the attribute information sign that indicates the subject and the attribute information of the subject, which is photographed using an imaging device having an optical system and an imaging device. And an image input program for inputting the attribute information of the subject, an attribute data creation step for creating attribute data relating to the image of the photographed subject based on the attribute information indicated by the attribute information sign, An image input step for inputting an image of a subject in association with image data of the image, an image classification step for classifying the image based on image classification information included in the attribute data, and image processing information included in the attribute data. And an image processing step for performing a predetermined process on the image.
[0024]
According to the eighth aspect of the present invention, a database can be automatically created based on the photographed attribute information, and more sophisticated image information can be obtained based on information related to operations performed on the image included in the attribute information. Utilization becomes possible.
[0025]
DETAILED DESCRIPTION OF THE INVENTION
The present invention realizes a method for inputting and managing an image together with information on a subject using a digital camera, a scanner, a document camera, and other photographing apparatuses for photographing an image.
[0026]
DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings with specific examples.
[0027]
〔Example〕
FIG. 1 is a diagram illustrating a configuration example of an embodiment of the present invention. The image input device 70 in FIG. 1 includes an imaging device 15 held at a predetermined position by a support base A17, a support base B18, and a support column 16. An area indicated by a dotted line from the image pickup device 15 is set as an image pickup area, and image data is input by arranging and photographing a paper surface 20 as a subject in the image pickup area. As the imaging area of the imaging device 15, the specifications (size, positional relationship (layout)) of the imaging device 15, the support column 16, the support base A17, and the support base B18 are determined so as to include the paper surface 20 and the attribute information sign described later. It is done.
[0028]
A display 19 and operation switches 21 are provided on the support base B18. The display device 19 displays the attribute information on the paper surface 20, and the operation switch 21 operates the functions of the image input device, such as setting of the image acquisition condition and an image acquisition instruction. The computer 80 is connected to the support base A17 through a USB (Universal Serial Bus), RS232C cable, or the like, and processes and stores images and attribute information captured by the image input unit 1, which will be described in detail later. The computer 80 may be connected to the support base B18 or the imaging device 15.
[0029]
A configuration example of the imaging device 15 is shown in FIG. An image of the paper surface 20 that is a subject is formed on the image sensor 6 with an exposure time controlled by the shutter 4 through the fixed lens 1, zoom lens 2, aperture mechanism 3, and focus lens 5. An image signal from the image sensor 6 is sampled by a CDS (Correlated Double Sampling) (correlated double sampling) circuit 7 and then converted into a digital signal by an A / D converter 8. The timing at this time is generated by a TG (Timing Generator) 9. Thereafter, the image signal is stored in the memory 11 after being subjected to image processing such as aperture correction, compression, and the like by an IPP (Image Pre-Processor) 10. The operation of each unit is controlled by the MPU 12.
[0030]
An MPU 12 is connected with an I / O (Input / Output) controller 13 and an I / O device 14 is further connected. As the I / O device, an interface such as RS-232C, USB (Universal Serial Bus), iLink (registered trademark (IEEE 1394)), or a network adapter is used.
[0031]
Further, the imaging device 15 includes an image input unit 37, captures an image of a subject and attribute information corresponding to the subject, and stores the captured image in the memory 11. If necessary, it may be stored in a storage device in the PC instead of the memory 11.
[0032]
Based on the above configuration, the attribute information of the page 20 is displayed on the display device 19, and the displayed attribute information is stored together with the image of the page 20.
[0033]
The display device 19 displays attribute information corresponding to the page 20. As a display method of attribute information, signs such as text, images, codes, etc. of arbitrary notation are displayed. As the sign, for example, a general-purpose bar code (one-dimensional bar code, two-dimensional bar code) is used, and converted into recognizable information such as text by existing encoding means.
[0034]
The display device 19 includes a display device such as an LCD (Liquid Crystal Display) or an EL (Electroluminescence) display, and is provided with a drive power supply, a drive control circuit, and an interface. The display pattern to be selected can be selected. Therefore, attribute information suitable for the subject is displayed on the display device 19. Thus, if the attribute information is displayed by an operation on the image input device main body, the operation burden on the operator is reduced.
[0035]
Further, a means for generating a display pattern may be separately provided so that the user can customize and use it. The generation of attribute information corresponding to the image to be captured may be performed by the MPU 12 in the imaging device 15.
[0036]
As described above, in this embodiment, simple display devices and operation switches are arranged at arbitrary positions in the imaging area of the imaging device 15, thereby displaying the attribute information of the paper to be recorded on the display device 19 on the recorded image. Acquired and recognized from the generated image.
[0037]
Next, an operation example of the image input apparatus shown in FIG. 1 will be described based on the flowchart of FIG.
[0038]
FIG. 3A is a flowchart showing processing of a program that causes a computer to execute image input. FIG. 3B is a flowchart for explaining the “processing in the imaging device 15” in step 100 of FIG.
[0039]
Note that “processing in the computer 80” in step 200 in FIG. 3A performs creation of a database by the image classification unit and processing of an image by the image processing unit based on the subject and attribute information input in step 100. . Details of step 200 will be described later.
[0040]
In this embodiment, the processing performed by the imaging device 15 and the processing performed by the computer are individually configured. However, the processing may be integrated into either the imaging device 15 or the computer.
[0041]
The flowchart in FIG. 3B is a flowchart showing a flow of processing for adding attribute information to an image based on a photographed subject and the attribute information image. First, the operator sets attribute information to be given (S1). The attribute information has information necessary for creating a database, and contents necessary for the database system are given in advance. A method of selecting the item from the list and setting it, or the user may be able to add new contents independently. When the user inputs new contents independently, a coordinate detection unit and a contact detection unit are provided on the display surface of the display device 19, and a display input area such as a software keyboard is provided on the display surface by the coordinate detection unit. Is pointed on the display means so that the touch detection means can detect which key is pointed. Moreover, the structure which can operate the software keyboard displayed on the display apparatus 19 with the operation switch 21 and can input a content may be sufficient. Alternatively, a general-purpose input unit such as a keyboard or a tablet may be provided separately for input.
[0042]
The display device 19 has a decoding means for encoding the text selected by the operator into a barcode or the like, and can switch the display form of the attribute information. The user inputs the attribute information in an information form understandable by the operator, such as text information, and the input text information is displayed as a code on the display device 19. Since the image input device 70 can capture the attribute information displayed in code and recognize it as attribute information, it can recognize the attribute information from code information that can be recognized at a higher recognition rate than character recognition. Therefore, more reliable attribute information can be given.
[0043]
When the attribute information to be added is set, a document to be photographed is placed in the imaging area, and the image input is instructed by adjusting the exposure conditions with respect to the brightness of the subject and the photographing conditions such as focusing with the operation switch 21. (S2). As a result, the imaging device 15 acquires the input image A of the display device 19 on which the paper surface 20 and the attribute information are displayed (S3).
[0044]
Next, an image B in which attribute information is written is extracted from a predetermined image area of the input image A (S4).
[0045]
It should be noted that the area in which the attribute information is written may be automatically recognized and obtained without being designated in advance. A feature point (an image recognizable mark) indicating the image area of the attribute information is provided, the position of the feature point is obtained by pattern matching, and the position of the image area of the attribute information is calculated from this position.
[0046]
Subsequently, the attribute information is recognized from the image B (S5). Image B is subjected to preprocessing such as binarization processing and size normalization processing, and is input to the recognition means. The image B input to the recognition unit is recognized as attribute information by the recognition unit.
[0047]
As a recognition means, a normalized recognition template (dictionary) prepared in advance is provided, and feature points such as edges are extracted from the preprocessed image, and the feature point image and the template image are extracted. An algorithm used in general character recognition for obtaining a correlation coefficient and performing recognition using the correlation coefficient is used. For recognition of a general-purpose code such as a barcode, a template related to code information is created, and the recognition result can be acquired by comparing the template with the encoding result for the code image.
[0048]
Next, the reliability of the recognition result is evaluated (S6). As a function for evaluating reliability, for example, a similarity evaluation function indicated by a Euclidean distance between a template and a feature point image is used.
[0049]
If the similarity evaluation function is a reliability and the reliability is equal to or lower than a predetermined threshold, it is determined that the recognition is impossible, an error is displayed to the operator (S10), and an operation of stopping image recording is performed (S10). S11).
[0050]
If the reliability is greater than or equal to a predetermined threshold, the subject area is extracted as an image C from the input image A (S7). The subject area is, for example, a standard document (A3, A4, B5, etc.) paper document, and is an area where at least all of the subject to be recorded is imaged.
[0051]
When the image C is extracted, the recognized attribute information is given to the image C (S8). As a method of giving attribute information, there is a method of writing attribute information in the data name of the image, an attribute data file (text file) describing the attribute information is separately provided, and an attribute associated with each image data in the attribute data file A method for writing and managing information. The attribute data file may be provided for each image data, or may be provided as one file for all images.
[0052]
Image data and attribute information are recorded in recording means such as a hard disk and semiconductor memory, respectively (S9).
[0053]
This completes the input of the image having the attribute information.
[0054]
(Features of the present invention)
Subjects that are difficult to automatically load into the copier feeder due to problems such as paper jams, for example, multiple-bound paper such as carbon paper used in routine tasks such as form entry, sticky notes, etc. Documents, forms, etc. that are being used require work such as changing pages to digitize images. Therefore, an image input device that takes an image of the paper surface from above using an imaging device is useful in the business of digitizing and recording these document images.
[0055]
According to the present embodiment, attribute information such as text, code, and image can be displayed by a simple operation method using a simple display device, so that attribute information is added to image data without embedding special attribute information on the paper. it can.
[0056]
In this embodiment, the display device 19 is used as an attribute information sign, but various embodiments are used for the attribute information sign. Hereinafter, various embodiments of the attribute information sign will be described.
[0057]
(Modification 1)
In this modification, an underlay-like plate on which a subject is placed is used as the attribute information indicator. FIG. 4 shows an example in which an underlay is used as an attribute information sign. 4, the same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted. The image input device 70 of FIG. 4 differs from the embodiment in that attribute information is displayed on the underlay 22. In FIG. 4, a sign 23 is displayed as an example of attribute information.
[0058]
In this modification, for example, a plurality of underlays on which signs such as text, graphics, and codes for displaying attribute information added to the image data on the paper are printed are prepared. It is assumed that the portion on which the sign is printed is arranged at a position that is not shielded when the paper surface 20 is installed. Depending on the size of the subject, an underlay having a different size printed with the sign 23 may be prepared. Since it is possible to perform operations other than shooting, such as the placement of an object and the placement of an underlay, by exchanging or placing a paper-like object, there is no need to bother with a plurality of operating environments, and the operational burden on the operator is reduced. Further, when changing the attribute information to be added, an operation to change the underlay is required, so that it is possible to create a more reliable database, such as reducing erroneous input of attribute information.
[0059]
(Modification 2)
FIG. 5 shows an example using a member on which image information is displayed as an attribute information indicator. 5, the same components as those in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted. The image input device 70 of FIG. 5 differs from the first modification in that attribute information is displayed on the stowable member 24.
[0060]
The retractable member 24 on which the sign 23 is printed is provided on the support base A17. The storable member 24 is a member constituting the configuration of the support base A17. However, in this modification, the storable member 24 can be stored in the support base A17. Further, since the storable member 24 only needs to be storable on a member in the imaging region of the imaging device 15, for example, the storable member 24 may be provided on the support base B18 and at a position that does not block the photographing of the paper surface 20 that is the subject. I just need it.
[0061]
The storable member 24 is provided with a plurality of pages of indicators 23 so that the page on which the code is printed is changed according to the attribute information to be given. In addition, the description regarding the contents of the code is also written in text information on a part of the plurality of pages of the stowable member 24.
[0062]
Note that the stowable member 24 is stowed in the support base A17 by expansion and contraction in the direction X. For example, the stowable member 24 can be stowed by a rotational movement with respect to an arbitrary axis, or can be housed by bending. May be.
[0063]
In this modification, the attribute information is provided on a member that can be stored in the support member of the imaging apparatus, so that the content of the attribute information can be changed with easier work.
[0064]
(Modification 3)
FIG. 6 shows an example using a sheet on which image information is displayed as an attribute information indicator. In FIG. 6, the same components as those in FIG. The image input device 70 of FIG. 6 is different from the first and second modifications in that attribute information is displayed on the attribute information input sheet surface 27.
[0065]
Handwritten characters, symbols, and figures may be displayed on the attribute information input paper surface 27 as shown in FIG. 6A, or an image forming apparatus such as a printer or a copying machine as shown in FIG. 6B. Characters, symbols, and figures output by may be displayed.
[0066]
FIG. 6A shows an example in which “Accounting A” is added by a handwritten writing trajectory, and attribute information “Accounting A” is given to image data obtained by imaging the paper surface 20.
[0067]
In FIG. 6B, the text “Yamada” output by the image forming apparatus is displayed on the attribute information input paper surface 27, and the attribute information “Yamada” is added to the image data obtained by imaging the paper surface 20. .
[0068]
In this modification, the attribute information input sheet surface 27 can be freely arranged in the shooting range, and the degree of freedom is greater than those in Modifications 1 and 2 in that the attribute information can be added with handwritten characters.
[0069]
Moreover, when using a handwritten writing trajectory, the character recognition rate is lower than in the case of printed characters. In order to improve the character recognition rate, when the acquisition start of the attribute information is instructed, a moving image is acquired by the imaging device 15, the trajectory (stroke) of the pen tip is acquired as time series data, and the attribute is obtained by online character recognition. Information may be acquired. Moreover, you may utilize the method of adding attribute information by a handwritten writing locus | trajectory in combination with another modification.
[0070]
(Modification 4)
FIG. 7 shows an example in which image information is displayed on the portable information terminal 26 as an attribute information sign. In FIG. 7, the same components as those in FIG. The image input device 70 of FIG. 7 is different from the first to third modifications in that attribute information is displayed on the display device of the portable information terminal 26.
[0071]
In this modification, a portable information terminal having display means such as an LCD is provided in the imaging area, and attribute information is displayed on the LCD, and the attribute information is recognized and recorded in correspondence with the acquired image. The portable information terminal 26 has its own software for generating attribute information, and is displayed by an operation with a switch provided on the housing or a touch panel operation with a coordinate detection means and a press detection means provided on the LCD surface. The attribute information can be updated or input.
[0072]
In this modification, attribute information can be displayed on the portable information terminal 26 with high portability, so that various attribute information can be displayed as in the embodiment, and can be freely arranged within the photographing range.
[0073]
If there is sufficient space, a display screen of a PC as a display device may be arranged within the imaging range. In this case, generation of attribute information and display control are performed on a PC (personal computer) connected to the image input device 70.
[0074]
(Modification 5)
FIG. 8 shows an example in which attribute information is optically projected and displayed as an attribute information indicator. 8, the same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted. The image input device 70 in FIG. 8 is different from the first to fourth modifications in that attribute information is projected by the projection device 25.
[0075]
The projection device 25 provided in the imaging device 15 has the same configuration as a liquid crystal projector including a projection variable magnification lens, a light amount control unit, a condenser lens group, and an LCD. When a trapezoidal distortion in which the projection area becomes trapezoid occurs, correction by controlling the driving state of the LCD or correction by moving the optical axis by the prism is performed. Further, when the attribute information is recognized, it may be corrected by digital image processing.
[0076]
The projection device 25 only needs to be provided at a site that can be projected onto the imaging region, and is not necessarily provided on the imaging device 15 as illustrated. For example, a support member 16 or another member supported by the support column 16 is provided, You may provide on this another member. The projection area to be projected is also formed on the support member B18 in the drawing, but it may be formed in an area that does not overlap the subject in the imaging area.
[0077]
In the present modification, the display position and size of the attribute information to be displayed and the degree of freedom of the contents are increased by the optical projection means.
[0078]
(Modification 6)
FIG. 9 shows an example in which a three-dimensional shape is used as the attribute information sign. 9, the same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted. The image input device 70 of FIG. 9 is different from the first to fifth modifications in that attribute information is displayed by a three-dimensional shape 30 arranged in the imaging region.
[0079]
In this modification, objects having different recognizable colors and shapes are placed in the imaging region as attribute information, and different attribute information is provided depending on the color and shape. For example, a specific attribute for each object having a different color and shape, such as attribute information A for a red disk-shaped object, attribute information B for a black square object, and attribute information C for a yellow triangle object. Keep information. In addition, the contents of the attribute information are appended to the invisible part such as the back of the object in text so that the operator can recognize the attribute information of the object.
[0080]
In this modification, although the number of attribute information that can be given is smaller than that of character recognition, the attribute information can be recognized with high accuracy, and the reliability is improved.
[0081]
(Update attribute information)
The attribute information displayed by the attribute information sign in the above modification can be freely updated by an operator's operation or setting. When a display device such as an LCD or optical projection means is used as the attribute information indicator, the attribute information displayed by the update operation by the operation switch 21, the update operation by the computer, the update operation by the portable information terminal 26, etc. is updated. it can. Further, when using the underlay 22, the stowable member 24, the attribute information input sheet surface 27, or an object having a different color or shape as the attribute information sign, it can be updated by exchanging them.
[0082]
Therefore, if it is not necessary to change to the next attribute information, the same attribute information is used without being changed. Rather than acquiring attribute information for each shooting, the attribute information displayed once is retained, and the attribute information is updated only when a change is necessary, thereby improving the efficiency of image acquisition. If the last attribute information is held in a predetermined storage area, an attribute can be given even if there is no attribute information sign in the imaging area. In the form processing and the like, since the types of attribute information are also limited, there are many cases where the same attribute information is continuously given, and holding the attribute information improves efficiency.
[0083]
So far, the image input apparatus has been described that uses the attribute information sign illustrated as a preferred embodiment and simultaneously captures the subject and the attribute information sign representing the attribute of the subject.
[0084]
Here, an image data processing method using a computer used together with the image input apparatus or as a single unit and a program executed by the computer will be described.
[0085]
The computer 80 in FIG. 1 described above is an example of a computer that executes image information processing means used in this embodiment. FIG. 10 is a block diagram showing functions of the computer 80 shown in FIG.
[0086]
A computer 80 shown in FIG. 10 is, like a general computer, a main control unit 31 that comprehensively controls and controls functions constituting the computer 80, and a main storage unit 32 that temporarily stores programs and data. , A storage device 33 for storing programs and data, a communication unit 34 for controlling communication with the Internet, a LAN (local area network), etc., and an input from an input / output device such as a keyboard and an output to a display device. An input / output control unit 35 is included.
[0087]
In addition, the storage device unit 33 includes an image database 36 that stores images input by the image input device 70.
[0088]
Further, the computer is equipped with an image input program, and an image obtained by the attribute data creation means 41, the image recording means 42, and the image recording means 42 already described based on the flowchart of FIG. Image classification means 43 for classifying images, and image processing means 44 for processing images based on the processing information of the image database. Therefore, the program of this embodiment is a program including both step 100 and step 200 in the flowchart of FIG. Among these, the image classification unit 43 and the image processing unit 44 execute the process of step 200.
[0089]
The image classification means 43 will be described based on the configuration example of the image database shown in FIG. 11 and the flowchart of the processing of the image classification means 43 shown in FIG.
[0090]
The image file in FIG. 11A shows an example of an image file included in the image database 36, and the image data file in FIG. 11B shows an example of an attribute data file included in the image database. As described in the processing for assigning attribute information in FIG. 3, the attribute information photographed together with the subject image is the input image A, and the subject portion image of the input image A is the input image C, and the input image A Among them, the image of the attribute information portion is extracted as the input image B. In FIG. 11A, input images A to C are stored. FIG. 11B shows the attribute information indicating the attributes of the images associated with the input images A to C by the image ID, the classification ID in which the information for classification is coded, and the processing performed on the image Is recorded, and information on the input date when the image is input is recorded.
[0091]
First, the image classification unit 42 receives a classification condition input by, for example, an operator (S51). The classification condition can be freely input such as the department that owns the image, the person in charge, and the field indicated by the captured image, but may be automatically determined based on the attribute information and the classification ID. Receiving the classification condition, the image classification means 42 analyzes the classification condition input as text information, searches the classification ID based on the analysis result, and extracts the image ID that matches the classification condition (S52).
[0092]
When the image ID is extracted, the input image C corresponding to the image ID is extracted from the image file of FIG. 11A based on the image ID (S53). As described above, the corresponding input image C is classified under the inputted classification condition. The extracted input image C is output as a table together with the image ID (S54).
[0093]
The image classification means 42 creates, for example, a database in which an image list is created for images related to “accounting”, and images for which a certain storage period has elapsed from the input date are extracted. Therefore, the image classification means 42 can create various databases according to the purpose of classification.
[0094]
Next, the image processing unit 43 will be described based on the configuration example of the image database shown in FIG. 11 and the flowchart of the processing of the image classification unit 43 shown in FIG.
[0095]
The image processing means 43 executes the processing content described in the processing content of the attribute data file automatically or when a predetermined instruction is given. The processing contents include, for example, “send this image to mail address xxx@yyy.co.jp”, “output this image to the printer with IP address 000.111.222.333”, and the like.
[0096]
First, the image processing means 43 analyzes the processing content (S61). For example, it is determined whether or not the processing content includes an expression in a prescribed format such as an email address, or the processing recorded in the processing content is analyzed by performing language analysis on the processing content.
[0097]
When the processing content is analyzed, a processing method is generated (S62). For example, when an e-mail address is recorded in the processing content, e-mail software is called and information necessary for sending e-mail is transferred to the e-mail software. The mail software provided with the information necessary for processing transfers the mail address to the address box, and transmits it with the input image C attached (S63).
[0098]
Therefore, the image processing means 43 provides a function for performing predetermined processing on the image according to the processing content of the attribute data file. That is, the processing based on the attribute information can be performed on the image only by photographing the image of the subject and the attribute information sign. Imaging of an image functions as an operation conversion unit that executes various processes.
[0099]
In addition, this image database enables not only to create a database using attribute information but also to provide an application using an image.
[0100]
As described above, the present embodiment functions as a program that executes processing based on the image and attribute information together with the image input apparatus described in the embodiment or alone.
[0101]
【The invention's effect】
The contents indicating the attribute of the input image can be input accurately without taking time.
[Brief description of the drawings]
FIG. 1 is a configuration diagram showing a configuration in an embodiment of an image input apparatus of the present invention.
FIG. 2 is a block diagram illustrating a configuration of an imaging apparatus.
FIG. 3 is a flowchart showing image input processing in the present embodiment.
FIG. 4 is a diagram illustrating an example of image input using an underlay as an attribute information indicator.
FIG. 5 is a diagram illustrating an example of image input using a stowable member as an attribute information indicator.
FIG. 6 is a diagram illustrating an example of image input using an attribute information input sheet surface as an attribute information indicator.
FIG. 7 is a diagram illustrating an example of image input using a portable information terminal as an attribute information indicator.
FIG. 8 is a diagram illustrating an example of image input using a projection device as an attribute information indicator.
FIG. 9 is a diagram illustrating an example of image input using a three-dimensional shape as an attribute information indicator.
FIG. 10 is a block diagram illustrating a functional configuration of a computer used in the present embodiment.
FIG. 11 is a diagram illustrating a configuration example of an image database.
FIG. 12 is a flowchart showing operations of (a) image classification processing and (b) image processing in the present embodiment.
[Explanation of symbols]
1 Fixed lens
2 Zoom lens
3 Aperture mechanism
4 Shutter
5 Focus lens
6 Image sensor
7 CDS
8 A / D converter
9 Timing generator
10 IPP
11 memory
12 MPU
13 I / O controller
14 I / O devices
15 Imaging device
16 props
17 Indicator board
19 Display device
20 pages
21 Operation switch
22 Underlay
23 signs
24 Storable members
25 Projector
26 Mobile information terminal
27 Attribute information input sheet
30 Three-dimensional shape
36 Image Database
37 Image input means
41 Attribute information giving means
42 Image recording means
43 Image classification means
44 Image processing means
70 Image input device
80 computers

Claims (8)

An image input device that uses an imaging device having an optical system and an imaging device to simultaneously photograph a subject and an attribute information indicator that indicates the subject's attribute information, and input the subject image and the subject's attribute information Because
Attribute data creating means for creating attribute data related to the image of the photographed subject based on the attribute information indicated by the attribute information indicator;
Image input means for inputting the image of the photographed subject in association with the image data of the image;
An image input apparatus characterized by that. The attribute information sign is
The attribute information is displayed on a display device provided in the image input device, or
A subject mounting board in which the attribute information is marked in an area that is not shielded by the subject, or a storage member that is stored in the image input device in which the attribute information is marked;
The image input apparatus according to claim 1. A projection means for optically projecting the attribute information;
The attribute information is marked on the shooting area by the projection means.
The image input apparatus according to claim 1. The attribute information is
Optionally updated with new attribute information,
The image input device according to claim 1, wherein the image input device is an image input device. An image input method for simultaneously capturing an image of an object and an attribute information sign indicating the attribute information of the object using an imaging apparatus having an optical system and an image sensor, and inputting the image of the object and the attribute information of the object Because
A creation procedure for creating attribute data relating to an image of a photographed subject based on the attribute information indicated by the attribute information indicator;
An image input procedure for inputting the image of the photographed subject in association with the image data of the image;
An image input method characterized by the above. Input of the attribute information of the subject is
A subject mounting board in which the attribute information is marked in an area not covered by the subject, or
Attribute information labeling sheet on which the attribute information is labeled, or
A terminal having a display device on which the attribute information is indicated, or
A three-dimensional shape in which the attribute information is indicated by a combination of color and shape;
Enter using
6. The image input method according to claim 5, wherein: The attribute information is
Optionally updated with new attribute information,
The image input method according to claim 5 or 6, characterized in that An image of the subject and attribute information of the subject are input on the basis of an image of the subject and an attribute information marking object that indicates the subject's attribute information photographed using an imaging device having an optical system and an imaging device. An image input program,
An attribute data creating step for creating attribute data related to an image of a photographed subject based on the attribute information indicated by the attribute information sign;
An image input step of inputting the image of the photographed subject in association with the image data of the image;
An image classification step of classifying the image based on image classification information included in the attribute data;
An image processing step for performing predetermined processing on the image based on image processing information included in the attribute data;
An image input program characterized by that.

Images