JP2005267034A - Image input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image input device for controlling the input and input inhibition of position information corresponding to a position to be pointed by an indication member according to the height of the indication member, the indication member pointing an arbitrary position to an object whose image is imaged. <P>SOLUTION: The image data of an object are acquired by region units divided by the locus of the indication member, and the end position of an locus to be drawn by the indication member is recognized when the position of the indication member is the height of the predetermined position or more. Thus, the end position of one locus is recognized by lifting the indication member to the height of the predetermined position or more when an locus is inputted by the indication member. Thus, it is possible to easily recognize the end position of one locus, and to surely recognize the end position of one locus. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image input apparatus, and more particularly to an image input apparatus that can easily and reliably specify a desired input area for a document placed on a desk.

  2. Description of the Related Art Conventionally, there is a desk stand type image input device that can input character data and image data in a document by imaging the document placed on the desk from above with an imaging device. For example, Patent Document 1 discloses a copying apparatus including a video camera / projector device provided above a desk. This copying apparatus uses a video camera to copy an original document placed on a desk surface. By taking an image, the original document can be input as image information, while the input image information can be projected onto a desk surface by a projector.

  In Patent Document 1, in the copying apparatus, a desired figure included in an original document placed on a desk surface is moved from the upper right corner to the lower left corner of the figure, It is described that the figure region can be selected by photographing and inputting drawing of a “circle” with a video camera. Edit the image of the selected graphic area by placing the finger on the selected graphic area and moving the finger to the desired position in the document being edited projected on the desk by the projector. It is described that it can be pasted into a document inside.

In the copying apparatus described in Patent Document 1, an operation completion instruction in each operation such as selection and pasting of a graphic area with a finger as described above is performed by a user tapping a desk. Specifically, in the copying apparatus described in Patent Document 1, a small snare drum type microphone is attached to the lower side of a desk, and a vibration signal or sound generated by hitting the desk is transmitted to the small snare drum. The signal is picked up by a type microphone, and the vibration signal or sound is compared with a threshold value by a signal processing device.
Japanese Unexamined Patent Publication No. 7-168949

  However, the copying apparatus described in Patent Document 1 recognizes a vibration signal or sound picked up by a small snare drum type microphone provided under the desk as an instruction to complete the operation for selecting the graphic area. There is a problem that noise generated regardless of the completion instruction, for example, a vibration signal generated when the arm hits the desk is erroneously recognized as the operation completion instruction.

  The present invention has been made to solve the above-described problems, and by detecting the position of the pointing member pointing to an arbitrary position with respect to the object to be imaged, in particular, the height thereof, the height of the pointing member is detected. Accordingly, the input and prohibition of input of position information corresponding to the position indicated by the pointing member is controlled, so that, for example, when a boundary line that divides the object into a plurality of regions is drawn by the pointing member, It is an object of the present invention to provide an image input device that can be regarded as the end of drawing of the boundary line by lifting the pointing member to a predetermined height or more.

  In order to achieve this object, an image input apparatus according to claim 1 is an image capturing unit capable of capturing an image of an object existing in a predetermined area on a plane, and an image of the object imaged by the image capturing unit. Image data acquisition means acquired as data, indication member position detection means for detecting the position of the indication member pointing to an arbitrary position with respect to the object relative to the object, and the indication member position detection means, Position information input means for inputting position information corresponding to the position of the object pointed to by the pointing member when it is detected that the difference between the height and the height of the object is smaller than a predetermined value; When the position detection means detects that the difference between the height of the pointing member and the height of the object is greater than a predetermined value, the position information input means prohibits the input of position information. When the position information input prohibiting unit and the position information input unit start inputting the position information of the pointing member, the pointing member moves until the position information input prohibiting unit prohibits the input of the position information. Area classification means for dividing the object into a plurality of areas according to the indicated locus, and the image data acquisition means can acquire image data in units of areas divided by the area classification means. Is.

  According to the image input device of the first aspect, the object in the predetermined area on the plane imaged by the imaging unit is imaged, and the imaging is acquired as image data by the image data acquiring unit. On the other hand, the position of the pointing member indicating an arbitrary position with respect to the object is detected by the pointing member position detecting means. At this time, if it is detected that the difference between the height of the pointing member and the height of the object is smaller than a predetermined value, the position information corresponding to the position of the object pointed to by the pointing member by the position information input means Although it is input, if it is detected that the difference between the height of the pointing member and the height of the object is greater than a predetermined value, the position information input prohibiting means prohibits the input of the position information. In response to the locus indicated by the pointing member that moves until the position information input prohibiting unit prohibits the input of the position information after the position information input unit starts to input the position information of the pointing member. Thus, the object is divided into a plurality of areas by the area dividing means. When the object is divided into a plurality of areas by the area dividing means, the image data acquisition means acquires image data in units of the divided areas.

  According to a second aspect of the present invention, in the image input device according to the first aspect, the indicating member has a rod-shaped tip, and the pointing member position detecting means detects the position of the rod-shaped tip. Is.

  The image input device according to claim 3 is the image input device according to claim 1 or 2, wherein the focus adjustment unit adjusts the focus so that the object imaged by the imaging unit is in focus, and the focus adjustment thereof. A focus degree measuring means for measuring a focus degree of the pointing member with respect to a focus adjusted to fit the object by the means, and the pointing member position detecting means is measured by the focus degree measuring means. The height of the indicating member is determined by comparing the degree of focus with a predetermined threshold value.

  According to the image input apparatus of the third aspect, the focal point of the pointing member with respect to the focal point adjusted to be suitable for the object by the focal point adjusting means is the same as that of the image input apparatus according to the first or second aspect. Is measured by the focus degree measuring means. The pointing member position detecting means determines the height of the pointing member by comparing the focus degree measured by the focus degree measuring means with a predetermined threshold value.

  The image input device according to claim 4 is the image input device according to any one of claims 1 to 3, wherein the region segmenting means is a region surrounded by a closed line based on the shape of the trajectory, And / or the object is divided into a region surrounded by a line crossing the object and the outline of the object.

  The image input device according to claim 5 is the image input device according to any one of claims 1 to 4, wherein after the region is partitioned by the region partitioning unit, the pointing member is When position information indicating that one of the divided areas is pointed in is input, the image data acquisition means includes the area specifying means for specifying the one area. When one area is designated by the means, the image data of the area portion designated by the area designation means is acquired.

  According to the image input device according to claim 5, in addition to acting in the same manner as the image input device according to any one of claims 1 to 4, the area where the indication member is divided by the position information input means. When position information indicating that it is pointing within one area is input, the designated one area is designated by the area designating means. Then, the image data of the designated area is acquired by the image data acquisition means.

  The image input device according to claim 6 is the image input device according to claim 5, wherein when the image data corresponding to the region specified by the region specifying unit is acquired by the image data acquiring unit, the acquired image data is acquired. A filing means for creating an image file of image data is provided.

  According to the image input device of the sixth aspect, the image input device operates in the same manner as the image input device according to the fifth aspect, and the image file of the image data corresponding to the area specified by the area specifying means is filed by the file forming means. Created.

  According to a seventh aspect of the present invention, in the image input device according to the sixth aspect, the image data acquisition means obtains image data corresponding to the designated area every time the area is designated by the area designation means. The filing means creates a separate image file for each image data obtained by the image data obtaining means.

  According to the image input apparatus of the seventh aspect, the image input apparatus operates in the same manner as the image input apparatus according to the sixth aspect, and each time an area is specified by the area specifying means, an image corresponding to the specified area An image file of data is created by the filing means.

  The image input device according to claim 8 is the image input device according to any one of claims 1 to 7, further comprising a fixed object detection unit that detects a fixed object that fixes the object, and the fixed object detection unit When a fixed object is detected, the position of the pointing member is detected by the pointing member position detecting means.

  According to the image input device according to the eighth aspect, the fixed object for detecting the fixed object is detected by the fixed object detecting means in addition to the same operation as the image input apparatus according to any one of the first to seventh aspects. Then, the position of the pointing member is detected by the pointing member position detecting means.

  The image input device according to claim 9, wherein the image input device according to any one of claims 1 to 8 projects an image showing a boundary of each region divided by the region dividing unit onto the object. Boundary projecting means, and identifier projecting means for projecting an image indicating an identifier for identifying each of the areas on each area indicated by the boundary projecting means.

  According to the image input device according to claim 9, the image input device operates in the same manner as the image input device according to any one of claims 1 to 8, and also shows an image indicating a boundary partitioned by the region partition region with respect to the object. Is projected by the boundary projecting means, and an identifier indicating an identifier for specifying each region is projected by the identifier projecting means.

  The image input device according to claim 10 is the image input device according to claim 9, wherein when the image data acquisition means acquires image data in units of areas divided by the area classification means, the image data acquisition means Pattern projection means for projecting an image distinguishable from an area for which image data has not been acquired on each area indicated by the boundary by the boundary projection means with respect to the area for which image data has been acquired. ing.

  According to the image input device of the tenth aspect, the image input device operates in the same manner as the image input device according to the ninth aspect, and when the image data of each divided area is acquired, boundary projection is performed on the area. An image that can be distinguished from other areas for which image data has not been acquired is projected by the pattern projection means together with the boundaries between the areas projected by the means, whereby the image data acquired area and the unacquired area A distinction is possible.

  The image input device according to claim 11 is the image input device according to any one of claims 1 to 10, further comprising a message projecting unit that projects an auxiliary message for the operation in accordance with a timing at which the predetermined operation is performed. ing.

  An image input device according to claim 12 is the operation button projecting means for projecting an image having a predetermined shape in accordance with the timing for executing the predetermined operation in the image input device according to any one of claims 1 to 11. The position information input means executes the predetermined operation when position information indicating that the pointing member points within the area of the image projected by the operation button projection means is input.

  According to the image input device of the twelfth aspect, in addition to the same operation as the image input device according to any one of the first to eleventh aspects, the operation button projecting unit performs the predetermined operation according to the timing of executing the predetermined operation. An image having a predetermined shape is projected. When the position information indicating that the pointing member points to the area of the image having the predetermined shape is input by the position information input unit, a predetermined operation corresponding to the projected operation button is executed. .

  According to the image input device of the first aspect, the image data of the object can be acquired in units of regions divided by the locus of the pointing member, and the end position of the locus drawn by the pointing member is Is recognized when the position is equal to or higher than the height of the predetermined position. Therefore, after placing the pointing member close to the target object at a position lower than the predetermined position, keeping the position lower than the predetermined position and drawing the trajectory, finally lifting the pointing member above the predetermined position to Image data of a desired region in the object can be acquired. Since the end position of the trajectory is recognized by lifting the indicating member above the predetermined position, not only the end position can be easily recognized, but also the end position can be surely recognized.

  According to the image input device of the second aspect, in addition to the effect produced by the image input device according to the first aspect, the pointing member position detecting means detects the position of the bar-shaped tip of the pointing member. The position indicated by can be detected more clearly. Therefore, there is an effect that a desired area can be accurately divided and acquired as image data.

  According to the image input device of the third aspect, in addition to the effect produced by the image input device according to the first or second aspect, the detection of the position of the pointing member in the pointing member position detecting means is adjusted so as to match the object. Since the degree of focus of the pointing member with respect to the focused point (the degree of focus on the pointing member) is compared with a predetermined threshold, the height of the pointing member with respect to the target is determined as the position of the pointing member with respect to the target. Can be detected. Therefore, even if it is a simple operation of bringing the pointing member close to the object, drawing a locus, and lifting the pointing member upward with respect to the object, the input start position and input end position of the locus are identified. There is an effect of obtaining. Therefore, it is possible to input a boundary line of a desired region in the object more easily and reliably.

  According to the image input device of the fourth aspect, in addition to the effect produced by the image input device according to any one of the first to third aspects, the closed line is used based on the shape of the locus drawn by the pointing member. Since the object can be divided into an enclosed area and / or an area surrounded by a line crossing the object and the outline of the object, for example, a desired area from which image data is to be acquired can be obtained. There is an effect that image data having a desired shape can be obtained by surrounding the object with a locus drawn by the pointing member and / or drawing a locus traversing the object with the pointing member.

  According to the image input device of the fifth aspect, in addition to the effect produced by the image input device according to any one of the first to fourth aspects, one region among the regions where the pointing member is divided by the region dividing means When position information indicating that the inside is pointed in is input by the position information input means, the image data of the area pointed to by the pointing member is acquired. By pointing the pointing member closer, image data of the desired area can be acquired. Therefore, there is an effect that image data of a desired area can be acquired by a simple operation.

  According to the image input device of the sixth aspect, in addition to the effect produced by the image input device according to the fifth aspect, the image file of the image data corresponding to the area designated by the area designation means is created. There is an effect that an image file of a desired region in an object can be easily created, and the image file can be used for a desired application (for example, creation of a document).

  According to the image input means described in claim 7, in addition to the effect produced by the image input device according to claim 6, every time an area is specified by the area specifying means, the image data corresponding to the specified area is stored. Since the image file is created, there is an effect that an image file obtained by dividing one target object into a plurality of objects can be efficiently created.

  According to the image input device according to claim 8, in addition to the effect produced by the image input device according to any one of claims 1 to 7, the position of the pointing member is detected when a fixed object that fixes the object is detected. Therefore, for example, when a fixed object is not detected, there is an effect that it is not necessary to perform useless detection even if the pointing member moves within the imaging region.

  According to the image input device of the ninth aspect, in addition to the effect produced by the image input device according to any one of the first to eighth aspects, an image showing the boundary divided by the region division region with respect to the object. Since the identifier is projected by the boundary projection unit and the identifier indicating the identifier for specifying each region is projected by the identifier projection unit, each divided region can be easily identified.

  According to the image input device of the tenth aspect, in addition to the effect produced by the image input means according to the ninth aspect, an image that can be distinguished from an unacquired area is projected onto an area where image data has already been acquired. Therefore, it can be recognized at a glance whether or not the image data of each divided area has already been acquired. Therefore, it is possible to efficiently perform image data input operations by suppressing wasteful operations such as redundantly acquiring image data of already acquired regions or failing to acquire image data of desired regions. There is.

  According to the image input device of the eleventh aspect, in addition to the effect produced by the image input device according to any one of the first to tenth aspects, an auxiliary message for the operation is displayed according to the timing of executing the predetermined operation. Since the projection is performed, the operation can be executed efficiently, and an operation error can be suppressed.

  According to the image input device of claim 12, in addition to the effect produced by the image input device according to any one of claims 1 to 11, the operation projected according to the timing at which the instruction member performs a predetermined operation When position information indicating that the button is pointed is input by the position information input means, a predetermined operation corresponding to the projected operation button is executed, so that various operations can be easily performed. .

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a diagram schematically showing a state of imaging by an imaging device 100 which is an image input device of the present invention. As shown in FIG. 1, the external appearance of the imaging device 100 is as follows: a main body case 10, a support arm 12 for arranging the main body case 10 above a flat table 400 such as a desk, an imaging unit 20, and a light projecting unit. 30, and an imaging target object such as a document 200 arranged in the imaging area 300 on the plane table 400 is imaged by the imaging unit 20 from directly above, and image data of the imaging is input. The light projecting unit 30 projects a frame 301 of an area (imaging area) 300 that can be imaged by the imaging unit 20, various messages, various operation buttons, a projection image, and the like on the flat table 400. Note that the “projection image” refers to an image for segmenting the document 200 such as a boundary 302 of each region (divided region) divided according to the processing described later and an identifier for identifying each region. means. Note that the side of the support arm 12 not connected to the main body case 10 is connected to a clip or a fixing base (not shown), and the imaging device 100 is fixed to a thin display or a desk stand of a personal computer using the clip. Used as a clip type or a desk stand type with a fixed base as a leg.

  Next, the configuration of the imaging unit 20 and the light projecting unit 30 in the imaging apparatus 100 will be described with reference to FIG. FIG. 2 is a cross-sectional view illustrating main configurations of the imaging unit 20 and the light projecting unit 30 in the imaging apparatus 100. For simplification of the drawing, FIG. 2 shows only the arrangement of main members in the imaging unit 20 and the light projecting unit 30, and the case for housing these members and the electrical wiring of each member are omitted. doing. As shown in FIG. 2, the imaging unit 20 includes an imaging lens 22 that is directed to the plane table 400 and a CCD image sensor 24 that is provided behind the imaging lens 22 (inside the imaging device 100). ing.

  The imaging lens 22 is composed of a plurality of lenses, has an autofocus function, and automatically adjusts the focal length and aperture to form an image of light from the outside on the CCD image sensor 24.

  The CCD image sensor 24 has a configuration in which photoelectric conversion elements such as CCD (Charge Coupled Device) elements are arranged in a matrix, and generates a signal corresponding to the color and intensity of light of an image formed on the surface thereof. Then, this is converted into digital data and output to a processor (processor 40 to be described later) that controls the entire imaging apparatus 100. Note that the image data of the entire imaging is composed of pixel data of a number of pixels equal to the number of CCD elements. Here, one CCD element corresponds to one pixel, and each pixel has pixel data represented by three colors of red (R), green (G), and blue (B) and 256 levels of luminance. doing.

  On the other hand, as shown in FIG. 2, the light projecting unit 30 includes a light source unit 32 and a condensing lens 34 that collects light projected from the light source unit 32 in the order from the inner side to the outer side of the imaging device 100. A liquid crystal panel 36 and a projection lens 38 are provided.

  The light source unit 32 includes a light source 32a such as a halogen lamp that emits white light or a white LED (Light Emitting Diode), and a reflection plate 32b that is directed to the condenser lens 34. The light source 32 emits white light emitted from the light source 32a. The light enters the condenser lens 34 efficiently using the reflector 32b.

  The condensing lens 34 is an optical lens that condenses the light emitted from the light source unit 32, and can be constituted by, for example, a Fresnel lens. In this Fresnel lens, a thin and flat acrylic resin plate-like sheet is formed by concentric circles of prisms having different angles at regular intervals. The peak of the prism acts as a small bent surface and functions as a condenser lens 34.

  The liquid crystal panel 36 encloses liquid crystal between two glass plates, changes the direction of liquid crystal molecules by applying a voltage, and increases or decreases the light transmittance, thereby causing an image (frame 301 or Images corresponding to various messages, various buttons, and projection images) are displayed. The white light that has entered from the condenser lens 34 and transmitted through the liquid crystal panel 36 is an image corresponding to an image formed on the liquid crystal panel 36 (frame 301, various messages, various operation buttons, projection images (divided areas). Projected onto the plane table 400 as a boundary line 302 or the like).

  In the imaging apparatus 100, as illustrated in FIG. 2, a frame 301 corresponding to the imaging area 300 that is an area that can be imaged by the imaging unit 20 is projected by the light projecting unit 30.

  FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus 100 as described above. As shown in FIG. 3, the imaging apparatus 100 includes a processor 40 for controlling the entire imaging apparatus 100, a hard disk (HDD) 50, the CCD image sensor 24 described above, and a light source control for controlling the light source unit 32. Unit 54, a liquid crystal control unit 56 that controls the liquid crystal panel 36, and an external interface 58 for connecting to a personal computer (PC) 500.

  The processor 40 includes a CPU 42, a ROM 44, and a RAM 46. The CPU 42 is a central processing unit and executes various programs corresponding to the processes shown in the flowcharts of FIGS. 8 to 13, 15 to 19, and 21.

  The ROM 44 is a non-rewritable memory that stores various control programs executed by the CPU 42 and data necessary for executing the control programs by the CPU 42. In the ROM 44, a camera control program 44a that is a program relating to the control of the entire image input apparatus 100 including the main processing of FIG. 8 and an image change for detecting whether or not the image data captured in the imaging area 300 has changed. An image change detection program 44b, which is a program for executing the detection process (FIG. 13), and a four document edge presence / absence determination process for determining whether or not the four document edges 201 of the document 200 exist in the imaging region 300 (FIG. 13). 15) a document end presence / absence determination program 44c, which is a program for executing 15), and a blank portion fixed object presence / absence determination process for determining whether or not a fixed object for fixing the document 200 is disposed in the margin portion of the document 200. A blank portion fixed object presence / absence determination program 44d, which is a program for executing FIG. A change area focus degree measurement program 44e, which is a program for executing the change area focus degree measurement process (FIG. 17) for measuring the focus degree of the change area when there is a change in the captured image data; A pointer presence / absence determination program 44f, which is a program for executing a pointer presence / absence determination process (FIG. 18) for determining whether or not a pointer (indicating member) exists, and the boundary lines of the divided areas are displayed on the document 200. An original dividing line projection program 44g, which is a program for executing the original dividing line projection process (FIG. 19) for projecting to the corresponding position, and divided area image data for acquiring the image data of the specified divided area and making it a file. A divided region file conversion program 44h, which is a program for executing the acquisition process (FIG. 21), and a message storage unit 44i are described. It is. Details of each process executed in accordance with each program stored in the ROM 44 will be described later.

  The message storage unit 44i is a memory that stores a standby message 44i1, a trace reception message 44i2, a scan reception initial message 44i3, and a next scan reception message 44i4 as auxiliary messages for assisting various operations of the imaging apparatus 100. These messages 44i1 to 44i4 are read according to the execution timing of the operation corresponding to each message, and an image corresponding to a predetermined position of the liquid crystal panel 36 is formed, whereby a predetermined image in the imaging region 300 is formed. (Position corresponding to a predetermined position where an image is formed on the liquid crystal panel 36).

  The RAM 46 is a rewritable volatile memory that can be accessed at random. The still image data storage unit 46a, the initial image data storage unit 46b, the four-vertex coordinate storage unit 46c, the pointer tip coordinate storage unit 46d, The divided region boundary coordinate storage unit 46e, the divided region image data storage unit 46f, the change region coordinate storage unit 46g, the projection image data storage unit 46h, the state counter 46i, and various processes executed by the CPU 42 are necessary. And a working area 46j for temporarily storing data and programs.

  The still image data storage unit 46a is a memory for storing image data obtained by imaging the imaging region 300 at a low resolution in an image change detection process (FIG. 13) described later. The initial image data storage unit 46b is a memory for storing image data obtained by imaging the imaging region 300 after a fixed object is arranged in a blank portion in a standby process (FIG. 10) described later. The four-vertex coordinate storage unit 46c is a memory for storing the coordinates of the four vertices of the document 200 placed in the imaging area 300 in standby processing (FIG. 10) described later.

  The pointer tip coordinate storage unit 46d is a memory for sequentially storing the coordinates indicated by the moving pointer (for example, the index finger of the right hand) in the trace reception process (FIG. 11) described later. The divided area boundary coordinate storage unit 46e is a memory for storing the boundary lines of the respective areas (divided areas) of the document 200 divided according to the locus of the tip of the moving pointer (for example, the fingertip of the right hand index finger). It is. The divided area image data storage unit 46f is a memory for storing image data including a designated divided area and transparent color information. The configuration of data (coordinate data or image data) stored in the pointer tip coordinate storage unit 46d, the divided region boundary coordinate storage unit 46e, and the divided region image data storage unit 46f will be described later.

  The change area coordinate storage unit 46g is a memory for storing the coordinates of the leftmost and uppermost pixels of the change area in an image change detection process (FIG. 13) described later. The projection image data storage unit 46h is a memory for storing projection image data corresponding to a projection image (an index for identifying a boundary line or a divided area of a divided area of the document 200) projected on the imaging area 300. It is. Note that the projection image data stored as an initial value in the projection image data storage unit 46 h is projection image data corresponding to the frame 301 for indicating the imaging region 300.

  The state counter 46i is a counter that indicates the operation state of the imaging apparatus 100, and has values from “0” to “2”. In the state counter 46i, “0” indicates a mode (standby mode) in which the imaging apparatus 100 should perform standby processing (FIG. 10) described later, and “1” indicates a trace described later by the imaging apparatus 100. 11 indicates that the reception process (FIG. 11) is to be executed (trace reception mode), and “2” is a mode (scan reception mode) in which the imaging apparatus 100 should execute a scan process (FIG. 12) described later. Indicates that there is.

  The HDD 50 is a rewritable nonvolatile memory having a large storage capacity, a fixed object color information storage unit 50a that is a memory for previously registering color information of a fixed object for fixing the document 200, a transparent GIF format, and the like. And an image file storage unit 50b which is a memory for storing the image file filed.

  The light source control device 54 receives a signal from the processor 40 and controls the light source unit 32, and the liquid crystal control unit 56 receives a signal from the processor 40 and controls the liquid crystal panel 36.

FIG. 4 is a diagram illustrating the configuration of data (coordinates, image data, etc.) stored in the pointer tip coordinate storage unit 46d, the divided region boundary coordinate storage unit 46e, and the divided region image data storage unit 46f. FIG. 4A illustrates the pointer tip coordinate storage unit 46d. As shown in FIG. 4A, the pointer tip coordinate storage unit 46d stores _n coordinates from coordinates (x ₁ , y ₁ ) to coordinates (x _n , y _n ). Each time the coordinates indicated by the tip of the moving pointer (for example, the index finger of the right hand) are detected in the trace receiving process (FIG. 11) described later, these coordinates are the coordinates (x ₁ , y ₁ ) to the last detected coordinates (x _n , y _n ) are stored in the input order. The storage of the coordinates in the pointer tip coordinate storage unit 46d will be described later.

FIG. 4B is a diagram illustrating the divided region boundary coordinate storage unit 46e. As shown in FIG. 4B, for each divided area of the document 200 corresponding to the locus of the moving pointer, coordinates constituting the boundary line of each divided area are stored. FIG. 4B illustrates a case where the document 200 is divided into three divided areas. In the storage area 46e1, coordinates (x1 ₁ ,. p coordinates from y1 ₁ ) to (x1 _p , y1 _p ) are stored, and the storage area 46e2 has (x2 ₁ , y2 ₁ ) as coordinates constituting the boundary line of the second divided area. Q coordinates from (x2 _q , y2 _q ) to (x2 _q , y2 _q ) are stored, and (x3 ₁ , y ₃₁ ) to (x3) are stored in the storage area 46e3 as coordinates constituting the boundary line of the third divided area. _r coordinates up to r 1, y3 _r ) are stored. The storage of coordinates in the divided area boundary coordinate storage unit 46e will be described later.

  FIG. 4C illustrates the divided area image data storage unit 46f. As shown in FIG. 4C, for each divided region for which image data acquisition is designated by the user, rectangular image data including the designated divided region and transparent color information are stored. Here, “rectangular image data including a divided area” is image data of a rectangular area larger than the divided area, and this rectangular area has a margin of a predetermined width between each side and the divided area. Yes. FIG. 4C illustrates the case where acquisition of image data is designated for two divided areas in the document 200, and the storage area 46f1 is a rectangle including the first designated divided area. Image data (first rectangular image data) and transmission color information for the first rectangular image data are stored, and the storage area 46f2 includes rectangular image data (second rectangle) including a second designated divided area. Image data) and transmission color information for the second rectangular image data are stored. The storage of data in the divided area image data storage unit 46f will be described later.

  Next, with reference to FIGS. 5 to 7, operations from the power-on to the acquisition of image data for each divided area of the document 200 in the imaging apparatus 100 will be schematically described. FIG. 5 is a diagram illustrating the imaging apparatus 100 in the standby mode. FIG. 5A illustrates a state in which the standby message 44i1 is projected on the upper part of the imaging area 300 together with the frame 301 of the imaging area 300 after the power is turned on. FIG. As shown in FIG. 5A, by projecting the frame 301 of the imaging area 300, the user can appropriately arrange the document 200 to be imaged in the imaging area 300. In addition, since the standby message 44i1 is projected, an operation to be performed by the user in the standby mode can be executed without referring to a manual or the like, so that the operation becomes accurate and the work becomes efficient.

  In FIG. 5B, the document 200 having four document edges 201 is disposed in the imaging region 300, and the user's left hand 250 is disposed as a fixed object for fixing the margin of the document 200. It is a figure which shows a state. The “margin” is an area formed with a predetermined width (for example, about 2 cm) from the four document edges 201 of the document 200 inward. When the imaging apparatus 100 detects a state as shown in FIG. 5B, the imaging apparatus 100 shifts from the standby mode to the trace acceptance mode.

  As shown in FIG. 5B, “the document 200 having four document edges 201 is arranged in the image area 300” is detected based on the four document edge presence / absence determination process (FIG. 15) described later. In addition, “the left hand 250 of the user being placed as a fixed object for fixing the margin part of the document 200” is detected based on a margin part fixed object presence / absence determination process (FIG. 16) described later. The standby including the four document edge presence / absence determination processing (FIG. 15) and the blank portion fixed object presence / absence determination processing (FIG. 16) is executed in the standby mode in which the situation shown in FIGS. 5 (a) and 5 (b) occurs. The process (FIG. 10) will be described later.

  FIG. 6 is a diagram for describing the imaging device 100 in the trace acceptance mode. As shown in each figure ((a) to (d)) in FIG. 6, when the imaging apparatus 100 shifts to the trace acceptance mode, a trace acceptance message 44 i 2 is projected on the upper part of the imaging area 300, and A division button 220 is projected on the lower left portion of the document 200. As shown in FIG. 6 (FIG. 6 (a) to FIG. 6 (d)), by projecting the trace acceptance message 44i2, the operation in this trace acceptance mode is accurate as in the projection of the standby message 44i1 described above. And work becomes more efficient.

  6A is a diagram showing a state in which the index finger 260a of the user's right hand 260 as a pointer (indicating member) points to the starting point of the boundary line for dividing the document 200 into a plurality of regions. FIG. 6B is a diagram showing a state in which the index finger 260a is inputting the boundary line 202a for separating the document 200 as a locus. FIG. 6C is a diagram showing a state in which the index finger 260a draws a trajectory for making the second boundary line 202b after the first boundary line 202a is drawn, and FIG. After the user draws the boundary lines 202a and 202b as the desired boundary lines, the index finger 260a indicates the state in which the index button 260a points to the division button 220 in order to instruct to sort the document 200 according to the drawn boundary lines 202a and 202b. FIG. When detecting the state as illustrated in FIG. 6D, the imaging apparatus 100 shifts from the trace reception mode to the scan reception mode.

  As shown in FIG. 6D, the division button 220, which is an instruction button for dividing the document 200 by the drawn boundary line, is projected into the imaging region 300, so that the user turns the line of sight to the other. In addition, the division button 220 can be input while facing the imaging area 300 (and the original 200 placed in the imaging area 300), and the work becomes efficient.

  As shown in FIGS. 6A to 6C, “input of a boundary line for dividing the document 200 into a plurality of areas by the locus of the index finger 260a” is a change area in a trace reception process (FIG. 11) described later. This process is executed according to the processing results of the internal focus degree measurement process (FIG. 17) and the pointer presence / absence determination process (FIG. 18). Including the change area focus degree measurement process (FIG. 17) and the pointer presence / absence determination process (FIG. 18), the process is executed in the trace acceptance mode in which the situation shown in each of the diagrams (a) to (d) of FIG. The trace acceptance process (FIG. 11) will be described later.

  FIG. 7 is a diagram for describing the imaging apparatus 100 in the scan acceptance mode. FIG. 7A is a diagram illustrating a state in which the division button 220 is operated as described above to shift from the trace reception mode to the scan reception mode. As shown in FIG. 7A, when the scan acceptance mode is entered, the images 203a and 203b (hereinafter referred to as the boundary lines 203a and 203b respectively) corresponding to the boundary lines 202a and 202b input by the trajectory of the index finger 260a as described above. 3) and an image showing the four document edges 201 of the document 200 are projected at corresponding positions on the document 200, and are divided into three divided regions 200a of the document 200 divided by the boundary lines 203a and 203b. Indexes (identifiers) 204a to 204c represented by “1” to “3” for specifying each of .about.200c are respectively projected at predetermined positions on the divided areas 200a to 200c. In FIG. 7, the indexes 204 a to 204 c are illustrated as numbers “1” to “3” surrounded by circles (circle numbers). Further, in FIG. 7, since the image showing the four document edges 201 of the document 200 overlaps the actual document edge 201, the projected image is not shown in order to simplify the drawing.

  By projecting the boundary lines 203a to 203b, the image indicating the document edge 201, and the indexes 204a to 204c on the document 200, the user can clearly recognize the three divided regions 200a to 200c in the document 200. Thus, by clearly recognizing the divided areas 200a to 200c, it is possible to improve work efficiency in individually inputting image data of these divided areas 200a to 200c in the scan acceptance mode described later. .

  As shown in FIG. 7A, when the imaging apparatus 100 shifts to the scan acceptance mode, a scan acceptance initial message 44 i 3 is projected on the upper part of the imaging area 300, and the document is located at the lower left part of the imaging area 300. By projecting the scan end button 230 on the outer portion of the 200, the operation in this scan acceptance mode becomes accurate and the work can be made efficient.

  FIG. 7B is a diagram showing a state in which the divided region 200b is designated as a region for acquiring (inputting) image data by pointing the divided region 200b with the index finger 260a. As shown in FIG. 7B, by placing the index finger 260a in the divided area where the image data is desired to be acquired (the divided area 200b in the example shown in FIG. 7B in this embodiment), the divided area is obtained. Image data is acquired, and the image data is stored in a predetermined storage area (divided area image data storage unit 46f). Note that selection of divided areas and acquisition of image data by the index finger 260a will be described later.

  FIG. 7C is a diagram illustrating a state in which the divided region 200b is designated by pointing the index finger 260a with the index finger 260a after the image data is obtained by designating the divided region 200b as the divided region. . As shown in FIG. 7C, when the designation of one divided area (division area 200b in this embodiment) and the acquisition of the image data of the designated divided area are completed, the user is notified of this. The next scan acceptance message 44i4 for assisting the next operation is projected in place of the scan acceptance initial message 44i3. Further, as shown in FIG. 7C, diagonal lines are projected on the entire divided area (divided area 200b in this embodiment) from which image data has already been acquired. Therefore, the user can clearly distinguish the divided area from which image data has already been acquired from the divided area from which image data has not yet been acquired.

  FIG. 7D is a diagram illustrating a state in which the scan end button 230 is pointed with the index finger 260a when the user determines that all the image data of the desired divided area has been acquired. When the imaging apparatus 100 detects a state as shown in FIG. 7D, the imaging apparatus 100 ends the mode (scan acceptance mode) for waiting for acquisition of image data of each divided area in the document 200, and shifts to the standby mode. As shown in FIG. 7 (d), the scan end button 230, which is a button for instructing that it is not necessary to acquire any more image data, is projected into the imaging region 300, so that the user can change his / her line of sight. The scan end button 230 can be input while facing the image pickup area 300 (and the original 200 arranged in the image pickup area 300) without turning to the direction, and the work becomes efficient.

  Next, operations performed by the imaging apparatus 100 configured as described above will be described with reference to the flowcharts of FIGS. 8 to 13, 15 to 19, and 21, and FIGS. 14 and 20. FIG. 8 is a flowchart of main processing executed by the imaging apparatus 100. This main process is activated when the power of the imaging apparatus 100 is turned on, and is repeatedly executed by the CPU 42 while the power is turned on.

  When the main process is activated, initialization of the RAM 46 is first executed as an initial setting (S1). The state counter 46i is set to “0” by the initialization of the RAM 46 by this initial setting (S1). Further, the projection image data storage unit 46h is initialized so that the projection image data is initialized to data in an initial state, whereby a frame for indicating the imaging region 300 is displayed on the plane table 400 when the power is turned on. Only 301 is projected as a projection image.

  As a process of storing (registering) color information (hereinafter referred to as “fixed object color information”) of a fixed object for fixing the document 200 in the fixed object color information storage unit 50a of the HDD 50 after the process of S1, a fixed object color information registration process described later is performed. (S15) is executed.

  After execution of the fixed object color information registration process (S15), the value of the state counter 46i is confirmed (S2). If the value of the state counter 46i is “0” (S2: 0), the imaging apparatus 100 is in the standby mode. Therefore, standby processing described later is executed (S3). On the other hand, if the value of the state counter 46i is “1” (S2: 1), since the imaging apparatus 100 is in the trace reception mode, a trace reception process described later is executed (S4). Furthermore, if the value of the state counter 46i is “2” (S2: 2), the imaging apparatus 100 is in the scan acceptance mode, and therefore performs a scan process (S5) described later.

  When any of S3 to S5 is executed, as each process (S6), for example, initialization of the RAM 46 when the value of the state counter 46i is forcibly set to “0” by operating a reset button (not shown), etc. Is executed, the process proceeds to S2.

  Next, the fixed object color information registration process (S15) will be described with reference to FIG. FIG. 9 is a flowchart of the fixed object color information registration process (S15). In the fixed object color information registration process (S15), first, the fixed object color information is transferred to a predetermined position of the imaging area 300 (for example, the upper part of the imaging area 300). A first message (not shown) for assisting the user in the registration process is projected (S1501). Note that the first message (not shown) is a message stored in a memory (not shown) in the message storage unit 44i. For example, “the imaging region is stored before the color information of the fixed object that fixes the document is stored. The user is encouraged to take an image of the initial state of the imaging area 300 that is required in the processing to be described later. It is a message for.

  After the processing of S1501, it is confirmed whether or not 5 seconds have passed while the first auxiliary message is projected (S1502). If 5 seconds have not passed (S1502: No), the processing returns to S1501 and returns to the first auxiliary. Continue projecting the message. On the other hand, when 5 seconds have elapsed (S1502: Yes), the imaging region 300 is imaged, and the image data is acquired as the initial image data (S1503).

  After the processing of S1503, the first message is unprojected (S1504), and the second message (not shown) replacing the first message is projected onto a predetermined position (for example, the upper part of the imaging region 300) (S1505). ). The second message (not shown) is a message stored in a memory (not shown) in the message storage unit 44i. For example, “a fixed object is photographed to store color information of the fixed object. The message is for urging the user to take an image of a fixed object that is required in the processing described later.

  After the processing of S1505, it is confirmed whether or not 5 seconds have passed with the second auxiliary message projected (S1506). If 5 seconds have not passed (S1506: No), the processing returns to S1505 and returns to the second auxiliary. Continue projecting the message. On the other hand, when 5 seconds have elapsed (S1506: Yes), the imaging region 300 is imaged, and the image data is acquired as image data of a fixed object containing state (S1507).

  After the process of S1507, the second message is unprojected (S1508), and difference image data between the image data of the fixed object containing state acquired by the process of S1507 and the image data of the initial state acquired by the process of S1503 is obtained. The pixel of the part which produced | generated and produced the difference is extracted (S1509).

  After the processing of S1509, the RGB values of the extracted pixels are averaged (S1510), and the averaged RGB values are registered as fixed object color information in the fixed object color information storage unit 50a (S1511), and this fixed object color information registration process is performed. (S15) is ended.

  Next, a standby process (S3) executed when the imaging apparatus 100 is in the standby mode will be described with reference to FIG. FIG. 10 is a flowchart of the standby process (S3). In this standby process (S3), first, a standby message 44i1 is projected onto a predetermined position of the imaging area 300 (in this embodiment, the upper part of the imaging area 300 (see FIG. 5)) (S301). Note that, when the standby message 44i1 is already being projected when performing the process of S301, the projection of the standby message 44i1 is continued. After the process of S301, an image change detection process for detecting that the document 200 is placed is executed (S7). This image change detection process (S7) is a process for detecting an image change in the imaging region 300, and the contents of the process will be described later.

  After the execution of the image change detection process (S7), whether or not a change has occurred in the imaging region 300, specifically, the pixel change amount HW calculated in the image change detection process (S7) is “1”. It is confirmed whether or not there is (S302). As a result of checking in the processing of S302, if the inside of the imaging area 300 is unchanged, specifically, if the pixel change amount HW is “0” (S302: No), the four areas of the document 200 in the imaging area 300 are displayed. Four document edge presence / absence determination processing for determining whether or not the document edge 201 exists is executed (S8). The four document edge presence / absence determination process (S8) will be described later.

  After the four document edge presence / absence determination process (S9) is performed, it is confirmed whether or not the four document edges (four document edges 201) of the document 200 are within the imaging area 300 (S303). As a result of checking in the process of S303, if the four document edges of the document 200 are within the imaging region 300 (S303: Yes), the coordinates of the four vertices of the document 200 acquired in the four document edge presence / absence determination process (S8) are obtained. It memorize | stores in the four vertex coordinate storage part 46c (S304). After the process of S304, a fixed object (left hand 250 in this embodiment) is placed in the margin of the original 200, and a blank part fixed object presence / absence determination process for determining whether or not the original 200 is fixed is executed (S9). . The margin part fixed object presence / absence determination process (S9) will be described later.

  After this margin portion fixed object presence / absence determination processing (S9) is executed, whether or not there is a fixed object (left hand 250) in the margin part of the document 200, that is, the margin part of the document 200 is fixed by the fixed object (left hand 250). It is confirmed whether or not (S305). If the margin of the document 200 is fixed with a fixed object (left hand 250) (S305: Yes) as a result of the confirmation in S305, the document 200 is focused (S306), and the imaging area 300 is imaged. Then, the image data is stored in the initial image data storage unit 46b (S307).

  In the processes of S305 to S307, since it is confirmed that the blank portion of the document 200 is detected to be fixed by the fixed object (left hand 250), the document 200 is imaged. It is possible to prevent the image from moving due to blurring.

  After the processing of S307, the value of the status counter 46i is incremented by 1 to “1” (S308). Next, the standby message 44i1 being projected is not projected (S309), and this standby process (S3) is terminated.

  In this case, since the state counter 46i is “1”, the trace reception process (S4) is subsequently executed in accordance with the main process (FIG. 8) described above. That is, in the standby process (S3), the document 200 is arranged in the imaging region 300 (four document edges 201 of the document 200 are arranged), and the blank portion of the document 200 is fixed by a fixed object such as the left hand 250. When it is confirmed that the status has been confirmed, the state shifts from the standby mode to the trace acceptance mode.

  On the other hand, as a result of checking in the process of S302, if there is a change in the imaging region 300 (S302: Yes), this standby process is terminated. In this case, since the state counter 46i remains “0”, the standby process (S3) is executed again in accordance with the main process (FIG. 8) described above. Therefore, as long as it is confirmed by the process of S302 that a change has occurred in the imaging region 300, the four document edge presence / absence determination process (S8) is not executed.

  Further, as a result of checking in the process of S303, when the four document edges of the document 200 are not in the imaging area 300 (S303: No), or as a result of checking in the process of S305, the blank portion of the document 200 is fixed by a fixed object. If not (S305: No), the standby process is terminated in any case. Also in this case, since the state counter 46i remains “0”, the standby process (S3) is executed again according to the main process (FIG. 8) described above.

  Next, with reference to FIG. 11, the trace reception process (S4) executed when the imaging apparatus 100 is in the trace reception mode will be described. FIG. 11 is a flowchart of the trace acceptance process (S4). In this trace acceptance processing (S4), first, a trace acceptance message 44i2 is projected onto a predetermined position of the imaging area 300 (in this embodiment, the upper part of the imaging area 300 (see FIG. 6)) (S401). The division button 220 is projected to a predetermined position (in this embodiment, the lower left portion of the imaging region 300 (see FIG. 6)) (S402). When performing the processing of S401 and S402, if the trace reception message 44i2 and the division button 220 are already being projected, the projection of the trace reception message 44i2 and the division button 220 is continued.

  After the process of S402, an image change detection process (S7) is executed, and then whether or not there is a change in the imaging region 300, specifically, the pixel change amount HW calculated in the image change detection process (S7) is calculated. It is confirmed whether or not it is “0” (S403). As a result of checking in the process of S403, if there is a change in the imaging area 300 (S403: Yes), a process for determining whether or not there are four document edges is executed (S8). Next, it is confirmed whether or not the coordinates of the four vertices of the document 200 acquired in the four document edge presence / absence determination process (S8) match the coordinates stored in the four vertex coordinate storage unit 46c (S404).

  As a result of the confirmation in the process of S404, if the coordinates of the four vertices of the document 200 acquired in the four document edge presence / absence determination process (S8) match the coordinates stored in the four-vertex coordinate storage unit 46c (S404). : Yes), a margin portion fixed object presence / absence determination process (S9) is executed, and then whether or not there is a fixed object (left hand 250) in the margin part of the document 200, that is, the margin part of the document 200 is a fixed object (left hand). 250), it is confirmed whether it is fixed (S405). If the margin of the original 200 is fixed with a fixed object (left hand 250) as a result of the confirmation in S405 (S405: Yes), an area in which the change has occurred in the imaging area 300 (change area P (see FIG. 14)). )) To measure the degree of focus in the change region (S10). Here, the “degree of focus” is an index indicating whether or not a certain object is in focus with reference to the focus that is focused on the document 200. The greater the degree of focus, the more the object. This indicates that the object is in focus and that the object is out of focus (the image to be taken is blurred) as the degree of focus decreases. Note that the above-described change area focal degree measurement processing (S10) will be described later.

  After execution of the change area focus degree measurement process (S10), it is confirmed whether or not the focus degree in the change area P is equal to or greater than a predetermined threshold (S406). As a result of confirmation in the process of S406, if the degree of focus is equal to or greater than a predetermined threshold, that is, the object that has caused a change in the imaging region 300 is in focus (focus) at a predetermined level or higher (S406). : Yes), a pointer presence / absence determination process (S11) for detecting whether or not the object has a pointer (an index finger 260a of the right hand 260 in this embodiment) as an instruction member pointing to the document 200 in the change area P is executed. To do. The pointer presence / absence detection process (S11) will be described later.

  After executing this pointer presence / absence detection process (S11), it is confirmed whether or not there is a pointer (index finger 260a) (S407). If there is a pointer (index finger 260a) (S407: Yes), the pointer (index finger 260a) The position coordinates of the tip (position coordinates pointed by the tip of the pointer) are detected (S408). Next, it is confirmed whether or not the position coordinate of the tip of the detected pointer (index finger 260a) is in the area where the division button 220 is projected (S409).

  If the position coordinate of the tip of the pointer (index finger 260a) is not in the area where the split button 220 is projected (S409: No) as a result of the confirmation in S409, the position coordinate of the tip of the pointer (index finger 260a) is the pointer. It memorize | stores in the front-end | tip coordinate storage part 46d (S410), and transfers to the process of S7.

  In addition, as a result of checking in the process of S406, when the degree of focus is less than a predetermined threshold, that is, the focus (focus) of the change area P is more than a predetermined level (S406: No), or by the process of S407 As a result of the confirmation, if the pointer (index finger 260a) does not exist (S407: No), the process also proceeds to S7.

  Therefore, according to the processes of S10, S406, S11, and S407 to S410, when a pointer (index finger 260a) having a degree of focus equal to or greater than a predetermined threshold is detected, the position coordinates of the tip of the pointer (index finger 260a) are changed to the pointer. It is stored in the tip coordinate storage unit 46d. If it is a moving pointer (index finger 260a), the pointer tip coordinate storage unit 46d starts recording the position coordinate of the tip of the pointer (index finger 260a), and each time the process of S410 is executed, The position coordinates of the tip of the pointer (index finger 260a) are sequentially recorded. Then, when the focus on the pointer (index finger 260a) becomes lower than the threshold value by an operation such as lifting the pointer (index finger 260a) upward (increasing the position of the pointer (index finger 260a)) at a certain position, the pointer Recording of the position coordinates of the tip of the pointer (index finger 260a) to the tip coordinate storage unit 46d is stopped (prohibited), and as a result, a position corresponding to one locus drawn by the tip of the moving pointer (index finger 260a). Coordinate recording is temporarily terminated. In other words, the recording of the coordinates corresponding to the locus drawn by the tip of the moving pointer (index finger 260a) in the pointer tip coordinate storage unit 46d is performed by an operation such as lifting the pointer (index finger 260a) upward. The process is continuously executed until the degree of focus on the pointer (index finger 260a) is less than the threshold value.

  As described above, if recording of the position coordinates of the tip of the pointer (index finger 260a) to the pointer tip coordinate storage unit 46d is stopped (prohibited) during the recording of the locus coordinates, the pointer tip coordinate storage is performed. It is assumed that a mark indicating the last input in one trajectory is added to the position coordinate stored at the end of the part 46d.

  In addition, the in-change-region focus degree measurement process (S10) and the pointer presence / absence detection process (S11), which are preconditions for storing the coordinates in the pointer tip coordinate storage unit 46d in S410, are S8, S404, S9, By the process of S405, the positions (coordinates) of the four vertices of the document 200 are not changed from the positions obtained by the process of S304 in the standby process (FIG. 10), and the fixed object (left hand 250) is left in place. It is executed after confirming that the status is. Therefore, the coordinates pointed to by the pointer (index finger 260a) and stored in the pointer tip coordinate storage unit 46d are accurate positions with respect to the image data of the document 200 captured in the process of S307 of the standby process (FIG. 10). Is entered as Therefore, the document 200 can be accurately classified. Furthermore, since the document 200 is fixed by the fixed object (left hand 250) even when the pointer (index finger 260a) draws a locus, the position of the document 200 may be moved by contact with the pointer (index finger 260a) or the like. In addition, when a fixed object is not detected, even if the pointing member moves within the imaging region, it is not necessary to perform useless detection.

  On the other hand, if the position coordinate of the tip of the pointer (forefinger 260a) is in the area where the division button 220 is projected (S409: Yes) as a result of checking in the process of S409, the value of the state counter 46i is incremented by 1 and “ 2 ”(S415). Next, the projecting trace acceptance message 44i2 is unprojected (S416), the division button 220 is unprojected (S417), and the trace acceptance process (S4) is terminated. In this case, since the state counter 46i is “2”, the scan process (S5) is subsequently executed in accordance with the main process (FIG. 8) described above. If the position coordinate of the tip of the pointer (forefinger 260a) is confirmed on the projected area of the division button 220 by the process of S409 without performing the process of S410 described above, a plurality of documents 200 are stored. Indicates that the area is not divided.

  Further, as a result of the confirmation in the process of S404, the coordinates of the four vertices of the document 200 acquired in the four document edge presence / absence determination process (S8) do not match the coordinates stored in the four-vertex coordinate storage unit 46c. (S404: No), or if the result of the confirmation in S405 is that there is no fixed object (left hand 250) for fixing the margin of the original 200 (S405: No), the value of the state counter 46i is decremented by 1. Then, “0” is set (S412). Next, the projecting trace acceptance message 44i2 is unprojected (S413), the division button 220 is unprojected (S414), and the trace acceptance process (S4) is terminated. In this case, since the state counter 46i is “1”, the standby process (S3) is subsequently executed in accordance with the main process (FIG. 8) described above.

  Further, as a result of the confirmation in the process of S403, if there is no change in the imaging region 300 (S403: No), this trace acceptance process (S4) is terminated. In this case, since the state counter 46i remains “1”, the trace reception process (S4) is executed again according to the main process (FIG. 8) described above.

  Next, the scanning process (S5) executed when the imaging apparatus 100 is in the scan acceptance mode will be described with reference to FIG. FIG. 12 is a flowchart of the scanning process (S5). In this scanning process (S5), first, the boundary line (200a to 200c in this embodiment) of the divided area (200a to 200c in this embodiment) according to the coordinates stored in the pointer tip coordinate storage unit 46d in the above-described trace acceptance process (S4). , Boundary dividing lines 203a, 203b) are projected onto the corresponding positions on the document 200, and document dividing line projection processing (S12) is executed. The document dividing line projection process (S12) will be described later.

  After the processing of S12, a scan acceptance initial message 44i3 is projected onto a predetermined position of the imaging area 300 (in this embodiment, above the imaging area 300 (see FIG. 7)) (S501), and a predetermined position of the imaging area 300 (this In the embodiment, the scan end button 230 is projected onto the lower left part of the imaging area 300 (see FIG. 7) (S502). When performing the processing of S501 and S502, if the scan reception initial message 44i3 and the scan end button 230 are already being projected, the projection of the scan reception initial message 44i3 and the scan end button 230 is continued. To do.

  After the process of S502, an image change detection process (S7) is executed, and then whether or not there is a change in the imaging region 300, specifically, the pixel change amount HW calculated in the image change detection process (S7) is determined. It is confirmed whether or not it is “0” (S503). If there is a change in the imaging area 300 as a result of the confirmation in the process of S503 (S503: Yes), a process for determining whether or not there are four document edges is executed (S8). Next, it is confirmed whether or not the coordinates of the four vertices of the document 200 acquired in the four document edge presence / absence determination process (S8) coincide with the coordinates stored in the four vertex coordinate storage unit 46c (S504).

  As a result of checking in the process of S504, if the coordinates of the four vertices of the document 200 acquired in the four document edge presence / absence determination process (S8) match the coordinates stored in the four-vertex coordinate storage unit 46c (S504). : Yes), the in-change-region focus degree measurement process (S10) for measuring the focus degree of the region (change region P) in which the change has occurred in the imaging region 300 is executed.

  After the execution of the change area focus degree measurement process (S10), it is checked whether or not the focus degree in the change area P is equal to or greater than a predetermined threshold (S505), and the focus degree is equal to or greater than the predetermined threshold, that is, the imaging area. If the object that caused the change in 300 is in focus (focus) at a predetermined level or higher (S505: Yes), a pointer (indicator) that points to the document 200 in the change area 300 (book) In the embodiment, a pointer presence / absence determination process (S11) for detecting whether or not the index finger 260a) of the right hand 260 is present is executed.

  After executing this pointer presence / absence detection process (S11), it is confirmed whether or not there is a pointer (index finger 260a) (S506). If there is a pointer (index finger 260a) (S506: Yes), the pointer (index finger 260a) The position coordinate of the tip is detected (S507).

  In step S507, the in-change area focus degree measurement process (S10) and the pointer presence / absence detection process (S11), which are preconditions for detecting the position coordinates of the tip of the pointer (index finger 260a), are performed in steps S8 and S504. It is executed after confirming that the positions (coordinates) of the four vertices are not different from the positions obtained by the process of S304 in the standby process (FIG. 10). Therefore, the coordinates indicated by the tip of the pointer (index finger 260a) detected by the process of S507 are input as an accurate position with respect to the image data of the document 200 imaged in the process of S307 of the standby process (FIG. 10). The

  After the processing of S507, it is confirmed whether or not the position coordinate of the tip of the detected pointer (index finger 260a) is in the area where the scan end button 230 is projected (S508). If the position coordinate of the tip of the pointer (index finger 260a) is not in the area where the scan end button 230 is projected (S508: No) as a result of the confirmation in S508, the position coordinate of the tip of the pointer (index finger 260a) is determined. It is confirmed whether or not the divided area to be included has already been acquired (input) (S509).

  As a result of confirmation in the processing of S509, if the divided area including the position coordinate of the tip of the pointer (index finger 260a) has not yet been acquired (input) (S509: No), by pointing with the pointer (index finger 260a) The image data of the specified divided area is acquired (input), and the divided area image data acquisition process (S13) to be filed is executed. The divided area image data acquisition process (S13) will be described later.

  After execution of this divided area image data acquisition process (S13), oblique lines are projected onto the divided areas for which acquisition (input) of image data has been completed (S510). In the processing of S510, the projection image data stored in the projection image data storage unit 46h is updated with the projection image data corresponding to the projection image obtained by adding a diagonal line to the divided area where the image data has been acquired. Based on the updated projection image data, the image is projected onto the document 200 in the imaging area 300.

  By the processing of S510, oblique lines are projected on the divided areas for which the acquisition of image data has been completed, so that the divided areas where the image data has been acquired (input) and the divided areas where the image data has not been acquired (uninputted) can be clearly seen. A distinction can be made. As a result, it is possible to prevent the image data of the already input area from being input twice or to fail to acquire the image data of the desired area, and the image data can be input efficiently.

  After the processing of S510, it is checked whether or not there is a divided area for which image data has not been acquired (not input) (S511), and if image data of all the divided areas has been acquired (S511: No) After the value of the state counter 46i is set to -2 to "0" (S512), the message being projected (scan reception initial message 44i3 or next scan reception message 44i4) is not projected (S513). Next, the scan end button 230 is not projected (S514), and this scan process (S5) is ended. In this case, since the status counter 46i is “0”, the standby process (S3) is subsequently performed in accordance with the main process (FIG. 8) described above, and the next document 200 is placed on standby.

  On the other hand, as a result of the confirmation in the process of S511, if there is a divided area for which image data has not yet been acquired (S511: Yes), the process proceeds to S7, and S7, S503, S8, S504, S10, S505. , S11, S506 to S509, S13, S510 to S511 are repeated.

  If the position coordinate of the tip of the pointer (forefinger 260a) is in the area where the scan end button 230 is projected (S508: Yes) as a result of confirmation in S508 processing, it has acquired the desired image data. Therefore, the process of S509, S13, S510 to S511 is skipped, the process proceeds to S512, the process of S512 to S514 is executed, and the scan process (S5) is terminated. Also in this case, since the state counter 46i is “0”, the standby process (S3) is subsequently executed in accordance with the main process (FIG. 8) described above, and the next document 200 is placed on standby. .

  Further, as a result of checking in the process of S509, if the divided area including the position coordinate of the tip of the pointer (forefinger 260a) has already been acquired (input) (S509: Yes), the process proceeds to S7. By the processing of S509, it is possible to suppress the image data of the same divided area from being acquired redundantly, and it is possible to store useless image data in the storage area (the divided area image data storage unit 46f in this embodiment). In addition to being able to reduce, work becomes more efficient. When it is confirmed that the divided area including the position coordinate of the tip of the pointer (forefinger 260a) is an area that has already been acquired (input), a message informing that is projected onto the imaging area 300. Also good.

  Further, as a result of the confirmation in the process of S505, when the degree of focus is less than a predetermined threshold, that is, the focus (focus) of the change area P is blurred above a predetermined level (S505: No), or by the process of S506 As a result of the confirmation, if the pointer (index finger 260a) does not exist (S506: No), the process also proceeds to S7. Therefore, according to the processing of S10, S505, S11, and S506, an operation instruction corresponding to the position coordinate is input only to a pointer (index finger 260a) having a degree of focus equal to or greater than a predetermined threshold. . Therefore, for example, an operation instruction by the tip of the pointer (index finger 260a) is input or not input by a simple operation such as lowering the pointer (index finger 260a) to the document 200 and lifting the pointer (index finger 260a) upward. Can be switched.

  In addition, as a result of the confirmation in the process of S504, the coordinates of the four vertices of the document 200 acquired in the four document edge presence / absence determination process (S8) do not match the coordinates stored in the four-vertex coordinate storage unit 46c. (S504: No), the process proceeds to S512, the processes of S512 to S514 are performed, and the scan process (S5) is terminated. In this case, since the value of the state counter 46i is “0” by the process of S512, the standby process (S3) is subsequently executed in accordance with the main process (FIG. 8) described above.

  Further, as a result of checking in the processing of S503, if there is no change in the imaging region 300 (S503: No), this scanning processing (S5) is terminated. In this case, since the state counter 46i remains “2”, the scan process (S5) is executed again according to the main process (FIG. 8) described above.

  Next, referring to FIG. 13 and FIG. 14, processing executed in the above-described standby processing (FIG. 10), trace acceptance processing (FIG. 11), and scanning processing (FIG. 12) The image change detection process (S7), which is a process for detecting whether or not there is a change in the area 300, will be described. FIG. 13 is a flowchart of the image change detection process (S7), and FIG. 14 is a diagram for explaining the coordinates of the change area P output as a result of the image change detection process (S7). In FIG. 14, in order to simplify the drawing, a part of the message projected in the imaging region 300 is omitted.

  As shown in FIG. 13, in this image detection process (S7), first, the imaging region 300 is imaged by the imaging device 100, and low-resolution image data with a reduced resolution is acquired (S701). In the subsequent processing in the image change detection processing (S7), the low-resolution image data acquired by the processing in S701 is used, so that the amount of calculation is small and the processing can be performed at high speed.

  After the processing of S701, it is confirmed whether there is stored image data in the still image data storage unit 46a (S702). If there is no stored image data in the still image data storage unit 46a (S702: No), the processing of S701 is performed. The acquired low-resolution image data is stored as saved image data in the still image data storage unit 46a (S703), and the process proceeds to S704. On the other hand, as a result of checking in the process of S702, if there is stored image data in the still image data storage unit 46a (S702), the process of S703 is skipped and the process proceeds to S704.

  In S704, the variable “h” indicating the pixel row is set to “0” in the coordinates (w, h) of the pixel to be referred to in the image change detection process (S14), that is, the pixel in the imaging region 300, and the pixel change. The value of the amount HW is initialized to “0”, and the change pixel coordinate storage unit 46g is initialized. As shown in FIG. 14, the coordinates (w, h) of the pixel are the coordinates inside the imaging region 300 where the upper left end is (0, 0) and the lower right end is (W, H). Shall. By setting the variable “h” to “0” by the processing of S704, the pixel data of the uppermost pixel in the imaging region 300 is referred to.

  After the processing of S704, it is determined whether or not the value of the variable “h” is smaller than “H” indicating the lowermost pixel row of the imaging region 300 (S705). If the value of the variable “h” is smaller than “H” as a result of checking in the process of S705, that is, if h <H (S705: Yes), the variable “w” indicating the pixel column at the coordinates (w, h). "Is set to" 0 "(S706). By setting the variable “w” to “0” by the processing of S704, the pixel data of the leftmost pixel in the imaging region 300 is referred to.

  After the processing of S706, it is determined whether or not the value of the variable “w” is smaller than “W” indicating the rightmost pixel column of the imaging region 300 (S707). As a result of checking in the process of S707, when the value of the variable “w” is smaller than “W”, that is, when w <W (S707: Yes), the coordinates in the image data acquired by the process of S701 (w, The pixel data [h] [w] of the pixel h) is compared with the pixel data [h] [w] of the pixel at the coordinates (w, h) in the stored image data stored in the still image data storage unit 46a. (S708). Specifically, in S708, the values of the R, G, and B components included in the pixel data [h] [w] are compared.

  Next, as a result of comparing the pixel data [h] [w] by the processing of S708, whether or not both pixel data [h] [w] indicate the same color, specifically, R, G, It is confirmed whether or not the values of the components of B all match (S709).

  As a result of checking in step S709, when the colors of the pixel data [h] [w] are different, that is, the value of any one of the R, G, and B component values is different. In this case (S709: No), “1” is added to the pixel change amount HW (S710), the coordinates (w, h) of the pixel are acquired (S711), and “1” is added to the variable “w”. In step S712, the pixel coordinates (w, h) are moved to the right by one column, and the pixel data of the pixel on the right is used as pixel data to be referred to. After the processing of S712, the process proceeds to S707.

  Further, as a result of the confirmation in the process of S709, when the pixel data [h] [w] of the both indicate the same color, that is, when the values of the R, G, and B components are all the same (S709). : Yes), it indicates that there is no change in the pixel data at the coordinates (w, h), so the processing of S710 to S711 is skipped and the processing proceeds to S712.

  On the other hand, if the value of the variable “w” is “W” as a result of the confirmation in S707 (S707: No), “1” is added to the variable “h” (S712), and the pixel coordinates (w, h) is moved downward by one line (S713), and the process proceeds to S705.

  If the value of the variable “h” is “H” as a result of the confirmation in S705 (S705: No), that is, the image data of the imaging region 300 referred to in this image change detection process (S14) ( When the comparison of pixel data is completed for all the pixels constituting the image data acquired in the process of S701 and the stored image data stored in the still image data storage unit 46a), the process is acquired in the process of S711. The coordinates (WSTART, HEND) and the coordinates (WEND, HEND) at the upper left of the change area P (see FIG. 14) in which a change in imaging has been detected are referenced with reference to the coordinates (w, h) of the pixel that has been detected. Are stored in the change area coordinate storage unit 46h (S714), and then the pixel change amount HW is output (S715).

  The value of the pixel change amount HW output by the process of S715 is referred to in the process of S302 of the standby process (FIG. 10), S403 of the trace reception process (FIG. 11), or S503 of the scan process (FIG. 12). Processing according to the determination result is performed.

  After the processing of S715, the saved image data stored in the still image data storage unit 46a is updated with the image data (low-resolution image data) acquired by the processing of S701 (S716), and this image change detection processing (S7 ) Ends.

  Next, referring to FIG. 15, processing executed in the above-described standby processing (FIG. 10), trace reception processing (FIG. 11), and scanning processing (FIG. 12) The four document edge presence / absence determination process (S8) for determining whether there are four document edges 201 of the document 200 will be described.

  In the four document edge detection process (S8), first, the imaging area 300 is imaged by the imaging device 100, and the image data is acquired (S801). Next, simple luminance image data is generated from the acquired image data (S802). That is, in S802, the image data is obtained by adding the luminance values of the R, G, and B components of each pixel constituting the image data acquired by the processing of S801.

  After the processing of S802, the centroid value of the histogram of the simple luminance image data is calculated (S803), and the binary image data is generated from the simple luminance image data generated in S802 using the centroid value as a threshold (S804). Specifically, in S804, the barycentric value of the histogram obtained by the processing in S803 is set as a threshold, pixel information having a luminance higher than the threshold is set to “1” (that is, “white”), and luminance lower than the threshold is set. The pixel information is “0” (ie, “black”).

  After the processing of S804, secondary differential image data is generated from the binary image data (S805). Next, a horizontal histogram of the secondary differential image data is calculated (S806), and a vertical histogram is further calculated (S807). The “horizontal direction” and “vertical direction” in the above description correspond to the X-axis direction and the Y-axis direction shown in FIG. 14, respectively.

  Next, in the horizontal and vertical histograms obtained by the processing of S806 to S807, it is confirmed whether two histogram values exceeding a predetermined threshold value are detected in the horizontal direction and two in the vertical direction. (S808). That is, in S808, in the imaging area 300, the largest histogram peak indicating the document edge 201 of the document 200 corresponds to the right and left edges of the document 200 in the horizontal direction, and corresponds to the upper and lower edges of the document 200. It is confirmed whether or not two are detected in the vertical direction.

  As a result of checking in the process of S808, if two histogram values exceeding a predetermined threshold are detected in the horizontal direction and two in the vertical direction in the horizontal and vertical histograms (S808: Yes). Then, it is determined that the four sides (four document edges 201) of the document 200 are present in the imaging region 300 (S809). Next, the coordinates of the four vertices of the document 200 arranged in the imaging region 300 are acquired based on the peak positions of the total of four histograms detected by the processing of S808 (S810), and the four document edge presence / absence determination processing is performed. (S8) is terminated.

  On the other hand, as a result of the confirmation in the processing of S808, when two histogram values exceeding a predetermined threshold are not detected in the horizontal direction and two in the vertical direction in the horizontal and vertical histograms, for example, in the horizontal direction 2 is detected, but only one is detected in the vertical direction (S808: No), it is determined that the four sides (four document edges 201) of the document 200 do not exist in the imaging region 300 ( In step S811, the four document edge presence / absence determination process (S8) ends.

  The result determined in S810 or S908 is referred to in S303 of the standby process (FIG. 10), S404 of the trace reception process (FIG. 11), or S504 of the scan process (FIG. 12), and depends on the determination result. Processing is done.

  Next, referring to FIG. 16, processing executed in the above-described standby processing (FIG. 10) and trace acceptance processing (FIG. 11), and a fixed object (in the present embodiment, in the blank portion). The blank portion fixed object presence / absence determination process (S9) for determining whether or not the left hand 250) is placed will be described. FIG. 16 is a flowchart of margin part fixed object presence / absence determination processing (S9).

  In this blank portion presence / absence determination processing (S9), first, the imaging region 300 is imaged by the imaging device 100, and the image data is acquired (S901). Next, based on the coordinates of the four vertices of the document 200 stored in the four-vertex coordinate storage unit 46c, a margin portion constituted by an area having a predetermined width from the document edge 201 is set for the acquired image data (S902). ).

  Next, it is confirmed whether or not there is a pixel having a color similar to the fixed object color information registered in advance in the fixed object color information storage unit 50a among all the pixels included in the blank portion detected by the processing of S902. (S903). Specifically, in S903, the pixels included in the blank portion detected by the processing in S902, the RGB values of which are on the color space with the fixed object color information registered in advance in the fixed object color information storage unit 50a. It is confirmed whether or not there is a pixel having an RGB value whose distance is equal to or less than a threshold value.

  If there is a pixel having a similar color to the fixed object color information registered in advance in the fixed object color information storage unit 50a as a result of the confirmation in S903 (S903: Yes), these pixels are extracted (S904) and extracted. In addition, for each pixel, pixels having similar color information and similar colors (color space with the fixed object color information) with respect to all the numbers of pixels included in a region having a radius r (for example, a radius of about 5 mm) from each pixel. The existence ratio of pixels having an RGB value whose upper distance is equal to or less than the threshold is calculated (S905), and the pixel at the center of the circular area whose existence ratio is equal to or greater than the predetermined threshold is extracted (S906).

  Next, it is confirmed whether or not the pixels extracted by the processing of S906 are present in a predetermined ratio or more with respect to the total number of pixels included in the blank portion, that is, have a similar color to the fixed object color information, and It is confirmed whether or not an object having an area of a predetermined level or more occupies a blank portion at a predetermined ratio or more (S907).

  As a result of checking in the processing of S906, if an object having a color similar to the fixed object color information and having an area of a predetermined level or more occupies at a predetermined ratio or more with respect to the blank portion (S907: Yes). Then, it is determined that there is a fixed object in the margin part (S908), and this margin part fixed object presence / absence determination process (S9) is terminated.

  On the other hand, as a result of confirmation by the process of S903, when there is no pixel having a similar color to the fixed object color information registered in advance in the fixed object color information storage unit 50a (S903: No), or a result confirmed by the process of S907 If the ratio of an object having a color similar to the fixed object color information and having an area of a predetermined level or more to the margin part is less than a predetermined value (S907: No), it is determined that there is no fixed object in the margin part ( S909), the margin portion fixed object presence / absence determination process (S9) is terminated.

  The result determined in S907 or S908 is referred to in S305 of the standby process (FIG. 10) or S405 of the trace reception process (FIG. 11), and a process according to the determination result is performed.

  Next, referring to FIG. 17, processing executed in the above-described trace reception processing (FIG. 11) and scanning processing (FIG. 12), and the focus of the change region P in the imaging region 300 The in-change-region focus degree measurement process (S10), which is a process for measuring the above, is described. FIG. 17 is a flowchart of the in-change-region focus degree measurement process (S10).

  In the change area focal degree measurement process (S10), first, the image data of the imaging area 300 stored in the still image data storage unit 46a is converted into simple luminance image data (S1001). In the processing of S1001, for example, the RGB value of each pixel is converted into a luminance value by a method such as a weighted average method of the NTSC video standard.

  After the process of S1001, the variable [w] and the pixel representing the pixel column in the coordinates (w, h) of the pixel to be referred to in the focal area measurement process (S10) in the change area, that is, the coordinate pixel of the pixel in the imaging area 300 The variable “h” representing the row is set to “WSTART” and “HSTART” respectively based on the upper left coordinates of the change area P stored in the change area coordinate storage unit 46h, and the variable “avg” is set to “0” is set (S1002). By the processing of S1002, the coordinates of the pixel to be referred to are set to (WSTART, HSTART), so that the pixel data of the upper left pixel in the change region P is referred to.

  After the processing of S1002, it is confirmed whether or not the value of the variable “h” is smaller than “HEND” which is the bottom row of the change area P (S1003). As a result of checking in the processing of S1003, if the value of the variable “h” is smaller than “HEND”, that is, if h <HEND (S1003: Yes), the value of the variable “w” is the rightmost column of the change region P. It is confirmed whether it is smaller than a certain “WEND” (S1004).

  If the value of the variable “w” is smaller than “WEND” as a result of the confirmation in S1004, that is, if w <WEND (S1004: Yes), the stored image stored in the still image data storage unit 46a is stored. With reference to the pixel data of the pixel at the coordinates (w, h) in the data, the luminance value (pixel data [h] [w]) of the pixel data is added to the variable “avg” (S1005). Next, “1” is added to the variable “w” (S1006), and the process proceeds to S1004. By the processing of S1006, the pixel to be referred to is moved to the right by one column.

  On the other hand, if the value of the variable “w” is “WEND” indicating the rightmost column of the change area P stored in the change area coordinate storage unit 46h as a result of checking by the process of S1004 (S1004: No), “1” is added to the variable “h” (S1007), and the variable “w” is set to “WSTART” (S1008). Through the processing of S1007 to S1008, the pixel in the leftmost column below one row is referred to. After the process of S1008, the process proceeds to S1003.

  If the value of the variable “h” is “HEND” indicating the bottom row of the change area P stored in the change area coordinate storage unit 46h as a result of the confirmation in S1003 (S1003: No), the variable “Avg” is divided by the number of pixels constituting the change area P, that is, | (HEND−HSTART) * (WEND−WSTART) | (| x | is an arithmetic symbol representing the absolute value of x) (S1009). The value (avg) obtained by the calculation in S1009 indicates the average of the luminance values of the pixel data.

  After the process of S1009, the variable [w] and the variable “h” are set to “WSTART” and “HSTART”, respectively, and the variable “v” is set to “0” (S1010). By the processing of S1010, the coordinates of the pixel to be referred to are set to (WSTART, HSTART), and the upper left pixel data in the change region P is referred again.

  After the processing of S1010, it is confirmed whether or not the value of the variable “h” is smaller than “HEND” (S1011). If the value of the variable “h” is smaller than “HEND” as a result of the confirmation in S1011 (S1011: Yes), it is confirmed whether the value of the variable “w” is smaller than “WEND” (S1012).

If the value of the variable “w” is smaller than “WEND” (S1012: Yes) as a result of the confirmation in S1012, the pixel at the coordinates (w, h) in the saved image data stored in the still image data storage unit 46a. Referring to the luminance value of the pixel data, “(pixel data [h] [w] −avg) ² ” is added to the variable “v” (S1013). Next, “1” is added to the variable “w” (S1014), and the process proceeds to S1012. By the processing of S1014, the pixel data to be referred to is moved to the right by one column.

  On the other hand, if the value of the variable “w” is “WEND” (S1012: No) as a result of checking in the processing of S1012, “1” is added to the variable “h” (S1015), and the variable “w” is changed to “ WSTART ”(S1016). By the processing of S1015 to S1016, the pixel data in the leftmost column below one row is referred to. After the process of S1016, the process proceeds to S1011.

  If the value of the variable “h” is “HEND” (S1011: No) as a result of the confirmation in S1011, the variable “v” is set to the number of pixels constituting the change area P (that is, | (HEND-HSTART). ) * (WEND−WSTART) |) is set to “v” (S1017).

  “V” obtained by the calculation in S1017 represents the variance of the luminance values of the pixel data [h] [w] in the change region P. The variance value increases as the variation of the sum of the R, G, and B components for each pixel increases. In other words, the dispersion value becomes larger as the whole object existing in the imaging region 300 is focused and sharper.

  In the change area focus degree measurement process (S10), when the image pickup area 300 is changed by the image change detection process (S7), the change area (change area P) is changed to S1001 to S1018. Execute the process. That is, if the variance value “v” obtained by the processing of S1017 is large, an object existing in the change area P, that is, an object that causes a change in the imaging area 300 is in focus. It shows that. Therefore, the variance value “v” obtained by the process of S1017 is an index that indicates whether or not the object that caused the change in the imaging region 300 in the image change detection process (S7) described above is in focus. It is a value corresponding to a certain “focus”.

  Therefore, following S1017, the obtained dispersion value “v” is output as the focus degree (S1018), and this change area focus degree measurement process (S10) is ended.

  The value of the focus level output by the process of S1018 is referred to in the process of S406 of the trace reception process (FIG. 11) or the process of S505 of the scan process (FIG. 12), and is compared with a predetermined threshold value. At this time, if the value of the degree of focus is equal to or greater than a predetermined threshold, that is, the focus with respect to an object that causes a change in the imaging region 300 (specifically, an object existing in the change region P) is equal to or greater than a predetermined level. Next, it is determined whether or not the object that is considered to be matched and that has caused a change in the imaging area 300 is a pointer (an index finger 260a of the right hand 260 in this embodiment) as an instruction member that points to the document 200. A pointer presence / absence determination process (S11) is executed.

  In the present embodiment, since the imaging apparatus 100 is focused on the document 200, the position of the object that caused a change in the imaging area 300 (the object existing in the change area P) is above the document 200. As a result, the object is out of focus, and as a result, the dispersion value “v” obtained by the process of S1017 becomes a small value. Therefore, in other words, the “focus degree” is also an index representing the height of the object that causes a change in the imaging region 300 with respect to the document 200. Therefore, in the change area focus degree measurement process (S10), the height of the object that caused the change in the imaging area 300 with respect to the document 200 is detected. Processing (S11) is executed.

  Next, the pointer presence / absence determination process (S11) will be described with reference to FIG. This pointer presence / absence determination process (S11) is executed in the above-described trace reception process (FIG. 11) and scan process (FIG. 12), and FIG. 18 is a flowchart of the pointer presence / absence determination process (S11).

  In this pointer presence / absence determination processing (S11), first, the imaging region 300 is imaged by the imaging device 100, and the image data is acquired (S1101). Next, simple luminance image data (image data obtained by adding luminance values of R, G, and B components of each pixel of the image data) is generated from the acquired image data (S1102).

  After the processing of S1102, simple luminance image data is generated from the initial image data stored in the initial image data storage unit 46b as a result of the processing of S303 of the standby processing (FIG. 10) (S1103), and is generated by the processing of S1102 Difference image data between the simple luminance image data and the simple luminance image data generated by the processing of S1103 is generated (S1104). Next, the difference image data is binarized using a predetermined threshold (S1105). By the processing of S1105, the pixel of the area where the difference is generated, that is, the area corresponding to the object which caused the change in the image data is set to “0” (that is, “black”).

  After the processing of S1105, for all the pixels included in the difference area, that is, for each pixel constituting the black area in the binarized image data, an area having a radius r ′ (for example, a radius of about 2 cm) The presence ratio of black pixels included in the image is calculated (S1106). Next, pixels whose black pixel presence rate calculated by the processing of S1106 is within a predetermined range are extracted (S1107).

  Due to the process of S1106 to S1107, for example, an isolated point due to noise or the like, a pixel in which the existence ratio of the black pixel in the area of the radius r ′ is too low and the area of the radius r ′ in the vicinity thereof Pixels of a large object (for example, the back of the hand) whose black pixel presence rate is higher than a predetermined range are excluded as pixels to be referred to in the next processing of S1108 to S1109. .

  After the process of S1107, it is confirmed whether or not there is a pixel group that constitutes a continuous area for a predetermined distance (for example, about 3 cm) for the extracted pixel (S1108). That is, in S1108, it is confirmed whether or not there is a black image region that is long and thin and longer than a predetermined distance.

  As a result of the confirmation in S1108, if there is a pixel group that forms a continuous area that is a predetermined distance or more (S1108: Yes), it is confirmed whether there is only one pixel group that forms a continuous area that is a predetermined distance or more. If there is only one (S1109: Yes), it is determined that there is a pointer (S1110), and this pointer presence / absence determination process (S11) is terminated.

  One slender object is recognized as a pointer by the processes of S1106 to S1110. Since the tip of the elongated pointer can point to one narrow point, the position coordinates of the tip of the pointer are accurately detected in S408 of the trace reception process (FIG. 11) and S507 of the scan process (FIG. 12), thereby The processing using the coordinates can be executed accurately.

  On the other hand, as a result of confirmation in the process of S1108, when there is no pixel group constituting a continuous area of a predetermined distance or more (SS1108: No), or as a result of confirmation in the process of S1109, a continuous area of a predetermined distance or more is formed. If two or more pixel groups exist (S1109: No), it is determined that there is no pointer (S1111), and this pointer presence / absence determination process (S11) is terminated.

  The result determined in S1110 or S1111 is referred to in S407 of the trace reception process (FIG. 11) or S506 of the scan process (FIG. 12), and a process according to the determination result is performed.

  Next, referring to FIG. 19, an image (this embodiment) which is a process executed in the above-described scanning process (FIG. 12) and shows the boundary lines of the divided areas (200a to 200c in this embodiment). The document dividing line projection process (S12) for projecting the boundary lines 203a, 203b) to the corresponding position on the document 200 will be described. FIG. 19 is a flowchart of the document dividing line projection process (S12).

  In the document dividing line projection process (S12), first, the projection image data stored in the projection image data storage unit 46h is initialized (S1201), and then the pointer tip coordinates are converted into the initialized projection image data. The coordinates read from the storage unit 46d are mapped (S1202).

  After the process of S1202, the mapped coordinates are connected by line segments (S1203), and the process proceeds to S1204. In the processing of S1203, as described above, the start point and end point of each line segment are determined by referring to the mark added to the coordinates stored in the pointer tip portion 46d. That is, in the process of S1203, the coordinates from the start point to the end point of one trajectory are connected by a line segment. When there is no coordinate stored in the pointer tip coordinate storage unit 46d, that is, in the processing of the above-described trace reception processing (S10), the tip of the pointer (index finger 260a) is performed by the processing of S409 without performing the processing of S410. However, if it is confirmed that it is on the area of the split button 200, nothing is executed in S1202 to S1203, and the process proceeds to the next S1204.

  In the process of S1204, the coordinates of the four vertices of the document 200 read from the four-vertex coordinate storage unit 46c are mapped to the projection image data. Next, the coordinates of the four vertices of the mapped document 200 are connected by line segments, and the outline of the document 200 (corresponding to the four document edges 201) is drawn (S1205).

  After the processing of S1205, it is confirmed whether or not there is an intersection between the outline of the original document 200 in the projection image data and the line segment combined by the processing of S1203 (S1206), and if there is an intersection (S1206: Yes), The intersection points are mapped (S1207). Next, of the line segments combined by the processing of S1203, the line segments and mapping located outside the outline of the document 200 are deleted (S1208), and the process proceeds to S1209. In the process of S1207, when the line segment combined by the process of S1203 is not closed and the end portion is in the area of the original document 200, the line segment in the area of the original document 200 is displayed. If the distance from the edge to the intersection of the extension line of the line passing through the edge and the outline of the document 200 is equal to or less than a predetermined distance, the intersection with the extension line is mapped.

  On the other hand, if there is no intersection as a result of checking in the process of S1206 (S1206: No), the process of S1207 to S1208 is skipped, and the process proceeds to S1209.

  Through the processes in S1201 to S1208, projection image data including the boundary lines of the divided areas in the document 200 drawn by the movement of the pointer (index finger 260a) in the above-described trace acceptance process (FIG. 11) is created. .

  In S1209, the coordinates mapped to the projection image data, that is, the coordinates on the boundary line of the dividing line are stored in the divided area boundary coordinate storage unit 46e for each divided area. In S1209, when the coordinates on the boundary line of the dividing line are stored in the divided area boundary coordinate storage unit 46e, the following areas are regarded as one divided area: (1) Closed by the line segments combined by the process of S1203 (2) a closed area formed by the line segments combined by the processing of S1203 and the outline (four edges) of the document 200, and (3) an area classified as (2). (1) A region excluding the region classified as (1), (4) A region excluding the region (1) included in the region classified as (1). In the present embodiment, the coordinates of the boundary lines constituting the divided areas 200a to 200c (see FIG. 7) are stored in the divided area boundary coordinate storage unit 46e.

  After the processing of S1209, an index (identifier) for identifying each area is added to each divided area (S1210). Through the processing of S1210, an index is added to each divided area, so that the divided areas into which the document 200 is divided can be more clearly identified.

  Next, the projection image data created by the processing of S1201 to S1210 is stored in the projection image data storage unit 46h (S1211), and the projection image data stored in the projection image data storage unit 46h is used as a projection image. The image is projected onto the imaging region 300 (S1212), and the document dividing line projection process (S12) is terminated.

  FIG. 20 is a diagram schematically showing how the boundary lines of the divided areas are set in the document dividing line projection process (FIG. 19) described above. 20A to 20D show projection images corresponding to the projection image data created in each process in the document dividing line projection process (FIG. 19).

FIG. 20A is a diagram showing a state where the coordinates read from the pointer tip coordinate storage unit 46d are mapped, and this corresponds to after S1202 of the document dividing line projection process (FIG. 19). As shown in FIG. 20A, coordinates p1 to p21 stored in the pointer tip coordinate storage unit 46d are mapped to the initialized projection image (projecting only the imaging region 300). Here, the coordinates p1 to p21 are input in the order of p1, p2,..., P20, p21 in S410 of the trace reception process (FIG. 11). Therefore, these mapping coordinates are the coordinates (x ₁ , y ₁ ), (x ₂ , y ₂ ),..., (X ₂₀ , y ₂₀ ), (x ₂₁ , y ₂₁ ) (see FIG. 4A). For ease of explanation, the number of mappings (coordinates input in S410) is a small number (21).

  FIG. 20B is a diagram showing a state in which a line segment is drawn based on the coordinates read and mapped from the pointer tip coordinate storage unit 46d and the four vertex coordinate storage unit 46c. This corresponds to the processing after S1205 of the projection processing (FIG. 19). As shown in FIG. 20B, in the trace reception process (FIG. 11), the line segment connecting p1 to p13 and the line segment connecting p14 to p21 corresponding to the locus of the pointer (index finger 260a), and the original 200 Outlines (four end sides) obtained by connecting the four vertices p101 to p104 are drawn.

  FIG. 20C is a diagram showing a state in which the intersection of the line segment connecting the coordinates stored in the pointer tip coordinate storage unit 46d and the outline of the document 200 is mapped. This is a document dividing line projection process ( This corresponds to the processing after S1207 in FIG. As shown in FIG. 20C, p201 and p202 are at the intersections between the line segment connecting p14 to p21 and the two sides of the document 200 (the line segment connecting p101 to p102 and the line segment connecting p103 to p104). It is mapped.

  FIG. 20D is a diagram showing a state in which line segments and mapping located outside the outline of the document 200 are deleted, and this shows a state corresponding to S1208 in the document dividing line projection process (FIG. 19). FIG. As shown in FIG. 20 (d), the line segments p14 to p201 and p202 to p21 located outside the outline of the document 200 and the mapping of p14 and p21 are deleted. Accordingly, when the process of S1208 of the document dividing line projection process (FIG. 19) is performed, the document 200 is divided into three areas (divided areas 200a to 200c).

  In the case of the present embodiment, the coordinates stored in the divided area boundary coordinate storage unit 46e by the process of S1209 of the original dividing line projection process (FIG. 19) are the boundary lines of the divided area 200a (first divided area). Coordinates corresponding to p101, p201, p15 to p20, p202, p104, p101, p1 to p13 are stored as the constituting coordinates, and p1 is used as the coordinates constituting the boundary line of the divided area 200b (second divided area). To p13 are stored, and coordinates corresponding to p201, p102, p103, p202, p20 to p15, and p201 are stored as coordinates constituting the boundary line of the divided region 200c (third divided region). .

  As shown in FIGS. 19 and 20, in the imaging device 100, a rectangle surrounded by a closed line in the document 200 based on the shape of the locus drawn by the pointer (index finger 260 a), and / or An area surrounded by a line crossing the document 200 and the document edge 201 of the document 200 can be divided. That is, the document 200 can be divided into desired divided areas by a simple operation of drawing a desired area with the pointer (index finger 260a). Further, by dividing the document 200 into a plurality of divided areas as described above, in the divided area image data acquisition process (FIG. 21) described below, the image data is acquired and filed in units of the divided areas. Is possible.

  Next, the divided area image data acquisition process will be described with reference to FIG. FIG. 21 is a process executed in the above-described scan process (FIG. 12). The process of the divided area image data acquisition process (S13) that takes in the image data of each divided area specified by the user and creates a file. It is a flowchart.

  In this divided area image data acquisition process (S13), first, a rectangle including the designated divided area is obtained from the image data of the original 200 using the image data of the original 200 stored in the initial image data storage unit 46b. Image data is extracted (S1301). Next, an unused color in the divided area in the extracted rectangular image data is designated as a transparent color (S1302), and an area outside the divided area in the rectangular image data is filled with the designated transparent color (S1303). .

  After the process of S1303, the rectangular image data in which the area outside the divided area is filled with the specified transparent color and the transparent color information specified in the process of S1302 are stored in the divided area image data storage unit 46f (S1304).

  Next, based on the information (rectangular image data and transparent color information) stored in the divided area image data storage unit 46f, the image data of the designated divided area is filed (transparent GIF format), and the file is stored in the HDD 50. The image file is stored in the image file storage unit 50b (S1305).

  An image file of the designated divided area is created by the processing of S1301 to S1305. Therefore, the user can easily create an image file of the divided area by a simple operation in which the user points to the divided area desired to be filed with the pointer (index finger 260a). The image file that is easily created as described above can use an image in an arbitrary area for various purposes (for example, document creation).

  Further, in this divided area area image data acquisition process (S13), in the above-described scanning process (FIG. 12), the pointer (index finger 260a) points to the scan end button 230, or all the divided areas in the original 200 (main book) In the embodiment, the processing is executed until the image data of the divided areas 200a to 200c) is filed. Therefore, the file formation of the image data in units of divided areas can be executed only for a portion desired by the user.

  After the processing of S1305, the next scan acceptance message 44i4 is projected onto a predetermined position of the imaging area 300 (in this embodiment, above the imaging area 300 (see FIG. 7)) (S1306), and this divided area image data acquisition process (S13) ) Ends.

  As described above, according to the imaging apparatus 100 as the image input apparatus of the present invention, the document 200 is divided into desired divided areas according to the locus drawn by moving the index finger 260a of the right hand 260 as a pointer. can do. When inputting the trajectory of the index finger 260a as the boundary line of the divided area, the input can be prohibited by lifting the index finger 260a upward, so that the interrupt position of the trajectory of the divided area can be specified easily and reliably. Further, according to the imaging apparatus 100, it is possible to acquire image data in units of divided areas by inputting a boundary line according to the trajectory of the index finger 260a, and file the image data in units of divided areas. be able to. Therefore, after the user draws the boundary line of a desired divided area with the index finger 260a, the image file can be used for various purposes by acquiring the image file of the divided area.

  The image data acquisition means according to claim 1 corresponds to S307 in the standby process (FIG. 10) and the divided region image data acquisition process (S13), and the pointing member position detection means according to claim 1 includes a trace. The process of S10, S406, S11, and S407 in the reception process and the process of S10, S505, S11, and S506 in the scan process (FIG. 12) are applicable, and the position information input means according to claim 1 includes a trace reception process. The position information input prohibiting means according to claim 1 corresponds to the process of S410 in (FIG. 11), and the branching processes of S406 and S407 in the trace reception process (FIG. 11) and the S505 in the scan process (FIG. 12). , The branch of “No” in the branch process of S506 corresponds to the area classification means according to claim 1. , The processing of S1201~S1209 in document dividing line projecting process (FIG. 19) corresponds.

  Further, the focus adjustment means according to claim 3 corresponds to the process of S306 in the standby process (FIG. 10), and the focus degree measurement means according to claim 3 includes the in-change area focus degree measurement process (S10). Applicable.

  Further, the area designating means according to claim 5 corresponds to the processes of S10, S505, S11, and S506 to S509 in the scan process (FIG. 12).

  Further, the filing means according to claim 6 corresponds to the processing of S1305 in the divided area image data acquisition processing (FIG. 21).

  The fixed object detection means according to claim 8 corresponds to a blank area fixed object presence / absence determination process (S9).

  Further, as the boundary projection means according to the ninth aspect, the “projection image data of the boundary line created by the processing of S1201-1209 in the document dividing line projection processing (FIG. 19) is used as a projection image by the processing of S1212. The identifier projecting means according to claim 9 is an index for identifying each divided area created by the process of S1210 in the original dividing line projection process (FIG. 19). Projecting the (identifier) portion of the projection image data as a projection image onto the boundary region by the processing of S1212 ”.

  The pattern projecting means according to claim 10 corresponds to the processing of S510 in the scanning processing (FIG. 12).

  The message projecting means according to claim 11 includes the process of S301 in the standby process (FIG. 10), the process of S401 in the trace reception process (FIG. 11), the process of S501 in the scan process (FIG. 12), and the divided region image. This corresponds to the process of S1306 in the data acquisition process (FIG. 21).

  The operation button projecting means according to claim 12 corresponds to the process of S402 in the trace acceptance process (FIG. 11) and the process of S502 in the scan process (FIG. 12).

  The present invention has been described above based on the embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications and changes can be easily made without departing from the spirit of the present invention. Can be inferred.

  For example, in the above-described embodiment, the imaging device 100 in which the imaging unit 20 and the light projecting unit 30 are separated is used, but instead of this, an imaging device in which the imaging unit and the light projecting unit are integrally configured (hereinafter, referred to as “imaging device”). , Referred to as “integrated imaging device”).

  FIG. 22 is a cross-sectional view illustrating the main configuration of the integrated imaging apparatus. In order to simplify the drawing, FIG. 22 shows only the arrangement of main members in the imaging unit and the light projecting unit, and the case for housing these members and the electrical wiring of each member are omitted. Yes. Further, in the integrated imaging apparatus shown in FIG. 22, the same members as those in the above embodiment are denoted by the same reference numerals, and the description thereof is omitted.

  As shown in FIG. 22, the integrated imaging device includes an imaging lens 22 that is directed to the plane table 400, a CCD image sensor 24 that is provided behind the imaging lens 22 (inside the imaging device 100), A light source unit 32 composed of a light source 32a and a reflecting plate 32b, a condensing lens 34 for condensing light projected from the light source unit 32, a liquid crystal panel 36, an imaging lens 22, and a CCD image sensor 24. And a half mirror 62 disposed therebetween. The half mirror 62 is disposed at an angle of approximately 45 degrees with respect to the projection direction of the light from the light source unit 32, and changes the optical path of the light projected linearly from the light source unit 32 toward the imaging lens 22. Is.

  Further, in the above embodiment, the index finger 260a of the right hand 260 is used as a pointer (indicating member) for drawing a trajectory for dividing the document 200 into a plurality of regions and performing various operation instructions. You may use the member which has rod-shaped front-end | tip parts, such as a pencil.

  Moreover, in the said Example, although the left hand 250 was utilized as a fixed object, heavy stones, such as a paperweight, may be used.

  In the above embodiment, the fixed object color information registration process (S15) is configured as a process executed once every time the power is turned on and the main process is started. S15) may be skipped. Alternatively, the fixed object color information registration process (S15) may be executed only when the power is turned on for the first time.

  Or you may comprise so that the color information of a specific fixed thing may be previously registered into a predetermined storage area (for example, ROM44). In that case, at the time of product shipment, the image input device of the present invention and a specific fixed object may be shipped as a set.

  Alternatively, a fixed object registration mode switch may be provided so that the fixed object color information registration process (S15) can be executed at any time by operating the fixed object registration mode switch if the power is on.

  In the processing of S1305 in the above embodiment, the image data is filed in a transparent GIF format and then stored in the HDD 50 (image file storage unit 50b) provided in the imaging apparatus 100. Alternatively, it may be configured such that whether the filed data is stored in the HDD 50 (image file storage unit 50b) in a nonvolatile manner or in a predetermined area in the RAM 46 can be set by a user setting. . Alternatively, the filed data may be transmitted to the PC 500 connected via the external interface 58 and stored in a memory (such as a hard disk) provided in the PC 500.

  In the above embodiment, the image data of the designated divided area is acquired by extracting the image data of the part corresponding to the designated divided area from the image data stored in the initial image data storage unit 46b. However, the designated divided area may be zoomed in and imaged again.

  In the above-described embodiment, the imaging unit 20 is disposed immediately above the imaging region 300, and thus the captured image data is described as having the same rectangle as the imaging region 300. However, the initial image data after imaging has been described. Alternatively, it may be configured to perform a predetermined correction such that the image data of the divided area before being filed is rectangular image data. Further, a lens shift mechanism may be provided on the imaging lens 22 of the imaging unit 20.

  In the above embodiment, only the case where the closed boundary line drawn by the trajectory of the index finger 260a is a rectangle has been described. However, this is not limited to a rectangle, but a polygon such as a triangle or a pentagon, a circle Any shape such as a lasso with a free line may be used.

  In the above-described embodiment, the blank portion is an area formed with a predetermined width inward from the four document edges 201 of the document 200, but based on the image data of the document 200 captured by the imaging unit 20. The margin area may be detected.

  In the processing of S510 in the above embodiment, the oblique line is projected into the divided area from which the image data has been acquired. However, the projected image is not limited to the oblique line, and the divided image data has already been acquired. Any image can be used as long as the area and the divided area from which image data has not been acquired can be distinguished.

It is a figure which shows roughly the mode of the imaging by the imaging device which is an image input device of this invention. It is sectional drawing explaining the main structures of the imaging part and light projection part in the imaging device of a present Example. It is a block diagram which shows the structure of the imaging device of a present Example. It is a figure explaining the structure of the data stored in a pointer front end coordinate storage part, a division area boundary coordinate storage part, and a division area image data storage part, (a) is a figure explaining a pointer front end coordinate storage part. (B) is a diagram for explaining the divided region boundary coordinate storage unit, and (c) is a diagram for explaining the divided region image data storage unit. It is a figure explaining the case where the imaging device of a present Example is in standby mode, (a) is a figure which shows the state in which the standby message was projected with the frame of the imaging area after power activation, (b) is an imaging It is a figure which shows the state by which the user's left hand is arrange | positioned as a fixed thing which fixes the margin part of the document arrange | positioned in the area | region. It is a figure explaining the case where the imaging device of a present Example is in trace reception mode, (a) is the state which the index finger of a user's right hand points to the starting point of the boundary line for dividing the area | region in a document. (B) is a figure which shows the state in the middle of the input of the boundary line for the index finger to divide the area, and (c) after drawing the first boundary line FIG. 4 is a diagram illustrating a state in which the index finger is drawing a second boundary line, and (d) is a diagram illustrating a state in which the user has drawn all desired boundary lines and then points to the division button with the index finger. . It is a figure explaining the case where the imaging device of a present Example is in a scan reception mode, (a) is a figure which shows the state which the division button was operated and the imaging device changed to the scan reception mode from trace reception mode. And (b) is a diagram showing a state in which the division area of the image data is designated by pointing the division area where the image data is desired to be taken in with the index finger, and (c) is a diagram showing the designated division area. It is a figure which shows the state which has pointed the next division area with the index finger after designating image data, and has designated the division area, (d) is all the image data of the division area which the user acquired FIG. 5 is a diagram illustrating a state in which a scan end button is pointed with an index finger later. It is a flowchart of the main process performed with the imaging device of a present Example. It is a flowchart of the fixed object color information registration process performed with the imaging device of a present Example. 6 is a flowchart of standby processing executed by the imaging apparatus of the present embodiment. It is a flowchart of the trace reception process performed with the imaging device of a present Example. 6 is a flowchart of scan processing executed by the imaging apparatus of the present embodiment. It is a flowchart of the image change detection process performed with the imaging device of a present Example. It is a figure explaining the coordinate of the change area output as a result of an image change detection process. 4 is a flowchart of four document edge presence / absence determination processing executed by the imaging apparatus according to the present exemplary embodiment. It is a flowchart of the margin part fixed object presence determination process performed with the imaging device of a present Example. It is a flowchart of a change area | region focal degree measurement process performed with the imaging device of a present Example. 6 is a flowchart of pointer presence / absence determination processing executed by the imaging apparatus of the present embodiment. 6 is a flowchart of document dividing line projection processing executed by the imaging apparatus of the present embodiment. FIG. 6 is a diagram schematically illustrating how boundary lines of divided areas are set in document dividing line projection processing, and (a) is a diagram illustrating a state in which coordinates read from a pointer tip coordinate storage unit are mapped. (B) is a figure which shows the state by which the line segment was drawn based on the coordinate read and mapped from the pointer tip coordinate storage part and the four vertex coordinate storage part, (c) is a pointer tip coordinate. It is a figure which shows the state which mapped the intersection of the line segment which connected between the coordinates memorize | stored in a storage part, and the outline of a document, (d) deleted the line segment and mapping located outside the outline of a document It is a figure which shows a state. It is a flowchart of the division area image data acquisition process performed with the imaging device of a present Example. It is sectional drawing explaining the main structures of an integrated imaging device.

Explanation of symbols

20 Imaging unit (imaging means)
30 Projection unit 46b Initial image data storage unit (part of image data acquisition means)
46f Divided area image data storage (part of divided area image data acquisition means)
50b Image file storage (part of file creation means)
100 Imaging Device 200 Document 201 Document Edge 220 Division Button (Operation Button)
230 Scan end button (operation button)
250 Left hand (fixed object)
260 Right hand (part of pointing member, part of pointer)
260a Index finger (indicator member having a rod-shaped tip, pointer)
300 Imaging area

Claims (12)

An imaging means capable of imaging an object existing in a predetermined area on a plane;
Image data acquisition means for acquiring imaging of the object imaged by the imaging means as image data;
Indicating member position detecting means for detecting a position of the indicating member pointing to an arbitrary position with respect to the object with respect to the object;
Position information corresponding to the position of the object pointed to by the pointing member when the difference between the height of the pointing member and the height of the object is detected by the pointing member position detecting means to be smaller than a predetermined value Position information input means for inputting
Position information input prohibition for prohibiting position information input by the position information input means when the indication member position detection means detects that the difference between the height of the indication member and the height of the object is greater than a predetermined value Means,
When the position information input means starts to input the position information of the pointing member, the position information input prohibiting means responds to the locus indicated by the pointing member that moves until the position information input is prohibited. And an area dividing means for dividing the object into a plurality of areas,
The image input apparatus, wherein the image data acquisition means is capable of acquiring image data in units of areas divided by the area classification means.   2. The image input apparatus according to claim 1, wherein the pointing member has a rod-shaped tip, and the pointing member position detecting means detects a position of the rod-shaped tip. Focus adjusting means for adjusting the focus so that the object imaged by the imaging means is in focus;
A focus degree measuring means for measuring the focus degree of the pointing member with respect to the focus adjusted to fit the object by the focus adjusting means,
2. The pointing member position detecting unit is configured to determine the height of the pointing member by comparing a focus degree measured by the focus degree measuring unit with a predetermined threshold value. Or the image input device of 2.   Based on the shape of the trajectory, the region segmenting means may include a region surrounded by a closed line and / or a region surrounded by a line crossing the target and the contour of the target. The image input device according to claim 1, wherein the image input device is a device for classifying images. When the position information indicating that the pointing member points within one of the divided areas is input by the position information input means after the area is divided by the area dividing means. And an area specifying means for specifying the one area,
5. The image data acquisition means, when one area is designated by the area designation means, obtains image data of the area portion designated by the area designation means. The image input device according to any one of the above.   When image data corresponding to an area specified by the area specifying unit is acquired by the image data acquiring unit, a file forming unit is provided for creating an image file of the acquired image data. The image input device according to claim 5. The image data acquisition means acquires image data corresponding to the designated area every time an area is designated by the area designation means,
The image input apparatus according to claim 6, wherein the filing unit creates a separate image file for each image data acquired by the image data acquisition unit. A fixed object detecting means for detecting a fixed object for fixing the object;
The image input according to any one of claims 1 to 7, wherein when the fixed object is detected by the fixed object detection means, the position of the pointing member is detected by the pointing member position detecting means. apparatus. Boundary projection means for projecting an image showing the boundary of each area divided by the area dividing means onto the object;
9. An identifier projecting unit for projecting an image indicating an identifier for specifying each of the regions on each region indicated by the boundary projecting unit. An image input device according to claim 1.   When the image data acquisition unit acquires image data in units of regions divided by the region classification unit, no image data has been acquired for the region where the image data has been acquired by the image data acquisition unit. The image input apparatus according to claim 9, further comprising a pattern projecting unit that projects an image distinguishable from the region onto each region indicated by the boundary by the boundary projecting unit.   The image input device according to claim 1, further comprising a message projecting unit that projects an auxiliary message for the operation according to a timing of executing the predetermined operation. An operation button projecting unit that projects an image having a predetermined shape according to a timing at which a predetermined operation is performed,
The position information input means executes the predetermined operation when position information indicating that the pointing member points within the area of the image projected by the operation button projection means is input. The image input device according to claim 1.

Images