WO2013111278A1

WO2013111278A1 - Image recording device, image recording method, program for image recording, and information recording medium

Info

Publication number: WO2013111278A1
Application number: PCT/JP2012/051500
Authority: WO
Inventors: 久規白戸
Original assignee: SHIROTO Hisanori
Priority date: 2012-01-25
Filing date: 2012-01-25
Publication date: 2013-08-01
Also published as: JP5858388B2; JPWO2013111278A1

Abstract

Provided is an image recording device able to image and record, simply and with high resolution, information in a subject to be imaged, such as a document. A smartphone (S) is internally provided with: a camera (9) the relative position of which to a prescribed position where a document (P) is to be placed is fixed, said camera continuously acquiring images of the prescribed position if no document (P) is placed thereon or images of a document (P) if placed on the prescribed position and outputting corresponding image data for each image acquired; and a central processing unit (CPU) that, on the basis of the output image data, identifies whether the document (P) is placed at the prescribed position and, when the document (P) is identified to be currently placed, captures output image data corresponding to the time of the identification.

Description

Image recording apparatus, image recording method, image recording program, and information recording medium

The present invention belongs to the technical fields of an image recording apparatus, an image recording method, an image recording program, and an information recording medium. More specifically, an image recording apparatus provided with imaging means such as a camera, an image recording method executed in the image recording apparatus, an image recording program used in the image recording apparatus, and information recorded with the image recording program It belongs to the technical field of recording media.

In the information-oriented society in recent years, information written as letters, symbols, or figures on paper (paper) etc. is digitally imaged with high image quality, high resolution, and wide range even in daily life of individuals other than work. There are still many requests to do. Here, for imaging as described above, it is common to use a so-called scanner. As a scanner in this case, for example, a so-called flatbed scanner is generally used.

However, it is often not convenient to hold such a scanner for personal use other than work, from the viewpoint of cost, installation location, complexity of handling, and the like. In recent years, there are many cases in which an individual does not have a personal computer. Therefore, an environment in which a personal computer as a main body to which the scanner is connected does not exist in the first place is increasing. Furthermore, imaging of information described in a book, magazine, or large paper that generally requires a large flatbed scanner is often more difficult due to the circumstances described above.

On the other hand, so-called digital cameras have become common as imaging devices that can be easily handled by individuals. However, even if you try to use a digital camera that is currently available instead of a scanner, if it is handled by a general individual, the scanner will fail to capture because of, for example, camera shake or inappropriate ambient lighting There are many cases. In addition, if multiple times of imaging (scanning) are to be performed, it is necessary to repeat the troublesome task of resetting a document or the like to be imaged each time the image is taken and then picking up an image again by holding the digital camera. is there.

On the other hand, in the case of handwritten documents, etc., the order of entry on the document is often important later, but generally only the image of the final document after the completion of handwriting captures the content on the document. The handwritten order cannot be read. And in order to save such a handwritten order as information, every time one piece of information is handwritten, the handwriting work is interrupted and the handwritten content must be imaged. Is required.

Further, when imaging is performed by connecting the scanner to a personal computer, the read image data and the like are basically stored or accumulated in the personal computer. In this case, for example, when an out-of-office or other person's scanner is used, the read image data or the like is stored in the personal computer owned by the out-of-office or other person. In many cases, it is inconvenient, for example, it is necessary to move the image data to its own personal computer.

On the other hand, recently, everyone is carrying portable information devices with built-in cameras, such as so-called smartphones and tablet information terminals, and they are often worn all the time. . In addition, the imaging capability, image processing capability, and network connection capability of the camera included in the information device have been greatly improved in recent years, and rapid improvement is expected in the future.

In addition, as the prior art related to the above-described scanner or imaging processing, for example, the contents disclosed in the following Patent Document 1 and Patent Document 2 are known.

US Pat. No. 6,061,478 US Patent No. 7,949,370 B1

As described above, although there are many requests to easily image information written in documents, there is no effective method that can be easily realized by individuals. Therefore, establishment of such an imaging method is desired.

Therefore, the present invention has been made in view of the above-mentioned demand, and an example of the problem is that information described in an imaging object such as a document can be easily imaged and recorded with high image quality. An image recording apparatus, an image recording method executed in the image recording apparatus, an image recording program used in the image recording apparatus, and an information recording medium on which the image recording program is recorded.

In order to solve the above-described problem, the invention according to claim 1 is an imaging unit in which a relative position with respect to an object placement position on which an imaging object such as a document is placed is constant, and the imaging The imaging object placed at the object placement position or the object placement position where the object is not placed is continuously imaged, and corresponds to the object placement position or the imaging object. Imaging means such as a camera for outputting imaging information for each imaging, and a CPU for identifying whether or not the imaging object is placed at the object placement position based on each of the output imaging information And a recording unit such as a CPU for recording the imaging information output corresponding to the identified timing on a recording medium such as a ROM when it is identified that the imaging object is placed. And comprising.

In order to solve the above-mentioned problem, the invention according to claim 33 is an imaging means in which a relative position with respect to an object placement position on which an imaging object such as a document is placed is constant, and the imaging The imaging object placed at the object placement position or the object placement position where the object is not placed is continuously imaged, and corresponds to the object placement position or the imaging object. In an image recording method executed in an image recording apparatus including an imaging unit such as a camera that outputs imaging information for each imaging, the imaging object is located at the object placement position based on the output imaging information. A step of identifying whether or not the object to be imaged is placed, and when the object to be imaged is identified, the imaging information output corresponding to the identified timing is recorded on a recording medium. Record maker And, including the.

In order to solve the above-described problems, the invention described in claim 34 is an imaging means in which a relative position with respect to an object placement position on which an imaging object such as a document is placed is constant, and the imaging The imaging object placed at the object placement position or the object placement position where the object is not placed is continuously imaged, and corresponds to the object placement position or the imaging object. A computer included in an image recording apparatus including an imaging unit such as a camera that outputs imaging information for each imaging is used to place the imaging object on the object placement position based on the output imaging information. And a recording unit that records the imaging information output corresponding to the identified timing on a recording medium when it is identified that the imaging object is placed. Means, as To function.

In order to solve the above-described problem, the invention according to claim 35 is an imaging means in which a relative position with respect to an object placement position on which an imaging object such as a document is placed is constant, and the imaging The imaging object placed at the object placement position or the object placement position where the object is not placed is continuously imaged, and corresponds to the object placement position or the imaging object. A computer included in an image recording apparatus including an imaging unit such as a camera that outputs imaging information for each imaging is used to place the imaging object on the object placement position based on the output imaging information. And a recording unit that records the imaging information output corresponding to the identified timing on a recording medium when it is identified that the imaging object is placed. Means, as The image recording program for performance is recorded readably by the computer.

According to the invention described in

claim

1 or 33 to 35, the image is continuously detected by the imaging means whose relative position to the object placement position where the imaging object is placed is constant. When the imaging object placement position or the imaging object is imaged and it is identified that the imaging object is placed at the object placement position based on each imaging information, it corresponds to the timing of the identification. Therefore, the information recorded on the object to be imaged can be simplified while preventing blurring due to the user's operation with respect to the imaging means for recording or imaging, for example. Can be recorded and recorded.

In order to solve the above-mentioned problem, the invention according to claim 2 is the image recording apparatus according to claim 1, wherein the identification means is based on the imaging information respectively output from the imaging means. When a boundary between the imaging object and the periphery of the imaging object in the imaging information is identified, it is configured to identify that the imaging object is placed at the object placement position.

According to the invention described in claim 2, in addition to the operation of the invention described in claim 1, based on the imaging information output from the imaging means, the imaging object in each imaging information and the surroundings of the imaging object When the boundary defining the image is identified, it is identified that the imaging object is placed at the object placement position, so the imaging object is imaged more reliably and easily and the information described therein is recorded. can do.

In order to solve the above-described problem, according to a third aspect of the present invention, in the image recording apparatus according to the second aspect, when the boundary is identified, a boundary line indicating the identified boundary is displayed as the imaging information. Display means such as a display unit that displays the image in association with the imaging object.

According to the invention described in claim 3, in addition to the action of the invention described in claim 2, when a boundary between the imaging object and the surrounding is identified, the boundary line indicating the boundary corresponds to the imaging object For example, the user can improve the recognition accuracy of the boundary and the success rate of the imaging itself by moving the imaging object so that the display can be performed more accurately.

In order to solve the above-described problem, according to a fourth aspect of the present invention, in the image recording apparatus according to the first aspect, the identification unit is configured to output each of the identification information based on the imaging information output from the imaging unit. When a part or all of the imaging information changes by a predetermined amount in time series, and then it is identified that the change has disappeared, it is configured to identify that the imaging object is placed at the object placement position Is done.

According to the invention described in claim 4, in addition to the operation of the invention described in claim 1, a part or all of the imaging information changes by a predetermined amount in time series based on the imaging information respectively output from the imaging means. Then, when it is identified that the change has disappeared thereafter, it is identified that the imaging object is placed at the object placement position, so that the imaging object is imaged more reliably and easily and described in it. Information can be recorded.

In order to solve the above-described problem, the invention according to claim 5 is the image recording apparatus according to claim 1, wherein the identification unit is configured to mount the object on the mounting table on which the imaging object is mounted. When it is recognized that the object placement position of the mounting table is blocked based on the feature information indicating the feature of the portion corresponding to the placement position, the imaging object is placed at the object placement position. Configured to be identified.

According to the invention described in claim 5, in addition to the operation of the invention described in claim 1, the feature information indicating the feature of the portion corresponding to the object mounting position of the mounting table on which the imaging object is mounted. Based on the above, when it is recognized that the object placement position of the placement table is blocked, it is identified that the imaging object is placed at the object placement position. Can be recorded and the information described therein can be recorded.

In order to solve the above-mentioned problem, the invention according to claim 6 is the image recording apparatus according to claim 1, wherein the identification unit is located at the object placement position where the imaging object is not placed. Based on the difference between the corresponding imaging information and the other imaging information, it is configured to identify that the imaging object is placed at the object placement position.

According to the invention described in claim 6, in addition to the operation of the invention described in claim 1, imaging information corresponding to the object placement position where the imaging object is not placed, other imaging information, Based on the difference, it is identified that the imaging target is placed at the target placement position, so that the imaging target can be captured more reliably and easily and the information described therein can be recorded.

In order to solve the above problems, the invention according to claim 7 recognizes that the imaging object is placed in the image recording apparatus according to any one of claims 1 to 6. It is further provided with notifying means such as a display unit for sequentially notifying whether or not it is being performed.

According to the invention described in claim 7, in addition to the operation of the invention described in any one of claims 1 to 6, whether or not it is recognized that the imaging object is placed is determined. Since notification is performed sequentially, for example, when the user moves the imaging target based on the notification, the recognition accuracy of the placement and the success rate of imaging itself can be improved. The notification in this case can use a visual method, an auditory method, or a method of vibrating the image recording apparatus.

In order to solve the above-described problem, the invention according to claim 8 is the image recording apparatus according to any one of claims 1 to 7, wherein the imaging object is located at the object placement position. A determination unit such as a CPU for determining whether at least the imaging target in the imaging information is stationary for a predetermined time after being identified as being placed; and the imaging target by the determination unit Control means such as a CPU for controlling the recording means so as to record the imaging information output corresponding to the determination that the camera is stationary for the predetermined time on the recording medium.

According to the invention described in claim 8, in addition to the operation of the invention described in any one of claims 1 to 7, in the imaging information after it is identified that the imaging object is placed. Since the imaging information output corresponding to the determination that at least the imaging object is stationary for a predetermined time set in advance is recorded on the recording medium, at least by imaging the imaging object without change, The imaging object can be imaged with higher image quality.

In order to solve the above-described problem, the invention according to claim 9 is the image recording apparatus according to any one of claims 1 to 8, wherein the imaging object is located at the object placement position. A determination unit such as a CPU for determining whether or not an object other than the imaging object is imaged within the range of the imaging object in the imaging information after being identified as being placed; and the imaging When it is determined that the other object is captured within the range of the imaging target in the information, recording of the imaging information output corresponding to the determined timing onto the recording medium is prohibited. Control means such as a CPU for controlling the recording means.

According to the invention described in claim 9, in addition to the operation of the invention described in any one of claims 1 to 8, after the object to be imaged is identified, the object to be imaged is identified. When it is determined that another object is captured within the range, the recording of the imaging information output corresponding to the timing is prohibited, so that the imaging information obtained by capturing an object other than the imaging object is captured. Can be prevented from being recorded.

In order to solve the above-described problem, the invention according to claim 10 is the image recording apparatus according to any one of claims 1 to 9, wherein the first imaging information recorded in the recording medium is used. A CPU for comparing the imaging object with the imaging object in the second imaging information output from the imaging means after the timing when the first imaging information is recorded on the recording medium, for each imaging When the comparison means, the imaging object in the first imaging information, and the imaging object in the second imaging information are the same, recording of the second imaging information onto the recording medium is prohibited. Control means such as a CPU for controlling the recording means.

According to the invention described in claim 10, in addition to the operation of the invention described in any one of claims 1 to 9, the imaging object in the recorded first imaging information and the unrecorded first The imaging object in the two imaging information is compared for each imaging, and when both are the same, the recording of the second imaging information is prohibited, so that the imaging information including the same imaging object is recorded redundantly. Can be prevented.

In order to solve the above problem, an invention according to claim 11 is an image recording apparatus according to any one of claims 1 to 10, wherein an image of a related object related to the imaging object. Projection means such as a projector that projects the image onto the imaging object, and the recording means is controlled to record the imaging information output from the imaging means at the timing when the image is projected onto the recording medium. Configured to do.

According to the invention described in claim 11, in addition to the operation of the invention described in any one of claims 1 to 10, an image of a related object related to the imaging object is displayed on the imaging object. Since the imaging information output at the timing of projecting and projecting the image is recorded, the imaging object can be imaged and recorded while clarifying the relationship with the related object.

In order to solve the above-mentioned problem, the invention according to claim 12 is the image recording apparatus according to claim 11, wherein the imaging information corresponding to the imaging object on which the image is projected, and the image The recording means is controlled to record both the imaging information corresponding to the imaging object while the projection is temporarily interrupted on the recording medium.

According to the invention described in claim 12, in addition to the operation of the invention described in claim 11, the imaging information corresponding to the imaging object on which the image of the related imaging object is projected and the projection of the image are provided. Since both the imaging information corresponding to the imaging target while being temporarily interrupted are recorded on the recording medium, the imaging information corresponding to the imaging target after the projection of the image is selectively recorded. Can do.

In order to solve the above-described problem, an invention according to claim 13 is the image recording apparatus according to any one of claims 1 to 12, wherein a plurality of the images corresponding to the same imaging object are provided. The image forming apparatus further includes a combining unit such as a CPU that combines the imaging information to generate combined imaging information, and is configured to control the recording unit to record the generated combined imaging information on the recording medium.

According to the invention described in claim 13, in addition to the operation of the invention described in any one of claims 1 to 12, a plurality of pieces of imaging information corresponding to the same imaging object are synthesized and combined. Since the imaging information is generated and recorded, it is possible to record imaging information corresponding to a higher image quality or a wider range of imaging objects.

In order to solve the above-described problem, the invention according to claim 14 is the image recording apparatus according to claim 13, wherein the synthesizing means is a plurality of pieces of the imaging information corresponding to the same imaging object. Thus, the composite imaging information is generated by combining a plurality of the imaging information having different imaging conditions of the imaging object.

According to the invention described in claim 14, in addition to the operation of the invention described in claim 13, a plurality of pieces of imaging information corresponding to the same imaging object and having different imaging conditions of the imaging object are synthesized. Thus, the composite imaging information is generated, so that, for example, the imaging object can be imaged stereoscopically, and imaging information corresponding to the imaging object with higher image quality and higher accuracy can be recorded.

In order to solve the above-mentioned problem, the invention according to claim 15 is the image recording apparatus according to claim 13, wherein the relative position between the imaging means and the imaging object is between the preceding and following imaging. Based on the change, the synthesizing means uses a plurality of the imaging information before and after the change corresponding to the same imaging object, to produce a composite image having a higher image quality or a wider range than images corresponding to the respective imaging information. The corresponding composite imaging information is generated.

According to the invention described in claim 15, in addition to the action of the invention described in claim 13, the same imaging based on a change in relative position between the imaging means and the imaging object between the preceding and succeeding imaging. Since composite imaging information corresponding to a composite image having a higher image quality or a wider range than the images corresponding to the plurality of imaging information before and after the change corresponding to the object is generated, a higher image quality or a wider range than the image corresponding to the imaging object is generated. Composite imaging information can be recorded.

In order to solve the above-mentioned problem, the invention according to claim 16 is the image recording apparatus according to any one of claims 1 to 15, wherein the imaging object personally identifies a person. It is comprised so that it may be the imaging target object in which the personal information to describe is described.

According to the invention described in claim 16, in addition to the operation of the invention described in any one of claims 1 to 15, personal information is described in the imaging object. This saves you the trouble of filling in and entering.

In order to solve the above-described problem, the invention according to claim 17 is the image recording apparatus according to any one of claims 1 to 16, wherein the imaging information is recorded on the recording medium. An event information generating unit such as a CPU for generating event information associated with the recorded imaging information and specifying an event related to the recorded imaging information; and the generated event information is an event information recording unit A collation unit such as a CPU for collating whether or not the event information corresponds to the same event information already recorded in the event information, and the generated event information recorded in the event information recording unit When the event information does not correspond to the same event information, the generated event information is recorded in the event information recording means. Further comprising a transmission unit, such as interface.

According to the invention described in claim 17, in addition to the operation of the invention described in any one of claims 1 to 16, when the imaging information is recorded on the recording medium, the recorded imaging information is added. Event information is recorded when event information for identifying an event associated with the imaging information is generated, and the event information does not correspond to any event information recorded in the event information recording means. Since the generated event information is recorded by the means, the event information associated with the imaging object and specifying the event related to the imaging information can be easily generated and recorded, thereby easily maintaining and managing the event information. can do.

In order to solve the above-mentioned problem, the invention according to claim 18 is the image recording apparatus according to claim 17, wherein the generated event information is recorded in the event information recording means. An association changing unit such as a CPU that changes the association destination of the imaging information associated with the generated event information to the event information of the same event when the event corresponds to the same event as the information; Prepare.

According to the invention of claim 18, in addition to the action of the invention of claim 17, when the generated event information corresponds to the same event as any of the recorded event information Since the association destination of the imaging information associated with the generated event information is changed to the event information of the same event, a plurality of imaging information can be managed in association with the recorded event information.

In order to solve the above-described problem, the invention according to claim 19 is the image recording apparatus according to any one of claims 1 to 18, wherein the imaging information is recorded on the recording medium. A personal information generating unit such as a CPU for generating personal information associated with the recorded imaging information and identifying an individual related to the recorded imaging information; and the generated personal information is stored in the personal information recording unit. Collation means such as a CPU for collating whether or not it corresponds to an individual indicated by any personal information already recorded, and any of the generated personal information recorded in the personal information recording means And a transmission means such as a communication interface for recording the generated personal information in the personal information recording means when the personal information does not correspond to the individual indicated by the personal information. That.

According to the nineteenth aspect of the invention, in addition to the operation of the first aspect of the invention, when the imaging information is recorded on the recording medium, the recorded imaging information is added. Generates associated personal information, and records the generated personal information in the personal information recording means when it does not correspond to the individual indicated by any personal information recorded in the personal information recording means Therefore, the personal information related to the imaging object can be easily generated and recorded, so that the personal information can be easily maintained.

In order to solve the above-mentioned problem, the invention according to claim 20 is the image recording apparatus according to claim 19, wherein any one of the individuals in which the generated personal information is recorded in the personal information recording means. Association changing means such as a CPU for changing the association destination of the imaging information associated with the generated personal information to the personal information of the recorded individual when corresponding to the individual indicated by the information Is further provided.

According to the invention of claim 20, in addition to the action of the invention of claim 19, when the generated personal information corresponds to an individual indicated by any of the recorded personal information Since the association destination of the imaging information associated with the generated personal information is changed to the personal information of the recorded individual, a plurality of imaging information can be managed in association with the recorded personal information.

In order to solve the above-described problem, the invention according to claim 21 is the image recording apparatus according to any one of claims 1 to 20, wherein the imaging information is recorded on the recording medium. Link information generating means such as a CPU for generating link information that is associated with the recorded imaging information and identifies an individual and an event related to the recorded imaging information, and the generated link information is a link Collation means such as a CPU for collating whether or not the same individual and event as any of the link information already recorded in the information recording means are identified, and the generated link information is the link information recording means When no individual or event is identified by any link information recorded in the link information, the link information generated is A transmission unit such as a communication interface for recording further comprises a.

According to the invention described in claim 21, in addition to the operation of the invention described in any one of claims 1 to 20, link information is generated when imaging information is recorded on a recording medium. Since the link information recording means records the generated link information when no individual or event specified by any link information recorded in the link information recording means is specified, it is associated with the imaging information. The link information can be easily generated and recorded, so that the link information can be easily maintained.

In order to solve the above-described problem, the invention according to claim 22 is the image recording apparatus according to claim 21, wherein the generated link information is recorded in the link information recording means. When specifying the individual and the event specified by, the association change of the CPU or the like that changes the association destination of the imaging information associated with the generated link information to the recorded link information Means are further provided.

According to the invention described in claim 22, in addition to the operation of the invention described in claim 21, an individual identified by any link information in which the generated link information is recorded in the link information recording means When the event is specified, the association destination of the imaging information associated with the generated link information is changed to the recorded link information, so that a plurality of imaging information is associated with the recorded link information and managed. can do.

In order to solve the above-described problem, the invention according to claim 23 is the image recording apparatus according to claim 17 or 18, wherein the imaging means when the imaging information is recorded on the recording medium. It further comprises position detecting means such as a CPU for detecting a position and generating position information indicating the detected position, and the event information generating means generates the event information by including the generated position information. Configured.

According to the invention described in claim 23, in addition to the action of the invention described in claim 17 or claim 18, the event information includes position information indicating the position of the image pickup means when the image pickup information is recorded. Therefore, highly useful event information can be easily maintained and managed.

In order to solve the above-described problem, an invention according to claim 24 is the image recording apparatus according to any one of claims 1 to 23, wherein the imaging unit is a portable information processing apparatus. It is comprised so that it may be provided with the imaging means.

According to the invention described in claim 24, in addition to the operation of the invention described in any one of claims 1 to 23, since the imaging means is provided in the portable information processing apparatus, it is simplified. The imaging object can be imaged with a simple configuration.

In order to solve the above-described problem, an invention according to claim 25 is the image recording apparatus according to any one of claims 1 to 24, wherein the imaging means is a portable holder. The image recording apparatus is configured to be an image pickup unit in which the relative position is fixed by being held.

According to the invention described in claim 25, in addition to the operation of the invention described in any one of claims 1 to 24, the relative position of the image pickup means is set on the portable holder. Since the recording apparatus is held constant, the imaging object can be imaged with a simple configuration.

In order to solve the above-described problem, the invention according to claim 26 is the image recording apparatus according to claim 24 or claim 25, wherein the imaging means is configured such that the image recording apparatus is held by a holder. The relative position is fixed by the imaging means, and the holder is a holder that is assembled by folding a foldable sheet-like material, and is unfolded into a sheet shape when carried and used. The holder is configured to be folded and assembled so that the image recording apparatus can be held.

According to the twenty-sixth aspect of the invention, in addition to the action of the twenty-fourth or twenty-fifth aspect of the invention, the image recording device is held by the holder so that the relative position of the imaging means is constant. The holder is a holder that is assembled by folding a foldable sheet-like material, and is unfolded into a sheet shape when carried, and can be folded and assembled when used to hold the image recording apparatus. Since it is a holder, an object to be imaged can be stably imaged with only a cheap / lightweight and highly portable holder.

In order to solve the above-described problem, the invention according to claim 27 is the image recording apparatus according to any one of claims 1 to 26, wherein the imaging object is located at the object placement position. An image processing means such as a CPU for adding advertisement information having an advertisement content to the imaging information output corresponding to the identified timing when it is identified as being placed; The means is configured to record the imaging information added with the advertisement information on the recording medium.

According to the twenty-seventh aspect of the invention, in addition to the operation of the invention according to any one of the first to twenty-sixth aspects, the imaging information to which the advertising information is added is recorded. By distributing by, the user can enjoy the service related to the present invention at a lower cost.

In order to solve the above-described problem, the invention according to claim 28 is the image recording apparatus according to claim 27, wherein the image processing means is configured to place the imaging object at the object placement position. Imaging information transmitting means such as a communication interface for transmitting at least a part of the imaging information output corresponding to the timing identified as being present to an external information processing apparatus, and the information on the content of the transmitted imaging information Imaging information receiving means such as a communication interface for receiving the imaging information to which the advertisement information is added in the information processing apparatus based on a recognition result in the processing apparatus, and the recording means is configured to receive the received imaging information. Is recorded on the recording medium.

According to the invention described in claim 28, in addition to the operation of the invention described in claim 27, at least a part of the imaging information output corresponding to the timing when it is identified that the imaging object is placed. Is transmitted to an external information processing device, the content is recognized and advertisement information is added, and the imaging information with the advertisement information added is received and recorded, thus reducing the processing load on the image recording device. The advertisement can be recorded together with the imaged information and can be referred to later.

In order to solve the above-mentioned problem, the invention according to claim 29 is the image recording apparatus according to claim 27, wherein the image processing means is an advertisement information such as a ROM that records one or more of the advertisement information in advance. A recording unit; a recognition unit such as a CPU for recognizing the content of the imaging information output corresponding to the timing at which the imaging object is identified as being placed at the object placement position; Reading means such as a CPU for reading out the advertisement information corresponding to the contents from the advertisement information recording means, and the image processing means converts the read advertisement information into the imaging information whose contents are recognized. Configured to add.

According to the invention described in claim 29, in addition to the operation of the invention described in claim 27, it corresponds to the content of the imaging information output corresponding to the timing when the imaging object is identified as being placed. Since the advertisement information to be read is read from the advertisement information recording means and added to the image pickup information, the advertisement can be recorded together with the imaged information and referred to later by the configuration completed within the image recording apparatus.

In order to solve the above-described problem, the invention according to claim 30 is the image recording apparatus according to claim 27, wherein the image processing means is configured to place the imaging object at the object placement position. A recognition unit such as a CPU for recognizing the contents of the imaging information output corresponding to the timing identified as being present, and a recognition result transmission such as a communication interface for transmitting a recognition result by the recognition unit to an external information processing apparatus Means and an advertisement information receiving means such as a communication interface for receiving the advertisement information transmitted from the information processing apparatus based on the transmitted recognition result, and the image processing means includes the received advertisement Information is configured to be added to the imaging information whose contents are recognized.

According to the invention of claim 30, in addition to the action of the invention of claim 27, recognition of the contents of the imaging information output corresponding to the timing at which the imaging object is identified as being placed Since the result is transmitted to an external image processing apparatus, and the advertisement information based on the recognition result is received and added to the imaging information, the advertisement can be recorded together with the imaged information and can be referred to later.

In order to solve the above problem, the invention according to claim 31 is the image recording apparatus according to any one of claims 1 to 30, wherein the imaging information is recorded on the recording medium. The recording means includes at least identification information for identifying each of the imaging information, time information indicating when the imaging object corresponding to the imaging information is captured, or location information indicating a place where the imaging is performed. After any one is embedded as an image in the imaging information, the imaging information is recorded on the recording medium.

According to the invention of claim 31, in addition to the operation of the invention of any one of claims 1 to 30, when recording imaging information, at least identification information, time information or location information is recorded. Since any one is embedded after being embedded as an image in the imaging information, the imaging information after recording can be easily identified.

In order to solve the above-mentioned problem, the invention according to claim 32 is the image recording apparatus according to claim 31, wherein the recording means already includes the other identification information in the imaged imaging information. New identification information related to the recognized other identification information is generated, and the generated new identification information is recorded in the imaging information recorded on the recording medium by the imaging. Is configured to be embedded and recorded.

According to the invention of claim 32, in addition to the action of the invention of claim 31, when recognizing that other identification information is already included in the imaged imaging information, Since new identification information related to the identification information is generated, embedded in the imaging information, and recorded, the imaging information obtained by multiple imaging can be reliably identified by the relevance of the identification information.

According to the present invention, the imaging object mounting position or the imaging object is continuously imaged by the imaging means whose relative position with respect to the object mounting position on which the imaging object is placed is constant, and each imaging information When it is identified that the imaging target is placed at the target placement position, the imaging information output corresponding to the identified timing is automatically recorded on the recording medium.

Therefore, for example, information described on the imaging object can be easily imaged and recorded while preventing blurring due to the user's operation on the imaging means for recording or imaging.

BRIEF DESCRIPTION OF THE DRAWINGS It is an external appearance perspective view etc. which show schematic structure of the capture system which concerns on 1st Embodiment, (a) is the said external appearance perspective view, (b) is a figure which illustrates the imaged image. It is a block diagram which shows the schematic structure of the smart phone which concerns on 1st Embodiment. It is a flowchart which shows the capture process which concerns on 1st Embodiment. FIG. 2A is a diagram illustrating a capture process according to the first embodiment, FIG. 3A is a diagram illustrating a first example of the capture process, and FIG. 4B is a diagram illustrating a second example of the capture process; It is figure (II) which illustrates the capture process which concerns on 1st Embodiment, (a) is a figure which shows the 3rd example of a capture process, (b) is a figure which shows the 4th example of a capture process, (C) is a figure which shows the 5th example of a capture process, (d) is a figure which shows the 6th example of a capture process, (e) is a figure which shows the 7th example of a capture process. It is an external appearance perspective view (I) which shows the other example of the stand contained in the capture system which concerns on 1st Embodiment. It is an external appearance perspective view (II) which shows the other example of the stand contained in the capture system which concerns on 1st Embodiment, (a) is a front view which shows the said stand before an assembly, (b) is after an assembly. It is an external appearance perspective view which shows the usage example of the said stand. It is an external appearance perspective view which shows schematic structure of the 1st example of the capture system which concerns on 2nd Embodiment. It is an external appearance perspective view which shows schematic structure of the 2nd example of the capture system which concerns on 2nd Embodiment. It is an external appearance perspective view which shows schematic structure of the 3rd example of the capture system which concerns on 2nd Embodiment. It is an external appearance perspective view which shows schematic structure of the capture system which concerns on 3rd Embodiment. It is a block diagram which shows the schematic structure of the smart phone contained in the capture system which concerns on 4th Embodiment. It is a flowchart which shows the capture process which concerns on 4th Embodiment. It is figure (i) which illustrates the position alignment process which concerns on 4th Embodiment, (a) is a figure which illustrates the state before position alignment, (b) is a figure which illustrates the state during position alignment process (i). (C) is a diagram (ii) illustrating the position alignment process. It is figure (ii) which illustrates the position alignment process which concerns on 4th Embodiment, (a) is a figure (iii) which illustrates during position alignment process, (b) is a figure which illustrates during position alignment process ( iv), (c) is a diagram (v) illustrating the alignment process, and (d) is a diagram (vi) illustrating the alignment process. It is a figure (iii) which illustrates the alignment process which concerns on 4th Embodiment.

Next, modes for carrying out the present invention will be described based on the drawings. Each embodiment described below is a capture system that captures (i.e., records) an image using a portable smartphone including a digital camera (hereinafter simply referred to as a camera) capable of continuous shooting and moving image capturing. This is an embodiment when the present invention is applied to the above. In addition, you may apply this invention with respect to the capture system which captures an image using the digital camera independent as an apparatus instead of the digital camera with which the said smart phone is equipped. In addition, a smartphone user according to the present invention is hereinafter simply referred to as a “carrier”.
(I) First Embodiment First, a first embodiment according to the present invention will be described with reference to FIGS. 1 is an external perspective view showing a schematic configuration of the capture system according to the first embodiment, FIG. 2 is a block diagram showing a schematic configuration of the smartphone according to the first embodiment, and FIG. It is a flowchart which shows the capture process which concerns on embodiment. 4 and 5 are diagrams illustrating the capture processing according to the first embodiment, respectively. FIGS. 6 and 7 are external perspective views illustrating other examples of the stand included in the capture system according to the first embodiment. FIG.

In the capture system according to the first embodiment, information described using, for example, a letter, a symbol, or a figure on a document or a three-dimensional object as an example of an imaging object is displayed with respect to a position where the imaging object is placed. Then, continuous shooting or moving image capturing is performed by using the smartphone camera at a relatively fixed position. Thereafter, the image data selected by the capture process described later is recorded (captured) from the image data corresponding to the captured image.

That is, as illustrated in FIG. 1A, the capture system CS according to the first embodiment includes a smartphone S provided with a camera 9 and a smartphone S such that the camera 9 faces a document P that is an example of an imaging object. And a stand ST that supports The smartphone S in this case corresponds to an example of the “image recording apparatus” according to the present invention. By supporting the smartphone S so as not to move by the stand ST, the position of the camera 9 (and its imaging range AR) is made relatively constant with respect to the position where the document P is placed. When the document 9 placed on, for example, the desk D in the imaging range AR is imaged by the camera 9 of the smartphone S supported by the stand ST, an image obtained by the imaging is, for example, in FIG. The document P on the desk D as shown is included. The example in which the document P placed on the desk D shown in FIG. 1B is an imaging target is the same in FIGS. 4 and 5 described later.

In the state shown in FIG. 1, the smartphone S continuously captures or captures a moving image of the document P using the camera 9, and selects image data selected by capture processing described later from image data corresponding to the captured image. Record (capture) in the smartphone S. Thereby, the capture process of the document P (in other words, information described on the document P) according to the first embodiment is performed.

Next, details of the configuration and operation of the capture system CS according to the first embodiment will be described with reference to FIGS. 2 to 5.

First, as shown in FIG. 2, the smartphone S included in the capture system CS according to the first embodiment includes a CPU 1, a ROM (Read Only Memory) 2, a RAM (Random Access Memory) 3, an operation button, a touch panel, and the like. An operation unit 4 comprising: a display 5 comprising a liquid crystal display or the like on which the touch panel is disposed; a call control unit 6 to which a speaker 7 and a microphone 8 are connected; and “imaging means” according to the present invention. A communication interface 10 including the camera 9 as an example and an antenna ANT for connection to an external network (a network such as a wireless LAN (Local Area Network), a dedicated line, the Internet, or a so-called 3G line) not shown in FIG. And a part or all of the imaging object to be imaged by the camera 9 A light 11 that illuminates when imaging, and is composed of. In the RAM 3, a current image buffer 32 is formed as a volatile storage area as a buffer necessary for executing the capture processing according to the first embodiment centered on the CPU 1.

Among the above configurations, the CPU 1 is an example of “identification means”, an example of “recording means”, an example of “determination means”, an example of “control means”, an example of “comparison means”, ”,“ Event information generation means ”,“ matching means ”,“ personal information generation means ”,“ position detection means ”,“ image processing means ”,“ reading means ” It corresponds to an example and an example of “link information generating means”, respectively. The communication interface 10 is an example of “transmission means”, an example of “imaging information transmission means”, an example of “imaging information reception means”, an example of “recognition result transmission means”, an example of “imaging information reception means”, and “ Each of them corresponds to an example of “advertisement information receiving means”. Furthermore, the display 5 corresponds to an example of “display means” and an example of “notification means” according to the present invention. Furthermore, the ROM 2 includes an example of “recording medium”, an example of “event information recording unit”, an example of “personal information recording unit”, an example of “link information recording unit”, and an “advertisement information recording unit” according to the present invention. Each corresponds to an example.

In this configuration, the communication interface 10 controls transmission / reception of data with the network via the antenna ANT under the control of the CPU 1. At this time, the communication interface 10 may be configured not only to transmit / receive data wirelessly via the antenna ANT but also to control data transmission / reception via a wired LAN or a so-called USB (Universal Serial Bus). it can.

The call control unit 6 controls a voice call as the smartphone S using the microphone 8 and the speaker 7 under the control of the CPU 1. Furthermore, the operation part 4 produces | generates the operation signal corresponding to the said operation based on operation by the user of the smart phone S, and outputs it to CPU1. Thereby, CPU1 controls the smart phone S whole based on the said operation signal.

On the other hand, in the ROM 2, a program or the like for processing as the smartphone S including the capture processing according to the first embodiment described later is recorded in advance in a nonvolatile manner. The ROM 2 includes a rewritable area, and image data corresponding to an image captured by the capture processing according to the first embodiment is recorded in the rewritable ROM 2 area. And CPU1 controls the process as the said smart phone S by reading and running the said program etc. which are recorded on ROM2. In addition, in the rewritable area in the ROM 2, data necessary for processing as the smartphone S, such as telephone number data and address data, is also recorded in a nonvolatile manner.

On the other hand, the RAM 3 temporarily stores data necessary for the current image buffer 32, and further temporarily stores other data necessary for processing as the smartphone S. Further, the display 5 displays information necessary for the process as the smartphone S to the user under the control of the CPU 1 in addition to the information necessary for the capture process according to the first embodiment.

On the other hand, under the control of the CPU 1, the camera 9 continuously captures or captures the information on the document P or the like, and captures image data (digitized image data) corresponding to the captured image. Each time or in the case of moving image capturing, the data is output to the CPU 1 continuously. As a result, the CPU 1 temporarily inputs the output image data to the current image buffer 32 in the RAM 3. Then, the CPU 1 executes the capture process according to the first embodiment using the image data stored in the current image buffer 32. At this time, the light 11 illuminates a part or all of the document P or the like imaged by the camera 9 under the control of the CPU 1 so that the illuminance is suitable for the imaging at the time of the imaging.

Next, the current image buffer 32 in the RAM 3 stores the image data for one frame that is the target of the capture processing according to the first embodiment at that time. In this case, an image corresponding to one frame of image data (frame image data) is referred to as a “current image”.

Next, the capture processing according to the first embodiment will be specifically described with reference to FIGS. The capture process according to the first embodiment is started, for example, when a predetermined operation by a carrier is executed on the operation unit 4.

When the document P is placed and the capture process is started, as shown in FIG. 3, the CPU 1 first activates the camera 9 to image the document P placed in the imaging range AR (step S1). ). Thereby, a plurality of images corresponding to the document P (images corresponding to the current image) are captured by continuous shooting or moving images. Then, the CPU 1 temporarily inputs the image data of the current image input from the camera 9 along with the imaging to the current image buffer 32 (step S2). Next, in the image picked up by the process of step S1, the CPU 1 illustrates the boundary between the document P shown in the image and its surroundings (in the case illustrated in FIG. 1 and FIG. It is identified whether or not all of the boundary BD) between the document P and the desk D is recognized (step S3). When the entire boundary is recognized in any image in the identification in step S3 (step S3; YES), the CPU 1 next sets in advance the image data stored in the current image buffer 32 at that time. It is determined whether or not the document P or the like shown in the image is stationary for the predetermined time (step S4). In this case, for example, when a boundary is recognized, the boundary BD illustrated in FIG. 4 may be displayed in accordance with the image of the document P at a position corresponding to the recognized boundary. Moreover, it can also be configured to sequentially notify whether or not the document P is recognized by using, for example, blinking of the display 5 or the light 11 or sound emission from the speaker 7.

If it is determined in step S4 that the document P or the like in the image is stationary for a predetermined time (step S4; YES), the CPU 1 next stores the image data stored in the current image buffer 32 at that time. Is compared with the image of the image data captured immediately before and recorded in the ROM 2 to determine whether or not they are the same (step S5). If they are not the same in the determination in step S5 (step S5; NO), the CPU 1 records (that is, captures) the image data stored in the current image buffer 32 at that time in the ROM 2 (step S6). Thereafter, the CPU 1 determines whether or not an operation for ending the capture processing according to the first embodiment has been performed by, for example, the carrier in the operation unit 4 (step S8), and when the end operation has been performed ( Step S8; YES), the capture processing according to the first embodiment is terminated. On the other hand, when the end operation is not performed in the determination in step S8 (step S8; NO), the CPU 1 returns to step S2 and performs the next imaging.

On the other hand, if the entire boundary between the document P and its periphery is not recognized in the image stored in the current image buffer 32 in the identification in step S3 (step S3; NO), or in the determination in step S4. When it is determined that the document P or the like in the image of the image data stored in the current image buffer 32 is not stationary for a predetermined time (step S4; NO), or in the determination of step S5, the current image buffer 32 When the image of the stored image data is the same as the image of the image data captured immediately before and recorded in the ROM 2 (step S5; YES), the CPU 1 at that time, the current image buffer 32 Since the image data stored in the Flop S7), and then shifts to the process in the step S8.

When the capture processing according to the first embodiment described above is executed, for example, as shown in FIG. 4A, all of the boundary BD between the document P and the desk D is recognized (step S3; Only when the image including the document P is stationary for the predetermined time (see step S4; YES), the image data stored in the current image buffer 32 at that time is the target of capture. Will be able to. Therefore, for example, as shown in FIG. 4B, when a hand H having a writing instrument for writing on the document P is on the document P, a part of the boundary BD is not recognized in the image (above Step S3; see NO), and if the image including the document P for writing by the hand H has not been stationary for the predetermined time (see Step S4; NO), it is stored in the current image buffer 32 at that time. The captured image data is discarded without being captured (see step S7).

Further, as shown in FIG. 5 as another example, after the image on which the document P and the desk D shown in FIG. 5A are first captured is captured (see step S6 above), it is illustrated in FIG. 5B. As described above, when the hand H enters the document P but no writing is made on the document P (that is, the document P is the same as the previous capture), the hand H comes out of the document P. Even if the predetermined time has elapsed (see step S4; YES), as illustrated in FIG. 5C, the document P is the same as the previous capture (see FIG. 5A) (see above). At step S5; see YES), the image data stored in the current image buffer 32 at that time is discarded without being captured (see step S7). On the other hand, as illustrated in FIG. 5B, when the hand H enters the document P and further, for example, a character L is written on the document P as illustrated in FIG. 5D (that is, the document P). If the predetermined time elapses after the hand H comes out of the document P (see step S4; YES), the document P is not the same as the previous capture. Therefore (see step S5; NO), the image data stored in the current image buffer 32 at that time is captured (see step S6).

As described above, according to the operation of the capture system CS according to the first embodiment, the document 9 is continuously imaged by the camera 9 in which the relative position with respect to the position where the document P is placed is constant. When it is identified that the document P is placed at the position based on the image data, the image data output corresponding to the identified timing is automatically captured. Therefore, the information described on the document P can be captured easily and with high image quality while preventing the camera 9 from shaking due to the user's operation.

Further, based on the image data respectively output from the camera 9, when the boundary BD that defines the document P and the periphery of the document P in each image data is identified, it is identified that the document P is placed at a predetermined position. Therefore, the document P can be imaged more reliably and easily, and the information described therein can be captured.

Further, after the document P is identified as being placed, the image data output corresponding to the determination that at least the document P in the image data is stationary for a predetermined time set in advance is captured. By taking an image while the document P is stationary for the predetermined time, the document P can be imaged with higher accuracy.

Furthermore, when it is determined that another object such as the hand H has been imaged within the range of the document P after it is identified that the document P is placed, an image output in accordance with the timing. Since data capture is prohibited, it is possible to prevent recording of image data obtained by capturing an object other than the document P.

In addition, the document P in the captured image data and the document P in the uncaptured image data are compared for each imaging, and when both are the same, the capture of the image data is prohibited, so the same document P In addition, when there is no new writing or the like on the document P, it is possible to prevent the image data including the document P from being captured redundantly.

Furthermore, since the camera 9 is provided in the portable smartphone S, and the relative position of the camera 9 is fixed by holding the smartphone S on a portable stand (see FIG. 7), for example. The document P can be imaged with a simple configuration while keeping the relative position of the camera 9 and the document P constant.

If the stand is a stand that can be assembled by folding a foldable sheet-like material (see FIG. 7 described later), the document P can be imaged with a simpler configuration.

Further, when the boundary between the document P and the surroundings is identified, when the boundary BD indicating the boundary is displayed in association with the image of the document P, for example, the user writes the document so that the display can be performed more accurately. By moving P or the like, the boundary recognition accuracy and the success rate of capture itself can be improved.

Furthermore, when it is notified by sequential display or the like whether or not the document P is recognized, the user can move the document P based on the notification, for example. And the success rate of imaging itself can be improved.

In the capture process according to the first embodiment described above, the image data of the image whose suitability as the current image to be captured is determined by the processes in steps S3 to S5 is captured. However, the image data to be captured is not limited to the image data itself used for the recognition (identification) of the document P. For example, an image (newly captured after the timing when the recognition (identification) of the document P is completed) For example, the camera 9 may be configured to capture (see step S6) image data of a high-quality still image captured by switching to the still image mode.

Moreover, the installation method with respect to the document P etc. of the smart phone S which concerns on 1st Embodiment is not restricted to the method by the stand ST illustrated to Fig.1 (a).

For example, like the capture system CS1 illustrated in FIG. 6, the imaging target PP placed on the mounting table B is covered with a transparent plate TB such as acrylic or glass, and the imaging target PP is fixed to the mounting table B. The light LT supported by the supported support portion BS1 illuminates the transparent plate TB, and is further supported by the support portion BS2 fixed to the mounting table B on the holding table PT supported at a fixed position with respect to the imaging target PP. The camera 9 can also be configured to take an image with the camera 9 of the smartphone S placed so as to face the imaging target PP (see step S1).

In this case, the transparent plate TB may be openable and closable so that the imaging object PP can be easily taken in and out. Further, the bottom plate of the mounting table B may be movable in the vertical direction in FIG. 6 so that the distance from the transparent plate TB can be adjusted according to the height of the imaging target PP. Furthermore, the mounting table B may have a structure in which the imaging target PP can be taken in and out without releasing the transparent plate TB. Further, the support portion BS2 is preferably a mechanism that can adjust the position and angle of the camera 9 with respect to the imaging target PP. Furthermore, the holding stand PT can be configured by a tray type with a dent, a detachable holder having a shape that matches the external shape of the smartphone S, or the like so that the smartphone S can be held stationary. Further, it is convenient that the light LT is automatically turned on in conjunction with the smartphone S placed on the holding base PT.

Further, as an application example of the capture system CS1 illustrated in FIG. 6, for example, when the object to be imaged is a thin document or a film, an image may be captured using a light that illuminates from the back of the object to be imaged. Further, contrary to the case illustrated in FIG. 6, the smartphone S is installed with the camera 9 facing upward, and the document P is placed on the upper side of the transparent plate TB (that is, above the smartphone S with the camera 9 facing upward). You may comprise so that it may face down and image. Furthermore, the capture system CS1 can also be used as a so-called OHP (Over Head Projector) by outputting captured image data from a smartphone S to a projector (not shown) by wire or wirelessly and projecting it. Further, the holder PT may be provided with a drive unit that is driven under the control of the CPU 1 of the smartphone S and moves the imaging range of the camera 9 on the imaging target PP. Further, an optical mechanism such as a predetermined lens or a polarizing filter may be provided near the camera 9 or the light LT by the support portion BS1.

As another example, as shown in FIG. 7A, the camera 9 is opposed to the document P by a foldable stand ST1 cut out from a sheet-like material (for example, corrugated paper). You may comprise so that the smart phone S may be hold | maintained.

The stand ST1 shown in FIG. 7A is configured to include a holding base PT1 and support portions PT2 and PT3 formed of the single sheet-like material. In FIG. 7 (a), the solid line indicates the cut at the joint between the holding base PT1 and the support PT2, and the joint between the support PT2 and the support PT3, and the alternate long and short dash line indicates the assembly as the stand ST1. The line part made into valley fold is shown. In FIG. 7B, the stand ST1 is actually assembled, and the smartphone S faces the document placed on the lower side of the smartphone S at the time of imaging although not shown in FIG. 7B. An external perspective view of the capture system in a state where it can be imaged by being placed on the holding base PT1 is shown.

6 and 7 can achieve the same effects as the capture system CS according to the first embodiment.

In addition, in the capture process according to the first embodiment described above, when a movement caused by vibration or the like in the camera 9 is detected after it is identified that the document P is placed, it is output corresponding to the timing. If the configuration is such that the capture of the image data is prohibited, it is possible to prevent the image data blurred by the movement of the camera 9 from being captured.

In addition, using the feature data indicating features such as a reference pattern or pattern formed in advance at the position where the document P is placed (for example, on the document table), the position is blocked (by the document P). When this is recognized, the CPU 1 can be configured to identify that the document P is placed at the position.

Further, based on the difference between the image data corresponding to the position where the document P is not placed (for example, on the document table) and the other image data (for example, the image data before and after that), the position is determined. It can also be configured to identify that the document P is placed.
(II) Second Embodiment Next, a second embodiment which is another embodiment of the present invention will be described with reference to FIGS. FIGS. 8 to 10 are external perspective views respectively showing the schematic configuration of each example of the capture system according to the second embodiment. Further, in the hardware configuration of the smartphone according to the second embodiment, the same members as those of the smartphone S according to the first embodiment will be described using the same member numbers.

In the capture process of the capture system CS according to the first embodiment described above, only the document P is captured. In contrast, in each example of the capture system according to the second embodiment described below, the document P is captured together with other information projected on the document P.

That is, as shown in FIG. 8, as a first example, the capture system CS2-1 according to the second embodiment is a camera of a smartphone S supported by a stand ST similar to the capture system S according to the first embodiment. 9, the document P placed in the imaging range AR is imaged.

At this time, the smartphone S according to the second embodiment includes the projector 20 in addition to the camera 9. The projector 20 projects other projection information PJ to be captured together with the document P onto the document P when the document P is imaged, for example, by a laser method or another optical method. The projector 20 corresponds to an example of “projection unit” in the present invention. In this case, as an image projected onto the document P as the projection information PJ, for example, a ruled line used when writing on the document P, a style in which a portion to be written is blank, or reference at the time of writing It is an image including other figures, characters, etc. to be performed. As this projection information PJ, for example, information stored in advance in the ROM 2 of the smartphone S according to the second embodiment may be read and projected, or electronically externally via the recording medium or the communication interface 10. The image data or non-image electronic data generated at the same time may be acquired from the outside and projected.

Further, at the time of imaging, it can be configured to capture both at the timing when the projection information PJ is projected onto the document P (see step S6 in FIG. 3). In this case, only the information to be written by hand can be left on the document P, and the contents of the projection information PJ and the information written on the document P based on it are combined as an image to be captured. Captured images. In addition, the projection information PJ is only written on the document P that has been written in a state where the projection information PJ is projected after the projection of the projection information PJ is finished or temporarily interrupted. It can be configured to capture separately (see step S6 in FIG. 3). In this case, information written on the document P can be captured separately from the content of the projection information PJ to be referred to.

As a second example of the capture system according to the second embodiment, the projection information PJ is projected from the projector 20 arranged on the back side of the document P as in the capture system CS2-2 shown in FIG. You may comprise. In this case, if the document P is thin enough to allow the contents of the projection information PJ to be seen from the surface of the document P (the surface to be imaged), the same effect as the capture system CS2 shown in FIG. 8 can be obtained.

Furthermore, as a third example, as in the capture system CS2-3 shown in FIG. 10, for example, the projection information PJ is used to display the transparent sheet TS from the back side of the document P using the display device DD arranged on the back side of the document P. You may comprise so that it may project via. Also in this case, if the document P is thin enough that the contents of the projection information PJ can be seen from the surface of the document P, the same effect as the capture system CS2 shown in FIG. 8 can be obtained. As the display device DD at this time, for example, a liquid crystal panel or a so-called tablet computer can be used.

As described above, according to the operations of the capture systems CS2-1 to CS2-3 according to the second embodiment, in addition to the operational effects of the operation of the capture system CS according to the first embodiment, Since the image of the read projection information PJ is projected onto the document P and the image data output at the timing when the image is projected is captured, the document P is displayed while clarifying the relationship with the projection information PJ. Images can be recorded.

Further, since the image data corresponding to the document P on which the projection information PJ is projected and the image data corresponding to the document P while the projection is temporarily interrupted are captured, the projection ends. The image data corresponding to the written document P can be selectively recorded.
(III) Third Embodiment Next, a third embodiment which is another embodiment according to the present invention will be described with reference to FIG. FIG. 11 is an external perspective view showing a schematic configuration of the capture system according to the third embodiment. Moreover, in the hardware configuration of the smartphone according to the third embodiment, the same members as those of the smartphone S according to the first embodiment will be described using the same member numbers.

For example, in the capture process of the capture system CS according to the first embodiment described above, the document P is captured using a single camera 9. On the other hand, in the capture system according to the third embodiment described below, the imaging object is captured using a plurality of cameras.

That is, as shown in FIG. 11, the capture system CS3 according to the third embodiment is within the imaging range AR1 by the camera 9A of the smartphone S3 supported by the same stand ST as the capture system CS according to the first embodiment. In addition to imaging the placed imaging object PP, the imaging object PP placed in the imaging range AR2 is imaged by the camera 9B further provided in the same smartphone S3. In the smartphone S3 according to the third embodiment, the image captured by the camera 9A and the image captured by the camera 9B are combined by the CPU 1 to generate one combined image obtained by capturing the imaging target PP. Capture (ie, record in ROM 2). In this case, the imaged object PP can be captured in a higher image quality or in a wider range by combining images captured separately by the

separate cameras

9A and 9B.

In this case, the camera 9A and the camera 9B can be configured to change, for example, an imaging angle, a focus, a zoom degree, or an illuminance of a light (not shown) provided for each of the

cameras

9A and 9B. Thereby, even if the imaging target PP is a three-dimensional imaging target PP as illustrated in FIG. 11, the geometric correction of the imaging target PP is performed after recognizing the three-dimensional shape and arrangement thereof. It is possible to generate a composite image with improved accuracy. More specifically, for example, it is possible to generate a high-accuracy composite image by correcting the curvature of the surface or the like when a book with a thick imaging target PP is opened.

Furthermore, the CPU 1 compares images captured by the

cameras

9A and 9B (for example, images captured before and after time), and based on the comparison result, for example, due to vibration of the smartphone S3 itself. When it is detected that the camera 9A and the camera 9B have moved (blurred), the capture at that timing can be prohibited.

As described above, according to the operation of the capture system CS3 according to the third embodiment, in addition to the operational effects of the operation of the capture system CS according to the first embodiment, it corresponds to the same imaging target PP and is imaged. Since a composite image is generated by synthesizing a plurality of image data with different imaging conditions of the object PP, for example, the imaging object PP can be imaged in a three-dimensional manner, and the imaging object with higher image quality and higher accuracy. Image data corresponding to PP can be recorded.

It should be noted that by combining a plurality of pieces of image data having different focus depths as imaging conditions, it is possible to configure to capture an image that is in focus at each part of the entire imaging target PP. Further, in order to obtain a plurality of image data having different shooting conditions, it is not always necessary to use the plurality of

cameras

9A and 9B as in the third embodiment. Specifically, for example, a plurality of pieces of image data are picked up while changing the focus depth with one camera 9 and are combined to capture an image in which the focus or the like is matched in each part of the entire photographing target PP. You can also
(IV) Fourth Embodiment Finally, a fourth embodiment, which is another embodiment according to the present invention, will be described with reference to FIGS. FIG. 12 is a block diagram illustrating a schematic configuration of a smartphone included in the capture system according to the fourth embodiment, and FIG. 13 is a flowchart illustrating capture according to the fourth embodiment. FIGS. 14 to 16 are diagrams illustrating the alignment process according to the fourth embodiment. Furthermore, in the hardware configuration of the smartphone according to the fourth embodiment, the same members as those of the smartphone S according to the first embodiment will be described using the same member numbers.

For example, in the capture process of the capture system CS according to the first embodiment described above, a single camera 9 is used to capture a document P having a size that falls within the imaging range AR (FIG. 1A )reference). On the other hand, in the capture system according to the fourth embodiment described below, for example, one camera 9 is used to capture the document P having a size that does not fit in the imaging range AR (capture according to step S6 in FIG. 3). Then, after capturing for each part of the document P (a part having a size that fits within the imaging range AR), the original large document P is captured by combining the captured parts. In addition to this, even if the document P has a size that fits within the imaging range AR, capturing of the document P can be performed by generating a composite image by repeatedly capturing the image of each part over the entire document P. The fourth embodiment can also be applied when the image quality is improved as a whole. In the capture process according to the fourth embodiment, processes other than the capture according to step S6 are basically the same as the capture process according to the first embodiment (see FIG. 3). The detailed description of is omitted.

First, the configuration of the smartphone according to the fourth embodiment will be described with reference to FIG. As shown in FIG. 12, the smartphone S4 according to the fourth embodiment is similar to the smartphone S according to the first embodiment, the CPU 1, the ROM 2, the operation unit 4, the display 5, the communication control unit 6, the speaker 7, the microphone 8, and the camera. 9. A communication interface 10 including an antenna ANT and a light 11 are provided. In addition to this, in the RAM 3 of the smartphone S4 according to the fourth embodiment, the smartphone S according to the first embodiment is used as a buffer necessary for executing the capture processing according to the fourth embodiment centered on the CPU 1. In addition to the similar current image buffer 32, a composite image buffer 31 and a registered current image buffer 33 are formed as a volatile storage area.

Here, each buffer other than the current image buffer 32 in the RAM 3 will be specifically described.

First, the composite image buffer 31 sequentially stores image data corresponding to a composite image formed with high image quality / wide-range by the composite processing in the capture according to the fourth embodiment in accordance with the progress of the composite processing. Next, the aligned current image buffer 33 stores image data for one frame that is the target of the composition process after the alignment process in the image processing according to the fourth embodiment. Note that the current image stored in the current image buffer 32 according to the fourth embodiment is a target of alignment processing described later at that time.

Next, capture according to the fourth embodiment (corresponding to step S6 in the capture processing according to the first embodiment (FIG. 3)) will be specifically described with reference to FIGS. In the fourth embodiment, the composite image buffer 31 of the smartphone S4 is initialized to “zero” once at the start of the entire capture shown in FIG. 3 including the processing of the fourth embodiment.

Then, the compatibility of the image data stored in the current image buffer 32 at that time (see step S2 in FIG. 3) as the current image to be captured is the same as the processing in steps S3 to S5 shown in FIG. If determined, the CPU 1 starts the alignment process according to the fourth embodiment shown in FIG.

That is, as shown in FIG. 13, the CPU 1 performs the non-rigid positioning process according to the fourth embodiment using the image data stored in the current image buffer 32 (step S21). The alignment processing of the non-rigid body at this time compares the portion of the document P captured as the current image with the other portion of the document P captured first and stored in the composite image buffer 31. This is a process of aligning the current image so that the overlapping portions of the images are not discontinuous as an image but are joined together. More specifically, the positioning process will be described later with reference to FIGS. 14 to 16.

When the alignment processing of the non-rigid body with respect to the image data corresponding to the current image is completed (step S21), the CPU 1 stores the image data of the current image after the alignment processing in the aligned current image buffer 33 (step S22). ).

Next, the CPU 1 adds the image data in the aligned current image buffer 33 to the image data in the composite image buffer 31, and if there is an overlapping image area, for example, using an average value of pixel values or the like. The image quality is improved (step S23). By the process in step S23, the current image is added to the synthesized image synthesized so far. As a result, the area ratio of the composite image in the entire document P is enlarged, or the image quality of the corresponding part is improved. Thereafter, the CPU 1 confirms whether or not to end the generation of the composite image currently being combined according to the fourth embodiment (step S24). Specifically, as the end confirmation processing, for example, by confirming whether or not imaging of the current image has been completed for the preset number of times of imaging, if imaging for the number of times of imaging has been completed. It can be configured to end. In addition, for example, it may be terminated by a predetermined termination operation.

When the same composite image is continuously generated in the confirmation in step S24 (step S24; NO), the CPU 1 ends the capture according to the fourth embodiment, and proceeds to the same process as step S8 shown in FIG. To do. On the other hand, when the generation of the currently synthesized image is completed in the confirmation in step S24 (step S24; YES), the CPU 1 stores in the ROM 2 image data corresponding to the synthesized image stored in the synthesized image buffer 31 at that time. Recording (that is, capturing) (step S25), and after initializing the composite image buffer 31 (step S26), the process proceeds to step S8 shown in FIG.

Next, the non-rigid positioning process according to step S21 will be specifically described with reference to FIGS.

As described above, the alignment processing according to step 21 compares the portion of the document P captured as the current image with the composite image (image data stored in the composite image buffer 31), and both of them. This is a process of aligning (deforming) the current image so that the overlapping portions are not discontinuous as an image but are joined together. Here, in the examples shown in FIGS. 14 to 16, the composite image GA (image data stored in the composite image buffer 31) shown on the left of FIG. 14A is used as a reference image, and shown on the right of FIG. It is assumed that a non-rigid body alignment process is performed on the current image GT.

As the alignment process according to step S21, the CPU 1 first divides the current image GT into a predetermined number as illustrated in FIG. In the case illustrated on the right side of FIG. 14B, the current image GT is divided into four divided images GTa to GTd. However, the larger the number of divisions, the better in order to obtain higher image quality. Next, the CPU 1 pays attention to one divided image as illustrated in FIG. In the case illustrated in FIG. 14C, the CPU 1 focuses on the divided image GTa.

Next, as illustrated in FIG. 15A, the CPU 1 superimposes the divided image GTa of interest on the synthesized image GA synthesized up to that point. Note that the coordinate axes in FIG. 15 have the origin (0, 0) as the upper left corner of the area corresponding to each divided image in the composite image GA and the upper left corner of each divided image, and the right direction in FIG. The direction, the downward direction in FIG. 15, is the positive direction of the y coordinate axis. In FIG. 15A, when the divided image GTa is first superimposed on the composite image GA, the offset is (0, 0).

Thereafter, as illustrated in FIG. 15B, the CPU 1 searches for a position (offset) where the divided image GTa and the content best match in the composite image GA. In addition, in order to quantify the coincidence between the contents of images, for example, a method using mutual information (Mutual Information) or a target region (in the case of FIG. 15B, the region of the divided image GTa) A method using a sum of luminance differences (SAD (Sum （Absolute Difference)) is suitable. In the example of FIG. 15B, the CPU 1 obtains coordinate data (−2, +3) as the offset.

Thereafter, the CPU 1 similarly searches for a position (offset) in which the content of the divided images GTb to GTd other than the divided image GTa illustrated in FIG. In the case illustrated in FIG. 15C, in the case of the divided image GTa, the coordinate data (−2, +3) is used as the offset, and in the case of the divided image GTb, the coordinate data (+2, +3) is used as the offset. In this case, the coordinate data (+4, −1) is obtained by the CPU 1 as the offset, and in the case of the divided image GTd, the coordinate data (−3, −1) is obtained by the CPU 1 as the offset.

As a result of the series of processes described above, the amount by which the center point of each of the divided images GTa to GTd is to be moved as the alignment processing according to step S21 is exemplified as the above-mentioned offset on the right side of FIG. Obtained respectively. This center point may be generally called “anchor”.

In addition, alignment processing is performed so as to deform the entire current image GT as illustrated in FIG. 16 by so-called interpolation or extrapolation based on the amount of movement of the anchor of each of the divided images GTa to GTd. It is also possible to do this. In this case, the content of the current image GT and the content of the composite image GA can be matched more. Furthermore, movement or deformation (including rotation, enlargement / reduction, or trapezoid deformation) of the entire current image GT or the entire divided image GTa to the entire divided image GTd can be used.

As described above, according to the operation of the capture system according to the fourth embodiment, in addition to the operational effects of the operation of the capture system CS according to the first embodiment, a plurality of image data corresponding to the same document P is obtained. Since the combined image is generated and captured, image data corresponding to a higher quality image or a wide range of document P can be captured.

Note that, for example, a user shifts the document P between each capture, so that even the document P having a size that cannot be captured entirely by one capture can be captured with high image quality. That is, when the relative position between the camera 9 and the document P is appropriately changed during the preceding and following imaging, the image is higher than the images corresponding to the plurality of image data before and after the change corresponding to the same document P. Since a composite image with a high image quality or a wide range is generated, a composite image with higher image quality corresponding to the document P can be captured.
(V) Modifications The present invention can be applied in various ways other than the above-described embodiments.
(A) First Modification As a first modification, the document P to be imaged may be a document P on which personal information that personally identifies a person is described. In this case, even if the personal information is written on the document P, it does not flow out of the smartphone S, so that the personal information can be protected easily and reliably, and the personal information It is possible to save the trouble of entering or inputting a new one.
(B) As 2nd modification or 2nd modification, when one image data is captured, the event information which identifies the event linked | related with the said captured image data (namely, a meeting, a game, mountain climbing, etc.) Event information indicating an event associated with an image, and it is generally considered that the event information includes, for example, information indicating the date and place related to the event. Then, for example, it is configured to check whether or not the generated event information corresponds to the same event as any event information already recorded in the external event information management server or the ROM 2. When the event information does not correspond to the same event as any event information recorded in the event information management server or the like, the newly generated event information is recorded in the event information management server or the like. Can be configured. In this case, by easily generating and recording event information associated with the document P, the event information can be easily maintained and managed.

In the case of the second modification, the position of the camera 9 (smart phone S) when the image data is captured is detected using, for example, GPS (Global Positioning System), and the detected position is indicated. The event information may be generated by including position data. In this case, highly valuable event information can be easily maintained.
(C) Third modification Next, as a third modification, when one image data is captured, the person is associated with the captured image data and specifies an individual related to the captured image data. Whether information is automatically generated and whether the generated personal information corresponds to an individual indicated by any personal information already recorded in an external personal information management server or the like or in the smartphone S itself Are configured to match. When the personal information does not correspond to the individual indicated by any personal information recorded in the personal information management server or the like or in the smartphone S itself, the newly generated personal information is stored in the personal information management server. Etc., and can be configured to be recorded. In this case, the personal information related to the document P can be easily generated and recorded, so that the personal information can be easily maintained.

In the case of the second variation and the third variation, when one image data is captured, in addition to the event information and the personal information, a link for specifying the event and the individual indicated by them Information may be generated automatically. Specifically, for example, the attendance information indicating the participation when the individual specified by the personal information participates in the event indicated by the event information corresponds to the link information. The attendance information is recorded / stored in, for example, an attendance information management server or the like that is separate from the event information management server and the personal information management server. In addition to event information and personal information, the presence / absence of attendance information is collated with the event information management server, etc., the personal information management server, etc. and the attendance information management server, etc. It is configured so that the presence or absence is confirmed. As a result, if new event information (personal information or attendance information) is not recorded in the event information management server or the like (personal information management server or attendance information management server or the like), the association with the image data remains as it is. The new event information (personal information or attendance information) is newly recorded in an event information management server or the like (personal information management server or attendance information management server or the like). In contrast, if new event information (personal information or attendance information) is recorded in an event information management server or the like (personal information management server or attendance information management server or the like), the captured image data is associated. , Change to the recorded event information (personal information or attendance information). In this way, it is possible to associate a plurality of image data with one event information (personal information or attendance information). As a result, for example, associating a plurality of image data with one personal information, Information management of association of a plurality of image data to one event information, a plurality of attendees to one event, and attendance to a plurality of events of one individual becomes possible.
(D) Fourth Modification As a fourth modification , when it is identified that the document P is placed at a predetermined position, the image data output corresponding to the identified timing is For example, image data or character string data having the contents of advertisements may be added, or a part of the image data may be replaced and inserted, and image data to which the image data or character string data is added may be captured. In this case, the advertisement can be recorded together with the imaged information and can be referred to later, and further, the advertisement can be distributed as an image, so that the user can enjoy the service related to the present invention at a lower cost. .

In this case, at least a part of the image data output corresponding to the timing when it is identified that the document P is placed at the predetermined position is transmitted to an external image processing server or the like, and the transmitted image is transmitted. Based on the recognition result of the data content in the image processing server or the like, the image processing server may receive the image data to which the image data having the content of the advertisement is added and capture the image data. In this case, while reducing the processing load on the smartphone S, it is possible to record an advertisement together with the imaged information and refer to it later.

Also, unlike this, one or a plurality of image data having the contents of the advertisement is recorded in advance in the ROM 2 of the smartphone S, and output corresponding to the timing when the document P is identified as being placed at the predetermined position. The content of the recognized image data may be recognized by the CPU 1, and the image data having the content of the advertisement corresponding to the recognized content may be read from the ROM 2 and added. In this case, with the configuration completed in the smartphone S, it is possible to record an advertisement together with the imaged information and refer to it later.

On the other hand, the CPU 1 recognizes the content of the image data output corresponding to the timing at which it is identified that the document P is placed at the predetermined position, and transmits the recognition result to an external image processing server or the like. You may comprise so that the image data which have the content of the advertisement transmitted from the image processing server etc. based on the recognition result may be received and added. In this case, the advertisement can be recorded together with the imaged information and can be referred to later.

Furthermore, the present invention can be variously modified as follows.
-Stand ST which concerns on each embodiment can be set as the structure which can adjust an angle and height.
-It can comprise so that it may image | photograph by supplementing illumination with the light 11 of the smart phone S at the time of imaging.
The captured image can be geometrically corrected to form a general rectangular document image. In this case, the angle of the camera 9 with respect to the document P can be detected using an attitude sensor (acceleration sensor or gyro sensor) provided in the smartphone S, and this can be used for the geometric correction.
The stand ST and the document (notebook or the like) can be physically fixed with a clip or the like. In this case, if you move the document by hand, the stand will move with it.
-You may comprise so that a portable person may be notified by methods other than display, such as an audio | voice, light-emitting bodies, such as LED, or a vibration, at the moment when capture was performed automatically.
・ When deciding the position to place the document P, the recommended position to place the document P is presented by the light from the smartphone S or stand ST, the laser beam, or the display, and at the actual capture, it is optimal for the position of the document P Thus, the camera 9 can be configured to automatically adjust the zoom or swing angle of the camera 9.
It is possible to configure not only one document P but also a plurality of imaging objects (for example, small documents such as business cards) to be recognized and captured simultaneously.
The imaging object according to the present invention is displayed not only on the document P described in each embodiment, that is, paper, but also on a portable display device such as a slate personal computer or a display device of a so-called electronic book. It can be configured to take an image or the like.
-Further, identification information (character string such as a serial number) for identifying each image data at the time of capture, time information indicating when the image data was captured, or a place where the capture was performed It can be configured to record after embedding at least one of the location information as an image in the image data. In this case, when capturing image data, since at least one of identification information, time information, and location information is embedded as an image and recorded, the recorded image data can be easily identified. For example, when printing image data in which a character string “1234” (for example, a serial number) is captured in the past and embedded again with new writing in it, the serial of the captured printed material is captured. A number or the like (“1234”) is recognized by, for example, a character recognition function using an image as an input, and related to a character string such as “1234-2” (not related to, for example, “3456”, related A character string may be recorded after being embedded in newly captured image data. In this case, when it is recognized that another character string or the like is already included in the captured image data, a new character string or the like related to the other character string or the like is generated, and the image data Since the image is newly embedded and recorded, the image data obtained by performing the imaging a plurality of times can be reliably identified due to the relevance of the character string or the like.

It should be noted that the program corresponding to the flowcharts shown in FIGS. 3 and 13 is acquired via a network such as the Internet, or is recorded on an information recording medium such as an optical disk, for example, by a general-purpose microcomputer. It can also be configured to read and execute this. The microcomputer in this case executes the same processing as the CPU 1 according to each embodiment.

As described above, the present invention can be used in the field of image recording apparatuses. Particularly, when the present invention is applied to the field of image recording apparatuses that capture images captured by the camera 9, a particularly remarkable effect can be obtained. It is done. In addition, as described above, anytime, anywhere, anywhere, personal privacy and work-related information security at the highest level, and easy high-quality or wide-range image synthesis without the hassle. It can be carried out. This is an epoch-making value that was not available in previous devices.

1 CPU
2 ROM
3 RAM
4 Operation Unit 5 Display 6 Call Control Unit 7 Speaker 8

Microphone

9, 9A, 9B Camera 10 Communication Interface 20 Projector 31 Composite Image Buffer 32 Current Image Buffer 33 Aligned Current Image Buffer 4A, 4B, 4C Operation Buttons S, S3, S4 Smartphone P Document D Desk H Hand L Character BD Border DD Display device TS Transparency sheet PJ Projection information PT, PT1 Holding stand ST, ST2 Stand B Mounting stand PP Imaging object TB Transparency plate BS1, BS2, PT2, PT3 Supporting part LT Light AR, AR1, AR2 Imaging range CS, CS1, CS2-1, CS2-2, CS2-3, CS3 Capture system ANT Antenna GA Composite image GT Current image GTa, GTb, GTc GTd divided image

Claims

An imaging means in which a relative position with respect to an object placement position on which an imaging object is placed is fixed, and the object placement position on which the imaging object is not placed or the object placement position Imaging means for continuously imaging the placed imaging object and outputting imaging information corresponding to the object placement position or the imaging object for each imaging;
Identification means for identifying whether or not the imaging object is placed at the object placement position based on the output imaging information;
A recording means for recording the imaging information output corresponding to the identified timing on a recording medium when it is identified that the imaging object is placed;
An image recording apparatus comprising:
The image recording apparatus according to claim 1,
The identification unit is configured to detect the object mounting when a boundary between the imaging target and the periphery of the imaging target in the imaging information is identified based on the imaging information output from the imaging unit. An image recording apparatus that identifies that the imaging object is placed at a placement position.
The image recording apparatus according to claim 2,
An image recording apparatus, further comprising: a display unit configured to display a boundary line indicating the identified boundary in association with the imaging object in the imaging information when the boundary is identified.
The image recording apparatus according to claim 1,
The identifying means is based on the imaging information output from the imaging means, respectively, when a part or all of the imaging information is changed by a predetermined amount in time series, and thereafter, when it is identified that the change is lost, An image recording apparatus that identifies that the imaging target is placed at a target placement position.
The image recording apparatus according to claim 1,
The identification means is configured to block the object placement position of the placement table based on feature information indicating a feature of a portion corresponding to the object placement position of the placement table on which the imaging object is placed. When it is recognized that the imaging object is placed at the object placement position, the image recording apparatus is characterized.
The image recording apparatus according to claim 1,
The identification unit is configured to capture the image at the object placement position based on a difference between the imaging information corresponding to the object placement position where the imaging object is not placed and other imaging information. An image recording apparatus characterized by identifying that an object is placed.
In the image recording device according to any one of claims 1 to 6,
An image recording apparatus, further comprising notification means for sequentially notifying whether or not the imaging object is placed.
In the image recording device according to any one of claims 1 to 7,
Determining means for determining whether at least the imaging object in the imaging information is stationary for a predetermined time after it is identified that the imaging object is placed at the object placement position; ,
Control means for controlling the recording means so as to record the imaging information output in response to the determination that the imaging object is stationary for the predetermined time by the determination means;
An image recording apparatus comprising:
In the image recording device according to any one of claims 1 to 8,
Whether or not an object other than the imaging object is imaged within the range of the imaging object in the imaging information after it is identified that the imaging object is placed at the object placement position. Determining means for determining
When it is determined that the other object is imaged within the range of the imaging object in the imaging information, the imaging information output corresponding to the determined timing is recorded on the recording medium. Control means for controlling the recording means to prohibit;
An image recording apparatus comprising:
In the image recording device according to any one of claims 1 to 9,
The imaging object in the first imaging information recorded on the recording medium and the imaging object in the second imaging information output from the imaging means after the timing when the first imaging information is recorded on the recording medium Comparing means for each imaging,
When the imaging object in the first imaging information is the same as the imaging object in the second imaging information, the recording unit is configured to prohibit recording of the second imaging information on the recording medium. Control means for controlling
An image recording apparatus comprising:
In the image recording device according to any one of claims 1 to 10,
Projecting means for projecting an image of a related object related to the imaging object onto the imaging object;
An image recording apparatus that controls the recording unit to record the imaging information output from the imaging unit on the recording medium at a timing when the image is projected.
The image recording apparatus according to claim 11,
Both the imaging information corresponding to the imaging object on which the image is projected and the imaging information corresponding to the imaging object while the projection of the image is temporarily interrupted An image recording apparatus for controlling the recording means so as to perform recording.
The image recording apparatus according to any one of claims 1 to 12,
And further comprising combining means for combining the plurality of imaging information corresponding to the same imaging object to generate composite imaging information,
An image recording apparatus, wherein the recording unit is controlled to record the generated composite imaging information on the recording medium.
The image recording apparatus according to claim 13.
The synthesizing unit generates the composite imaging information by synthesizing a plurality of the imaging information corresponding to the same imaging object and having different imaging conditions of the imaging object. An image recording apparatus.
The image recording apparatus according to claim 13.
Based on a change in relative position between the imaging means and the imaging object between preceding and following imaging, the synthesizing means uses a plurality of the imaging information before and after the change corresponding to the same imaging object. An image recording apparatus that generates the composite image information corresponding to a composite image having a higher image quality or a wider range than images corresponding to the respective image information.
The image recording apparatus according to any one of claims 1 to 15,
The image recording apparatus, wherein the imaging object is an imaging object in which personal information for personally identifying a person is described.
The image recording apparatus according to any one of claims 1 to 16,
Event information generating means for generating event information that identifies an event associated with the recorded imaging information and related to the recorded imaging information when the imaging information is recorded on the recording medium;
Checking means for checking whether the generated event information corresponds to the same event as any event information already recorded in the event information recording means;
Transmitting means for recording the generated event information in the event information recording means when the generated event information does not correspond to the same event as any event information recorded in the event information recording means When,
An image recording apparatus further comprising:
The image recording apparatus according to claim 17,
When the generated event information corresponds to the same event as any event information recorded in the event information recording unit, the association destination of the imaging information associated with the generated event information is An image recording apparatus further comprising association changing means for changing to the event information of the same event.
The image recording apparatus according to any one of claims 1 to 18,
Personal information generating means for generating personal information that identifies an individual associated with the recorded imaging information and associated with the recorded imaging information when the imaging information is recorded on the recording medium;
Collation means for collating whether or not the generated personal information corresponds to an individual indicated by any personal information already recorded in the personal information recording means;
Transmitting means for recording the generated personal information in the personal information recording means when the generated personal information does not correspond to an individual indicated by any personal information recorded in the personal information recording means; ,
An image recording apparatus further comprising:
The image recording apparatus according to claim 19, wherein
When the generated personal information corresponds to an individual indicated by any of the personal information recorded in the personal information recording means, the association destination of the imaging information associated with the generated personal information is An image recording apparatus, further comprising association changing means for changing the personal information of the recorded individual.
The image recording apparatus according to any one of claims 1 to 20,
Link information generating means for generating link information specifying an individual and an event associated with the recorded imaging information and associated with the recorded imaging information when the imaging information is recorded on the recording medium;
Collation means for collating whether the generated link information identifies the same individual and event as any link information already recorded in the link information recording means;
When the generated link information does not specify an individual or event specified by any link information recorded in the link information recording unit, the generated link information is stored in the link information recording unit. Transmission means for recording;
An image recording apparatus further comprising:
The image recording apparatus according to claim 21, wherein
The imaging information associated with the generated link information when the generated link information specifies the individual and the event specified by any link information recorded in the link information recording means The image recording apparatus further comprises association changing means for changing the association destination to the recorded link information.
The image recording apparatus according to claim 17 or 18,
A position detection unit that detects a position of the imaging unit when the imaging information is recorded on the recording medium, and generates position information indicating the detected position;
The event information generating means generates the event information by including the generated position information.
The image recording apparatus according to any one of claims 1 to 23,
The image recording apparatus, wherein the image pickup means is an image pickup means provided in a portable information processing apparatus.
The image recording apparatus according to any one of claims 1 to 24,
The image recording apparatus is an image recording apparatus characterized in that the relative position is fixed by holding the image recording apparatus on a portable holder.
The image recording apparatus according to claim 24 or claim 25,
The imaging means is an imaging means in which the relative position is fixed by holding the image recording apparatus on a holder.
The holder is a holder that is assembled by folding a foldable sheet-like material, and is a holder that is unfolded into a sheet shape when carried and can be folded and assembled when used to hold the image recording apparatus. An image recording apparatus characterized by being a tool.
In the image recording device according to any one of claims 1 to 26,
When it is identified that the imaging object is placed at the object placement position, advertisement information having advertisement content is added to the imaging information output corresponding to the identified timing. An image processing means;
The image recording apparatus, wherein the recording unit records the imaging information to which the advertisement information is added on the recording medium.
The image recording apparatus according to claim 27, wherein
The image processing means includes
Imaging information transmitting means for transmitting at least a part of the imaging information output corresponding to the timing at which the imaging object is identified as being placed at the object placement position to an external information processing device;
Imaging information receiving means for receiving the imaging information to which the advertising information is added in the information processing device based on a recognition result in the information processing device of the content of the transmitted imaging information;
With
The image recording apparatus, wherein the recording unit records the received imaging information on the recording medium.
The image recording apparatus according to claim 27, wherein
The image processing means includes
Advertising information recording means for recording one or more of the advertising information in advance;
Recognizing means for recognizing the content of the imaging information output corresponding to the timing at which the imaging object is identified as being placed at the object placement position;
Reading means for reading out the advertisement information corresponding to the recognized content from the advertisement information recording means;
With
The image processing unit adds the read advertisement information to the imaging information whose contents are recognized.
The image recording apparatus according to claim 27, wherein
The image processing means includes
Recognizing means for recognizing the content of the imaging information output corresponding to the timing at which the imaging object is identified as being placed at the object placement position;
Recognition result transmission means for transmitting the recognition result by the recognition means to an external information processing device;
Advertising information receiving means for receiving the advertising information transmitted from the information processing device based on the transmitted recognition result;
With
The image processing means adds the received advertisement information to the imaging information whose contents are recognized.
The image recording apparatus according to any one of claims 1 to 30,
When recording the imaging information on the recording medium, the recording unit includes identification information for identifying each imaging information, time information indicating when the imaging object corresponding to the imaging information is captured, or the An image recording apparatus, wherein at least one of location information indicating a location where imaging has been performed is embedded as an image in the imaging information, and then the imaging information is recorded on the recording medium.
The image recording apparatus according to claim 31, wherein
When the recording unit recognizes that the other identification information is already included in the captured imaging information, the recording unit generates new identification information related to the recognized other identification information, and An image recording apparatus characterized by embedding and recording the generated new identification information in the imaging information to be recorded on the recording medium by imaging.
An imaging means in which a relative position with respect to an object placement position on which an imaging object is placed is fixed, and the object placement position on which the imaging object is not placed or the object placement position An image to be executed in an image recording apparatus including an imaging unit that continuously images the placed imaging object and outputs imaging information corresponding to the object placement position or the imaging object for each imaging In the recording method,
An identification step for identifying whether or not the imaging object is placed at the object placement position based on each of the output imaging information;
A recording step of recording the imaging information output corresponding to the identified timing on a recording medium when it is identified that the imaging object is placed;
An image recording method comprising:
An imaging means in which a relative position with respect to an object placement position on which an imaging object is placed is fixed, and the object placement position on which the imaging object is not placed or the object placement position A computer included in an image recording apparatus including imaging means for continuously imaging the placed imaging object and outputting imaging information corresponding to the object placement position or the imaging object for each imaging; ,
Identification means for identifying whether or not the imaging object is placed at the object placement position based on each of the output imaging information; and
Recording means for recording the imaging information output corresponding to the identified timing on a recording medium when it is identified that the imaging object is placed;
An image recording program which is made to function as:
An imaging means in which a relative position with respect to an object placement position on which an imaging object is placed is fixed, and the object placement position on which the imaging object is not placed or the object placement position A computer included in an image recording apparatus including imaging means for continuously imaging the placed imaging object and outputting imaging information corresponding to the object placement position or the imaging object for each imaging; ,
Identification means for identifying whether or not the imaging object is placed at the object placement position based on each of the output imaging information; and
Recording means for recording the imaging information output corresponding to the identified timing on a recording medium when it is identified that the imaging object is placed;
An information recording medium in which an image recording program that functions as an image recording medium is recorded so as to be readable by the computer.