JP2015142283A - Information processing terminal, data generation kit and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing terminal capable of performing desired processing on a captured image that is obtained by imaging a fetch object, without requiring much time and efforts, a data generation kit and a program.SOLUTION: The information processing terminal includes: an imaging part for fetching a plurality of fetch objects 3 disposed over a support surface 21 as a single entire image; an individual image generation part for generating a plurality of individual images by segmenting images corresponding to the fetch objects from the entire image fetched by the imaging part; and an information processing part for performing predetermined processing on the individual images generated by the individual image generation part. The entire image is obtained by imaging the support surface and the plurality of fetch objects in mutually different colors, and the individual image generation part binarizes the entire image, such that areas in which the fetch objects are placed can be clearly separated from areas in which the fetch objects are not placed.

Description

  The present invention relates to an information processing terminal used for the purpose of photographing business cards, handwritten memos, and other various objects to be captured and converting them into digital data, a data conversion kit including this information processing terminal as one element, and information processing The present invention relates to a program for causing a computer constituting a terminal to function.

  Recently, high-performance smartphones and tablet computers equipped with camera modules are becoming widespread. There is an increasing need to use these information processing terminals to photograph handwritten memos and notebooks in which meetings and business contents are recorded, business cards exchanged in business, and the like to be captured and utilized as digital data.

  Conventionally, how to process the captured image obtained by capturing the capture object in this manner in the information processing terminal is performed by operating the screen of the information processing terminal after capturing the capture object. (See, for example, Patent Document 1 below). For this reason, there has been an inconvenience that it takes time to operate the screen when desired processing is performed on a large number of objects to be captured.

JP 2002-271671 A

  An object of the present invention is to provide an information processing terminal, a data conversion kit, and a program capable of executing a desired process on a captured image obtained by capturing an object to be captured without taking time and effort. To do.

  The present invention employs the following configuration in order to solve the above-described problems. That is, the information processing terminal according to the present invention includes an imaging unit that captures a plurality of capture objects arranged on a support surface as a single entire image, and each capture object from the entire image captured by the imaging unit. An individual image generation unit that cuts out images corresponding to each of the images to form a plurality of individual images, and an information processing unit that executes a predetermined process for each individual image generated by the individual image generation unit The whole image is obtained by photographing the support surface and the plurality of capture objects having different colors, and the individual image generation unit binarizes the whole image. Thus, it is characterized in that the area where the capture object is placed and the area where the capture object is not placed are clarified.

  As a specific aspect of the information processing unit, an individual image of each capture target is stored in a folder in an information processing terminal specified by predetermined information, and a meta image specified by predetermined information is stored. Adding information to the individual image, sending the individual image as an e-mail to a destination address designated by predetermined information, uploading the individual image to a server designated by predetermined information, Of these, it is preferable to execute at least one process.

  In addition, as another information processing terminal of the present invention, an image capturing unit that captures an object to be captured arranged on a support surface as a single entire image, and an entire image captured by the image capturing unit is converted into an object to be captured. An individual image generation unit that cuts out a corresponding image into an individual image, and an information processing unit that executes processing based on the display attached to the capture target for the individual image generated by the individual image generation unit The entire image is obtained by photographing the support surface and the capturing object having different colors, and the individual image generation unit binarizes the entire image. , One that clarifies the area where the capture object is placed and the area where the capture object is not placed.

  As the data conversion kit of the present invention, the information processing terminal that captures and captures an object to be captured and a support that supports the capture object at the time of capturing are included as elements. It is preferable that it is a rectangular thing provided with the black support surface.

  Further, as a program according to the present invention, the computer constituting the information processing terminal may be configured to individually cut out images corresponding to each capture target from the entire image captured by the imaging unit, and make individual images. It is preferable to function as an image generation unit and an information processing unit that executes a predetermined process for each individual image generated by the individual image generation unit.

  Since the present invention is configured as described above, an information processing terminal and a data conversion kit capable of executing desired processing on a captured image obtained by capturing an object to be captured without taking time and effort. And programs can be provided.

The perspective view which shows the data conversion kit of one Embodiment of this invention. The front view of the support body in the embodiment. The figure which shows the hardware resource which the information processing terminal in the embodiment has. The functional block diagram of the information processing terminal in the embodiment. The figure which shows the example of the whole image image | photographed by the information processing terminal in the embodiment. The figure which shows the example of the whole intermediate image after carrying out the perspective transformation process of the whole image in the embodiment. The figure which shows the example of a procedure which carries out the perspective transformation process of the separate intermediate image in the same embodiment. 6 is an exemplary flowchart illustrating a procedure example of processing by the information processing terminal according to the embodiment. The figure which shows the screen displayed on the information processing terminal in the embodiment. The figure which shows the screen displayed on the information processing terminal in the embodiment. The figure which shows the screen displayed on the information processing terminal in the embodiment. The figure which shows the screen displayed on the information processing terminal in the embodiment. The figure which shows the screen displayed on the information processing terminal in the embodiment. The front view of the support body in which the acquisition subject in the modification of the present invention is arranged. The figure which shows the example of the setting information which prescribes | regulates the relationship between the information regarding the setting in the modification, and the process performed in an information processing terminal. The figure which shows the screen displayed on the information processing terminal in the modification. The front view of the support body by which the acquisition subject in other modifications of the present invention is arranged. The perspective view which shows the support body in the further another modification of this invention.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS.

  As shown in FIG. 1, the data conversion kit 10 of this embodiment includes an information processing terminal 1 that captures and captures a plurality of capture objects 3, and a support 2 that supports the capture objects 3 during the capture. Is the element.

  In the present embodiment, a plurality of business cards 3 (or small memo paper or the like) is assumed as the object 3 to be captured, and the support 2 has a sheet shape on which a plurality of business cards 3 can be arranged. Specifically, the support 2 shown in FIG. 2 is attached so as to be removable, for example, in an A4 size business card file, and includes a black support surface 21.

  On the support surface 21 of the support 2, characters 23 suggesting a usage pattern and ruled lines 24 on which a plurality of business cards 3 can be arranged and arranged are inconspicuous dark gray (photographing the support 2. It is printed in a gray color close to black to the extent that it is recognized as “black” when binarization processing described later is performed. The ruled line 24 can be used as a guideline when the business card 3 is placed on the support 2, and “black” or other various colors can be applied.

  Then, a plurality of business cards 3 are arranged on the support surface 21 of the support 2 so as not to overlap, and the entire support 2 is photographed by the information processing terminal 1 together with the business card 3 in this state. It is desirable to arrange a plurality of business cards 3 in an orderly manner along the ruled lines 24. However, the ruled lines 24 may be ignored and arranged. When photographing the support 2, it is desirable to photograph so that all the edges 22 of the support 2 fit within the photographing screen. The reason why the support surface 21 of the support 2 is set to black is to make the color of the business card 3 arranged on the support surface 21 different from the color of the support surface 21.

  The information processing terminal 1 incorporates a camera module 1i such as a mobile phone terminal, a smartphone, a portable video game machine, a personal computer (including a notebook computer, a tablet computer, a portable information terminal, etc.). Terminal or device. As shown in FIG. 3, the information processing terminal 1 is similar to a general-purpose computer in that a CPU (Central Processing Unit) 1a, a main memory 1b, an auxiliary storage device 1c, an operation input device 1d, an audio codec 1e, a video codec 1f, Hardware resources such as a communication interface 1g, a display 1h, a camera 1i, and the like are provided, and these are controlled by a controller (system controller, I / O controller, etc.) 1j to perform a cooperative operation.

  The auxiliary storage device 1c is a hard disk drive, a flash memory, an optical disk drive, or the like. The operation input device 1d is a touch panel that can be operated with fingers, a pointing device such as a track pad or a mouse, a push button (including a numeric keypad or a cursor key), a keyboard, and the like. The audio codec 1e decodes the encoded audio data and outputs the audio from the speaker, or encodes the audio collected via the microphone.

  The video codec 1f generates a screen to be displayed based on a drawing instruction received from the CPU 1a, and transmits a screen signal to the display 1i. The video codec 1f temporarily stores screen data. The video memory etc. Each of the audio codec 1e and the video codec 1f can be implemented as software instead of hardware.

  The communication interface 1g is a device for performing data communication via an electric communication line such as the Internet, a public telephone network, a mobile phone network, a WAN (Wide Area Network), a LAN (Local Area Network), and the like, and is an NIC (Network Interface). Card), a wireless LAN device, a Bluetooth (registered trademark) device, a wireless device for connecting to a mobile phone network, and the like. Other than these, an interface such as USB (Universal Serial Bus), IEEE 1394, or the like may be employed.

  The camera 1i is a known camera that uses an image sensor such as a CCD (Cahrage Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The camera 1i may be built in the information processing terminal 1 or may be externally attached to the information processing terminal 1 via an interface such as a USB.

  A program to be executed by the CPU 1a is stored in the auxiliary storage device 1c. When the program is executed, the program is read from the auxiliary storage device 1c into the main memory 1b and decoded by the CPU 1a. In this embodiment, a known OS (Operating System) program and various device driver programs attached thereto are installed in advance to mediate the use of the hardware resources by other programs. As application programs, an e-mail client program, a web browser program, a camera shooting control program, and the like are installed. In addition, programs necessary for configuring the data conversion kit 10 of the present embodiment are installed, and the computer which is the hardware resource is operated by these programs, and the imaging unit 11 illustrated in FIG. It functions as the image generation unit 12 and the information processing unit 13. Hereinafter, the function of each part will be described.

  The imaging unit 11 captures a plurality of business cards 3 arranged on the support surface 21 of the support 2 as a single whole image 4a shown in FIG. 5, and uses the camera module 1i to support the support 2 The entire support surface 21 is photographed at once. The entire image 4a including both the business card 3 and the support surface 21 is temporarily stored in a required storage area of the main memory 1b or the auxiliary storage device 1c. Note that the function of temporarily clicking the camera icon 51a on the home screen 51 (to be described later) to switch to the shooting mode and temporarily storing the entire image 4a obtained by shooting in the storage area is omitted because it is a normal function.

  When a so-called smartphone is used as the information processing terminal 1, a function for switching the screen display by 90 ° may be activated depending on the attitude of the information processing terminal 1, but a means for locking this function is provided. May be. Specifically, the information processing unit 13 includes a camera lock selection screen display unit that displays a camera lock selection screen 58 when the camera lock setting icon 50c on the shooting screen 50 shown in FIG. 12 is clicked. . When any one of the camera lock setting display fields 58a of the camera lock selection screen 58 is selected by clicking, the function is locked and the camera lock release setting display field 58b of the camera lock selection screen 58 is displayed. When selected by clicking, the function is unlocked.

  The individual image generation unit 12 cuts out an image corresponding to each capture object 3 from the entire image 4a captured by the imaging unit 11 to form a plurality of individual images 4b. The individual image generation unit 12 includes a plurality of arrangement areas 121 corresponding to the business cards 3, an external area 122 corresponding to the support surface 21 adjacent to the arrangement area 121, and the entire image 4 a captured by the imaging unit 11. It has a function of recognizing the outside-outline region 123 corresponding to the outside of the support surface 21 adjacent to the outside region 122.

  The individual image generation unit 12 first performs a first binarization process on the entire image 4 a to recognize the outer region 122 and the outer contour region 123, and determines the contour 125 of the outer region 122. Specifically, the entire image 4a is converted into a black and white image expressed in white and black by the binarization process, and the support surface 21, that is, the external region 122 appearing in the entire image 4a is expressed in black. The out-of-contour area 123 is expressed in white. Then, a perspective transformation process is performed on the pixels included in the outline 125 in the entire image 4a, and a plurality of business cards 3 are arranged on a rectangular support surface 21 whose distortion and inclination are corrected, as shown in FIG. An overall intermediate image 4c like this is obtained. In other words, the overall intermediate memory corresponding to the overall intermediate image 4c is secured at the stage where the outline 125 of the external region 122 is determined, and the pixels existing inside the outline 125 are subjected to a perspective transformation process to obtain the processed pixels. The entire intermediate image 4c is completed on the entire intermediate memory when the perspective transformation processing of the pixels in the outline 125 is completed.

  A second binarization process is performed on the entire intermediate image 4 c to recognize the arrangement area 121 and the external area 122. Based on this recognition result, a plurality of individual intermediate images 4d each including one arrangement area 121 are specified. Then, a perspective transformation process is performed on each individual intermediate image 4d, and each individual image 4b corresponding to each business card 3 is obtained. In other words, the individual intermediate memory corresponding to the individual intermediate image 4d is secured at the stage where the outline 124 of the arrangement area 121 is determined, and the pixels existing inside the outline 124 are subjected to a perspective transformation process, and the processed pixels are obtained. The individual images are sequentially stored in the individual intermediate memory, and the individual image 4b is completed on the individual intermediate memory when the perspective transformation processing of the pixels in the outline 124 is completed.

  As described above, in the final acquisition of the individual image 4b of each business card 3, it is necessary to correct the inclination and / or distortion of the image obtained by photographing with the imaging unit 11, and this correction is converted to perspective conversion. This is called processing. That is, in the entire image 4a captured by the user using the information processing terminal 1, the support 2 may be inclined with respect to the x axis (horizontal axis) or the y axis (vertical axis) of the entire image 4a. In addition, as illustrated in FIG. 5, the support 2 is not included in the entire image 4 a because the optical axis of the camera 1 i at the time of shooting is not orthogonal to the support 2 and the business card 3. It may be deformed from the original rectangular shape to a distorted shape.

  In order to correct these inclinations and distortions, the information processing terminal 1 uses the edge 22 (the outline 124 of the external region 122) of the support 2 in the whole image 4a temporarily stored in the main memory 1b or the auxiliary storage device 1c. Recognizing and performing so-called four-point correction, which is an affine transformation or projective transformation for an image constituted by pixels existing inside the edge 22 (outline 124). Thereby, the entire intermediate image 4c is obtained in which each side of the support 2 is not inclined with respect to the predetermined x-axis and y-axis, and each side draws a rectangular shape with a predetermined aspect ratio. In addition, after obtaining each individual intermediate image 4d from the whole intermediate image 4c, each individual intermediate image 4d is subjected to a perspective transformation process again to obtain each individual image 4b mainly on the rectangular support surface 21. This is because the business cards 3 are not always arranged neatly along the frame. In this case as well, processing similar to that described above is performed. The details of the process for correcting the tilt and distortion of the image can be the same as those in the existing method. FIG. 7 illustrates an individual image 4b after correction.

The information processing unit 13 executes a predetermined process for each individual image 4 b generated by the individual image generation unit 12. As an example of the predetermined process,
-The individual images 4b of the respective capture objects 3 are stored in a folder in the information processing terminal 1 designated by predetermined information.
Add meta information (tag) designated by predetermined information to the individual image 4b,
-Send the individual image 4b as an e-mail to a destination address designated by predetermined information,
Upload the individual image 4b to a server or a cloud service specified by predetermined information (for example, an information storage type Internet service such as “Dropbox (registered trademark)” or “Evernote (registered trademark)”),
-Send the individual image 4b to the application specified by the predetermined information,
The individual image 4b is transmitted to other information processing terminals, displays, output devices (printers, facsimiles, etc.) designated by predetermined information by communication means (for example, “Bluetooth (registered trademark)”, “Wi-Fi”). (Registered trademark) ", Internet, etc.)
Etc.

  More specifically, the information processing unit 13 displays, for example, a home screen display unit that displays a home screen 51 as illustrated in FIG. 9 and a setting icon 51b of the home screen 51, for example, as illustrated in FIG. When the action setting icon 52a on this setting screen 52 is clicked, a first action having a plurality of setting content display fields 53a as shown in FIG. 11, for example, is displayed. When the first action setting screen display section for displaying the setting screen 53 and the setting content display field 53a of any of the first action setting screens 53 are selected by clicking, the second action setting screen shown in FIG. And a second action setting screen display unit for displaying 54. The second action setting screen 54 includes a mail selection field 54a, a plurality of cloud service selection fields 54b, an album selection field 54c, and a tag addition selection field 54d for adding a tag. The information processing unit 13 further has a mail setting screen 55 having an information entry field 55a for a mail address as shown in FIG. 11 when the mail selection field 54a of the second action setting screen 54 is clicked. When the cloud service selection field 54b is clicked, the cloud service login display screen 56 has an information entry field 56a for automatic login to the cloud service as shown in FIG. And a login screen display unit for displaying.

  Further, the information processing unit 13 clicks on each of the selection fields 54a, 54b, 54c, 54d, and selects “mail”, “cloud services 1-5” corresponding to the selection fields 54a, 54b, 54c, 54d. ”,“ Save to Album ”,“ Tag ”, etc. are displayed in a specific setting content display field 53a of the first action setting screen 53 as shown in FIG. 12 (shown in FIG. 11). Information after selection in the selection fields 54a, 54b, 54c, 54d, etc., that is, information after completion of selection is displayed on the first action setting screen 53) Setting content display section and individual image In accordance with a mail transmission unit for automatically transmitting 4b to a predetermined address by e-mail and a login procedure in which the individual image 4b is set in advance, the cloud services 1-5 An upload unit that automatically uploads, an album storage unit that stores an individual image 4b in a preset album memory, and a tag addition unit that adds a tag set in advance to the individual image 4b as metadata. ing.

  Further, the information processing unit 13 displays a shooting screen display unit that displays a shooting screen 50 as shown in FIG. 12 and a first action setting screen 53 when the action setting icon 50b of the shooting screen 50 is clicked. And a shooting setting screen display section to be displayed.

  In addition, when the shutter icon 50a on the shooting screen 50 is clicked, the information processing unit 13 determines which setting content display field 53a is selected on the first action setting screen 53 and selects the selected one. The action execution part which performs automatically the action content currently displayed on the setting content display column 53a currently provided is provided. That is, a plurality of action contents can be preset and displayed in the setting contents display field 53a as shown in FIG. When a desired setting content display field 53a is selected, a check mark is displayed at the right end of the display field 53a. By performing such a selection operation, every time the individual image 4b is generated, the desired action content displayed in the setting content display field 53a is changed to the mail transmission unit, upload unit, album storage unit, tag addition unit. Any one or more of these are executed upon activation. Specifically, each individual image 4b is automatically sent by e-mail, uploaded to a cloud service, stored in an album, or tagged.

  When the individual image 4b of the business card 3 is stored in the auxiliary storage device 1c or the like of the information processing terminal 1, if a storage destination is not specified, a fixed storage destination directory or folder (file system provided by the OS or application program) (In other words, an image in which a plurality of business cards 3 are stored in a “business card folder” is stored). On the other hand, when the user designates a storage destination in advance, a directory or folder corresponding to the designation You may make it save to.

  When the individual image 4b of the business card 3 is transmitted as an e-mail or uploaded to a server, meta information or the like attached to the individual image 4b may be transmitted together with the individual image 4b.

  When uploading the individual image 4b of the business card 3 to the server, user account information for authenticating access authority, typically a user ID and password may be required. Such user account information is also stored in advance in the main memory 1b or the auxiliary storage device 1c of the information processing terminal 1 as setting information or as an instruction described in a program or script.

  In addition, the imaging unit 11, the individual image generation unit 12, and the information processing unit 13 (at least the home screen display unit, the setting screen display unit, the first action setting screen display unit, the first description) 2 action setting screen display unit, setting content display unit, mail transmission unit, upload unit, album storage unit, tag addition unit, action execution unit, shooting screen display unit, shooting setting screen display unit) The program may be stored in the main memory 1b or the auxiliary storage device 1c of the information processing terminal 1 so that it can be executed as appropriate.

  Next, the operation of the information processing terminal 1 will be described using the flowchart shown in FIG.

  First, it is set in advance how to process the digitized business card 3. That is, the setting icon 51b on the home screen 51 is clicked to display the setting screen 52, and the action setting icon 52a on the setting screen 52 is clicked to display the first action setting screen 53. Click one of the setting content display fields 53a displayed on the first action setting screen 53 to select it. Thereby, a check is displayed in the selected setting content display field 53a. That is, it is set in advance what kind of automatic action the individual image 4b obtained by digitizing each business card 3 is to be processed (step S1).

  After completing this setting operation, the screen returns to the home screen 51, and the camera icon 51a is clicked to shoot. Specifically, the business card 3 to be digitized is placed on the support 2 and the entire support 2 is photographed using the camera module 1i of the information processing terminal 1 in this state (step S2). That is, the information processing terminal 1 acquires the entire image 4a obtained by capturing the support 2 and the business card 3 with the camera module 1i.

  The whole image 4a stored in the auxiliary storage device 1c of the information processing terminal 1 by this shooting is corrected for the inclination and / or distortion of the image by the action of the individual image generation unit 12, and individually corresponding to each business card 3. The image is converted into an image 4b (step S3). That is, the whole image 4a is converted into a rectangular whole intermediate image 4c by the first binarization process and the perspective transformation process described above, and the whole intermediate image 4c is converted into the second binarization process and the second binarization process described above. Each image is converted into a rectangular individual image 4b corresponding to each business card 3 by the perspective conversion process.

At the stage when each individual image 4b is completed, a thumbnail display screen 57 as shown in FIG. 13 is displayed, and at the same time, the action content set in advance by the operation of the information processing unit 13 is executed (step S4). That is, for the individual image 4b of the business card 3, preset processing, for example, addition of meta information, transmission in the form of an e-mail, uploading to a server, saving to an album, etc. is performed. According to the setting contents of this embodiment shown in FIG.
-When the first column is selected, the e-mail is automatically transmitted by the function of the mail transmitting unit.
When the second field is selected, the individual image 4b is uploaded to the server of the cloud service 1 via the Internet by the function of the upload unit. Further, meta information corresponding to a preset tag is added to the individual image 4b.
When the third column is selected, the individual image 4b is stored in the album memory in the information processing terminal 1 by the action of the album storage unit.

  As described above, the information processing terminal 1 according to the present embodiment includes the imaging unit 11 that captures a plurality of capture objects 3 arranged on the support surface 21 as a single whole image 4a, and the imaging unit 11 includes: For each individual image 4b generated by the individual image generating unit 12 and the individual image generating unit 12 which cuts out images corresponding to the respective capturing objects 3 from the captured whole image 4a to form a plurality of individual images 4b. An information processing unit 13 that executes a predetermined process, and the entire image 4a includes the support surface 21 and the plurality of capture objects 3 having different colors. The individual image generation unit 12 binarizes the whole image 4a, and clears the region where the capture target 3 is placed and the region where the capture target 3 is not placed. It is to make. Since this is the case, the desired post-processing can be automatically performed after photographing the business card 3 that is desired to be converted into data and processed uniformly. In addition, the information processing terminal 1 (the information processing unit 13 thereof) detects four sides that are the outline 124 of the capture target 3 from the image obtained by photographing, and the x-axis of the detected image of each edge. And based on the inclination with respect to the y-axis, the inclination and distortion in the image of the support 2 and the capture object 3 that are subjects can be corrected. At this time, the information processing terminal 1 does not incline each edge of the capture object 3 detected on the entire image 4a or the individual intermediate image 4d with respect to the x-axis or y-axis of the image and captures each edge. An arithmetic process for performing affine transformation or projective transformation on the image is performed so as to draw a rectangular shape having a predetermined aspect ratio corresponding to the size of the object 3.

  Further, the information processing unit 13 according to the present embodiment stores the individual images 4b of the respective capture objects 3 in the folder in the information processing terminal 1 specified by predetermined information, and specified by predetermined information. The added meta information is added to the individual image 4b, the individual image 4b is sent as an e-mail to a destination address specified by predetermined information, and the server is specified by predetermined information. Since at least one of the uploading of the individual image 4b is executed, the individual image 4b obtained by photographing the capture object 3 is sorted and stored according to the user's option, or transmitted. And the destination can be controlled, and high convenience can be provided.

  The data conversion kit 10 of the present embodiment includes the information processing terminal 1 that captures and captures the capture object 3 and the support 2 that supports the capture object 3 at the time of capturing. And since the said support body 2 is a rectangular thing provided with the black support surface 21, the information processing terminal 1 which image | photographed the capture target 3 arrange | positioned on this support body 2 and the support body 2 (Information processing unit 13) can detect the edge of the capture object 3, that is, the outline 124 relatively accurately from the pixel value (color) of each pixel of the entire image 4a obtained by photographing. Only the portion of the capture target 3 that is captured along the line 124 can be cut out from the entire image 4a. That is, since the support 2 has a dark color (especially black, etc.) that is clearly different from the paper color of the business card 3 that is the object to be captured, a strict boundary between the arrangement area 121 and the external area 122 The business card 3 can be relatively freely arranged on the support 2 without the need for a mark for clearly displaying the symbol.

  In addition, the information processing terminal 1 according to the present embodiment can lock the function of switching the screen display by 90 ° according to the attitude of the information processing terminal 1. Therefore, in order to avoid the shadow of the information processing terminal 1 or the photographer from being reflected on the surface of the business card 3 at the time of shooting, even if the information processing terminal 1 is shot obliquely, the information processing terminal 1 The problem that the screen's portrait / landscape orientation switches inadvertently can be solved.

  The present invention is not limited to the embodiment described above.

  In the information processing terminal of the present invention, the information processing unit may execute a process based on a display attached to the capture target with respect to the individual image generated by the individual image generation unit. If it is such, it will also be possible to perform individual processing on the individual images of each business card photographed at once.

  As an example, as shown in FIG. 14, a mark column 31 is pasted on the surface of the capture target 3 in advance, and an action to be executed by filling a predetermined portion of the mark column 31 is set. The mark column 31 is for entering a value in binary notation, for example, referred to as “action marker”. The user attaches the mark column 31 to the object 3 to be captured such as a business card, and the “action marker” Mark the value in the field. The value of “action marker” indicates how an individual image corresponding to each business card 3 obtained by imaging the capture object 3 should be processed in the information processing terminal.

  The user activates application software on the information processing terminal, and photographs the capture object 3 in which the value of “action marker” is entered via the camera module. In this case, the information processing terminal reads the value of the “action marker” included in the individual image and performs processing corresponding to the value.

The relationship between the value entered in the mark field 31 and the content of the process to be executed on the captured image of the business card 3 is previously set as information (table) or as an instruction described in a program or script. Stored in the main memory or auxiliary storage device. FIG. 15 illustrates the relationship between the value of each mark field 31 and the processing content, and FIG. 16 includes a setting content display field 59a for setting the relationship between the value of each mark field 31 and the processing content. An example of the action marker setting screen 59 is shown. In this modified example, as processing contents, designation of meta information to be added to the individual image of the business card 3, designation of a destination address of the individual image of the business card 3 by e-mail transmission, a server ( (Not shown) is assumed. In accordance with the example shown in FIG.
If the value of the mark column 31 is 1, the meta information “work” is attached to the individual image of the business card 3 and the information processing terminal 1 (auxiliary storage device 1c) is attached with the meta information (tag for classifying the individual image). If the value in the mark column 31 is 2, the individual image of the business card 3 is added with meta information “private” and then stored in the information processing terminal, and the individual image is stored in the destination address “hogehoge @ Send in the form of e-mail to "mail.xxx"-If the value in the mark field 31 is 3, save it in the information processing terminal with the meta information "office work procedure" attached to the individual image of the business card 3 At the same time, the individual image is transmitted to the destination address “user@mail.yyy” in the form of an e-mail. In addition, for the external server (which may be a so-called cloud service) designated by the URI “www.xxxx.com/yy_user/”, the individual images are displayed in accordance with a predetermined communication protocol such as HyperText Transfer Protocol. If the value of the mark field 31 is 4, the meta information “business partner 1” is attached to the individual image of the business card 3 and stored in the information processing terminal 1, and the URI “www.zzz. The individual image is uploaded and transmitted to an external server designated by “jp / yy_user /” in accordance with a predetermined communication protocol.

  Note that the processing performed by reading the mark field attached to the business card and the processing performed by determining the processing after shooting on the setting screen as shown in the above-described embodiment may be performed simultaneously. In such a case, for example, when an individual image of a business card is stored in an auxiliary storage device or the like of the information processing terminal, the storage destination directory is determined according to meta information or the like based on a mark field attached to each business card. Alternatively, it is possible to determine a folder and sort the entire images of a plurality of business cards for each piece of meta information or the like in the information processing terminal. Even if there are a large number of business cards or the like to be converted into data, the desired post-processing can be automatically performed after shooting, and the troublesome work to be performed on the captured image as in the past is difficult. Can be reduced.

  In the above modification, the mark field 31 attached to the business card 3 or the like is provided as the information that defines the content of the process to be executed on the individual image of the capture object 3. In place of 31, an entry field 32 for handwritten patterns / characters as shown in FIG. 17, in other words, an entry field 32 for numbers and other character strings readable by OCR (Optical Character Recognition) in the information processing terminal, Or you may read the handwritten checkmark entry column 33 grade | etc., And perform an action. In these cases as well, setting and action execution may be performed in a manner according to the mark column 31 described above. In addition to this, a bar code, a two-dimensional code (QR code (registered trademark), etc.), a pattern, a dot pattern, a color, etc. are used to represent information that defines the content of processing to be executed. You may attach it. For example, when the color of the attachment is different, the processing executed in the information processing terminal is different.

  Needless to say, the capture object is not limited to a business card. Of course, handwritten notes, receipts, notebooks, loose leafs, handy whiteboards of portable size, postcards, letters, memorandums, etc. will be included. Conceivable. There may be cards to be used in games and games, and objects to be captured such as lotteries and winning betting tickets.

  The size of the object to be taken in varies from the size of business cards and memo papers to A4 and A3 (both are standard paper sizes according to ISO 216). Therefore, the dimensions of the support are not limited to those in the above embodiment.

  The support 2 is not limited to the paper for exclusive use of image capture as described above. For example, a so-called pocket file having a plurality of pockets 27 between the front cover 25 and the back cover 26 as shown in FIG. 28 may be sufficient. More specifically, these pockets 27 are mainly composed of a black plastic sheet 29 functioning as the support surface 21 and a transparent plastic sheet 20 overlapping the surface side of the plastic sheet 29. Each pocket 27 is set to a size that can accommodate a business card (not shown). If shooting is performed in a state in which the capture object is arranged on such a support 2, an effect according to the above-described embodiment can be obtained. The transparent plastic sheet is preferably made of a material that minimizes reflection of light or the like during photographing. In addition, it is preferable to adopt a file conforming to a file as disclosed in, for example, Japanese Patent Application Laid-Open No. 2011-104984 or Japanese Patent Application Laid-Open No. 2013-193443. It is possible to reduce the thickness during use, and it is possible to suppress the occurrence of a problem that a part of the cover swells in a state where a business card or a document is accommodated in each pocket. Of course, the file used as the support is not limited to this and can be variously changed.

  The material of the support is not limited to paper (thick paper, cardboard, etc.), and may be configured as a sheet or thin plate made of polypropylene or other resin (or plastic), and may be made of wood or cloth. As other specific modes of the support, for example, the upper surface of a desk or the surface of a personal computer can be considered.

  Further, the support surface and the object to be captured may have any color as long as they are different from each other. As described above, “the support surface is black and the object to be captured is white”. In addition to the case, the color may be other than black and white when the “support surface is white and the capture target is black”. That is, one color of the support surface and the capture target is a color that is recognized as “white” when the support and capture target are photographed and binarized, Various changes can be made as long as the other color of the capturing object is a color that is recognized as “black” when the support and the capturing object are photographed and binarized.

  The information processing terminal is not a general-purpose device such as a smartphone, a personal computer, or a scanner, but may be a dedicated machine.

  The individual image generation unit may be any one as long as an image corresponding to the capture target is cut out from the entire image captured by the imaging unit to form an individual image. Those that do not perform perspective transformation processing are also included. Further, the processing may be performed without recognizing the contour of the support, that is, the boundary between the outer region and the outer region. Furthermore, as described above, the image is captured in a state where the entire support is included, and not only when the edge of the support included in the entire image is an outer frame and the perspective conversion process is performed on the basis of the outer frame. The image is taken close to the support (the entire support is not included), and the edge of the object to be captured becomes the outer frame to perform a perspective conversion process etc. based on the outer frame. May be.

Various modifications can be considered for the processing to be executed by the information processing terminal. For example;
<As processing of captured images of captured objects>
Select or change the file format of the captured image (BMP, JPEG, GIF, PDF, PIX, etc.), select or change the resolution, change the number of colors (monochrome (monochrome) binarization, gray scale, etc.), color tone Change, sharpening and other image processing using filters, symbol images such as time stamps (obtainable from the timekeeping function of the information processing terminal) or seals (symbol images are stored in advance in the main memory or auxiliary storage device of the information processing terminal Is added to or superimposed on the captured image and the captured image is saved. It includes an identifier that specifies the file format, resolution, number of colors, color change, filter processing, etc. of the captured image in which the mark field is stored or transmitted, and the file format corresponding to the identifier in the information processing terminal, An image having the resolution and the number of colors is generated, and if necessary, color correction, filter processing, and other processes are performed on the image. Multiple shot images related to multiple capture objects shot using a support are stitched together into a single image file, or multiple pages (each shot image is a page) It is also possible to combine them into a single PDF or document file. <As processing related to the import object itself>
Extracting part or all of the text data displayed on the surface of the object to be captured by OCR reading, characteristic images and patterns (company name logo mark, etc.) displayed on the surface of the object to be captured , And further, classification of the captured image of the capture object based on the extracted text data, image or pattern (meta information, selection of storage directory, designation of transmission destination, etc.) processing <import target object Content of meta information added to captured images of>
Specification of information indicating the photographer, shooting location, and other shooting conditions. The mark field or the like includes an identifier for identifying a photographer, a shooting location, and the like, and meta information corresponding to the identifier is added to the shot image in the information processing terminal <As a process for outputting the shot image of the capture target>
Printing, writing to a specific recording medium, and taking a captured image data file with other application software (for example, image retouching software, document management software, PDF editing software, etc. Web application or SaaS (Software as a Service)) Open). The mark field or the like includes an identifier for designating hardware for outputting a photographed image or an application for opening a photographed image, and causes the information processing terminal to output the photographed image via hardware corresponding to the identifier, or the identifier For example, by opening an application corresponding to, and opening a captured image.

  In addition, various changes may be made without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 1 ... Information processing terminal 11 ... Imaging part 12 ... Individual image generation part 13 ... Information processing part 2 ... Supporting body 21 ... Support surface 3 ... Capture object 4a ... Whole image 4b ... Individual image 10 ... Data conversion kit

Claims (5)

An imaging unit that captures a plurality of capture objects arranged on a support surface as a single entire image;
An individual image generation unit that cuts out images corresponding to each captured object from the entire image captured by the imaging unit, and forms a plurality of individual images;
An information processing unit that executes a predetermined process for each individual image generated by the individual image generation unit,
The entire image is obtained by photographing the support surface and a plurality of capture objects having different colors, and the individual image generation unit binarizes the entire image so that the capture object is placed. An information processing terminal for clarifying the area where the object is placed and the area where the object to be captured is not placed. The information processing unit stores an individual image of each capture target in a folder in an information processing terminal designated by predetermined information, and adds meta information designated by predetermined information to the individual image. At least one process of transmitting the individual image as an e-mail to a destination address designated by predetermined information and uploading the individual image to a server designated by predetermined information. The information processing terminal according to claim 1 to be executed. An imaging unit that captures an object to be captured arranged on a support surface as a single whole image;
An individual image generation unit that cuts out an image corresponding to the capture object from the entire image captured by the imaging unit and makes an individual image;
An information processing unit that executes processing based on the display attached to the capture target for the individual image generated by the individual image generation unit,
The entire image is obtained by photographing the support surface and the capturing object having different colors, and the individual image generation unit binarizes the entire image, and the capturing object is placed. An information processing terminal that clarifies an area where an object to be captured is not placed and an area where an object to be captured is not placed. An information processing terminal according to claim 1, 2 or 3, which captures and captures an object to be captured, and a data conversion kit including a support that supports the object to be captured at the time of capturing,
A data conversion kit, wherein the support is rectangular with a black support surface. A computer constituting the information processing terminal according to claim 1,
An individual image generation unit that cuts out images corresponding to each capture object from the entire image captured by the imaging unit, and forms a plurality of individual images;
A program for functioning as an information processing unit for executing a predetermined process for each individual image generated by the individual image generation unit.

Images