JP5742545B2 - Image processing program, information processing apparatus, and image processing method - Google Patents

Description

  The present invention relates to an image processing program, an information processing apparatus, and an image processing method.

  Patent Document 1 discloses a document processing apparatus including a camera for photographing a user and a scanner that reads a document and generates a document file. The document processing apparatus automatically captures a user's face image with a camera, and transmits the captured face image and document file to a designated transmission destination. Therefore, the transmission destination apparatus can display a face image together with the document file and indicate the transmission source user to the transmission destination user.

JP 2004-056712 A

  However, when the user of the document processing apparatus and the transmission destination apparatus are the same person, even if the face image of the user photographed in the document processing apparatus is displayed on the transmission destination apparatus, it is not necessary to identify or manage the document file. There was a problem that it was not useful and did not contribute to the improvement of convenience.

  The present invention has been made in order to solve the above-described problems, and allows an original image based on read data read by a reading device to be browsed based on imaging data generated by a camera unit, which is convenient. An object is to provide a good image processing program, an information processing apparatus, and an image processing method.

To this end, the image processing program of the present invention, which is executed in an information processing apparatus, an image of an object specified by the user I by the camera unit provided in the information processing apparatus an imaging request unit for requesting an imaging data acquisition means for acquiring imaging data generated by the camera unit in response to the request of imaging by the imaging request unit, when the imaging is required by the imaging request unit, wherein A reading instruction transmission control means for transmitting a reading instruction of a document to a reading apparatus provided separately from the information processing apparatus via the communication unit, and the reading instruction transmitted according to the reading instruction transmission control means. a reading data obtaining means for obtaining read data read by the reading device via the communication unit, a read data obtained by the read data acquisition means, the read Associating means and storage control means for storing in the storage unit and the read data and the imaging data associated with the association means for associating the image pickup data obtained by the imaging data acquisition unit with a demand of imaging corresponding to the over data And a set of read data and imaging data stored in association with the storage unit by the storage control means , and a plurality of sets of original images based on the read data and stored in association with the read data. The information processing apparatus is caused to function as first display control means for displaying on a display unit in a manner associated with a captured image based on captured data .

  The present invention can be realized in various modes such as a control device that controls an information processing device, an image processing system, an information processing device, an image processing method, and a recording medium that records an image processing program.

According to the image processing program of claim 1, when a request for imaging the subject specified by the user is made by the imaging request means by the camera unit provided in the information processing apparatus, the camera unit generates the request in response to the imaging request. The acquired imaging data is acquired by the imaging data acquisition means. On the other hand, when an imaging request is made by the imaging requesting means, a document reading instruction is transmitted to the external reading device via the communication unit by the reading instruction transmission control means, and the reading apparatus responds to the reading instruction by the reading device. The read data that has been read is acquired by the read data acquisition means via the communication unit. The read data acquired by the read data acquisition unit is associated with the imaging data acquired by the imaging data acquisition unit in accordance with the imaging request corresponding to the read data by the association unit, and the associated read data and imaging data are associated with each other. Are stored in the storage unit by the storage control means. Then, with the read data and the image data stored in association with the storage unit as one set, a document image based on the read data for each of a plurality of sets, and a captured image based on the image data stored in association with the read data, Is displayed on the display unit by the first display control means in an associated manner. That is, the captured image displayed in a manner associated with the document image on the display unit by the first display control unit displays the captured image of the subject specified by the user as the captured image associated with the document image. Therefore, the user can find out a desired document image while remembering what captured image is associated with the document image. Therefore, the user can easily find a desired document image by using the captured image as a hand .

  According to the image processing program of the second aspect, in addition to the effect produced by the image processing program of the first aspect, the read data of the document image read by the reading device in response to the reading instruction corresponds to the reading instruction. Since encryption is performed based on the imaging data acquired in response to the imaging request, there is an effect that browsing by an unspecified number of document images based on the read data can be suppressed. The encrypted read data is decrypted based on the imaging data stored in the storage unit, and a document image based on the read data is displayed. Therefore, even if the read data is encrypted, the user can decrypt and browse based on the imaging data stored in the storage unit, which is advantageous in that it is convenient.

According to the image processing program of the third aspect, in addition to the effect produced by the image processing program according to the first or second aspect, a document image and a captured image displayed in a manner associated with the display unit by the first display control unit When at least one of the above is selected, the document image is displayed larger than the captured image on the display unit, so that it is easy to confirm whether the selected document is a desired document image .

  According to the image processing program of claim 4, in addition to the effect produced by the image processing program of claim 1, the read data read in response to a request for imaging and the imaging data generated in response to the request for imaging Is stored in the storage unit, and there is an effect that data management is easy.

  According to the image processing program of claim 5, since the read data is extracted from the image reading file and output to the output device, the output device outputs an image based on the read data, while the image based on the image data. Is not output. For example, an image based on imaging data may be used by a user as a clue to search for an image based on read data. In this case, it is highly likely that the user desires only the output of an image based on the read data out of the imaging data and the read data. According to the image processing program of the fifth aspect, in addition to the effect produced by the image processing program according to the fourth aspect, among the images based on the imaging data and the read data, the reading that is highly likely to be desired by the user is performed. Since only the image based on the data can be output, there is an effect that the convenience is good.

  According to the image processing program of the sixth aspect, since the read data is extracted as the processing target data from the image reading file and is output to the application received by the data output destination receiving means, the read data is stored in the application. Can be processed, while the imaging data is not processed. Therefore, according to the image processing program of the sixth aspect, in addition to the effect produced by the image processing program of the fourth or fifth aspect, the captured image data that is highly likely not to be desired by the user is output to the application. Thus, there is no need for the user to perform an operation such as stopping the processing of the captured image data, which is advantageous in that it is convenient.

  According to the image processing program of the seventh aspect, in addition to the effect produced by the image processing program according to any one of the first to sixth aspects, the application can be started in the information processing apparatus, Since imaging data is generated using a program, there is an effect that it is possible to suppress a burden required for development of an image processing program.

  According to the image processing program of claim 8, in addition to the effect of the image processing program according to any one of claims 1 to 7, it is requested to perform imaging at the lowest resolution that can be set in the camera unit. There is an effect that the amount of image data can be reduced.

  According to the image processing program of the ninth aspect, in addition to the effect of the image processing program according to the seventh aspect, the user is informed that the image processing program is being executed even while the reception screen is displayed by the imaging program. There is an effect that can be.

  According to the information processing apparatus of the tenth aspect, the same effect as that of the information processing apparatus that executes the image processing program according to the first aspect is obtained.

  According to the image processing method of the eleventh aspect, the same effect as that of the information processing apparatus that executes the image processing program according to the first aspect is obtained.

(A), (b) is a figure which shows typically the relationship between the portable terminal carrying the device control application of this invention, and the scanner which operate | moves by the instruction | indication from the portable terminal, (c) is a portable It is a block diagram which shows the electric constitution of a terminal and a scanner. It is a flowchart which shows the image generation process performed in a portable terminal. (A) is a flowchart which shows the camera imaging process performed in a portable terminal, (b) is a figure which shows an example of the operation screen displayed on LCD of a portable terminal. (A) is a flowchart which shows the image printing process performed in a portable terminal, (b) is a figure which shows an example of the joint file selection screen displayed on LCD of a portable terminal, (c), It is a figure which shows an example of the read image confirmation screen displayed on LCD of a portable terminal. It is a flowchart which shows the image sharing output process performed in a portable terminal. It is a flowchart which shows the mail transmission process performed in a portable terminal. (A) is a flowchart which shows the modification of the camera imaging process performed in a portable terminal, (b) is a figure which shows an example of the operation screen displayed on LCD of a portable terminal. It is a flowchart which shows the image generation process performed in the portable terminal of 2nd Embodiment. 10 is a flowchart illustrating document reading processing executed in the scanner of the second embodiment. It is a flowchart which shows the image printing process performed in the portable terminal of 2nd Embodiment.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIGS. 1A and 1B show a portable terminal 10 on which a device control application (hereinafter referred to as “this application”) 14b according to the first embodiment of the present invention is mounted, and instructions from the portable terminal 10 It is a figure which shows typically the relationship with the scanner 30 which operate | moves by. The portable terminal 10 has a camera 15 and is connected to the scanner 30 so as to be communicable.

  As illustrated in FIG. 1A, the application 14 b installed in the mobile terminal 10 causes the camera 15 to capture an image at the timing when the user inputs an imaging instruction of the camera 15, and corresponds to the captured image 81. Image data (hereinafter referred to as “captured image data”) is generated, a scan instruction is transmitted to the scanner 30, the original is read by the scanner 30, and image data (hereinafter referred to as “read image data”) corresponding to the read image 82 is generated. Generate.

  Next, as illustrated in FIG. 1B, the mobile terminal 10 acquires the read image data from the scanner 30 and associates the read image data with the captured image data generated by the camera 15. Specifically, the read image data generated by the scanner 30 based on the imaging instruction input by the user and the captured image data generated by the camera 15 based on the imaging instruction are included in one combined file. Associate each image data. For example, when the document bound to the file A is read by the scanner 30 and the appearance of the file A is captured by the camera 15, captured image data indicating the appearance of the file A and the document bound to the file A A combined file including the read image data indicating is generated.

  Thereby, when the user searches for the target read image 82 from among the plurality of read images 82, the captured image 81 can be searched for as a clue, so that the target read image 82 can be easily searched.

  FIG. 1C is a block diagram illustrating an electrical configuration of the mobile terminal 10 and the scanner 30. The mobile terminal 10, the scanner 30, and the printer 40 are connected to each other via an access point 50 so that data communication is possible. Each device 10, 30, 40 is connected to the Internet 60 via an access point 50.

  The mobile terminal 10 is a mobile phone that performs a voice call with another call device via a wireless base station (not shown). The portable terminal 10 includes a CPU 11, a ROM 12, a RAM 13, a flash memory 14, a camera 15, a wireless LAN transmission / reception unit 16, an operation key 17, a touch panel 18, an LCD 19, and a memory card interface (hereinafter referred to as “memory card I / F”). 20, a voice input / output unit 22 and a telephone network communication unit 23 are provided. These are connected to each other via a bus line 24 so that they can communicate with each other.

  The CPU 11 controls each unit connected to the bus line 24 according to a fixed value, a program, or the like stored in the ROM 12 or the like. The ROM 12 is a non-rewritable nonvolatile memory and stores various fixed values. The RAM 13 is a rewritable volatile memory.

  The flash memory 14 is a rewritable nonvolatile memory, and stores an OS 14a, the application 14b, and other applications (hereinafter, other applications) 14c. The OS 14a is basic software installed in the mobile terminal 10, and in the present embodiment, is assumed to be an Android (registered trademark) OS. The application 14b is an application for transmitting a scan instruction from the mobile terminal 10 to the scanner 30 and displaying a read image 82 and the like acquired from the scanner 30.

  The other application 14c includes an application preinstalled in the mobile terminal 10 and an application installed by the user. In the present embodiment, an application (hereinafter referred to as a camera application) for controlling the camera 15 provided in the mobile terminal 10 to perform imaging and generating a captured image file of the captured image is mounted as the other application 14c. It shall be.

  Hereinafter, the CPU 11 that executes a program such as an application (including the application 14b and other applications 14c) and the OS 14a may be simply described by a program name. For example, the description “application” may mean “CPU 11 that executes the application”.

  Each application (including the application 14b and other applications 14c) installed in the mobile terminal 10 calls the API of the OS 14a, and the camera 15, the wireless LAN transmission / reception unit 16, the operation key 17, the touch panel 18, the LCD 19, and the memory Data to be transferred to each component of the mobile terminal 10, such as the card I / F 20, the voice input / output unit 22, and the telephone network communication unit 23, is output to the OS 14a. That is, each application controls each component of the mobile terminal 10 by calling an API of the OS 14a. Each application calls the API of the OS 14a to acquire data output from each component of the mobile terminal 10 and data indicating the state of each component from the OS 14a. That is, by calling the API of the OS 14a, data indicating the state of each component of the mobile terminal 10 (including the state of operation input to the mobile terminal 10) is acquired from the OS 14a. In addition, the OS 14a may notify each application of data output from each component of the mobile terminal 10 or data indicating the state of each component periodically or whenever the state of each component changes. That is, each application acquires data indicating the state of each component of the mobile terminal 10 (including the state of operation input to the mobile terminal 10) from the OS 14a by receiving a notification from the OS 14a.

  The camera 15 is composed of a digital camera, performs imaging with an imaging device, and generates captured image data. The wireless LAN transmission / reception unit 15 connects the mobile terminal 10 and other devices via Wi-Fi (registered trademark) by a wireless LAN compliant with the IEEE 802.11b / g standard. The operation key 17 is a hard key, and inputs setting information and instructions to the mobile terminal 10. The touch panel 18 is provided over the LCD 19 and inputs setting information and instructions to the mobile terminal 10. The LCD 19 displays a list of icons indicating applications installed in the mobile terminal 10 and a screen of the activated application.

  The memory card I / F 20 is an interface to which a nonvolatile memory card 21 is attached, and controls writing or reading of data with respect to the memory card 21. The memory card 21 stores a combined file generated by the application 14b, a captured image file, and the like. The memory card 21 is an SD card (registered trademark) as an example. The voice input / output unit 22 is a voice input / output device composed of a microphone, a speaker, and the like, and the telephone network communication unit 23 is a circuit for performing telephone communication with other telephone devices.

  The scanner 30 includes a document reading program 30 a and reads a document based on a scan instruction sent from the mobile terminal 10 to generate read image data. The printer 40 prints an image based on the image data output from the mobile terminal 10.

  FIG. 2 is a flowchart showing an image generation process executed in the mobile terminal 10 in accordance with the application 14b. This process is a process for generating a combined file, and is executed when the application 14b is activated. The steps shown in the flowcharts of FIGS. 2, 3 (a), 4 (a), 5, 6, 7 (a), 8, and 10 described below are performed by the application 14 b on the CPU 11. It is assumed that it is executed.

  First, in the mobile terminal 10, when the application 14b is activated regardless of the other applications 14c (S1: No), the CPU 11 executes camera imaging processing (S2). This camera imaging process is a process for causing the camera 15 to generate a captured image based on an input of an imaging instruction by the user. Details will be described later with reference to FIG. Next, the CPU 11 acquires (reads) the captured image data generated in the camera imaging process (S2) (S3), and proceeds to S7. The camera imaging process will be described later with reference to FIG.

  On the other hand, the application 14b may be activated by the sharing function of the Android OS. The sharing function of the Android OS is a function for starting up another application via the OS 14a and transferring data between applications in order to process data output from one application by another application. Since the sharing function is a known technique, a detailed description is omitted.

  When the application 14b is selected as the output destination of data output by the other application 14c, that is, when the application 14b is activated by the sharing function of the OS 14a (S1: Yes), the CPU 11 passes through the OS 14a. The shared file to be passed is acquired (S4). In the present embodiment, it is assumed that the shared file is an image file. If the automatic scan start setting is invalid (S5: No) and no scan instruction is input by the user (S6: No), the process does not proceed to the next step until the scan instruction is input. The validity or invalidity of the automatic scan start setting is set in advance by the user when the application 14b is installed. On the other hand, if the automatic scan start setting is valid (S5: Yes), or if a scan instruction is input by the user (S6: Yes), the CPU 11 proceeds to S7.

  When the captured image data of the camera is acquired (S3), or when the shared file is acquired (S4) and the transmission condition of the scan instruction is satisfied (S5: Yes or S6: Yes), the CPU 11 A scan instruction is transmitted to the scanner 30 via the transmission / reception unit 16 (S7). On the other hand, when receiving the scan instruction, the scanner 30 reads the document and transmits the read image data to the portable terminal 10.

  The CPU 11 acquires (reads) the read image data transmitted from the scanner 30 (S8). Then, one combined file including the captured image data and the read image data is generated and associated with each other. Alternatively, one combined file including the image data of the shared file and the read image data is generated and associated with each other (S9). Next, the CPU 11 stores the generated combined file in the memory card 21 (S10), and ends this process.

  In the present embodiment, the combined file is a PDF file, and captured image data or image data of a shared file is stored as the data of the first page. The read image data is stored as data from the second page. The read image data is stored in page units so that the read image data corresponding to one original becomes one page of data in the combined file. Shall be stored.

  FIG. 3A is a flowchart showing a camera imaging process (S2) executed in the mobile terminal 10 in accordance with the application 14b. This process is a process for causing the camera 15 to generate captured image data used to generate a combined file based on an input of an imaging instruction by the user.

  First, the CPU 11 operates the camera 15 using a camera module (S31). The camera module is an API group for controlling the camera 15 and is provided as a function of the OS 14a. An application installed in the mobile terminal 10 instructs the camera 15 to perform initial setting, execution of imaging, and completion of imaging through the OS 14a by using the camera module. Hereinafter, it will be described that the API is used by the application when the camera 15 is controlled. Next, the CPU 11 sets the lowest resolution as the resolution used for imaging by the camera 15 (S32). Note that resolutions that can be selected by imaging with the camera 15 can be acquired by requesting the OS 14a. In S <b> 32, the CPU 11 transmits to the camera 15 a setting instruction for causing the camera 15 to perform imaging with the lowest resolution among the resolutions requested and acquired from the OS 14 a. Next, the CPU 11 displays an operation screen for the user to operate the camera 15 on the LCD 19 (S33). FIG. 3B is a diagram illustrating an example of the operation screen.

  As shown in FIG. 3B, the operation screen includes a captured image display area 70, an imaging button 71, and a cancel button 72. The captured image display area 70 is an area in which an image currently captured by the camera 15 is displayed. The imaging button 71 is a button for the user to input an imaging instruction of the camera 15.

  When the image capture button 71 is pressed, a request to acquire an image displayed in the captured image display area 70 as the captured image 81 is transmitted to the camera 15 at the timing of the press, and the camera 15 receives the request based on the request. Thus, captured image data of the requested image is generated. When the image capture button 71 is pressed, the image capture by the camera 15 is terminated and the operation screen displayed on the LCD 19 is closed. The cancel button 72 is a button for the user to stop imaging by the camera 15. When the cancel button 72 is pressed, the image generation process and the camera imaging process end.

  Here, it returns to description of Fig.3 (a). When the imaging instruction is not input on the operation screen (S34: No), the CPU 11 does not proceed to the next step until the imaging instruction is input. On the other hand, when an imaging instruction is input (S34: Yes), the CPU 11 transmits a request to acquire a captured image to the camera 15, causes the camera 15 to generate captured image data (S35), and ends this process. .

  The captured image data generated by the camera 15 is stored in the combined file together with the read image data. As will be described later with reference to FIG. 4, the image based on the captured image data only needs to function as a clue for the user to search for desired read image data, and has a resolution that allows the user to visually recognize what is being captured. If there is. Therefore, in the camera imaging process of the present embodiment, imaging is performed using the lowest resolution among the resolutions that can be selected by imaging by the camera 15, thereby reducing the data amount of the captured image data as much as possible and reducing the capacity of the memory card 21. I try not to.

  FIG. 4A is a flowchart showing an image printing process executed in the mobile terminal 10 in accordance with the application 14b. This process is started when the user requests printing of the read image data in the application 14b.

  First, the CPU 11 confirms the combined file existing in the memory card 21 (S41), and displays a combined file selection screen for allowing the user to select the found combined file on the LCD 19 (S42). FIG. 4B is a diagram illustrating an example of a combined file selection screen. In the present embodiment, there are two types of combined files: one that stores captured image data and read image data, and one that stores image data and read image data of a shared file. However, here, in order to make the explanation easy to understand, it is assumed that only the combined file storing the captured image data is stored in the memory card 21 among the two types of combined files.

  As shown in FIG. 4B, on the combined file selection screen, an index image 80 indicating the contents of the combined file is displayed for each combined file. The index image 80 is obtained by vertically connecting a captured image 81 based on captured image data stored on the first page of the combined file and a read image 82 based on read image data stored on the second page. .

  According to the combined file selection screen, the user can read the read image 82 based on the read data read by the scanner 30 in response to the imaging request based on the captured image data generated by the camera 15 in response to the imaging request. Can browse. That is, when the user stores that the scan instruction is transmitted from the portable terminal 10 to the scanner 30 using the imaging instruction as a trigger, the user displays the combined file selection screen to display the captured image data. The read image 82 based on the associated read image data can be browsed to find desired read image data quickly, which is convenient.

  Further, according to the combined file selection screen, the captured image 81 captured by the camera 15 in accordance with the input of the imaging instruction and the read image 82 read by the scanner 30 in accordance with the input of the imaging instruction are associated with each other. Therefore, when the user transmits a scan instruction for the read image 82 currently being searched for to the scanner 30, the user remembers what the camera 15 photographed and uses the captured image 81 as a clue. A desired read image 82 can be easily found.

  Returning to the description of FIG. When the index image 80 is not designated by the user on the combined file selection screen (S43: No), the CPU 11 does not proceed to the next step until the index image 80 is designated. On the other hand, when one index image 80 is designated by the user (S43: Yes), the CPU 11 confirms the read image for the user to confirm the detailed contents of the combined file corresponding to the designated index image 80. The screen is displayed on the LCD 19 (S44). FIG. 4C is a diagram illustrating an example of a read image confirmation screen.

  As shown in FIG. 4C, the read image confirmation screen includes a captured image 81, a read image 82, a print button 83, and a cancel button 84. In the read image confirmation screen, the read image 82 is displayed larger than the combined file selection screen so that the content can be easily confirmed, and the captured image 81 is displayed in a reduced size so that the content can be discriminated. . The print button 83 is a button for causing the printer 40 to print the read image 82 displayed on the read image confirmation screen, and the cancel button 84 is a button for closing the read image confirmation screen.

  Returning to the description of FIG. When the cancel button 84 is pressed on the read image confirmation screen (S45: No), the CPU 11 returns to the process of S42. On the other hand, when the print button 83 is pressed, that is, when a print start instruction is input (S45: Yes), the CPU 11 designates a combined file whose contents are displayed on the read image confirmation screen, that is, specified by the user. The read image data is extracted from the combined file corresponding to the index image 80 (S46), and the extracted read image data is output to the printer 40 via the wireless LAN transmission / reception unit 16 (S47). Exit.

  According to the image printing process, since the read image data is extracted from the captured image data and the read image data included in the combined file and output to the printer 40, the read image 82 is printed on the printer 40, and the captured image 81 is printed. Do not let me print. This is because the captured image 81 is used as a clue for the user to search for the read image 82, and the user may not want the printer 40 to print the captured image 81.

  FIG. 5 is a flowchart showing image sharing output processing executed in the mobile terminal 10 according to the application 14b. Note that the same steps as those in the image printing process shown in FIG. 4A are denoted by the same step numbers and description thereof is omitted. This process is started when the user requests to use the shared function in the application 14b. This process is a process of extracting the read image data from the combined file and outputting the read image data to the other application 14c as shared data. The other application 14c that is the output destination of the read image data includes, for example, an image editing application for editing the shared data, a mail application that attaches the shared data to an e-mail message, and transmits the mail. A printing application that causes the printer 40 to print the shared data.

  When one index image 80 is designated by the user on the combined file selection screen (FIG. 4B) (S43: Yes), the CPU 11 displays the read image 82 corresponding to the designated index image 80 in detail. The read image confirmation screen is displayed on the LCD 19 (S44). Although not shown, on the read image confirmation screen displayed here, a shared application designation button is displayed instead of the print button 83 shown in FIG. The shared application designation button is a button for the user to designate an application that shares the combined file (hereinafter, shared application) from among the other applications 14c. In the present embodiment, when the shared application designation button is pressed, the OS 14a is requested to use the shared function. As a result, the OS 14a causes the user to designate a shared application from the other applications 14c.

  When the cancel button 84 is pressed on the read image confirmation screen (S51: No), the CPU 11 returns to the process of S42. On the other hand, when the shared application designation button is pressed and the shared application is designated (S51: Yes), the CPU 11 extracts the read image data from the combined file whose contents are displayed on the read image confirmation screen (S46). Then, the extracted read image data is output to the shared application (S52), and this process is terminated.

  According to the image sharing output process, the scanned image data can be output to the shared application among the captured image data and the scanned image data included in the combined file. Therefore, the shared application processes the scanned image data and captures the captured image data. Is not processed. Therefore, in the shared application, the user does not have to perform an operation such as canceling the processing of the captured image data, which is convenient for the user.

  FIG. 6 is a flowchart showing a mail transmission process executed in the mobile terminal 10 according to the application 14b. Note that the same steps as those in the image printing process shown in FIG. 4A are denoted by the same step numbers and description thereof is omitted. This process is started when the user requests creation of an e-mail message in the application 14b. This process is a process of extracting the read image data of the combined file and attaching the image file corresponding to the read image data to an e-mail message.

  First, the CPU 11 displays an e-mail message creation screen on the LCD 19 (S61). If the attachment of an attached file is not instructed by the user (S62: No), the CPU 11 proceeds to S66. On the other hand, when the attachment of the attached file is instructed by the user (S62: Yes), the CPU 11 displays the combined file selection screen (FIG. 4B) on the LCD 19 (S42), and the index image is displayed on the combined file selection screen. When one 80 is designated by the user (S43: Yes), a read image confirmation screen on which the read image 82 corresponding to the designated index image 80 is displayed in detail is displayed on the LCD 19 (S44). Although not shown, in the read image confirmation screen displayed here, instead of the print button 83 shown in FIG. 4C, a combined file whose contents are displayed on the read image confirmation screen is designated as an attached file. An attachment file designation button is displayed.

  When the cancel button 84 is pressed on the read image confirmation screen (S63: No), the CPU 11 returns to the process of S42. On the other hand, when the attached file designation button is pressed and a combined file to be attached is designated (S63: Yes), the CPU 11 extracts the read image data from the joined file designated as the attached file (S64). The image file including the extracted read image data is attached to the mail (S65).

  If the user does not instruct the transmission of the e-mail (S66: No), the CPU 11 returns to S61 and continues to cause the user to input a message on the message creation screen. On the other hand, when the user is instructed to send an e-mail (S66: Yes), the CPU 11 uses the message input on the message creation screen or the image file attached to the e-mail as an e-mail to the wireless LAN transmission / reception unit 16. (S67), and this process is terminated. An example of a mail transmission destination is a mobile terminal 10 or a device such as a PC.

  According to the mail transmission process, an image file corresponding to the read image data out of the captured image data and the read image data included in the combined file can be attached to the mail. Therefore, the user himself / herself does not have to remove the captured image data from the combined file and attach it to the mail, which is convenient for the user.

  According to the first embodiment, the user causes the camera 15 to generate captured image data and transmits a scan instruction to the scanner 30 by a single operation of inputting an imaging instruction. The acquired image data and the read image data can be associated with each other. Furthermore, according to the combined file selection screen (FIG. 4B), the read image based on the read image data associated with the captured image data can be browsed on the LCD 19, which is highly convenient.

  Further, according to the first embodiment, the captured image data generated by the camera 15 in response to an imaging request and the read image data generated by the scanner 30 in response to the imaging request are combined into one combined file. By storing, they were related. Therefore, it is not necessary to associate the captured image data with the read image data using a table or the like, and data management is easy. Further, when displaying the combined file selection screen (FIG. 4B), the index image 80 can be generated from the first and second pages of each combined file, so the processing load is small.

  Further, according to the first embodiment, when the application 14b is activated by the sharing function of the OS 14a, the image data of the shared file output from the other application 14c installed in the mobile terminal 10, and the reading It can be associated with image data.

  Although the camera imaging process (FIG. 3) of the first embodiment has been described on the assumption that the control of the camera 15 is performed by the application 14b, the control of the camera 15 is controlled by a camera application that is one of the other applications 14c. It may be executed.

  FIG. 7 is a flowchart showing a camera imaging process according to a modification, and is a process executed instead of the camera imaging process shown in FIG.

  First, the CPU 11 designates the output destination of the captured image data and activates the camera application (S81). Specifically, the OS 14a is requested to start the camera application as an external program of the application 14b. As a result, the OS 14a activates the camera application. Further, it requests the OS 14a to set the output destination of the image data output from the camera application. Thereby, the OS 14a sets the output destination of the image data of the camera application. In the present embodiment, description will be made assuming that the memory card 21 is designated as the output destination of the captured image data.

  Next, the CPU 11 causes the LCD 19 to display a caution display 73 for allowing the user to recognize that the camera application is being executed as an external program (S82). When the camera application is activated, a screen dedicated to the camera application and an operation screen for the user to operate the camera 15 is displayed on the forefront of the LCD 19.

  FIG. 7B is a diagram illustrating an example of an operation screen dedicated to the camera application. The operation screen dedicated to the camera application includes, for example, a captured image display area 70, an imaging button 71, and a cancel button 72. When the imaging button 71 is pressed, the camera application transmits a request to the camera 15 for acquiring the image displayed in the captured image display area 70 at the timing of the pressing as the captured image 81. That is, irrespective of the control of the application 14b, the camera application alone transmits a request for acquiring the captured image 81 to the camera 15.

  However, the caution display 73 illustrated in FIG. 7B is displayed under the control of the application 14b. Thus, the application 14b displays the caution display 73 during execution of the camera application, so that the user can recognize that the camera application is called and executed from the application 14b. Therefore, it is possible to suppress operation mistakes such as a user misunderstanding that the camera 15 is performing normal shooting.

  When the imaging by the camera 15 is completed, the captured image data of the captured image 81 captured by the control of the camera application is output from the camera application, and the output captured image data is stored in the memory card 21 by the OS 14a. . When the imaging is completed, the camera application is terminated by the OS 14a, and the OS 14a notifies the present application 14b of the termination of imaging by the camera application. When the end of imaging by the camera application is not notified (S83: No), the CPU 11 does not proceed to the next step until the end of imaging is notified. On the other hand, when the end of imaging is notified (S83: Yes), the CPU 11 ends this process.

  When the modification shown in FIG. 7 is employed, the user can operate the operation screen of a camera application with good operability or familiarity, and can perform imaging with the camera 15, which is convenient. In addition, since another camera application installed in the mobile terminal 10 can be used to capture an image with the camera 15, a program for controlling the camera 15 need not be developed and incorporated into the application 14b. The burden required for the development of 14b can be suppressed.

  Next, a second embodiment will be described with reference to FIGS. In the first embodiment, including the captured image data generated by the camera 15 and the read image data generated by the scanner 30 in one combined file associates the captured image data with the read image data. It was equivalent. On the other hand, in the second embodiment, encrypting the read image data generated by the scanner 30 based on the captured image data generated by the camera 15 associates the captured image data with the read image data. It corresponds to. Since the electrical configuration of the second embodiment is the same as that of the first embodiment, illustration and description thereof are omitted.

  FIG. 8 is a flowchart showing image generation processing executed in the mobile terminal 10 according to the application 14b of the second embodiment. The application 14b of the second embodiment executes the image generation process shown in FIG. 8 instead of the image generation process (FIG. 2) of the first embodiment. Of the image generation processing shown in FIG. 8, the same parts as those of the image generation processing (FIG. 2) are denoted by the same step numbers, and the description thereof is omitted.

  When the captured image data generated by the camera 15 is acquired (S3), or when the shared file is acquired (S4) and the transmission condition of the scan instruction is satisfied (S5: Yes or S6: Yes), the CPU 11 The captured image data or the image data of the shared file is stored in the memory card 21 (S91). Next, the CPU 11 transmits a scan instruction to the scanner 30 (S92). The scanner 30 starts reading a document based on a scan instruction.

  Next, the CPU 11 instructs the scanner 30 to encrypt the read image data by transmitting the captured image data stored in the memory card 21 or the image data of the shared file to the scanner 30 (S93). This process ends. As described above, in the present embodiment, the request for encrypting the read image data (encryption instruction) is transmitted to the scanner 30 by transmitting the captured image data or the image data of the shared file to the scanner 30.

  FIG. 9 is a flowchart showing document reading processing executed by the scanner 30 in accordance with the document reading program 30a of the second embodiment. This process is started when a scan instruction transmitted from the mobile terminal 10 is received.

  The scanner 30 reads a document, generates read image data (S100), and receives image data (that is, captured image data or image data of a shared file) transmitted from the mobile terminal 10 ( In step S101, a password is generated from the received image data (S102). Since a method for generating a password from image data is publicly known, description thereof is omitted. Next, the scanner 30 encrypts the generated read image data using the generated password (S103). Next, the scanner 30 generates an encrypted file including the encrypted read image data, uploads the encrypted file to a predetermined folder of the server (not shown) (S104), and ends this processing. .

  As described above, according to the second embodiment, since the read image data is encrypted and uploaded to the server, it is possible to suppress reading of the read image 82 corresponding to the read image data by an unspecified number. . In addition, when the user needs the read image data, the user only needs to acquire the read image data from the read image data server. Therefore, the user need not always store the read image data, and the amount of data stored in the mobile terminal 10 can be suppressed. .

  FIG. 10 is a flowchart illustrating an image printing process executed in the mobile terminal 10 according to the application 14b of the second embodiment. The application 14b of the second embodiment executes the image printing process shown in FIG. 10 instead of the image printing process (FIG. 4) of the first embodiment. In the image printing process shown in FIG. 10, the same steps as those in the image printing process (FIG. 4) are denoted by the same step numbers, and the description thereof is omitted.

  First, the CPU 11 confirms an encrypted file existing in a predetermined folder of a server (not shown) (S111), and displays an encrypted file selection screen for allowing the user to select one of the found encrypted files. (S112). Although not shown, on the encrypted file selection screen, for example, a list of file names of the encrypted files is displayed, and one of the file names is designated by the user.

  Next, when the file name of the encrypted file is not designated by the user on the encrypted file selection screen (S113: No), the CPU 11 does not proceed to the next step. On the other hand, when the file name is designated by the user (S113: Yes), the CPU 11 acquires (downloads) the encrypted file having the designated file name from the server (S114). The downloaded encrypted file is stored in the memory card 21. Next, the CPU 11 causes the LCD 19 to display an image data selection screen for allowing the user to select image data used for decrypting the read image data included in the encrypted file (S115). Although not shown, on the image data selection screen, for example, thumbnail images of each image data (including captured image data) existing in the memory card 21 are displayed, and one of the thumbnail images is designated by the user. . When a thumbnail image is designated, it is assumed that image data corresponding to the thumbnail image is designated by the user as image data used for decoding.

  When the image data used for decoding is not designated by the user on the image data selection screen (S116: No), the CPU 11 does not proceed to the next step. On the other hand, when one image data is designated by the user (S116: Yes), the CPU 11 generates a password from the designated image data (S117). The password is generated in the same manner as the processing in S102 of FIG.

  Next, the CPU 11 decrypts the read image data included in the encrypted file using the generated password (S118), and causes the LCD 19 to display a read image confirmation screen (see FIG. 4C) (S44). On the read image confirmation screen of the second embodiment, an image corresponding to the decoded read image data is displayed as a read image 82, and an image corresponding to the image data used for decoding is displayed as a captured image 81. .

  When the cancel button 84 is pressed on the read image confirmation screen (S45: No), the CPU 11 returns to S112. On the other hand, when the print button 83 is pressed, that is, when a print start instruction is input (S45: Yes), the CPU 11 reads the read image data (that is, decodes) of the read image 82 displayed on the read image confirmation screen. The converted read image data) is output to the printer 40 (S119), and this process ends.

  According to the image printing process of the second embodiment, the read image data included in the encrypted file can be decrypted and output to the printer 40, so that the decrypted read image 82 can be printed on the printer 40.

  Moreover, since the captured image data (or image data included in the shared file) necessary for decoding the read image data is stored in the memory card 21 of the mobile terminal 10, the user of the mobile terminal 10 is necessary for the decoding. Image data can be freely distributed to a specific person. Therefore, even when the read image data is encrypted and uploaded to the server, the read image data can be easily shared by a plurality of people.

  In addition, if the user hands over the captured image data used for encryption to a specific person in advance, the specific person can also use the captured image data to encrypt the encrypted file. Can be read and the read image 82 can be browsed.

  In the above embodiment, the scan instruction is an example of a document reading instruction. The read image data is an example of read data. The captured image data is an example of the captured data. The request for encrypting the read image data is an example of an instruction to encrypt the read data. The combined file is an example of an image reading file. The scanner 30 is an example of an external device. The other application 14c is an example of an application that can be activated in the information processing apparatus. A camera application is an example of an imaging program. An operation screen dedicated to the camera application is an example of a reception screen. The mobile terminal 10 is an example of an information processing device. The device control application 14b is an example of an image processing program. The printer 40, the PC, and the mobile terminal 10 are examples of output devices.

  The camera 15 is an example of a camera unit. The wireless LAN transmission / reception unit 16 is an example of a transmission unit. The memory card 21 is an example of a storage unit. The LCD 19 is an example of a display unit. However, each unit such as the camera unit, the transmission unit, the storage unit, and the display unit may be hardware alone or hardware that operates by executing a program other than the present invention such as the program or operating system of the present invention. good. Each unit such as a camera unit, a transmission unit, a storage unit, and a display unit may be hardware that operates by combining a plurality of programs.

  CPU11 which performs S2 is an example of an imaging request | requirement means and an imaging request | requirement step. CPU11 which performs S3 is an example of an imaging data acquisition means and an imaging data acquisition step. CPU11 which performs S7 is an example of a read instruction transmission control means and a read instruction transmission control step. CPU11 which performs S9 or S92, S93 is an example of an association means and an association step. CPU11 which performs S10 or S91, S114 is an example of a storage control means and a storage control step. CPU11 which performs S42 or S44 is an example of a 1st display control means or a 1st display control step. The CPU 11 that executes S8 is an example of the read data acquisition unit. The CPU 11 that executes S46 is an example of the read data extraction unit. CPU11 which performs S47 and S67 is an example of a data transmission control means. CPU11 which performs S51 is an example of a data output destination reception means. CPU11 which performs S52 is an example of a data output means. The CPU 11 that executes S82 is an example of the second display control means.

  Although the present invention has been described based on the embodiments, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be easily made without departing from the spirit of the present invention. Can be inferred.

  For example, in the above embodiment, the mobile terminal 10 is an example of an information processing device, but various devices such as a personal computer, a PDA, a tablet terminal, and a digital camera can also be examples of the information processing device. Moreover, the specific numerical value quoted by the said embodiment is an example, and it is naturally possible to employ | adopt another numerical value.

  Moreover, in the said embodiment, each step shown to the flowchart of FIG.2, FIG.3 (a), FIG.4 (a), FIG.5, FIG.6, FIG.7 (a), FIG.8, FIG. However, the application 14b may cause the CPU 11 to execute each step using a function such as the OS 14a. 2, 3 (a), 4 (a), 5, 6, 7 (a), 8, and 10 include steps executed by the OS 11 a and other applications. A part may be replaced with a step. Moreover, a part realized by the operation of the hardware provided in the mobile terminal 10 regardless of the CPU 11 may be replaced.

  In the image generation process (FIGS. 2 and 8) of the above embodiment, after the camera imaging process (S2) is completed, a scan instruction is transmitted to the scanner 30 (S7, S92). A scan instruction may be transmitted before the process is executed or while the camera imaging process is being executed.

  In the above-described embodiment, the minimum resolution is set as the resolution used for imaging by the camera 15 in the camera imaging process (FIG. 2). However, the captured image captured by the camera 15 after the imaging by the camera 15 is completed. 81 may be processed, and the resolution of the captured image 81 may be lowered to the lowest resolution or a lower resolution.

  Further, in the above embodiment, when the user presses the imaging button 71 on the operation screen dedicated to the application 14b or the camera application (FIGS. 3B and 7B), the imaging of the camera 15 is performed. Although it has been described that an instruction is input, an imaging instruction may be input when the operation key 17 (hard key) is pressed.

  Further, in the camera imaging process described with reference to FIG. 7, when the application 14 b executes the camera application as an external program, a caution display 73 for causing the user to recognize that is provided for the camera application only. It has been described as being displayed on the operation screen (FIG. 7B). However, as the attention display 73, a mark indicating the application name of the application 14b or a mark indicating the name of the provider of the application 14b may be displayed. Thereby, this application 14b can make a user recognize that the camera application is being executed as an external program.

  Further, in place of the caution display 73 or in addition to the caution display 73, the operation screen of the application 14b is displayed on the entire screen, and an operation screen dedicated to the camera application is displayed on the front of the operation screen of the application 14b. It may be displayed with a smaller occupied area. Even in this case, the user can recognize that the application 14b is executing the camera application as an external program.

  Moreover, in the said 1st Embodiment, it demonstrated as what produces | generates a joint file with the portable terminal 10. FIG. However, the combined file may be generated by the scanner 30 and the combined file may be acquired by the mobile terminal 10. In that case, transmitting the captured image data from the portable terminal 10 to the scanner 30 and instructing the generation of the combined file corresponds to associating the read image data with the captured image data.

  In the first embodiment described above, the combined file is described as a PDF file. However, the file is not limited to the PDF format, and any other file may be used as long as it can store a plurality of pages in one file. It may be a file of the data format. For example, a multi-page TIFF format file may be used.

  In the first embodiment, the index image 80 is described as an image obtained by connecting the captured image 81 and the read image 82 in the vertical direction. However, the index image 80 may be displayed in association with each other. You may display by connecting in the left-right direction.

  In the first embodiment, each image data is associated by including the captured image data or the image data of the shared file and the read image data in one combined file. It may be stored as an individual image file, and each image file may be associated using a table or the like.

  In the second embodiment, the scanned image data is encrypted and the encrypted file is generated by the scanner 30. However, the portable terminal 10 may perform encryption and generation of the encrypted file. . In that case, the portable terminal 10 acquires the read image data from the scanner 30, encrypts the read image data based on the captured image data generated by the camera 15, and generates an encrypted file. Then, the encrypted file is uploaded to the server.

  In the second embodiment, the encrypted file encrypted by the scanner 30 is uploaded to the server. However, the encrypted file may be stored in the scanner 30, or transmitted to the portable terminal 10 and transmitted to the portable terminal. 10 may be stored. Similarly, when an encrypted file is generated by a device other than the scanner 30, it may be stored in the scanner 30 or the portable terminal 10.

  In the second embodiment, the encrypted file is decrypted by the portable terminal 10. However, the decrypted read image data may be acquired by the portable terminal 10 by causing the server or the scanner 30 to perform decryption. good. In that case, the mobile terminal 10 transmits the captured image data used for the decryption to the server or the scanner 30, and further transmits the file name of the encrypted file to be decrypted. On the other hand, the server or scanner 30 acquires the transmitted encrypted file with the file name from the server and decrypts it using the transmitted captured image data. Then, the decoded read image data is transmitted to the mobile terminal 10.

  Also, the image file including the read image data decrypted in the second embodiment may be output to the shared application as in the first embodiment, or may be output attached to the mail.

  Further, in the image generation process (FIG. 8) of the second embodiment, the camera imaging process shown in FIG. 7 may be executed.

  Further, although the application 14b of the present embodiment has been described as operating on an Android (registered trademark) OS, the application 14b may be operated on another OS such as Windows (registered trademark) or Linux (registered trademark). good.

  In the image generation process (FIG. 8) of the second embodiment, the captured image data or the image data of the shared file is transmitted to the scanner 30 (S93), thereby requesting encryption of the read image data (encryption). Encryption request) is transmitted to the scanner 30, but an encryption request for requesting (instructing) the scanned image data to be encrypted (provided) to the scanner 30 is newly provided, and the encryption request is sent to the scanner 30 separately from the processing of S93. Or may be included in the processing of S92 and S93. In this case, the scanner 30 starts to encrypt the read image data in response to the reception of the read image data encryption request. In this case, the request for encrypting the read image data corresponds to an instruction for encrypting the read data.

  In the above embodiment, the combined file, the encrypted file, the captured image data, and the image data of the shared file are stored in the memory card 21, but may be stored in the RAM 13. Alternatively, the RAM 13 and the memory card 21 may be distributed and stored. In that case, the RAM 13 or the memory card 21 corresponds to a storage unit.

In the above embodiment, a scan instruction is transmitted to the scanner 30 via the wireless LAN transmission / reception unit 16 (S7, S92), or a request for encrypting read image data is transmitted to the scanner 30 (S93). The read image data is output to the printer 40 (S47), or an e-mail attached with the read image data is transmitted (S67). However, other communication such as a USB interface or an infrared communication interface is transmitted to the portable terminal 10. An interface may be provided, and a scan instruction, an encryption request, read image data, an e-mail, or the like may be transmitted (output) through the interface. In that case, the other communication interface corresponds to the transmission unit.
<Others>
<Means>
An image processing program described in the technical idea 1 is executed in an information processing apparatus, and includes an imaging request unit that requests imaging by a camera unit provided in the information processing apparatus, and imaging by the imaging request unit.
An imaging data acquisition unit that acquires imaging data generated by the camera unit in response to the request, and when imaging is requested by the imaging request unit, an instruction to read a document is transmitted to the reading unit to the transmission unit Reading instruction transmission control means for reading, reading data read by the reading device in response to a reading instruction to be transmitted to the transmission unit by the reading instruction transmission control means, and imaging data acquired by the imaging data acquisition means Associating means for associating, storage control means for storing the read data and imaging data associated by the associating means in the storage unit, and a document image based on the read data stored in the storage unit by the storage control means, The information processing apparatus is caused to function as first display control means to be displayed on the display unit.
The image processing program described in the technical idea 2 is the image processing program described in the technical idea 1, in which the associating unit is read by the reading device in accordance with a reading instruction transmitted to the transmitting unit by the reading instruction transmission control unit. The read data of the original document image is encrypted based on the imaging data acquired with the imaging request corresponding to the reading instruction, or the imaging acquired with the imaging request to the external device Data and an instruction for encrypting the read data based on the imaging data are transmitted to the transmission unit, and the first display control unit adds the encrypted read data to the imaging data stored in the storage unit. A document image based on the read data associated with the image data based on the read data generated by decoding based on the read data It is intended to be displayed on the display unit as.
The image processing program described in the technical idea 3 is an image processing program described in the technical idea 1 or 2, in which the reading instruction is transmitted by the reading device in response to a reading instruction transmitted to the transmission unit by the reading instruction transmission control unit. The information processing apparatus is made to function as read data acquisition means for acquiring data, and the association means is acquired with a request for imaging corresponding to the read data acquired by the read data acquisition means and the read data The first display control means associates each image of the read data and the imaging data associated by the association means and displays them on the display unit.
The image processing program described in the technical idea 4 is the image processing program described in the technical idea 1, in which the read data read by the reading device is read according to the reading instruction transmitted to the transmission unit by the reading instruction transmission control unit. The information processing apparatus is made to function as read data acquisition means to be acquired, and the association means reads the read data acquired by the read data acquisition means and the imaging data acquired in response to an imaging request corresponding to the read data Is generated, and the storage control unit stores the imaging read file generated by the association unit in the storage unit. .
The image processing program described in the technical idea 5 is the image processing program described in the technical idea 4, wherein the information processing device is connected to an output device that outputs an image corresponding to the processing target data, and the imaging read file Read data extraction means for extracting read data from the read data extraction control means, and data transmission control means for causing the output device to transmit the read data extracted by the read data extraction means to the output unit as the processing target data. Make the device work.
The image processing program described in the technical idea 6 is an image processing program described in the technical idea 4 or 5, in which any one of applications that can be activated in the information processing apparatus is received as an output destination of processing target data. A destination receiving unit, a reading data extracting unit for extracting reading data from the image reading file, and an application received by the data output destination receiving unit with the reading data extracted by the reading data extracting unit as the processing target data The information processing apparatus is caused to function as data output means for outputting to the computer.
The image processing program according to the technical idea 7 is the image processing program according to any one of the technical ideas 1 to 6, wherein the imaging request unit is based on the camera unit among applications that can be activated in the information processing apparatus. An imaging program that is capable of imaging and is an application other than the image processing program is executed.
The image processing program according to the technical idea 8 is the image processing program according to any one of the technical ideas 1 to 7, wherein the imaging request unit is the lowest of the resolutions of the captured images that can be set in the camera unit. It is requested to perform imaging at a resolution.
The image processing program described in the technical idea 9 accepts an instruction for imaging by the camera unit when the imaging program is executed by the imaging request unit in the image processing program described in the technical idea 7 As the second display control means for causing the display unit to display information indicating that the image processing program is being executed in a state in which a reception screen for displaying is displayed on the display unit by the imaging program, the information processing Make the device work.
The information processing apparatus described in the technical idea 10 includes a camera unit capable of imaging, an imaging request unit that requests imaging by the camera unit provided in the information processing apparatus, and imaging by the imaging request unit An imaging data acquisition unit that acquires imaging data generated by the camera unit in response to the request, and when imaging is requested by the imaging request unit, an instruction to read a document is transmitted to the reading unit to the transmission unit Reading instruction transmission control means for reading, reading data read by the reading device in response to a reading instruction to be transmitted to the transmission unit by the reading instruction transmission control means, and imaging data acquired by the imaging data acquisition means Association means for associating, storage control means for storing the read data and imaging data associated by the association means in the storage unit, and the storage control means Said original image based on the read data stored in the storage unit, and a first display control means for displaying on the display unit by unit.
The image processing method described in the technical idea 11 is executed in an information processing apparatus, and includes an imaging request step for requesting imaging by a camera unit provided in the information processing apparatus, and imaging processing by the imaging request step. An imaging data acquisition step for acquiring imaging data generated by the camera unit in response to a request, and when imaging is requested by the imaging request step, causes the reading device to transmit a document reading instruction to the transmission unit The reading instruction transmission control step associates the reading data read by the reading device according to the reading instruction to be transmitted to the transmission unit by the reading instruction transmission control step with the imaging data acquired by the imaging data acquisition step. The association step, and the read data and the imaging data associated by the association step are stored. To include a storage control step of storing a document image based on the read data stored in the storage unit by the storage control step, and a first display control step of displaying on the display unit.
<Effect>
According to the image processing program described in the technical idea 1, a reading instruction is transmitted to the reading device in response to a request for imaging, and an original image based on the read data read in accordance with the reading instruction corresponds to the request for imaging. It is associated with the imaging data generated by the camera unit. Then, a document image based on the read data associated with the imaging data is displayed on the display unit. Therefore, the user can view a document image based on the read data read by the reading device in response to the imaging request based on the imaging data generated by the camera unit in response to the imaging request, which is convenient. There is an effect.
According to the image processing program described in the technical idea 2, in addition to the effects produced by the image processing program described in the technical idea 1, the read data of the original image read by the reading device in accordance with the reading instruction is included in the reading instruction. Since encryption is performed based on the image data acquired in accordance with the corresponding imaging request, there is an effect that browsing by an unspecified number of document images based on the read data can be suppressed. The encrypted read data is decrypted based on the imaging data stored in the storage unit, and a document image based on the read data is displayed. Therefore, even if the read data is encrypted, the user can decrypt and browse based on the imaging data stored in the storage unit, which is advantageous in that it is convenient.
According to the image processing program described in the technical idea 3, in addition to the effects produced by the image processing program described in the technical idea 1 or 2, the read data read according to the request for imaging and the request for the imaging Since each image with the generated imaging data is displayed in association with the display unit, the user can search for desired read data using the image of the imaging data as a clue.
According to the image processing program described in the technical idea 4, in addition to the effects produced by the image processing program described in the technical idea 1, the read data read according to the imaging request and the data generated according to the imaging request Since an image reading file including image data is stored in the storage unit, there is an effect that data management is easy.
According to the image processing program described in the technical idea 5, since the read data is extracted from the image reading file and output to the output device, the output device outputs an image based on the read data, while the image data is based on the image data. No image is output. For example, an image based on imaging data may be used by a user as a clue to search for an image based on read data. In this case, it is highly likely that the user desires only the output of an image based on the read data out of the imaging data and the read data. According to the image processing program described in the technical idea 5, in addition to the effects produced by the image processing program described in the technical idea 4, it is possible that the user may desire to output among the images based on the imaging data and the read data. Since only an image based on high read data can be output, there is an effect that convenience is good.
According to the image processing program described in the technical idea 6, since the read data is extracted as the processing target data from the image reading file and is output to the application received by the data output destination receiving unit, the read data is included in the application. While the imaging data is not processed. Therefore, according to the image processing program described in the technical idea 6, in addition to the effect produced by the image processing program described in the technical idea 4 or 5, captured image data that is highly likely not to be desired by the user is output to the application. After that, there is no need for the user to perform an operation such as stopping the processing of the captured image data.
According to the image processing program described in the technical idea 7, in addition to the effect produced by the image processing program described in any of the technical ideas 1 to 6, the image processing program is an application that can be activated in the information processing apparatus and is not an image processing program. Since the imaging data is generated using the imaging program, it is possible to reduce the burden required for developing the image processing program.
According to the image processing program described in the technical idea 8, in addition to the effect produced by the image processing program described in any of the technical ideas 1 to 7, it is requested to perform imaging at the lowest resolution that can be set in the camera unit. Therefore, there is an effect that the amount of image data can be reduced.
According to the image processing program described in the technical idea 9, in addition to the effects produced by the image processing program described in the technical idea 7, the user is informed that the image processing program is being executed even while the reception screen is displayed by the imaging program. There is an effect that can be notified.
According to the information processing apparatus described in the technical idea 10, the same effect as that of the information processing apparatus that executes the image processing program described in the technical idea 1 can be obtained.
According to the image processing method described in the technical idea 11, the same effect as that of the information processing apparatus that executes the image processing program described in the technical idea 1 is obtained.

10 Mobile terminal 14b Device control application 15 Camera 30 Scanner 40 Printer 80 Index image 81 Captured image 82 Read image

Claims (11)

An image processing program executed in the information processing apparatus,
An imaging request unit for requesting imaging of the subject specified by the user I by the camera unit provided in the information processing apparatus,
Imaging data acquisition means for acquiring imaging data generated by the camera unit in response to a request for imaging by the imaging request means;
A reading instruction transmission control means for transmitting a reading instruction of a document via a communication unit to a reading apparatus provided separately from the information processing apparatus when imaging is requested by the imaging request means;
Read data acquisition means for acquiring read data read by the reading device in response to a read instruction transmitted by the read instruction transmission control means via the communication unit;
Association means for associating the read data acquired by the read data acquisition means with the imaging data acquired by the imaging data acquisition means in response to a request for imaging corresponding to the read data ;
Storage control means for storing the read data and imaging data associated by the association means in a storage unit;
The reading control and imaging data stored in association with the storage unit by the storage control unit are taken as one set, and a document image based on the reading data for each of a plurality of sets, and the imaging data stored in association with the reading data An image processing program for causing an information processing apparatus to function as first display control means for displaying on a display unit in a manner associated with a captured image based on . The association means includes
The reading taken data read by the reading device in accordance with the read instruction to be transmitted via the communication unit by the reading instruction transmission control unit, based on the imaging data acquired with a demand of imaging corresponding to the reading instruction Or the image data acquired in response to the imaging request and the read data encryption instruction based on the imaging data are transmitted to the external device via the communication unit .
The first display control means includes
A document image based on the read data generated by decrypting the encrypted read data based on the image data stored in the storage unit is used as a document image based on the read data associated with the image data. The image processing program according to claim 1, wherein the image processing program is displayed on the display unit. When at least one of the document image and the captured image displayed in a manner associated with the display unit is selected by the first display control unit, the document image is displayed on the display unit to be larger than the captured image. The image processing program according to claim 1, wherein the information processing apparatus is caused to function as a confirmation display unit. Before Symbol associated with means,
A read data obtained by the reading data acquisition unit, by generating an image reading file including an image pickup data obtained with a demand of imaging corresponding to the read data, which associates the read data and the imaging data And
The storage control means
The image processing program according to claim 1, wherein the image reading file generated by the association unit is stored in the storage unit. The information processing device is connected to an output device that outputs an image corresponding to the processing target data,
Read data extraction means for extracting read data from the imaging read file;
The information processing apparatus is made to function as data transmission control means for transmitting the read data extracted by the read data extracting means as the processing target data to the output device via the communication unit. Item 5. The image processing program according to Item 4. A data output destination accepting means for accepting any of the applications that can be activated in the information processing apparatus as an output destination of the processing target data;
Reading data extraction means for extracting reading data from the imaging reading file;
The information processing apparatus is caused to function as data output means for outputting the read data extracted by the read data extracting means as the processing target data to an application received by the data output destination accepting means. Item 6. The image processing program according to item 4 or 5. The imaging request means is
2. An application that can be activated in the information processing apparatus and capable of imaging by the camera unit and that executes an imaging program that is an application other than the image processing program. The image processing program according to any one of items 6 to 6. The imaging request means is
The image processing program according to any one of claims 1 to 7, wherein the image processing program requests to perform imaging at the lowest resolution among resolutions of a captured image that can be set in the camera unit.   When the imaging program is executed by the imaging request unit, the image processing program is executed in a state where a reception screen for receiving an imaging instruction by the camera unit is displayed on the display unit by the imaging program. The image processing program according to claim 7, wherein the information processing apparatus is caused to function as second display control means for displaying information indicating that the information is being displayed on the display unit. In an information processing apparatus provided with a camera unit capable of imaging,
An imaging request unit for requesting imaging of the subject specified by the user I by the camera unit provided in the information processing apparatus,
Imaging data acquisition means for acquiring imaging data generated by the camera unit in response to a request for imaging by the imaging request means;
And when the imaging is required, the read instruction transmission control means for reading instructions of a document to be transmitted via the communication unit to the reading device by the imaging request unit,
Read data acquisition means for acquiring read data read by the reading device in response to a read instruction transmitted by the read instruction transmission control means via the communication unit;
Association means for associating the read data acquired by the read data acquisition means with the imaging data acquired by the imaging data acquisition means in response to a request for imaging corresponding to the read data ;
Storage control means for storing the read data and imaging data associated by the association means in a storage unit;
The reading control and imaging data stored in association with the storage unit by the storage control unit are taken as one set, and a document image based on the reading data for each of a plurality of sets, and the imaging data stored in association with the reading data An information processing apparatus comprising: a first display control unit configured to display on a display unit in a manner associated with a captured image based on the above . An image processing method executed in an information processing apparatus,
An imaging request step of requesting imaging of the subject specified by the user I by the camera unit provided in the information processing apparatus,
An imaging data acquisition step for acquiring imaging data generated by the camera unit in response to an imaging request in the imaging request step;
When the imaging has been requested by the imaging request step, the instruction transmission control step read to transmit the read instruction of the document through the communication unit to the reading device,
A read data acquisition step of acquiring, via the communication unit, read data read by the reading device in accordance with a read instruction transmitted by the read instruction transmission control step ;
Associating the read data acquired by the read data acquisition step with the imaging data acquired by the imaging data acquisition step in accordance with the imaging request corresponding to the read data ;
A storage control step of storing in the storage unit the read data and the imaging data associated by the association step;
The reading data and the imaging data stored in association with the storage unit in the storage control step are taken as one set, and a document image based on the reading data for each of a plurality of sets, and the imaging data stored in association with the reading data And a first display control step for causing the display unit to display the captured image based on the first display control step.

Images