JP2015050730A - Information processing system, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve operation efficiency when attaching image data to a prescribed region of a predetermined format.SOLUTION: An information processing system comprises a reception unit, a recognition unit, a first storage unit, an identification unit, a second storage unit, and an image attachment unit. The reception unit receives first image data indicating an image of the document read by a read unit. The recognition unit recognizes the handwritten characters included in the first image data. The first storage unit stores the first association information with which position information of a prescribed region to which second image data is attached is associated for each of a plurality of kinds of template images. The identification unit identifies the corresponding template image on the basis of feature information of the first image data. The second storage unit stores the second association information with which the second image data is associated for each of a plurality of kinds of characters. The image attachment unit generates third image data by attaching the second image data corresponding to the handwritten characters recognized by the recognition unit to a prescribed region of the template image identified by the identification unit.

Description

  The present invention relates to an information processing system, an information processing method, and a program.

  Conventionally, a photo management application that can be installed in an image reading apparatus or the like is known. As an example of this photo management application, an image file group placed on an external server connected via a network and a model representing a print format template (hereinafter sometimes referred to as a “template image”) are displayed in parallel. For example, when the user selects an image file by touching the image file on the screen with the finger, and moves the finger to the specified position range on the template image while touching the screen, the selection is performed. This is an application for providing a function of forming the image file on the template image and drawing the accompanying information as character information on the template image.

  However, in the conventional photo management application, the user has to select an image file to be attached with a finger or the like on the screen and paste it on a template (predetermined format). Has a problem that it is very difficult to operate.

  The present invention has been made in view of the above, and provides an information processing system, an information processing method, and a program capable of improving the operation efficiency when attaching image data to a predetermined area of a predetermined format. The purpose is to provide.

  In order to solve the above-described problems and achieve the object, the present invention provides a receiving unit that receives first image data indicating an image of a document read by an image reading unit, and a handwriting included in the first image data. A first unit that stores first correspondence information that associates position information of a predetermined area to which second image data is attached, for each of a plurality of types of template images each representing a template of a print format, and a recognition unit that recognizes characters. Based on the feature information of the first image data, a storage unit, a specifying unit for specifying the corresponding template image, and second correspondence information in which the second image data is associated for each of a plurality of types of characters are stored. And attaching the second image data corresponding to the handwritten character recognized by the recognition unit to the predetermined area of the template image specified by the specifying unit. An image attachment unit for generating image data, an information processing system comprising a.

  According to the present invention, it is possible to improve the operation efficiency when attaching image data to a predetermined area of a predetermined format.

FIG. 1 is a diagram illustrating a hardware configuration example of an MFP. FIG. 2 is a schematic diagram illustrating a software configuration example of the MFP. FIG. 3 is a diagram illustrating an example of a functional configuration of the operation unit according to the first embodiment. FIG. 4 is a flowchart illustrating an operation example of the MFP according to the first embodiment. FIG. 5 is a diagram showing an example of a photo number description format sheet. FIG. 6 is a diagram illustrating an example of a screen displayed on the operation unit. FIG. 7 is a diagram showing an example of a format sheet on which a photo number is entered. FIG. 8 is a diagram illustrating an example of a screen displayed on the operation unit. FIG. 9 is a diagram illustrating an example of a functional configuration of the operation unit according to the second embodiment. FIG. 10 is a diagram showing an example of a format sheet on which correction symbols are entered. FIG. 11 is a flowchart illustrating an operation example of the MFP according to the second embodiment. FIG. 12 is a diagram illustrating an example of a functional configuration of the operation unit according to the third embodiment. FIG. 13 is a flowchart illustrating an operation example of the MFP according to the third embodiment. FIG. 14 is a diagram illustrating an example of a functional configuration of the operation unit according to the fourth embodiment. FIG. 15 is a flowchart illustrating an operation example of the MFP according to the fourth embodiment. FIG. 16 is a diagram illustrating an example of a functional configuration of the operation unit according to the fifth embodiment. FIG. 17 is a flowchart illustrating an operation example of the MFP according to the fifth embodiment. FIG. 18 is a diagram illustrating an example of a screen displayed on the operation unit.

  Hereinafter, embodiments of an information processing system, an information processing method, and a program according to the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, a case where the information processing system according to the present invention is applied to a multifunction peripheral (MFP) will be described as an example, but the present invention is not limited to this. Note that a multifunction peripheral is a device having at least two functions among a printing function, a copying function, a scanner function, and a facsimile function. A multifunction machine to which an information processing system according to the present invention is applied has at least a scanner function.

(First embodiment)
FIG. 1 is a block diagram illustrating a hardware configuration example of the MFP 1 according to the present embodiment. As illustrated in FIG. 1, the MFP 1 includes a main body 10 capable of realizing various functions such as a copy function, a scanner function, a fax function, and a printer function, and an operation unit 20 that receives an input corresponding to a user operation. . The main body 10 and the operation unit 20 are connected via a dedicated communication path 300 so that they can communicate with each other. The communication path 300 may be, for example, a USB (Universal Serial Bus) standard, but may be of any standard regardless of whether it is wired or wireless.

  The main body 10 can perform an operation according to the input received by the operation unit 20. The main body 10 can also communicate with an external device such as a client PC (personal computer), and can also perform an operation according to an instruction received from the external device.

  Next, the hardware configuration of the main body 10 will be described. As shown in FIG. 1, the main body 10 includes a CPU 11, a ROM 12, a RAM 13, an HDD (hard disk drive) 14, a communication I / F (interface) 15, a connection I / F 16, and an engine unit 17. These are connected to each other via a system bus 18.

  The CPU 11 comprehensively controls the operation of the main body 10. The CPU 11 controls the overall operation of the main body 10 by executing a program stored in the ROM 12 or the HDD 14 or the like using the RAM 13 as a work area (work area), and the above-described copy function, scanner function, fax function, printer function, etc. Implement various functions.

  The communication I / F 15 is an interface for communicating with an external device such as a client PC (personal computer). The connection I / F 16 is an interface for communicating with the operation unit 20 via the communication path 300.

  The engine unit 17 is hardware that performs processing other than general-purpose information processing and communication for realizing a copy function, a scanner function, a fax function, and a printer function. For example, a scanner (image reading unit) that scans and reads an image of a document, a plotter (image forming unit) that performs printing on a sheet material such as paper, and a fax unit that performs fax communication are provided. The engine unit 17 in this embodiment includes at least a scanner (image reading unit), and the scanner (image reading unit) has an OCR (Optical Character Recognition) function. Further, a specific option such as a finisher for sorting printed sheet materials or an ADF (automatic document feeder) for automatically feeding a document can be provided.

  Next, the hardware configuration of the operation unit 20 will be described. As shown in FIG. 1, the operation unit 20 includes a CPU 21, a ROM 22, a RAM 23, a flash memory 24, a communication I / F 25, a connection I / F 26, and an operation panel 27, which are system buses. They are connected to each other through 28.

  The CPU 21 comprehensively controls the operation of the operation unit 20. The CPU 21 uses the RAM 23 as a work area (work area) and executes a program stored in the ROM 22 or the flash memory 24 to control the operation of the entire operation unit 20 and information (image) according to the input received from the user. Various functions described later such as display of) are realized.

  The communication I / F 25 is an interface for communicating with an external device such as a server device via a network such as the Internet. The connection I / F 26 is an interface for communicating with the main body 10 via the communication path 300.

  The operation panel 27 accepts various inputs in accordance with user operations and displays various types of information (for example, information indicating the operation status of the MFP 1, information indicating a setting state, etc.). In this example, the operation panel 27 is configured by a liquid crystal display device (LCD) having a touch panel function, but is not limited thereto. For example, an organic EL display device equipped with a touch panel function may be used. Further, in addition to or instead of this, an operation unit such as a hardware key and a display unit such as a lamp may be provided.

  Next, the software configuration of the MFP 1 will be described. FIG. 2 is a schematic diagram illustrating an example of the software configuration of the MFP 1. As illustrated in FIG. 2, the main body 10 includes an application layer 101, a service layer 102, and an OS layer 103. The entities of the application layer 101, the service layer 102, and the OS layer 103 are various software stored in the ROM 12, the HDD 14, and the like. Various functions are provided by the CPU 11 executing these software.

  The software of the application layer 101 is application software for operating a hardware resource to provide a predetermined function (in the following description, it may be simply referred to as “application” or “application”). For example, application types include a copy application for providing a copy function, a scanner application for providing a scanner function, a fax application for providing a fax function, and a printer application for providing a printer function. .

  The software of the service layer 102 is software that is interposed between the application layer 101 and the OS layer 103 and provides an interface for using hardware resources included in the main body 10 for the application. More specifically, it is software for providing a function of accepting an operation request for a hardware resource and arbitrating the operation request. As an operation request received by the service layer 102, a request such as reading by a scanner or printing by a plotter can be considered.

  Note that the interface function by the service layer 102 is provided not only to the application layer 101 of the main body 10 but also to the application layer 201 of the operation unit 20. That is, the application layer 201 (application) of the operation unit 20 can also realize a function using hardware resources (for example, the engine unit 17) of the main body 10 via the interface function of the service layer 102.

  The software of the OS layer 103 is basic software (operating system) for providing a basic function for controlling hardware included in the main body 10. The software of the service layer 102 converts a hardware resource use request from various applications into a command interpretable by the OS layer 103 and passes the command to the OS layer 103. Then, when the command is executed by the software of the OS layer 103, the hardware resource performs an operation according to the request of the application.

  Similarly, the operation unit 20 includes an application layer 201, a service layer 202, and an OS layer 203. The application layer 201, the service layer 202, and the OS layer 203 included in the operation unit 20 have the same hierarchical structure as that of the main body 10 side. However, the functions provided by the applications in the application layer 201 and the types of operation requests that can be accepted by the service layer 202 are different from those on the main body 10 side. The application of the application layer 201 may be software for operating a hardware resource provided in the operation unit 20 to provide a predetermined function, but mainly functions provided in the main body 10 (copy function, scanner function, Software for providing a UI (user interface) function for performing operations and display related to a fax function and a printer function) and image data obtained by imaging of an imaging device such as a digital camera used by a user (claims) (Corresponding to “second image data”) of the document (hereinafter referred to as “second image data”) to a predetermined area of the image data of the document read by the scanner (corresponding to “first image data” in the claims) The description includes “sometimes referred to as a“ photo management application ”).

  In this embodiment, the software of the OS layer 103 on the main body 10 side and the software of the OS layer 203 on the operation unit 20 side are different from each other in order to maintain the independence of functions. That is, the main body 10 and the operation unit 20 operate independently of each other with different operating systems. For example, it is possible to use Linux (registered trademark) as the software of the OS layer 103 on the main body 10 side and Android (registered trademark) as the software of the OS layer 203 on the operation unit 20 side.

  In the present embodiment, since the power supply to the operation unit 20 is performed from the main body 10 via the communication path 300, the power control of the operation unit 20 is performed separately from the power control of the main body 10 (independently). Can do).

  Next, the functional configuration of the MFP 1 will be described. FIG. 3 is a diagram illustrating an example of a functional configuration of the operation unit 20. For convenience of explanation, FIG. 3 mainly illustrates functions related to the above-described photo management application, but the functions of the operation unit 20 are not limited to these.

  As illustrated in FIG. 3, the operation unit 20 includes a reception unit 211, a recognition unit 212, a first storage unit 213, a specification unit 214, a second storage unit 215, an image attachment unit 216, and generated data storage. Part 217 and first display part 218. As for each of the above parts, some or all of them may be software (program) or hardware circuit. Moreover, the form mounted in the main body 10 side may be sufficient as a part of said each part.

  The receiving unit 211 receives first image data indicating an image of a document read by a scanner (image reading unit) included in the engine unit 17 described above. The scanner according to the present embodiment performs OCR processing on an image read by scanning a document, and calculates various image characteristic values representing attributes of the document image. Since the OCR process is a known technique, detailed description thereof is omitted here. The scanner in the present embodiment transmits first image data indicating the scan result and OCR information (information indicating the calculated image characteristic value) indicating the result of the OCR processing to the operation unit 20. The receiving unit 211 receives first image data and OCR information from the scanner.

  The recognition unit 212 recognizes handwritten characters included in the first image data. The recognition unit 212 in this embodiment recognizes handwritten characters included in the first image data based on the first image data and the OCR information received by the reception unit 211.

  The first storage unit 213 associates position information (for example, coordinate information in the coordinate system of image data) of a predetermined area to which the second image data is attached, for each of a plurality of types of template images each representing a print format template. The first correspondence information is stored. In this example, the second image data is image data obtained by imaging with an imaging device such as a digital camera used by the user. “Imaging” refers to converting an image of a subject (imaging target) imaged by an optical system such as a lens into an electrical signal. In the following description, the predetermined area may be referred to as a “photo attachment area”.

  The specifying unit 214 specifies a corresponding template image based on the feature information of the first image data. For example, the specifying unit 214 selects a template image that includes a feature point that matches a feature point (an example of feature information) of the first image data among the plurality of template images stored in the first storage unit 213 as the first image data. It can also be specified as a template image corresponding to. The feature information is not limited to this, and may be, for example, a determination image (for example, a barcode) for determining a template image. In this example, a discrimination image is drawn on a document in advance, and the specifying unit 214 analyzes the first image data indicating the scan result to extract a discrimination image, and extracts a corresponding template image from the extracted discrimination image. It can also be specified.

  Here, the recognition unit 212 in the present embodiment recognizes handwritten characters in an area corresponding to a predetermined area of the template image specified by the specifying unit 214 among the first image data received by the receiving unit 211. More specifically, the recognizing unit 212 refers to the first correspondence information stored in the first storage unit 213 and refers to the position information corresponding to the template image specified by the specifying unit 214 (for example, the coordinate system of image data). In the first image data received by the receiving unit 211, the handwritten characters in the area indicated by the specified position information are recognized.

  The second storage unit 215 stores the second correspondence information in which the second image data is associated for each of a plurality of types of characters. The second correspondence information stored in the second storage unit 215 is updated each time the second image data is added or deleted. The second image data can be read from an external storage medium such as an SD card, and the second correspondence information can be generated (or updated) by associating the read second image data with a specific character.

  The image attachment unit 216 generates the third image data by attaching the second image data corresponding to the handwritten character recognized by the recognition unit 212 to the predetermined region of the template image specified by the specifying unit 214. More specifically, the image attachment unit 216 refers to the second correspondence information stored in the second storage unit 215 and identifies the second image data corresponding to the handwritten character recognized by the recognition unit 212. Then, the image attachment unit 216 attaches the specified second image data to a predetermined area of the template image specified by the specification unit 214 to generate third image data.

  The generation data storage unit 217 stores the third image data generated by the image attachment unit 216. The first display unit 218 performs control to display the third image data on the operation panel 27. The first display unit 218 can also perform control to display a list of attachable second image data. In this example, the first display unit 218 displays the second correspondence information described above as a list of attachable second image data. More specifically, the first display unit 218 associates, for each attachable second image data (photo data in this example), a photo number (an example of the character) indicating a number for identifying photo data. The second correspondence information is displayed. Furthermore, the first display unit 218 can also perform control to display a list of template images.

  Next, an operation example of the MFP 1 will be described. FIG. 4 is a flowchart showing an example of a procedure for displaying photographic data (an example of second image data) attached to a template image. First, the user enters the photo number of the photo data to be attached on the photo number description format sheet (original) printed in advance (step S1). FIG. 5 is a diagram showing an example of a photo number description format sheet. The photo number description format sheet has a photo attachment area, and this photo attachment area includes an area for entering the photo number of the photo data to be attached.

  At this time, as shown in FIG. 6, on the screen of the operation panel 27, second correspondence information in which a photo number is associated with each attachable photo data and information for prompting entry of the photo number are displayed. Has been. In this example, a UI image 30 for receiving a scan execution instruction by the scanner is also displayed on the screen of the operation panel 27. While viewing the second correspondence information displayed on the operation panel 27, the user enters the photo number of the photo data to be attached on the photo number description format sheet. FIG. 7 is a diagram showing an example of a photo number description format sheet after the photo number has been entered.

  The user enters the photo number of the photo data to be attached on the photo number description format sheet, and then instructs the scanner to execute scanning (step S2). In this example, the user can input a scan execution instruction by the scanner by performing an operation of pressing the UI image 30 (see FIG. 6) displayed on the operation panel 27. When an instruction to execute scanning by the scanner is received, the scanner starts scanning the photo number-formatted paper on which the photo number is written, and obtains first image data indicating the scan result. Further, the scanner performs OCR processing on the first image data, and transmits first image data indicating the scan result and OCR information indicating the result of the OCR processing to the operation unit 20.

  The receiving unit 211 of the operation unit 20 receives the first image data and the OCR information from the scanner (step S3). Next, the specifying unit 214 specifies a corresponding template image based on the feature information of the first image data received in step S3 (step S4). For example, the specifying unit 214 uses, as a template image corresponding to the first image data, a template image including a feature point that matches the feature point of the first image data among a plurality of template images stored in the first storage unit 213. It can also be specified. However, the present invention is not limited to this, and as described above, the feature information may be, for example, a determination image (for example, a barcode) for determining a template image.

  Next, the recognition part 212 recognizes the handwritten character in the area | region corresponding to the predetermined area | region of the template image specified by step S4 among the 1st image data received by step S3. In this example, the recognizing unit 212 refers to the first correspondence information stored in the first storage unit 213, specifies the position information corresponding to the template image specified in step S4, and includes the first image data. The handwritten character in the area indicated by the specified position information is recognized based on the OCR information. In short, the recognition unit 212 recognizes handwritten characters entered in the photo attachment area of the photo number description format sheet (step S5).

  Next, the image attachment unit 216 generates the third image data by attaching the second image data corresponding to the handwritten character recognized in step S5 to the predetermined area of the template image specified in step S4 (step S6). ). More specifically, the image attachment unit 216 refers to the second correspondence information stored in the second storage unit 215, and specifies the second image data corresponding to the handwritten character recognized in step S5. In addition, the image attachment unit 216 refers to the first correspondence information stored in the first storage unit 213, and specifies the predetermined area of the template image specified in step S4. Then, the image attachment unit 216 generates the third image data by attaching the second image data specified as described above to the predetermined region of the template image specified as described above.

  For example, if the size of the second image data corresponding to the handwritten character recognized in step S5 is different from the size of the predetermined area of the template image specified in step S4, the image attachment unit 216 determines that the second image data It may have a function of adjusting the size. In short, the image attachment unit 216 may have a function of changing the size of the second image data in accordance with the size of the predetermined area.

  Next, as shown in FIG. 8, the first display unit 218 performs control to display the third image data generated in step S6 on the operation panel 27 (step S7). In the example of FIG. 8, a UI image 31 that receives a print execution instruction is also displayed on the operation panel 27. In this example, the user can input a print execution instruction by performing an operation of pressing the UI image 31 displayed on the operation panel 27. When the print execution instruction is received, the MFP 1 (the image forming unit included in the engine unit 17) starts printing the third image data.

  As described above, in the present embodiment, when the user inputs the photo number of the photo data to be attached on the photo number description format sheet by hand and then instructs the execution of scanning by the scanner, the photo management application described above is executed. The mounted operation unit 20 generates third image data by attaching the photo data corresponding to the photo number handwritten by the user to a predetermined area of the template image corresponding to the first image data indicating the scan result. . Thereby, the operation efficiency when attaching image data to a predetermined area of a predetermined format (template image) can be improved.

(Second Embodiment)
Next, a second embodiment will be described. A description of the same parts as those in the first embodiment will be omitted as appropriate.

  FIG. 9 is a diagram illustrating an example of a functional configuration of the operation unit 220 according to the second embodiment. As illustrated in FIG. 9, the operation unit 220 includes a reception unit 211, a recognition unit 221, a first storage unit 213, a specification unit 214, a second storage unit 215, an image attachment unit 216, and generated data storage. Part 217 and first display part 218. Functions other than the recognition unit 221 are the same as those in the first embodiment.

  In addition to the function described in the first embodiment, the recognition unit 221 has a function of recognizing a handwritten character existing within a certain range from the detected correction symbol when a correction symbol for correcting the character is detected. . Examples of correction symbols include a double line 32 as shown in FIG.

  FIG. 11 is a flowchart showing an example of a procedure for displaying photographic data attached to a template image in the second embodiment. Here, a case where a correction symbol is detected by the recognition unit 221 will be described as an example. Since the content of the process of step S11-step S14 shown in FIG. 11 is the same as the content of the process of step S1-step S4 shown in FIG. 4, detailed description is abbreviate | omitted.

  After step S14, the recognition unit 221 detects the correction symbol entered in the photo attachment area (step S15). Next, the recognizing unit 221 determines whether characters other than the character string of the template image exist within a certain range from the detected correction symbol (step S16). This search range is limited to the range corresponding to the photo attachment area in the first image data. If there is a character within a certain range (step S16: Yes), the recognition unit 221 recognizes the character as a character entered in the photo attachment area. Then, the image attachment unit 216 identifies the second image data corresponding to the character recognized by the recognition unit 221 with reference to the second correspondence information, and the identified second image data is identified in step S14. Third image data is generated by attaching to a predetermined area of the image (step S17). Then, the first display unit 218 displays the third image data generated in step S17 (step S18). On the other hand, in step S16 described above, if there is no character within a certain range (step S16: No), the process ends.

(Third embodiment)
Next, a third embodiment will be described. A description of the same parts as those in the first embodiment will be omitted as appropriate.

  FIG. 12 is a diagram illustrating an example of a functional configuration of the operation unit 230 according to the third embodiment. As illustrated in FIG. 12, the operation unit 230 includes a reception unit 211, a recognition unit 212, a first storage unit 213, a specification unit 214, a second storage unit 215, an image attachment unit 216, and a generated data storage. A section 217, a first display section 218, and an editing section 231. Functions other than the editing unit 231 are the same as those in the first embodiment.

  When the third image data is displayed by the first display unit 218, the editing unit 231 performs control to inquire the user whether or not to edit the handwritten character, and receives an instruction to edit the handwritten character. Then, control for recreating the third image data is performed. More specifically, the editing unit 231 discards the third image data generated by the image attachment unit 216 and instructs the reception unit 211 to wait for reception of new first image data.

  FIG. 13 is a flowchart showing an example of a procedure for displaying photographic data attached to a template image in the third embodiment. The contents of the processes in steps S21 to S27 shown in FIG. 13 are the same as the contents of the processes in steps S1 to S7 shown in FIG. After step S27 shown in FIG. 13, the editing unit 231 performs control to inquire the user whether or not to edit handwritten characters (step S28). In this example, the editing unit 231 performs control to display an edit button (UI image) for accepting an instruction to edit a handwritten character on the operation panel 27.

  Here, a case where the user edits a handwritten character will be described as an example. After step S28, the user performs an operation of pressing an edit button (step S29). When the user performs an operation of pressing the edit button (step S30: Yes), the editing unit 231 performs control to regenerate the third image data. In this example, the editing unit 231 discards the third image data generated in step S26 and instructs the receiving unit 211 to wait for reception of new first image data. Then, the user corrects the photo number entered on the scanned document (step S31). For example, a double line may be drawn on the number to be corrected and a new number may be written in the vicinity thereof. Henceforth, the process after step S22 is repeated.

(Fourth embodiment)
Next, a fourth embodiment will be described. A description of the same parts as those in the first embodiment will be omitted as appropriate.

  FIG. 14 is a diagram illustrating an example of a functional configuration of the operation unit 240 according to the fourth embodiment. As illustrated in FIG. 14, the operation unit 240 includes a reception unit 211, a recognition unit 212, a first storage unit 213, a specification unit 214, a second storage unit 215, an image attachment unit 246, and generated data storage. A unit 217, a first display unit 218, a second display unit 241, and a selection unit 242. Functions other than the second display unit 241, the selection unit 242, and the image attachment unit 246 are the same as those in the first embodiment.

  When the recognition unit 212 recognizes a plurality of types of handwritten characters, the second display unit 241 displays the plurality of types of handwritten characters recognized by the recognition unit 212 before the third image data is generated. The selection unit 242 selects any one of a plurality of types of handwritten characters displayed by the second display unit 241 in accordance with a user instruction. In addition to the functions described in the first embodiment, the image attachment unit 246 attaches second image data corresponding to the handwritten character selected by the selection unit 242 to a predetermined region of the template image specified by the specification unit 214. Thus, the third image data is generated.

  FIG. 15 is a flowchart showing an example of a procedure for displaying photographic data attached to a template image in the fourth embodiment. The contents of the processes in steps S31 to S35 shown in FIG. 15 are the same as the contents of the processes in steps S1 to S5 shown in FIG. Here, the case where the recognition unit 212 recognizes a plurality of types of handwritten characters in step S35 illustrated in FIG. 13 will be described as an example. After step S35, the second display unit 241 performs control to display a plurality of types of handwritten characters recognized by the recognition unit 212 on the operation panel 27 (step S36). The user who sees this instructs to select any character (step S37). Then, the selection unit 242 selects any character according to the user's instruction (step S38).

  Next, the image attachment unit 246 generates the third image data by attaching the second image data corresponding to the character selected in step S38 to the predetermined area of the template image specified in step S34 (step S39). ). Next, the first display unit 218 displays the third image data generated in step S39 (step S40).

(Fifth embodiment)
Next, a fifth embodiment will be described. A description of the same parts as those in the first embodiment will be omitted as appropriate.

  FIG. 16 is a diagram illustrating an example of a functional configuration of the operation unit 250 according to the fifth embodiment. As illustrated in FIG. 16, the operation unit 250 includes a reception unit 211, a recognition unit 212, a first storage unit 213, a specification unit 214, a second storage unit 215, an image attachment unit 216, and generated data storage. A unit 217, a first display unit 218, and a change unit 251. Functions other than the changing unit 251 are the same as those in the first embodiment.

  The change unit 251 can change the layout of the template image when the recognition unit 212 does not recognize the handwritten character. More specifically, the changing unit 251 performs control for inquiring of the user whether or not to change the layout of the template image, and changes the template image layout when receiving an instruction to change the layout of the template image. . In the present embodiment, the change unit 251 performs control to display a layout change button (UI image) on the operation panel 27 for accepting an instruction to change the layout when the recognition unit 212 does not recognize a handwritten character. .

  FIG. 17 is a flowchart showing an example of a procedure for displaying photographic data attached to a template image in the fifth embodiment. The details of the processing in steps S41 to S45 shown in FIG. 17 are the same as the details of the processing in steps S1 to S5 shown in FIG. Further, the contents of the processes in steps S50 and S51 shown in FIG. 17 are the same as the contents of the processes in steps S6 and S7 shown in FIG.

  After step S45, the recognition unit 212 determines whether or not the first image data received in step S43 includes a handwritten character indicating a photo number (step S46). This determination is made for each photo attachment region. When it is determined that the handwritten character indicating the photo number is not included (step S46: No), the changing unit 251 performs control to inquire the user whether to change the layout of the template image (step S47). In this example, the change unit 251 performs control to display the layout change button described above on the operation panel 27.

  Here, a case where the user instructs to change the layout will be described as an example. After step S47, the user performs an operation of pressing the layout change button (step S48). When the user performs an operation of pressing the layout change button, that is, when an instruction to change the layout is received, the changing unit 251 changes the layout of the template image (step S49). For example, the changing unit 251 can also delete a portion of a photo attachment area in which a photo number is not entered and a portion related thereto in the template image. In this example, as shown in FIG. 18, only the part where the photo number is entered is displayed.

  As mentioned above, although embodiment which concerns on this invention was described, this invention is not limited to each above-mentioned embodiment as it is, A component can be deform | transformed and embodied in the range which does not deviate from the summary in an implementation stage. . Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in each embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  For example, in each of the above-described embodiments, the main body 10 and the operation unit 20 operate independently of each other with different operating systems. However, the present invention is not limited thereto, and for example, the main body 10 and the operation unit 20 operate with the same operating system. It may be a form to do.

  The program executed in the information processing system of each embodiment described above is a file in an installable format or an executable format, and is a CD-ROM, flexible disk (FD), CD-R, or DVD (Digital Versatile Disk). It may be configured to be recorded and provided on a computer-readable recording medium such as USB (Universal Serial Bus), or may be configured to be provided or distributed via a network such as the Internet. Various programs may be provided by being incorporated in advance in a ROM or the like.

1 MFP
DESCRIPTION OF SYMBOLS 10 Main body 20 Operation part 211 Reception part 212 Recognition part 213 1st preservation | save part 214 Identification part 215 2nd preservation | save part 216 Image attachment part 217 Generation data preservation | save part 218 1st display part 231 Editing part 241 2nd display part 242 Selection part 251 Change unit 300 communication path

JP 2010-136085 A

Claims (12)

A receiving unit that receives first image data indicating an image of a document read by the image reading unit;
A recognition unit for recognizing handwritten characters included in the first image data;
A first storage unit that stores first correspondence information in which position information of a predetermined area to which the second image data is attached is associated with each of a plurality of types of template images each representing a template in print format;
A specifying unit for specifying the corresponding template image based on the feature information of the first image data;
A second storage unit that stores second correspondence information in which the second image data is associated for each of a plurality of types of characters;
An image attachment unit for generating third image data by attaching the second image data corresponding to the handwritten character recognized by the recognition unit to the predetermined region of the template image specified by the specification unit; Comprising
Information processing system. The recognizing unit recognizes the handwritten character in an area corresponding to the predetermined area of the template image specified by the specifying unit in the first image data;
The information processing system according to claim 1. The feature information is a discrimination image for discriminating the template image.
The information processing system according to claim 1 or 2. The image attachment unit changes the size of the second image data in accordance with the size of the predetermined area.
The information processing system according to any one of claims 1 to 3. A first display unit for displaying the third image data;
The information processing system according to any one of claims 1 to 4. When the recognition unit detects a correction symbol for correcting a character, the recognition unit recognizes the handwritten character existing within a certain range from the detected correction symbol;
The information processing system according to any one of claims 1 to 5. When the third image data is displayed by the first display unit, control is performed to inquire the user whether or not to edit the handwritten character, and an input indicating that the handwritten character is edited is received Further includes an editing unit that performs control to regenerate the third image data.
The information processing system according to any one of claims 1 to 5. A second display unit that displays the plurality of types of handwritten characters recognized by the recognition unit before the third image data is generated when the recognition unit recognizes a plurality of types of the handwritten characters. When,
A selection unit that selects any one of the plurality of types of the handwritten characters displayed by the second display unit according to the user's instruction;
The image attachment unit attaches the second image data corresponding to the handwritten character selected by the selection unit to the predetermined area of the template image specified by the specification unit, and attaches the third image data. Generate,
The information processing system according to any one of claims 1 to 5. If the handwritten character is not recognized by the recognition unit, further comprising a changing unit for changing the layout of the template image.
The information processing system according to any one of claims 2 to 6. The change unit performs control for inquiring the user whether or not to change the layout of the template image, and when receiving an input indicating that the layout of the template image is changed, changes the layout of the template image Do control,
The information processing system according to claim 9. A receiving step of receiving first image data indicating an image of a document read by the image reading unit;
Recognizing a handwritten character included in the first image data;
A first specifying step of specifying a template image corresponding to the first image data and representing a template of a print format based on the feature information of the first image data;
A second specifying step of specifying the second image data corresponding to the handwritten character recognized in the recognition step with reference to second correspondence information in which the second image data is associated for each of a plurality of types of characters; ,
For each of the plurality of types of template images, referring to first correspondence information in which position information of a predetermined area to which the second image data is attached is associated, the template image identified in the first identifying step A third specifying step of specifying a predetermined area;
Attaching the second image data specified in the second specifying step to the predetermined area of the template image specified in the third specifying step, and generating third image data.
Information processing method. On the computer,
A receiving step of receiving first image data indicating an image of a document read by the image reading unit;
Recognizing a handwritten character included in the first image data;
A first specifying step of specifying a template image corresponding to the first image data and representing a template of a print format based on the feature information of the first image data;
A second specifying step of specifying the second image data corresponding to the handwritten character recognized in the recognition step with reference to second correspondence information in which the second image data is associated for each of a plurality of types of characters; ,
For each of the plurality of types of template images, referring to first correspondence information in which position information of a predetermined area to which the second image data is attached is associated, the template image identified in the first identifying step A third specifying step of specifying a predetermined area;
An image attaching step of generating the third image data by attaching the second image data specified in the second specifying step to the predetermined area of the template image specified in the third specifying step. Program.

Images