JP2011193262A - Image processor, method of controlling the same, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve a problem wherein a process corresponding to an instructed color of processing information is performed by reading a document having coded processing information described therein, but a user can not easily change the content of the process corresponding to the instructed color. <P>SOLUTION: This image processor reads a document having coded processing information described therein to analyze the coded processing information (S1202), displays the instructed color as a result of the analysis and the content of the process corresponding to the instructed color, and changes the content of the process corresponding to the instructed color according to input of an instruction from the user after the content is displayed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, a control method thereof, and a program.

  2. Description of the Related Art Conventionally, a technique for reading a document such as a form with a scanner and extracting the amount, date, and the like described on the document is known. This technology makes it possible to easily use data extracted from a large number of forms for processing such as tabulation. However, in order to automate processing such as tabulation, it is necessary to recognize what data is in which position of the form.

  For example, in Patent Document 1, processing instruction information indicating a processing target region and processing content is entered by hand on a processing target document, and the processing target information and processing content are read by a scanner. A technique for identifying and creating a processing instruction is disclosed.

JP 2008-145611 A

  However, the method described in Patent Document 1 expresses processing instruction information as a symbol or character such as a horizontal bar, vertical bar, or point, and instructs the processing using the symbol or character. There is a problem that cannot be easily changed.

  The present invention has been made in view of the above problems, and provides an image processing apparatus, a control method thereof, and a program capable of easily changing the contents of a process designated using encoded process information. With the goal.

  In order to achieve the above object, an image processing apparatus according to the present invention includes a reading unit that reads a document on which coded processing information is written, and analyzes the coded processing information, and indicates an instruction color as a result of the analysis. And display means for displaying the contents of the process corresponding to the indicated color; and after the contents of the process corresponding to the indicated color are displayed by the display means, the contents of the process corresponding to the indicated color are received from the user. Changing means for changing in response to an input of an instruction, coding means for coding the contents of processing after being changed by the changing means in association with the instruction color, and an image coded by the coding means Output means for outputting.

  According to the present invention, it is possible to easily change the content of the process corresponding to the instruction color when reading the document in which the encoded process information is described and performing the process corresponding to the instruction color. .

1 is a block diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention. It is a figure which shows the example of the original of the process target in this embodiment. It is a figure which shows the example of the screen for registering the color information and process content of the process instruction information in this embodiment. It is a figure which shows the example of the screen for performing a detailed setting in the case of performing the date check in this embodiment. It is a figure which shows the example of the screen for performing the detailed setting in the case of performing the seal | sticker check in this embodiment. It is a flowchart which shows the flow of the process which produces the scan ticket in this embodiment. It is a figure which shows the example of the screen for changing the check content from the result of the analysis of the process instruction document in this embodiment. It is a figure which shows the example of the screen for performing the setting change with respect to the date check in this embodiment. It is a figure which shows the example of the screen for performing the setting change with respect to the seal | sticker check in this embodiment. It is a figure which shows the example of the output result of the scan ticket in this embodiment. 6 is a flowchart showing a flow of processing for checking a document using a scan ticket in the present embodiment. 10 is a flowchart showing a flow of processing for re-creating a scan ticket in Embodiment 2.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an image processing apparatus which is an example of an embodiment of the present invention. The image forming apparatus 0101 according to the present embodiment is an example of a multi-function peripheral equipped with various functions such as a copy function and a scanner function. However, these functions may be realized by linking a plurality of apparatuses.

  The CPU 0102 controls the overall operation of the image processing apparatus 0101 by loading a program stored in the ROM 0110 into the RAM 0109. The CPU 0102 communicates with each component in the image processing apparatus 0101 via the bus 0103. The operation unit 0107 includes a plurality of keys for the user to give instructions and a display unit that displays various types of information to be notified to the user. A scanner 0106 serving as a reading device reads an image on a document set by a user on a document table as a color image, and accumulates electronic data (image data) obtained thereby in the HDD 0104, the RAM 0109, or the like. The HDD 0104 is a hard disk drive including a hard disk, and stores various pieces of input information. The scanner 0106 includes a document feeder, and can sequentially feed and read a plurality of documents set on the document feeder on the document table. A printer 0105 serving as a printing apparatus prints an image based on input image data on a recording sheet (sheet). A network I / F 0108 connects the image processing apparatus 0101 to the network 0111 and controls reception of data from an external apparatus on the network and transmission of data to the external apparatus on the network.

  In the present embodiment, image data used for processing to be described later will be described as an example of input via the scanner 0106. For example, image data of a document sent from an external device is transferred to the network I / F 0108. It is possible to process in the same manner even if it is input via the interface. The same processing can be performed in a personal computer (PC) or the like to which a scanner or printer is connected. In this case, all or part of the program used in this embodiment can be provided to the PC via a network or the like, or stored in a storage medium such as a CD-ROM and provided to the PC.

  Next, an example of a document used in this embodiment will be described.

  FIG. 2 is a diagram showing an example of a document used in this embodiment. A document 0201 is an estimate in a state where the user has not entered anything (before processing instruction information described later is added). This estimate sheet is provided with a date, a product name, an amount of money, an area for pressing an approver mark, and the like. When the estimate is officially issued, the user enters each content.

  In this embodiment, a check is made to check that the correct date is entered in the date column described by the user, and that the correct mark is pressed in the area where the mark is pressed, in each column of the estimate. And

  A document 0202 is a diagram illustrating an example in which a user adds an arbitrary region for checking among items included in the document 0201 using a color pen. This document 0202 serves as a processing instruction sheet.

  The processing instruction sheet is created when a user who checks the created quotation sheet writes processing instruction information, which will be described later, on a sheet of the same format as the quotation sheet to be checked. That is, the processing instruction sheet is the one in which the processing instruction information is written in the estimate sheet shown in the document 0201. In the present embodiment, in order to designate a region to be processed by the user, the corresponding region is surrounded as a closed region such as a rectangle with a color pen or the like.

  Here, processing instruction information to be written on the estimate (form document) will be described. In the document 0202, for example, an area 0203 is an area written with a blue pen, and an area 0204 is an area written with a red pen. Note that colors other than those shown here can also be used, and the number of colors may be reduced or increased according to the check contents, not limited to two colors. Although a pen is used here, the pen is not limited to a pen as long as it can be colored.

  Then, the user registers the color information of the processing instruction information to be used in advance and the processing content in the RAM 0109 using the operation unit 0107 in association with each other. That is, it is registered in the RAM 0109 to check that the date is correctly entered for blue and to check that the date is correctly stamped for red. The registration procedure will be described later with reference to FIGS.

  A document 0205 is a diagram showing an example of a document to be checked used in the present embodiment. It is assumed that the document to be checked is based on a document having the same format as 0201 and 0202. In the present embodiment, the processing instruction sheet 0202 instructs to check that the date is correctly written in the area 0203 and that the area 0204 is correctly stamped. For this reason, the date 0206 described in the document 0205 to be checked and the seal 0207 are checked. Note that the content and area of the check are not limited to this, and other check contents and other areas can be instructed.

  The registration of the color information of the processing instruction information and the processing content is performed using a registration screen as shown in FIG. FIG. 3 is displayed on the operation unit 0107, and the user performs registration from this screen. In this embodiment, since it is desired to check that the date is correctly entered for blue, the user selects the check content setting button 0302 for blue and registers what is to be checked. When the check content setting button 0302 is pressed, the user can select one of “check date”, “check stamp”, and “do not check” from the pull-down menu. In 0302, “Check date” is selected. Similarly, “checking” is selected for red in 0303, and “not checked” is used as a check content for an instruction with a green pen that is not used in the current processing instruction 0202 in 0304. Is selected. If it is desired to set an instruction for a color pen other than the blue, red, and green colors, the user presses a button 0301 for selecting another color, determines the color, and similarly instructs the check contents using the check contents setting button 0305. It is possible.

  Next, a method for setting the details of the check contents will be described with reference to FIGS. FIG. 4 shows a case in which, when “Check Date” is selected in the check contents setting buttons 0302 to 0305 for each pen color in FIG. 3, the detailed setting button 0306 for performing detailed setting is pressed. 6 is an example of a screen displayed on an operation unit 0107. From this screen (FIG. 4), the user sets the details of what to check when checking the date. In FIG. 4, when the user selects the default setting button 0401, it is determined that the date is correctly entered if there is a description up to the date of the check day. When the user selects the date designation button 0402, the date to be checked is designated by inputting the designated date into the input field 0404 from the operation unit 0107. In addition, when the user selects the period specifying button 0403, the period of the date to be checked is specified by inputting the periods in 0405 and 0406. Here, it is assumed that “period designation 0403” is selected and the period is set from January 1, 2009 to April 30, 2009.

  FIG. 5 shows a case in which, when “Check stamp” is selected in the check contents setting buttons 0302 to 0305 for each pen in FIG. 3, the detailed setting button 0307 for performing the detailed setting is pressed. 6 is an example of a screen displayed on an operation unit 0107. From this screen (FIG. 5), the user sets the details of what to check when checking the seal. In FIG. 5, when the user selects the default setting button 0501, it is only checked whether or not there is a mark. In addition, when the user selects the stamp specifying button 0502, it is determined from the stamp list 0503 stored in advance in the HDD 0104 which of the stamps is pressed to determine that the stamp has been correctly applied. For example, 0503 represents a state in which “director stamp 0504” and “section manager stamp 0505” are registered, and the user selects one of these stamps. When it is desired to check a stamp that is not in the list, the registration is performed using a button 0506 for newly registering. Registration is performed by reading the paper on which the registration stamp has been pressed by the scanner 0106 and storing the read image data in the HDD 0104. For convenience of explanation, it is assumed here that “hanko designation 0502” has been selected and the department head mark 0504 is set.

  The above settings are stored as setting information in the RAM 0109 as follows.

<Setting information>
1. Blue -Check date -Specify period: 2009/01/01 to 2009/04/30
2. Red-Check the stamp-Hanko designation: General manager Green-not checked Other Colors-No Check Next, a process for creating a scan ticket for executing a check of the description content of a document based on the processing instruction sheet 0202 as shown in FIG. 2 will be described. Here, the scan ticket is a ticket that recognizes the instruction content of the processing instruction sheet 0202 and has a format (for example, QR code) that can be recognized by the image processing apparatus 100 as a check method for a document to be checked such as 0205. is there. The scan ticket includes instruction content recognized from the processing instruction sheet 0202 and position information of an area to which the instruction content is applied. When checking the document to be checked, the scanner 0106 reads the scan ticket and the CPU 11 recognizes the processing contents, and then checks the document to be checked.

  FIG. 6 is a flowchart showing the flow of processing when creating a scan ticket in this embodiment. The program for executing each process of the flowchart of FIG. 6 stored in the ROM 0110 is loaded into the RAM 0109 and executed by the CPU 0102, whereby the flowchart of FIG. 6 is executed.

  When the user gives an instruction to create a scan ticket via the operation unit 0107, this flow is started. When this flow is started, in step S0601, a display for prompting the user to set a document on which instruction information is written (corresponding to the processing instruction sheet 0202) is displayed on the operation unit 0107. When the user presses an OK button after setting a document on which instruction information is already written, the scanner 0106 reads the document. Image data obtained by reading with the scanner 0106 is stored in the RAM 0109.

  In step S0602, processing instruction information is analyzed / recognized from the image data input from the scanner 0106. Here, based on the setting information set in advance, by analyzing where the instruction color of the processing instruction information registered by the user is in the document and recognizing the color of that part, the target area for each color Specify the position of. The position specified here can determine which size of the region to be processed exists at which position on the document. For example, the position is specified by coordinates. Then, the position specified here is associated with the processing content from the indicated color, and is stored in the RAM 0109 as analysis information. For example, the analysis information is as follows.

<Analysis information>
・ Region 1
-Position: (2100, 1500) to (4400, 2000)
-Blue: Check date Period designation: 2009/01/01 to 2009/04/30
・ Region 2
-Position: (3000,5500) to (4000,6500)
-Red: Checking the seal Stamp designation: Department head mark Subsequently, in step S0603, the CPU 0102 causes the operation unit 0107 to display the result of analysis / recognition in step S0602. FIG. 7 shows an example of the display. As shown in FIG. 7, a thumbnail image (0701) of the read document is displayed, and in correspondence with the image, the processing instruction information is located at which position and the processing content is displayed in an identifiable manner. . A rectangular area 0702 filled in blue corresponds to the first area 0203 of the processing instruction sheet 0202 specified when the user checks the date. A rectangular area 0703 painted in red corresponds to the second area 0204 of the processing instruction sheet 0202 designated when the user checks the seal. The processing contents for each area are displayed as 0704 and 0705 in FIG.

  In step S0604, the CPU 0102 waits for the user to determine whether or not the content displayed in step S0603 is unchanged. The user looks at the thumbnail image displayed in 0701 and confirms whether the position is correctly recognized as specified in the processing instruction sheet 0202. Specifically, it is confirmed that the rectangular areas 0702 and 0703 recognized by the CPU 0102 are correct in the areas 0203 and 0204 designated by the processing instruction sheet 0202. Next, the user confirms the contents of the check. The check contents for the rectangular area 0702 filled in blue correspond to 0704, and the details are confirmed by pressing the detail setting button 0706. When the user presses the detail setting button 0706, the CPU 0102 displays details of the check contents as shown in FIG. 8 on the operation unit 0107 based on the analysis information. The user confirms the check contents from this screen, and if there is no change, presses an OK button 0807. If there is a change, the user makes a change here (step S0605). For example, in the analysis information 1, the date in the area is checked with respect to the area 1 by specifying the period (2009/01/01 to 2009/04/30). If the period is to be changed, 0805 is used. And 0806, enter a new date. In addition, when changing to date designation, the date designation button 0802 is pressed, and a further designated date is input from 0804. Here, it is assumed that the date for specifying the period is changed as follows.

<Change 1>
Before change: 2009/01/01 to 2009/04/30
After change: 2009/01/01 to 2009/03/31
This change is reflected in the analysis information.

  Similarly, the check content for the rectangular area 0703 painted in red corresponds to 0705, and in order to confirm the details, the detail setting button 0707 is pressed. When the user presses the detail setting button 0707, the CPU 0102 displays details of the check contents as shown in FIG. 9 on the operation unit 0107 based on the analysis information. The user confirms the check contents from this screen, and if there is no change, presses the OK button 0907. If there is a change, the change is made here. For example, in the analysis information, a check of the seal is performed for the area 2 with a stamp designation (department stamp). However, when it is desired to change the designated stamp (hand stamp), the registration is indicated by 0903. Make a new selection from the list of stamps. Here, it is assumed that the designated seal (hanko) has been changed to permit the section manager's seal.

<Change 2>
Before change: General manager sign After change: General manager sign + Manager sign This change is reflected in the analysis information.

  As described above, the analysis information is changed as follows by the two changes.

<Analysis information after change>
・ Region 1
-Position: (2100, 1500) to (4400, 2000)
-Blue: Check date Period designation: 2009/01/01 to 2009/03/31
・ Region 2
-Position: (3000,5500) to (4000,6500)
-Red: Check the seal Mark designation: General manager + Section manager In addition to the detailed setting button 0706 or 0707, the check setting can be changed by the item setting button 0704 or 0705. For example, in the item setting button 0704, “Check date” is displayed, but by pressing this button, changes to other setting items are set to “Do not check” or “Check stamp”. You can also. When the check is changed to “check mark”, it is possible to further determine the mark to be checked by pressing the detailed setting button 0706. However, in this embodiment, since the rectangular area 0702 designated in blue is a date entry column, changing to “check stamp” is an impossible setting, and the possibility of change here is “not checked”. Only. The same applies to the item setting button 0705.

  When the confirmation of all the check contents is completed, the user presses an OK button 0709 and proceeds to step S0606.

  In step S0606, the CPU 0102 encodes the analysis information (here, the analysis information after the change because the check content has been changed). When encoding, the thumbnail image shown in 0701 is also encoded with the stamp image itself stored in the HDD 0104 such as a department manager or section manager. However, for a stamp image, a path to the area of the HDD 0104 where the image is stored may be used. Also, the coding of analysis information refers to coding using, for example, a two-dimensional bar code (for example, a QR code). Although a two-dimensional barcode is described here as an example, it may be coded by other methods, and is not limited to this as long as the image processing apparatus 0101 can be analyzed and recognized. Finally, in step S0607, the CPU 0102 outputs the coded image created in step S0606 as an image on a recording sheet by the printer 0105, and prints it. An example of the printed scan ticket is shown in FIG. As shown in FIG. 10, in addition to the QR code 1003 created in step S0606, it is desirable that the document 1002 to be checked and the contents of the check 1004 are simultaneously printed on the scan ticket.

  A procedure for checking a document according to the extracted processing instruction information using the scan ticket created as described above will be described.

  FIG. 11 is a flowchart showing a flow of processing for checking a document to be checked using a scan ticket. The program for executing each process of the flowchart of FIG. 11 stored in the ROM 0110 is loaded into the RAM 0109 and executed by the CPU 0102, whereby the flowchart of FIG. 11 is executed.

  When the user gives an instruction to check the document to be checked via the operation unit 0107, this flow is started. When this flow is started, the CPU 0102 displays on the operation unit 0107 to prompt the user to set the first scan ticket printed in step S0607 and then stack the document to be checked on the document feeder. (Step 1101). Subsequently, after the document is set, when reading of the document is instructed by pressing the OK button of the operation unit 0107 or the like, the process proceeds to step S1102, and the CPU 0102 sequentially stores the document set on the document feeder. Then, the scanner 0106 starts reading the document. Here, first, a scan ticket, which is the first of the originals set on the original feeder, is fed, and the scanner 0106 reads the scan ticket. Subsequently, the document to be checked set on the scan ticket is sequentially read. Note that a plurality of documents to be checked can be stacked and set. In addition, by designating a series of originals from the operation unit 0107, it is possible to divide a large number of originals into a plurality of bundles and set them in the original feeder.

  In step S1103, analysis / recognition processing of the first original read in step S1102, that is, the image of the scan ticket is performed. Here, the two-dimensional code or the like in the read scan ticket is analyzed, and the region (position) to be processed and the processing content are recognized. The recognized result is stored in the RAM 0109. In step S <b> 1104, the CPU 0102 performs analysis / recognition processing on the second and subsequent check target documents using the recognized result stored in the RAM 0109. For example, in the example 0205 of the document to be checked, a date in the range of “2009/01/01 to 2009/03/31” is described in the date description column 0206, and the stamp 0207 is “Department stamp”. Recognize that it is "or a section chief".

  The recognition here is, for example, OCR processing is performed on the image in the date description column 0206 to recognize the described date, and the date in the range of “2009/01/01 to 2009/03/31” is described. Check that there is. In addition, in the seal 0207, it is determined from the image by the pattern recognition process whether it matches the “department stamp or section manager seal”. The above recognition process is an example, and other recognition methods may be employed.

  Then, the CPU 0102 sequentially stores the page number of the document to be checked and the recognition result for the page in the RAM 18. Here, it is OK when all the recognition results are normal for one document to be checked, and NG when even one is not recognized as normal. When the recognition process for all of the check target documents is completed, the CPU 0102 totals the results for all the documents stored in the RAM 0109. The totaling of results refers to, for example, totaling the total number of checked documents to be checked, the number of areas determined to be NG, the page numbers of the documents including the areas determined to be NG, and the like. This page number is the first page of the document to be checked excluding the scan ticket in the order read by the scanner 0106 (the order fed from the document feeder). If information other than that shown here can be identified from the information stored in the RAM 0109, the information may be further totaled. Here, the accumulation in the RAM 0109 has been described, but the same processing can be performed even if the accumulation in the HDD 0104.

  In step S1105, the CPU 0102 causes the operation unit 0107 to display the totalization result performed in step S1104. For example, if there is a checked total number of sheets, a document determined to be NG, an area determined to be NG, a page number of the document determined to be NG, and the like are displayed. At the same time as this display, the CPU 0102 can display a button for instructing report printing on the operation unit 0107, and the printer 0105 can output a report indicating the counting result on a recording sheet.

  If it is determined in step S1106 that the button for instructing printing of the report has been pressed in the above display, the process proceeds to step S1107, and the CPU 0102 creates a report indicating the aggregation result. Since printing on recording paper by the printer 0105 can use a wider area than the display on the operation unit 0107, more information may be added to the report than the display in step S1105. For example, a reduced image of a document template to be checked may be simultaneously placed in addition to the above-described total result. In step S1108, the CPU 0102 causes the created report to be output as image data to the printer 0105 and printed on the recording paper. At this time, information indicating NG may be added to the page determined to be NG at the same time as the report and printed.

  In the above check process, the scan ticket is used as an example. However, as described above, the process instruction document in which the process instruction information is written may be used as it is instead of the scan ticket.

  As described above, according to the present embodiment, the user can easily change the check content specified by the processing instruction information using the operation unit.

  Next, a scan ticket re-creation method will be described.

  In the first embodiment, the processing instruction sheet 0202 is read from the scanner 0106 and the scan ticket 1001 is created. In this embodiment, the scan ticket 1001 is read from the scanner 0106 and another new scan ticket is generated. State.

  FIG. 12 is a flowchart showing the flow of processing when re-creating a scan ticket in the present embodiment. The program for executing each process of the flowchart of FIG. 12 stored in the ROM 0110 is loaded into the RAM 0109 and executed by the CPU 0102, whereby the flowchart of FIG. 12 is executed.

  When the user gives an instruction to recreate the scan ticket via the operation unit 0107, this flow is started. When this flow is started, in step S1201, the operation unit 0107 is displayed to prompt the user to set a scan ticket (corresponding to the scan ticket 1001) in which coded processing information is described. Here, as described in the first embodiment, the scan ticket is a paper medium including coded information such as a two-dimensional barcode (for example, a QR code). When the user presses an OK button after setting a scan ticket, the scanner 0106 reads the original. Image data obtained by reading with the scanner 0106 is stored in the RAM 0109.

  Next, in step S1202, the coded processing information (for example, QR code) is analyzed and recognized from the scan ticket input from the scanner 0106, and the contents of the processing corresponding to the instruction color and the instruction information are recognized. To do. For example, when the scan ticket 1001 is used, the analysis information is as follows.

<Analysis information>
・ Region 1
-Position: (2100, 1500) to (4400, 2000)
-Blue: Check date Period designation: 2009/01/01 to 2009/03/31
・ Region 2
-Position: (3000,5500) to (4000,6500)
-Red: Check the seal. Hanko designation: Department manager + Section manager. Subsequently, in step S1203, the CPU 0102 displays the result of analysis / recognition in step S1202 on the operation unit 0107. The display contents are the same as in FIG. In step S1204, the CPU 0102 waits for the user to determine whether or not the content displayed in step S1203 is changed. Hereinafter, the processing from step S1205 to step S1207 is the same as the processing from step S0605 to step S0607 in FIG.

  Since the document check process using the re-created scan ticket is the same as the process in FIG. 11, the description of the process flow is also omitted. In addition to using the re-created scan ticket in the check process, after changing the check contents in step 1205, the check target document is continuously scanned, so that the check process can be performed without re-creating the scan ticket. It is also good to do.

  As described above, according to the present embodiment, the user can easily change the check contents and re-create a scan ticket from the scan ticket once created. For example, when checking the date of a document, it is effective when it is desired to change the date and check another document.

Claims (8)

Reading means for reading a document on which encoded processing information is described;
Display means for analyzing the coded processing information and displaying the instruction color and the content of the processing corresponding to the instruction color as a result of the analysis;
A change unit configured to change the content of the process corresponding to the instruction color according to the input of the instruction from the user after the content of the process corresponding to the instruction color is displayed by the display unit;
Coding means for coding the contents of the processing after being changed by the changing means in association with the instruction color;
An image processing apparatus comprising: output means for outputting an image coded by the coding means.   The image processing apparatus according to claim 1, wherein the changing unit changes a date corresponding to the instruction color.   The image processing apparatus according to claim 1, wherein the changing unit changes or adds a seal corresponding to the instruction color.   The image processing apparatus according to claim 1, wherein the contents of the process corresponding to the instruction color check a date in an area surrounded by the instruction color on the document.   The image processing apparatus according to claim 1, wherein the content of the processing corresponding to the instruction color checks a type of a seal in an area surrounded by the instruction color on the document.   The image processing apparatus according to claim 1, wherein the coded image is a two-dimensional barcode. A control method for an image processing apparatus, comprising:
A reading step for reading a document on which encoded processing information is described;
A control step of analyzing the coded processing information and controlling display of an instruction color and processing contents corresponding to the instruction color as a result of the analysis;
After the content of the process corresponding to the instruction color is displayed by the control step, a change step of changing the content of the process corresponding to the instruction color in accordance with an instruction input from the user;
A coding step of coding the contents of the processing after being changed by the changing step in association with the instruction color;
And an output step of outputting the image encoded by the encoding step.   A program for causing a control method according to claim 7 to be executed by a computer.

Images