JP6547658B2 - Image processing apparatus, image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing method.

  In an image processing apparatus such as a copying machine, various types of originals are printed. For example, in this type of image processing apparatus, a document of a musical score may be printed. There is known an image processing apparatus capable of adding an auxiliary symbol to a score based on image data read from a document of the score (see Patent Document 1).

JP, 2010-220097, A

  By the way, in an image processing apparatus, an original of a musical score including a plurality of parts such as a musical score of musical score may be printed. For example, a user who participates in an ensemble may print an original score of an ensemble score using an image processing apparatus in order to use the performance of the part in charge. Here, parts other than the part in charge included in the printed score are often unnecessary for the user. When a part other than the part in charge is unnecessary for the user, the user feels inconvenient to find out the part in charge from the plurality of parts included in the printed score.

  An object of the present invention is to provide an image processing apparatus and an image processing method capable of improving the convenience of a score including a plurality of parts.

  An image processing apparatus according to one aspect of the present invention includes a first detection processing unit, an extraction processing unit, and an aggregation processing unit. The first detection processing unit detects a partial score corresponding to each of the parts based on image data of a score including a plurality of parts. The extraction processing unit corresponds to one or more of the parts selected according to a selection operation predetermined from the partial score corresponding to each of the plurality of parts detected by the first detection processing unit. Extract partial score. The aggregation processing unit consolidates a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit into one image.

  An image processing method according to another aspect of the present invention includes the following first step, second step, and third step. In the first step, a partial score corresponding to each of the parts is detected based on image data of a score including a plurality of parts. In the second step, the partial score corresponding to one or more of the parts selected according to a selection operation determined in advance from the partial scores corresponding to each of the plurality of parts detected in the first step. Is extracted. In the third step, a plurality of images indicating the partial score corresponding to the part extracted in the second step are integrated into one image.

  According to the present invention, it is possible to improve the convenience of a score including a plurality of parts.

FIG. 1 is a diagram showing the configuration of an image processing apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram showing the system configuration of the image processing apparatus according to the embodiment of the present invention. FIG. 3 is a flowchart showing an example of part grouping processing performed by the image processing apparatus according to the embodiment of the present invention. FIG. 4 is a view showing an example of image data of a musical score acquired by the image processing apparatus according to the embodiment of the present invention. FIG. 5 is a view showing an example of a selection screen displayed on the operation display unit of the image processing apparatus according to the embodiment of the present invention. FIG. 6 is a view showing an example of image data output from the image processing apparatus according to the embodiment of the present invention. FIG. 7 is a view showing another example of image data output from the image processing apparatus according to the embodiment of the present invention.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The following embodiments are merely specific examples of the present invention, and do not limit the technical scope of the present invention.

[Configuration of Image Processing Device 10]
First, the configuration of an image processing apparatus 10 according to an embodiment of the present invention will be described with reference to FIGS. 1 and 2. Here, FIG. 1 is a schematic cross-sectional view showing the configuration of the image processing apparatus 10. As shown in FIG.

  The image processing apparatus 10 is a multifunction peripheral having a scan function for reading image data from a document, a print function for forming an image based on image data, and a plurality of functions such as a facsimile function and a copy function. The present invention is also applicable to image processing apparatuses such as scanners, printers, facsimiles, copiers, and personal computers.

  As shown in FIGS. 1 and 2, the image processing apparatus 10 includes an ADF (automatic document feeder) 1, an image reading unit 2, an image forming unit 3, a sheet feeding unit 4, a control unit 5, an operation display unit 6, And a storage unit 7.

  The ADF 1 includes an original setting unit, a plurality of conveyance rollers, an original pressing unit, and a discharge unit, and conveys an original read by the image reading unit 2. The image reading unit 2 includes an original table, a light source, a plurality of mirrors, an optical lens, and a CCD, and can read image data from an original.

  The image forming unit 3 can form a color or monochrome image by electrophotography based on the image data read by the image reading unit 2. The image forming unit 3 can also form an image based on image data input from an information processing apparatus such as an external personal computer. Specifically, the image forming unit 3 includes a plurality of image forming units corresponding to cyan (C), magenta (M), yellow (Y), and black (K), an optical scanning device, an intermediate transfer belt, and a secondary transfer. A roller, a fixing device, and a discharge tray are provided. The sheet feeding unit 4 supplies a sheet to the image forming unit 3. In the image forming unit 3, a color or monochrome image is formed on the sheet supplied from the sheet feeding unit 4, and the sheet on which the image is formed is discharged to the sheet discharge tray. The image forming unit 3 may form an image by another image forming method such as an inkjet method.

  The control unit 5 includes control devices such as a CPU, a ROM, a RAM, and an EEPROM (registered trademark) (not shown). The CPU is a processor that executes various arithmetic processing. The ROM is a non-volatile storage medium in which information such as a control program for causing the CPU to execute various processes is stored in advance. The RAM is a volatile storage medium, and the EEPROM is a non-volatile storage medium. The RAM and the EEPROM are used as temporary storage memories (work areas) of various processes executed by the CPU. In the control unit 5, the CPU executes various control programs stored in advance in the ROM. As a result, the image processing apparatus 10 is totally controlled by the control unit 5. The control unit 5 may be configured by an electronic circuit such as an integrated circuit (ASIC) or the like, and is a control unit provided separately from the main control unit that generally controls the image processing apparatus 10. May be

  The operation display unit 6 is a display unit such as a liquid crystal display that displays various types of information in response to a control instruction from the control unit 5, and operation keys or a touch panel that inputs various types of information to the control unit 5 in accordance with user operations. Etc. has an operation unit.

  The storage unit 7 is a non-volatile storage medium. For example, the storage unit 7 is a storage medium such as a flash memory, an SSD (solid state drive), or an HDD (hard disk drive).

  In the image processing apparatus 10, various types of originals are printed. For example, in the image processing apparatus 10, a document of a musical score may be printed. There is known an image processing apparatus capable of adding an auxiliary symbol to the score based on image data read from a document of the score.

  By the way, in the image processing apparatus 10, a manuscript of a score including a plurality of parts such as a score of a musical ensemble may be printed. For example, a user who participates in an ensemble may use the image processing apparatus 10 to print an original sheet of the score of the ensemble in order to use the performance of the assigned part. Here, parts other than the part in charge included in the printed score are often unnecessary for the user. When a part other than the part in charge is unnecessary for the user, the user feels inconvenient to find out the part in charge from the plurality of parts included in the printed score.

  On the other hand, the image processing apparatus 10 according to the embodiment of the present invention can improve the convenience of the score including a plurality of parts as described below.

  Specifically, in the ROM of the control unit 5, a part consolidation program for causing the CPU to execute part consolidation processing (see the flowchart of FIG. 3) described later is stored in advance. The part grouping program may be recorded in a computer readable recording medium such as a CD, a DVD, a flash memory, etc., and may be read from the recording medium and installed in the storage unit 7.

  Then, as shown in FIG. 2, the control unit 5 includes an acquisition processing unit 51, a first detection processing unit 52, a second detection processing unit 53, an extraction processing unit 54, an aggregation processing unit 55, and an output processing unit 56. Including. Specifically, the control unit 5 executes the part grouping program stored in the ROM using the CPU. Thus, the control unit 5 functions as an acquisition processing unit 51, a first detection processing unit 52, a second detection processing unit 53, an extraction processing unit 54, an aggregation processing unit 55, and an output processing unit 56.

  The acquisition processing unit 51 acquires image data of a score including a plurality of parts.

  For example, the acquisition processing unit 51 uses the image reading unit 2 to acquire the image data of the score from the document of the score. Specifically, when the document is placed on the document setting unit of the ADF 1, the acquisition processing unit 51 uses the ADF 1 and the image reading unit 2 to start the document placed on the document setting unit. Read the image data of the score. Further, when a document is placed on the document table of the image reading unit 2, the acquisition processing unit 51 uses the image reading unit 2 to generate an image of the score from the document placed on the document table Read the data

  In addition, the acquisition processing unit 51 may acquire the image data of the score by receiving the image data of the score transmitted from an external information processing apparatus. Further, the acquisition processing unit 51 reads out the image data of the musical score read by the image reading unit 2 or transmitted from an external information processing apparatus and stored in the storage unit 7 to obtain the image data of the musical score. You may get it.

  The first detection processing unit 52 detects a partial score corresponding to each of the parts based on the image data of the score acquired by the acquisition processing unit 51.

  For example, the first detection processing unit 52 detects the partial score corresponding to each of the parts based on the staff included in the score and the name of the part. Specifically, the first detection processing unit 52 is an area including one or more of the staff identified for each name of the part according to whether or not the name of the part is a predetermined special part. Is detected as the partial score corresponding to the part.

  Here, the special part is the part in which a plurality of the staves are used to express melody. For example, the number of the staves specified corresponding to the special part is predetermined for each special part. For example, the special part includes a piano. When the special part is a piano, the number of the staves specified corresponding to the special part is two.

  For example, when the name of the part is not the special part, the first detection processing unit 52 sets one of the staffs arranged in a specific direction determined in advance from the name of the part as the name of the part. Identify as the corresponding said staff. On the other hand, when the name of the part is the special part, the first detection processing unit 52 corresponds to the name of the part corresponding to the name of the part, with respect to the plurality of staff arranged in the specific direction from the name of the part Identify as a staff. For example, the specific direction is below or to the right of the name of the part.

  Then, the first detection processing unit 52 detects an area including one or more of the staff corresponding to the specified name of the part as the partial score corresponding to the part.

  Here, the procedure for detecting the partial score corresponding to the part by the first detection processing unit 52 will be described with reference to FIG. FIG. 4 shows image data D1 of a musical score which is an example of the image data of the musical score acquired by the acquisition processing unit 51.

  First, the first detection processing unit 52 detects staves G11 to G28 included in the image data D1 of the score based on the image data D1 of the score acquired by the acquisition processing unit 51. For example, the first detection processing unit 52 performs a binarization process for binarizing each pixel included in the image data D1 of the score on the image data D1 of the score based on a preset threshold value. Then, the first detection processing unit 52 detects the staves G11 to G28 included in the image data D1 of the score based on the execution result of the binarization processing.

  Next, the first detection processing unit 52 detects part names M1 to M5 included in the image data D1 of the score based on the image data D1 of the score acquired by the acquisition processing unit 51. For example, the first detection processing unit 52 performs an optical character recognition (OCR) process for recognizing characters included in the image data D1 of the score on the image data D1 of the score. Then, the first detection processing unit 52 detects the part names M1 to M5 included in the image data D1 of the score based on the execution result of the OCR processing.

  Next, the first detection processing unit 52 determines whether or not the detected part names M1 to M5 are the special part. For example, the first detection processing unit 52 determines that the part names M1 to M4 are not the special part. Further, the first detection processing unit 52 determines that the part name M5 is the special part.

  Next, the first detection processing unit 52 specifies the staff corresponding to the detected part names M1 to M5. For example, the first detection processing unit 52 specifies the staff G11, the staff G17, and the staff G23 disposed to the right of the part name M1 as the staff corresponding to the part name M1. Further, the first detection processing unit 52 specifies the staff G12, the staff G18, and the staff G24 disposed on the right of the part name M2 as the staff corresponding to the part name M2. Further, the first detection processing unit 52 specifies the staff G13, the staff G19, and the staff G25 disposed on the right of the part name M3 as the staff corresponding to the part name M3. Further, the first detection processing unit 52 specifies the staff G14, the staff G20, and the staff G26 disposed on the right of the part name M4 as the staff corresponding to the part name M4. Further, the first detection processing unit 52 identifies the staff G15 to G16, the staff G21 to G22, and the staff G27 to G28 disposed on the right of the part name M5 as the staff corresponding to the part name M5. Do.

  Then, the first detection processing unit 52 detects an area including the staff identified corresponding to each of the part names M1 to M5 as the partial score corresponding to the part. For example, the first detection processing unit 52 specifies an area including the staff G11, the staff G17, and the staff G23 specified corresponding to the part name M1 and the part name M1 as the partial score P1. Further, the first detection processing unit 52 specifies an area including the staff G12, the staff G18, and the staff G24 specified corresponding to the part name M2 and the part name M2 as a partial score P2. Further, the first detection processing unit 52 specifies an area including the staff G13, the staff G19, and the staff G25 specified corresponding to the part name M3 and the part name M3 as a partial score P3. Further, the first detection processing unit 52 specifies an area including the staff G14, the staff G20, and the staff G26 specified corresponding to the part name M4 and the part name M4 as the partial score P4. Further, the first detection processing unit 52 sets a region including the staff G15 to G16, the staff G21 to G22, and the staff G27 to G28 specified corresponding to the part name M5 and the part name M5 as the partial score P5. Identify. In FIG. 4, the partial scores P <b> 1 to P <b> 5 are indicated by two-dot chain lines.

  The first detection processing unit 52 may detect the partial score corresponding to the part without being based on the staff. For example, the first detection processing unit 52 detects an area specified for each part name according to whether or not the part name is the special part, as the partial score corresponding to the part. It is also good.

  The second detection processing unit 53 detects a predetermined specific musical performance symbol among the musical performance symbols included in the musical score, based on the image data of the musical score. Here, the specific musical symbol is the musical symbol relating to the performance of all the parts included in the score. For example, the specific musical symbols include speed symbols and expression symbols.

  For example, the second detection processing unit 53 detects the specific musical symbol based on the execution result of the OCR processing performed by the first detection processing unit 52. For example, the second detection processing unit 53 detects the specific musical symbol A1 from the image data D1 of the musical score shown in FIG.

  The extraction processing unit 54 corresponds to one or more of the parts selected according to a selection operation predetermined from the partial score corresponding to each of the plurality of parts detected by the first detection processing unit 52. Extract partial score.

  For example, the extraction processing unit 54 causes the operation display unit 6 to display a selection screen used for selecting the partial score corresponding to the part detected by the first detection processing unit 52. Then, the extraction processing unit 54 corresponds to one or more of the partial scores corresponding to each of the plurality of parts detected by the first detection processing unit 52 according to the user's operation on the selection screen. Extract the partial score. Here, the user's operation on the selection screen is an example of a predetermined selection operation in the present invention.

  FIG. 5 shows an example of the selection screen displayed on the operation display unit 6 by the extraction processing unit 54. The selection screen X1 shown in FIG. 5 includes a display area R1 and operation keys K1 to K2. Image data D1 of a musical score is displayed in the display area R1. The user can select the partial score corresponding to one or more of the parts from the image data D1 of the score displayed in the display area R1 on the selection screen X1. For example, the user can select the partial score corresponding to the part by performing a touch operation on the display area of the partial score corresponding to the desired part on the selection screen X1. For example, when the user performs a touch operation on the display area of the partial score P5 of the selection screen X1, the extraction processing unit 54 causes the display area R1 to display a cursor A2 indicating that the partial score P5 is in a selected state. When the user performs a touch operation on the operation key K1 in a state where the cursor A2 is displayed in the display area R1, the extraction processing unit 54 extracts the partial score P5. On the other hand, when the user performs a touch operation on the operation key K2, the extraction processing unit 54 does not extract the partial score corresponding to the part. In FIG. 5, the cursor A2 is indicated by a two-dot chain line.

  The aggregation processing unit 55 integrates a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit 54 into one image.

  Further, the aggregation processing unit 55 combines a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit 54 and the specific performance symbol detected by the second detection processing unit 53 into one image. Summarize.

  For example, the aggregation processing unit 55 includes a plurality of images representing the partial score corresponding to the part extracted by the extraction processing unit 54 including the specific musical symbol detected by the second detection processing unit 53 in advance. Aggregate image data arranged at a predetermined interval. The interval may be arbitrarily set in accordance with the user's operation on the operation display unit 6.

  For example, when the partial score P5 is selected on the selection screen X1 shown in FIG. 5, for example, the aggregation processing unit 55 includes stave G15 to G16 (see FIG. 4) indicating the partial score P5. An aggregate image data D2 shown in FIG. 6 is generated in which the images including the image, the image including the staff G21 to G22, and the images including the staff G27 to G28 are arranged at the intervals.

  Further, when the extraction processing unit 54 extracts the partial score corresponding to each of the plurality of parts, the aggregation processing unit 55 generates a plurality of images indicating the partial score corresponding to each of the plurality of extracted parts. Integrate into one image. For example, the aggregation processing unit 55 generates the aggregated image data in which a plurality of images indicating the partial score corresponding to each of the plurality of parts extracted by the extraction processing unit 54 are arranged at the intervals.

  Further, when the extraction processing unit 54 extracts the partial score corresponding to each of the plurality of parts, the aggregation processing unit 55 generates a plurality of images indicating the partial score corresponding to each of the plurality of extracted parts. Are integrated into one image, and the color of the partial score corresponding to each of the plurality of extracted parts is changed to a different color. For example, the aggregation processing unit 55 changes the color of the partial score corresponding to each of the parts to a different color in the aggregated image data.

  For example, when the partial score P1 and the partial score P5 are selected on the selection screen X1 shown in FIG. 5, for example, the aggregation processing unit 55 is an image including the specific musical symbol A1 and including the staff G11 indicating the partial score P1. The image containing the staff G17, the image containing the staff G23, and the image containing staff G15 to G16 indicating the partial score P5, the image containing the staff G21 to G22, and the image containing the staff G27 to G28 Aggregated image data D3 shown in FIG. 7 arranged at intervals are generated. For example, as illustrated in FIG. 7, the aggregation processing unit 55 generates aggregated image data D3 in which an image indicating a partial score P1 and an image indicating a partial score P5 are alternately arranged. Further, the aggregation processing unit 55 changes the color of the partial score P1 and the color of the partial score P5 to different colors in the aggregated image data D3. Further, the aggregation processing unit 55 changes the color of the specific musical performance symbol A1 to the same color as the color of the partial score P1 in the aggregated image data D3. The aggregation processing unit 55 may generate the aggregated image data in which the plurality of images indicating the partial score P5 are disposed after the plurality of images indicating the partial score P1 are disposed. Further, in the aggregated image data D3, the color of each of the partial score P1, the partial score P5, and the specific musical symbol A1 may be arbitrarily selected according to the operation of the user on the operation display unit 6.

  When the partial score corresponding to each of the plurality of parts is extracted by the extraction processing unit 54, the aggregation processing unit 55 sets the part for each of the partial scores corresponding to the plurality of extracted parts. A plurality of images representing the corresponding partial score may be integrated into one image. For example, for each of the partial scores corresponding to each of the plurality of parts extracted by the extraction processing unit 54, the aggregation processing unit 55 arranges a plurality of images indicating the partial scores corresponding to the part at the intervals. The aggregated image data may be generated. Also, the aggregation processing unit 55 executes processing for generating the aggregated image data in which a plurality of images indicating the partial score corresponding to each of the plurality of parts extracted by the extraction processing unit 54 are arranged at the intervals. For each of the partial scores corresponding to each of the plurality of parts extracted by the extraction processing unit 54, the aggregation image data in which a plurality of images indicating the partial scores corresponding to the part are arranged at the intervals is generated Depending on the user's operation on the operation display unit 6, whether to execute the process may be switched.

  The output processing unit 56 outputs the aggregated image data generated by the aggregation processing unit 55.

  For example, the output processing unit 56 prints the aggregated image data generated by the aggregation processing unit 55 using the image forming unit 3.

  Further, the output processing unit 56 may store the aggregated image data generated by the aggregation processing unit 55 in the storage unit 7. Further, the output processing unit 56 may transmit the aggregated image data generated by the aggregation processing unit 55 to an external information processing apparatus.

Part consolidation processing
Hereinafter, the procedure of the image processing method in the present invention will be described together with an example of the procedure of the part aggregation process performed by the control unit 5 in the image processing apparatus 10 with reference to FIG. 3. Here, steps S11, S12,... Indicate the numbers of the processing procedures (steps) executed by the control unit 5. The control unit 5 executes the part grouping process when a user's operation of instructing the operation display unit 6 to execute the part grouping process is performed.

<Step S11>
First, in step S11, the control unit 5 acquires the image data of the score. Here, the process of step S11 is executed by the acquisition processing unit 51 of the control unit 5.

  For example, when a document is placed on the document setting unit of the ADF 1, the control unit 5 uses the ADF 1 and the image reading unit 2 to generate an image of the score from the document placed on the document setting unit Read the data Further, when the document is placed on the document table of the image reading unit 2, the control unit 5 uses the image reading unit 2 to generate image data of the score from the document placed on the document table Read For example, in step S11, the control unit 5 acquires the image data D1 of the score shown in FIG.

<Step S12>
In step S12, the control unit 5 detects the partial score corresponding to each of the parts based on the image data of the score obtained in step S11. Here, the process of step S12 is an example of the first step in the present invention, and is executed by the first detection processing unit 52 of the control unit 5.

  For example, the control unit 5 first detects the staff included in the image data of the score based on the image data of the score acquired in step S11. For example, the control unit 5 executes the binarization process on the image data of the score. Then, the control unit 5 detects the staff included in the image data of the score based on the execution result of the binarization processing.

  Next, the control unit 5 detects the name of the part included in the image data of the score based on the image data of the score acquired in step S11. For example, the control unit 5 executes the OCR process on the image data of the score. Then, the control unit 5 detects the name of the part included in the image data of the score based on the execution result of the OCR processing.

  Next, the control unit 5 determines whether the name of the detected part is the special part.

  Next, the control unit 5 specifies the staff corresponding to the name of the detected part. For example, when the control unit 5 determines that the name of the part is not the special part, the five score lines corresponding to the name of the part correspond to the one staff line disposed to the right of the name of the part. Identify as a line. On the other hand, when the control unit 5 determines that the name of the part is the special part, a plurality of the staff arranged on the right of the name of the part corresponds to the five corresponding to the name of the part Identify as a line.

  Then, the control unit 5 specifies an area including the staff identified corresponding to each name of the part as the partial score corresponding to the part. For example, in step S12, the control unit 5 detects the partial scores P1 to P5 shown in FIG.

<Step S13>
In step S13, the control unit 5 detects the specific musical symbol based on the image data of the musical score acquired in step S11. Here, the process of step S13 is executed by the second detection processing unit 53 of the control unit 5. Note that the process of step S13 may be omitted.

  For example, the control unit 5 detects the specific musical symbol from the image data of the musical score, based on the execution result of the OCR processing performed in step S12. For example, in step S13, the control unit 5 detects the specific musical symbol A1 shown in FIG.

<Step S14>
In step S14, the control unit 5 causes the operation display unit 6 to display the selection screen. For example, in step S14, the control unit 5 causes the operation display unit 6 to display the selection screen X1 shown in FIG.

<Step S15>
In step S15, in the selection screen displayed on the operation display unit 6 in step S14, the control unit 5 selects one or more of the partial scores corresponding to the plurality of parts detected in step S12. It is determined whether or not the user's operation of selecting the corresponding partial score has been performed. For example, in step S15, it is determined whether or not the operation key K1 has been operated with the cursor A2 displayed on the selection screen X1 shown in FIG.

  Here, on the selection screen, the control unit 5 performs a user operation of selecting the partial score corresponding to one or more of the parts from the partial score corresponding to each of the plurality of parts detected in step S12. If it is determined that the process has been performed (Yes in S15), the process proceeds to step S16. In addition, if the user's operation to select the partial score corresponding to one or more of the parts from the partial score corresponding to each of the plurality of parts detected in step S12 is not performed (No side of S15) The control unit 5 waits for the user's operation of selecting the partial score corresponding to one or more of the parts in step S15.

<Step S16>
In step S16, the control unit 5 responds to one or more target parts from the partial score corresponding to each of the plurality of parts detected in step S12 according to the user operation performed on the selection screen. Extract the partial score. Here, the processing from step S14 to step S16 is an example of the second step in the present invention, and is executed by the extraction processing unit 54 of the control unit 5. For example, in step S16, the control unit 5 extracts the partial score P5 shown in FIG.

<Step S17>
In step S17, the control unit 5 combines a plurality of images indicating the partial score corresponding to the part extracted in step S16 into one image. Here, the process of step S17 is an example of the third step in the present invention, and is executed by the aggregation processing unit 55 of the control unit 5.

  For example, the control unit 5 generates the aggregated image data in which a plurality of images indicating the partial score corresponding to the part extracted in step S16 are arranged at the intervals.

  Here, the control unit 5 combines a plurality of images indicating the partial score corresponding to the part extracted in step S16 and the specific performance symbol detected in step S13 into one image. Thereby, the specific musical symbols relating to the performance of all the parts included in the score are included in the aggregated image data. Therefore, the user can refer to the specific musical symbol in addition to the part for which he is in charge in the aggregated image data output from the image processing apparatus 10.

  For example, when the partial score P5 shown in FIG. 5 is extracted in step S16, the integrated image data D2 shown in FIG. 6 is generated by the control unit 5 in step S17. Further, when the partial score P1 and the partial score P5 shown in FIG. 5 are extracted in step S16, the integrated image data D3 shown in FIG. 7 is generated by the control unit 5 in step S17. Here, in the consolidated image data D3, the color of the partial score P1 and the color of the partial score P5 are different from each other. This facilitates identification of the partial score P1 and the partial score P5 included in the aggregated image data D3.

<Step S18>
In step S18, the control unit 5 outputs the integrated image data generated in step S17. Here, the process of step S18 is executed by the output processing unit 56 of the control unit 5.

  For example, the control unit 5 uses the image forming unit 3 to print the aggregated image data generated in step S17. For example, in step S18, the consolidated image data D2 or aggregated image data D3 generated in step S17 is printed by the control unit 5.

  When the operation key K2 is operated on the selection screen X1 (see FIG. 5), the control unit 5 may print the image data D1 of the score as it is.

  As described above, in the image processing apparatus 10, the partial score corresponding to each of the parts is detected based on the image data of the score including the plurality of parts, and the partial score corresponding to each of the detected plurality of parts is detected. A plurality of images indicating the partial score corresponding to one or more of the parts extracted from the partial score in response to a user's operation are integrated into one image. Therefore, it is possible to improve the convenience of the score including the plurality of parts.

1 ADF
2 image reading unit 3 image forming unit 4 sheet feeding unit 5 control unit 6 operation display unit 7 storage unit 10 image processing apparatus 51 acquisition processing unit 52 first detection processing unit 53 second detection processing unit 54 extraction processing unit 55 aggregation processing unit 56 Output processing unit

Claims (6)

A first detection processing unit that detects a partial score corresponding to each of the parts based on image data of a score including a plurality of parts;
A plurality of the above selected according to the user's operation of selecting any of the plurality of partial scores on the selection screen by displaying a selection screen including the plurality of partial scores detected by the first detection processing unit. An extraction processing unit that extracts a partial score;
An aggregation processing unit that aggregates a plurality of images indicating the plurality of partial scores extracted by the extraction processing unit into one image;
Equipped with
The first detection processing unit detects the partial score corresponding to each of the parts based on the score included in the score and the name of the part, and the name of the part is not a predetermined special part An area including one of the staff arranged in a specific direction predetermined from the name of the part and not including the other staves is detected as the partial score corresponding to the part, and the name of the part is When it is the special part, it includes the number of the staff corresponding to the part arranged corresponding to the name of the part in the specific direction from the name of the part and does not include the other staves An image processing apparatus that detects an area as the partial score corresponding to the part.   When the extraction processing unit extracts the partial score corresponding to each of the plurality of parts, the aggregation processing unit extracts one of a plurality of images indicating the partial score corresponding to each of the plurality of extracted parts. The image processing apparatus according to claim 1, wherein the image processing apparatus according to claim 1, wherein the partial score corresponding to each of the plurality of extracted parts is changed to a different color while being integrated into one image. And a second detection processing unit that detects a predetermined specific performance symbol from among the performance symbols included in the score based on the image data of the score.
The aggregation processing unit consolidates a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit and the specific performance symbol detected by the second detection processing unit into one image. An image processing apparatus according to claim 1 or 2. An image reading unit that reads image data from a document;
An acquisition processing unit that acquires image data of the score from the document using the image reading unit;
The image processing apparatus according to any one of claims 1 to 3, further comprising: An image forming unit that forms an image based on image data;
An output processing unit that prints the images aggregated by the aggregation processing unit using the image forming unit;
The image processing apparatus according to any one of claims 1 to 4, further comprising: A first step of detecting a partial score corresponding to each of the parts based on image data of a score including a plurality of parts;
A plurality of the partial scores selected according to the user's operation of displaying a selection screen including the plurality of partial scores detected in the first step and selecting any of the plurality of partial scores on the selection screen The second step of extracting
A third step of combining a plurality of images indicating the plurality of partial scores extracted in the second step into one image;
Including
In the first step, the partial score corresponding to each of the parts is detected based on the score included in the score and the name of the part, and if the name of the part is not a predetermined special part An area including one of the staff arranged in a specific direction predetermined from the part name and not including the other staff is detected as the partial score corresponding to the part, and the part name is the special When the part is a part, an area including the number of the staff corresponding to the part arranged in correspondence with the name of the part in the specific direction from the name of the part and not including the other staff An image processing method detected as the partial score corresponding to the part.