JP2017158127A - Image processing apparatus and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing apparatus and an image processing method that can improve convenience of a score including a plurality of parts.SOLUTION: An image processing apparatus comprises: a first detection processing part that detects partial scores P1 to P5 corresponding respectively to a plurality of parts on the basis of image data D1 of a score including the partial scores P1 to P5; an extraction processing part that extracts, from the partial scores P1 to P5 detected by the first detection processing part, partial scores corresponding to one or more parts selected according to a predetermined selection operation; and an integration processing part that integrates a plurality of images showing the partial scores corresponding to the parts extracted by the extraction processing part into one image.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an image processing apparatus and an image processing method.

  In an image processing apparatus such as a copying machine, various types of originals are printed. For example, in this type of image processing apparatus, a musical score document may be printed. An image processing apparatus is known that can add auxiliary symbols to the musical score based on image data read from a musical score manuscript (see Patent Document 1).

JP 2010-220097 A

  By the way, in the image processing apparatus, a musical score document including a plurality of parts such as a musical score of an ensemble may be printed. For example, a user participating in an ensemble may print a musical score manuscript of the ensemble using an image processing device in order to use it for the performance of the part in charge. Here, parts other than the assigned part included in the printed score are often unnecessary for the user. When a part other than the responsible part is unnecessary for the user, the user feels inconvenient to find the responsible part from a plurality of parts included in the printed score.

  An object of the present invention is to provide an image processing apparatus and an image processing method capable of improving the convenience of a score including a plurality of parts.

  An image processing apparatus according to one aspect of the present invention includes a first detection processing unit, an extraction processing unit, and an aggregation processing unit. The first detection processing unit detects a partial score corresponding to each part based on image data of a score including a plurality of parts. The extraction processing unit corresponds to one or a plurality of the parts selected according to a selection operation predetermined from the partial score corresponding to each of the plurality of parts detected by the first detection processing unit. Extract a partial score. The aggregation processing unit aggregates a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit into one image.

  An image processing method according to another aspect of the present invention includes the following first step, second step, and third step. In the first step, a partial score corresponding to each part is detected based on image data of a score including a plurality of parts. In the second step, the partial score corresponding to one or a plurality of the parts selected according to a predetermined selection operation from the partial scores corresponding to each of the plurality of parts detected in the first step. Is extracted. In the third step, a plurality of images indicating the partial score corresponding to the part extracted in the second step are integrated into one image.

  According to the present invention, it is possible to improve the convenience of a score including a plurality of parts.

FIG. 1 is a diagram showing a configuration of an image processing apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram showing a system configuration of the image processing apparatus according to the embodiment of the present invention. FIG. 3 is a flowchart showing an example of part aggregation processing executed by the image processing apparatus according to the embodiment of the present invention. FIG. 4 is a diagram illustrating an example of image data of a score acquired by the image processing apparatus according to the embodiment of the present invention. FIG. 5 is a diagram illustrating an example of a selection screen displayed on the operation display unit of the image processing apparatus according to the embodiment of the present invention. FIG. 6 is a diagram illustrating an example of image data output from the image processing apparatus according to the embodiment of the present invention. FIG. 7 is a diagram illustrating another example of image data output from the image processing apparatus according to the embodiment of the present invention.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. The following embodiment is an example embodying the present invention, and does not limit the technical scope of the present invention.

[Configuration of Image Processing Device 10]
First, the configuration of the image processing apparatus 10 according to the embodiment of the present invention will be described with reference to FIGS. 1 and 2. Here, FIG. 1 is a schematic cross-sectional view showing the configuration of the image processing apparatus 10.

  The image processing apparatus 10 is a multifunction machine having a plurality of functions such as a facsimile function and a copy function, as well as a scan function for reading image data from a document and a print function for forming an image based on the image data. The present invention is also applicable to image processing apparatuses such as scanner apparatuses, printer apparatuses, facsimile apparatuses, copiers, and personal computers.

  As shown in FIGS. 1 and 2, the image processing apparatus 10 includes an ADF (automatic document feeder) 1, an image reading unit 2, an image forming unit 3, a paper feeding unit 4, a control unit 5, an operation display unit 6, And a storage unit 7.

  The ADF 1 includes a document setting unit, a plurality of conveyance rollers, a document pressing unit, and a paper discharge unit, and conveys a document read by the image reading unit 2. The image reading unit 2 includes a document table, a light source, a plurality of mirrors, an optical lens, and a CCD, and can read image data from the document.

  The image forming unit 3 can form a color or monochrome image by electrophotography based on the image data read by the image reading unit 2. The image forming unit 3 can also form an image based on image data input from an information processing apparatus such as an external personal computer. Specifically, the image forming unit 3 includes a plurality of image forming units corresponding to C (cyan), M (magenta), Y (yellow), and K (black), an optical scanning device, an intermediate transfer belt, and a secondary transfer. A roller, a fixing device, and a paper discharge tray are provided. The sheet feeding unit 4 supplies sheets to the image forming unit 3. In the image forming unit 3, a color or monochrome image is formed on the sheet supplied from the paper feeding unit 4, and the sheet after image formation is discharged to the paper discharge tray. The image forming unit 3 may form an image by another image forming method such as an ink jet method.

  The control unit 5 includes control devices such as a CPU, ROM, RAM, and EEPROM (registered trademark) (not shown). The CPU is a processor that executes various arithmetic processes. The ROM is a non-volatile storage medium in which information such as a control program for causing the CPU to execute various processes is stored in advance. The RAM is a volatile storage medium, and the EEPROM is a nonvolatile storage medium. The RAM and the EEPROM are used as a temporary storage memory (working area) for various processes executed by the CPU. In the control unit 5, various control programs stored in advance in the ROM are executed by the CPU. As a result, the image processing apparatus 10 is comprehensively controlled by the control unit 5. The control unit 5 may be an electronic circuit such as an integrated circuit (ASIC), and is a control unit provided separately from the main control unit that comprehensively controls the image processing apparatus 10. May be.

  The operation display unit 6 is a display unit such as a liquid crystal display that displays various types of information in response to control instructions from the control unit 5, and an operation key or touch panel that inputs various types of information to the control unit 5 in response to user operations. And so on.

  The storage unit 7 is a nonvolatile storage medium. For example, the storage unit 7 is a storage medium such as a flash memory, an SSD (solid state drive), or an HDD (hard disk drive).

  The image processing apparatus 10 prints various types of documents. For example, the image processing apparatus 10 may print a musical score document. An image processing apparatus is known that can add auxiliary symbols to a musical score based on image data read from a musical score manuscript.

  By the way, the image processing apparatus 10 may print a musical score original including a plurality of parts such as a musical score of an ensemble. For example, a user participating in an ensemble may print a musical score manuscript of the ensemble using the image processing apparatus 10 in order to use it for the performance of the part in charge. Here, parts other than the assigned part included in the printed score are often unnecessary for the user. When a part other than the responsible part is unnecessary for the user, the user feels inconvenient to find the responsible part from a plurality of parts included in the printed score.

  On the other hand, the image processing apparatus 10 according to the embodiment of the present invention can improve the convenience of a score including a plurality of parts, as will be described below.

  Specifically, the ROM of the control unit 5 stores in advance a part aggregation program for causing the CPU to execute a later-described part aggregation process (see the flowchart of FIG. 3). The part aggregation program may be recorded on a computer-readable recording medium such as a CD, a DVD, or a flash memory, and read from the recording medium and installed in the storage unit 7.

  Then, as shown in FIG. 2, the control unit 5 includes an acquisition processing unit 51, a first detection processing unit 52, a second detection processing unit 53, an extraction processing unit 54, an aggregation processing unit 55, and an output processing unit 56. Including. Specifically, the control unit 5 executes the part aggregation program stored in the ROM using the CPU. Thereby, the control unit 5 functions as an acquisition processing unit 51, a first detection processing unit 52, a second detection processing unit 53, an extraction processing unit 54, an aggregation processing unit 55, and an output processing unit 56.

  The acquisition processing unit 51 acquires image data of a score including a plurality of parts.

  For example, the acquisition processing unit 51 uses the image reading unit 2 to acquire the score image data from the score document. Specifically, when a document is placed on the document setting unit of the ADF 1, the acquisition processing unit 51 uses the ADF 1 and the image reading unit 2 to read the document from the document placed on the document setting unit. Read the image data of the score. In addition, when a document is placed on the document table of the image reading unit 2, the acquisition processing unit 51 uses the image reading unit 2 to image the score from the document placed on the document table. Read data.

  The acquisition processing unit 51 may acquire the image data of the score by receiving the image data of the score transmitted from an external information processing apparatus. The acquisition processing unit 51 reads the image data of the score by reading the image data of the score that is read by the image reading unit 2 or transmitted from an external information processing apparatus and stored in the storage unit 7. You may get it.

  The first detection processing unit 52 detects a partial score corresponding to each of the parts based on the image data of the score acquired by the acquisition processing unit 51.

  For example, the first detection processing unit 52 detects the partial score corresponding to each of the parts based on the staff and the name of the part included in the score. Specifically, the first detection processing unit 52 includes an area including one or more staffs that are specified for each part name depending on whether or not the part name is a predetermined special part. Is detected as the partial score corresponding to the part.

  Here, the special part is the part in which a plurality of the staffs are used for expressing the melody. For example, the number of staffs specified corresponding to the special part is predetermined for each special part. For example, the special part includes a piano. Further, when the special part is a piano, the number of staffs specified corresponding to the special part is two.

  For example, if the name of the part is not the special part, the first detection processing unit 52 sets one of the staffs arranged in a specific direction predetermined from the name of the part as the name of the part. Identify as the corresponding staff. On the other hand, the first detection processing unit 52, when the name of the part is the special part, the plurality of staffs arranged in the specific direction from the name of the part, the corresponding to the name of the part Identify as a staff. For example, the specific direction is below or to the right of the name of the part.

  And the 1st detection process part 52 detects the area | region containing the one or some said staff corresponding to the name of the specified said part as the said partial score corresponding to the said part.

  Here, the procedure for detecting the partial score corresponding to the part by the first detection processing unit 52 will be described with reference to FIG. FIG. 4 shows musical score image data D <b> 1 that is an example of the musical score image data acquired by the acquisition processing unit 51.

  First, the first detection processing unit 52 detects the staffs G11 to G28 included in the musical score image data D1 based on the musical score image data D1 acquired by the acquisition processing unit 51. For example, the first detection processing unit 52 executes binarization processing for binarizing each pixel included in the musical score image data D1 based on a preset threshold value with respect to the musical score image data D1. And the 1st detection process part 52 detects the staff G11-G28 contained in the image data D1 of a score based on the execution result of the said binarization process.

  Next, the first detection processing unit 52 detects part names M1 to M5 included in the musical score image data D1 based on the musical score image data D1 acquired by the acquisition processing unit 51. For example, the first detection processing unit 52 performs OCR (optical character recognition) processing for recognizing characters included in the score image data D1 on the score image data D1. Then, the first detection processing unit 52 detects part names M1 to M5 included in the musical score image data D1 based on the execution result of the OCR process.

  Next, the first detection processing unit 52 determines whether or not the detected part names M1 to M5 are the special parts. For example, the first detection processing unit 52 determines that the part names M1 to M4 are not the special parts. Further, the first detection processing unit 52 determines that the part name M5 is the special part.

  Next, the first detection processing unit 52 specifies the staff corresponding to the detected part names M1 to M5. For example, the first detection processing unit 52 specifies the staff G11, staff G17, and staff G23 arranged to the right of the part name M1 as the staff corresponding to the part name M1. The first detection processing unit 52 identifies the staff G12, staff G18, and staff G24 arranged on the right side of the part name M2 as the staff corresponding to the part name M2. Further, the first detection processing unit 52 specifies the staff G13, staff G19, and staff G25 arranged on the right side of the part name M3 as the staff corresponding to the part name M3. Moreover, the 1st detection process part 52 specifies the staff G14, the staff G20, and the staff G26 arrange | positioned on the right side of the part name M4 as the said staff corresponding to the part name M4. In addition, the first detection processing unit 52 identifies the staff G15 to G16, the staff G21 to G22, and the staff G27 to G28 arranged to the right of the part name M5 as the staff corresponding to the part name M5. To do.

  And the 1st detection process part 52 detects the area | region containing the said staff specified corresponding to each part name M1-M5 as the said partial score corresponding to the said part. For example, the first detection processing unit 52 specifies a region including the staff G11, staff G17, and staff G23 identified corresponding to the part name M1 and the part name M1 as the partial score P1. In addition, the first detection processing unit 52 specifies a region including the staff G12, staff G18, and staff G24 identified corresponding to the part name M2 and the part name M2 as the partial score P2. In addition, the first detection processing unit 52 specifies a region including the staff G13, staff G19, and staff G25 identified corresponding to the part name M3 and the part name M3 as the partial score P3. In addition, the first detection processing unit 52 specifies a region including the staff G14, staff G20, and staff G26 identified corresponding to the part name M4 and the part name M4 as the partial score P4. In addition, the first detection processing unit 52 uses, as a partial score P5, an area including the staff G15 to G16, staff G21 to G22, and staff G27 to G28 specified corresponding to the part name M5 and the part name M5. Identify. In FIG. 4, the partial scores P1 to P5 are indicated by two-dot chain lines.

  Note that the first detection processing unit 52 may detect the partial score corresponding to the part without being based on the staff. For example, the first detection processing unit 52 detects an area specified for each part name according to whether the part name is the special part as the partial score corresponding to the part. Also good.

  The second detection processing unit 53 detects a predetermined specific performance symbol among performance symbols included in the score based on the image data of the score. Here, the specific performance symbol is the performance symbol related to the performance of all the parts included in the score. For example, the specific performance symbol includes a speed symbol and an idea symbol.

  For example, the second detection processing unit 53 detects the specific performance symbol based on the execution result of the OCR process executed by the first detection processing unit 52. For example, the second detection processing unit 53 detects the specific performance symbol A1 from the musical score image data D1 shown in FIG.

  The extraction processing unit 54 corresponds to one or a plurality of the parts selected according to a predetermined selection operation from the partial score corresponding to each of the plurality of parts detected by the first detection processing unit 52. Extract a partial score.

  For example, the extraction processing unit 54 causes the operation display unit 6 to display a selection screen used for selecting the partial score corresponding to the part detected by the first detection processing unit 52. Then, the extraction processing unit 54 corresponds to one or a plurality of the parts from the partial score corresponding to each of the plurality of parts detected by the first detection processing unit 52 in accordance with a user operation on the selection screen. The partial score is extracted. Here, the user operation on the selection screen is an example of a predetermined selection operation in the present invention.

  FIG. 5 shows an example of the selection screen displayed on the operation display unit 6 by the extraction processing unit 54. The selection screen X1 shown in FIG. 5 includes a display area R1 and operation keys K1 to K2. In the display area R1, musical score image data D1 is displayed. The user can select the partial score corresponding to one or a plurality of the parts from the score image data D1 displayed in the display area R1 on the selection screen X1. For example, the user can select the partial score corresponding to the part by performing a touch operation on the partial score display area corresponding to the desired part on the selection screen X1. For example, when the user performs a touch operation on the display area of the partial score P5 on the selection screen X1, the extraction processing unit 54 displays a cursor A2 indicating that the partial score P5 is selected in the display area R1. When the user performs a touch operation on the operation key K1 while the cursor A2 is displayed in the display area R1, the extraction processing unit 54 extracts the partial score P5. On the other hand, when the user performs a touch operation on the operation key K2, the extraction processing unit 54 does not extract the partial score corresponding to the part. In FIG. 5, the cursor A2 is indicated by a two-dot chain line.

  The aggregation processing unit 55 aggregates a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit 54 into one image.

  In addition, the aggregation processing unit 55 combines the plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit 54 and the specific performance symbol detected by the second detection processing unit 53 into one image. Summarize.

  For example, the aggregation processing unit 55 includes a plurality of images that include the specific performance symbol detected by the second detection processing unit 53 and indicate the partial score corresponding to the part extracted by the extraction processing unit 54. Aggregated image data arranged at regular intervals is generated. The interval may be arbitrarily set according to a user operation on the operation display unit 6.

  For example, when the partial score P5 is selected on the selection screen X1 shown in FIG. 5, the aggregation processing unit 55 includes staffs G15 to G16 (see FIG. 4) including the specific performance symbol A1 and indicating the partial score P5. The aggregated image data D2 shown in FIG. 6 is generated in which the image including the image including the staff G21 to G22 and the image including the staff G27 to G28 are arranged at the intervals.

  In addition, when the partial score corresponding to each of the plurality of parts is extracted by the extraction processing unit 54, the aggregation processing unit 55 includes a plurality of images indicating the partial score corresponding to each of the plurality of extracted parts. Are combined into one image. For example, the aggregation processing unit 55 generates the aggregated image data in which a plurality of images indicating the partial score corresponding to each of the plurality of parts extracted by the extraction processing unit 54 are arranged at the intervals.

  In addition, when the partial score corresponding to each of the plurality of parts is extracted by the extraction processing unit 54, the aggregation processing unit 55 includes a plurality of images indicating the partial score corresponding to each of the plurality of extracted parts. Are integrated into one image, and the color of the partial score corresponding to each of the extracted parts is changed to a different color. For example, the aggregation processing unit 55 changes the color of the partial score corresponding to each part in the aggregated image data to different colors.

  For example, when the partial score P1 and the partial score P5 are selected on the selection screen X1 shown in FIG. 5, the aggregation processing unit 55 includes an image including the specific performance symbol A1 and the staff G11 indicating the partial score P1, The image including the staff G17, the image including the staff G23, the image including the staff G15 to G16 indicating the partial score P5, the image including the staff G21 to G22, and the image including the staff G27 to G28 are described above. Aggregated image data D3 shown in FIG. 7 arranged at intervals is generated. For example, as shown in FIG. 7, the aggregation processing unit 55 generates aggregated image data D3 in which an image showing the partial score P1 and an image showing the partial score P5 are alternately arranged. Further, the aggregation processing unit 55 changes the color of the partial score P1 and the color of the partial score P5 to different colors in the aggregated image data D3. Further, the aggregation processing unit 55 changes the color of the specific performance symbol A1 to the same color as the color of the partial score P1 in the aggregated image data D3. The aggregation processing unit 55 may generate the aggregated image data in which a plurality of images showing the partial score P5 are arranged after a plurality of images showing the partial score P1 are arranged. In the aggregated image data D3, the color of each of the partial score P1, the partial score P5, and the specific performance symbol A1 may be arbitrarily selected according to a user operation on the operation display unit 6.

  When the partial score corresponding to each of the plurality of parts is extracted by the extraction processing unit 54, the aggregation processing unit 55 adds the partial score corresponding to each of the extracted plurality of parts to the part. A plurality of images showing the corresponding partial scores may be integrated into one image. For example, for the partial score corresponding to each of the plurality of parts extracted by the extraction processing unit 54, the aggregation processing unit 55 includes a plurality of images indicating the partial score corresponding to the part arranged at the interval. The aggregated image data may be generated. In addition, the aggregation processing unit 55 executes a process of generating the aggregated image data in which a plurality of images indicating the partial score corresponding to each of the plurality of parts extracted by the extraction processing unit 54 are arranged at the intervals. Alternatively, for each partial score corresponding to each of the plurality of parts extracted by the extraction processing unit 54, the aggregated image data in which a plurality of images indicating the partial scores corresponding to the part are arranged at the intervals is generated. Whether to perform the processing to be performed may be switched according to a user operation on the operation display unit 6.

  The output processing unit 56 outputs the aggregated image data generated by the aggregation processing unit 55.

  For example, the output processing unit 56 prints the aggregated image data generated by the aggregation processing unit 55 using the image forming unit 3.

  The output processing unit 56 may store the aggregated image data generated by the aggregation processing unit 55 in the storage unit 7. Further, the output processing unit 56 may transmit the aggregated image data generated by the aggregation processing unit 55 to an external information processing apparatus.

[Parts aggregation processing]
Hereinafter, the procedure of the image processing method according to the present invention will be described together with an example of the procedure of part aggregation processing executed by the control unit 5 in the image processing apparatus 10 with reference to FIG. Here, steps S11, S12,... Represent the numbers of processing procedures (steps) executed by the control unit 5. The control unit 5 executes the part aggregation process when a user operation is performed to instruct the operation display unit 6 to execute the part aggregation process.

<Step S11>
First, in step S11, the control unit 5 acquires image data of the score. Here, the process of step S <b> 11 is executed by the acquisition processing unit 51 of the control unit 5.

  For example, when a document is placed on the document set unit of the ADF 1, the control unit 5 uses the ADF 1 and the image reading unit 2 to image the score from the document placed on the document set unit. Read data. In addition, when a document is placed on the document table of the image reading unit 2, the control unit 5 uses the image reading unit 2 to convert the image data of the score from the document placed on the document table. Read. For example, in step S11, the image data D1 of the musical score shown in FIG.

<Step S12>
In step S12, the control unit 5 detects the partial score corresponding to each of the parts based on the image data of the score acquired in step S11. Here, the process of step S12 is an example of the first step in the present invention, and is executed by the first detection processing unit 52 of the control unit 5.

  For example, the control unit 5 first detects the staff included in the musical score image data based on the musical score image data acquired in step S11. For example, the control unit 5 executes the binarization process on the musical score image data. And the control part 5 detects the said staff included in the image data of the said score based on the execution result of the said binarization process.

  Next, the control unit 5 detects the name of the part included in the image data of the score based on the image data of the score acquired in step S11. For example, the control unit 5 performs the OCR process on the musical score image data. And the control part 5 detects the name of the said part contained in the image data of the said score based on the execution result of the said OCR process.

  Next, the control unit 5 determines whether or not the name of the detected part is the special part.

  Next, the control unit 5 identifies the staff corresponding to the detected name of the part. For example, when the control unit 5 determines that the name of the part is not the special part, the control unit 5 sets one of the staffs arranged to the right of the name of the part to the name of the part corresponding to the name of the part. Identifies as a line. On the other hand, when the control unit 5 determines that the name of the part is the special part, a plurality of staffs arranged on the right side of the name of the part are displayed as the five corresponding to the name of the part. Identifies as a line.

  And the control part 5 specifies the area | region containing the said staff specified corresponding to each name of the said part as the said partial score corresponding to the said part. For example, in step S12, the partial score P1 to P5 shown in FIG.

<Step S13>
In step S13, the control unit 5 detects the specific performance symbol based on the image data of the musical score acquired in step S11. Here, the process of step S <b> 13 is executed by the second detection processing unit 53 of the control unit 5. Note that the process of step S13 may be omitted.

  For example, the control unit 5 detects the specific performance symbol from the image data of the score based on the execution result of the OCR process executed in step S12. For example, in step S13, the specific performance symbol A1 shown in FIG.

<Step S14>
In step S <b> 14, the control unit 5 causes the operation display unit 6 to display the selection screen. For example, in step S <b> 14, the selection screen X <b> 1 shown in FIG. 5 is displayed on the operation display unit 6 by the control unit 5.

<Step S15>
In step S15, the control unit 5 changes the partial score corresponding to each of the plurality of parts detected in step S12 to one or a plurality of the parts on the selection screen displayed on the operation display unit 6 in step S14. It is determined whether or not a user operation for selecting the corresponding partial score has been performed. For example, in step S15, it is determined whether or not the operation key K1 has been operated with the cursor A2 displayed on the selection screen X1 shown in FIG.

  Here, the control unit 5 performs, on the selection screen, a user operation to select the partial score corresponding to one or a plurality of the parts from the partial score corresponding to each of the plurality of parts detected in step S12. If it is determined that the process has been performed (Yes in S15), the process proceeds to step S16. Further, if the user does not perform an operation to select the partial score corresponding to one or a plurality of the parts from the partial scores corresponding to the plurality of parts detected in step S12 (No side in S15). In step S15, the control unit 5 waits for a user operation to select the partial score corresponding to one or more of the parts.

<Step S16>
In step S <b> 16, the control unit 5 responds to one or a plurality of the target parts from the partial score corresponding to each of the plurality of parts detected in step S <b> 12 according to a user operation performed on the selection screen. The partial score is extracted. Here, the processing from step S14 to step S16 is an example of the second step in the present invention, and is executed by the extraction processing unit 54 of the control unit 5. For example, in step S16, the partial score P5 shown in FIG.

<Step S17>
In step S17, the control unit 5 aggregates a plurality of images indicating the partial score corresponding to the part extracted in step S16 into one image. Here, the process of step S17 is an example of a third step in the present invention, and is executed by the aggregation processing unit 55 of the control unit 5.

  For example, the control unit 5 generates the aggregated image data in which a plurality of images indicating the partial score corresponding to the part extracted in step S16 are arranged at the intervals.

  Here, the control unit 5 aggregates a plurality of images indicating the partial score corresponding to the part extracted in step S16 and the specific performance symbols detected in step S13 into one image. As a result, the specific performance symbols relating to the performance of all the parts included in the score are included in the aggregated image data. Therefore, in the aggregated image data output from the image processing apparatus 10, the user can refer to the specific performance symbol in addition to the part that he / she is in charge of.

  For example, when the partial score P5 shown in FIG. 5 is extracted in step S16, the aggregated image data D2 shown in FIG. 6 is generated by the control unit 5 in step S17. If the partial score P1 and the partial score P5 shown in FIG. 5 are extracted in step S16, the aggregated image data D3 shown in FIG. 7 is generated by the control unit 5 in step S17. Here, in the aggregated image data D3, the color of the partial score P1 and the color of the partial score P5 are different from each other. This facilitates identification of the partial score P1 and the partial score P5 included in the aggregated image data D3.

<Step S18>
In step S18, the control unit 5 outputs the aggregated image data generated in step S17. Here, the process of step S <b> 18 is executed by the output processing unit 56 of the control unit 5.

  For example, the control unit 5 prints the aggregated image data generated in step S <b> 17 using the image forming unit 3. For example, in step S18, the aggregated image data D2 or the aggregated image data D3 generated in step S17 by the control unit 5 is printed.

  When the operation key K2 is operated on the selection screen X1 (see FIG. 5), the control unit 5 may print the score image data D1 as it is.

  Thus, in the image processing apparatus 10, the partial score corresponding to each of the parts is detected based on the image data of the score including the plurality of parts, and the plurality of parts corresponding to the detected plurality of parts are detected. A plurality of images showing the partial score corresponding to one or a plurality of the parts extracted from the partial score in accordance with the user's operation are collected into one image. Therefore, it is possible to improve the convenience of the score including a plurality of parts.

1 ADF
2 Image reading unit 3 Image forming unit 4 Paper feeding unit 5 Control unit 6 Operation display unit 7 Storage unit 10 Image processing device 51 Acquisition processing unit 52 First detection processing unit 53 Second detection processing unit 54 Extraction processing unit 55 Aggregation processing unit 56 Output processor

Claims (9)

A first detection processing unit for detecting a partial score corresponding to each of the parts based on image data of a score including a plurality of parts;
Extraction that extracts the partial score corresponding to one or a plurality of the parts selected in accordance with a predetermined selection operation from the partial score corresponding to each of the plurality of parts detected by the first detection processing unit A processing unit;
An aggregation processing unit that aggregates a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit into one image;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the first detection processing unit detects the partial score corresponding to each of the parts based on a staff and a name of the part included in the score.   When the partial score corresponding to each of the plurality of parts is extracted by the extraction processing unit, the aggregation processing unit corresponds to the part for each partial score corresponding to each of the plurality of extracted parts. The image processing apparatus according to claim 1, wherein a plurality of images representing the partial score are collected into one image.   When the partial score corresponding to each of the plurality of parts is extracted by the extraction processing unit, the aggregation processing unit sets a plurality of images indicating the partial score corresponding to each of the extracted plurality of parts. The image processing apparatus according to claim 1, wherein the image processing apparatus aggregates the images into one image.   When the partial score corresponding to each of the plurality of parts is extracted by the extraction processing unit, the aggregation processing unit sets a plurality of images indicating the partial score corresponding to each of the extracted plurality of parts. The image processing apparatus according to claim 4, wherein the image processing apparatus aggregates the images into one image and changes the color of the partial score corresponding to each of the extracted parts to a different color. A second detection processing unit for detecting a predetermined specific performance symbol among performance symbols included in the score based on image data of the score;
The aggregation processing unit aggregates a plurality of images indicating the partial score corresponding to the part extracted by the extraction processing unit and the specific performance symbols detected by the second detection processing unit into one image. Item 6. The image processing apparatus according to any one of Items 1 to 5. An image reading unit for reading image data from a document;
An acquisition processing unit for acquiring image data of the musical score from the document using the image reading unit;
The image processing apparatus according to claim 1, further comprising: An image forming unit that forms an image based on the image data;
An output processing unit that prints an image aggregated by the aggregation processing unit using the image forming unit;
The image processing apparatus according to claim 1, further comprising: A first step of detecting a partial score corresponding to each of the parts based on image data of a score including a plurality of parts;
A second step of extracting the partial score corresponding to one or a plurality of the parts selected in accordance with a predetermined selection operation from the partial score corresponding to each of the plurality of parts detected in the first step; When,
A third step of aggregating a plurality of images indicating the partial score corresponding to the part extracted in the second step into one image;
An image processing method including: